azma-OpenHermes-2.5-Mistral-7B-agent-v1

README.md

@@ -1,11 +1,11 @@
 ---
-license: other
+license: apache-2.0
 library_name: peft
 tags:
 - trl
 - sft
 - generated_from_trainer
-base_model: deepseek-ai/deepseek-coder-1.3b-instruct
+base_model: teknium/OpenHermes-2.5-Mistral-7B
 model-index:
 - name: results
   results: []
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # results
 
-This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-instruct](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-instruct) on the None dataset.
+This model is a fine-tuned version of [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) on the None dataset.
 
 ## Model description
 
@@ -36,10 +36,10 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 4
-- eval_batch_size: 4
+- train_batch_size: 2
+- eval_batch_size: 2
 - seed: 42
-- gradient_accumulation_steps: 2
+- gradient_accumulation_steps: 4
 - total_train_batch_size: 8
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:868e618f88134d6eeb82f017200eebe19d9eed73faacf59d9f24a643787abb67
+oid sha256:a27886c0f7303783f3839d529b8c52466fb87acf68a9d1fe9ff96bff644ef538
 size 637592768