monsterapi
/

mistral_7b_norobots

Model card Files Files and versions

souvik0306 commited on Nov 28, 2023

Commit

996fab4

·

1 Parent(s): 44cd309

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -36,7 +36,7 @@ With the utilization of [MonsterAPI](https://monsterapi.ai)'s [LLM finetuner](ht
 - **Model Path:** mistralai/Mistral-7B-v0.1
 - **Learning Rate:** 0.0002
 - **Data Split:** 100% train
-- **Gradient Accumulation Steps:** 4
 - **lora r:** 32
 - **lora alpha:** 64

 - **Model Path:** mistralai/Mistral-7B-v0.1
 - **Learning Rate:** 0.0002
 - **Data Split:** 100% train
+- **Gradient Accumulation Steps:** 64
 - **lora r:** 32
 - **lora alpha:** 64