Statuo
/

Mistral-Nemo-Instruct-2407-EXL2-4bpw

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Statuo commited on Aug 1, 2024

Commit

ca1d27e

·

verified ·

1 Parent(s): 175f794

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ extra_gated_description: If you want to learn more about how we process your per
 # Model Card for Mistral-Nemo-Instruct-2407
-[This is the **6bpw** EXL2 Quant of the Update for Mistral Nemo as of 07/31. Find the original model here.](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407)
 Not sure how much this differs from the unsloth version (it didn't look like Unsloth had theirs updated yet so I've quanted the one produced my Mistral here). Commits indicate a chat template was fixed and some fixes to the eos token/clean_up_tokenization_spaces. So if you had issues with Nemo previously, this may fix some of this. May.
 <br>

 # Model Card for Mistral-Nemo-Instruct-2407
+[This is the **4bpw** EXL2 Quant of the Update for Mistral Nemo as of 07/31. Find the original model here.](https://huggingface.co/mistralai/Mistral-Nemo-Instruct-2407)
 Not sure how much this differs from the unsloth version (it didn't look like Unsloth had theirs updated yet so I've quanted the one produced my Mistral here). Commits indicate a chat template was fixed and some fixes to the eos token/clean_up_tokenization_spaces. So if you had issues with Nemo previously, this may fix some of this. May.
 <br>