Instructions to use jmeadows17/DerivationGeneration8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use jmeadows17/DerivationGeneration8B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("unsloth/Meta-Llama-3.1-8B-bnb-4bit") model = PeftModel.from_pretrained(base_model, "jmeadows17/DerivationGeneration8B") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -9,7 +9,7 @@ DerivationGeneration8B is a QLoRA fine-tuned from a quantised LLaMa-3.1-8B check
|
|
| 9 |
|
| 10 |
**How to use**
|
| 11 |
|
| 12 |
-
A notebook for inference is available [here](https://github.com/jmeadows17/deriving-equations-with-LLMs/blob/main/llama_evaluation.ipynb).
|
| 13 |
|
| 14 |
**Example prompt**
|
| 15 |
|
|
|
|
| 9 |
|
| 10 |
**How to use**
|
| 11 |
|
| 12 |
+
A notebook for inference is available [here](https://github.com/jmeadows17/deriving-equations-with-LLMs/blob/main/llama_evaluation.ipynb). The model was exposed to prompts through the chatml template (all in the notebook).
|
| 13 |
|
| 14 |
**Example prompt**
|
| 15 |
|