Instructions to use florath/CoqLLM-FineTuned-Experiment-Gen0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use florath/CoqLLM-FineTuned-Experiment-Gen0 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1") model = PeftModel.from_pretrained(base_model, "florath/CoqLLM-FineTuned-Experiment-Gen0") - Notebooks
- Google Colab
- Kaggle
Added missing tokenizer line
Browse files
README.md
CHANGED
|
@@ -112,6 +112,8 @@ ft_model = PeftModel.from_pretrained(
|
|
| 112 |
|
| 113 |
eval_prompt = "Lemma plus_n_O : forall n:nat, n = n + 0."
|
| 114 |
|
|
|
|
|
|
|
| 115 |
ft_model.eval()
|
| 116 |
with torch.no_grad():
|
| 117 |
|
|
|
|
| 112 |
|
| 113 |
eval_prompt = "Lemma plus_n_O : forall n:nat, n = n + 0."
|
| 114 |
|
| 115 |
+
model_input = eval_tokenizer(eval_prompt, return_tensors="pt").to("cuda")
|
| 116 |
+
|
| 117 |
ft_model.eval()
|
| 118 |
with torch.no_grad():
|
| 119 |
|