Instructions to use florath/CoqLLM-FineTuned-Experiment-Gen0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use florath/CoqLLM-FineTuned-Experiment-Gen0 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-v0.1") model = PeftModel.from_pretrained(base_model, "florath/CoqLLM-FineTuned-Experiment-Gen0") - Notebooks
- Google Colab
- Kaggle
Question about dataset and training
#1
by vvvu - opened
The dataset is split into facts and props/proofs. How did was each training example constructed? Was all the facts for a particular file added to context, and then the associated prop/proof? Was the facts even used during training?
vvvu changed discussion title from Dataset used to Question about dataset and training
Both parts (facts and props/poofs) were used during fine-tuning.
The used format of the data:
### Context: Filename: {filename} Imports {imports}
{proposition}
{proof}
and
### Context: Filename: {filename} Imports {imports}
{fact}