jbb/coq_code
Viewer โข Updated โข 22.3k โข 32 โข 2
How to use jbb/llama_coq with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("codellama/CodeLlama-7b-hf")
model = PeftModel.from_pretrained(base_model, "jbb/llama_coq")For generating code for mathematical formalization.
codellama/CodeLlama-7b-hf jbb/coq_code
peft
https://wandb.ai/jaeson/coq-coder/reports/peft-llama-coq--Vmlldzo2MzY1NzYy
https://wandb.ai/jaeson/coq-coder/runs/slare690?workspace=user-jaeson
Base model
codellama/CodeLlama-7b-hf