jbb/coq_code
Viewer • Updated • 22.3k • 17 • 2
How to use jbb/llama_coq with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("codellama/CodeLlama-7b-hf")
model = PeftModel.from_pretrained(base_model, "jbb/llama_coq")For generating code for mathematical formalization.
codellama/CodeLlama-7b-hf jbb/coq_code
peft
https://wandb.ai/jaeson/coq-coder/reports/peft-llama-coq--Vmlldzo2MzY1NzYy
https://wandb.ai/jaeson/coq-coder/runs/slare690?workspace=user-jaeson
Base model
codellama/CodeLlama-7b-hf