sahil2801/CodeAlpaca-20k
Viewer • Updated • 20k • 24k • 236
How to use XeroCodes/lynx-8b with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("unsloth/meta-llama-3.1-8b-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "XeroCodes/lynx-8b")Lynx-8B is a fine-tuned language model based on Meta's LLaMA-3.1-8B, specifically optimized to be an exceptional coding assistant. This model has been fine-tuned using the CodeAlpaca-20k dataset, which enhances its capability to understand and generate code across various programming languages and scenarios.
Lynx-8B leverages the robust foundation of the Meta-Llama-3.1-8B-Instruct model and fine-tunes it with the comprehensive CodeAlpaca-20k dataset. This results in a model that excels in coding tasks, offering precise and context-aware code suggestions, completions, and explanations.