LoRA fine-tuned adapters
Collection
Adding lora adapters of apple/OPEN-ELM 450 M base model fine-tuned on specific datasets around STEM/coding tasks. • 4 items • Updated
How to use solarpunkin/OpenELM-450M-gsm8k-LoRA with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("path-to-your-project/models/openelm-450m")
model = PeftModel.from_pretrained(base_model, "solarpunkin/OpenELM-450M-gsm8k-LoRA")How to use solarpunkin/OpenELM-450M-gsm8k-LoRA with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("solarpunkin/OpenELM-450M-gsm8k-LoRA", dtype="auto")apple/OpenELM-450Mfrom transformers import AutoModelForCausalLM, AutoTokenizer
base_model = AutoModelForCausalLM.from_pretrained("apple/OpenELM-450M")
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neo-125M")
Base model
apple/OpenELM-450M