How to use from the
Use from the
Transformers library
# Load model directly
from transformers import AutoTokenizer, PeftModelForSeq2SeqLM

tokenizer = AutoTokenizer.from_pretrained("maxmnd/fine_tuned")
model = PeftModelForSeq2SeqLM.from_pretrained("maxmnd/fine_tuned", device_map="auto")
Quick Links

Uploaded model

  • Developed by: maxmnd
  • License: apache-2.0
  • Finetuned from model : unsloth/meta-llama-3.1-8b-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support