How to use from the
Use from the
Transformers library
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("detoxioai/qwen-goat-0.5b-4bit-instruct", dtype="auto")
Quick Links

Uploaded model

  • Developed by: detoxioai
  • License: apache-2.0
  • Finetuned from model : unsloth/qwen2.5-0.5b-instruct-bnb-4bit

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support