How to use detoxioai/qwen-goat-0.5b-4bit-instruct with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("detoxioai/qwen-goat-0.5b-4bit-instruct", device_map="auto")
The community tab is the place to discuss and collaborate with the HF community!
