Hugging Face's logo

solidrust
/
bagel-7b-v0.4-AWQ

Text Generation
Transformers
Safetensors
PyTorch
English
mistral
finetuned
quantized
4-bit precision
AWQ
instruct
conversational
text-generation-inference
finetune
chatml
RLHF
gpt4
synthetic data
distillation
awq
Model card Files
xet
Community
1
bagel-7b-v0.4-AWQ / quant_config.json

Commit History

Add missing quant config
1bf5ba1
verified

Suparious commited on

Create quant_config.json
530073f
verified

Suparious commited on