Hugging Face's logo

TeeZee
/
falcon-180B-chat-AWQ

Text Generation
Transformers
Safetensors
falcon
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community

Falcon 180B Chat - AWQ

Description

This repo contains AWQ model files for Technology Innovation Institute's Falcon 180B Chat. with correct chat template inside tokenizer_config.json

Contact

falconllm@tii.ae

Downloads last month
39
Safetensors
Model size
180B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for TeeZee/falcon-180B-chat-AWQ

Base model

tiiuae/falcon-180B-chat
Quantized
(5)
this model

Dataset used to train TeeZee/falcon-180B-chat-AWQ