Hugging Face's logo

hiuman
/
vi-gemma-2b-RAG-awq-quantization

Text Generation
Transformers
Safetensors
gemma
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
 Community
vi-gemma-2b-RAG-awq-quantization
File size: 90 Bytes
ece0d5a
 
 
 
 
 
1
2
3
4
5
6
{
    "zero_point": true,
    "q_group_size": 128,
    "w_bit": 4,
    "version": "GEMM"
}