Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ayush7
/
sarvam-m_fp4
like
0
Text Generation
Transformers
Safetensors
mistral
conversational
text-generation-inference
4-bit precision
bitsandbytes
arxiv:
1910.09700
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
sarvam-m_fp4
/
generation_config.json
ayush7
Upload MistralForCausalLM
3a5c3c2
verified
8 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
133 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"transformers_version"
:
"4.51.3"
,
"use_cache"
:
false
}