Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
QuantTrio
/
sarvam-105b-AWQ
like
1
Follow
QuantTrio
348
Text Generation
Safetensors
sarvam_mla
awq
vllm
conversational
custom_code
compressed-tensors
Model card
Files
Files and versions
xet
Community
1
main
sarvam-105b-AWQ
75.1 GB
Ctrl+K
Ctrl+K
1 contributor
History:
4 commits
JunHowie
Update README.md
851e587
verified
2 months ago
.ipynb_checkpoints
Add files using upload-large-folder tool
2 months ago
.gitattributes
Safe
1.57 kB
Add files using upload-large-folder tool
2 months ago
README.md
1.43 kB
Update README.md
2 months ago
chat_template.jinja
Safe
3.14 kB
Add files using upload-large-folder tool
2 months ago
config.json
8.35 kB
Add files using upload-large-folder tool
2 months ago
configuration_sarvam_moe.py
Safe
5.43 kB
Add files using upload-large-folder tool
2 months ago
generation_config.json
Safe
112 Bytes
Add files using upload-large-folder tool
2 months ago
hotpatch_vllm.py
Safe
3.36 kB
Add files using upload-large-folder tool
2 months ago
model-00001-of-00016.safetensors
Safe
4.94 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00002-of-00016.safetensors
4.99 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00003-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00004-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00005-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00006-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00007-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00008-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00009-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00010-of-00016.safetensors
4.98 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00011-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00012-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00013-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00014-of-00016.safetensors
5 GB
xet
Add files using upload-large-folder tool
2 months ago
model-00015-of-00016.safetensors
849 MB
xet
Add files using upload-large-folder tool
2 months ago
model-00016-of-00016.safetensors
Safe
4.29 GB
xet
Add files using upload-large-folder tool
2 months ago
model.safetensors.index.json
3.5 MB
Add files using upload-large-folder tool
2 months ago
modeling_sarvam_moe.py
Safe
41.1 kB
Add files using upload-large-folder tool
2 months ago
recipe.yaml
974 Bytes
Add files using upload-large-folder tool
2 months ago
sarvam.py
Safe
28.3 kB
Add files using upload-large-folder tool
2 months ago
special_tokens_map.json
Safe
680 Bytes
Add files using upload-large-folder tool
2 months ago
tokenizer.json
33.6 MB
xet
Add files using upload-large-folder tool
2 months ago
tokenizer_config.json
Safe
1.16 MB
Add files using upload-large-folder tool
2 months ago