Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Sumitc13
/
sarvam-30b-GGUF
like
3
GGUF
llama-cpp
Mixture of Experts
sarvam
quantized
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
main
sarvam-30b-GGUF
145 GB
1 contributor
History:
8 commits
Sumitc13
Upload sarvam-30B-Q8_0.gguf with huggingface_hub
6a90b49
verified
4 days ago
.gitattributes
1.75 kB
Upload sarvam-30B-Q8_0.gguf with huggingface_hub
4 days ago
README.md
2.55 kB
Upload README.md with huggingface_hub
4 days ago
sarvam-30B-Q4_K_M.gguf
19.6 GB
xet
Upload sarvam-30B-Q4_K_M.gguf with huggingface_hub
4 days ago
sarvam-30B-Q6_K.gguf
26.4 GB
xet
Upload sarvam-30B-Q6_K.gguf with huggingface_hub
4 days ago
sarvam-30B-Q8_0.gguf
34.2 GB
xet
Upload sarvam-30B-Q8_0.gguf with huggingface_hub
4 days ago
sarvam-30B-full-BF16.gguf
64.3 GB
xet
Upload sarvam-30B-full-BF16.gguf with huggingface_hub
4 days ago
