inference-optimization
/

sarvam-30b-NVFP4

Text Generation

8-bit precision

compressed-tensors

Model card Files Files and versions

sarvam-30b-NVFP4

25.5 GB

Ctrl+K

Ctrl+K

2 contributors

History: 3 commits

ThatCultivator's picture

Create README.md

5d8c4fe verified 3 months ago

.gitattributes

1.57 kB
Upload folder using huggingface_hub 3 months ago
README.md

71 Bytes
Create README.md 3 months ago
chat_template.jinja

3.14 kB
Upload folder using huggingface_hub 3 months ago
config.json

2.81 kB
Upload folder using huggingface_hub 3 months ago
configuration_sarvam_moe.py

3.96 kB
Upload folder using huggingface_hub 3 months ago
generation_config.json

112 Bytes
Upload folder using huggingface_hub 3 months ago
model-00001-of-00006.safetensors

5 GB
xet

Upload folder using huggingface_hub 3 months ago
model-00002-of-00006.safetensors

5 GB
xet

Upload folder using huggingface_hub 3 months ago
model-00003-of-00006.safetensors

5 GB
xet

Upload folder using huggingface_hub 3 months ago
model-00004-of-00006.safetensors

5 GB
xet

Upload folder using huggingface_hub 3 months ago
model-00005-of-00006.safetensors

1.21 GB
xet

Upload folder using huggingface_hub 3 months ago
model-00006-of-00006.safetensors

4.29 GB
xet

Upload folder using huggingface_hub 3 months ago
model.safetensors.index.json

2.8 MB
Upload folder using huggingface_hub 3 months ago
modeling_sarvam_moe.py

44.8 kB
Upload folder using huggingface_hub 3 months ago
recipe.yaml

170 Bytes
Upload folder using huggingface_hub 3 months ago
special_tokens_map.json

680 Bytes
Upload folder using huggingface_hub 3 months ago
tokenizer.json

33.6 MB
xet

Upload folder using huggingface_hub 3 months ago
tokenizer_config.json

1.16 MB
Upload folder using huggingface_hub 3 months ago