Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
sh0ck0r
/
qwen2.5-coder-32b-FP8-Dynamic
like
0
Text Generation
Transformers
Safetensors
qwen2
fp8
vllm
compressed-tensors
quantized
llmcompressor
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
qwen2.5-coder-32b-FP8-Dynamic
34.3 GB
1 contributor
History:
2 commits
sh0ck0r
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
83e442d
verified
3 days ago
.gitattributes
1.57 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
README.md
3.67 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
added_tokens.json
605 Bytes
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
chat_template.jinja
2.51 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
config.json
3.29 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
generation_config.json
243 Bytes
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
merges.txt
1.67 MB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00001-of-00007.safetensors
5 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00002-of-00007.safetensors
4.91 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00003-of-00007.safetensors
4.88 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00004-of-00007.safetensors
4.88 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00005-of-00007.safetensors
4.88 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00006-of-00007.safetensors
4.88 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model-00007-of-00007.safetensors
4.91 GB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
model.safetensors.index.json
102 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
recipe.yaml
136 Bytes
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
special_tokens_map.json
613 Bytes
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
tokenizer.json
11.4 MB
xet
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
tokenizer_config.json
4.69 kB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
vocab.json
2.78 MB
Upload FP8 quantized version of Qwen/Qwen2.5-Coder-32B-Instruct
3 days ago
