Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
like
2
Follow
Red Hat AI
1.76k
Text Generation
Transformers
Safetensors
llama
deepseek
int8
vllm
llmcompressor
conversational
text-generation-inference
8-bit precision
compressed-tensors
arxiv:
2210.17323
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Commit History
Add reasoning evals
2fb57dc
verified
nm-research
commited on
Feb 27, 2025
Update README.md
9037a40
verified
nm-research
commited on
Feb 25, 2025
update tokenizer configs
1e8c6bc
nm-research
commited on
Feb 22, 2025
Update README.md
d03570d
verified
nm-research
commited on
Feb 20, 2025
Update README.md
46cdd00
verified
nm-research
commited on
Feb 20, 2025
Update README.md
49529f0
verified
nm-research
commited on
Feb 19, 2025
Update README.md
81dc57c
verified
nm-research
commited on
Feb 12, 2025
Update README.md
8b2e640
verified
nm-research
commited on
Feb 11, 2025
Create README.md
0c1ec85
verified
nm-research
commited on
Feb 11, 2025
Upload folder using huggingface_hub
6461fb3
verified
nm-research
commited on
Feb 4, 2025
initial commit
b2d55b3
verified
nm-research
commited on
Feb 4, 2025