Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
TMElyralab
/
DeepSeek-R1-0528-AWQ-W4AFP8
like
2
Follow
Tencent Music Entertainment Lyra Lab
121
Text Generation
Transformers
Safetensors
deepseek_v3
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2501.12948
License:
mit
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
New discussion
New pull request
Resources
PR & discussions documentation
Code of Conduct
Hub documentation
All
Discussions
Pull requests
View closed (0)
Sort: Recently created
能不能贴个sglang运行的示例
1
#2 opened 5 months ago by
wangliuwei
我使用sglang运行该模型的时候,会报“quant_method is not None”
#1 opened 5 months ago by
wangliuwei