Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-V3.1-AWQ-Lite
like
3
Follow
QuantTrio
306
Text Generation
Transformers
Safetensors
Chinese
English
deepseek_v3
vLLM
AWQ
conversational
custom_code
text-generation-inference
4-bit precision
awq
arxiv:
2412.19437
License:
mit
Model card
Files
Files and versions
xet
Community
4
Deploy
Use this model
Resolved
#1
by
mmangkad
- opened
Aug 31, 2025
Discussion
mmangkad
Aug 31, 2025
This comment has been hidden (marked as Resolved)
mmangkad
changed discussion status to
closed
Aug 31, 2025
mmangkad
changed discussion title from
Both working with vLLM and SGLang built from source
to
Resolved
Aug 31, 2025
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment