Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

QuantTrio
/

DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation

DeepSeek-R1-0528

text-generation-inference

4-bit precision

Model card Files Files and versions

DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

2 contributors

History: 105 commits

JunHowie's picture

Update README.md

7a037a7 verified 9 months ago

figures
Upload folder using huggingface_hub 9 months ago
.gitattributes
1.64 kB

Upload folder using huggingface_hub 9 months ago
LICENSE
1.06 kB

Upload folder using huggingface_hub 9 months ago
README.md
11.5 kB

Update README.md 9 months ago
config.json
1.88 kB

Upload folder using huggingface_hub 9 months ago
configuration.json
48 Bytes

Upload folder using huggingface_hub 9 months ago
configuration_deepseek.py
9.9 kB

Upload folder using huggingface_hub 9 months ago
generation_config.json
171 Bytes

Upload folder using huggingface_hub 9 months ago
gptq_marlin.py
26.9 kB

Upload folder using huggingface_hub 9 months ago
model-00001-of-00096.safetensors
5 GB
xet

Upload model-00001-of-00096.safetensors with huggingface_hub 9 months ago
model-00002-of-00096.safetensors
5 GB
xet

Upload model-00002-of-00096.safetensors with huggingface_hub 9 months ago
model-00003-of-00096.safetensors
5 GB
xet

Upload model-00003-of-00096.safetensors with huggingface_hub 9 months ago
model-00004-of-00096.safetensors
5 GB
xet

Upload model-00004-of-00096.safetensors with huggingface_hub 9 months ago
model-00005-of-00096.safetensors
5 GB
xet

Upload model-00005-of-00096.safetensors with huggingface_hub 9 months ago
model-00006-of-00096.safetensors
4.99 GB
xet

Upload model-00006-of-00096.safetensors with huggingface_hub 9 months ago
model-00007-of-00096.safetensors
5 GB
xet

Upload model-00007-of-00096.safetensors with huggingface_hub 9 months ago
model-00008-of-00096.safetensors
5 GB
xet

Upload model-00008-of-00096.safetensors with huggingface_hub 9 months ago
model-00009-of-00096.safetensors
5 GB
xet

Upload model-00009-of-00096.safetensors with huggingface_hub 9 months ago
model-00010-of-00096.safetensors
5 GB
xet

Upload model-00010-of-00096.safetensors with huggingface_hub 9 months ago
model-00011-of-00096.safetensors
5 GB
xet

Upload model-00011-of-00096.safetensors with huggingface_hub 9 months ago
model-00012-of-00096.safetensors
5 GB
xet

Upload model-00012-of-00096.safetensors with huggingface_hub 9 months ago
model-00013-of-00096.safetensors
5 GB
xet

Upload model-00013-of-00096.safetensors with huggingface_hub 9 months ago
model-00014-of-00096.safetensors
5 GB
xet

Upload model-00014-of-00096.safetensors with huggingface_hub 9 months ago
model-00015-of-00096.safetensors
5 GB
xet

Upload model-00015-of-00096.safetensors with huggingface_hub 9 months ago
model-00016-of-00096.safetensors
5 GB
xet

Upload model-00016-of-00096.safetensors with huggingface_hub 9 months ago
model-00017-of-00096.safetensors
5 GB
xet

Upload model-00017-of-00096.safetensors with huggingface_hub 9 months ago
model-00018-of-00096.safetensors
5 GB
xet

Upload model-00018-of-00096.safetensors with huggingface_hub 9 months ago
model-00019-of-00096.safetensors
5 GB
xet

Upload model-00019-of-00096.safetensors with huggingface_hub 9 months ago
model-00020-of-00096.safetensors
5 GB
xet

Upload model-00020-of-00096.safetensors with huggingface_hub 9 months ago
model-00021-of-00096.safetensors
4.99 GB
xet

Upload model-00021-of-00096.safetensors with huggingface_hub 9 months ago
model-00022-of-00096.safetensors
5 GB
xet

Upload model-00022-of-00096.safetensors with huggingface_hub 9 months ago
model-00023-of-00096.safetensors
5 GB
xet

Upload model-00023-of-00096.safetensors with huggingface_hub 9 months ago
model-00024-of-00096.safetensors
5 GB
xet

Upload model-00024-of-00096.safetensors with huggingface_hub 9 months ago
model-00025-of-00096.safetensors
5 GB
xet

Upload model-00025-of-00096.safetensors with huggingface_hub 9 months ago
model-00026-of-00096.safetensors
4.99 GB
xet

Upload model-00026-of-00096.safetensors with huggingface_hub 9 months ago
model-00027-of-00096.safetensors
5 GB
xet

Upload model-00027-of-00096.safetensors with huggingface_hub 9 months ago
model-00028-of-00096.safetensors
5 GB
xet

Upload model-00028-of-00096.safetensors with huggingface_hub 9 months ago
model-00029-of-00096.safetensors
5 GB
xet

Upload model-00029-of-00096.safetensors with huggingface_hub 9 months ago
model-00030-of-00096.safetensors
5 GB
xet

Upload model-00030-of-00096.safetensors with huggingface_hub 9 months ago
model-00031-of-00096.safetensors
4.99 GB
xet

Upload model-00031-of-00096.safetensors with huggingface_hub 9 months ago
model-00032-of-00096.safetensors
4.96 GB
xet

Upload model-00032-of-00096.safetensors with huggingface_hub 9 months ago
model-00033-of-00096.safetensors
5 GB
xet

Upload model-00033-of-00096.safetensors with huggingface_hub 9 months ago
model-00034-of-00096.safetensors
5 GB
xet

Upload model-00034-of-00096.safetensors with huggingface_hub 9 months ago
model-00035-of-00096.safetensors
5 GB
xet

Upload model-00035-of-00096.safetensors with huggingface_hub 9 months ago
model-00036-of-00096.safetensors
5 GB
xet

Upload model-00036-of-00096.safetensors with huggingface_hub 9 months ago
model-00037-of-00096.safetensors
4.99 GB
xet

Upload model-00037-of-00096.safetensors with huggingface_hub 9 months ago
model-00038-of-00096.safetensors
5 GB
xet

Upload model-00038-of-00096.safetensors with huggingface_hub 9 months ago
model-00039-of-00096.safetensors
5 GB
xet

Upload model-00039-of-00096.safetensors with huggingface_hub 9 months ago
model-00040-of-00096.safetensors
5 GB
xet

Upload model-00040-of-00096.safetensors with huggingface_hub 9 months ago
model-00041-of-00096.safetensors
5 GB
xet

Upload model-00041-of-00096.safetensors with huggingface_hub 9 months ago