QuantFactory
/

Qwen2.5-3B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Qwen2.5-3B-Instruct-GGUF

28.3 GB

1 contributor

History: 16 commits

aashish1904's picture

Upload Qwen2.5-3B-Instruct.Q4_K_S.gguf with huggingface_hub

7837d44 verified over 1 year ago

.gitattributes
2.46 kB

Upload Qwen2.5-3B-Instruct.Q4_K_S.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q2_K.gguf
1.27 GB
xet

Upload Qwen2.5-3B-Instruct.Q2_K.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q3_K_L.gguf
1.71 GB
xet

Upload Qwen2.5-3B-Instruct.Q3_K_L.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q3_K_M.gguf
1.59 GB
xet

Upload Qwen2.5-3B-Instruct.Q3_K_M.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q3_K_S.gguf
1.45 GB
xet

Upload Qwen2.5-3B-Instruct.Q3_K_S.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q4_0.gguf
1.82 GB
xet

Upload Qwen2.5-3B-Instruct.Q4_0.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q4_1.gguf
2 GB
xet

Upload Qwen2.5-3B-Instruct.Q4_1.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q4_K_M.gguf
1.93 GB
xet

Upload Qwen2.5-3B-Instruct.Q4_K_M.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q4_K_S.gguf
1.83 GB
xet

Upload Qwen2.5-3B-Instruct.Q4_K_S.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q5_0.gguf
2.17 GB
xet

Upload Qwen2.5-3B-Instruct.Q5_0.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q5_1.gguf
2.34 GB
xet

Upload Qwen2.5-3B-Instruct.Q5_1.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q5_K_M.gguf
2.22 GB
xet

Upload Qwen2.5-3B-Instruct.Q5_K_M.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q5_K_S.gguf
2.17 GB
xet

Upload Qwen2.5-3B-Instruct.Q5_K_S.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q6_K.gguf
2.54 GB
xet

Upload Qwen2.5-3B-Instruct.Q6_K.gguf with huggingface_hub over 1 year ago
Qwen2.5-3B-Instruct.Q8_0.gguf
3.29 GB
xet

Upload Qwen2.5-3B-Instruct.Q8_0.gguf with huggingface_hub over 1 year ago
README.md
5.39 kB

Upload README.md with huggingface_hub over 1 year ago