Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Hunyuan-7B-Instruct-GGUF
like
0
Transformers
GGUF
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Hunyuan-7B-Instruct-GGUF
116 GB
Ctrl+K
Ctrl+K
1 contributor
History:
25 commits
Mungert
Upload Hunyuan-7B-Instruct-bf16.gguf with huggingface_hub
def343a
verified
2 months ago
.gitattributes
3.08 kB
Upload Hunyuan-7B-Instruct-bf16.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-bf16.gguf
15 GB
xet
Upload Hunyuan-7B-Instruct-bf16.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-bf16_q8_0.gguf
10.9 GB
xet
Upload Hunyuan-7B-Instruct-bf16_q8_0.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-f16_q8_0.gguf
10.9 GB
xet
Upload Hunyuan-7B-Instruct-f16_q8_0.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-imatrix.gguf
Safe
5.02 MB
xet
Upload Hunyuan-7B-Instruct-imatrix.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq2_m.gguf
3.07 GB
xet
Upload Hunyuan-7B-Instruct-iq2_m.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq2_s.gguf
3.06 GB
xet
Upload Hunyuan-7B-Instruct-iq2_s.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq2_xs.gguf
2.86 GB
xet
Upload Hunyuan-7B-Instruct-iq2_xs.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq2_xxs.gguf
2.68 GB
xet
Upload Hunyuan-7B-Instruct-iq2_xxs.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq3_m.gguf
4.01 GB
xet
Upload Hunyuan-7B-Instruct-iq3_m.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq3_xxs.gguf
3.44 GB
xet
Upload Hunyuan-7B-Instruct-iq3_xxs.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq4_nl.gguf
4.25 GB
xet
Upload Hunyuan-7B-Instruct-iq4_nl.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-iq4_xs.gguf
4.17 GB
xet
Upload Hunyuan-7B-Instruct-iq4_xs.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q2_k_m.gguf
3.22 GB
xet
Upload Hunyuan-7B-Instruct-q2_k_m.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q2_k_s.gguf
3.15 GB
xet
Upload Hunyuan-7B-Instruct-q2_k_s.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q3_k_m.gguf
4.19 GB
xet
Upload Hunyuan-7B-Instruct-q3_k_m.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q3_k_s.gguf
4.13 GB
xet
Upload Hunyuan-7B-Instruct-q3_k_s.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q4_0.gguf
4.23 GB
xet
Upload Hunyuan-7B-Instruct-q4_0.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q4_1.gguf
4.7 GB
xet
Upload Hunyuan-7B-Instruct-q4_1.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q4_k_m.gguf
4.69 GB
xet
Upload Hunyuan-7B-Instruct-q4_k_m.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q4_k_s.gguf
4.49 GB
xet
Upload Hunyuan-7B-Instruct-q4_k_s.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q5_0.gguf
5.17 GB
xet
Upload Hunyuan-7B-Instruct-q5_0.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q5_1.gguf
5.64 GB
xet
Upload Hunyuan-7B-Instruct-q5_1.gguf with huggingface_hub
2 months ago
Hunyuan-7B-Instruct-q8_0.gguf
7.98 GB
xet
Upload Hunyuan-7B-Instruct-q8_0.gguf with huggingface_hub
2 months ago
README.md
26.5 kB
Upload README.md with huggingface_hub
2 months ago