Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
granite-3.0-2b-instruct-GGUF
like
0
Text Generation
Transformers
GGUF
language
granite-3.0
Eval Results (legacy)
conversational
arxiv:
0000.00000
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
granite-3.0-2b-instruct-GGUF
42.1 GB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
Mungert
Super-squash history to reclaim storage
8efa91e
verified
7 months ago
.gitattributes
Safe
4.03 kB
Super-squash history to reclaim storage
7 months ago
README.md
Safe
15.4 kB
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-bf16.gguf
5.27 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-bf16_q8_0.gguf
3.82 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-f16_q8_0.gguf
3.82 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq3_m.gguf
1.27 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq3_s.gguf
1.27 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq3_xs.gguf
1.14 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq3_xxs.gguf
1.11 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq4_nl.gguf
1.52 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-iq4_xs.gguf
1.44 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q3_k_m.gguf
1.33 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q3_k_s.gguf
1.3 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q4_0.gguf
1.48 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q4_1.gguf
1.65 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q4_k_m.gguf
1.61 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q4_k_s.gguf
1.56 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q5_0.gguf
1.81 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q5_1.gguf
1.98 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q5_k_m.gguf
1.89 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q5_k_s.gguf
1.86 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q6_k_m.gguf
2.16 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct-q8_0.gguf
2.8 GB
xet
Super-squash history to reclaim storage
7 months ago
granite-3.0-2b-instruct.imatrix
Safe
3.29 MB
xet
Super-squash history to reclaim storage
7 months ago
