metadata
license: apache-2.0
base_model:
- Maincode/Maincoder-1B
library_name: transformers
Maincoder-1B - GGUF
About
This repository contains GGUF weights for Maincode/Maincoder-1B.
For a convenient overview and download list, visit our model page.
Usage
If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.
Llama.cpp CLI
./llama-cli -m Maincoder-1B-q4_k_m.gguf -p "Hello!"
Provided Quants
(sorted by size, not necessarily quality)
| Link | Type | Size/GB | Notes |
|---|---|---|---|
| GGUF | q2_k | 0.46 | very low quality, for testing |
| GGUF | q3_k_m | 0.54 | |
| GGUF | q4_0 | 0.60 | |
| GGUF | q4_k_m | 0.63 | recommended, good balance |
| GGUF | q5_k_m | 0.71 | |
| GGUF | q8_0 | 1.02 | near-full precision |
Thanks
Special thanks to the llama.cpp team for their amazing work.