How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Fazmin/solus_v1_maincoder-1b-f16:F16
# Run inference directly in the terminal:
llama cli -hf Fazmin/solus_v1_maincoder-1b-f16:F16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Fazmin/solus_v1_maincoder-1b-f16:F16
# Run inference directly in the terminal:
llama cli -hf Fazmin/solus_v1_maincoder-1b-f16:F16
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Fazmin/solus_v1_maincoder-1b-f16:F16
# Run inference directly in the terminal:
./llama-cli -hf Fazmin/solus_v1_maincoder-1b-f16:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Fazmin/solus_v1_maincoder-1b-f16:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Fazmin/solus_v1_maincoder-1b-f16:F16
Use Docker
docker model run hf.co/Fazmin/solus_v1_maincoder-1b-f16:F16
Quick Links

Maincoder 1B โ€” Solus v1

Maincode's 1B code-focused model, aimed at code generation and completion rather than open-ended conversation. Its size makes it viable on machines that cannot run a 7B coder at usable speed.

This build is F16 rather than a 4-bit quant, so it is full precision: larger on disk than a Q4 of the same model, but with no quantisation loss. Best suited to short scripts, snippets, and inline completions.

Specifications

Parameters 1B
Quantization F16
File size 1.92 GB
Minimum RAM 4.00 GB
Minimum VRAM not required
Context length 8,192 tokens
SHA-256 4a3e551e0586cd4cd09bdd7ae5a37a9605461ec15ee9436a93a7852f27980b40

Single file: Maincoder-1B-F16.gguf

Quantization

Quantization performed at the Faculty of Engineering, McMaster University.

The GGUF conversion this build is derived from was produced by Maincode, and the weights here are a byte-for-byte copy of that file โ€” the SHA-256 above matches the upstream artifact.

Provenance

Usage

llama-cli -m Maincoder-1B-F16.gguf -cnv
Downloads last month
12
GGUF
Model size
1B params
Architecture
maincoder
Hardware compatibility
Log In to add your hardware

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Fazmin/solus_v1_maincoder-1b-f16

Quantized
(7)
this model