How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SBDO1/SBD04:F16
# Run inference directly in the terminal:
llama cli -hf SBDO1/SBD04:F16
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SBDO1/SBD04:F16
# Run inference directly in the terminal:
llama cli -hf SBDO1/SBD04:F16
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf SBDO1/SBD04:F16
# Run inference directly in the terminal:
./llama-cli -hf SBDO1/SBD04:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf SBDO1/SBD04:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf SBDO1/SBD04:F16
Use Docker
docker model run hf.co/SBDO1/SBD04:F16
Quick Links

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

SBD04 - Custom Coding AI Assistant

A fine-tuned language model optimized for programming tasks, built on Qwen2.5-Coder-1.5B-Instruct architecture.

πŸ“¦ Models

File Size Description
sbd04-qwen2.5-coder-1.5b-q4_k_m.gguf ~1.1 GB Recommended - Quantized Q4_K_M, fast inference
sbd04-qwen2.5-coder-1.5b-f16.gguf ~3 GB Full precision F16

πŸš€ Quick Start

LM Studio

  1. Download sbd04-qwen2.5-coder-1.5b-q4_k_m.gguf
  2. Open LM Studio β†’ My Models β†’ Add Model β†’ From File
  3. Select the GGUF file
  4. Set context length to 4096+ and start coding

llama.cpp

./main -m sbd04-qwen2.5-coder-1.5b-q4_k_m.gguf -p "Write a Python function to parse JSON" -n 512

Python (llama-cpp-python)

from llama_cpp import Llama

llm = Llama(model_path="sbd04-qwen2.5-coder-1.5b-q4_k_m.gguf", n_ctx=4096)
output = llm("Write a binary search in Python", max_tokens=512)
print(output['choices'][0]['text'])

πŸŽ“ Training Details

  • Base Model: Qwen2.5-Coder-1.5B-Instruct
  • Method: LoRA fine-tuning (r=16, Ξ±=32)
  • Dataset: 60 coding Q&A pairs covering Python, JavaScript, TypeScript, SQL, Git, Docker, REST APIs, Design Patterns, Debugging, Performance, Security, and more
  • Epochs: 3
  • Trainable params: ~18.5M (1.18% of model)
  • Max context: 1024 tokens

πŸ’‘ Example Prompts

"Write a Python decorator for timing functions"
"How do I implement a binary search tree in Python?"
"Review this code for bugs: [paste code]"
"Explain async/await in JavaScript"
"How to prevent SQL injection in Python?"
"Write a Dockerfile for a FastAPI app"
"What's the difference between INNER JOIN and LEFT JOIN?"
"How to use TypeScript generics?"
"Optimize this slow Python loop: [paste code]"
"Write a pytest fixture for database testing"

πŸ“„ License

Apache-2.0

πŸ”— Links


Built with ❀️ for developers everywhere

Downloads last month
49
GGUF
Model size
2B params
Architecture
qwen2
Hardware compatibility
Log In to add your hardware

4-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Space using SBDO1/SBD04 1