Text Generation
GGUF
English
code
coder
qwen2.5
qwen2.5-coder
llama-cpp
llama.cpp
ollama
code-generation
tool-calling
conversational
cpu-inference
small-language-model
offline
sakthai
house-of-sak
Eval Results (legacy)
Eval Results
Instructions to use Nanthasit/sakthai-coder-1.5b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Nanthasit/sakthai-coder-1.5b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Nanthasit/sakthai-coder-1.5b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Nanthasit/sakthai-coder-1.5b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-coder-1.5b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Ollama
How to use Nanthasit/sakthai-coder-1.5b with Ollama:
ollama run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Unsloth Studio
How to use Nanthasit/sakthai-coder-1.5b with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Nanthasit/sakthai-coder-1.5b to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Nanthasit/sakthai-coder-1.5b to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Nanthasit/sakthai-coder-1.5b to start chatting
- Pi
How to use Nanthasit/sakthai-coder-1.5b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Nanthasit/sakthai-coder-1.5b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use Nanthasit/sakthai-coder-1.5b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use Nanthasit/sakthai-coder-1.5b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-coder-1.5b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Nanthasit/sakthai-coder-1.5b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use Nanthasit/sakthai-coder-1.5b with Docker Model Runner:
docker model run hf.co/Nanthasit/sakthai-coder-1.5b:Q4_K_M
- Lemonade
How to use Nanthasit/sakthai-coder-1.5b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Nanthasit/sakthai-coder-1.5b:Q4_K_M
Run and chat with the model
lemonade run user.sakthai-coder-1.5b-Q4_K_M
List all available models
lemonade list
Commit History
docs: improve model card with usage, benchmark table, limitations, citation dcd0c7a verified
chore: enrich model-index with SakThai Bench v2 verified results f366088 verified
Improve model card: add model-size badge, refresh family-table downloads, update coverage wording to 26 public models. 316ae0a verified
Fix family coverage wording: 22 -> 26 public models; add model-size badge. 6d36dd9 verified
Improve model card: model-size badge, refreshed family table row download counts, expanded coverage wording. 5bd6b0d verified
docs: unify usage section, add Limitations, improve tool-calling snippet 077cdbd verified
docs: verify internal benchmark + add prompt template to coder-1.5b card 6450a5a verified
docs: remove duplicated Internal SakThai Coding Suite heading/table d0c3440 verified
docs: fix duplicated Benchmarks section after live eval insert b67ea29 verified
docs: add live local eval snapshot to Benchmarks 440eecc verified
docs: add How to Use, Limitations, Citation; repair front-matter sections 09fe086 verified
docs: add usage snippet, clarify benchmarks, tighten evaluation section 4515a97 verified
docs: add Tool-calling example section to README e6d46c9 verified
docs: promote benchmark eval to model card 27857df verified
docs: repair TTS badge link and verify Model Description section 4707c14 verified
docs: add Model Description, fix badge link, improve metadata 9bba5a2 verified
Upload README.md with huggingface_hub 7d90331 verified
chore: add dataset cross-link sakthai-combined-v10 fbe6780 verified
fix: clean model-index metric names for HF validator compatibility 27adc34
docs: improve model card β tool-calling XML example, expanded limitations, honest benchmark caveats bc6d0ec verified
Upload README.md with huggingface_hub 950b54b verified
docs: improve model card β Model Description, Usage, Benchmarks, Limitations, Citation; honest base-model refs + internal suite; widget YAML normalized 243f7c5 verified
fix: include sakthai-bench-v2 and irrelevance-supplement in datasets YAML; update Training section b470d96
Beer commited on
Update family count: 20 public models -> 22 public models fd9caa6 verified
docs: GGUF-only metadata (library_name gguf), honest inference section, ecosystem status refresh, housekeeping cleanup-done; .gitattributes junk entries removed ecb3e3e verified
Audit fix: family collection count 20 public models / 15 datasets / 4 Spaces (39 items, bench-v3 joined) 7feb07c verified
Update collection footer: 13 datasets -> 14 (sakthai-combined-v11 joined the family collection) 42b3e3c verified
fix(crosslinks): correct stale Coder Browser GGUF size 6.6->7.1 GB (actual 7,111,560,032 B); remove phantom private/internal dataset claim (combined-v8 & cycle-bench 404) e8c8b98 verified
docs: refresh collection/family counts to live state (19 public models, 13 datasets, 4 Spaces) 340bbc8 verified
docs: enrich coder-1.5b card β 19-model family table with live downloads + verified sizes, fix stale embedding size (80MB->470MB), architecture table, llama-cpp-python example, honest single-trial verified:false, ecosystem status + repo hygiene note 5ce5423 verified
Fix cross-link: replace dead sakthai-vision-demo Space (404) with sakthai-web-agent c88dcb4 verified
Update model card: fix model-index format, add source metadata, refresh dataset counts 049496e verified
Update model card: add downloads badge, benchmarks, code examples, YAML tags 9e3e56f verified
Update model card: refresh download counts, add coding benchmarks and usage examples 638267a verified
Upload README.md with huggingface_hub 354562d verified
Upload README.md with huggingface_hub b5e3f0e verified
Fix model count: 11β12 public (v2 added) 54fbc74 verified
docs: add origin story + CTA section for narrative consistency across House of Sak cards 7f5ee2b verified
Fix coder-1.5b card: remove dead Rising Stars links, add 0.5b-tools cross-link, fix ecosystem count a695334 verified
Upload README.md with huggingface_hub 9184a87 verified
fix: model count 12β11 (actual from HF API) eeaf349 verified
fix: update model family count from 13 to 12 69dae28 verified
fix: correct model count 14β13, remove deprecated English embedding reference 58d1916 verified
fix: align family count to 14 models + add signature tagline deb477a verified
docs: align card to lean standard β live downloads badge, single canonical family table, drop funnel sections and stale counts 55f8f6e verified
docs: align card to lean standard β live downloads badge, single canonical family table, drop funnel sections and stale counts b519591 verified
fix: replace broken shields.io/endpoint badge with working static badge (70 dl) 17b8f79 verified
Remove unearned model-index claims; state measured results or mark as unbenchmarked 03376c7 verified
Overhaul coder-1.5b card: add growing ecosystem section, expand family table, fix counts 12β13 models, 5β6 datasets a8351cf
SakThai commited on