Text Generation
Transformers
Safetensors
English
qwen2
agent
conversational
ollama
small-language-model
slm
tool-use
qwen
qwen2.5
sakthai
house-of-sak
tool-calling
function-calling
merged
edge
lightweight
low-resource
raspberry-pi
on-device
benchmark
eval
Eval Results (legacy)
Eval Results
text-generation-inference
Instructions to use Nanthasit/sakthai-context-0.5b-tools with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Nanthasit/sakthai-context-0.5b-tools with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Nanthasit/sakthai-context-0.5b-tools") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Nanthasit/sakthai-context-0.5b-tools") model = AutoModelForCausalLM.from_pretrained("Nanthasit/sakthai-context-0.5b-tools", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Nanthasit/sakthai-context-0.5b-tools with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Nanthasit/sakthai-context-0.5b-tools" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-0.5b-tools", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Nanthasit/sakthai-context-0.5b-tools
- SGLang
How to use Nanthasit/sakthai-context-0.5b-tools with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Nanthasit/sakthai-context-0.5b-tools" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-0.5b-tools", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Nanthasit/sakthai-context-0.5b-tools" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-0.5b-tools", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Nanthasit/sakthai-context-0.5b-tools with Docker Model Runner:
docker model run hf.co/Nanthasit/sakthai-context-0.5b-tools
Commit History
Add metadata eval result 09b1757 verified
Fix architecture table completeness 191bc27 verified
Improve model card: badges, architecture table, usage examples, verified model-index 00fc9e0 verified
fix(model card): remove duplicated subtitle after title correction c611b2a verified
fix(model card): align README title with repo id and clean H1 3c236ab verified
health check report 2026-08-01 537ece3 verified
2026-08-01: Added Quick Example section with 30-second working tool-calling snippet 95b9066 verified
docs: improve model card usage, format, inference snapshot a4279d0 verified
Add eval snapshot cron-eval-Nanthasit-sakthai-context-0.5b-tools-20260801T032221Z.yaml 83f2dd1 verified
improve model card: clean badges, add hf-hub usage, fix model-index selection value, note eval artifacts 285d218 verified
Upload .eval_results/cron-eval-Nanthasit-sakthai-context-0.5b-tools-20260731T231603Z.yaml with huggingface_hub 0b49701 verified
health check 2026-07-31: healthy 06cf87a verified
health check 2026-07-31: issues_found e06d277 verified
Upload README.md with huggingface_hub 2749208 verified
fix malformed README link trailing }, 71dd563 verified
fix: restore closing brace in README software citation 06c21ac verified
fix: remove malformed URL in software citation bb804ee verified
eval-updater: add metadata eval 2026-07-31T17:51:01Z 61b5ec3 verified
Update family count: 20 public models -> 22 public models f74371d verified
Add real, verified sakthai-bench-v2 results d15ad56 verified
eval results on bench-v2 (scorer multiset-selection-v2) 8bbb75b verified
Audit fix: family collection count 20 public models / 15 datasets / 4 Spaces (39 items, bench-v3 joined) 864f47e verified
Update collection footer: 13 datasets -> 14 (sakthai-combined-v11 joined the family collection) 4f40f86 verified
docs: add Model Description, Limitations, and Citation sections to README 1974aad verified
docs(round-2): correct bench-v2 selection to multiset-scored 91.2%, fix family-table sizes (0.5b-tools is merged 988 MB not LoRA; embedding 471 MB; tools-v2 73.9 MB LoRA; 7b-128k config-only; plus-1.5b-coder planned), refresh rising-star dataset counts (irrelevance 78, v7 101, bench-v2 92, food-penguin 89), add in-repo inference-check section, update sibling comparisons to corrected 48.2%/57.0% 2e959b8 verified
cron: fix metrics_count to 8 in eval result for sakthai-context-0.5b-tools (run 14) f2a6253 verified
cron: add eval result #1 for sakthai-context-0.5b-tools (metadata_cron, run 14) 268b944 verified
docs: refresh collection/family counts to live state (19 public models, 13 datasets, 4 Spaces) 63bed65 verified
Fix broken GGUF cross-link: sakthai-context-0.5b-merged-q4_k_m.gguf β sakthai-0.5b-Q4_K_M.gguf (actual file in merged repo) 8be8045 verified
Upload .eval_results/benchmark-20260731_015807.yaml with huggingface_hub 1d03e16 verified
Upload README.md with huggingface_hub b7f6458 verified
Fix cross-link: replace dead sakthai-vision-demo Space (404) with sakthai-web-agent 1630bd4 verified
Add cross-links to v2 models (1.5b-tools-v2, 1.5b-merged-v2), bump family count 12->14 07c9f2d verified
Fix model count: 11β12 (v2 added) c838cbd verified
Add download badge, Spaces links, and Rising Stars promotion section 0558168 verified
fix: remove broken v7 model link from family table 4a8f6c9 verified
Upload README.md with huggingface_hub 527b414 verified
fix: model count 12β11 (actual from HF API) 1255f0c verified
chore: expand discoverability tags (agent, ollama, slm, tool-use, conversational) b8d91b3 verified
fix: update model family count from 13 to 12 668af99 verified
fix: correct model count 14β13, remove deprecated English embedding reference 4d49c08 verified
chore: update family table β split tool rows, add v7 and exp models, emoji roles 86096a8 verified
docs: align card to lean standard β live downloads badge, single canonical family table, drop funnel sections and stale counts dcbf21a verified
docs: align card to lean standard β live downloads badge, single canonical family table, drop funnel sections and stale counts 92b16b8 verified
comprehensive model card: full per-category benchmark, baseline comparison, training details, methodology 267cc35 verified
clean card: trim bloat, keep benchmark + usage + links 72fc2bc verified
cron: add cross-links for new experimental model + datasets (07-29) 81fe8c2
SakThai Cron commited on