Other models
Collection
Hy3, Kimi-K2.5, INTELLECT-3, NousCoder. • 8 items • Updated
How to use 0xSero/NousCoder-14B-SFT-Tools with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-generation", model="0xSero/NousCoder-14B-SFT-Tools") # Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("0xSero/NousCoder-14B-SFT-Tools", dtype="auto")How to use 0xSero/NousCoder-14B-SFT-Tools with vLLM:
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "0xSero/NousCoder-14B-SFT-Tools"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "0xSero/NousCoder-14B-SFT-Tools",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker model run hf.co/0xSero/NousCoder-14B-SFT-Tools
How to use 0xSero/NousCoder-14B-SFT-Tools with SGLang:
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
--model-path "0xSero/NousCoder-14B-SFT-Tools" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "0xSero/NousCoder-14B-SFT-Tools",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "0xSero/NousCoder-14B-SFT-Tools" \
--host 0.0.0.0 \
--port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "0xSero/NousCoder-14B-SFT-Tools",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'How to use 0xSero/NousCoder-14B-SFT-Tools with Docker Model Runner:
docker model run hf.co/0xSero/NousCoder-14B-SFT-Tools
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("0xSero/NousCoder-14B-SFT-Tools", dtype="auto")Support this work → · X · GitHub · REAP paper · Cerebras REAP
SFT fine-tune of NousResearch/Hermes-3-Llama-3.1-8B.
| Base model | NousResearch/Hermes-3-Llama-3.1-8B |
| Format | SFT |
| Total params | 14B |
| Active / token | — |
| Experts / layer | — |
| Layers | — |
| Hidden size | — |
| Context | — |
| On-disk size | 1 GB |
| Variant | Format | Link |
|---|---|---|
NousCoder-14B-SFT |
SFT | link |
NousCoder-14B-SFT-Tools (this) |
SFT | link |
NousCoder-14B-Tools |
Tools | link |
License inherited from the base model.
@misc{lasby2025reap,
title = {REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression},
author = {Mike Lasby and Ivan Lazarevich and Nish Sinnadurai and Sean Lie and Yani Ioannou and Vithursan Thangarasa},
year = {2025}, eprint = {2510.13999}, archivePrefix = {arXiv}
}
Made possible by NVIDIA · TNG Technology · Lambda · Prime Intellect · Hot Aisle.
Base model
meta-llama/Llama-3.1-8B
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="0xSero/NousCoder-14B-SFT-Tools")