Instructions to use haohuiliang/RobustOps-SFT-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use haohuiliang/RobustOps-SFT-4B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="haohuiliang/RobustOps-SFT-4B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("haohuiliang/RobustOps-SFT-4B")
model = AutoModelForCausalLM.from_pretrained("haohuiliang/RobustOps-SFT-4B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use haohuiliang/RobustOps-SFT-4B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "haohuiliang/RobustOps-SFT-4B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "haohuiliang/RobustOps-SFT-4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/haohuiliang/RobustOps-SFT-4B

SGLang

How to use haohuiliang/RobustOps-SFT-4B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "haohuiliang/RobustOps-SFT-4B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "haohuiliang/RobustOps-SFT-4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "haohuiliang/RobustOps-SFT-4B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "haohuiliang/RobustOps-SFT-4B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use haohuiliang/RobustOps-SFT-4B with Docker Model Runner:
```
docker model run hf.co/haohuiliang/RobustOps-SFT-4B
```
Browse Quantizations to use this model in llama.cpp, Ollama, LM Studio, or any compatible app.

RobustOps-SFT-4B

English · 简体中文 · Models & data collection

GitHub: code & reproduction · Quick start · Training · Evaluation

RobustOps combines supervised fine-tuning and reinforcement learning to improve task completion and fault recovery in 4B enterprise tool agents. The GitHub project provides source code, enterprise runtime adapters, fault injection, training data, recipes and evaluation workflows.

Full-parameter SFT for enterprise task completion and recovery from tool failures. Model repository.

Training data · Trajectories.

Training

Training recipe · Environment and dependencies

692 successful DeepSeek-V4.1-Flash teacher trajectories from 80% Train, with separate demonstration coverage of 357/1,025 clean task–tool-configuration cases (34.83%) and 335/1,025 fault cases (32.68%). Selective decision supervision applies: identified invalid decisions remain in context with their target loss masked, while valid fault encounters and recovery remain learnable. Training uses batch 8, learning rate 3e-6, cosine decay, 8% warmup and three epochs. The adopted checkpoint is epoch 2 / step 174. The initial model is Arctic-MidTool-RL-4B at revision 38b5e742fd20023058cd2cb207358dd033556773.

Training uses two 96 GB GPUs and a 32K context. SFT/RL share 15 validation records for supervised loss diagnostics, without training gradients. Weights are stored as FP32 and evaluated with BF16 compute.

Fixed Test results

Measure	Result
Clean task success	28/130 (21.54%)
Actual injection coverage	121/130 (93.08%)
Actual-hit task success	29/121 (23.97%)
Base/SFT/RL/teacher common-hit success	28/116 (24.14%)
Four-model common ignored-filter OOD success	4/20 (20.00%)

Evaluation fixes tasks, state, verifiers, fault mechanisms and repetition limits. Only valid zero-hit runs under these fixed settings receive supplementation, stopping on the first valid hit even when the task fails. Recovery additionally requires matched clean success. The ignored-filter family is held out of project SFT/RL.

Loading

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "haohuiliang/RobustOps-SFT-4B"
revision = "main"
tokenizer = AutoTokenizer.from_pretrained(repo, revision=revision)
model = AutoModelForCausalLM.from_pretrained(
    repo, revision=revision, dtype=torch.bfloat16, device_map="auto",
)

Use the supplied tool-call chat template and tool definitions, with thinking disabled. Running enterprise tasks also requires the RobustOps runtime and adapters.