Text Generation
Transformers
Safetensors
qwen2
coder
code
agent
conversational
text-generation-inference
Instructions to use AdminReal/NexusCoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AdminReal/NexusCoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="AdminReal/NexusCoder") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("AdminReal/NexusCoder") model = AutoModelForCausalLM.from_pretrained("AdminReal/NexusCoder", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use AdminReal/NexusCoder with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AdminReal/NexusCoder" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AdminReal/NexusCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/AdminReal/NexusCoder
- SGLang
How to use AdminReal/NexusCoder with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AdminReal/NexusCoder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AdminReal/NexusCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AdminReal/NexusCoder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AdminReal/NexusCoder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use AdminReal/NexusCoder with Docker Model Runner:
docker model run hf.co/AdminReal/NexusCoder
Tools Documentation
Nexus Coder v0.2 có 18+ tools để tương tác với môi trường.
Safety Levels
| Level | Icon | Description |
|---|---|---|
| SAFE | ✓ | Read-only, no side effects |
| MODERATE | ⚠ | Writes to local files |
| DANGEROUS | ⚡ | Executes commands, network ops |
| DESTRUCTIVE | 💀 | Can delete data, requires confirmation |
Tools by Category
FILE Operations
file_read(✓) - Đọc file textfile_write(⚠) - Ghi file (overwrite/append)file_list(✓) - Liệt kê files với globfile_delete(💀) - Xóa file/thư mục
EXEC
shell_exec(⚡) - Execute bash commandspython_exec(⚡) - Execute Python code (sandboxed)git_ops(⚡) - Git commands
WEB
http_request(⚠) - HTTP GET/POST/PUT/DELETEweb_fetch(✓) - Fetch webpage, extract textweb_search(✓) - Search web
CODE
code_search(✓) - Regex search trong codecode_lint(✓) - Lint code (ruff, flake8, pylint)code_format(⚠) - Format code (black, autopep8, isort)regex_search(✓) - Regex search trong files
MATH
calculator(✓) - Safe math expression eval
PARSER
json_parse(✓) - Parse JSON với query supportyaml_parse(✓) - Parse YAMLcsv_parse(✓) - Parse CSV
SYSTEM
datetime(✓) - DateTime operations + timezone
NETWORK
dns_lookup(✓) - DNS lookup (A, AAAA, MX, NS, CNAME, TXT)ping(✓) - Ping host
CRYPTO
hash(✓) - Compute hash (md5, sha1, sha256, sha512, blake2)encrypt(⚡) - AES-256-GCM encrypt/decrypt
FILE (Archive)
archive(⚠) - ZIP/TAR create/extract/list
Usage
from nexus.tools import get_global_registry, ToolContext
registry = get_global_registry()
# List all tools
print(registry.list_tools())
# Execute tool
from nexus.tools.base import ToolContext
ctx = ToolContext(working_dir="/tmp")
result = registry.execute("file_read", {"path": "/etc/hostname"}, ctx)
print(result.output)
# Check safety
tool = registry.get("file_delete")
print(f"Safety: {tool.safety.value}")
Audit Log
All tool calls are logged to ./logs/tool_audit.jsonl:
{
"timestamp": 1234567890.123,
"tool": "file_write",
"safety": "moderate",
"args": {"path": "/tmp/test.txt", "content": "hello"},
"working_dir": ".",
"user_id": null,
"success": true,
"return_code": 0,
"duration": 0.001
}
Safety Features
- Confirmation required for DANGEROUS and DESTRUCTIVE tools
- Dry-run mode to preview actions without executing
- Pre-hooks for rate limiting, auth checks
- Post-hooks for metrics, notifications
- Audit log for compliance
- Blocked commands for known dangerous patterns
Custom Tools
from nexus.tools.base import Tool, ToolResult, ToolContext, ToolCategory, ToolSafety
class MyTool(Tool):
category = ToolCategory.FILE
safety = ToolSafety.SAFE
@property
def name(self) -> str:
return "my_tool"
@property
def description(self) -> str:
return "My custom tool"
@property
def parameters(self) -> dict:
return {
"type": "object",
"properties": {"input": {"type": "string"}},
"required": ["input"],
}
def execute(self, args, context):
return ToolResult(
success=True,
output=f"Processed: {args['input']}",
)
# Register
from nexus.tools import get_global_registry
get_global_registry().register(MyTool())
Tool Calling via Natural Language
Agent có thể detect tool calls từ natural language:
- "read file /etc/hostname" →
file_read - "run ls -la" →
shell_exec - "search for TODO in src/" →
regex_search - "fetch https://example.com" →
web_fetch - "git status" →
git_ops
Hoặc JSON format:
{"tool": "file_read", "args": {"path": "/etc/hostname"}}
Or @-mention:
@file_read path=/etc/hostname