Instructions to use nex-agi/Nex-N2-Pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use nex-agi/Nex-N2-Pro with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="nex-agi/Nex-N2-Pro", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("nex-agi/Nex-N2-Pro")
model = AutoModelForMultimodalLM.from_pretrained("nex-agi/Nex-N2-Pro", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use nex-agi/Nex-N2-Pro with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "nex-agi/Nex-N2-Pro"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/nex-agi/Nex-N2-Pro

SGLang

How to use nex-agi/Nex-N2-Pro with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "nex-agi/Nex-N2-Pro" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "nex-agi/Nex-N2-Pro" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "nex-agi/Nex-N2-Pro",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use nex-agi/Nex-N2-Pro with Docker Model Runner:
```
docker model run hf.co/nex-agi/Nex-N2-Pro
```

Nex-N2-Pro

Commit History

Fix thinking bug in jinja template

34589c2
verified

huaj1ng commited on Jun 10

Update README.md

7587d53
verified

guoteng commited on Jun 8

Update README.md

1636138
verified

guoteng commited on Jun 8

Update README.md

65f8a0f
verified

Shuo Zhang commited on Jun 4

Update README.md

1a6f01e
verified

Shuo Zhang commited on Jun 4

Update README.md

beede59
verified

Shuo Zhang commited on Jun 4

Update README.md

90ae12e
verified

guoteng commited on Jun 4

Update README.md

fbaced6
verified

Shuo Zhang commited on Jun 4

Update README.md

f2d617d
verified

guoteng commited on Jun 4

Update README.md

826f6aa
verified

guoteng commited on Jun 4

Update README.md

958e912
verified

Shuo Zhang commited on Jun 4

Update README.md

d9ffad5
verified

guoteng commited on Jun 4

Update README.md

d0e68ce
verified

Shuo Zhang commited on Jun 4

Update README.md

e94e13d
verified

Shuo Zhang commited on Jun 4

Init

a85b319

mszhou

guoteng commited on Jun 3

Commit History

Fix thinking bug in jinja template 34589c2 verified

Update README.md 7587d53 verified

Update README.md 1636138 verified

Update README.md 65f8a0f verified

Update README.md 1a6f01e verified

Update README.md beede59 verified

Update README.md 90ae12e verified

Update README.md fbaced6 verified

Update README.md f2d617d verified

Update README.md 826f6aa verified

Update README.md 958e912 verified

Update README.md d9ffad5 verified

Update README.md d0e68ce verified

Update README.md e94e13d verified

Init a85b319

Fix thinking bug in jinja template

34589c2
verified

Update README.md

7587d53
verified

Update README.md

1636138
verified

Update README.md

65f8a0f
verified

Update README.md

1a6f01e
verified

Update README.md

beede59
verified

Update README.md

90ae12e
verified

Update README.md

fbaced6
verified

Update README.md

f2d617d
verified

Update README.md

826f6aa
verified

Update README.md

958e912
verified

Update README.md

d9ffad5
verified

Update README.md

d0e68ce
verified

Update README.md

e94e13d
verified

Init

a85b319