How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="AppliedIntuitionResearch/nord")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("AppliedIntuitionResearch/nord")
model = AutoModelForMultimodalLM.from_pretrained("AppliedIntuitionResearch/nord", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))
Quick Links

NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning (SFT + Dr. GRPO)

CVPR 2026 | arXiv | Project Page | GitHub

Ishaan Rawal · Shubh Gupta · Yihan Hu · Wei Zhan

This is the paper's main result: Qwen2.5-VL-3B supervised fine-tuned and then further trained with Dr. GRPO to directly predict driving trajectories as discrete tokens without chain-of-thought reasoning, using 3× fewer tokens than reasoning-based VLA baselines.

Model Training NAVSIM PDMS
nord (this repo) SFT + Dr. GRPO 0.8626
nord-base SFT only 0.7273
PDMS                                 0.8626
  no_at_fault_collisions             0.9737
  drivable_area_compliance           0.9522
  ego_progress                       0.8156
  time_to_collision                  0.9253
  comfort                            0.9997

Usage

Install the nord client and serve with vLLM:

vllm serve AppliedIntuitionResearch/nord --served-model-name qwen --dtype bfloat16 --port 8000
from PIL import Image
import nord

agent = nord.NordAgent.from_pretrained("nord")

output = agent.predict(nord.NordInput(
    cameras=[Image.open("fl.jpg"), Image.open("front.jpg"), Image.open("fr.jpg")],
    ego_velocity_ms=(8.3, 0.0),
    driving_command="straight",
))

print(output.trajectory.shape)   # (40, 3) — x, y, heading at 10 Hz, 4 seconds

Full inference and NAVSIM evaluation instructions: github.com/Applied-Intuition-Open-Source/nord.

This repo bundles the K-Disc trajectory tokenizer vocab (vocab.pkl, 2048 clusters) used to decode the model's output tokens into (x, y, heading) trajectories.

Citation

@inproceedings{rawal2026nord,
  title={NoRD: A Data-Efficient Vision-Language-Action Model that Drives without Reasoning},
  author={Rawal, Ishaan and Gupta, Shubh and Hu, Yihan and Zhan, Wei},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
  year={2026}
}

License

This checkpoint is released under CC BY-NC-SA 4.0 (non-commercial). The nord inference client code is separately licensed under Apache 2.0 — see github.com/Applied-Intuition-Open-Source/nord.

Downloads last month
7
Safetensors
Model size
4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AppliedIntuitionResearch/nord

Finetuned
(839)
this model

Collection including AppliedIntuitionResearch/nord

Paper for AppliedIntuitionResearch/nord