Instructions to use thinkingmachines/Inkling-2-Small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thinkingmachines/Inkling-2-Small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="thinkingmachines/Inkling-2-Small") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("thinkingmachines/Inkling-2-Small") model = AutoModelForMultimodalLM.from_pretrained("thinkingmachines/Inkling-2-Small", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- HuggingChat
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use thinkingmachines/Inkling-2-Small with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "thinkingmachines/Inkling-2-Small" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "thinkingmachines/Inkling-2-Small", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/thinkingmachines/Inkling-2-Small
- SGLang
How to use thinkingmachines/Inkling-2-Small with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "thinkingmachines/Inkling-2-Small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "thinkingmachines/Inkling-2-Small", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "thinkingmachines/Inkling-2-Small" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "thinkingmachines/Inkling-2-Small", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use thinkingmachines/Inkling-2-Small with Docker Model Runner:
docker model run hf.co/thinkingmachines/Inkling-2-Small
Add evaluation results
Add evaluation results for thinkingmachines/Inkling-2-Small
Summary
This PR adds evaluation results from the model card's benchmark table for thinkingmachines/Inkling-2-Small to the .eval_results/ directory, following the Hugging Face Hub evaluation-results specification.
Benchmarks Added
- DeepSWE v1.1: 72.1
- Terminal-Bench-Science 0.1: 5.7
- SWE-Bench Pro v2 (Hard): 86.3
- ScreenSpot-Pro: 83.8
- ScreenSpot-Pro (with Python): 92.0
- MMMU-Pro (Standard 10 options): 81.6
- HLE (text only): 44.1
- MDPBench: 81.4
Mapping notes:
- SWE-Bench Pro v2 (Hard) →
SWE_Bench_Pro_hard, the 51-task HARD subset of SWE-Bench Pro V2. - ScreenSpot-Pro and HLE carry
notesfor their eval conditions (Python tool, image downsampling, text-only subset), as stated on the card.
Benchmarks Skipped (Not Registered on Hub)
The following benchmarks are in the model card but have no registered eval.yaml on the Hugging Face Hub:
- Coding: FrontierCode v2.0 (25.4), Vibe Code Bench v1.1 (81.6), SWE-Atlas v1.1 (61.9), Sudo L7 (14.1)
- Autoresearch: PostTrainBench v1.2 (31.9), PMPP-Hard (494.27 AUC), BioMysteryBench (70.0)
- Search and tools: BrowseComp (90.2), DeepSearchQA (90.9), MCP Atlas (85.4 full / 85.0 public)
- Knowledge work: AA-Briefcase v1.1 (1527), GDPval-AA v2.1 (1630), JobBench (70.5), DAYJOB Healthcare (6.4)
- Enterprise: EnterpriseOps-Gym (46.8), EnterpriseBench-CoreCraft (71.8)
- Finance: Finance Agent v2.1 (67.5), Excel Modeling Benchmark v1.1 (69.5), Tax Agent Bench (65.8), APEX-Accounting v1.1 (14.5), DAYJOB Finance (14.3), DeepFinance (29.8), Diligence Bench (58.1), AA-AnalystAgent (51.2), Tau 3 Banking v1.0.1 (40.4), ATLAS-Finance v1.1 (6.0)
- Legal: Harvey LAB v1.1 (21.7), Legal Research Bench (46.6)
- Visual creation: DesignArena (Web Apps 1286, Website 1331, Game Dev 1424, 3D Design 1457), Code Arena WebDev (1653), AA-3D (1021), Code2Video-AA (1020), BVB (71.6)
- Visual perception: PerceptionBench (64.7), Humanity's Sixth Sense (33.3), BabyVision (68.6 / 93.6 with Python), OmniDocBench v1.6 (94.6; not the same set as the registered Real5-OmniDocBench), SimpleVQA (68.2)
- Visual reasoning: GDP.pdf (25.2), CharXiv RQ (85.6 / 89.1), Chartography (36.7 / 82.1), VIALS (34.6 / 57.8), SAGE v1.1 (88.6), MuirBench (79.2), ZeroBench main (29.0 / 44.0)
- STEM reasoning: CritPt v2 (55.7 full / 35.0 hard), HLE-Diamond (28.7; not a task of
cais/hle), ArxivMath 10/2026 (27.7), BrokenArxiv 10/2026 (63.3), ARC-AGI-1 (96.5), ARC-AGI-2 (81.7), MysteryMechanism (25.2) - Long context: AA-LCR v1.1 (83.3), LongBench v2 (70.6)
- Factuality: AA-Omniscience v1.1 (16.1 score / 73.3 non-hallucination)
- Instruction following and multilingual: ComplexConstraints v1.0 (44.5), Global-MMLU-Lite (91.0)
- Safety: HoneyBench v0.2 (52.6, lower is better), DistressBench (82.0), FORTRESS (83.8 adversarial / 79.7 benign), StrongREJECT (97.1)
- Cybersecurity: CyberBench v1.1 (72.7), PatchEval (79.6)
- Indexes (aggregates, not benchmarks): AA Index v5.0 (30.6), Vals Index v2.2 (56.1)
These can be added once the benchmark authors register an eval.yaml on the Hub.
Source
Files Added
.eval_results/Inkling-2-Small.yaml
Verification
These results come from the model card's published benchmark table, with the harnesses listed there (mini-swe-agent v2.4.6 for the coding entries). No verified token is provided, since these were not run via HF Jobs with inspect-ai.
Thank you!