Instructions to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("gitcommit90/SenseNova-Loop-9B-Preview-NVFP4", trust_remote_code=True, device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4

SGLang

How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "gitcommit90/SenseNova-Loop-9B-Preview-NVFP4",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use gitcommit90/SenseNova-Loop-9B-Preview-NVFP4 with Docker Model Runner:
```
docker model run hf.co/gitcommit90/SenseNova-Loop-9B-Preview-NVFP4
```

SenseNova-Loop-9B-Preview-NVFP4 / figures /runtime-v2-performance.svg

gitcommit90

Publish runtime v2 optimization, final comparisons and figures (weights unchanged)

8edc128 verified 1 day ago

preview code

Raw History Blame Contribute Delete

31.6 kB

<?xml version="1.0" encoding="utf-8" standalone="no"?>
<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN"
  "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
<svg xmlns:xlink="http://www.w3.org/1999/xlink" width="898.025937pt" height="593.744pt" viewBox="0 0 898.025937 593.744" xmlns="http://www.w3.org/2000/svg" version="1.1">
 <metadata>
  <rdf:RDF xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:cc="http://creativecommons.org/ns#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
   <cc:Work>
    <dc:type rdf:resource="http://purl.org/dc/dcmitype/StillImage"/>
    <dc:date>2026-10-31T07:43:20.148372</dc:date>
    <dc:format>image/svg+xml</dc:format>
    <dc:creator>
     <cc:Agent>
      <dc:title>Matplotlib v3.11.1, https://matplotlib.org/</dc:title>
     </cc:Agent>
    </dc:creator>
   </cc:Work>
  </rdf:RDF>
 </metadata>
 <defs>
  <style type="text/css">*{stroke-linejoin: round; stroke-linecap: butt}</style>
 </defs>
 <g id="figure_1">
  <g id="patch_1">
   <path d="M 0 593.744 
L 898.025937 593.744 
L 898.025937 0 
L 0 0 
z
" style="fill: #ffffff"/>
  </g>
  <g id="axes_1">
   <g id="patch_2">
    <path d="M 53.105938 235.897186 
L 890.825938 235.897186 
L 890.825938 97.92 
L 53.105938 97.92 
z
" style="fill: #ffffff"/>
   </g>
   <g id="matplotlib.axis_1">
    <g id="xtick_1">
     <g id="line2d_1">
      <defs>
       <path id="m8ed376938e" d="M 0 0 
L 0 3.5 
" style="stroke: #000000; stroke-width: 0.8"/>
      </defs>
      <g>
       <use xlink:href="#m8ed376938e" x="191.979306" y="235.897186" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_1">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="191.979306" y="252.015311" transform="rotate(-0 191.979306 252.015311)">Matched synthetic (~1K input)</text>
     </g>
    </g>
    <g id="xtick_2">
     <g id="line2d_2">
      <g>
       <use xlink:href="#m8ed376938e" x="471.965937" y="235.897186" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_2">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="471.965937" y="252.015311" transform="rotate(-0 471.965937 252.015311)">Short code (~90 input)</text>
     </g>
    </g>
    <g id="xtick_3">
     <g id="line2d_3">
      <g>
       <use xlink:href="#m8ed376938e" x="751.952569" y="235.897186" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_3">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="751.952569" y="252.015311" transform="rotate(-0 751.952569 252.015311)">Document (~4K input)</text>
     </g>
    </g>
   </g>
   <g id="matplotlib.axis_2">
    <g id="ytick_1">
     <g id="line2d_4">
      <path d="M 53.105938 235.897186 
L 890.825938 235.897186 
" clip-path="url(#p31a648b832)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_5">
      <defs>
       <path id="m371ac351f6" d="M 0 0 
L -3.5 0 
" style="stroke: #000000; stroke-width: 0.8"/>
      </defs>
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="235.897186" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_4">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="240.45578" transform="rotate(-0 46.105938 240.45578)">0</text>
     </g>
    </g>
    <g id="ytick_2">
     <g id="line2d_6">
      <path d="M 53.105938 204.538735 
L 890.825938 204.538735 
" clip-path="url(#p31a648b832)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_7">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="204.538735" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_5">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="209.097329" transform="rotate(-0 46.105938 209.097329)">10</text>
     </g>
    </g>
    <g id="ytick_3">
     <g id="line2d_8">
      <path d="M 53.105938 173.180283 
L 890.825938 173.180283 
" clip-path="url(#p31a648b832)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_9">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="173.180283" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_6">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="177.738877" transform="rotate(-0 46.105938 177.738877)">20</text>
     </g>
    </g>
    <g id="ytick_4">
     <g id="line2d_10">
      <path d="M 53.105938 141.821832 
L 890.825938 141.821832 
" clip-path="url(#p31a648b832)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_11">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="141.821832" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_7">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="146.380426" transform="rotate(-0 46.105938 146.380426)">30</text>
     </g>
    </g>
    <g id="ytick_5">
     <g id="line2d_12">
      <path d="M 53.105938 110.463381 
L 890.825938 110.463381 
" clip-path="url(#p31a648b832)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_13">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="110.463381" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_8">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="115.021974" transform="rotate(-0 46.105938 115.021974)">40</text>
     </g>
    </g>
    <g id="text_9">
     <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="23.953125" y="166.908593" transform="rotate(-90 23.953125 166.908593)">Median decode tokens/s</text>
    </g>
   </g>
   <g id="patch_3">
    <path d="M 91.184119 235.897186 
L 158.380911 235.897186 
L 158.380911 197.108085 
L 91.184119 197.108085 
z
" clip-path="url(#p31a648b832)" style="fill: #767676; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_4">
    <path d="M 371.17075 235.897186 
L 438.367542 235.897186 
L 438.367542 185.837317 
L 371.17075 185.837317 
z
" clip-path="url(#p31a648b832)" style="fill: #767676; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_5">
    <path d="M 651.157381 235.897186 
L 718.354173 235.897186 
L 718.354173 191.082929 
L 651.157381 191.082929 
z
" clip-path="url(#p31a648b832)" style="fill: #767676; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_6">
    <path d="M 158.380911 235.897186 
L 225.577702 235.897186 
L 225.577702 150.286239 
L 158.380911 150.286239 
z
" clip-path="url(#p31a648b832)" style="fill: #3775ba; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_7">
    <path d="M 438.367542 235.897186 
L 505.564333 235.897186 
L 505.564333 131.251646 
L 438.367542 131.251646 
z
" clip-path="url(#p31a648b832)" style="fill: #3775ba; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_8">
    <path d="M 718.354173 235.897186 
L 785.550964 235.897186 
L 785.550964 139.788391 
L 718.354173 139.788391 
z
" clip-path="url(#p31a648b832)" style="fill: #3775ba; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_9">
    <path d="M 225.577702 235.897186 
L 292.774494 235.897186 
L 292.774494 145.215391 
L 225.577702 145.215391 
z
" clip-path="url(#p31a648b832)" style="fill: #0f4d92; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_10">
    <path d="M 505.564333 235.897186 
L 572.761125 235.897186 
L 572.761125 123.346628 
L 505.564333 123.346628 
z
" clip-path="url(#p31a648b832)" style="fill: #0f4d92; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_11">
    <path d="M 785.550964 235.897186 
L 852.747756 235.897186 
L 852.747756 131.38914 
L 785.550964 131.38914 
z
" clip-path="url(#p31a648b832)" style="fill: #0f4d92; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
   </g>
   <g id="patch_12">
    <path d="M 53.105938 235.897186 
L 53.105938 97.92 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="patch_13">
    <path d="M 53.105938 235.897186 
L 890.825938 235.897186 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="text_10">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="124.782515" y="195.383371" transform="rotate(-0 124.782515 195.383371)">12.4</text>
   </g>
   <g id="text_11">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="404.769146" y="184.112602" transform="rotate(-0 404.769146 184.112602)">16.0</text>
   </g>
   <g id="text_12">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="684.755777" y="189.358214" transform="rotate(-0 684.755777 189.358214)">14.3</text>
   </g>
   <g id="text_13">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="191.979306" y="148.561524" transform="rotate(-0 191.979306 148.561524)">27.3</text>
   </g>
   <g id="text_14">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="471.965937" y="129.526931" transform="rotate(-0 471.965937 129.526931)">33.4</text>
   </g>
   <g id="text_15">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="751.952569" y="138.063676" transform="rotate(-0 751.952569 138.063676)">30.6</text>
   </g>
   <g id="text_16">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="259.176098" y="143.490676" transform="rotate(-0 259.176098 143.490676)">28.9</text>
   </g>
   <g id="text_17">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="539.162729" y="121.621913" transform="rotate(-0 539.162729 121.621913)">35.9</text>
   </g>
   <g id="text_18">
    <text style="font-weight: 700; font-size: 11px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="819.14936" y="129.664425" transform="rotate(-0 819.14936 129.664425)">33.3</text>
   </g>
   <g id="text_19">
    <text style="font-size: 14px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="471.965937" y="91.92" transform="rotate(-0 471.965937 91.92)">A  Single-request decode (not aggregate throughput)</text>
   </g>
   <g id="legend_1">
    <g id="patch_14">
     <path d="M 62.105938 114.518438 
L 82.105938 114.518438 
L 82.105938 107.518438 
L 62.105938 107.518438 
z
" style="fill: #767676; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
    </g>
    <g id="text_20">
     <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: start" x="90.105938" y="114.518438" transform="rotate(-0 90.105938 114.518438)">Frozen v1 + MTP</text>
    </g>
    <g id="patch_15">
     <path d="M 193.83875 114.518438 
L 213.83875 114.518438 
L 213.83875 107.518438 
L 193.83875 107.518438 
z
" style="fill: #3775ba; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
    </g>
    <g id="text_21">
     <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: start" x="221.83875" y="114.518438" transform="rotate(-0 221.83875 114.518438)">v2 exact + MTP</text>
    </g>
    <g id="patch_16">
     <path d="M 320.243438 114.518438 
L 340.243438 114.518438 
L 340.243438 107.518438 
L 320.243438 107.518438 
z
" style="fill: #0f4d92; stroke: #000000; stroke-width: 0.8; stroke-linejoin: miter"/>
    </g>
    <g id="text_22">
     <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: start" x="348.243438" y="114.518438" transform="rotate(-0 348.243438 114.518438)">v2 fast + MTP</text>
    </g>
   </g>
  </g>
  <g id="axes_2">
   <g id="patch_17">
    <path d="M 53.105938 460.8 
L 417.332024 460.8 
L 417.332024 322.822814 
L 53.105938 322.822814 
z
" style="fill: #ffffff"/>
   </g>
   <g id="matplotlib.axis_3">
    <g id="xtick_4">
     <g id="line2d_14">
      <g>
       <use xlink:href="#m8ed376938e" x="69.661669" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_23">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="69.661669" y="476.917188" transform="rotate(-0 69.661669 476.917188)">1</text>
     </g>
    </g>
    <g id="xtick_5">
     <g id="line2d_15">
      <g>
       <use xlink:href="#m8ed376938e" x="116.963758" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_24">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="116.963758" y="476.917188" transform="rotate(-0 116.963758 476.917188)">2</text>
     </g>
    </g>
    <g id="xtick_6">
     <g id="line2d_16">
      <g>
       <use xlink:href="#m8ed376938e" x="211.567936" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_25">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="211.567936" y="476.917188" transform="rotate(-0 211.567936 476.917188)">4</text>
     </g>
    </g>
    <g id="xtick_7">
     <g id="line2d_17">
      <g>
       <use xlink:href="#m8ed376938e" x="400.776293" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_26">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="400.776293" y="476.917188" transform="rotate(-0 400.776293 476.917188)">8</text>
     </g>
    </g>
    <g id="text_27">
     <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="235.218981" y="492.917188" transform="rotate(-0 235.218981 492.917188)">Concurrent requests</text>
    </g>
   </g>
   <g id="matplotlib.axis_4">
    <g id="ytick_6">
     <g id="line2d_18">
      <path d="M 53.105938 460.8 
L 417.332024 460.8 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_19">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_28">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="465.358594" transform="rotate(-0 46.105938 465.358594)">0</text>
     </g>
    </g>
    <g id="ytick_7">
     <g id="line2d_20">
      <path d="M 53.105938 413.22166 
L 417.332024 413.22166 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_21">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="413.22166" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_29">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="417.780254" transform="rotate(-0 46.105938 417.780254)">50</text>
     </g>
    </g>
    <g id="ytick_8">
     <g id="line2d_22">
      <path d="M 53.105938 365.64332 
L 417.332024 365.64332 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_23">
      <g>
       <use xlink:href="#m371ac351f6" x="53.105938" y="365.64332" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_30">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="46.105938" y="370.201914" transform="rotate(-0 46.105938 370.201914)">100</text>
     </g>
    </g>
    <g id="text_31">
     <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="16.318125" y="391.811407" transform="rotate(-90 16.318125 391.811407)">Aggregate output tokens/s</text>
    </g>
   </g>
   <g id="line2d_24">
    <path d="M 69.661669 449.381091 
L 116.963758 438.56176 
L 211.567936 420.818174 
L 400.776293 399.646581 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #767676; stroke-width: 2.5; stroke-linecap: square"/>
    <defs>
     <path id="mb863dd1fc8" d="M 0 3.5 
C 0.928211 3.5 1.81853 3.131218 2.474874 2.474874 
C 3.131218 1.81853 3.5 0.928211 3.5 0 
C 3.5 -0.928211 3.131218 -1.81853 2.474874 -2.474874 
C 1.81853 -3.131218 0.928211 -3.5 0 -3.5 
C -0.928211 -3.5 -1.81853 -3.131218 -2.474874 -2.474874 
C -3.131218 -1.81853 -3.5 -0.928211 -3.5 0 
C -3.5 0.928211 -3.131218 1.81853 -2.474874 2.474874 
C -1.81853 3.131218 -0.928211 3.5 0 3.5 
z
" style="stroke: #767676"/>
    </defs>
    <g clip-path="url(#pad93dc8db5)">
     <use xlink:href="#mb863dd1fc8" x="69.661669" y="449.381091" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="116.963758" y="438.56176" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="211.567936" y="420.818174" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="400.776293" y="399.646581" style="fill: #767676; stroke: #767676"/>
    </g>
   </g>
   <g id="line2d_25">
    <path d="M 69.661669 436.030256 
L 116.963758 417.485354 
L 211.567936 391.700582 
L 400.776293 349.300858 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #3775ba; stroke-width: 2.5; stroke-linecap: square"/>
    <defs>
     <path id="me461699993" d="M -3.5 3.5 
L 3.5 3.5 
L 3.5 -3.5 
L -3.5 -3.5 
z
" style="stroke: #3775ba; stroke-linejoin: miter"/>
    </defs>
    <g clip-path="url(#pad93dc8db5)">
     <use xlink:href="#me461699993" x="69.661669" y="436.030256" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="116.963758" y="417.485354" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="211.567936" y="391.700582" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="400.776293" y="349.300858" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
    </g>
   </g>
   <g id="line2d_26">
    <path d="M 69.661669 434.306853 
L 116.963758 413.955449 
L 211.567936 377.994186 
L 400.776293 347.162312 
" clip-path="url(#pad93dc8db5)" style="fill: none; stroke: #0f4d92; stroke-width: 2.5; stroke-linecap: square"/>
    <defs>
     <path id="m2a41dffa0c" d="M 0 -3.5 
L -3.5 3.5 
L 3.5 3.5 
z
" style="stroke: #0f4d92; stroke-linejoin: miter"/>
    </defs>
    <g clip-path="url(#pad93dc8db5)">
     <use xlink:href="#m2a41dffa0c" x="69.661669" y="434.306853" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="116.963758" y="413.955449" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="211.567936" y="377.994186" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="400.776293" y="347.162312" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
    </g>
   </g>
   <g id="patch_18">
    <path d="M 53.105938 460.8 
L 53.105938 322.822814 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="patch_19">
    <path d="M 53.105938 460.8 
L 417.332024 460.8 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="text_32">
    <text style="font-size: 14px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="235.218981" y="316.822814" transform="rotate(-0 235.218981 316.822814)">B  Matched-workload concurrency</text>
   </g>
  </g>
  <g id="axes_3">
   <g id="patch_20">
    <path d="M 526.599851 460.8 
L 890.825938 460.8 
L 890.825938 322.822814 
L 526.599851 322.822814 
z
" style="fill: #ffffff"/>
   </g>
   <g id="matplotlib.axis_5">
    <g id="xtick_8">
     <g id="line2d_27">
      <g>
       <use xlink:href="#m8ed376938e" x="543.155582" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_33">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="543.155582" y="476.917188" transform="rotate(-0 543.155582 476.917188)">1</text>
     </g>
    </g>
    <g id="xtick_9">
     <g id="line2d_28">
      <g>
       <use xlink:href="#m8ed376938e" x="590.457671" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_34">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="590.457671" y="476.917188" transform="rotate(-0 590.457671 476.917188)">2</text>
     </g>
    </g>
    <g id="xtick_10">
     <g id="line2d_29">
      <g>
       <use xlink:href="#m8ed376938e" x="685.061849" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_35">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="685.061849" y="476.917188" transform="rotate(-0 685.061849 476.917188)">4</text>
     </g>
    </g>
    <g id="xtick_11">
     <g id="line2d_30">
      <g>
       <use xlink:href="#m8ed376938e" x="874.270206" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_36">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="874.270206" y="476.917188" transform="rotate(-0 874.270206 476.917188)">8</text>
     </g>
    </g>
    <g id="text_37">
     <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="708.712894" y="492.917188" transform="rotate(-0 708.712894 492.917188)">Concurrent requests</text>
    </g>
   </g>
   <g id="matplotlib.axis_6">
    <g id="ytick_9">
     <g id="line2d_31">
      <path d="M 526.599851 460.8 
L 890.825938 460.8 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_32">
      <g>
       <use xlink:href="#m371ac351f6" x="526.599851" y="460.8" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_38">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="519.599851" y="465.358594" transform="rotate(-0 519.599851 465.358594)">0</text>
     </g>
    </g>
    <g id="ytick_10">
     <g id="line2d_33">
      <path d="M 526.599851 414.807605 
L 890.825938 414.807605 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_34">
      <g>
       <use xlink:href="#m371ac351f6" x="526.599851" y="414.807605" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_39">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="519.599851" y="419.366198" transform="rotate(-0 519.599851 419.366198)">2</text>
     </g>
    </g>
    <g id="ytick_11">
     <g id="line2d_35">
      <path d="M 526.599851 368.815209 
L 890.825938 368.815209 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_36">
      <g>
       <use xlink:href="#m371ac351f6" x="526.599851" y="368.815209" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_40">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="519.599851" y="373.373803" transform="rotate(-0 519.599851 373.373803)">4</text>
     </g>
    </g>
    <g id="ytick_12">
     <g id="line2d_37">
      <path d="M 526.599851 322.822814 
L 890.825938 322.822814 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #b0b0b0; stroke-opacity: 0.16; stroke-width: 0.8; stroke-linecap: square"/>
     </g>
     <g id="line2d_38">
      <g>
       <use xlink:href="#m371ac351f6" x="526.599851" y="322.822814" style="stroke: #000000; stroke-width: 0.8"/>
      </g>
     </g>
     <g id="text_41">
      <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: end" x="519.599851" y="327.381407" transform="rotate(-0 519.599851 327.381407)">6</text>
     </g>
    </g>
    <g id="text_42">
     <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="505.082038" y="391.811407" transform="rotate(-90 505.082038 391.811407)">Median TTFT (seconds)</text>
    </g>
   </g>
   <g id="line2d_39">
    <path d="M 543.155582 443.837024 
L 590.457671 440.383283 
L 685.061849 418.541109 
L 874.270206 345.253945 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #767676; stroke-width: 2.5; stroke-linecap: square"/>
    <g clip-path="url(#p769d3eaad8)">
     <use xlink:href="#mb863dd1fc8" x="543.155582" y="443.837024" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="590.457671" y="440.383283" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="685.061849" y="418.541109" style="fill: #767676; stroke: #767676"/>
     <use xlink:href="#mb863dd1fc8" x="874.270206" y="345.253945" style="fill: #767676; stroke: #767676"/>
    </g>
   </g>
   <g id="line2d_40">
    <path d="M 543.155582 449.069202 
L 590.457671 447.492397 
L 685.061849 434.328759 
L 874.270206 360.669802 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #3775ba; stroke-width: 2.5; stroke-linecap: square"/>
    <g clip-path="url(#p769d3eaad8)">
     <use xlink:href="#me461699993" x="543.155582" y="449.069202" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="590.457671" y="447.492397" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="685.061849" y="434.328759" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
     <use xlink:href="#me461699993" x="874.270206" y="360.669802" style="fill: #3775ba; stroke: #3775ba; stroke-linejoin: miter"/>
    </g>
   </g>
   <g id="line2d_41">
    <path d="M 543.155582 453.504079 
L 590.457671 451.441146 
L 685.061849 438.995337 
L 874.270206 394.002853 
" clip-path="url(#p769d3eaad8)" style="fill: none; stroke: #0f4d92; stroke-width: 2.5; stroke-linecap: square"/>
    <g clip-path="url(#p769d3eaad8)">
     <use xlink:href="#m2a41dffa0c" x="543.155582" y="453.504079" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="590.457671" y="451.441146" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="685.061849" y="438.995337" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
     <use xlink:href="#m2a41dffa0c" x="874.270206" y="394.002853" style="fill: #0f4d92; stroke: #0f4d92; stroke-linejoin: miter"/>
    </g>
   </g>
   <g id="patch_21">
    <path d="M 526.599851 460.8 
L 526.599851 322.822814 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="patch_22">
    <path d="M 526.599851 460.8 
L 890.825938 460.8 
" style="fill: none; stroke: #000000; stroke-width: 1.8; stroke-linejoin: miter; stroke-linecap: square"/>
   </g>
   <g id="text_43">
    <text style="font-size: 14px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="708.712894" y="316.822814" transform="rotate(-0 708.712894 316.822814)">C  Matched-workload first token</text>
   </g>
  </g>
  <g id="text_44">
   <text style="font-weight: 700; font-size: 19px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle" x="441.545937" y="21.637031" transform="rotate(-0 441.545937 21.637031)">Runtime v2 — faster serving, unchanged NVFP4 weights</text>
  </g>
  <g id="text_45">
   <text style="font-size: 12px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; text-anchor: middle; fill: #4d4d4d" x="441.545937" y="40.464" transform="rotate(-0 441.545937 40.464)">Final validation on one DGX Spark • W4A4 + MTP • October 31, 2026</text>
  </g>
  <g id="text_46">
   <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; fill: #4d4d4d" transform="translate(206.4975 533.303375)">Exactly 256 output tokens • greedy • no prefix-cache hits • 0 errors in final performance runs</text>
   <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; fill: #4d4d4d" transform="translate(203.142812 549.303375)">Matched: 8 requests/level; code/document: 4 at c=1 • final results, not earlier screening peaks</text>
   <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; fill: #4d4d4d" transform="translate(168.685 565.303375)">Exact preserves reference routing math; fast changes FP32 reduction order and may change generated text.</text>
   <text style="font-size: 10px; font-family: 'DejaVu Sans', 'Arial', 'Helvetica', sans-serif; fill: #4d4d4d" transform="translate(246.512344 581.164313)">Source: runtime-v2/runs/final_*/{perf_matched,screen_code,screen_doc}.json</text>
  </g>
 </g>
 <defs>
  <clipPath id="p31a648b832">
   <rect x="53.105938" y="97.92" width="837.72" height="137.977186"/>
  </clipPath>
  <clipPath id="pad93dc8db5">
   <rect x="53.105938" y="322.822814" width="364.226087" height="137.977186"/>
  </clipPath>
  <clipPath id="p769d3eaad8">
   <rect x="526.599851" y="322.822814" width="364.226087" height="137.977186"/>
  </clipPath>
 </defs>
</svg>