Instructions to use dots-studio/dots3-note-prev-fp8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use dots-studio/dots3-note-prev-fp8 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="dots-studio/dots3-note-prev-fp8")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("dots-studio/dots3-note-prev-fp8", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use dots-studio/dots3-note-prev-fp8 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "dots-studio/dots3-note-prev-fp8"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dots-studio/dots3-note-prev-fp8",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/dots-studio/dots3-note-prev-fp8

SGLang

How to use dots-studio/dots3-note-prev-fp8 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "dots-studio/dots3-note-prev-fp8" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dots-studio/dots3-note-prev-fp8",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "dots-studio/dots3-note-prev-fp8" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "dots-studio/dots3-note-prev-fp8",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use dots-studio/dots3-note-prev-fp8 with Docker Model Runner:
```
docker model run hf.co/dots-studio/dots3-note-prev-fp8
```

dots3-note-prev-fp8 / README.md

MegatronPrimer

Release dots3-note preview

5123155 about 17 hours ago

preview code

Raw

History Blame Contribute Delete

12.1 kB

	---

	license: apache-2.0
	library_name: transformers
	pipeline_tag: image-text-to-text
	tags:
	- dots3
	- dots3-note
	- audio
	- multimodal
	- long-context
	- agentic


	---

	<p align="left">
	<a href="https://huggingface.co/dots-studio/dots3-note-prev-fp8/blob/main/README_CN.md">中文</a> ｜ English
	</p>
	<br>

	<div align="center">
	<img src="assets/dots%20logo@3x.png" alt="dots logo" width="200" />
	<h1>dots3-note Preview</h1>
	</div>

	<div align="center" style="line-height: 1;">
	<a href="https://github.com/studio-dots-ai/dots3-note-prev"><img alt="GitHub: studio-dots-ai" src="https://img.shields.io/badge/GitHub-studio--dots--ai-181717?logo=github&logoColor=white" /></a>
	<a href="https://github.com/huggingface/transformers/pull/47844"><img alt="Transformers: dots3-note" src="https://img.shields.io/badge/Transformers-dots3--note-yellow" /></a>
	<a href="https://github.com/sgl-project/sglang/pull/33829"><img alt="SGLang: dots3-note" src="https://img.shields.io/badge/SGLang-dots3--note-blue" /></a>
	<a href="https://recipes.vllm.ai/dots-studio/dots3-note-prev"><img alt="vLLM: dots3-note" src="https://img.shields.io/badge/vLLM-dots3--note-red" /></a>
	<a href="https://modelscope.cn/collections/dots-studio/dots3-note"><img alt="ModelScope: dots-studio" src="https://img.shields.io/badge/ModelScope-dots--studio-624AFF" /></a>

	<a href="https://www.xiaohongshu.com/user/profile/683ffe42000000001d021a4c"><img alt="Dots Studio" src="https://img.shields.io/badge/RedNote-Dots%20Studio-FF2442" /></a>
	<a href="https://discord.gg/haym6hEUE"><img alt="Discord" src="https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&logoColor=white" /></a>
	<a href="https://x.com/dotsstudioai"><img alt="X: dotsstudioai" src="https://img.shields.io/badge/X-%40dotsstudioai-black" /></a>
	<a href="#license"><img alt="License: Apache 2.0" src="https://img.shields.io/badge/License-Apache%202.0-blue" /></a>
	</div>

	<p align="center">
	🌐 <a href="https://studio.dots.ai/dots/dots3-en.html"><b>Tech Blog</b></a>  \|
	📄 <b>Full Report (coming soon)</b>
	</p>

	---


	## Table of Contents

	- [Model Introduction](#model-introduction)
	- [Model Overview](#model-overview)
	- [Evaluation Results](#evaluation-results)
	- [General Reasoning and Agent](#general-reasoning-and-agent)
	- [Multimodal Understanding](#multimodal-understanding)
	- [Model Links](#model-links)
	- [Quickstart](#quickstart)
	- [Deployment](#deployment)
	- [Transformers](#transformers)
	- [SGLang](#sglang)
	- [vLLM](#vllm)
	- [Benchmark Appendix](#benchmark-appendix)
	- [License](#license)
	- [Contact Us](#contact-us)

	---

	## Model Introduction

	dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and produces text outputs.

	dots3-note preview is optimized for a broad range of tasks, including:

	- General knowledge and instruction following;
	- Mathematical and logical reasoning;
	- Tool use and multi-step agent workflows;
	- Interactive tasks that require exploration, memory updates, and adaptation;
	- Code generation and code-based problem solving;
	- Image, document, chart, audio, and video understanding;
	- Long-context information processing.

	The dots3 family is designed to include models with different trade-offs among capability, latency, and inference cost. dots3-note preview is the most lightweight member of the family.



	## Model Overview

	\| Property \| Value \|
	\| :--- \| :--- \|
	\| Architecture \| Multimodal MoE \|
	\| Total Parameters \| 280B \|
	\| Activated Parameters \| 16B \|
	\| MTP \| 1 shared layer, 1.13B \|
	\| Number of Layers \| 1 dense + 45 MoE \|
	\| Hidden Size \| 5120 \|
	\| FFN Hidden Size \| 13824 (dense), 1536 (per expert) \|
	\| Experts \| 256 routed + 1 shared, top-8 \|
	\| Attention \| 13 DSA + 33 SWA (~1:3) \|
	\| DSA \| Top-2048 \|
	\| Context Length \| 512K \|
	\| Vocabulary Size \| 152K \|
	\| Vision Encoder \| MoE ViT, 7B total, 1.2B activated \|
	\| Audio Encoder \| Dense, 800M \|
	\| Supported Precision \| BF16, FP8 \|
	\| Input \| Text, image, video, audio \|
	\| Output \| Text \|


	## Evaluation Results

	### General Reasoning and Agent

	![General Reasoning and Agent evaluation results](assets/bench_en1.png)

	### Multimodal Understanding

	![Multimodal Understanding evaluation results](assets/bench_en2.png)

	## Model Links

	\| Model Name \| Description \| HuggingFace \| ModelScope \|
	\| --- \| --- \| --- \| --- \|
	\| dots3-note-prev \| Preview multimodal model \| 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev) \| <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" /> <a href="https://modelscope.cn/models/dots-studio/dots3-note-prev">Model</a></span> \|
	\| dots3-note-prev-fp8 \| FP8-quantized preview multimodal model \| 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev-fp8) \| <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" /> <a href="https://modelscope.cn/models/dots-studio/dots3-note-prev-fp8">Model</a></span> \|

	## Quickstart

	Recommended: serve the FP8 checkpoint on one 8-GPU node with [SGLang](#sglang) or [vLLM](#vllm).

	```python
	from openai import OpenAI

	client = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="EMPTY")

	response = client.chat.completions.create(
	model="dots3-note-prev",
	messages=[
	{"role": "user", "content": "Hello! Can you briefly introduce yourself?"},
	],
	temperature=1.0,
	top_p=0.95,
	max_tokens=256,
	# Set enable_thinking=True for reasoning; False returns a direct response.
	extra_body={"chat_template_kwargs": {"enable_thinking": False}},
	)
	print(response.choices[0].message.content)
	```

	For a multimodal request, replace `messages` with one of these public examples:

	```python
	examples = {
	"image": [
	{"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/cats.png"}},
	{"type": "text", "text": "How many cats are in this image?"},
	],
	"audio": [
	{"type": "audio_url", "audio_url": {"url": "https://huggingface.co/datasets/hf-internal-testing/dummy-audio-samples/resolve/main/mary_had_lamb.mp3"}},
	{"type": "text", "text": "Transcribe this nursery rhyme."},
	],
	"video": [
	{"type": "video_url", "video_url": {"url": "https://huggingface.co/datasets/merve/vlm_test_images/resolve/main/concert.mp4"}},
	{"type": "text", "text": "Describe the performance and what can be heard."},
	],
	}
	messages = [{"role": "user", "content": examples["image"]}]
	```

	Video inputs include their audio track when available.

	## Deployment

	The commands below target FP8 on one 8-GPU node. BF16 requires more memory. Tune the context length to available memory, concurrency, and input modalities.

	Native support is available on [vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) `main`. [Transformers #47844](https://github.com/huggingface/transformers/pull/47844) and [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829) are still under review; until they are merged, use the PR revisions below.

	### Transformers

	First install mutually compatible [PyTorch and torchvision](https://pytorch.org/get-started/locally/) builds supported by your NVIDIA driver. For audio and video, also install a PyTorch-compatible `torchcodec` (included below) and FFmpeg with your system package manager. Then install [Transformers #47844](https://github.com/huggingface/transformers/pull/47844):

	```bash
	pip install accelerate pillow torchcodec kernels==0.16.0 "transformers @ git+https://github.com/huggingface/transformers.git@refs/pull/47844/head"
	```

	Run a minimal local inference:

	```python
	from transformers import AutoModelForMultimodalLM, AutoProcessor

	model_id = "dots-studio/dots3-note-prev-fp8"
	processor = AutoProcessor.from_pretrained(model_id)
	model = AutoModelForMultimodalLM.from_pretrained(model_id, dtype="auto", device_map="auto")

	messages = [
	{"role": "user", "content": "Hello! Please briefly introduce yourself."},
	]
	inputs = processor.tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	return_tensors="pt",
	return_dict=True,
	enable_thinking=False,
	).to(model.device)
	outputs = model.generate(**inputs, max_new_tokens=128)
	print(processor.decode(outputs[0, inputs.input_ids.shape[1] :], skip_special_tokens=True))
	```

	Use SGLang or vLLM for multi-GPU OpenAI-compatible serving.

	### SGLang


	Recommended: use the release image [lmsysorg/sglang:dev-dots3-note](https://hub.docker.com/r/lmsysorg/sglang/tags). Full one-node recipes and tuning notes are in the [Dots3-Note cookbook](https://github.com/sgl-project/sglang/blob/main/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx). Source support is tracked in [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829).

	Docker (the image downloads the checkpoint from Hugging Face on first run):

	```bash
	docker run --gpus all --ipc=host -p 8000:8000 \
	lmsysorg/sglang:dev-dots3-note \
	sglang serve \
	--model-path dots-studio/dots3-note-prev-fp8 \
	--served-model-name dots3-note-prev \
	--host 0.0.0.0 \
	--port 8000 \
	--context-length 524288 \
	--enable-dp-attention \
	--dp-size 8 \
	--tp-size 8 \
	--ep-size 8 \
	--moe-dense-tp-size 1 \
	--page-size 64 \
	--trust-remote-code \
	--attention-backend fa3 \
	--moe-a2a-backend deepep \
	--enable-multimodal \
	--speculative-algorithm NEXTN \
	--speculative-num-steps 3 \
	--speculative-eagle-topk 1 \
	--speculative-num-draft-tokens 4 \
	--speculative-draft-model-path dots-studio/dots3-note-prev-fp8
	```

	Or install from source / the PR and run the same `sglang serve` arguments locally. `--attention-backend fa3` sets prefill, decode, and (when speculative decoding is enabled) draft attention. MTP/NEXTN (`--speculative-algorithm NEXTN` and the related flags) is optional and can reduce TPOT by more than 50%. Prefill CUDA graph is not supported yet.

	Optional features:

	```bash
	# Load only the language model
	--language-only

	# Enable OpenAI-compatible tool calling
	--tool-call-parser dots
	```

	### vLLM

	Native dots3-note preview support is available on [vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) `main`. Use a recent nightly build until it is included in a stable release.

	The following example deploys the FP8 checkpoint on eight NVIDIA H100 GPUs with TP=8 and EP=8:

	```bash
	vllm serve dots-studio/dots3-note-prev-fp8 \
	--served-model-name dots3-note-prev \
	--host 0.0.0.0 \
	--tensor-parallel-size 8 \
	--enable-expert-parallel \
	--moe-backend deep_gemm \
	--max-model-len 262144
	```

	Optional features:

	```bash
	# Load only the language model
	--language-model-only

	# Enable three-token MTP speculative decoding
	--speculative-config '{"method":"mtp","num_speculative_tokens":3}'

	# Enable OpenAI-compatible automatic tool calling
	--enable-auto-tool-choice --tool-call-parser dots

	```

	## Benchmark Appendix

	![General Reasoning and Agent benchmark appendix](assets/benchmark_appendix_en_reasoning.png)

	![Multimodal benchmark appendix](assets/benchmark_appendix_en_multimodal.png)

	## License

	Copyright (c) 2026 Xiaohongshu.

	Developed and released by dots studio.

	The dots3-note preview model weights and modeling code in this repository are licensed under the Apache License, Version 2.0.

	See the LICENSE file for details.

	Transformers, SGLang, vLLM, and other third-party software are subject to their respective licenses.


	## Contact Us

	For questions and feedback, please contact us through:

	- Email: dots-model-feedback@xiaohongshu.com

	---

	<p align="center">

	<i>dots3-note preview is developed and released by dots studio.</i>

	</p>