Update README.md

.gitattributes

@@ -34,11 +34,3 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 tokenizer.json filter=lfs diff=lfs merge=lfs -text
-assets/bench_cn1.png filter=lfs diff=lfs merge=lfs -text
-assets/bench_en2.png filter=lfs diff=lfs merge=lfs -text
-assets/bench_cn2.png filter=lfs diff=lfs merge=lfs -text
-assets/bench_en1.png filter=lfs diff=lfs merge=lfs -text
-assets/benchmark_appendix_en_reasoning.png filter=lfs diff=lfs merge=lfs -text
-assets/benchmark_appendix_en_multimodal.png filter=lfs diff=lfs merge=lfs -text
-assets/benchmark_appendix_cn_reasoning.png filter=lfs diff=lfs merge=lfs -text
-assets/benchmark_appendix_cn_multimodal.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -14,8 +14,10 @@ tags:
 
 ---
 
+<!-- DRAFT: Replace all [TO FILL] fields before release. -->
+
 <p align="left">
-  <a href="https://huggingface.co/dots-studio/dots3-note-prev-fp8/blob/main/README_CN.md">中文</a>&nbsp;｜&nbsp;English
+  <a href="https://huggingface.co/dots-studio/dots-3-note-prev-fp8/blob/main/README_CN.md">中文</a>&nbsp;｜&nbsp;English
 </p>
 <br>
 
@@ -25,13 +27,13 @@ tags:
 </div>
 
 <div align="center" style="line-height: 1;">
-  <a href="https://github.com/studio-dots-ai/dots3-note-prev"><img alt="GitHub: studio-dots-ai" src="https://img.shields.io/badge/GitHub-studio--dots--ai-181717?logo=github&amp;logoColor=white" /></a>
-  <a href="https://github.com/huggingface/transformers/pull/47844"><img alt="Transformers: dots3-note" src="https://img.shields.io/badge/Transformers-dots3--note-yellow" /></a>
-  <a href="https://github.com/sgl-project/sglang/pull/33829"><img alt="SGLang: dots3-note" src="https://img.shields.io/badge/SGLang-dots3--note-blue" /></a>
-  <a href="https://recipes.vllm.ai/dots-studio/dots3-note-prev"><img alt="vLLM: dots3-note" src="https://img.shields.io/badge/vLLM-dots3--note-red" /></a>
-  <a href="https://modelscope.cn/collections/dots-studio/dots3-note"><img alt="ModelScope: dots-studio" src="https://img.shields.io/badge/ModelScope-dots--studio-624AFF" /></a>
-
-  <a href="https://www.xiaohongshu.com/user/profile/683ffe42000000001d021a4c"><img alt="Dots Studio" src="https://img.shields.io/badge/RedNote-Dots%20Studio-FF2442" /></a>
+  <a href="https://studio.dots.ai/dots/dots3-en.html"><img alt="Blog: dots3" src="https://img.shields.io/badge/Blog-dots3-blue" /></a>
+  <a href="https://www.xiaohongshu.com/user/profile/683ffe42000000001d021a4c?xsec_token=YB7FKyZcxokO1lQbgGrFVcPREY5pD95pemGAVktUdvQ8c%3D&amp;xsec_source=app_share&amp;shareRedId=ODY0QTlGNTs2NzUyOTgwNjY0OTc7PkxL&amp;apptime=1786629429&amp;share_id=4537ac010ec1466d88b7a18f8362b763&amp;share_channel=copy_link&amp;appuid=602a6a1200000000010079fb&amp;xhsshare=CopyLink"><img alt="RedNote: dots-studio" src="https://img.shields.io/badge/RedNote-dots--studio-red" /></a>
+  <a href="https://modelscope.cn/organization/dots-studio"><img alt="ModelScope: dots-studio" src="https://img.shields.io/badge/ModelScope-dots--studio-624AFF" /></a>
+  <a href="https://github.com/studio-dots-ai"><img alt="GitHub: studio-dots-ai" src="https://img.shields.io/badge/GitHub-studio--dots--ai-181717?logo=github&amp;logoColor=white" /></a>
+  <a href="https://github.com/huggingface/transformers"><img alt="Transformers: dots3-note" src="https://img.shields.io/badge/Transformers-dots3--note-yellow" /></a>
+  <a href="https://github.com/sgl-project/sglang"><img alt="SGLang: dots3-note" src="https://img.shields.io/badge/SGLang-dots3--note-blue" /></a>
+  <a href="https://github.com/vllm-project/vllm"><img alt="vLLM: dots3-note" src="https://img.shields.io/badge/vLLM-dots3--note-red" /></a>
   <a href="https://discord.gg/haym6hEUE"><img alt="Discord" src="https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&amp;logoColor=white" /></a>
   <a href="https://x.com/dotsstudioai"><img alt="X: dotsstudioai" src="https://img.shields.io/badge/X-%40dotsstudioai-black" /></a>
   <a href="#license"><img alt="License: Apache 2.0" src="https://img.shields.io/badge/License-Apache%202.0-blue" /></a>
@@ -39,12 +41,11 @@ tags:
 
 <p align="center">
   🌐&nbsp;<a href="https://studio.dots.ai/dots/dots3-en.html"><b>Tech Blog</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
+  📕&nbsp;<a href="https://xhslink.cn/m/7vLoWFQV0wN"><b>Dots Studio</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
   📄&nbsp;<b>Full Report (coming soon)</b>
 </p>
 
-<div align="center">
-  <h3>Try <b>dots3-note Preview</b> for free at&nbsp;<a href="https://openrouter.ai/dots-studio/dots-3-note-preview:free" style="vertical-align: middle;"><img alt="OpenRouter: dots3-note" src="https://img.shields.io/badge/OpenRouter-dots3--note-6366F1?logo=openrouter&amp;logoColor=white" /></a></h3>
-</div>
+<!-- TODO: Add the Technical Report link when available. -->
 
 ---
 
@@ -52,38 +53,45 @@ tags:
 ## Table of Contents
 
 - [Model Introduction](#model-introduction)
-- [Model Overview](#model-overview)
-- [Evaluation Results](#evaluation-results)
-  - [General Reasoning and Agent](#general-reasoning-and-agent)
-  - [Multimodal Understanding](#multimodal-understanding)
+- [Multimodal Capabilities](#multimodal-capabilities)
+- [Benchmark Eval](#benchmark-eval)
+- [News](#news)
 - [Model Links](#model-links)
 - [Quickstart](#quickstart)
 - [Deployment](#deployment)
   - [Transformers](#transformers)
   - [SGLang](#sglang)
   - [vLLM](#vllm)
-- [Benchmark Appendix](#benchmark-appendix)
 - [License](#license)
+- [Citation](#citation)
 - [Contact Us](#contact-us)
 
 ---
 
 ## Model Introduction
 
-dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and produces text outputs.
-
+dots3-note preview is the first open-weight model in the dots-3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, and audio, and produces text outputs.
 dots3-note preview is optimized for a broad range of tasks, including:
+general knowledge and instruction following;
+mathematical and logical reasoning;
+tool use and multi-step agent workflows;
+interactive tasks that require exploration, memory updates, and adaptation.
+code generation and code-based problem solving;
+image, document, chart, audio and video understanding;
+long-context information processing;
+The dots-3 family is designed to include models with different trade-offs among capability, latency, and inference cost. dots3-note preview is the most lightweight member of the family.
+
+<!--
+
+TODO: Add the final architecture figure and uncomment the block below.
+
+<p align="center">
 
-- General knowledge and instruction following;
-- Mathematical and logical reasoning;
-- Tool use and multi-step agent workflows;
-- Interactive tasks that require exploration, memory updates, and adaptation;
-- Code generation and code-based problem solving;
-- Image, document, chart, audio, and video understanding;
-- Long-context information processing.
+  <img src="assets/architecture.png" width="100%"/>
 
-The dots3 family is designed to include models with different trade-offs among capability, latency, and inference cost. dots3-note preview is the most lightweight member of the family.
+</p>
 
+-->
 
 
 ## Model Overview
@@ -95,10 +103,10 @@ The dots3 family is designed to include models with different trade-offs among c
 | Activated Parameters | 16B |
 | MTP | 1 shared layer, 1.13B |
 | Number of Layers | 1 dense + 45 MoE |
-| Hidden Size | 5120 |
-| FFN Hidden Size | 13824 (dense), 1536 (per expert) |
+| Hidden Size | 5,120 |
+| FFN Hidden Size | 13,824 (dense), 1,536 (per expert) |
 | Experts | 256 routed + 1 shared, top-8 |
-| Attention | 13 DSA + 33 SWA (~1:3) |
+| Attention | MLA, 13 full + 33 SWA (~1:3) |
 | DSA | Top-2048 |
 | Context Length | 512K |
 | Vocabulary Size | 152K |
@@ -113,18 +121,13 @@ The dots3 family is designed to include models with different trade-offs among c
 
 ### General Reasoning and Agent
 
-![General Reasoning and Agent evaluation results](assets/bench_en1.png)
-
-### Multimodal Understanding
-
-![Multimodal Understanding evaluation results](assets/bench_en2.png)
 
 ## Model Links
 
 | Model Name | Description | HuggingFace | ModelScope |
 | --- | --- | --- | --- |
-| dots3-note-prev | Preview multimodal model | 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev) | <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" />&nbsp;<a href="https://modelscope.cn/models/dots-studio/dots3-note-prev">Model</a></span> |
-| dots3-note-prev-fp8 | FP8-quantized preview multimodal model | 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev-fp8) | <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" />&nbsp;<a href="https://modelscope.cn/models/dots-studio/dots3-note-prev-fp8">Model</a></span> |
+| dots3-note-prev | Preview multimodal model | 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev) | <img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" /> [Model](https://modelscope.cn/models/dots-studio/dots3-note-prev) |
+| dots3-note-prev-fp8 | FP8-quantized preview multimodal model | 🤗 [Model](https://huggingface.co/dots-studio/dots3-note-prev-fp8) | <img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" /> [Model](https://modelscope.cn/models/dots-studio/dots3-note-prev-fp8) |
 
 ## Quickstart
 
@@ -175,7 +178,7 @@ Video inputs include their audio track when available.
 
 The commands below target FP8 on one 8-GPU node. BF16 requires more memory. Tune the context length to available memory, concurrency, and input modalities.
 
-Native support is available on [vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) `main`. [Transformers #47844](https://github.com/huggingface/transformers/pull/47844) and [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829) are still under review; until they are merged, use the PR revisions below.
+Native support is available on [vLLM](https://github.com/vllm-project/vllm) `main`. [Transformers #47844](https://github.com/huggingface/transformers/pull/47844) and [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829) are still under review; until they are merged, use the PR revisions below.
 
 ### Transformers
 
@@ -208,7 +211,7 @@ outputs = model.generate(**inputs, max_new_tokens=128)
 print(processor.decode(outputs[0, inputs.input_ids.shape[1] :], skip_special_tokens=True))
 ```
 
-Use SGLang or vLLM for multi-GPU OpenAI-compatible serving.
+The first FP8 run downloads `kernels-community/finegrained-fp8` from the Hugging Face Hub unless cached. Use SGLang or vLLM for multi-GPU OpenAI-compatible serving.
 
 ### SGLang
 
@@ -221,8 +224,8 @@ Docker (the image downloads the checkpoint from Hugging Face on first run):
 docker run --gpus all --ipc=host -p 8000:8000 \
   lmsysorg/sglang:dev-dots3-note \
   sglang serve \
-    --model-path dots-studio/dots3-note-prev-fp8 \
-    --served-model-name dots3-note-prev \
+    --model-path dots-studio/dots-3-note-prev-fp8 \
+    --served-model-name dots-3-note-prev \
     --host 0.0.0.0 \
     --port 8000 \
     --context-length 524288 \
@@ -240,7 +243,7 @@ docker run --gpus all --ipc=host -p 8000:8000 \
     --speculative-num-steps 3 \
     --speculative-eagle-topk 1 \
     --speculative-num-draft-tokens 4 \
-    --speculative-draft-model-path dots-studio/dots3-note-prev-fp8
+    --speculative-draft-model-path dots-studio/dots-3-note-prev-fp8
 ```
 
 Or install from source / the PR and run the same `sglang serve` arguments locally. `--attention-backend fa3` sets prefill, decode, and (when speculative decoding is enabled) draft attention. MTP/NEXTN (`--speculative-algorithm NEXTN` and the related flags) is optional and can reduce TPOT by more than 50%. Prefill CUDA graph is not supported yet.
@@ -257,7 +260,7 @@ Optional features:
 
 ### vLLM
 
-Native dots3-note preview support is available on [vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) `main`. Use a recent nightly build until it is included in a stable release.
+Native dots3-note preview support is available on [vLLM](https://github.com/vllm-project/vllm) `main`. Use a recent nightly build until it is included in a stable release.
 
 The following example deploys the FP8 checkpoint on eight NVIDIA H100 GPUs with TP=8 and EP=8:
 
@@ -282,15 +285,8 @@ Optional features:
 
 # Enable OpenAI-compatible automatic tool calling
 --enable-auto-tool-choice --tool-call-parser dots
-
 ```
 
-## Benchmark Appendix
-
-![General Reasoning and Agent benchmark appendix](assets/benchmark_appendix_en_reasoning.png)
-
-![Multimodal benchmark appendix](assets/benchmark_appendix_en_multimodal.png)
-
 ## License
 
 Copyright (c) 2026 Xiaohongshu.

README_CN.md

@@ -1,296 +0,0 @@
-<p align="left">
-  <a href="https://huggingface.co/dots-studio/dots3-note-prev-fp8">English</a>&nbsp;｜&nbsp;中文
-</p>
-<br>
-
-<div align="center">
-  <img src="assets/dots%20logo@3x.png" alt="dots logo" width="200" />
-  <h1>dots3-note Preview</h1>
-</div>
-
-<div align="center" style="line-height: 1;">
-  <a href="https://github.com/studio-dots-ai/dots3-note-prev"><img alt="GitHub: studio-dots-ai" src="https://img.shields.io/badge/GitHub-studio--dots--ai-181717?logo=github&amp;logoColor=white" /></a>
-  <a href="https://github.com/huggingface/transformers/pull/47844"><img alt="Transformers: dots3-note" src="https://img.shields.io/badge/Transformers-dots3--note-yellow" /></a>
-  <a href="https://github.com/sgl-project/sglang/pull/33829"><img alt="SGLang: dots3-note" src="https://img.shields.io/badge/SGLang-dots3--note-blue" /></a>
-  <a href="https://recipes.vllm.ai/dots-studio/dots3-note-prev"><img alt="vLLM: dots3-note" src="https://img.shields.io/badge/vLLM-dots3--note-red" /></a>
-  <a href="https://modelscope.cn/collections/dots-studio/dots3-note"><img alt="ModelScope: dots-studio" src="https://img.shields.io/badge/ModelScope-dots--studio-624AFF" /></a>
-
-  <a href="https://www.xiaohongshu.com/user/profile/683ffe42000000001d021a4c"><img alt="Dots Studio" src="https://img.shields.io/badge/RedNote-Dots%20Studio-FF2442" /></a>
-  <a href="https://discord.gg/haym6hEUE"><img alt="Discord" src="https://img.shields.io/badge/Discord-Join-5865F2?logo=discord&amp;logoColor=white" /></a>
-  <a href="https://x.com/dotsstudioai"><img alt="X: dotsstudioai" src="https://img.shields.io/badge/X-%40dotsstudioai-black" /></a>
-  <a href="#许可证"><img alt="License: Apache 2.0" src="https://img.shields.io/badge/License-Apache%202.0-blue" /></a>
-</div>
-
-<p align="center">
-  🌐&nbsp;<a href="https://studio.dots.ai/dots/dots3-zh.html"><b>技术博客</b></a>&nbsp;&nbsp;|&nbsp;&nbsp;
-  📄&nbsp;<b>完整报告（即将发布）</b>
-</p>
-
-<div align="center">
-  <h3>免费体验 <b>dots3-note Preview</b>&nbsp;<a href="https://openrouter.ai/dots-studio/dots-3-note-preview:free" style="vertical-align: middle;"><img alt="OpenRouter: dots3-note" src="https://img.shields.io/badge/OpenRouter-dots3--note-6366F1?logo=openrouter&amp;logoColor=white" /></a></h3>
-</div>
-
----
-
-## 目录
-
-- [模型介绍](#模型介绍)
-- [模型概览](#模型概览)
-- [评测结果](#评测结果)
-  - [通用推理与智能体](#通用推理与智能体)
-  - [多模态理解](#多模态理解)
-- [模型链接](#模型链接)
-- [快速开始](#快速开始)
-- [部署](#部署)
-  - [Transformers](#transformers)
-  - [SGLang](#sglang)
-  - [vLLM](#vllm)
-- [评测附录](#评测附录)
-- [许可证](#许可证)
-- [联系我们](#联系我们)
-
----
-
-## 模型介绍
-
-dots3-note preview 是 dots3 系列首个开放权重模型。该模型采用混合专家（Mixture-of-Experts，MoE）架构，总参数量为 280B，激活参数量为 16B，支持最长 512K 个 token 的上下文。模型支持文本、图像、视频和音频理解，并生成文本输出。
-
-dots3-note preview 针对以下任务进行了优化：
-
-- 通用知识与指令遵循；
-- 数学与逻辑推理；
-- 工具使用与多步骤智能体工作流；
-- 需要探索、记忆更新和适应能力的交互式任务；
-- 代码生成与基于代码的问题求解；
-- 图像、文档、图表、音频和视频理解；
-- 长上下文信息处理。
-
-dots3 系列包含在能力、时延和推理成本之间采用不同权衡的多款模型，dots3-note preview 是该系列中最轻量级的成员。
-
-## 模型概览
-
-| 属性 | 值 |
-| :--- | :--- |
-| 架构 | 多模态混合专家模型（MoE） |
-| 总参数量 | 280B |
-| 激活参数量 | 16B |
-| MTP | 1 个共享层，1.13B 参数 |
-| 层数 | 1 个稠密层 + 45 个 MoE 层 |
-| 隐藏层维度 | 5120 |
-| FFN 中间层维度 | 13824（稠密层），1536（每个专家） |
-| 专家数量 | 256 个路由专家 + 1 个共享专家，Top-8 激活 |
-| 注意力机制 | 13 DSA + 33 SWA（约 1:3） |
-| DSA | Top-2048 |
-| 上下文长度 | 512K |
-| 词表大小 | 152K |
-| 视觉编码器 | MoE ViT，总参数量 7B，激活参数量 1.2B |
-| 音频编码器 | 稠密模型，800M |
-| 支持精度 | BF16、FP8 |
-| 输入 | 文本、图像、视频、音频 |
-| 输出 | 文本 |
-
-## 评测结果
-
-### 通用推理与智能体
-
-![通用推理与智能体评测结果](assets/bench_cn1.png)
-
-### 多模态理解
-
-![多模态理解评测结果](assets/bench_cn2.png)
-
-## 模型链接
-
-| 模型名称 | 简介 | Hugging Face | ModelScope |
-| --- | --- | --- | --- |
-| dots3-note-prev | 预览版多模态模型 | 🤗 [模型](https://huggingface.co/dots-studio/dots3-note-prev) | <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" />&nbsp;<a href="https://modelscope.cn/models/dots-studio/dots3-note-prev">模型</a></span> |
-| dots3-note-prev-fp8 | FP8 量化预览版多模态模型 | 🤗 [模型](https://huggingface.co/dots-studio/dots3-note-prev-fp8) | <span style="white-space: nowrap;"><img src="https://modelscope.cn/favicon.ico" width="16" alt="ModelScope" style="display: inline-block; vertical-align: middle; margin: 0;" />&nbsp;<a href="https://modelscope.cn/models/dots-studio/dots3-note-prev-fp8">模型</a></span> |
-
-## 快速开始
-
-建议使用 [SGLang](#sglang) 或 [vLLM](#vllm)，在单个 8 卡节点上部署 FP8 权重。
-
-```python
-from openai import OpenAI
-
-client = OpenAI(base_url="http://127.0.0.1:8000/v1", api_key="EMPTY")
-
-response = client.chat.completions.create(
-    model="dots3-note-prev",
-    messages=[
-        {"role": "user", "content": "你好！请简单介绍一下你自己。"},
-    ],
-    temperature=1.0,
-    top_p=0.95,
-    max_tokens=256,
-    # 启用推理时设置 enable_thinking=True；设置为 False 时直接回复。
-    extra_body={"chat_template_kwargs": {"enable_thinking": False}},
-)
-print(response.choices[0].message.content)
-```
-
-如需发起多模态请求，可将 `messages` 替换为以下任一公开示例：
-
-```python
-examples = {
-    "image": [
-        {"type": "image_url", "image_url": {"url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/cats.png"}},
-        {"type": "text", "text": "这张图片中有几只猫？"},
-    ],
-    "audio": [
-        {"type": "audio_url", "audio_url": {"url": "https://huggingface.co/datasets/hf-internal-testing/dummy-audio-samples/resolve/main/mary_had_lamb.mp3"}},
-        {"type": "text", "text": "请转写这段童谣。"},
-    ],
-    "video": [
-        {"type": "video_url", "video_url": {"url": "https://huggingface.co/datasets/merve/vlm_test_images/resolve/main/concert.mp4"}},
-        {"type": "text", "text": "请描述这场表演以及视频中可以听到的内容。"},
-    ],
-}
-messages = [{"role": "user", "content": examples["image"]}]
-```
-
-如果视频包含音轨，模型也会同时处理其中的音频。
-
-## 部署
-
-以下命令面向单个 8 卡节点上的 FP8 部署。BF16 需要更多显存，请根据可用显存、并发量和输入模态调整上下文长度。
-
-[vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) 的 `main` 分支已原生支持 dots3-note preview。[Transformers #47844](https://github.com/huggingface/transformers/pull/47844) 和 [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829) 仍在审核中；合并前请使用下文指定的 PR 版本。
-
-### Transformers
-
-请先安装 NVIDIA 驱动支持且相互兼容的 [PyTorch 和 torchvision](https://pytorch.org/get-started/locally/) 版本。若需处理音频和视频，还应安装与 PyTorch 兼容的 `torchcodec`（包含在下方命令中），并通过系统包管理器安装 FFmpeg。随后安装 [Transformers #47844](https://github.com/huggingface/transformers/pull/47844)：
-
-```bash
-pip install accelerate pillow torchcodec kernels==0.16.0 "transformers @ git+https://github.com/huggingface/transformers.git@refs/pull/47844/head"
-```
-
-运行最小化本地推理示例：
-
-```python
-from transformers import AutoModelForMultimodalLM, AutoProcessor
-
-model_id = "dots-studio/dots3-note-prev-fp8"
-processor = AutoProcessor.from_pretrained(model_id)
-model = AutoModelForMultimodalLM.from_pretrained(model_id, dtype="auto", device_map="auto")
-
-messages = [
-    {"role": "user", "content": "你好！请简单介绍一下你自己。"},
-]
-inputs = processor.tokenizer.apply_chat_template(
-    messages,
-    add_generation_prompt=True,
-    return_tensors="pt",
-    return_dict=True,
-    enable_thinking=False,
-).to(model.device)
-outputs = model.generate(**inputs, max_new_tokens=128)
-print(processor.decode(outputs[0, inputs.input_ids.shape[1] :], skip_special_tokens=True))
-```
-
-如需提供多 GPU、兼容 OpenAI API 的服务，请使用 SGLang 或 vLLM。
-
-### SGLang
-
-推荐使用发布镜像 [lmsysorg/sglang:dev-dots3-note](https://hub.docker.com/r/lmsysorg/sglang/tags)。完整的单节点部署方案和调优说明请参阅 [Dots3-Note cookbook](https://github.com/sgl-project/sglang/blob/main/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx)。源码支持进展请参阅 [SGLang #33829](https://github.com/sgl-project/sglang/pull/33829)。
-
-Docker 部署（首次运行时，镜像会从 Hugging Face 下载模型权重）：
-
-```bash
-docker run --gpus all --ipc=host -p 8000:8000 \
-  lmsysorg/sglang:dev-dots3-note \
-  sglang serve \
-    --model-path dots-studio/dots3-note-prev-fp8 \
-    --served-model-name dots3-note-prev \
-    --host 0.0.0.0 \
-    --port 8000 \
-    --context-length 524288 \
-    --enable-dp-attention \
-    --dp-size 8 \
-    --tp-size 8 \
-    --ep-size 8 \
-    --moe-dense-tp-size 1 \
-    --page-size 64 \
-    --trust-remote-code \
-    --attention-backend fa3 \
-    --moe-a2a-backend deepep \
-    --enable-multimodal \
-    --speculative-algorithm NEXTN \
-    --speculative-num-steps 3 \
-    --speculative-eagle-topk 1 \
-    --speculative-num-draft-tokens 4 \
-    --speculative-draft-model-path dots-studio/dots3-note-prev-fp8
-```
-
-也可以从源码或相应 PR 安装，并在本地使用相同的 `sglang serve` 参数。`--attention-backend fa3` 会设置预填充、解码以及启用投机解码时的草稿模型注意力后端。MTP/NEXTN（`--speculative-algorithm NEXTN` 及相关参数）为可选功能，可将 TPOT 降低 50% 以上。目前尚不支持预填充阶段的 CUDA Graph。
-
-可选功能：
-
-```bash
-# 仅加载语言模型
---language-only
-
-# 启用兼容 OpenAI API 的工具调用
---tool-call-parser dots
-```
-
-### vLLM
-
-[vLLM](https://recipes.vllm.ai/dots-studio/dots3-note-prev) 的 `main` 分支已原生支持 dots3-note preview。在该功能进入稳定版本前，请使用较新的 nightly build。
-
-以下示例使用 8 张 NVIDIA H100 GPU，以 TP=8、EP=8 部署 FP8 权重：
-
-```bash
-vllm serve dots-studio/dots3-note-prev-fp8 \
-  --served-model-name dots3-note-prev \
-  --host 0.0.0.0 \
-  --tensor-parallel-size 8 \
-  --enable-expert-parallel \
-  --moe-backend deep_gemm \
-  --max-model-len 262144
-```
-
-可选功能：
-
-```bash
-# 仅加载语言模型
---language-model-only
-
-# 启用 3-token MTP 投机解码
---speculative-config '{"method":"mtp","num_speculative_tokens":3}'
-
-# 启用兼容 OpenAI API 的自动工具调用
---enable-auto-tool-choice --tool-call-parser dots
-```
-
-## 评测附录
-
-![通用推理与智能体评测附录](assets/benchmark_appendix_cn_reasoning.png)
-
-![多模态评测附录](assets/benchmark_appendix_cn_multimodal.png)
-
-## 许可证
-
-Copyright (c) 2026 Xiaohongshu.
-
-由 dots studio 开发并发布。
-
-本仓库中的 dots3-note preview 模型权重和建模代码基于 Apache License 2.0 发布。
-
-详情请参阅 LICENSE 文件。
-
-Transformers、SGLang、vLLM 及其他第三方软件适用其各自的许可证。
-
-## 联系我们
-
-如有问题或反馈，请通过以下方式联系我们：
-
-- 邮箱：dots-model-feedback@xiaohongshu.com
-
----
-
-<p align="center">
-
-<i>dots3-note preview is developed and released by dots studio.</i>
-
-</p>

config.json

@@ -94,7 +94,7 @@
   "rope_theta": 80000000.0,
   "routed_scaling_factor": 1.0,
   "scoring_func": "sigmoid",
-  "sliding_window_size": 513,
+  "sliding_window_size": 512,
   "swa_attention_gate_type": "headwise",
   "swa_kv_lora_rank": 1024,
   "swa_num_attention_heads": 64,