Duplicate from nex-agi/Nex-N2-Pro

Co-authored-by: wang <guoteng@users.noreply.huggingface.co>

.eval_results/wildclawbench.yaml

@@ -0,0 +1,9 @@
+- dataset:
+    id: internlm/WildClawBench
+    task_id: overall
+  value: 53.5
+  date: "2026-05-22"
+  source:
+    url: https://internlm.github.io/WildClawBench
+    name: WildClawBench
+    user: internlm

.gitattributes

@@ -0,0 +1,37 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+figures/Nex-N2-Benchmark-white.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,191 @@
+---
+license: apache-2.0
+pipeline_tag: text-generation
+library_name: transformers
+---
+
+<div align="center">
+<img src="./figures/NEX_logo.svg" width="20%"/>
+</div>
+
+---
+
+<div align="center">
+🤗 <a href="https://hf.co/collections/nex-agi/nex-n2"><b>Model</b></a>&nbsp&nbsp | &nbsp&nbsp
+🔀 <a href="https://openrouter.ai/nex-agi/Nex-N2-Pro:free"><b>OpenRouter (Enjoy two weeks free starting June 9!)</b></a>&nbsp&nbsp | &nbsp&nbsp
+💻 <a href="https://github.com/nex-agi/Nex-N2"><b>Github</b></a>&nbsp&nbsp | &nbsp&nbsp
+🧭 <a href="https://www.modelscope.cn/collections/nex-agi/Nex-N2"><b>ModelScope</b></a>&nbsp&nbsp | &nbsp&nbsp
+🚀 <a href="https://nex-agi.com"><b>Nex-AGI</b></a>
+</div>
+
+# Nex-N2
+
+**An agentic model with Agentic Thinking.**
+
+Today, we are officially releasing and open-sourcing our next-generation model, **Nex-N2** — an agent model built for real-world productivity scenarios. With first-tier coding and agentic capabilities, Nex-N2 keeps driving complex, long-horizon tasks forward in real environments to deliver stable, end-to-end results.
+
+Over the past year, a paradigm shift led by Vibe Coding and Harness Engineering has been redefining the limits of LLM agents. From dialogue, to reasoning, to agents that execute long-horizon tasks with environmental feedback, the tasks models must handle keep growing harder, the contexts longer, and the environments more realistic. The core of next-generation model competition is no longer *whether a model can think*, but whether it can reliably and efficiently turn thinking into actions that are executable, verifiable, and iterable.
+
+Rather than treating reasoning, tool use, and environment execution as separate capabilities, Nex-N2 unifies them through an **Agentic Thinking** framework that connects requirement understanding, task planning, code implementation, environmental feedback, evaluation and debugging, and continuous iteration into a single closed loop. The framework has two parts:
+
+- **Adaptive Thinking** lets the model decide on its own when to think and how deeply — executing simple actions quickly while reasoning thoroughly on critical decisions.
+- **Coherent Thinking** carries one consistent reasoning paradigm across general reasoning and diverse agentic tasks, staying consistent across tasks and modalities to enable stable capability transfer.
+
+Across real agentic workflows — agentic coding, deep research, tool calling, and terminal execution — Nex-N2 reaches first-tier performance, with substantial gains over the previous-generation Nex-N1 on multiple authoritative benchmarks. In real productivity scenarios such as OpenClaw one-person-company workflows, end-to-end game development, and web and multimodal generation, it likewise demonstrates outstanding usability, robustness, and stability.
+
+## Open Source
+
+In keeping with our commitment to open source, we are releasing both **Nex-N2-Pro** and **Nex-N2-mini** as open-source models starting today.
+
+- **Nex-N2-Pro:** [Hugging Face](https://huggingface.co/nex-agi/Nex-N2-Pro) | [ModelScope](https://www.modelscope.cn/models/nex-agi/Nex-N2-Pro)
+- **Nex-N2-mini:** [Hugging Face](https://huggingface.co/nex-agi/Nex-N2-mini) | [ModelScope](https://www.modelscope.cn/models/nex-agi/Nex-N2-mini)
+- **Early Access:** [SiliconFlow](https://cloud.siliconflow.cn/me/models?target=nex-agi%2FNex-N2-Pro)
+
+We welcome developers and enterprises to integrate and try Nex-N2 and share their feedback.
+
+## Performance
+
+We evaluate Nex-N2 in real agentic workflows along three directions — agentic tasks, coding tasks, and general tasks — covering benchmarks across tool calling, search-based decision-making, software engineering, and terminal execution. Nex-N2-Pro delivers strong performance that keeps pace with top-tier models such as GPT-5.5 and Opus 4.7: it excels at coding (e.g., 75.3 on Terminal-Bench 2.1) and long-horizon tasks (1585 on GDPval), and shows especially strong generalization and competitiveness on newer benchmarks like SWE-Atlas and DeepSWE. On general capability and core reasoning, it stands on par with leading frontier models.
+
+![Nex-N2 Benchmark Overview](./figures/Nex-N2-Benchmark-white.png)
+
+Nex-N2 ships in two variants, both post-trained on the Qwen3.5 series: **Nex-N2-Pro** (built on `Qwen3.5-397B-A17B`) and **Nex-N2-mini** (built on `Qwen3.5-35B-A3B-Base`), covering different latency and quality trade-offs. The table below reports their scores alongside leading proprietary and open models across our full evaluation suite.
+
+| Benchmark | **Nex-N2-mini** | **Nex-N2-Pro** | GPT-5.5 | Opus 4.7 | Kimi-K2.6 | GLM-5.1 | MiniMax M3 | DeepSeek-V4-Pro |
+| --- | --- | --- | --- | --- | --- | --- | --- | --- |
+| **Agent** |  |  |  |  |  |  |  |  |
+| BrowseComp | 74.1 | 83.7 | 84.4 | 79.8 | 83.2 | 79.3 | 83.5 | 83.4 |
+| GDPval | 1402 | 1585 | 1769 | 1753 | 1481 | 1535 | - | 1554 |
+| Toolathlon | 33.3 | 51.9 | 55.6 | 52.8 | 50.0 | 40.7 | - | 51.8 |
+| WildClawBench | 47.7 | 53.5 | 58.2 | 62.2 | - | 48.2 | - | 43.7 |
+| WideSearch | 62.0 | 75.6 | - | - | 80.8 | - | - | - |
+| TAU3 | 65.9 | 71.1 | - | - | - | 70.6 | - | - |
+| **Coding & SWE** |  |  |  |  |  |  |  |  |
+| SWE-Bench Pro | 50.2 | 58.8 | 58.6 | 64.3 | 58.6 | 58.4 | 59.0 | 55.4 |
+| Terminal-Bench 2.1 | 60.7 | 75.3 | 83.4 | 69.7 | - | 58.7 | 66.0 | 72.0 |
+| DeepSWE | 8.0 | 33.6 | 70 | 54 | 24 | 18 | - | 8 |
+| SWE-Bench Verified | 74.4 | 80.8 | 82.9 | 87.6 | 80.2 | - | 80.5 | 80.6 |
+| SWE Atlas QnA | 31.5 | 37.9 | 45.4 | 45.2 | - | - | 37.9 | - |
+| SWE Atlas RF | 30.0 | 32.9 | 44.8 | 48.6 | - | - | - | - |
+| SWE Atlas TW | 23.3 | 40.0 | 42.6 | 38.2 | - | - | 30.8 | - |
+| **General & Reasoning** |  |  |  |  |  |  |  |  |
+| GPQA Diamond | 82.6 | 90.7 | 93.6 | 94.2 | 90.5 | 86.2 | - | 90.1 |
+| IFEval | 89.1 | 94.0 | - | - | 94.5 | 94.5 | - | 91.9 |
+| Apex | 9.4 | 36.5 | - | - | 24.0 | 11.5 | - | 38.3 |
+
+## Usage
+
+### Local Deployment
+
+> **Note:** For the best performance with Nex-series models, we recommend serving them with our customized `sglang` fork.
+
+First, install our `sglang` fork:
+
+```bash
+# Use the customized `sglang` fork
+git clone https://github.com/nex-agi/sglang.git
+cd sglang
+
+# Install the python packages
+pip install --upgrade pip
+pip install -e "python"
+```
+
+#### Nex-N2-Pro
+
+Launch the server (example on two 8× H100 servers with CUDA 13.0):
+
+```bash
+# Multi-node (2 nodes). Run the same command on every node with:
+#   <node-rank> = 0 on the head node, 1 on the other node
+#   <node0-ip>  = IP of the head node (reachable from all others)
+python -m sglang.launch_server \
+  --model-path /path/to/your/model  \
+  --tp 16 \
+  --nnodes 2 \
+  --node-rank <node-rank> \
+  --dist-init-addr <node0-ip>:20000 \
+  --reasoning-parser qwen3 \
+  --tool-call-parser qwen3_coder \
+  --mamba-scheduler-strategy extra_buffer
+```
+
+#### Nex-N2-mini
+
+Launch the server (example on one 2× H100 server with CUDA 13.0):
+
+```bash
+python -m sglang.launch_server \
+  --model-path /path/to/your/model  \
+  --tp 2 \
+  --reasoning-parser qwen3 \
+  --tool-call-parser qwen3_coder \
+  --mamba-scheduler-strategy extra_buffer
+```
+
+### Docker Deployment
+
+We also provide a prebuilt Docker image with our customized `sglang` fork preinstalled: **`nexagi/sglang:v0.5.12`**. The launch command is the same as above.
+
+#### Nex-N2-Pro
+
+```bash
+# Multi-node (2 nodes). Run the same command on every node with:
+#   <node-rank> = 0 on the head node, 1 on the other node
+#   <node0-ip>  = IP of the head node (reachable from all others)
+docker run --gpus all --shm-size 32g --network host \
+  -v /path/to/your/model:/model \
+  nexagi/sglang:v0.5.12 \
+  python3 -m sglang.launch_server \
+    --model-path /model \
+    --tp 16 \
+    --nnodes 2 \
+    --node-rank <node-rank> \
+    --dist-init-addr <node0-ip>:20000 \
+    --host 0.0.0.0 --port 30000 \
+    --reasoning-parser qwen3 \
+    --tool-call-parser qwen3_coder \
+    --mamba-scheduler-strategy extra_buffer
+```
+
+#### Nex-N2-mini
+
+Single node with 2× H100:
+
+```bash
+docker run --gpus all --shm-size 32g --ipc=host \
+  -p 30000:30000 \
+  -v /path/to/your/model:/model \
+  nexagi/sglang:v0.5.12 \
+  python3 -m sglang.launch_server \
+    --model-path /model \
+    --tp 2 \
+    --host 0.0.0.0 --port 30000 \
+    --reasoning-parser qwen3 \
+    --tool-call-parser qwen3_coder \
+    --mamba-scheduler-strategy extra_buffer
+```
+
+### Recommended Sampling Parameters
+
+For the best generation quality, we recommend the following sampling parameters:
+
+- `temperature`: 0.7
+- `top_p`: 0.95
+- `top_k`: 40
+
+### Function Calling
+
+Nex-series models support robust function-calling capabilities. To enable function calling, add the `--tool-call-parser qwen3_coder` flag when launching the server:
+
+```bash
+python -m sglang.launch_server --model-path /path/to/your/model --tool-call-parser qwen3_coder
+```
+
+### Reasoning Parser
+
+Nex-series models emit explicit reasoning traces. Add the `--reasoning-parser qwen3` flag to parse the reasoning content separately from the final response. It can be combined with the function-calling parser above:
+
+```bash
+python -m sglang.launch_server --model-path /path/to/your/model --tool-call-parser qwen3_coder --reasoning-parser qwen3
+```

chat_template.jinja

@@ -0,0 +1,154 @@
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- macro render_content(content, do_vision_count, is_system_content=false) %}
+    {%- if content is string %}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping %}
+        {%- for item in content %}
+            {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain images.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Picture ' ~ image_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
+            {%- elif 'video' in item or item.type == 'video' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain videos.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Video ' ~ video_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
+            {%- elif 'text' in item %}
+                {{- item.text }}
+            {%- else %}
+                {{- raise_exception('Unexpected item type in content.') }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif content is none or content is undefined %}
+        {{- '' }}
+    {%- else %}
+        {{- raise_exception('Unexpected content type.') }}
+    {%- endif %}
+{%- endmacro %}
+{%- if not messages %}
+    {{- raise_exception('No messages provided.') }}
+{%- endif %}
+{%- if tools and tools is iterable and tools is not mapping %}
+    {{- '<|im_start|>system\n' }}
+    {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>" }}
+    {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {%- if content %}
+            {{- '\n\n' + content }}
+        {%- endif %}
+    {%- endif %}
+    {{- '<|im_end|>\n' }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" %}
+        {%- set content = render_content(message.content, false)|trim %}
+        {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
+            {%- set ns.multi_step_tool = false %}
+            {%- set ns.last_query_index = index %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if ns.multi_step_tool %}
+    {{- raise_exception('No user query found in messages.') }}
+{%- endif %}
+{%- for message in messages %}
+    {%- set content = render_content(message.content, true)|trim %}
+    {%- if message.role == "system" %}
+        {%- if not loop.first %}
+            {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+        {%- endif %}
+    {%- elif message.role == "user" %}
+        {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is string %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in content %}
+                {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+                {%- set content = content.split('</think>')[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- set reasoning_content = reasoning_content|trim %}
+        {%- if reasoning_content %}
+            {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if tool_call.function is defined %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {%- if loop.first %}
+                    {%- if content|trim %}
+                        {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- else %}
+                        {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- endif %}
+                {%- else %}
+                    {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                {%- endif %}
+                {%- if tool_call.arguments is defined %}
+                    {%- for args_name, args_value in tool_call.arguments|items %}
+                        {{- '<parameter=' + args_name + '>\n' }}
+                        {%- set args_value = args_value | tojson | safe if args_value is mapping or (args_value is sequence and args_value is not string) else args_value | string %}
+                        {{- args_value }}
+                        {{- '\n</parameter>\n' }}
+                    {%- endfor %}
+                {%- endif %}
+                {{- '</function>\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content }}
+        {{- '\n</tool_response>' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>\n' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- else %}
+        {{- raise_exception('Unexpected message role.') }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- else %}
+        {{- '<think>' }}
+    {%- endif %}
+{%- endif %}

config.json

@@ -0,0 +1,143 @@
+{
+  "architectures": [
+    "Qwen3_5MoeForConditionalGeneration"
+  ],
+  "dtype": "bfloat16",
+  "hidden_size": 4096,
+  "image_token_id": 248056,
+  "model_type": "qwen3_5_moe",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": null,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 4096,
+    "initializer_range": 0.02,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 64,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "mlp_only_layers": [],
+    "model_type": "qwen3_5_moe_text",
+    "moe_intermediate_size": 1024,
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 32,
+    "num_experts": 512,
+    "num_experts_per_tok": 10,
+    "num_hidden_layers": 60,
+    "num_key_value_heads": 2,
+    "output_router_logits": false,
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "router_aux_loss_coef": 0.001,
+    "shared_expert_intermediate_size": 1024,
+    "tie_word_embeddings": false,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "5.2.0",
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 27,
+    "dtype": "bfloat16",
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1152,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4304,
+    "model_type": "qwen3_5_moe",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 4096,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_start_token_id": 248053
+}

model-00001-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9c6b016494d82f42e57f5c28d9ddffd5af8c81cf26c977dd36bdd864bda91ef
+size 3211703200

model-00002-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:39755f3246369adf0d8e253c3954e2b12da3bba655cdbc95b6c140ffcf385025
+size 8589934736

model-00003-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0f9a4df1d8d7a0900d76f31bdb1cd73a8eeee831777d452f50561daa394cb0e8
+size 4560382680

model-00004-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87299367bd7fa2917179e1af18058234d9101419789e3e71cfc463d348ac1db9
+size 8589934736

model-00005-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1550371623ae1753a6d080bbab426c2e0a67cf1031f32913f4a04efb4f268c24
+size 4560382680

model-00006-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e04efc7481e5342b28c093ce0ef0077e25b3b24da0e5fb4ca9a310c660bf057
+size 8589934736

model-00007-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:773cfa0af38128557108749b91ee961f497be20ce113fc1115e182d10398a22f
+size 4534070088

model-00008-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e1ced164923558b72a80b72a9b8baab5f5cde777130578c4b8b0e9e4e9e0a44
+size 8589934736

model-00009-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c9e9ac0530ca9ee24088094ad1f2ed4b51a4b4f305703606dca2c93772572593
+size 4560382680

model-00010-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20a32c4b0d3c1bf2dd36cfe5fd23a290a56e076b9bddcd8ed1bf0512f1731ad2
+size 8589934736

model-00011-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7fdf5a5f564003852482c2dd805f71c4cd0148a2863fc061c35b92ae2f874ee3
+size 4560382680

model-00012-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c806c8ddb98ffbf1574ce658f335948e189da93a0d47059c7e71022675d660c2
+size 8589934736

model-00013-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fb65d906542b45eedbb0f796db57be4cb071930efa8d7c57966ecce8112ba6a3
+size 4560382680

model-00014-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c276f507d63b241a46805566c08fede804c4408252655b41908a782df5625027
+size 8589934736

model-00015-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:832c42d23c4d03acc69a46ded7c206750a70afc2ba0935ce80a3d7e9fbbaf7fe
+size 4534070088

model-00016-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52c33531f26055a4ca69da5070379f3bd4b7e8f4daabec0ca00e26764f239517
+size 8589934736

model-00017-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c264e1214dd10553d6524ba8d93d9086816651c604b0edbbfd42cef0b6b796c9
+size 4560382680

model-00018-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:81c4bd4d0a85bd48c678e7cd1ba86ebbbe427a842f4e99635c0d166a9764dcde
+size 8589934736

model-00019-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fcbb2b7bb39a810fae67c53ad84a9f4e4f8fae482bd509a23a36f37c5f72107b
+size 4560382680

model-00020-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b9bd28a2b254d44f725d2f544011c1f9325441419c06f92b75f7346fa12d2a0f
+size 8589934736

model-00021-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c1ac48ba53225932cf34b9d40b41b9b8342ad2ee9aae9bce91ae9aeb93c9765
+size 4560382624

model-00022-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3f09d8da0e8338adcbe74c86a0bc13740f55e68574a6687ac495af86f97b3657
+size 8589934736

model-00023-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e0e2ad64c866dc1c6cbf6220d05a058582b5994c7cde402ecd26dada7f06672
+size 4534070104

model-00024-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67e45fe71206ccb6f335f54fe0e331517678475744d787840a2b069d0a85f822
+size 8589934736

model-00025-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8b741f4f99015e6692304c054fd2d0ba6933d8366662504b836fc935c5f3f502
+size 4560382696

model-00026-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0684065b05b6d21a3d905deb793da18c29be8ddb0139eaa63d39c28ee0ad638f
+size 8589934736

model-00027-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad8259eff54d6184549549b00adfb6708a20c9bc05db698d9375405cc0fa2d08
+size 4560382696

model-00028-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:69675e113b50a831697e5d1c7343511b398027843598915eabc634cb8ed38acc
+size 8589934736

model-00029-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c0ba63b2e81197304620dd80b8867dd23da64420f2aa2c1871d660e0cebc812
+size 4560382696

model-00030-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9c187ca41082b743d71d0a9e0ea5cc9ebf00a5b87a28c48177bad1b8ec5f8a8
+size 8589934736

model-00031-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c59a133f05d8e9adbf5c70190a1eda883f98097b5596e7a2dea41dedadc17d0e
+size 4534070104

model-00032-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:822c9d521ef7552ee3f1f4cadbc96f5d9fb127920ed5ffc0f61f2a2e3327ae5a
+size 8589934736

model-00033-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71ecae56174f3c7dce1f56fe05c7d8ad0f361d50c4d6fdaf536ddc49219f6415
+size 4560382696

model-00034-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94b12f986c694bd930e46c5db9daf8824147dfa5cddc54237212a0cc7afaa226
+size 8589934736

model-00035-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62c8d6a342c084bbe6b322f85dc8b0068d145b825c66d8a9b45bd735dfa90bb2
+size 4560382696

model-00036-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:03fca81caf611a9bdc19acba34b594e5f4893f820a3d13e4d136ba66fd858e95
+size 8589934736

model-00037-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:904e9b94e0a3199932e43fa5b28dbe7ee01785ff9e354b15129a0ddc5db85c9e
+size 4560382696

model-00038-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c2ffcd57a045e7d680629481c9d8e70a444e18b9a440efed48a80dc01ed6d51
+size 8589934736

model-00039-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5d4d970b2ddad62e5a13dd453e22366c4839eff5252da864e7dd15a29fa3c2b3
+size 4534070104

model-00040-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4b019b26dfb32f3e56ff0188aa2643cb349169ee96b405d6d744624abf9059e
+size 8589934736

model-00041-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:95f7bc9dceea0763bed6fb11cf3b05fecf6538d771cc26e170217d8894110da2
+size 4560382696

model-00042-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ab2d54cbff0deec4cefa4a4dd35ff3bc7969077348a35961fc903427693fd78b
+size 8589934736

model-00043-of-00122.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c98687161e665d6c84997bcfc76bb458e91247aa8bfd80894b1ebc39708f8793
+size 4560382696