Leon02 commited on
Commit
2daba46
·
verified ·
1 Parent(s): da4082b

Add ExoMind model card

Browse files
Files changed (1) hide show
  1. README.md +65 -113
README.md CHANGED
@@ -23,79 +23,46 @@ tags:
23
 
24
  <img src="./assets/ExoMind.png" alt="ExoMind" width="560">
25
 
26
- # ExoMind
27
-
28
- **Democratizing Scientific Intelligence via an Extended-Mind-Inspired Agentic System**
29
 
30
  **ExoMind Team · Shanghai Artificial Intelligence Laboratory**
31
 
32
  [Project Page](https://ai4sgi.github.io/ExoMind/) ·
33
  [GitHub](https://github.com/AI4SGI/ExoMind) ·
34
  [Technical Report](https://github.com/AI4SGI/ExoMind/blob/main/Paper.pdf) ·
 
35
  [ModelScope](https://modelscope.cn/models/AI4SGI/ExoMind/summary)
36
 
37
  </div>
38
 
39
  ## Overview
40
 
41
- ExoMind is an extended-mind-inspired agentic system for scientific reasoning
42
- and research. It organizes a language model, typed interaction objects, and
43
- autonomous interaction processes as one system, allowing scientific
44
- specialization to scale through both model training and structured interaction
45
- with external tools.
46
-
47
- This repository contains the main ExoMind checkpoint, fine-tuned from
48
- [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B). The ExoMind
49
- project combines training-value-aware data engineering, a scientific
50
- interaction framework, and progressive Chain-of-Interaction training. Using a
51
- few thousand high-quality trajectories and 1–2 days of full-parameter SFT on
52
- eight NVIDIA H200 GPUs, the reported system raises its average score across
53
- eight scientific benchmarks from **36.2 to 67.5** and improves over its base
54
- model on all six evaluated general-capability benchmarks.
55
-
56
- <p align="center">
57
- <a href="https://ai4sgi.github.io/ExoMind/#results">
58
- <img src="./assets/fig1-benchmark.png" alt="ExoMind scientific intelligence evaluation" width="100%">
59
- </a>
60
- </p>
61
-
62
- > The headline results evaluate the complete ExoMind system under the report's
63
- > interaction and evaluation setup. The checkpoint alone does not reproduce
64
- > tool-augmented results unless it is connected to compatible interaction
65
- > objects and prompts.
66
-
67
- ## Model details
68
-
69
- | Item | Value |
70
- | --- | --- |
71
- | Base model | Qwen3.5-35B-A3B |
72
- | Architecture | Multimodal causal LM with vision encoder and sparse MoE language model |
73
- | Parameters | 35B total, 3B activated |
74
- | Hidden size / layers | 2,048 / 40 |
75
- | Experts | 256 total; 8 routed experts plus 1 shared expert activated per token |
76
- | Native context length | 262,144 tokens |
77
- | Weight format | BF16 safetensors |
78
- | Default behavior | Thinking mode, with reasoning enclosed in `<think>...</think>` |
79
- | Primary capabilities | Scientific reasoning, source-grounded research, code-assisted verification, tool use, and image-text input |
80
-
81
- The architecture and context specifications follow the upstream Qwen3.5 model.
82
- Runtime support for the full context window depends on the inference framework
83
- and available memory.
84
-
85
- ## Why ExoMind
86
-
87
- - **Extended-mind-inspired scientific intelligence:** unifies the LLM,
88
- interaction objects, and autonomous interaction processes instead of treating
89
- tool use as an afterthought.
90
- - **Training-value-aware data engineering:** estimates problem difficulty and
91
- interaction benefit before trajectory generation, followed by quality
92
- filtering, difficulty selection, and capability routing.
93
- - **Deep scientific interaction:** represents source discovery, source
94
- grounding, executable verification, and observation integration as typed
95
- objects under a unified action–observation contract.
96
- - **Progressive Chain-of-Interaction training:** jointly develops intrinsic
97
- reasoning and basic interaction capability before strengthening interaction
98
- reasoning with higher-quality trajectories.
99
 
100
  <p align="center">
101
  <a href="https://ai4sgi.github.io/ExoMind/#overview">
@@ -103,38 +70,42 @@ and available memory.
103
  </a>
104
  </p>
105
 
106
- ## Quick start
107
 
108
- Qwen3.5 support is evolving quickly. Use current releases or development builds
109
- of the serving framework and consult the upstream Qwen3.5 instructions when an
110
- older installation does not recognize the architecture.
111
 
112
- ### Serve with vLLM
113
-
114
- The following command exposes an OpenAI-compatible endpoint and enables the
115
- Qwen reasoning and tool-call parsers:
116
 
117
  ```bash
118
  vllm serve AI4SGI/ExoMind \
119
  --port 8000 \
120
  --tensor-parallel-size 8 \
121
- --max-model-len 262144 \
122
  --reasoning-parser qwen3 \
123
  --enable-auto-tool-choice \
124
  --tool-call-parser qwen3_coder
125
  ```
126
 
127
- If memory is limited, reduce `--max-model-len`. For text-only deployments,
128
- vLLM's `--language-model-only` option skips vision-encoder profiling and leaves
129
- more memory for KV cache.
 
 
 
 
 
 
 
 
 
130
 
131
- ### Call the endpoint
132
 
133
  ```python
134
  from openai import OpenAI
135
 
136
  client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
137
-
138
  response = client.chat.completions.create(
139
  model="AI4SGI/ExoMind",
140
  messages=[
@@ -147,59 +118,40 @@ response = client.chat.completions.create(
147
  top_p=0.95,
148
  extra_body={"top_k": 20},
149
  )
150
-
151
  print(response.choices[0].message.content)
152
  ```
153
 
154
- For the complete scientific interaction workflow, use the framework and prompt
155
- contracts in the [ExoMind GitHub repository](https://github.com/AI4SGI/ExoMind).
156
 
157
  ## Evaluation
158
 
159
  <p align="center">
160
  <a href="https://ai4sgi.github.io/ExoMind/#results">
161
- <img src="./assets/fig8-benchmarks.png" alt="ExoMind performance across eight scientific benchmarks" width="100%">
162
  </a>
163
  </p>
164
 
165
- The [interactive evaluation explorer](https://ai4sgi.github.io/ExoMind/#results)
166
- provides the complete model comparisons, benchmark scopes, settings, and
167
- rankings. Parameter counts marked with `~` are IKP-based estimates; see the
168
- technical report for the methodology and limitations.
 
 
169
 
170
- ## Intended use
171
 
172
  ExoMind is intended for research and development in scientific question
173
  answering, literature-grounded investigation, mathematical and computational
174
- reasoning, code-assisted verification, and agentic workflows that expose tools
175
- through a compatible action–observation interface.
176
-
177
- It should not be treated as an autonomous authority for medical, legal, safety-
178
- critical, or other high-stakes decisions. Users should independently verify
179
- citations, calculations, generated code, and experimental conclusions.
180
-
181
- ## Limitations
182
-
183
- - The model can produce incorrect reasoning, fabricated references, unsafe
184
- code, or conclusions unsupported by the retrieved evidence.
185
- - Reported system-level results depend on prompts, tools, observation formats,
186
- inference settings, and benchmark-specific evaluators in addition to weights.
187
- - Very long contexts are memory-intensive and do not guarantee faithful use of
188
- every supplied token.
189
- - Tool-call syntax and reasoning extraction can vary across inference
190
- frameworks and versions.
191
- - Performance outside the reported tasks, languages, and domains has not been
192
- established by the published evaluation.
193
-
194
- ## License and attribution
195
-
196
- The distributed model checkpoint and upstream Qwen3.5 materials are provided
197
- under the Apache License 2.0 included in this repository. ExoMind software is
198
- also Apache-2.0 where expressly identified by the project licensing overview.
199
- The technical report, scientific figures and results, and ExoMind brand assets
200
- are subject to the separate [ExoMind Research Content and Brand
201
- Terms](./CONTENT_RIGHTS.md). Third-party materials remain subject to their
202
- respective terms; see [NOTICE.md](./NOTICE.md).
203
 
204
  ## Citation
205
 
 
23
 
24
  <img src="./assets/ExoMind.png" alt="ExoMind" width="560">
25
 
26
+ # ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System
 
 
27
 
28
  **ExoMind Team · Shanghai Artificial Intelligence Laboratory**
29
 
30
  [Project Page](https://ai4sgi.github.io/ExoMind/) ·
31
  [GitHub](https://github.com/AI4SGI/ExoMind) ·
32
  [Technical Report](https://github.com/AI4SGI/ExoMind/blob/main/Paper.pdf) ·
33
+ [Hugging Face](https://huggingface.co/AI4SGI/ExoMind) ·
34
  [ModelScope](https://modelscope.cn/models/AI4SGI/ExoMind/summary)
35
 
36
  </div>
37
 
38
  ## Overview
39
 
40
+ ExoMind is the first extended-mind-inspired agentic system designed for
41
+ scientific reasoning and research. It organizes a general-purpose model,
42
+ specialized interaction objects, and autonomous interaction processes as one
43
+ system, allowing the model to discover sources, ground evidence, execute
44
+ verification, and update its reasoning around each scientific problem.
45
+
46
+ This repository hosts the main checkpoint, fine-tuned from
47
+ [Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B). With
48
+ training-value-aware data engineering, a scientific interaction framework, and
49
+ two-stage progressive Chain-of-Interaction training, ExoMind raises the average
50
+ score across eight scientific benchmarks from **36.2 to 67.5**, achieves the
51
+ highest average among all evaluated models, and ranks first on six benchmarks.
52
+
53
+ ## Highlights
54
+
55
+ - **Extended-mind-inspired intelligence:** unifies the LLM, interaction
56
+ objects, and autonomous interaction processes as a scientific agentic system.
57
+ - **Training-value-aware data engineering:** identifies challenging, learnable
58
+ problems and routes them to pure-reasoning or interaction-reasoning data.
59
+ - **Scientific interaction:** turns source discovery, evidence grounding,
60
+ executable verification, and observation integration into composable objects.
61
+ - **Progressive CoI training:** jointly develops intrinsic reasoning and
62
+ autonomous interaction using a few thousand high-quality trajectories.
63
+ - **Efficient frontier performance:** completes two-stage full-parameter SFT in
64
+ 1–2 days on 8 NVIDIA H200 GPUs while improving all six evaluated general
65
+ capability benchmarks over the base model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
66
 
67
  <p align="center">
68
  <a href="https://ai4sgi.github.io/ExoMind/#overview">
 
70
  </a>
71
  </p>
72
 
73
+ ## Quick Start
74
 
75
+ Use a recent vLLM or SGLang release with Qwen3.5 support. The examples below
76
+ start an OpenAI-compatible service with a practical initial context length.
 
77
 
78
+ ### vLLM
 
 
 
79
 
80
  ```bash
81
  vllm serve AI4SGI/ExoMind \
82
  --port 8000 \
83
  --tensor-parallel-size 8 \
84
+ --max-model-len 32768 \
85
  --reasoning-parser qwen3 \
86
  --enable-auto-tool-choice \
87
  --tool-call-parser qwen3_coder
88
  ```
89
 
90
+ ### SGLang
91
+
92
+ ```bash
93
+ python -m sglang.launch_server \
94
+ --model-path AI4SGI/ExoMind \
95
+ --host 0.0.0.0 \
96
+ --port 8000 \
97
+ --tp-size 8 \
98
+ --context-length 32768 \
99
+ --reasoning-parser qwen3 \
100
+ --tool-call-parser qwen3_coder
101
+ ```
102
 
103
+ ### OpenAI-Compatible API
104
 
105
  ```python
106
  from openai import OpenAI
107
 
108
  client = OpenAI(base_url="http://localhost:8000/v1", api_key="EMPTY")
 
109
  response = client.chat.completions.create(
110
  model="AI4SGI/ExoMind",
111
  messages=[
 
118
  top_p=0.95,
119
  extra_body={"top_k": 20},
120
  )
 
121
  print(response.choices[0].message.content)
122
  ```
123
 
124
+ The complete scientific interaction workflow and prompt contracts are available
125
+ in the [ExoMind GitHub repository](https://github.com/AI4SGI/ExoMind).
126
 
127
  ## Evaluation
128
 
129
  <p align="center">
130
  <a href="https://ai4sgi.github.io/ExoMind/#results">
131
+ <img src="./assets/fig-model-comparison.png" alt="ExoMind performance across eight scientific benchmarks" width="100%">
132
  </a>
133
  </p>
134
 
135
+ The figure compares ExoMind with one representative model from each of seven
136
+ major providers. Under the technical report's evaluation setup, ExoMind reaches
137
+ an eight-benchmark average of **67.5**, compared with **54.2** for the next-best
138
+ representative. See the [interactive evaluation
139
+ explorer](https://ai4sgi.github.io/ExoMind/#results) for the complete model list,
140
+ benchmark scopes, settings, and rankings.
141
 
142
+ ## Intended Use
143
 
144
  ExoMind is intended for research and development in scientific question
145
  answering, literature-grounded investigation, mathematical and computational
146
+ reasoning, code-assisted verification, and agentic scientific workflows.
147
+
148
+ ## License and Attribution
149
+
150
+ The distributed checkpoint and upstream Qwen3.5 materials are provided under
151
+ the Apache License 2.0 included in this repository. The technical report,
152
+ scientific figures and results, and ExoMind brand assets are subject to the
153
+ [ExoMind Research Content and Brand Terms](./CONTENT_RIGHTS.md). See
154
+ [NOTICE.md](./NOTICE.md) for third-party notices.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
155
 
156
  ## Citation
157