Fix bilingual README links: use absolute HF URLs so EN/ZH switch and internal links work on Hugging Face
#1
by JacobLIU1024 - opened
- README.md +22 -19
- README_ZH.md +20 -18
README.md
CHANGED
|
@@ -10,28 +10,30 @@ tags:
|
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
# UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
|
| 14 |
|
| 15 |
-
<
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
-
<img src="https://raw.githubusercontent.com/OpenBMB/UltraX/main/assets/ultrax-logo.png" alt="UltraX Logo" width="350"/>
|
| 22 |
-
</a>
|
| 23 |
-
</p>
|
| 24 |
|
| 25 |
<p align="center">
|
| 26 |
<a href="https://arxiv.org/abs/2607.08646">📜 Paper</a> |
|
| 27 |
<a href="https://github.com/openbmb/UltraX">💻 Code</a> |
|
| 28 |
<a href="https://huggingface.co/datasets/openbmb/UltraX-Preview">🤗 Datasets</a> |
|
| 29 |
-
<a href="https://huggingface.co/collections/openbmb/ultradata">📦 UltraData Collection</a>
|
|
|
|
| 30 |
</p>
|
| 31 |
|
| 32 |
<p align="center">
|
| 33 |
English |
|
| 34 |
-
<a href="README_ZH.md">中文</a>
|
| 35 |
</p>
|
| 36 |
|
| 37 |
## 📚 Introduction
|
|
@@ -48,8 +50,7 @@ This repository provides the **UltraX refinement models**, which are trained via
|
|
| 48 |
|
| 49 |
## 📢 News
|
| 50 |
|
| 51 |
-
- **[2026.07
|
| 52 |
-
- **[2025.07.10]** UltraX technical report is available on [arXiv](https://arxiv.org/abs/2607.08646). 🔥🔥🔥
|
| 53 |
|
| 54 |
## 💡 Highlights
|
| 55 |
|
|
@@ -60,7 +61,7 @@ This repository provides the **UltraX refinement models**, which are trained via
|
|
| 60 |
## 🔬 Pipeline Overview
|
| 61 |
|
| 62 |
<div align="center">
|
| 63 |
-
<img src="https://
|
| 64 |
</div>
|
| 65 |
|
| 66 |
## 🔍 Model Details
|
|
@@ -90,11 +91,11 @@ All models are trained with the following configuration:
|
|
| 90 |
Performance comparison on FineWeb (20B tokens, 1B MiniCPM, 10 benchmarks, zero-shot):
|
| 91 |
|
| 92 |
<div align="center">
|
| 93 |
-
<img src="https://
|
| 94 |
</div>
|
| 95 |
|
| 96 |
<div align="center">
|
| 97 |
-
<img src="https://
|
| 98 |
<p><i>Average downstream performance on FineWeb under different training token budgets.</i></p>
|
| 99 |
</div>
|
| 100 |
|
|
@@ -126,8 +127,8 @@ remove_lines(12, 15)
|
|
| 126 |
```python
|
| 127 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 128 |
|
| 129 |
-
model = AutoModelForCausalLM.from_pretrained("openbmb/UltraX
|
| 130 |
-
tokenizer = AutoTokenizer.from_pretrained("openbmb/UltraX
|
| 131 |
```
|
| 132 |
|
| 133 |
## ❤️ Acknowledgements
|
|
@@ -154,4 +155,6 @@ If you find our work useful, please consider citing:
|
|
| 154 |
|
| 155 |
## 📜 License
|
| 156 |
|
| 157 |
-
This project is licensed under the [Apache 2.0](./LICENSE) license.
|
|
|
|
|
|
|
|
|
| 10 |
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
| 13 |
+
<table width="100%" border="0" cellspacing="0" cellpadding="0">
|
| 14 |
+
<tr>
|
| 15 |
+
<td valign="middle">
|
| 16 |
+
|
| 17 |
# UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
|
| 18 |
|
| 19 |
+
</td>
|
| 20 |
+
<td width="280" align="right" style="padding-top: 14px;" valign="top">
|
| 21 |
+
<a href="https://huggingface.co/collections/openbmb/ultradata"><img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/ultradata-logo.png" width="250"/></a>
|
| 22 |
+
</td>
|
| 23 |
+
</tr>
|
| 24 |
+
</table>
|
|
|
|
|
|
|
|
|
|
| 25 |
|
| 26 |
<p align="center">
|
| 27 |
<a href="https://arxiv.org/abs/2607.08646">📜 Paper</a> |
|
| 28 |
<a href="https://github.com/openbmb/UltraX">💻 Code</a> |
|
| 29 |
<a href="https://huggingface.co/datasets/openbmb/UltraX-Preview">🤗 Datasets</a> |
|
| 30 |
+
<a href="https://huggingface.co/collections/openbmb/ultradata">📦 UltraData Collection</a> |
|
| 31 |
+
<a href="https://opensource.org/license/apache-2-0">📄 License: Apache 2.0</a>
|
| 32 |
</p>
|
| 33 |
|
| 34 |
<p align="center">
|
| 35 |
English |
|
| 36 |
+
<a href="https://huggingface.co/openbmb/UltraX-0.6B-Preview/blob/main/README_ZH.md">中文</a>
|
| 37 |
</p>
|
| 38 |
|
| 39 |
## 📚 Introduction
|
|
|
|
| 50 |
|
| 51 |
## 📢 News
|
| 52 |
|
| 53 |
+
- **[2026.07]** 🎉 We release the UltraX codebase, refinement models, and refined datasets.
|
|
|
|
| 54 |
|
| 55 |
## 💡 Highlights
|
| 56 |
|
|
|
|
| 61 |
## 🔬 Pipeline Overview
|
| 62 |
|
| 63 |
<div align="center">
|
| 64 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/ultrax_pipeline.png" width="800"/>
|
| 65 |
</div>
|
| 66 |
|
| 67 |
## 🔍 Model Details
|
|
|
|
| 91 |
Performance comparison on FineWeb (20B tokens, 1B MiniCPM, 10 benchmarks, zero-shot):
|
| 92 |
|
| 93 |
<div align="center">
|
| 94 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/results.png" width="900"/>
|
| 95 |
</div>
|
| 96 |
|
| 97 |
<div align="center">
|
| 98 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/fineweb_token_curve.png" alt="FineWeb Token Curve" width="450"/>
|
| 99 |
<p><i>Average downstream performance on FineWeb under different training token budgets.</i></p>
|
| 100 |
</div>
|
| 101 |
|
|
|
|
| 127 |
```python
|
| 128 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 129 |
|
| 130 |
+
model = AutoModelForCausalLM.from_pretrained("openbmb/UltraX")
|
| 131 |
+
tokenizer = AutoTokenizer.from_pretrained("openbmb/UltraX")
|
| 132 |
```
|
| 133 |
|
| 134 |
## ❤️ Acknowledgements
|
|
|
|
| 155 |
|
| 156 |
## 📜 License
|
| 157 |
|
| 158 |
+
This project is licensed under the [Apache 2.0](https://huggingface.co/openbmb/UltraX-0.6B-Preview/blob/main/LICENSE) license.
|
| 159 |
+
|
| 160 |
+
**No unauthorized unchanged redistribution:** Without prior written permission from the original authors (or this organization), any institution, organization, or third-party platform is strictly prohibited from directly reposting, mirroring, re-hosting, or commercially repackaging and republishing any artifacts of this project in any form.
|
README_ZH.md
CHANGED
|
@@ -1,14 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# UltraX:基于自适应程序化编辑的大规模预训练数据精炼
|
| 2 |
|
| 3 |
-
<
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
<img src="https://raw.githubusercontent.com/OpenBMB/UltraX/main/assets/ultrax-logo.png" alt="UltraX Logo" width="350"/>
|
| 10 |
-
</a>
|
| 11 |
-
</p>
|
| 12 |
|
| 13 |
<p align="center">
|
| 14 |
<a href="https://arxiv.org/abs/2607.08646">📜 论文</a> |
|
|
@@ -19,7 +20,7 @@
|
|
| 19 |
</p>
|
| 20 |
|
| 21 |
<p align="center">
|
| 22 |
-
<a href="README.md">English</a> |
|
| 23 |
中文
|
| 24 |
</p>
|
| 25 |
|
|
@@ -37,8 +38,7 @@
|
|
| 37 |
|
| 38 |
## 📢 最新动态
|
| 39 |
|
| 40 |
-
- **[2026.07
|
| 41 |
-
- **[2025.07.10]** UltraX 技术报告已发布于 [arXiv](https://arxiv.org/abs/2607.08646)。🔥🔥🔥
|
| 42 |
|
| 43 |
## 💡 亮点
|
| 44 |
|
|
@@ -49,7 +49,7 @@
|
|
| 49 |
## 🔬 流程概览
|
| 50 |
|
| 51 |
<div align="center">
|
| 52 |
-
<img src="https://
|
| 53 |
</div>
|
| 54 |
|
| 55 |
## 🔍 模型详情
|
|
@@ -77,11 +77,11 @@
|
|
| 77 |
在 FineWeb 上的性能对比(20B tokens,1B MiniCPM,10 个基准,零样本):
|
| 78 |
|
| 79 |
<div align="center">
|
| 80 |
-
<img src="https://
|
| 81 |
</div>
|
| 82 |
|
| 83 |
<div align="center">
|
| 84 |
-
<img src="https://
|
| 85 |
<p><i>FineWeb 在不同训练 token 预算下的平均下游性能。</i></p>
|
| 86 |
</div>
|
| 87 |
|
|
@@ -114,8 +114,8 @@ remove_lines(12, 15)
|
|
| 114 |
```python
|
| 115 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 116 |
|
| 117 |
-
model = AutoModelForCausalLM.from_pretrained("openbmb/UltraX
|
| 118 |
-
tokenizer = AutoTokenizer.from_pretrained("openbmb/UltraX
|
| 119 |
```
|
| 120 |
|
| 121 |
## ❤️ 致谢
|
|
@@ -142,4 +142,6 @@ tokenizer = AutoTokenizer.from_pretrained("openbmb/UltraX-0.6B-Preview")
|
|
| 142 |
|
| 143 |
## 📜 许可证
|
| 144 |
|
| 145 |
-
本项目基于 [Apache 2.0](./LICENSE) 许可证发布。
|
|
|
|
|
|
|
|
|
| 1 |
+
<table width="100%" border="0" cellspacing="0" cellpadding="0">
|
| 2 |
+
<tr>
|
| 3 |
+
<td valign="middle">
|
| 4 |
+
|
| 5 |
# UltraX:基于自适应程序化编辑的大规模预训练数据精炼
|
| 6 |
|
| 7 |
+
</td>
|
| 8 |
+
<td width="280" align="right" style="padding-top: 14px;" valign="top">
|
| 9 |
+
<a href="https://huggingface.co/collections/openbmb/ultradata"><img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/ultradata-logo.png" width="250"/></a>
|
| 10 |
+
</td>
|
| 11 |
+
</tr>
|
| 12 |
+
</table>
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
<p align="center">
|
| 15 |
<a href="https://arxiv.org/abs/2607.08646">📜 论文</a> |
|
|
|
|
| 20 |
</p>
|
| 21 |
|
| 22 |
<p align="center">
|
| 23 |
+
<a href="https://huggingface.co/openbmb/UltraX-0.6B-Preview/blob/main/README.md">English</a> |
|
| 24 |
中文
|
| 25 |
</p>
|
| 26 |
|
|
|
|
| 38 |
|
| 39 |
## 📢 最新动态
|
| 40 |
|
| 41 |
+
- **[2026.07]** 🎉 UltraX 代码、精炼模型和精炼数据集正式开源。
|
|
|
|
| 42 |
|
| 43 |
## 💡 亮点
|
| 44 |
|
|
|
|
| 49 |
## 🔬 流程概览
|
| 50 |
|
| 51 |
<div align="center">
|
| 52 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/ultrax_pipeline.png" width="800"/>
|
| 53 |
</div>
|
| 54 |
|
| 55 |
## 🔍 模型详情
|
|
|
|
| 77 |
在 FineWeb 上的性能对比(20B tokens,1B MiniCPM,10 个基准,零样本):
|
| 78 |
|
| 79 |
<div align="center">
|
| 80 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/results.png" width="900"/>
|
| 81 |
</div>
|
| 82 |
|
| 83 |
<div align="center">
|
| 84 |
+
<img src="https://huggingface.co/openbmb/UltraX-0.6B-Preview/resolve/main/assets/fineweb_token_curve.png" alt="FineWeb Token 曲线" width="450"/>
|
| 85 |
<p><i>FineWeb 在不同训练 token 预算下的平均下游性能。</i></p>
|
| 86 |
</div>
|
| 87 |
|
|
|
|
| 114 |
```python
|
| 115 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 116 |
|
| 117 |
+
model = AutoModelForCausalLM.from_pretrained("openbmb/UltraX")
|
| 118 |
+
tokenizer = AutoTokenizer.from_pretrained("openbmb/UltraX")
|
| 119 |
```
|
| 120 |
|
| 121 |
## ❤️ 致谢
|
|
|
|
| 142 |
|
| 143 |
## 📜 许可证
|
| 144 |
|
| 145 |
+
本项目基于 [Apache 2.0](https://huggingface.co/openbmb/UltraX-0.6B-Preview/blob/main/LICENSE) 许可证发布。
|
| 146 |
+
|
| 147 |
+
**禁止不加处理的二次发布:** 未经原作者(或本机构)书面明确授权,任何其他机构、组织或第三方平台不得以任何形式对本项目成果进行直接转载、复制、托管、镜像克隆或商业化包装再发布。
|