Add model card for NCoTS
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,37 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
pipeline_tag: text-generation
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
# Neural Chain-of-Thought Search (NCoTS)
|
| 7 |
+
|
| 8 |
+
This repository contains artifacts for **Neural Chain-of-Thought Search (NCoTS)**, a framework that reformulates reasoning as a dynamic search for the optimal thinking strategy to enhance Large Language Models.
|
| 9 |
+
|
| 10 |
+
- **Paper:** [Neural Chain-of-Thought Search: Searching the Optimal Reasoning Path to Enhance Large Language Models](https://huggingface.co/papers/2601.11340)
|
| 11 |
+
- **Repository:** [MilkThink-Lab/Neural-CoT-Search](https://github.com/MilkThink-Lab/Neural-CoT-Search)
|
| 12 |
+
|
| 13 |
+
## Introduction
|
| 14 |
+
NCoTS addresses the limitations of sequential Chain-of-Thought (CoT) generation by treating reasoning as a search process. By characterizing the solution space, the framework identifies "sparse superior reasoning paths" that are more accurate and concise than standard outputs. NCoTS navigates these paths using a dual-factor heuristic that balances correctness and computational cost, achieving a Pareto improvement across diverse reasoning benchmarks.
|
| 15 |
+
|
| 16 |
+
## 🚀 Quick Start
|
| 17 |
+
|
| 18 |
+
### ⚙️ Environment Setup
|
| 19 |
+
|
| 20 |
+
```bash
|
| 21 |
+
pip install -r requirements.txt
|
| 22 |
+
```
|
| 23 |
+
|
| 24 |
+
### 📊 Evaluation
|
| 25 |
+
|
| 26 |
+
To evaluate the model using the provided codebase:
|
| 27 |
+
|
| 28 |
+
```bash
|
| 29 |
+
python evaluation.py \
|
| 30 |
+
--checkpoint <path_to_head_checkpoint> \
|
| 31 |
+
--dataset <dataset_name> \
|
| 32 |
+
--max_new_tokens 4096 \
|
| 33 |
+
--output_dir ./evaluation_results \
|
| 34 |
+
--verbose
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
For more details on training and project structure, please refer to the [GitHub repository](https://github.com/MilkThink-Lab/Neural-CoT-Search).
|