Sync README updates
Browse files
README.md
CHANGED
|
@@ -118,26 +118,38 @@ The SFT stage fine-tunes Qwen2.5-VL-7B-Instruct on the GeoMTVR dataset to obtain
|
|
| 118 |
| Dependency | Source | Notes |
|
| 119 |
|------------|--------|-------|
|
| 120 |
| **Qwen2.5-VL-7B-Instruct** | [🤗 Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) | Base model |
|
| 121 |
-
| **GeoMTVR dataset** |
|
| 122 |
| **LLaMA-Factory** | `pip install llamafactory` | Training framework used by the SFT script |
|
| 123 |
|
| 124 |
Place the base model at a local path, e.g., `/path/to/models/Qwen2.5-VL-7B-Instruct`.
|
| 125 |
|
| 126 |
-
### Step 2: Prepare Dataset
|
| 127 |
|
| 128 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 129 |
|
| 130 |
```
|
| 131 |
/path/to/geomtvr-data/
|
| 132 |
-
|
| 133 |
-
|
| 134 |
-
|
| 135 |
-
|
| 136 |
-
|
| 137 |
-
|
| 138 |
-
|
| 139 |
-
train.json
|
| 140 |
-
images/
|
| 141 |
dataset_info.json
|
| 142 |
```
|
| 143 |
|
|
|
|
| 118 |
| Dependency | Source | Notes |
|
| 119 |
|------------|--------|-------|
|
| 120 |
| **Qwen2.5-VL-7B-Instruct** | [🤗 Qwen/Qwen2.5-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct) | Base model |
|
| 121 |
+
| **GeoMTVR dataset** | [🤗 NaOHjiang/GeoMTVR](https://huggingface.co/datasets/NaOHjiang/GeoMTVR) | Multi-tool visual reasoning dataset (13K samples) |
|
| 122 |
| **LLaMA-Factory** | `pip install llamafactory` | Training framework used by the SFT script |
|
| 123 |
|
| 124 |
Place the base model at a local path, e.g., `/path/to/models/Qwen2.5-VL-7B-Instruct`.
|
| 125 |
|
| 126 |
+
### Step 2: Download and Prepare Dataset
|
| 127 |
|
| 128 |
+
Download the GeoMTVR dataset from [HuggingFace](https://huggingface.co/datasets/NaOHjiang/GeoMTVR). The repository contains annotation files (`dataset_info.json` + 3 JSONL files) and image chunks:
|
| 129 |
+
|
| 130 |
+
```bash
|
| 131 |
+
# Download the dataset repository
|
| 132 |
+
git lfs clone https://huggingface.co/datasets/NaOHjiang/GeoMTVR
|
| 133 |
+
|
| 134 |
+
# Or download files manually via the web interface (see "Files" tab)
|
| 135 |
+
|
| 136 |
+
# Merge and extract the image archive
|
| 137 |
+
cd GeoMTVR
|
| 138 |
+
cat images/geomtvr_images_chunk_*.tar.part > geomtvr_images.tar
|
| 139 |
+
tar xf geomtvr_images.tar
|
| 140 |
+
```
|
| 141 |
+
|
| 142 |
+
Organize the extracted data into a single dataset directory (LLaMA-Factory format):
|
| 143 |
|
| 144 |
```
|
| 145 |
/path/to/geomtvr-data/
|
| 146 |
+
cold_start/
|
| 147 |
+
super_accepted_or_route.3img_summary.jsonl
|
| 148 |
+
zoom_results.visual.qa.with_aux.full.strict_superstyle.jsonl
|
| 149 |
+
route_visual_accepted_388.superstyle_sft.jsonl
|
| 150 |
+
images/
|
| 151 |
+
aux_images/...
|
| 152 |
+
vqa_results/...
|
|
|
|
|
|
|
| 153 |
dataset_info.json
|
| 154 |
```
|
| 155 |
|