| # Stage-2 CoVT data |
|
|
| This is the exact merged local dataset used by the current Stage-2 recipe: |
|
|
| - 889,489 rows; |
| - 756,894 unique files in the flat image directory; |
| - every row has exactly one image plus a multi-turn conversation; |
| - 3,387,330 conversation messages in total; |
| - no T2I target images and no I2I source/target pairs. |
|
|
| Stage 2 therefore trains visual understanding/VQA language generation. The |
| five frozen visual teachers create online supervision from each row's input |
| image; they are not extra target columns stored in JSON. |
|
|
| ## Source labels visible in the merged IDs |
|
|
| The original merged JSON contains only `id`, `image`, and `conversations`; it |
| does not contain a formal provenance column. The following counts are audited |
| from the source labels encoded in `id` and should not be treated as a new |
| upstream-license declaration. |
|
|
| | Encoded source label | Rows | |
| |---|---:| |
| | TallyQA (`tallyqa` plus `cauldron/tallyqa`) | 363,591 | |
| | numeric/unlabeled IDs | 99,797 | |
| | image textualization | 99,573 | |
| | ALLaVA (`laion` plus `vflan`) | 69,980 | |
| | Cauldron CLEVR | 69,995 | |
| | ShareGPT4o | 57,284 | |
| | identity | 29,193 | |
| | Cauldron IconQA | 27,302 | |
| | Cauldron ST-VQA | 17,242 | |
| | Cauldron A-OKVQA | 16,534 | |
| | Cauldron Visual7W | 14,361 | |
| | SA segmentation subset | 8,990 | |
| | Cauldron Hateful Memes | 8,495 | |
| | ADE depth subset | 5,000 | |
| | Cauldron VSR | 2,152 | |
|
|
| The counts sum to 889,489. Because 99,797 rows have numeric IDs only, exact |
| upstream attribution for those rows cannot be reconstructed from this merged |
| artifact alone. |
|
|
| ## Portable representation |
|
|
| `data.json` rewrites every absolute source-machine image path to a basename. |
| The loader resolves those basenames against `data/covt/images`. The 64 tar |
| files under `shards/` materialize that directory; each tar has a neighboring |
| SHA256 sidecar and is verified before extraction by `scripts/bootstrap.sh`. |
|
|
