File size: 667 Bytes
8e874f5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | # Summarization Data
The summarization benchmark (SQuALITY) data is loaded automatically from HuggingFace at runtime:
```
Dataset: pszemraj/SQuALITY-v1.3
Split: train
```
No manual download required. The benchmark will fetch the data on first run via the `datasets` library.
## Format
Each item contains:
- `document`: The full source document text
- `questions`: List of question objects, each with:
- `question_text`: The question
- `responses`: List of response objects with `response_text`
- `metadata.passage_id`: Unique passage identifier
## Usage
```bash
./run.sh summarization --questions 50
./run.sh summarization --build --max-documents 10
```
|