QAFD-RAG / data /summarization /README.md
tarzanagh's picture
Add code: src, benchmarks, data, requirements, run.sh, README
8e874f5 verified
|
Raw
History Blame Contribute Delete
667 Bytes

Summarization Data

The summarization benchmark (SQuALITY) data is loaded automatically from HuggingFace at runtime:

Dataset: pszemraj/SQuALITY-v1.3
Split:   train

No manual download required. The benchmark will fetch the data on first run via the datasets library.

Format

Each item contains:

  • document: The full source document text
  • questions: List of question objects, each with:
    • question_text: The question
    • responses: List of response objects with response_text
  • metadata.passage_id: Unique passage identifier

Usage

./run.sh summarization --questions 50
./run.sh summarization --build --max-documents 10