app/data/README.md

# Data Directory

This directory contains the Grid Code documentation and processed data.

## Structure

- `raw/` - Contains the original Grid Code PDF
- `processed/` - Contains processed chunks and embeddings
- `test/` - Contains test data and evaluation sets

## Grid Code PDF

Place the Grid Code PDF file in the `raw/` directory with filename `grid_code.pdf`.

## Processing

The data processing pipeline:
1. Loads PDF from raw/
2. Splits into chunks
3. Generates embeddings
4. Stores processed data

## Test Data

The test directory contains:
- Sample questions and answers
- Evaluation datasets
- Test PDF segments