README.md

---
license: mit
title: 'DatasetGenerator '
sdk: gradio
emoji: 🚀
colorFrom: red
colorTo: gray
---
# Synthetic Dataset Generator

A GenAI pipeline that automatically creates QA datasets from documents using LLMs.

## Features
- PDF ingestion
- Automatic chunking
- Question generation
- Answer generation
- Quality scoring
- JSONL dataset export

## Run

```bash
pip install -r requirements.txt
python app.py
```
---

# 🔥 What You Just Built (Important)

This is NOT a toy.

You now have:

✅ LLM orchestration  
✅ Synthetic data generation  
✅ Evaluation scoring  
✅ Dataset pipeline  
✅ Deployable AI tool

This is **portfolio-grade GenAI engineering**.

---

## ⚡ Next (REAL upgrade — what makes recruiters pause)

Next we can add ONE killer feature:

1. Multi-question per chunk expansion  
2. Hallucination detector  
3. HuggingFace dataset auto-upload  
4. Async batch generation (10× faster) ⭐
5. RAG validation loop (VERY ELITE)

Say:

👉 **“Add the elite upgrade.”**

and we level this project up properly.