README.md

metadata

title: Groq RAG Assistant
emoji: 🧠
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: 5.29.0
app_file: app.py
pinned: false
license: mit

🧠 Groq RAG Assistant

A fully local RAG (Retrieval-Augmented Generation) chatbot that lets you upload documents and ask questions about them.

Features

• 📄 Supports PDF, DOCX, and TXT files
• 🧠 Local embeddings via sentence-transformers (all-MiniLM-L6-v2)
• 🗄️ Vector storage via ChromaDB (stored in /tmp)
• ⚡ Fast LLM inference via Groq (llama3-8b-8192)

Setup

1. Fork / duplicate this Space.
2. Go to Settings → Variables and secrets.
3. Add a secret named GROQ_API_KEY with your key from console.groq.com.
4. Restart the Space — you're ready to go!

How to use

1. Upload one or more PDF / DOCX / TXT files in the left panel.
2. Click 🚀 Process Files and wait for the confirmation message.
3. Type your question in the chat box and hit Send.