metadata
title: WHEC Chatbot
emoji: 🧬
colorFrom: indigo
colorTo: green
sdk: docker
pinned: false
WHEC RAG System
This is a Multimodal Retrieval-Augmented Generation (RAG) system designed to answer questions based on the documents at WHEC (Warrior Heat- and Exertion-Related Events Collaborative) page: https://www.hprc-online.org/resources-partners/whec
It allows users to query both text and images extracted from the documents.
How it Works
The system uses a pre-built index (multimodal_rag_index) that contains embeddings for both text and images found in the research papers. When you ask a question, the system retrieves the most relevant text segments and images, then generates a consolidated answer using GPT-4o.
Features
- Multimodal Search: Retrieves relevant text and images simultaneously.
- Visual Evidence: Displays images extracted from the papers alongside the answer.
- Source Citations: Provides references to the specific documents and pages used.
Usage
Simply type your question in the search box. You can ask general questions or specifically request visual information (e.g., "Show me images of...").