---
title: WHEC Chatbot
emoji: 🧬
colorFrom: indigo
colorTo: green
sdk: docker
pinned: false
---

# WHEC RAG System

This is a Multimodal Retrieval-Augmented Generation (RAG) system designed to answer questions based on the documents at WHEC (Warrior Heat- and Exertion-Related Events Collaborative) page: https://www.hprc-online.org/resources-partners/whec

It allows users to query both text and images extracted from the documents.

## How it Works
The system uses a pre-built index (`multimodal_rag_index`) that contains embeddings for both text and images found in the research papers. When you ask a question, the system retrieves the most relevant text segments and images, then generates a consolidated answer using GPT-4o.

## Features
- **Multimodal Search**: Retrieves relevant text and images simultaneously.
- **Visual Evidence**: Displays images extracted from the papers alongside the answer.
- **Source Citations**: Provides references to the specific documents and pages used.

## Usage
Simply type your question in the search box. You can ask general questions or specifically request visual information (e.g., "Show me images of...").