File size: 1,155 Bytes
1d1103d
8708015
2266343
 
 
1d1103d
 
 
 
8708015
2266343
f1ac619
 
 
2266343
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
title: WHEC Chatbot
emoji: 🧬
colorFrom: indigo
colorTo: green
sdk: docker
pinned: false
---

# WHEC RAG System

This is a Multimodal Retrieval-Augmented Generation (RAG) system designed to answer questions based on the documents at WHEC (Warrior Heat- and Exertion-Related Events Collaborative) page: https://www.hprc-online.org/resources-partners/whec

It allows users to query both text and images extracted from the documents.

## How it Works
The system uses a pre-built index (`multimodal_rag_index`) that contains embeddings for both text and images found in the research papers. When you ask a question, the system retrieves the most relevant text segments and images, then generates a consolidated answer using GPT-4o.

## Features
- **Multimodal Search**: Retrieves relevant text and images simultaneously.
- **Visual Evidence**: Displays images extracted from the papers alongside the answer.
- **Source Citations**: Provides references to the specific documents and pages used.

## Usage
Simply type your question in the search box. You can ask general questions or specifically request visual information (e.g., "Show me images of...").