HarshaBattula
commited on
Commit
·
f5a475f
1
Parent(s):
20b9d6e
update readme
Browse files
README.md
CHANGED
|
@@ -10,4 +10,28 @@ pinned: false
|
|
| 10 |
license: unknown
|
| 11 |
---
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
license: unknown
|
| 11 |
---
|
| 12 |
|
| 13 |
+
# Document Retrieval Augmented Language Model with LangChain and OpenAI's GPT-3.5-turbo.
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
|
| 17 |
+
This project involves the creation of a vector database using OpenAI embeddings and Chroma DB, followed by the retrieval of document snippets through a similarity search with LangChain's retrieval system. Upon retrieval of relevant snippets, the system uses GPT-3.5 Turbo to generate responses to input questions using the retrieved snippets as context. The system also incorporates a ConversationBufferMemory to store the memory of the chat, enhancing the quality of the conversational context and the relevance of generated responses.
|
| 18 |
+
|
| 19 |
+
## Contents
|
| 20 |
+
|
| 21 |
+
1. **OpenAI Embeddings and Chroma DB**: Utilizes the rich semantic information in OpenAI embeddings and the efficient storage and retrieval capabilities of Chroma DB to create a performant and effective vector database.
|
| 22 |
+
2. **Document Retrieval**: Uses LangChain's retrieval system to perform similarity search and retrieve relevant snippets from documents based on input queries.
|
| 23 |
+
3. **Response Generation with GPT-3.5 Turbo**: Leverages the advanced language understanding and generation capabilities of GPT-3.5 Turbo to generate responses to input questions using Langchain's `RetrievalQA`.
|
| 24 |
+
4. **ConversationBufferMemory**: Stores the history of the conversation to ensure context continuity and enhance the relevance of the responses generated.
|
| 25 |
+
|
| 26 |
+
## Getting Started
|
| 27 |
+
|
| 28 |
+
### Prerequisites
|
| 29 |
+
Before you begin, ensure you have met the following requirements:
|
| 30 |
+
- You have installed Python 3.x.
|
| 31 |
+
- You have access to OpenAI GPT-3.5 Turbo and relevant API credentials.
|
| 32 |
+
- You have set up Chroma DB on your server/machine, and the documents in the database.
|
| 33 |
+
- You have access to LangChain's retrieval system.
|
| 34 |
+
|
| 35 |
+
|
| 36 |
+
### Usage
|
| 37 |
+
After installation, you can use the system via command line or GUI through **gradio** `app.py`.
|