Spaces:
Running
on
Zero
Running
on
Zero
Update app.py
Browse files
app.py
CHANGED
|
@@ -216,22 +216,23 @@ def answer_question(images, question):
|
|
| 216 |
|
| 217 |
|
| 218 |
with gr.Blocks() as app:
|
| 219 |
-
gr.Markdown("#
|
| 220 |
-
|
| 221 |
-
|
| 222 |
-
|
| 223 |
|
| 224 |
-
-
|
| 225 |
|
| 226 |
-
|
| 227 |
|
| 228 |
-
|
| 229 |
|
| 230 |
-
|
|
|
|
| 231 |
|
| 232 |
-
gr.Markdown("- We open-sourced our model at [RhapsodyAI/minicpm-visual-embedding-v0](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0)")
|
| 233 |
|
| 234 |
-
gr.Markdown("- Currently
|
| 235 |
|
| 236 |
with gr.Row():
|
| 237 |
file_input = gr.File(type="binary", label="Upload PDF")
|
|
|
|
| 216 |
|
| 217 |
|
| 218 |
with gr.Blocks() as app:
|
| 219 |
+
gr.Markdown("# MiniCPMV-RAG-PDFQA: Two Vision Language Models Enable End-to-End RAG")
|
| 220 |
+
|
| 221 |
+
gr.Markdown("""
|
| 222 |
+
- A Vision Language Model Dense Retriever ([MiniCPM-Visual-Embedding](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0)) **directly reads** your PDFs **without need of OCR**, produce **multimodal dense representations** and build your personal library.
|
| 223 |
|
| 224 |
+
- **Ask a question**, it retrieve most relavant pages, then [MiniCPM-V-2.6](https://huggingface.co/spaces/openbmb/MiniCPM-V-2_6) will answer your question based on pages recalled, with strong multi-image understanding capability.
|
| 225 |
|
| 226 |
+
1. It helps you read a long **visually-intensive** or **text-oriented** PDF document and find the pages that answer your question.
|
| 227 |
|
| 228 |
+
2. It helps you build a personal library and retireve book pages from a large collection of books.
|
| 229 |
|
| 230 |
+
3. It works like a human: read, store, retrieve, and answer with full vision.
|
| 231 |
+
""")
|
| 232 |
|
| 233 |
+
gr.Markdown("- We **open-sourced** our visual embedding model at [RhapsodyAI/minicpm-visual-embedding-v0](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0)")
|
| 234 |
|
| 235 |
+
gr.Markdown("- Currently online demo support PDF document with less than 50 pages.")
|
| 236 |
|
| 237 |
with gr.Row():
|
| 238 |
file_input = gr.File(type="binary", label="Upload PDF")
|