Update README.md
Browse files
README.md
CHANGED
|
@@ -14,15 +14,13 @@ pipeline_tag: feature-extraction
|
|
| 14 |
|
| 15 |
With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages. minicpm-visual-embedding-v0 is trained with over 30k paired query - visual document pages, including textual document, visual document, arxiv figures, industry documents, textbooks, ebooks, etc. The performance of minicpm-visual-embedding-v0 is on a par with a text embedding on text-oriented documents, and an advantages on visually-intensive documents.
|
| 16 |
|
| 17 |
-
[Github Repo](https://github.com/bokesyo/minicpm-visual-embedding)
|
| 18 |
-
|
| 19 |

|
| 20 |
|
| 21 |
# News
|
| 22 |
|
| 23 |
- 2024-06-27: We released our first visual embedding model checkpoint minicpm-visual-embedding-v0 on [huggingface](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0).
|
| 24 |
|
| 25 |
-
- 2024-05-08: We [
|
| 26 |
|
| 27 |
# Get started
|
| 28 |
|
|
|
|
| 14 |
|
| 15 |
With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages. minicpm-visual-embedding-v0 is trained with over 30k paired query - visual document pages, including textual document, visual document, arxiv figures, industry documents, textbooks, ebooks, etc. The performance of minicpm-visual-embedding-v0 is on a par with a text embedding on text-oriented documents, and an advantages on visually-intensive documents.
|
| 16 |
|
|
|
|
|
|
|
| 17 |

|
| 18 |
|
| 19 |
# News
|
| 20 |
|
| 21 |
- 2024-06-27: We released our first visual embedding model checkpoint minicpm-visual-embedding-v0 on [huggingface](https://huggingface.co/RhapsodyAI/minicpm-visual-embedding-v0).
|
| 22 |
|
| 23 |
+
- 2024-05-08: We [open-sourced](https://github.com/bokesyo/minicpm-visual-embedding) our training code (full-parameter tuning with GradCache and DeepSpeed, supports large batch size across multiple GPUs with zero-stage1) and eval code.
|
| 24 |
|
| 25 |
# Get started
|
| 26 |
|