Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,6 @@ tags:
|
|
| 11 |
---
|
| 12 |
# ColSmolVLM-500M-Instruct: Visual Retriever based on SmolVLM-500M-Instruct with ColBERT strategy
|
| 13 |
|
| 14 |
-
### This is a version trained with batch_size 32 for 3 epochs
|
| 15 |
|
| 16 |
ColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features.
|
| 17 |
It is a SmolVLM extension that generates [ColBERT](https://arxiv.org/abs/2004.12832)- style multi-vector representations of text and images.
|
|
@@ -19,6 +18,13 @@ It was introduced in the paper [ColPali: Efficient Document Retrieval with Visio
|
|
| 19 |
|
| 20 |
<p align="center"><img width=800 src="https://github.com/illuin-tech/colpali/blob/main/assets/colpali_architecture.webp?raw=true"/></p>
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
## Version specificity
|
| 23 |
|
| 24 |
This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo)
|
|
|
|
| 11 |
---
|
| 12 |
# ColSmolVLM-500M-Instruct: Visual Retriever based on SmolVLM-500M-Instruct with ColBERT strategy
|
| 13 |
|
|
|
|
| 14 |
|
| 15 |
ColSmolVLM is a model based on a novel model architecture and training strategy based on Vision Language Models (VLMs) to efficiently index documents from their visual features.
|
| 16 |
It is a SmolVLM extension that generates [ColBERT](https://arxiv.org/abs/2004.12832)- style multi-vector representations of text and images.
|
|
|
|
| 18 |
|
| 19 |
<p align="center"><img width=800 src="https://github.com/illuin-tech/colpali/blob/main/assets/colpali_architecture.webp?raw=true"/></p>
|
| 20 |
|
| 21 |
+
|
| 22 |
+
## Usage
|
| 23 |
+
|
| 24 |
+
> [!WARNING]
|
| 25 |
+
> This version should not be used: it is solely the base version useful for deterministic LoRA initialization.
|
| 26 |
+
|
| 27 |
+
|
| 28 |
## Version specificity
|
| 29 |
|
| 30 |
This version is trained with the commit b983e40 of the Colpali repository. (main branch from the repo)
|