Update README.md
Browse files
README.md
CHANGED
|
@@ -8,16 +8,18 @@ pinned: false
|
|
| 8 |
short_description: VLM assets for Llama-3.2-11B-Vision-Instruct
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# π³π΄π©π° Vision Language Model assets
|
| 12 |
-
|
| 13 |
|
| 14 |
# In these collections you will find:
|
| 15 |
- π½ Datasets for fine-tuning VLM
|
| 16 |
- π³π΄ MykMaks/NorwegianDataset-compressed
|
| 17 |
- π©π° MykMaks/fmsudgivelser
|
| 18 |
- πΎ Training code
|
|
|
|
|
|
|
| 19 |
- π€ Model LORA-adapter checkpoints for Llama-3.2-11B-Vision-Instruct
|
| 20 |
- The model is iteratively trained over all datasets:
|
| 21 |
-
- The suffix of each file denotes the order checkpoint, along with the dataset that it was fine-tuned on
|
| 22 |
- πΈ Final merged model:
|
| 23 |
- <b>Llama-3.2-11B-Vision-Instruct-MykMaks</b>
|
|
|
|
| 8 |
short_description: VLM assets for Llama-3.2-11B-Vision-Instruct
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# π³π΄π©π° Open Source Vision Language Model assets
|
| 12 |
+
Building on the philosophy of open source π¦, this repo is an effort to support development of small VLM's in the Scandinavian languages. Aa we are only fluenr in Norwegian and Danish, we have focused on these two languages. However, we encourgage the community () to help build on our work and extend the coverage. The current models and data focus on transcription and annotiation of documents in Norwegian and Danish, going beyond the capabilities of OCR.
|
| 13 |
|
| 14 |
# In these collections you will find:
|
| 15 |
- π½ Datasets for fine-tuning VLM
|
| 16 |
- π³π΄ MykMaks/NorwegianDataset-compressed
|
| 17 |
- π©π° MykMaks/fmsudgivelser
|
| 18 |
- πΎ Training code
|
| 19 |
+
- MM checkpoints: https://github.com/mikeriess/llama33_resources/
|
| 20 |
+
- V-I checkpoints: https://github.com/mikeriess/llama33_resources/
|
| 21 |
- π€ Model LORA-adapter checkpoints for Llama-3.2-11B-Vision-Instruct
|
| 22 |
- The model is iteratively trained over all datasets:
|
| 23 |
+
- The suffix of each file denotes the order of the checkpoint, along with the dataset that it was fine-tuned on
|
| 24 |
- πΈ Final merged model:
|
| 25 |
- <b>Llama-3.2-11B-Vision-Instruct-MykMaks</b>
|