Commit
·
8bb01e6
1
Parent(s):
bea4074
release Finedefics
Browse files
README.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Finedefics Model Card
|
| 2 |
+
|
| 3 |
+
## Model details
|
| 4 |
+
|
| 5 |
+
**Model type:**
|
| 6 |
+
Finedefics is an open-source MLLM that enhances the model's FGVR capability by incorporating informative attribute descriptions of objects into the training phase.
|
| 7 |
+
It is an auto-regressive language model, based on the transformer architecture.
|
| 8 |
+
Base MLLM: [HuggingFaceM4/idefics2-8b](https://huggingface.co/HuggingFaceM4/idefics2-8b)
|
| 9 |
+
|
| 10 |
+
**Paper or resources for more information:**
|
| 11 |
+
OpenReview: https://openreview.net/forum?id=p3NKpom1VL
|
| 12 |
+
Arxiv: https://arxiv.org/abs/2501.15140
|
| 13 |
+
|
| 14 |
+
## License
|
| 15 |
+
Idefics2 is licensed under the Apache 2.0 license, and we release the Finedefics checkpoints under the same license.
|
| 16 |
+
|
| 17 |
+
**Where to send questions or comments about the model:**
|
| 18 |
+
https://github.com/PKU-ICST-MIPL/Finedefics_ICLR2025/issues
|
| 19 |
+
|
| 20 |
+
## Intended use
|
| 21 |
+
**Primary intended uses:**
|
| 22 |
+
The primary use of Finedefics is research on Fine-grained MLLM.
|
| 23 |
+
|
| 24 |
+
**Primary intended users:**
|
| 25 |
+
The primary intended users of the model are researchers and hobbyists in computer vision, natural language processing, machine learning, and artificial intelligence.
|
| 26 |
+
|
| 27 |
+
## Training and evaluation datasets
|
| 28 |
+
A collection of 6 fine-grained visual recognition datasets, including Stanford Dog-120, Bird-200, FGVC-Aircraft, Flower-102, Oxford-IIIT Pet-37, and Stanford Car-196.
|