Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,31 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apple-amlr
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apple-amlr
|
| 3 |
+
license_name: apple-sample-code-license
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
A CLIP (Contrastive Language-Image Pre-training) ViT-B/32 model trained on Conceptual Captions 12M, Conceptual Captions 3M, and Shutterstock 15M.
|
| 8 |
+
Data Filtering Networks (DFNs) are small networks used to automatically filter large pools of uncurated data.
|
| 9 |
+
This model is a DFN trained on publicly available data.
|
| 10 |
+
|
| 11 |
+
This model has been converted to PyTorch from the original JAX checkpoints from Axlearn (https://github.com/apple/axlearn).
|
| 12 |
+
|
| 13 |
+
|
| 14 |
+
## Model Details
|
| 15 |
+
|
| 16 |
+
- **Model Type:** Contrastive Image-Text, Zero-Shot Image Classification.
|
| 17 |
+
- **Dataset:** CC12M + CC3M + SS15M
|
| 18 |
+
- **Papers:**
|
| 19 |
+
- Data Filtering Networks: https://arxiv.org/abs/2309.17425
|
| 20 |
+
- **Examples Seen:** 1.28B
|
| 21 |
+
|
| 22 |
+
## Citation
|
| 23 |
+
```bibtex
|
| 24 |
+
@article{fang2023data,
|
| 25 |
+
title={Data Filtering Networks},
|
| 26 |
+
author={Fang, Alex and Jose, Albin Madappally and Jain, Amit and Schmidt, Ludwig and Toshev, Alexander and Shankar, Vaishaal},
|
| 27 |
+
journal={arXiv preprint arXiv:2309.17425},
|
| 28 |
+
year={2023}
|
| 29 |
+
}
|
| 30 |
+
|
| 31 |
+
```
|