Update README.md
Browse files
README.md
CHANGED
|
@@ -45,9 +45,8 @@ Both image recognition (classification, retrieval, etc) and text generation (ima
|
|
| 45 |
|
| 46 |
# Uses
|
| 47 |
|
| 48 |
-
|
| 49 |
|
| 50 |
-
The OpenAI CLIP paper includes a discussion of potential downstream impacts to provide an example for this sort of analysis.
|
| 51 |
Details on the DataComp-1.4B training dataset can be found in [DataComp repository](https://github.com/mlfoundations/datacomp) and the [DataComp NeurIPS Oral paper](https://openreview.net/forum?id=dVaWCDMBof).
|
| 52 |
|
| 53 |
## Direct Use
|
|
@@ -67,7 +66,7 @@ Image classification, retrieval and image captioning. Linear probing and full fi
|
|
| 67 |
|
| 68 |
As per the OpenAI models,
|
| 69 |
|
| 70 |
-
**Any** deployed use case of the model (that is, in form of an end product) - whether commercial or not - is currently out of scope. Non-deployed use cases such as image search in a constrained environment, are also not recommended unless there is thorough in-domain testing of the model with a specific, fixed class taxonomy. This is because our safety assessment demonstrated a high need for task specific testing especially given the variability of CLIP’s performance with different class taxonomies. This makes untested and unconstrained deployment of the model in any use case currently potentially error prone and thus unsafe.
|
| 71 |
|
| 72 |
Certain use cases which would fall under the domain of surveillance and facial recognition are always out-of-scope regardless of performance of the model. This is because the use of artificial intelligence for tasks such as these can be premature currently given the lack of testing norms and checks to ensure its fair use.
|
| 73 |
|
|
@@ -81,7 +80,7 @@ Further the above notice, the DataComp-1.4B dataset used in training of these mo
|
|
| 81 |
|
| 82 |
This model was trained on [DataComp-1.4B](https://github.com/mlfoundations/datacomp), [DataComp paper](https://openreview.net/forum?id=dVaWCDMBof), [DataComp-1.4B metadata at HF](https://huggingface.co/datasets/mlfoundations/datacomp_1b) (also known as DataComp-XL), which contains 1.4 Billion image-text samples.
|
| 83 |
|
| 84 |
-
**IMPORTANT NOTE:**
|
| 85 |
|
| 86 |
## Training Procedure
|
| 87 |
|
|
|
|
| 45 |
|
| 46 |
# Uses
|
| 47 |
|
| 48 |
+
This model is intended as a research output for research communities. We hope that this model will enable researchers to better understand and explore zero-shot, arbitrary image classification and retrieval, and generalization capabilities of language-vision learning in general. We also hope it can be used for interdisciplinary studies of the impact of such model, eg when used as component in VLMs or other multi-modal models.
|
| 49 |
|
|
|
|
| 50 |
Details on the DataComp-1.4B training dataset can be found in [DataComp repository](https://github.com/mlfoundations/datacomp) and the [DataComp NeurIPS Oral paper](https://openreview.net/forum?id=dVaWCDMBof).
|
| 51 |
|
| 52 |
## Direct Use
|
|
|
|
| 66 |
|
| 67 |
As per the OpenAI models,
|
| 68 |
|
| 69 |
+
**Any** deployed use case of the model (that is, in form of an end product) - whether commercial or not - is currently out of scope. Non-deployed use cases such as image search in a constrained environment, are also not recommended unless there is thorough in-domain testing of the model with a specific, fixed class taxonomy. This is because our safety assessment demonstrated a high need for task specific testing especially given the variability of CLIP’s performance with different class taxonomies. This makes untested and unconstrained deployment of the model in any use case currently potentially error prone and thus unsafe.
|
| 70 |
|
| 71 |
Certain use cases which would fall under the domain of surveillance and facial recognition are always out-of-scope regardless of performance of the model. This is because the use of artificial intelligence for tasks such as these can be premature currently given the lack of testing norms and checks to ensure its fair use.
|
| 72 |
|
|
|
|
| 80 |
|
| 81 |
This model was trained on [DataComp-1.4B](https://github.com/mlfoundations/datacomp), [DataComp paper](https://openreview.net/forum?id=dVaWCDMBof), [DataComp-1.4B metadata at HF](https://huggingface.co/datasets/mlfoundations/datacomp_1b) (also known as DataComp-XL), which contains 1.4 Billion image-text samples.
|
| 82 |
|
| 83 |
+
**IMPORTANT NOTE:** Our recommendation is to use the model pre-trained on open DataComp-1.4B dataset only for research purposes. Open datasets provided to broad research and other interested communities allow reproducible and transparent studies of model training and resulting capabilities, the resulting models are basic research artefacts and as such are not recommended to be used for creating any ready-to-go industrial products.
|
| 84 |
|
| 85 |
## Training Procedure
|
| 86 |
|