tillmannohm commited on
Commit
565db07
·
verified ·
1 Parent(s): cfaf948

Upload 3 files

Browse files
Files changed (3) hide show
  1. README.md +98 -0
  2. config.yaml +164 -0
  3. model.onnx +3 -0
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: onnx
3
+ pipeline_tag: feature-extraction
4
+ license: mit
5
+ tags:
6
+ - eidora
7
+ - eidora-model-zoo
8
+ - onnx
9
+ - onnxruntime
10
+ - embeddings
11
+ - image
12
+ - clip
13
+ - compute:light
14
+ - modality:image
15
+ base_model: openai/clip-vit-base-patch32
16
+ datasets:
17
+ - openai/webimage-text
18
+ metrics:
19
+ - cosine-similarity
20
+ model-index:
21
+ - name: CLIP_VITB32_512
22
+ results: []
23
+ ---
24
+
25
+ # CLIP_VITB32_512
26
+
27
+ CLIP_VITB32_512 is a light image embedding model for fast visual grouping in EIDORA. Choose it when you want a broadly useful visual model that runs on most laptops.
28
+
29
+ ## Best For
30
+
31
+ - Fast first-pass visual grouping.
32
+ - Image collections where semantic similarity matters more than exact object classification.
33
+ - A broadly useful starter model for EIDORA image workflows.
34
+
35
+ ## Not Ideal For
36
+
37
+ - Fine-grained visual similarity where a heavier model is acceptable.
38
+ - Text-only projects.
39
+ - Specialized domains that need a domain-trained visual encoder.
40
+
41
+ ## Compute Tier
42
+
43
+ Light: small download, low memory, faster CPU runtime. Intended for laptop CPU use and large first-pass projects.
44
+
45
+ ## Inputs
46
+
47
+ - `image`: required image input from `media_source`.
48
+
49
+ ## Output
50
+
51
+ The primary output is `embedding`, a float32 tensor shaped `[batch, 512]`. Embeddings are already normalized and are intended for cosine similarity.
52
+
53
+ ## Usage In EIDORA
54
+
55
+ EIDORA shows this package as a light image embedding model in the Model Zoo. Use it for discovery maps, grouping, retrieval, and related embedding workflows.
56
+
57
+ ## Preprocessing
58
+
59
+ - `image`: resize mode defaults to `crop_center`; rescale uses `1/255`; normalize inside the ONNX graph with mean `[0.48145466, 0.4578275, 0.40821073]` and std `[0.26862954, 0.26130258, 0.27577711]`.
60
+
61
+ ## Authorship And Citation
62
+
63
+ This ONNX package was produced by EIDORA from the original CLIP ViT-B/32 model. EIDORA converted the model to ONNX and is not the original model creator. Please cite Learning Transferable Visual Models From Natural Language Supervision and the original model repository when using this converted model.
64
+
65
+ Original model: https://github.com/openai/CLIP
66
+
67
+ Original paper: https://arxiv.org/abs/2103.00020
68
+
69
+ Authors: Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, Ilya Sutskever
70
+
71
+ ```bibtex
72
+ @inproceedings{radford2021learning,
73
+ title={Learning Transferable Visual Models From Natural Language Supervision},
74
+ author={Radford, Alec and Kim, Jong Wook and Hallacy, Chris and Ramesh, Aditya and Goh, Gabriel and Agarwal, Sandhini and Sastry, Girish and Askell, Amanda and Mishkin, Pamela and Clark, Jack and Krueger, Gretchen and Sutskever, Ilya},
75
+ booktitle={International Conference on Machine Learning},
76
+ year={2021}
77
+ }
78
+ ```
79
+
80
+ ## Training Data And Provenance
81
+
82
+ Base model: `openai/clip-vit-base-patch32`. Source repository: https://huggingface.co/openai/clip-vit-base-patch32. Known training data: WebImageText-style image/text pairs described by the upstream CLIP authors. Package payload size: 351584808 bytes.
83
+
84
+ ## Evaluation And Validation
85
+
86
+ The package validation checks that the ONNX graph loads with ONNX Runtime CPU execution, runs the declared fixtures, returns finite float32 embeddings with the declared shape, and matches the artifact hash recorded in `config.yaml`.
87
+
88
+ ## Limitations And Safety
89
+
90
+ CLIP embeddings can reflect web-scale training data biases and may miss fine visual details. Similarity scores should not be used as sole evidence for identity, authorship, intent, or sensitive attributes.
91
+
92
+ ## License And Attribution
93
+
94
+ This package uses license `mit`. Upstream license: MIT. Converted to ONNX for EIDORA from the original OpenAI CLIP model.
95
+
96
+ ## Version
97
+
98
+ Package version: 1.0.0. ONNX opset: 17. Exporter: eidora-onnx-exporter 0.1.0.
config.yaml ADDED
@@ -0,0 +1,164 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ schema_version: 1
2
+ id: EIDORA/CLIP_VITB32
3
+ name: CLIP_VITB32
4
+ version: 1.0.0
5
+ model_family: CLIP
6
+ backend: onnx
7
+ file_size: 352 MB
8
+ runtime:
9
+ adapter: onnx_image
10
+ execution_provider: CPUExecutionProvider
11
+ model_path: model.onnx
12
+ input_names:
13
+ - pixel_values
14
+ output_name: embedding
15
+ onnxruntime:
16
+ opset: 17
17
+ tested_versions: '>=1.17,<2'
18
+ artifact:
19
+ path: model.onnx
20
+ sha256: 6e778c76fed3af2e98c837c304fa2f85f545b3e35d13854448c248812fcdf533
21
+ package_size_bytes: 351584808
22
+ inputs:
23
+ - id: image
24
+ modality: image
25
+ label: Images
26
+ required: true
27
+ source_kind: media_source
28
+ requirements:
29
+ color_space: RGB
30
+ layout: NCHW
31
+ width: 224
32
+ height: 224
33
+ preprocess:
34
+ image:
35
+ resize_mode:
36
+ label: Image preprocessing
37
+ kind: choice
38
+ choices:
39
+ - distort
40
+ - crop_center
41
+ - add_padding
42
+ default: crop_center
43
+ visible: true
44
+ resize:
45
+ mode: resize_shorter_edge_then_center_crop
46
+ resize_size: 224
47
+ crop_width: 224
48
+ crop_height: 224
49
+ interpolation: bicubic
50
+ source: CLIPImageProcessor for openai/clip-vit-base-patch32
51
+ rescale: 1/255
52
+ normalize:
53
+ mean:
54
+ - 0.48145466
55
+ - 0.4578275
56
+ - 0.40821073
57
+ std:
58
+ - 0.26862954
59
+ - 0.26130258
60
+ - 0.27577711
61
+ inside_onnx: true
62
+ embedding:
63
+ dimensions: 512
64
+ feature_type: embedding
65
+ pooling: pooler
66
+ normalized: true
67
+ similarity: cosine
68
+ output_name: embedding
69
+ dtype: float32
70
+ shape:
71
+ - batch
72
+ - 512
73
+ display:
74
+ summary: 'Light: fast image embeddings for visual grouping and discovery on laptops.'
75
+ compute_tier: light
76
+ modality_labels:
77
+ - image
78
+ recommended_batch_size: 8
79
+ validation:
80
+ fixtures:
81
+ - id: image_tensor_001
82
+ input_shape:
83
+ - 1
84
+ - 3
85
+ - 224
86
+ - 224
87
+ expected_shape:
88
+ - 1
89
+ - 512
90
+ seed: 29
91
+ checks:
92
+ load_with: onnxruntime
93
+ execution_provider: CPUExecutionProvider
94
+ output_dtype: float32
95
+ finite: true
96
+ normalized_l2_range:
97
+ - 0.99
98
+ - 1.01
99
+ provenance:
100
+ base_model: openai/clip-vit-base-patch32
101
+ source_repository: https://huggingface.co/openai/clip-vit-base-patch32
102
+ original_model_name: CLIP ViT-B/32
103
+ original_model_url: https://github.com/openai/CLIP
104
+ authors:
105
+ - Alec Radford
106
+ - Jong Wook Kim
107
+ - Chris Hallacy
108
+ - Aditya Ramesh
109
+ - Gabriel Goh
110
+ - Sandhini Agarwal
111
+ - Girish Sastry
112
+ - Amanda Askell
113
+ - Pamela Mishkin
114
+ - Jack Clark
115
+ - Gretchen Krueger
116
+ - Ilya Sutskever
117
+ paper_title: Learning Transferable Visual Models From Natural Language Supervision
118
+ paper_url: https://arxiv.org/abs/2103.00020
119
+ upstream_license: MIT
120
+ training_data: WebImageText-style image/text pairs described by the upstream CLIP
121
+ authors.
122
+ citation: "@inproceedings{radford2021learning,\n title={Learning Transferable Visual\
123
+ \ Models From Natural Language Supervision},\n author={Radford, Alec and Kim,\
124
+ \ Jong Wook and Hallacy, Chris and Ramesh, Aditya and Goh, Gabriel and Agarwal,\
125
+ \ Sandhini and Sastry, Girish and Askell, Amanda and Mishkin, Pamela and Clark,\
126
+ \ Jack and Krueger, Gretchen and Sutskever, Ilya},\n booktitle={International\
127
+ \ Conference on Machine Learning},\n year={2021}\n}\n"
128
+ conversion_note: EIDORA produced this ONNX conversion and is not the original model
129
+ creator.
130
+ export_date: '2026-07-14'
131
+ exporter_version: eidora-onnx-exporter 0.1.0
132
+ model_card:
133
+ best_for:
134
+ - Fast first-pass visual grouping.
135
+ - Image collections where semantic similarity matters more than exact object classification.
136
+ - A broadly useful starter model for EIDORA image workflows.
137
+ not_ideal_for:
138
+ - Fine-grained visual similarity where a heavier model is acceptable.
139
+ - Text-only projects.
140
+ - Specialized domains that need a domain-trained visual encoder.
141
+ limitations: CLIP embeddings can reflect web-scale training data biases and may
142
+ miss fine visual details. Similarity scores should not be used as sole evidence
143
+ for identity, authorship, intent, or sensitive attributes.
144
+ license:
145
+ id: mit
146
+ attribution: Converted to ONNX for EIDORA from the original OpenAI CLIP model.
147
+ huggingface:
148
+ org: eidora
149
+ repo_name: CLIP_VITB32_512
150
+ pipeline_tag: feature-extraction
151
+ tags:
152
+ - eidora
153
+ - eidora-model-zoo
154
+ - onnx
155
+ - onnxruntime
156
+ - embeddings
157
+ - image
158
+ - clip
159
+ - compute:light
160
+ - modality:image
161
+ datasets:
162
+ - openai/webimage-text
163
+ metrics:
164
+ - cosine-similarity
model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e778c76fed3af2e98c837c304fa2f85f545b3e35d13854448c248812fcdf533
3
+ size 351584308