prasadsachin commited on
Commit
7da0e55
·
verified ·
1 Parent(s): 09a6b22

Update README.md with new model card content

Browse files
Files changed (1) hide show
  1. README.md +48 -28
README.md CHANGED
@@ -1,31 +1,51 @@
1
  ---
2
  library_name: keras-hub
3
  ---
4
- This is a [`DINOV3` model](https://keras.io/api/keras_hub/models/dinov3) uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends.
5
- Model config:
6
- * **name:** dinov3_backbone
7
- * **trainable:** True
8
- * **dtype:** {'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None}
9
- * **patch_size:** 16
10
- * **num_layers:** 12
11
- * **hidden_dim:** 384
12
- * **num_heads:** 6
13
- * **intermediate_dim:** 1536
14
- * **num_register_tokens:** 4
15
- * **use_mask_token:** True
16
- * **layer_scale_init_value:** 1.0
17
- * **hidden_activation:** silu
18
- * **use_gated_mlp:** True
19
- * **use_query_bias:** True
20
- * **use_key_bias:** False
21
- * **use_value_bias:** True
22
- * **use_proj_bias:** True
23
- * **use_mlp_bias:** True
24
- * **attention_dropout:** 0.0
25
- * **drop_path_rate:** 0.0
26
- * **layer_norm_eps:** 1e-05
27
- * **image_shape:** [224, 224, 3]
28
- * **rope_theta:** 100.0
29
- * **apply_layernorm:** False
30
-
31
- This model card has been generated automatically and should be completed by the model author. See [Model Cards documentation](https://huggingface.co/docs/hub/model-cards) for more information.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  library_name: keras-hub
3
  ---
4
+ ### Model Overview
5
+ Vision Transformer (ViT) and ConvNeXt models trained using the DINOv3 method.
6
+
7
+ **Reference**
8
+
9
+ - [DINOv3: Learning Robust Visual Features without Supervision](https://arxiv.org/abs/2508.10104)
10
+
11
+ DINOv3 offers a powerful, generalist visual backbone learned entirely from
12
+ unlabeled images as described in DINOv3: Learning Robust Visual Features
13
+ without Supervision.
14
+
15
+ ## Links
16
+
17
+ * [DINOv3 Quickstart Notebook] - coming soon
18
+ * [DINOv3 API Documentation] - coming soon
19
+ * [DINOv3 Beginner Guide] - coming soon
20
+ * [KerasHub Model Publishing Guide](https://keras.io/guides/keras_hub/upload/)
21
+
22
+
23
+ ## Installation
24
+
25
+ Keras and KerasHub can be installed with:
26
+
27
+ ```
28
+ pip install -U -q keras-hub
29
+ pip install -U -q keras
30
+ ```
31
+
32
+ Jax, TensorFlow, and Torch come preinstalled in Kaggle Notebooks. For instructions on installing them in another environment see the [Keras Getting Started](https://keras.io/getting_started/) page.
33
+
34
+ ## Presets
35
+
36
+ The following model checkpoints are provided by the Keras team. Weights have been ported from: https://huggingface.co. Full code examples for each are available below.
37
+
38
+ | Preset name | Parameters | Description |
39
+ |---|---|---|
40
+ | dinov3_vit_small_lvd1689m | 21.6M | Vision Transformer (small-sized model) trained on LVD-1689M using DINOv3. |
41
+ | dinov3_vit_small_plus_lvd1689m | 29M | Vision Transformer (small-plus-sized model) trained on LVD-1689M using DINOv3. |
42
+ | dinov3_vit_base_lvd1689m | 86M | Vision Transformer (base-sized model) trained on LVD-1689M using DINOv3. |
43
+ | dinov3_vit_large_lvd1689m | 300M | Vision Transformer (large-sized model) trained on LVD-1689M using DINOv3. |
44
+ | dinov3_vit_huge_plus_lvd1689m | 840M | Vision Transformer (huge-plus-sized model) trained on LVD-1689M using DINOv3. |
45
+ | dinov3_vit_7b_lvd1689m | 6.7B | Vision Transformer (7B-sized model) trained on LVD-1689M using DINOv3. |
46
+ | dinov3_vit_large_sat493m | 300M | Vision Transformer (large-sized model) trained on SAT-493M using DINOv3. |
47
+ | dinov3_vit_7b_sat493m | 6.7B | Vision Transformer (7B-sized model) trained on SAT-493M using DINOv3. |
48
+
49
+
50
+ All the models weights are under DINO V3 license: https://ai.meta.com/resources/models-and-libraries/dinov3-license/
51
+