prasadsachin commited on
Commit
49b0fac
·
verified ·
1 Parent(s): b26030e

Update README.md with new model card content

Browse files
Files changed (1) hide show
  1. README.md +39 -18
README.md CHANGED
@@ -1,21 +1,42 @@
1
  ---
2
  library_name: keras-hub
3
  ---
4
- This is a [`DeiT` model](https://keras.io/api/keras_hub/models/dei_t) uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends.
5
- This model is related to a `ImageClassifier` task.
6
-
7
- Model config:
8
- * **name:** dei_t_backbone
9
- * **trainable:** True
10
- * **image_shape:** [224, 224, 3]
11
- * **patch_size:** [16, 16]
12
- * **num_layers:** 12
13
- * **num_heads:** 12
14
- * **hidden_dim:** 768
15
- * **intermediate_dim:** 3072
16
- * **dropout_rate:** 0.0
17
- * **attention_dropout:** 0.0
18
- * **layer_norm_epsilon:** 1e-12
19
- * **use_mha_bias:** True
20
-
21
- This model card has been generated automatically and should be completed by the model author. See [Model Cards documentation](https://huggingface.co/docs/hub/model-cards) for more information.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  library_name: keras-hub
3
  ---
4
+ ### Model Overview
5
+ Data-efficient Image Transformer (DeiT).
6
+
7
+ **Reference**
8
+
9
+ - [Training data-efficient image transformers & distillation through attention](https://arxiv.org/abs/2012.12877)
10
+
11
+ ViT models required training on expensive infrastructure for multiple weeks, using external data. DeiT (data-efficient image transformers) are more efficiently trained transformers for image classification, requiring far less data and far less computing resources compared to the original ViT models.
12
+
13
+ ## Links
14
+
15
+ * [DeiT Quickstart Notebook] - coming soon
16
+ * [DeiT API Documentation] - coming soon
17
+ * [DeiT Beginner Guide] - coming soon
18
+ * [KerasHub Model Publishing Guide](https://keras.io/guides/keras_hub/upload/)
19
+
20
+
21
+ ## Installation
22
+
23
+ Keras and KerasHub can be installed with:
24
+
25
+ ```
26
+ pip install -U -q keras-hub
27
+ pip install -U -q keras
28
+ ```
29
+
30
+ Jax, TensorFlow, and Torch come preinstalled in Kaggle Notebooks. For instructions on installing them in another environment see the [Keras Getting Started](https://keras.io/getting_started/) page.
31
+
32
+ ## Presets
33
+
34
+ The following model checkpoints are provided by the Keras team. Weights have been ported from: https://huggingface.co. Full code examples for each are available below.
35
+
36
+ | Preset name | Parameters | Description |
37
+ |------------------------------------|------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
38
+ | deit_tiny_distilled_patch16_224_imagenet | 5.52M | DeiT-T16 model pre-trained on the ImageNet 1k dataset with image resolution of 224x224 |
39
+ | deit_small_distilled_patch16_224_imagenet | 21.66M | DeiT-S16 model pre-trained on the ImageNet 1k dataset with image resolution of 224x224 |
40
+ | deit_base_distilled_patch16_224_imagenet | 85.80M | DeiT-B16 model pre-trained on the ImageNet 1k dataset with image resolution of 224x224 . |
41
+ | deit_base_distilled_patch16_384_imagenet | 86.09M | DeiT-B16 model pre-trained on the ImageNet 1k dataset with image resolution of 384x384 |
42
+