|
|
--- |
|
|
library_name: keras-hub |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
This is a [`PARSeq` model](https://keras.io/api/keras_hub/models/par_seq) uploaded using the KerasHub library and can be used with JAX, TensorFlow, and PyTorch backends. |
|
|
This model is related to a `CausalLM` task. |
|
|
|
|
|
Model config: |
|
|
* **name:** par_seq_backbone |
|
|
* **trainable:** True |
|
|
* **dtype:** {'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None} |
|
|
* **image_encoder:** {'module': 'keras_hub.src.models.vit.vit_backbone', 'class_name': 'ViTBackbone', 'config': {'name': 'encoder', 'trainable': True, 'dtype': {'module': 'keras', 'class_name': 'DTypePolicy', 'config': {'name': 'float32'}, 'registered_name': None}, 'image_shape': [32, 128, 3], 'patch_size': [4, 8], 'num_layers': 12, 'num_heads': 6, 'hidden_dim': 384, 'mlp_dim': 1536, 'dropout_rate': 0.0, 'attention_dropout': 0.0, 'layer_norm_epsilon': 1e-06, 'use_mha_bias': True, 'use_mlp_bias': True, 'use_class_token': False, 'use_patch_bias': True}, 'registered_name': 'keras_hub>ViTBackbone'} |
|
|
* **vocabulary_size:** 97 |
|
|
* **max_label_length:** 25 |
|
|
* **decoder_hidden_dim:** 384 |
|
|
* **num_decoder_layers:** 1 |
|
|
* **num_decoder_heads:** 12 |
|
|
* **decoder_mlp_dim:** 1536 |
|
|
* **dropout_rate:** 0.1 |
|
|
* **attention_dropout:** 0.1 |
|
|
|
|
|
This model card has been generated automatically and should be completed by the model author. See [Model Cards documentation](https://huggingface.co/docs/hub/model-cards) for more information. |
|
|
|
