Instructions to use keras/blip2_opt_6.7b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- KerasHub
How to use keras/blip2_opt_6.7b with KerasHub:
import keras_hub # Load CausalLM model (optional: use half precision for inference) causal_lm = keras_hub.models.CausalLM.from_preset("hf://keras/blip2_opt_6.7b", dtype="bfloat16") causal_lm.compile(sampler="greedy") # (optional) specify a sampler # Generate text causal_lm.generate("Keras: deep learning for", max_length=64)import keras_hub # Create a Seq2SeqLM model task = keras_hub.models.Seq2SeqLM.from_preset("hf://keras/blip2_opt_6.7b")import keras_hub # Create a Backbone model unspecialized for any task backbone = keras_hub.models.Backbone.from_preset("hf://keras/blip2_opt_6.7b") - Keras
How to use keras/blip2_opt_6.7b with Keras:
# Available backend options are: "jax", "torch", "tensorflow". import os os.environ["KERAS_BACKEND"] = "jax" import keras model = keras.saving.load_model("hf://keras/blip2_opt_6.7b") - Notebooks
- Google Colab
- Kaggle
File size: 2,460 Bytes
3cfaa1f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 | {
"module": "keras_hub.src.models.blip2.blip2_causal_lm_preprocessor",
"class_name": "BLIP2CausalLMPreprocessor",
"config": {
"name": "blip2_causal_lm_preprocessor",
"trainable": true,
"dtype": {
"module": "keras",
"class_name": "DTypePolicy",
"config": {
"name": "float32"
},
"registered_name": null
},
"tokenizer": {
"module": "keras_hub.src.models.blip2.blip2_opt_tokenizer",
"class_name": "BLIP2OPTTokenizer",
"config": {
"name": "blip2opt_tokenizer",
"trainable": true,
"dtype": {
"module": "keras",
"class_name": "DTypePolicy",
"config": {
"name": "int32"
},
"registered_name": null
},
"config_file": "tokenizer.json",
"sequence_length": null,
"add_prefix_space": false,
"unsplittable_tokens": [
"<pad>",
"</s>",
"<image>"
]
},
"registered_name": "keras_hub>BLIP2OPTTokenizer"
},
"image_converter": {
"module": "keras_hub.src.models.blip2.blip2_image_converter",
"class_name": "BLIP2ImageConverter",
"config": {
"name": "blip2_image_converter",
"trainable": true,
"dtype": {
"module": "keras",
"class_name": "DTypePolicy",
"config": {
"name": "float32"
},
"registered_name": null
},
"image_size": [
224,
224
],
"interpolation": "bicubic",
"antialias": true,
"crop_to_aspect_ratio": false,
"pad_to_aspect_ratio": false,
"bounding_box_format": "yxyx"
},
"registered_name": "keras_hub>BLIP2ImageConverter"
},
"config_file": "preprocessor.json",
"sequence_length": 512,
"add_start_token": true,
"add_end_token": true
},
"registered_name": "keras_hub>BLIP2CausalLMPreprocessor"
} |