Instructions to use Lin-Chen/sharegpt4video-8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Lin-Chen/sharegpt4video-8b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("visual-question-answering", model="Lin-Chen/sharegpt4video-8b")# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Lin-Chen/sharegpt4video-8b", dtype="auto") - Notebooks
- Google Colab
- Kaggle
model_type: "llava_llama" => "llava"
#2
by amitfin - opened
- config.json +1 -1
config.json
CHANGED
|
@@ -46,7 +46,7 @@
|
|
| 46 |
"mm_vision_select_layer": -2,
|
| 47 |
"mm_vision_tower": "openai/clip-vit-large-patch14-336",
|
| 48 |
"mm_vision_tower_lr": 2e-06,
|
| 49 |
-
"model_type": "
|
| 50 |
"num_attention_heads": 32,
|
| 51 |
"num_hidden_layers": 32,
|
| 52 |
"num_key_value_heads": 8,
|
|
|
|
| 46 |
"mm_vision_select_layer": -2,
|
| 47 |
"mm_vision_tower": "openai/clip-vit-large-patch14-336",
|
| 48 |
"mm_vision_tower_lr": 2e-06,
|
| 49 |
+
"model_type": "llava",
|
| 50 |
"num_attention_heads": 32,
|
| 51 |
"num_hidden_layers": 32,
|
| 52 |
"num_key_value_heads": 8,
|