Instructions to use Kwai-Keye/Keye-VL-8B-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Kwai-Keye/Keye-VL-8B-Preview with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Kwai-Keye/Keye-VL-8B-Preview", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -138,7 +138,7 @@ inputs = processor(
|
|
| 138 |
inputs = inputs.to("cuda")
|
| 139 |
|
| 140 |
# Inference: Generation of the output
|
| 141 |
-
generated_ids = model.generate(**inputs, max_new_tokens=
|
| 142 |
generated_ids_trimmed = [
|
| 143 |
out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
|
| 144 |
]
|
|
|
|
| 138 |
inputs = inputs.to("cuda")
|
| 139 |
|
| 140 |
# Inference: Generation of the output
|
| 141 |
+
generated_ids = model.generate(**inputs, max_new_tokens=1024)
|
| 142 |
generated_ids_trimmed = [
|
| 143 |
out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
|
| 144 |
]
|