Instructions to use deepseek-ai/Janus-Pro-7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use deepseek-ai/Janus-Pro-7B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("deepseek-ai/Janus-Pro-7B", dtype="auto") - Notebooks
- Google Colab
- Kaggle
How to use images from url directly so we don't have to download and provide the path?
#165
by tkaintura - opened
I'm using Janus-pro-7b, I want to directly give images from url and don't want to save it since it takes more memory.
How can I do that since in the code block below it requires path :
# setting conversation template
conversation = [
{"role": "<|User|>", "content": f"<image_placeholder>\n{question}", "images": [image_path]},
{"role": "<|Assistant|>", "content": ""},
]
# Load image
pil_images = load_pil_images(conversation)