Instructions to use HandmadeMayo/UDOP with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HandmadeMayo/UDOP with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="HandmadeMayo/UDOP")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("HandmadeMayo/UDOP") model = AutoModelForMultimodalLM.from_pretrained("HandmadeMayo/UDOP", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use HandmadeMayo/UDOP with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "HandmadeMayo/UDOP" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HandmadeMayo/UDOP", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/HandmadeMayo/UDOP
- SGLang
How to use HandmadeMayo/UDOP with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "HandmadeMayo/UDOP" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HandmadeMayo/UDOP", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "HandmadeMayo/UDOP" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "HandmadeMayo/UDOP", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use HandmadeMayo/UDOP with Docker Model Runner:
docker model run hf.co/HandmadeMayo/UDOP
Commit History
-
Upload processor
Verified signature834bd94 -
Upload UdopForConditionalGeneration
Verified signaturefc89e3a
-
Upload processor
Verified signature49b9a54 -
Upload UdopForConditionalGeneration
Verified signatured0746ca -
Upload processor
Verified signatureb73e0e0 -
Upload UdopForConditionalGeneration
Verified signaturea5b606d -
Upload processor
Verified signaturef20a0c5 -
Upload UdopForConditionalGeneration
Verified signature994a60c -
Upload processor
Verified signature46d342b -
Upload UdopForConditionalGeneration
Verified signaturebce5bd0 -
Upload processor
Verified signature384f22e -
Upload UdopForConditionalGeneration
Verified signatureb878d23 -
Upload processor
Verified signature53488dd -
Upload UdopForConditionalGeneration
Verified signaturee8e96e9 -
Upload processor
Verified signature14fa780 -
Upload UdopForConditionalGeneration
Verified signature9dd63d8 -
Upload processor
Verified signature33506bf -
Upload UdopForConditionalGeneration
Verified signaturef0c60e0 -
Upload processor
Verified signature68b55a3 -
Upload UdopForConditionalGeneration
Verified signature230be2b -
Upload processor
Verified signature1152ee6 -
Upload UdopForConditionalGeneration
Verified signature41f35ca
-
Upload processor
Verified signature07bc987 -
Upload UdopForConditionalGeneration
Verified signature8e11336 -
Upload processor
Verified signature845e02e -
Upload UdopForConditionalGeneration
Verified signature8b28796 -
Upload processor
Verified signature7a7bee9 -
Upload UdopForConditionalGeneration
Verified signaturedd7872e -
Upload processor
Verified signature27733bb -
Upload UdopForConditionalGeneration
Verified signature061fcd9 -
Upload processor
Verified signature1d4fff5 -
Upload UdopForConditionalGeneration
Verified signature477e0b3
-
Upload processor
Verified signaturef2e0062 -
Upload UdopForConditionalGeneration
Verified signature0bbbb34 -
Upload processor
Verified signature8f357c9 -
Upload UdopForConditionalGeneration
Verified signature27a24e9 -
Upload processor
Verified signaturefba967c -
Upload UdopForConditionalGeneration
Verified signatureac5949c -
Upload processor
Verified signature80474a0 -
Upload UdopForConditionalGeneration
Verified signature1c440c3 -
Upload processor
Verified signatureba387b0 -
Upload UdopForConditionalGeneration
Verified signature6f1a568 -
Upload processor
Verified signatureed4cbb4 -
Upload UdopForConditionalGeneration
Verified signature1246a3b -
Upload processor
Verified signature658e7af -
Upload UdopForConditionalGeneration
Verified signature0da5598 -
Upload processor
Verified signatured506b7c -
Upload UdopForConditionalGeneration
Verified signature91460fb -
Upload processor
Verified signaturef4293a5 -
Upload UdopForConditionalGeneration
Verified signature6a2c350