Image-Text-to-Text
Transformers
Safetensors
multilingual
GOT
feature-extraction
got
vision-language
ocr2.0
custom_code
Instructions to use srimanth-d/GOT_CPU with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use srimanth-d/GOT_CPU with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="srimanth-d/GOT_CPU", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("srimanth-d/GOT_CPU", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use srimanth-d/GOT_CPU with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "srimanth-d/GOT_CPU" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "srimanth-d/GOT_CPU", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/srimanth-d/GOT_CPU
- SGLang
How to use srimanth-d/GOT_CPU with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "srimanth-d/GOT_CPU" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "srimanth-d/GOT_CPU", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "srimanth-d/GOT_CPU" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "srimanth-d/GOT_CPU", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use srimanth-d/GOT_CPU with Docker Model Runner:
docker model run hf.co/srimanth-d/GOT_CPU
Commit History
Update modeling_got.py 4a76e0f verified
Update modeling_got.py 718f0f1 verified
Update modeling_got.py edc7f37 verified
Update modeling_got.py 15194a3 verified
Update modeling_got.py d02d539 verified
Update modeling_got.py 5b65c54 verified
Update modeling_got.py 646d03f verified
Update modeling_got.py fb190d7 verified
Update modeling_got.py f40c6ec verified
Update modeling_got.py 7e2b339 verified
Update modeling_got.py 9646a9b verified
Update modeling_got.py 1f97813 verified
Update modeling_got.py 06a9f8c verified
Update modeling_got.py f0461c9 verified
Update modeling_got.py 335c26a verified
Update modeling_got.py d5d9e39 verified
Update modeling_got.py 0abc3db verified
Update modeling_got.py 9ed59ac verified
Upload modeling_got.py 5364fe1 verified
Delete modeling_got.py d5f1f2e verified
Upload modeling_got.py c5b2116 verified
Delete modeling_got.py 99d3b0b verified
Upload modeling_got.py b779881 verified
Delete modeling_got.py 3ca36c1 verified
Upload modeling_got.py 0878766 verified
Delete modeling_got.py 47b339d verified
Update README.md b2f7974 verified
Create README.md 31f9720 verified
Update config.json 0d5be52 verified
Srimanth Dhondy commited on
Update config.json fcb5915 verified
Srimanth Dhondy commited on
Upload model.safetensors 7e31774 verified
Srimanth Dhondy commited on
Upload render_tools.py f6f9f31 verified
Srimanth Dhondy commited on
Upload modeling_got.py 728ee12 verified
Srimanth Dhondy commited on
Upload got_vision_b.py 80a1309 verified
Srimanth Dhondy commited on
Upload 6 files 76df704 verified
Srimanth Dhondy commited on
initial commit d8151b5 verified
Srimanth Dhondy commited on