Image-Text-to-Text
Transformers
Safetensors
English
gemma3
text-generation-inference
unsloth
conversational
Instructions to use solvrays/unsloth_finetuned_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use solvrays/unsloth_finetuned_model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="solvrays/unsloth_finetuned_model") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("solvrays/unsloth_finetuned_model") model = AutoModelForMultimodalLM.from_pretrained("solvrays/unsloth_finetuned_model", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use solvrays/unsloth_finetuned_model with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "solvrays/unsloth_finetuned_model" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "solvrays/unsloth_finetuned_model", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/solvrays/unsloth_finetuned_model
- SGLang
How to use solvrays/unsloth_finetuned_model with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "solvrays/unsloth_finetuned_model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "solvrays/unsloth_finetuned_model", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "solvrays/unsloth_finetuned_model" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "solvrays/unsloth_finetuned_model", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Unsloth Desktop
- Docker Model Runner
How to use solvrays/unsloth_finetuned_model with Docker Model Runner:
docker model run hf.co/solvrays/unsloth_finetuned_model
Commit History
-
(Trained with Unsloth)
Verified signature8c74554 -
(Trained with Unsloth)
Verified signatureb028ce5 -
(Trained with Unsloth)
Verified signature956ac91 -
(Trained with Unsloth)
Verified signature9349498 -
(Trained with Unsloth)
Verified signature3032f9f -
(Trained with Unsloth)
Verified signature49a0129 -
(Trained with Unsloth)
Verified signature85d7118 -
(Trained with Unsloth)
Verified signatureb3b601c -
(Trained with Unsloth)
Verified signaturef9fa773 -
(Trained with Unsloth)
Verified signature34cfea2
-
(Trained with Unsloth)
Verified signature94e02e8 -
(Trained with Unsloth)
Verified signature0c143ba -
(Trained with Unsloth)
Verified signature563074b -
(Trained with Unsloth)
Verified signature60d7c62 -
(Trained with Unsloth)
Verified signature874f895 -
(Trained with Unsloth)
Verified signature7b299c2 -
(Trained with Unsloth)
Verified signature2be4758 -
(Trained with Unsloth)
Verified signature99d1ce9 -
(Trained with Unsloth)
Verified signatured04675e -
(Trained with Unsloth)
Verified signature78af9e3 -
(Trained with Unsloth)
Verified signature0b556fe -
(Trained with Unsloth)
Verified signatured9c92bd -
(Trained with Unsloth)
Verified signature1445152 -
(Trained with Unsloth)
Verified signature010e45b -
(Trained with Unsloth)
Verified signature37d41c4 -
(Trained with Unsloth)
Verified signaturee786338
-
(Trained with Unsloth)
Verified signaturef4117f9 -
(Trained with Unsloth)
Verified signatureadf9551 -
(Trained with Unsloth)
Verified signature25c3404 -
(Trained with Unsloth)
Verified signature3dc83eb -
(Trained with Unsloth)
Verified signaturedbb225e -
(Trained with Unsloth)
Verified signaturede73167 -
(Trained with Unsloth)
Verified signatureefa7394 -
(Trained with Unsloth)
Verified signaturec9cede8 -
(Trained with Unsloth)
Verified signature36f458f -
(Trained with Unsloth)
Verified signature23d4d0a -
(Trained with Unsloth)
Verified signature6ef143a -
(Trained with Unsloth)
Verified signatureb25ac01 -
(Trained with Unsloth)
Verified signatured0fa964 -
(Trained with Unsloth)
Verified signature64c8ec4 -
(Trained with Unsloth)
Verified signaturecff2c2b -
(Trained with Unsloth)
Verified signature753bb2c -
(Trained with Unsloth)
Verified signaturecaf4a4f -
(Trained with Unsloth)
Verified signature0b03d61 -
(Trained with Unsloth)
Verified signatureb0ff3ba -
(Trained with Unsloth)
Verified signatured3f9896 -
(Trained with Unsloth)
Verified signature1a9cd83 -
(Trained with Unsloth)
Verified signaturea1a0ab3 -
(Trained with Unsloth)
Verified signature7745f4a -
(Trained with Unsloth)
Verified signature24d8648