Image-Text-to-Text
Transformers
Safetensors
gemma3
llama-factory
full
Generated from Trainer
conversational
text-generation-inference
Instructions to use AsherYang/physics_pmf_4bg_joint_api-step111 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AsherYang/physics_pmf_4bg_joint_api-step111 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="AsherYang/physics_pmf_4bg_joint_api-step111") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("AsherYang/physics_pmf_4bg_joint_api-step111") model = AutoModelForImageTextToText.from_pretrained("AsherYang/physics_pmf_4bg_joint_api-step111") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use AsherYang/physics_pmf_4bg_joint_api-step111 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "AsherYang/physics_pmf_4bg_joint_api-step111" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AsherYang/physics_pmf_4bg_joint_api-step111", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/AsherYang/physics_pmf_4bg_joint_api-step111
- SGLang
How to use AsherYang/physics_pmf_4bg_joint_api-step111 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "AsherYang/physics_pmf_4bg_joint_api-step111" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AsherYang/physics_pmf_4bg_joint_api-step111", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "AsherYang/physics_pmf_4bg_joint_api-step111" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "AsherYang/physics_pmf_4bg_joint_api-step111", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use AsherYang/physics_pmf_4bg_joint_api-step111 with Docker Model Runner:
docker model run hf.co/AsherYang/physics_pmf_4bg_joint_api-step111
| {"current_steps": 1, "total_steps": 60, "loss": 1.40986967086792, "lr": 0.0, "epoch": 0.07079646017699115, "percentage": 1.67, "elapsed_time": "0:00:12", "remaining_time": "0:12:15"} | |
| {"current_steps": 2, "total_steps": 60, "loss": 1.4964791536331177, "lr": 1.6666666666666667e-06, "epoch": 0.1415929203539823, "percentage": 3.33, "elapsed_time": "0:00:19", "remaining_time": "0:09:32"} | |
| {"current_steps": 3, "total_steps": 60, "loss": 1.3421201705932617, "lr": 3.3333333333333333e-06, "epoch": 0.21238938053097345, "percentage": 5.0, "elapsed_time": "0:00:28", "remaining_time": "0:08:52"} | |
| {"current_steps": 4, "total_steps": 60, "loss": 1.118983507156372, "lr": 5e-06, "epoch": 0.2831858407079646, "percentage": 6.67, "elapsed_time": "0:00:35", "remaining_time": "0:08:20"} | |
| {"current_steps": 5, "total_steps": 60, "loss": 0.9437508583068848, "lr": 6.666666666666667e-06, "epoch": 0.35398230088495575, "percentage": 8.33, "elapsed_time": "0:00:43", "remaining_time": "0:07:56"} | |
| {"current_steps": 6, "total_steps": 60, "loss": 0.9040769338607788, "lr": 8.333333333333334e-06, "epoch": 0.4247787610619469, "percentage": 10.0, "elapsed_time": "0:00:50", "remaining_time": "0:07:38"} | |
| {"current_steps": 7, "total_steps": 60, "loss": 0.8478146195411682, "lr": 1e-05, "epoch": 0.49557522123893805, "percentage": 11.67, "elapsed_time": "0:00:58", "remaining_time": "0:07:22"} | |
| {"current_steps": 8, "total_steps": 60, "loss": 0.760687530040741, "lr": 9.991540791356342e-06, "epoch": 0.5663716814159292, "percentage": 13.33, "elapsed_time": "0:01:05", "remaining_time": "0:07:05"} | |
| {"current_steps": 9, "total_steps": 60, "loss": 0.8113027811050415, "lr": 9.966191788709716e-06, "epoch": 0.6371681415929203, "percentage": 15.0, "elapsed_time": "0:01:13", "remaining_time": "0:06:55"} | |
| {"current_steps": 10, "total_steps": 60, "loss": 0.7258458137512207, "lr": 9.924038765061042e-06, "epoch": 0.7079646017699115, "percentage": 16.67, "elapsed_time": "0:01:22", "remaining_time": "0:06:50"} | |
| {"current_steps": 11, "total_steps": 60, "loss": 0.7298057079315186, "lr": 9.86522435289912e-06, "epoch": 0.7787610619469026, "percentage": 18.33, "elapsed_time": "0:01:31", "remaining_time": "0:06:45"} | |
| {"current_steps": 12, "total_steps": 60, "loss": 0.7588151693344116, "lr": 9.789947561577445e-06, "epoch": 0.8495575221238938, "percentage": 20.0, "elapsed_time": "0:01:38", "remaining_time": "0:06:35"} | |
| {"current_steps": 13, "total_steps": 60, "loss": 0.7416592836380005, "lr": 9.698463103929542e-06, "epoch": 0.9203539823008849, "percentage": 21.67, "elapsed_time": "0:01:46", "remaining_time": "0:06:24"} | |
| {"current_steps": 14, "total_steps": 60, "loss": 0.7269161939620972, "lr": 9.591080534401371e-06, "epoch": 0.9911504424778761, "percentage": 23.33, "elapsed_time": "0:01:52", "remaining_time": "0:06:11"} | |
| {"current_steps": 15, "total_steps": 60, "loss": 0.6428764462471008, "lr": 9.468163201617063e-06, "epoch": 1.0, "percentage": 25.0, "elapsed_time": "0:01:53", "remaining_time": "0:05:41"} | |
| {"current_steps": 16, "total_steps": 60, "loss": 0.6173319816589355, "lr": 9.330127018922195e-06, "epoch": 1.0707964601769913, "percentage": 26.67, "elapsed_time": "0:02:02", "remaining_time": "0:05:36"} | |
| {"current_steps": 17, "total_steps": 60, "loss": 0.6359413266181946, "lr": 9.177439057064684e-06, "epoch": 1.1415929203539823, "percentage": 28.33, "elapsed_time": "0:02:09", "remaining_time": "0:05:27"} | |
| {"current_steps": 18, "total_steps": 60, "loss": 0.6308578252792358, "lr": 9.01061596377522e-06, "epoch": 1.2123893805309733, "percentage": 30.0, "elapsed_time": "0:02:17", "remaining_time": "0:05:20"} | |
| {"current_steps": 19, "total_steps": 60, "loss": 0.5893546342849731, "lr": 8.83022221559489e-06, "epoch": 1.2831858407079646, "percentage": 31.67, "elapsed_time": "0:02:24", "remaining_time": "0:05:12"} | |
| {"current_steps": 20, "total_steps": 60, "loss": 0.6160678267478943, "lr": 8.636868207865244e-06, "epoch": 1.3539823008849559, "percentage": 33.33, "elapsed_time": "0:02:32", "remaining_time": "0:05:04"} | |
| {"current_steps": 21, "total_steps": 60, "loss": 0.6084617972373962, "lr": 8.43120818934367e-06, "epoch": 1.424778761061947, "percentage": 35.0, "elapsed_time": "0:02:38", "remaining_time": "0:04:55"} | |
| {"current_steps": 22, "total_steps": 60, "loss": 0.5884666442871094, "lr": 8.213938048432697e-06, "epoch": 1.495575221238938, "percentage": 36.67, "elapsed_time": "0:02:49", "remaining_time": "0:04:52"} | |
| {"current_steps": 23, "total_steps": 60, "loss": 0.5703476667404175, "lr": 7.985792958513932e-06, "epoch": 1.5663716814159292, "percentage": 38.33, "elapsed_time": "0:02:55", "remaining_time": "0:04:42"} | |
| {"current_steps": 24, "total_steps": 60, "loss": 0.572840690612793, "lr": 7.747544890354031e-06, "epoch": 1.6371681415929205, "percentage": 40.0, "elapsed_time": "0:03:04", "remaining_time": "0:04:36"} | |
| {"current_steps": 25, "total_steps": 60, "loss": 0.550726056098938, "lr": 7.500000000000001e-06, "epoch": 1.7079646017699115, "percentage": 41.67, "elapsed_time": "0:03:10", "remaining_time": "0:04:27"} | |
| {"current_steps": 26, "total_steps": 60, "loss": 0.5565768480300903, "lr": 7.243995901002312e-06, "epoch": 1.7787610619469025, "percentage": 43.33, "elapsed_time": "0:03:18", "remaining_time": "0:04:19"} | |
| {"current_steps": 27, "total_steps": 60, "loss": 0.5552008152008057, "lr": 6.980398830195785e-06, "epoch": 1.8495575221238938, "percentage": 45.0, "elapsed_time": "0:03:26", "remaining_time": "0:04:12"} | |
| {"current_steps": 28, "total_steps": 60, "loss": 0.6178507804870605, "lr": 6.710100716628345e-06, "epoch": 1.920353982300885, "percentage": 46.67, "elapsed_time": "0:03:33", "remaining_time": "0:04:04"} | |
| {"current_steps": 29, "total_steps": 60, "loss": 0.5532016754150391, "lr": 6.434016163555452e-06, "epoch": 1.991150442477876, "percentage": 48.33, "elapsed_time": "0:03:42", "remaining_time": "0:03:57"} | |
| {"current_steps": 30, "total_steps": 60, "loss": 0.4448966383934021, "lr": 6.153079353712201e-06, "epoch": 2.0, "percentage": 50.0, "elapsed_time": "0:03:42", "remaining_time": "0:03:42"} | |
| {"current_steps": 31, "total_steps": 60, "loss": 0.4768362045288086, "lr": 5.8682408883346535e-06, "epoch": 2.0707964601769913, "percentage": 51.67, "elapsed_time": "0:03:49", "remaining_time": "0:03:34"} | |
| {"current_steps": 32, "total_steps": 60, "loss": 0.4592363238334656, "lr": 5.5804645706261515e-06, "epoch": 2.1415929203539825, "percentage": 53.33, "elapsed_time": "0:03:58", "remaining_time": "0:03:28"} | |
| {"current_steps": 33, "total_steps": 60, "loss": 0.47542697191238403, "lr": 5.290724144552379e-06, "epoch": 2.2123893805309733, "percentage": 55.0, "elapsed_time": "0:04:06", "remaining_time": "0:03:21"} | |
| {"current_steps": 34, "total_steps": 60, "loss": 0.4710686206817627, "lr": 5e-06, "epoch": 2.2831858407079646, "percentage": 56.67, "elapsed_time": "0:04:14", "remaining_time": "0:03:14"} | |
| {"current_steps": 35, "total_steps": 60, "loss": 0.46914583444595337, "lr": 4.7092758554476215e-06, "epoch": 2.353982300884956, "percentage": 58.33, "elapsed_time": "0:04:24", "remaining_time": "0:03:08"} | |
| {"current_steps": 36, "total_steps": 60, "loss": 0.4385316073894501, "lr": 4.4195354293738484e-06, "epoch": 2.4247787610619467, "percentage": 60.0, "elapsed_time": "0:04:33", "remaining_time": "0:03:02"} | |
| {"current_steps": 37, "total_steps": 60, "loss": 0.4495742917060852, "lr": 4.131759111665349e-06, "epoch": 2.495575221238938, "percentage": 61.67, "elapsed_time": "0:04:41", "remaining_time": "0:02:54"} | |
| {"current_steps": 38, "total_steps": 60, "loss": 0.46654635667800903, "lr": 3.8469206462878e-06, "epoch": 2.566371681415929, "percentage": 63.33, "elapsed_time": "0:04:48", "remaining_time": "0:02:47"} | |
| {"current_steps": 39, "total_steps": 60, "loss": 0.42036041617393494, "lr": 3.5659838364445505e-06, "epoch": 2.6371681415929205, "percentage": 65.0, "elapsed_time": "0:04:56", "remaining_time": "0:02:39"} | |
| {"current_steps": 40, "total_steps": 60, "loss": 0.4493784010410309, "lr": 3.289899283371657e-06, "epoch": 2.7079646017699117, "percentage": 66.67, "elapsed_time": "0:05:04", "remaining_time": "0:02:32"} | |
| {"current_steps": 41, "total_steps": 60, "loss": 0.44434070587158203, "lr": 3.019601169804216e-06, "epoch": 2.7787610619469025, "percentage": 68.33, "elapsed_time": "0:05:12", "remaining_time": "0:02:24"} | |
| {"current_steps": 42, "total_steps": 60, "loss": 0.42155495285987854, "lr": 2.7560040989976894e-06, "epoch": 2.849557522123894, "percentage": 70.0, "elapsed_time": "0:05:19", "remaining_time": "0:02:16"} | |
| {"current_steps": 43, "total_steps": 60, "loss": 0.40417200326919556, "lr": 2.5000000000000015e-06, "epoch": 2.920353982300885, "percentage": 71.67, "elapsed_time": "0:05:25", "remaining_time": "0:02:08"} | |
| {"current_steps": 44, "total_steps": 60, "loss": 0.40475600957870483, "lr": 2.2524551096459703e-06, "epoch": 2.991150442477876, "percentage": 73.33, "elapsed_time": "0:05:32", "remaining_time": "0:02:00"} | |
| {"current_steps": 45, "total_steps": 60, "loss": 0.3524181544780731, "lr": 2.0142070414860704e-06, "epoch": 3.0, "percentage": 75.0, "elapsed_time": "0:05:32", "remaining_time": "0:01:50"} | |
| {"current_steps": 46, "total_steps": 60, "loss": 0.3934929370880127, "lr": 1.7860619515673034e-06, "epoch": 3.0707964601769913, "percentage": 76.67, "elapsed_time": "0:05:40", "remaining_time": "0:01:43"} | |
| {"current_steps": 47, "total_steps": 60, "loss": 0.35962843894958496, "lr": 1.5687918106563326e-06, "epoch": 3.1415929203539825, "percentage": 78.33, "elapsed_time": "0:05:48", "remaining_time": "0:01:36"} | |
| {"current_steps": 48, "total_steps": 60, "loss": 0.3938334584236145, "lr": 1.3631317921347564e-06, "epoch": 3.2123893805309733, "percentage": 80.0, "elapsed_time": "0:05:56", "remaining_time": "0:01:29"} | |
| {"current_steps": 49, "total_steps": 60, "loss": 0.3707515597343445, "lr": 1.1697777844051105e-06, "epoch": 3.2831858407079646, "percentage": 81.67, "elapsed_time": "0:06:03", "remaining_time": "0:01:21"} | |
| {"current_steps": 50, "total_steps": 60, "loss": 0.38788312673568726, "lr": 9.893840362247809e-07, "epoch": 3.353982300884956, "percentage": 83.33, "elapsed_time": "0:06:14", "remaining_time": "0:01:14"} | |
| {"current_steps": 51, "total_steps": 60, "loss": 0.36757567524909973, "lr": 8.225609429353187e-07, "epoch": 3.4247787610619467, "percentage": 85.0, "elapsed_time": "0:06:21", "remaining_time": "0:01:07"} | |
| {"current_steps": 52, "total_steps": 60, "loss": 0.375740110874176, "lr": 6.698729810778065e-07, "epoch": 3.495575221238938, "percentage": 86.67, "elapsed_time": "0:06:30", "remaining_time": "0:01:00"} | |
| {"current_steps": 53, "total_steps": 60, "loss": 0.34685075283050537, "lr": 5.318367983829393e-07, "epoch": 3.566371681415929, "percentage": 88.33, "elapsed_time": "0:06:37", "remaining_time": "0:00:52"} | |
| {"current_steps": 54, "total_steps": 60, "loss": 0.3674459457397461, "lr": 4.089194655986306e-07, "epoch": 3.6371681415929205, "percentage": 90.0, "elapsed_time": "0:06:43", "remaining_time": "0:00:44"} | |
| {"current_steps": 55, "total_steps": 60, "loss": 0.37284308671951294, "lr": 3.015368960704584e-07, "epoch": 3.7079646017699117, "percentage": 91.67, "elapsed_time": "0:06:50", "remaining_time": "0:00:37"} | |
| {"current_steps": 56, "total_steps": 60, "loss": 0.3796018958091736, "lr": 2.1005243842255552e-07, "epoch": 3.7787610619469025, "percentage": 93.33, "elapsed_time": "0:06:59", "remaining_time": "0:00:29"} | |
| {"current_steps": 57, "total_steps": 60, "loss": 0.36435168981552124, "lr": 1.3477564710088097e-07, "epoch": 3.849557522123894, "percentage": 95.0, "elapsed_time": "0:07:06", "remaining_time": "0:00:22"} | |
| {"current_steps": 58, "total_steps": 60, "loss": 0.361666202545166, "lr": 7.59612349389599e-08, "epoch": 3.920353982300885, "percentage": 96.67, "elapsed_time": "0:07:13", "remaining_time": "0:00:14"} | |
| {"current_steps": 59, "total_steps": 60, "loss": 0.37428635358810425, "lr": 3.3808211290284886e-08, "epoch": 3.991150442477876, "percentage": 98.33, "elapsed_time": "0:07:20", "remaining_time": "0:00:07"} | |
| {"current_steps": 60, "total_steps": 60, "loss": 0.35041147470474243, "lr": 8.459208643659122e-09, "epoch": 4.0, "percentage": 100.0, "elapsed_time": "0:07:21", "remaining_time": "0:00:00"} | |
| {"current_steps": 60, "total_steps": 60, "epoch": 4.0, "percentage": 100.0, "elapsed_time": "0:08:13", "remaining_time": "0:00:00"} | |