Image-Text-to-Text
Transformers
Safetensors
deconav
embodied-navigation
vision-language-navigation
multi-robot
Instructions to use Sunyao/deconav with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Sunyao/deconav with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="Sunyao/deconav")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Sunyao/deconav", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Sunyao/deconav with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Sunyao/deconav" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sunyao/deconav", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/Sunyao/deconav
- SGLang
How to use Sunyao/deconav with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Sunyao/deconav" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sunyao/deconav", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Sunyao/deconav" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Sunyao/deconav", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use Sunyao/deconav with Docker Model Runner:
docker model run hf.co/Sunyao/deconav
| { | |
| "basket": { | |
| "precision": 0.9379194630872483, | |
| "recall": 0.9030694668820679, | |
| "f1": 0.9201646090534981, | |
| "support": 619, | |
| "tp": 559, | |
| "fp": 37, | |
| "fn": 60, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "bathtub": { | |
| "precision": 0.956140350877193, | |
| "recall": 0.9732142857142857, | |
| "f1": 0.9646017699115044, | |
| "support": 112, | |
| "tp": 109, | |
| "fp": 5, | |
| "fn": 3, | |
| "threshold": 0.5 | |
| }, | |
| "bed": { | |
| "precision": 0.976878612716763, | |
| "recall": 0.9378468368479467, | |
| "f1": 0.956964892412231, | |
| "support": 901, | |
| "tp": 845, | |
| "fp": 20, | |
| "fn": 56, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "bench": { | |
| "precision": 0.8292682926829268, | |
| "recall": 0.576271186440678, | |
| "f1": 0.6799999999999999, | |
| "support": 59, | |
| "tp": 34, | |
| "fp": 7, | |
| "fn": 25, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "blanket": { | |
| "precision": 0.9020618556701031, | |
| "recall": 0.9615384615384616, | |
| "f1": 0.9308510638297872, | |
| "support": 182, | |
| "tp": 175, | |
| "fp": 19, | |
| "fn": 7, | |
| "threshold": 0.30000001192092896 | |
| }, | |
| "bookshelf": { | |
| "precision": 0.9774436090225563, | |
| "recall": 0.9848484848484849, | |
| "f1": 0.981132075471698, | |
| "support": 132, | |
| "tp": 130, | |
| "fp": 3, | |
| "fn": 2, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "bottle": { | |
| "precision": 0.968421052631579, | |
| "recall": 0.8598130841121495, | |
| "f1": 0.9108910891089109, | |
| "support": 107, | |
| "tp": 92, | |
| "fp": 3, | |
| "fn": 15, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "box": { | |
| "precision": 0.9248291571753986, | |
| "recall": 0.9042316258351893, | |
| "f1": 0.9144144144144143, | |
| "support": 449, | |
| "tp": 406, | |
| "fp": 33, | |
| "fn": 43, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "cabinet": { | |
| "precision": 0.9477058029689609, | |
| "recall": 0.9672865013774105, | |
| "f1": 0.9573960463531015, | |
| "support": 2904, | |
| "tp": 2809, | |
| "fp": 155, | |
| "fn": 95, | |
| "threshold": 0.30000001192092896 | |
| }, | |
| "carpet": { | |
| "precision": 0.9665948275862069, | |
| "recall": 0.975, | |
| "f1": 0.9707792207792206, | |
| "support": 920, | |
| "tp": 897, | |
| "fp": 31, | |
| "fn": 23, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "ceiling": { | |
| "precision": 0.9791157102539981, | |
| "recall": 0.9758109881867617, | |
| "f1": 0.9774605559729527, | |
| "support": 5333, | |
| "tp": 5204, | |
| "fp": 111, | |
| "fn": 129, | |
| "threshold": 0.10000000149011612 | |
| }, | |
| "chair": { | |
| "precision": 0.9665271966527197, | |
| "recall": 0.964509394572025, | |
| "f1": 0.9655172413793104, | |
| "support": 1916, | |
| "tp": 1848, | |
| "fp": 64, | |
| "fn": 68, | |
| "threshold": 0.5 | |
| }, | |
| "clock": { | |
| "precision": 0.9014084507042254, | |
| "recall": 0.9056603773584906, | |
| "f1": 0.9035294117647059, | |
| "support": 212, | |
| "tp": 192, | |
| "fp": 21, | |
| "fn": 20, | |
| "threshold": 0.5 | |
| }, | |
| "couch": { | |
| "precision": 0.9616766467065868, | |
| "recall": 0.9514218009478673, | |
| "f1": 0.9565217391304348, | |
| "support": 844, | |
| "tp": 803, | |
| "fp": 32, | |
| "fn": 41, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "counter": { | |
| "precision": 0.9554367201426025, | |
| "recall": 0.9657657657657658, | |
| "f1": 0.960573476702509, | |
| "support": 555, | |
| "tp": 536, | |
| "fp": 25, | |
| "fn": 19, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "curtain": { | |
| "precision": 0.9673003802281369, | |
| "recall": 0.9250909090909091, | |
| "f1": 0.945724907063197, | |
| "support": 1375, | |
| "tp": 1272, | |
| "fp": 43, | |
| "fn": 103, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "desk": { | |
| "precision": 0.9151670951156813, | |
| "recall": 0.9081632653061225, | |
| "f1": 0.9116517285531369, | |
| "support": 392, | |
| "tp": 356, | |
| "fp": 33, | |
| "fn": 36, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "dishwasher": { | |
| "precision": 0.9910714285714286, | |
| "recall": 0.7928571428571428, | |
| "f1": 0.8809523809523809, | |
| "support": 140, | |
| "tp": 111, | |
| "fp": 1, | |
| "fn": 29, | |
| "threshold": 0.800000011920929 | |
| }, | |
| "door": { | |
| "precision": 0.9662514156285391, | |
| "recall": 0.9349112426035503, | |
| "f1": 0.9503230118066384, | |
| "support": 4563, | |
| "tp": 4266, | |
| "fp": 149, | |
| "fn": 297, | |
| "threshold": 0.20000000298023224 | |
| }, | |
| "drawer": { | |
| "precision": 0.9660194174757282, | |
| "recall": 0.8984198645598194, | |
| "f1": 0.9309941520467837, | |
| "support": 443, | |
| "tp": 398, | |
| "fp": 14, | |
| "fn": 45, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "dresser": { | |
| "precision": 0.9706744868035191, | |
| "recall": 0.9566473988439307, | |
| "f1": 0.9636098981077148, | |
| "support": 346, | |
| "tp": 331, | |
| "fp": 10, | |
| "fn": 15, | |
| "threshold": 0.5 | |
| }, | |
| "fireplace": { | |
| "precision": 0.968299711815562, | |
| "recall": 0.9105691056910569, | |
| "f1": 0.9385474860335196, | |
| "support": 369, | |
| "tp": 336, | |
| "fp": 11, | |
| "fn": 33, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "floor": { | |
| "precision": 0.986312239634993, | |
| "recall": 0.9328330206378986, | |
| "f1": 0.9588274997589432, | |
| "support": 5330, | |
| "tp": 4972, | |
| "fp": 69, | |
| "fn": 358, | |
| "threshold": 0.10000000149011612 | |
| }, | |
| "fridge": { | |
| "precision": 0.9705882352941176, | |
| "recall": 0.9705882352941176, | |
| "f1": 0.9705882352941176, | |
| "support": 136, | |
| "tp": 132, | |
| "fp": 4, | |
| "fn": 4, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "kitchen": { | |
| "precision": 0.9015544041450777, | |
| "recall": 0.8446601941747572, | |
| "f1": 0.8721804511278196, | |
| "support": 206, | |
| "tp": 174, | |
| "fp": 19, | |
| "fn": 32, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "lamp": { | |
| "precision": 0.952288218111003, | |
| "recall": 0.9274537695590327, | |
| "f1": 0.9397069421090559, | |
| "support": 2109, | |
| "tp": 1956, | |
| "fp": 98, | |
| "fn": 153, | |
| "threshold": 0.5 | |
| }, | |
| "light": { | |
| "precision": 0.94, | |
| "recall": 0.912621359223301, | |
| "f1": 0.9261083743842364, | |
| "support": 103, | |
| "tp": 94, | |
| "fp": 6, | |
| "fn": 9, | |
| "threshold": 0.800000011920929 | |
| }, | |
| "microwave": { | |
| "precision": 0.9562841530054644, | |
| "recall": 0.9114583333333334, | |
| "f1": 0.9333333333333332, | |
| "support": 192, | |
| "tp": 175, | |
| "fp": 8, | |
| "fn": 17, | |
| "threshold": 0.800000011920929 | |
| }, | |
| "mirror": { | |
| "precision": 0.975, | |
| "recall": 0.9171779141104295, | |
| "f1": 0.9452054794520549, | |
| "support": 978, | |
| "tp": 897, | |
| "fp": 23, | |
| "fn": 81, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "nightstand": { | |
| "precision": 0.9310344827586207, | |
| "recall": 0.9642857142857143, | |
| "f1": 0.9473684210526316, | |
| "support": 84, | |
| "tp": 81, | |
| "fp": 6, | |
| "fn": 3, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "oven": { | |
| "precision": 0.9714285714285714, | |
| "recall": 0.9407114624505929, | |
| "f1": 0.9558232931726908, | |
| "support": 253, | |
| "tp": 238, | |
| "fp": 7, | |
| "fn": 15, | |
| "threshold": 0.800000011920929 | |
| }, | |
| "painting": { | |
| "precision": 0.9608127721335269, | |
| "recall": 0.9323943661971831, | |
| "f1": 0.9463902787705505, | |
| "support": 710, | |
| "tp": 662, | |
| "fp": 27, | |
| "fn": 48, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "picture": { | |
| "precision": 0.9712707182320443, | |
| "recall": 0.9559543230016313, | |
| "f1": 0.96355165798849, | |
| "support": 1839, | |
| "tp": 1758, | |
| "fp": 52, | |
| "fn": 81, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "pillow": { | |
| "precision": 0.9493365500603136, | |
| "recall": 0.94026284348865, | |
| "f1": 0.9447779111644657, | |
| "support": 837, | |
| "tp": 787, | |
| "fp": 42, | |
| "fn": 50, | |
| "threshold": 0.5 | |
| }, | |
| "plant": { | |
| "precision": 0.9523809523809523, | |
| "recall": 0.9171974522292994, | |
| "f1": 0.9344581440622972, | |
| "support": 785, | |
| "tp": 720, | |
| "fp": 36, | |
| "fn": 65, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "refrigerator": { | |
| "precision": 0.9607843137254902, | |
| "recall": 0.9158878504672897, | |
| "f1": 0.9377990430622011, | |
| "support": 214, | |
| "tp": 196, | |
| "fp": 8, | |
| "fn": 18, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "rug": { | |
| "precision": 0.97375, | |
| "recall": 0.937424789410349, | |
| "f1": 0.955242182709994, | |
| "support": 831, | |
| "tp": 779, | |
| "fp": 21, | |
| "fn": 52, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "shelf": { | |
| "precision": 0.961335676625659, | |
| "recall": 0.9208754208754208, | |
| "f1": 0.9406706792777298, | |
| "support": 594, | |
| "tp": 547, | |
| "fp": 22, | |
| "fn": 47, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "shower": { | |
| "precision": 0.9617834394904459, | |
| "recall": 0.9207317073170732, | |
| "f1": 0.940809968847352, | |
| "support": 164, | |
| "tp": 151, | |
| "fp": 6, | |
| "fn": 13, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "sink": { | |
| "precision": 0.9461883408071748, | |
| "recall": 0.9336283185840708, | |
| "f1": 0.9398663697104678, | |
| "support": 226, | |
| "tp": 211, | |
| "fp": 12, | |
| "fn": 15, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "soap": { | |
| "precision": 1.0, | |
| "recall": 0.7142857142857143, | |
| "f1": 0.8333333333333333, | |
| "support": 7, | |
| "tp": 5, | |
| "fp": 0, | |
| "fn": 2, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "sofa": { | |
| "precision": 0.9282051282051282, | |
| "recall": 0.863961813842482, | |
| "f1": 0.8949320148331273, | |
| "support": 419, | |
| "tp": 362, | |
| "fp": 28, | |
| "fn": 57, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "stairs": { | |
| "precision": 0.9810996563573883, | |
| "recall": 0.9548494983277592, | |
| "f1": 0.9677966101694915, | |
| "support": 598, | |
| "tp": 571, | |
| "fp": 11, | |
| "fn": 27, | |
| "threshold": 0.6000000238418579 | |
| }, | |
| "stool": { | |
| "precision": 0.9816176470588235, | |
| "recall": 0.9206896551724137, | |
| "f1": 0.9501779359430603, | |
| "support": 290, | |
| "tp": 267, | |
| "fp": 5, | |
| "fn": 23, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "stove": { | |
| "precision": 0.746031746031746, | |
| "recall": 0.734375, | |
| "f1": 0.7401574803149606, | |
| "support": 64, | |
| "tp": 47, | |
| "fp": 16, | |
| "fn": 17, | |
| "threshold": 0.30000001192092896 | |
| }, | |
| "table": { | |
| "precision": 0.957649550026469, | |
| "recall": 0.9637719765583378, | |
| "f1": 0.9607010090281465, | |
| "support": 1877, | |
| "tp": 1809, | |
| "fp": 80, | |
| "fn": 68, | |
| "threshold": 0.4000000059604645 | |
| }, | |
| "television": { | |
| "precision": 0.0, | |
| "recall": 0.0, | |
| "f1": 0.0, | |
| "support": 0, | |
| "tp": 0, | |
| "fp": 0, | |
| "fn": 0, | |
| "threshold": 0.5 | |
| }, | |
| "toilet": { | |
| "precision": 0.9874476987447699, | |
| "recall": 0.9554655870445344, | |
| "f1": 0.9711934156378601, | |
| "support": 247, | |
| "tp": 236, | |
| "fp": 3, | |
| "fn": 11, | |
| "threshold": 0.5 | |
| }, | |
| "towel": { | |
| "precision": 0.987220447284345, | |
| "recall": 0.9251497005988024, | |
| "f1": 0.9551777434312211, | |
| "support": 334, | |
| "tp": 309, | |
| "fp": 4, | |
| "fn": 25, | |
| "threshold": 0.800000011920929 | |
| }, | |
| "tv": { | |
| "precision": 0.9914965986394558, | |
| "recall": 0.9224683544303798, | |
| "f1": 0.9557377049180329, | |
| "support": 632, | |
| "tp": 583, | |
| "fp": 5, | |
| "fn": 49, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "vase": { | |
| "precision": 0.9596541786743515, | |
| "recall": 0.9073569482288828, | |
| "f1": 0.9327731092436975, | |
| "support": 367, | |
| "tp": 333, | |
| "fp": 14, | |
| "fn": 34, | |
| "threshold": 0.5 | |
| }, | |
| "wall": { | |
| "precision": 0.9985545651650205, | |
| "recall": 0.7453695378529042, | |
| "f1": 0.8535831960461284, | |
| "support": 5561, | |
| "tp": 4145, | |
| "fp": 6, | |
| "fn": 1416, | |
| "threshold": 0.10000000149011612 | |
| }, | |
| "wardrobe": { | |
| "precision": 0.9568965517241379, | |
| "recall": 0.8951612903225806, | |
| "f1": 0.925, | |
| "support": 248, | |
| "tp": 222, | |
| "fp": 10, | |
| "fn": 26, | |
| "threshold": 0.699999988079071 | |
| }, | |
| "window": { | |
| "precision": 0.9645654606490116, | |
| "recall": 0.9489908256880734, | |
| "f1": 0.9567147613762487, | |
| "support": 2725, | |
| "tp": 2586, | |
| "fp": 95, | |
| "fn": 139, | |
| "threshold": 0.30000001192092896 | |
| } | |
| } |