caca9527 commited on
Commit
2410073
·
verified ·
1 Parent(s): e2d9862
Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -1,3 +1,10 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+ # DeskVision: Large Scale Desktop Region Captioning for Advanced GUI Agents
5
+
6
+ [\[💻Code\]](https://sh-code.mthreads.com/liang.yang/mt-gui)[\[📝Paper\]](https://arxiv.org/abs/2503.11170) [\[🤗Models\]](https://huggingface.co/caca9527/GUIExplorer)[\[🤗Data\]]()
7
+
8
+ ![GUIExplorer](https://sh-code.mthreads.com/liang.yang/mt-gui/-/raw/master/assets/overview.png?ref_type=heads){:height="60%" width="60%"}
9
+
10
+ 🔥🔥🔥 We have open-sourced our self-developed GUI multimodal visual understanding model GUIExplorer, which is based on the model architecture of LLaVA OneVision 7B. It has basic GUI visual understanding capabilities, including regional OCR, Grounding, and single-step command execution capabilities. For details on how to train and use this model, please refer to the [\[💻Code\]](https://sh-code.mthreads.com/liang.yang/mt-gui).