Robotics
Transformers
Safetensors
llava_llama
Zhoues commited on
Commit
a1417f3
·
verified ·
1 Parent(s): b0c5ef1

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +3 -50
README.md CHANGED
@@ -1,50 +1,3 @@
1
- ---
2
- license: apache-2.0
3
- library_name: transformers
4
- pipeline_tag: robotics
5
- base_model:
6
- - Efficient-Large-Model/NVILA-Lite-2B
7
- ---
8
-
9
- # 🌏 RoboRefer
10
-
11
- [![Project Homepage](https://img.shields.io/badge/%F0%9F%8F%A0%20Project-Homepage-blue)](https://zhoues.github.io/RoboRefer/)
12
- [![arXiv](https://img.shields.io/badge/arXiv%20paper-2506.04308-b31b1b.svg)](https://arxiv.org/abs/2506.04308)
13
- [![GitHub](https://img.shields.io/badge/RoboRefer-black?logo=github)](https://github.com/Zhoues/RoboRefer)
14
- > This is the official checkpoint of our work: **RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics**
15
-
16
-
17
-
18
-
19
- ## Overview
20
- RoboRefer-2B-SFT is an open-source vision-language model that is instruction-tuned on a mixture of RefSpatial datasets, instruction tuning, and referring datasets.
21
-
22
-
23
- ## How to use
24
-
25
- RoboRefer-2B-SFT has strong spatial understanding capability and achieves SOTA performance across diverse benchmarks. Given an image with instructions, it can not only answer your questions in both qualitative and quantitative ways using its spatial knowledge, but also output precise points for spatial referring to guide robotic control. For more details, please visit our [official repo](https://github.com/Zhoues/RoboRefer).
26
-
27
-
28
- ## Resources for More Information
29
- - Paper: https://arxiv.org/abs/2506.04308
30
- - Code: https://github.com/Zhoues/RoboRefer
31
- - Website: https://zhoues.github.io/RoboRefer/
32
-
33
-
34
- ## Date
35
- This model was trained in June 2025.
36
-
37
-
38
-
39
- ## 📝 Citation
40
- If you find our code or models useful in your work, please cite [our paper](https://arxiv.org/pdf/2505.06111):
41
-
42
-
43
- ```
44
- @article{zhou2025roborefer,
45
- title={RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics},
46
- author={Zhou, Enshen and An, Jingkun and Chi, Cheng and Han, Yi and Rong, Shanyu and Zhang, Chi and Wang, Pengwei and Wang, Zhongyuan and Huang, Tiejun and Sheng, Lu and others},
47
- journal={arXiv preprint arXiv:2506.04308},
48
- year={2025}
49
- }
50
- ```
 
1
+ ---
2
+ license: apache-2.0
3
+ ---