nielsr HF Staff commited on
Commit
1a5cc67
·
verified ·
1 Parent(s): 5e03706

Link model card to Arxiv paper and update usage snippet

Browse files

This PR updates the model card by:
- Linking it to the published paper on Hugging Face (https://huggingface.co/papers/2607.05247).
- Updating the quickstart code snippet to reflect the correct module import `lingbot_vision` and usage as documented in the GitHub repository.
- Correcting the BibTeX citation template to match the repository's updated citation format.

Files changed (1) hide show
  1. README.md +18 -9
README.md CHANGED
@@ -1,7 +1,11 @@
1
  ---
2
- license: apache-2.0
 
3
  language:
4
  - en
 
 
 
5
  tags:
6
  - computer-vision
7
  - self-supervised-learning
@@ -11,10 +15,6 @@ tags:
11
  - depth-estimation
12
  - semantic-segmentation
13
  - pytorch
14
- datasets:
15
- - custom
16
- library_name: pytorch
17
- pipeline_tag: image-feature-extraction
18
  ---
19
 
20
  # LingBot-Vision
@@ -46,7 +46,7 @@ Each checkpoint contains backbone weights only. Training-time heads, optimizer s
46
 
47
  - **Repository:** https://github.com/robbyant/lingbot-vision
48
  - **Project Page:** https://technology.robbyant.com/lingbot-vision
49
- - **Technical Report:** coming soon
50
 
51
  ### Related Models
52
 
@@ -90,7 +90,7 @@ Load a pretrained backbone:
90
  ```python
91
  import torch
92
 
93
- from lbot_vision_infer import load_pretrained_backbone
94
 
95
  device = "cuda" if torch.cuda.is_available() else "cpu"
96
  dtype = torch.bfloat16 if device == "cuda" else torch.float32
@@ -101,7 +101,15 @@ backbone, embed_dim = load_pretrained_backbone(
101
  dtype=dtype,
102
  )
103
 
104
- print(backbone.patch_size, embed_dim)
 
 
 
 
 
 
 
 
105
  ```
106
 
107
  The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also pass an explicit Hugging Face model repo or a local directory to `load_pretrained_backbone`.
@@ -129,6 +137,7 @@ The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also
129
  @article{lingbot-vision2026,
130
  title={Vision Pretraining for Dense Spatial Perception},
131
  author={Fu, Zelin and Tan, Bin and Sun, Changjiang and Liu, Shaohui and Zheng, Kecheng and Xu, Yinghao and Zhu, Xing and Shen, Yujun and Xue, Nan},
 
132
  year={2026}
133
  }
134
  ```
@@ -136,4 +145,4 @@ The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also
136
  ## Model Card Contact
137
 
138
  - **Issues:** https://github.com/robbyant/lingbot-vision/issues
139
- - **Email:** fuzelin.fzl@antgroup.com, xuenan.xue@antgroup.com
 
1
  ---
2
+ datasets:
3
+ - custom
4
  language:
5
  - en
6
+ library_name: pytorch
7
+ license: apache-2.0
8
+ pipeline_tag: image-feature-extraction
9
  tags:
10
  - computer-vision
11
  - self-supervised-learning
 
15
  - depth-estimation
16
  - semantic-segmentation
17
  - pytorch
 
 
 
 
18
  ---
19
 
20
  # LingBot-Vision
 
46
 
47
  - **Repository:** https://github.com/robbyant/lingbot-vision
48
  - **Project Page:** https://technology.robbyant.com/lingbot-vision
49
+ - **Paper:** [Vision Pretraining for Dense Spatial Perception](https://huggingface.co/papers/2607.05247)
50
 
51
  ### Related Models
52
 
 
90
  ```python
91
  import torch
92
 
93
+ from lingbot_vision import load_pretrained_backbone, extract_patch_tokens, load_image
94
 
95
  device = "cuda" if torch.cuda.is_available() else "cpu"
96
  dtype = torch.bfloat16 if device == "cuda" else torch.float32
 
101
  dtype=dtype,
102
  )
103
 
104
+ img_norm, _, _ = load_image(
105
+ "examples/example.png",
106
+ size=512,
107
+ patch_size=backbone.patch_size,
108
+ mode="square",
109
+ )
110
+ patch_tokens, patch_grid = extract_patch_tokens(backbone, img_norm, device, dtype)
111
+
112
+ print(patch_tokens.shape, patch_grid, embed_dim)
113
  ```
114
 
115
  The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also pass an explicit Hugging Face model repo or a local directory to `load_pretrained_backbone`.
 
137
  @article{lingbot-vision2026,
138
  title={Vision Pretraining for Dense Spatial Perception},
139
  author={Fu, Zelin and Tan, Bin and Sun, Changjiang and Liu, Shaohui and Zheng, Kecheng and Xu, Yinghao and Zhu, Xing and Shen, Yujun and Xue, Nan},
140
+ journal={arXiv preprint arXiv:2607.05247},
141
  year={2026}
142
  }
143
  ```
 
145
  ## Model Card Contact
146
 
147
  - **Issues:** https://github.com/robbyant/lingbot-vision/issues
148
+ - **Email:** fuzelin.fzl@antgroup.com, xuenan.xue@antgroup.com