Link model card to Arxiv paper and update usage snippet
Browse filesThis PR updates the model card by:
- Linking it to the published paper on Hugging Face (https://huggingface.co/papers/2607.05247).
- Updating the quickstart code snippet to reflect the correct module import `lingbot_vision` and usage as documented in the GitHub repository.
- Correcting the BibTeX citation template to match the repository's updated citation format.
README.md
CHANGED
|
@@ -1,7 +1,11 @@
|
|
| 1 |
---
|
| 2 |
-
|
|
|
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
|
|
|
|
|
|
| 5 |
tags:
|
| 6 |
- computer-vision
|
| 7 |
- self-supervised-learning
|
|
@@ -11,10 +15,6 @@ tags:
|
|
| 11 |
- depth-estimation
|
| 12 |
- semantic-segmentation
|
| 13 |
- pytorch
|
| 14 |
-
datasets:
|
| 15 |
-
- custom
|
| 16 |
-
library_name: pytorch
|
| 17 |
-
pipeline_tag: image-feature-extraction
|
| 18 |
---
|
| 19 |
|
| 20 |
# LingBot-Vision
|
|
@@ -46,7 +46,7 @@ Each checkpoint contains backbone weights only. Training-time heads, optimizer s
|
|
| 46 |
|
| 47 |
- **Repository:** https://github.com/robbyant/lingbot-vision
|
| 48 |
- **Project Page:** https://technology.robbyant.com/lingbot-vision
|
| 49 |
-
- **
|
| 50 |
|
| 51 |
### Related Models
|
| 52 |
|
|
@@ -90,7 +90,7 @@ Load a pretrained backbone:
|
|
| 90 |
```python
|
| 91 |
import torch
|
| 92 |
|
| 93 |
-
from
|
| 94 |
|
| 95 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 96 |
dtype = torch.bfloat16 if device == "cuda" else torch.float32
|
|
@@ -101,7 +101,15 @@ backbone, embed_dim = load_pretrained_backbone(
|
|
| 101 |
dtype=dtype,
|
| 102 |
)
|
| 103 |
|
| 104 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 105 |
```
|
| 106 |
|
| 107 |
The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also pass an explicit Hugging Face model repo or a local directory to `load_pretrained_backbone`.
|
|
@@ -129,6 +137,7 @@ The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also
|
|
| 129 |
@article{lingbot-vision2026,
|
| 130 |
title={Vision Pretraining for Dense Spatial Perception},
|
| 131 |
author={Fu, Zelin and Tan, Bin and Sun, Changjiang and Liu, Shaohui and Zheng, Kecheng and Xu, Yinghao and Zhu, Xing and Shen, Yujun and Xue, Nan},
|
|
|
|
| 132 |
year={2026}
|
| 133 |
}
|
| 134 |
```
|
|
@@ -136,4 +145,4 @@ The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also
|
|
| 136 |
## Model Card Contact
|
| 137 |
|
| 138 |
- **Issues:** https://github.com/robbyant/lingbot-vision/issues
|
| 139 |
-
- **Email:** fuzelin.fzl@antgroup.com, xuenan.xue@antgroup.com
|
|
|
|
| 1 |
---
|
| 2 |
+
datasets:
|
| 3 |
+
- custom
|
| 4 |
language:
|
| 5 |
- en
|
| 6 |
+
library_name: pytorch
|
| 7 |
+
license: apache-2.0
|
| 8 |
+
pipeline_tag: image-feature-extraction
|
| 9 |
tags:
|
| 10 |
- computer-vision
|
| 11 |
- self-supervised-learning
|
|
|
|
| 15 |
- depth-estimation
|
| 16 |
- semantic-segmentation
|
| 17 |
- pytorch
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
---
|
| 19 |
|
| 20 |
# LingBot-Vision
|
|
|
|
| 46 |
|
| 47 |
- **Repository:** https://github.com/robbyant/lingbot-vision
|
| 48 |
- **Project Page:** https://technology.robbyant.com/lingbot-vision
|
| 49 |
+
- **Paper:** [Vision Pretraining for Dense Spatial Perception](https://huggingface.co/papers/2607.05247)
|
| 50 |
|
| 51 |
### Related Models
|
| 52 |
|
|
|
|
| 90 |
```python
|
| 91 |
import torch
|
| 92 |
|
| 93 |
+
from lingbot_vision import load_pretrained_backbone, extract_patch_tokens, load_image
|
| 94 |
|
| 95 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
| 96 |
dtype = torch.bfloat16 if device == "cuda" else torch.float32
|
|
|
|
| 101 |
dtype=dtype,
|
| 102 |
)
|
| 103 |
|
| 104 |
+
img_norm, _, _ = load_image(
|
| 105 |
+
"examples/example.png",
|
| 106 |
+
size=512,
|
| 107 |
+
patch_size=backbone.patch_size,
|
| 108 |
+
mode="square",
|
| 109 |
+
)
|
| 110 |
+
patch_tokens, patch_grid = extract_patch_tokens(backbone, img_norm, device, dtype)
|
| 111 |
+
|
| 112 |
+
print(patch_tokens.shape, patch_grid, embed_dim)
|
| 113 |
```
|
| 114 |
|
| 115 |
The `variant` argument can be `giant`, `large`, `base`, or `small`. You can also pass an explicit Hugging Face model repo or a local directory to `load_pretrained_backbone`.
|
|
|
|
| 137 |
@article{lingbot-vision2026,
|
| 138 |
title={Vision Pretraining for Dense Spatial Perception},
|
| 139 |
author={Fu, Zelin and Tan, Bin and Sun, Changjiang and Liu, Shaohui and Zheng, Kecheng and Xu, Yinghao and Zhu, Xing and Shen, Yujun and Xue, Nan},
|
| 140 |
+
journal={arXiv preprint arXiv:2607.05247},
|
| 141 |
year={2026}
|
| 142 |
}
|
| 143 |
```
|
|
|
|
| 145 |
## Model Card Contact
|
| 146 |
|
| 147 |
- **Issues:** https://github.com/robbyant/lingbot-vision/issues
|
| 148 |
+
- **Email:** fuzelin.fzl@antgroup.com, xuenan.xue@antgroup.com
|