Image Feature Extraction
Transformers
Safetensors
motif_vision
feature-extraction
motif
vision-transformer
self-supervised
video
custom_code
Instructions to use Motif-Technologies/Motif-Vision-Encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Motif-Technologies/Motif-Vision-Encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
docs: add training-data scale (~0.47B samples, 96% image / 4% video) + data-efficiency vs DINOv3 LVD-1689M
Browse files
README.md
CHANGED
|
@@ -79,6 +79,7 @@ with torch.inference_mode():
|
|
| 79 |
| Video tokenizer | 3D Conv, tubelet size 2 |
|
| 80 |
| Precision | bf16 weights |
|
| 81 |
| Training | DINO + iBOT + KoLeo self-distillation, Gram anchoring, contrastive caption alignment |
|
|
|
|
| 82 |
|
| 83 |
Outputs (`BaseModelOutputWithPooling`): `last_hidden_state` `(B, 1+4+N, 4096)`,
|
| 84 |
`pooler_output` `(B, 4096)`.
|
|
@@ -101,8 +102,12 @@ better for every column **except KITTI depth MSE** (lower is better). Best value
|
|
| 101 |
reflecting the encoder's dense, temporally-coherent patch features on video.
|
| 102 |
- **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
|
| 103 |
second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 104 |
- K400 action recognition and KITTI depth estimation are still being evaluated and will be added
|
| 105 |
-
as the runs complete.
|
| 106 |
|
| 107 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 108 |
video. Comparison numbers are the best figures reported by each model's authors.
|
|
|
|
| 79 |
| Video tokenizer | 3D Conv, tubelet size 2 |
|
| 80 |
| Precision | bf16 weights |
|
| 81 |
| Training | DINO + iBOT + KoLeo self-distillation, Gram anchoring, contrastive caption alignment |
|
| 82 |
+
| Training data | ~0.47B samples — 448.6M images (96%) + 18.5M video clips (4%) |
|
| 83 |
|
| 84 |
Outputs (`BaseModelOutputWithPooling`): `last_hidden_state` `(B, 1+4+N, 4096)`,
|
| 85 |
`pooler_output` `(B, 4096)`.
|
|
|
|
| 102 |
reflecting the encoder's dense, temporally-coherent patch features on video.
|
| 103 |
- **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
|
| 104 |
second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
|
| 105 |
+
- **Data efficiency** — these results come from **~0.47B training samples** (448.6M images +
|
| 106 |
+
18.5M video clips), roughly **3.6× less data than DINOv3**, which is trained on LVD-1689M
|
| 107 |
+
(1,689M images). Despite the smaller corpus — and with only ~4% of samples being video — the
|
| 108 |
+
encoder stays competitive across both image and video benchmarks, and leads on DAVIS.
|
| 109 |
- K400 action recognition and KITTI depth estimation are still being evaluated and will be added
|
| 110 |
+
as the runs complete. Numbers in this table will be updated as evaluations finish.
|
| 111 |
|
| 112 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 113 |
video. Comparison numbers are the best figures reported by each model's authors.
|