Image Feature Extraction
Transformers
Safetensors
motif_vision
feature-extraction
motif
vision-transformer
self-supervised
video
custom_code
Instructions to use Motif-Technologies/Motif-Vision-Encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Motif-Technologies/Motif-Vision-Encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
docs(README): condense results prose to DAVIS-SOTA + competitive summary
Browse filesReplace the detailed per-benchmark bullet list with a concise summary: SOTA on DAVIS, competitive elsewhere on ~1/3 of DINOv3's data; keep KITTI-pending note.
README.md
CHANGED
|
@@ -115,20 +115,10 @@ single-resolution (S) figure is available.
|
|
| 115 |
|
| 116 |
<sub>‡ VideoMAEv2 ViT-g: K400 top-1 after **full fine-tuning**, not the frozen attentive-probe protocol used for the other rows.</sub>
|
| 117 |
|
| 118 |
-
|
| 119 |
-
|
| 120 |
-
|
| 121 |
-
|
| 122 |
-
of PEcore, SigLIP2, and V-JEPA 2.1.
|
| 123 |
-
- **ImageNet-1K linear probe (87.2)** is close to DINOv3 (88.4) and behind the contrastively
|
| 124 |
-
trained SigLIP2 (89.1) and PEcore (89.3) — notable given Motif sees **0.5B** samples versus
|
| 125 |
-
PEcore's **5.4B** and SigLIP2's **10B** image–text pairs.
|
| 126 |
-
- **Data efficiency** — these results come from **~0.47B training samples** (448.6M images +
|
| 127 |
-
18.5M video clips), roughly **3.6× less data than DINOv3**, which is trained on LVD-1689M
|
| 128 |
-
(1,689M images). Despite the smaller corpus — and with only ~4% of samples being video — the
|
| 129 |
-
encoder stays competitive across both image and video benchmarks, and leads on DAVIS.
|
| 130 |
-
- KITTI depth estimation is still being evaluated and will be added as the run completes.
|
| 131 |
-
Numbers in this table will be updated as evaluations finish.
|
| 132 |
|
| 133 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 134 |
video. Baseline DAVIS / ADE20K / K400 / KITTI figures are taken from the DINOv3 technical
|
|
|
|
| 115 |
|
| 116 |
<sub>‡ VideoMAEv2 ViT-g: K400 top-1 after **full fine-tuning**, not the frozen attentive-probe protocol used for the other rows.</sub>
|
| 117 |
|
| 118 |
+
Motif sets a new **state of the art on DAVIS video segmentation**, leading at every resolution
|
| 119 |
+
(74.0 / 80.5 / 83.5 J&F), and stays **competitive across the remaining image and video
|
| 120 |
+
benchmarks** — despite training on only **~0.5B samples**, roughly **1/3 of DINOv3's data**.
|
| 121 |
+
KITTI depth is still being evaluated and will be added as the run completes.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
|
| 123 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 124 |
video. Baseline DAVIS / ADE20K / K400 / KITTI figures are taken from the DINOv3 technical
|