Image Feature Extraction
Transformers
Safetensors
page
feature-extraction
gaze-estimation
gaze-target-estimation
dinov3
custom_code
Instructions to use Octopus1/page-vithplus with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Octopus1/page-vithplus with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="Octopus1/page-vithplus", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Octopus1/page-vithplus", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,6 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
library_name: transformers
|
| 4 |
-
base_model: []
|
| 5 |
tags:
|
| 6 |
- gaze-estimation
|
| 7 |
- gaze-target-estimation
|
|
@@ -9,11 +8,12 @@ tags:
|
|
| 9 |
pipeline_tag: image-feature-extraction
|
| 10 |
---
|
| 11 |
|
| 12 |
-
# PaGE
|
| 13 |
|
| 14 |
-
Huge+ flagship
|
|
|
|
| 15 |
|
| 16 |
-
- **Backbone:** DINOv3 ViT-H+
|
| 17 |
- **Params:** ~1.7B
|
| 18 |
- **Scene input:** 512×512, **Head input:** 256×256, **Heatmap output:** 64×64
|
| 19 |
- **Source checkpoint:** `vithplus_ft.pt`
|
|
@@ -21,8 +21,11 @@ Huge+ flagship variant. Fine-tuned. Part of the [PaGE](https://huggingface.co/Oc
|
|
| 21 |
## Self-contained weights
|
| 22 |
|
| 23 |
This checkpoint includes the full DINOv3 backbone weights in its `safetensors` files. **No external
|
| 24 |
-
DINOv3 weights are downloaded
|
| 25 |
-
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
## Installation
|
| 28 |
|
|
@@ -55,7 +58,7 @@ inout = out["inout"][0] # [Np]
|
|
| 55 |
|
| 56 |
## Inputs / Outputs
|
| 57 |
|
| 58 |
-
See the family [README](https://huggingface.co/Octopus1/PaGE) for the full
|
| 59 |
|
| 60 |
- Input dict: `images` (list of `[B,3,512,512]`), `head_images` (list of `[sum(Np),3,256,256]`),
|
| 61 |
`bboxes` (per-image list of `(xmin,ymin,xmax,ymax)` in `[0,1]`).
|
|
@@ -63,4 +66,15 @@ See the family [README](https://huggingface.co/Octopus1/PaGE) for the full input
|
|
| 63 |
|
| 64 |
## License
|
| 65 |
|
| 66 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: mit
|
| 3 |
library_name: transformers
|
|
|
|
| 4 |
tags:
|
| 5 |
- gaze-estimation
|
| 6 |
- gaze-target-estimation
|
|
|
|
| 8 |
pipeline_tag: image-feature-extraction
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# PaGE ViT-H+
|
| 12 |
|
| 13 |
+
Huge+ flagship teacher; finetuned end-to-end. Part of the [PaGE](https://huggingface.co/Octopus1/PaGE) gaze target estimation family
|
| 14 |
+
(ICLR 2026).
|
| 15 |
|
| 16 |
+
- **Backbone:** DINOv3 ViT-H+ (gated MLP) (derivative of DINOv3, full-parameter trained)
|
| 17 |
- **Params:** ~1.7B
|
| 18 |
- **Scene input:** 512×512, **Head input:** 256×256, **Heatmap output:** 64×64
|
| 19 |
- **Source checkpoint:** `vithplus_ft.pt`
|
|
|
|
| 21 |
## Self-contained weights
|
| 22 |
|
| 23 |
This checkpoint includes the full DINOv3 backbone weights in its `safetensors` files. **No external
|
| 24 |
+
DINOv3 weights are downloaded** — the DINOv3 model *structure* is provided by `transformers>=4.56`
|
| 25 |
+
(built-in `dinov3_vit`), and the backbone weights here are derivative weights from full-parameter
|
| 26 |
+
training of DINOv3. The model code (`modeling_page.py`) is loaded automatically from
|
| 27 |
+
[`Octopus1/PaGE`](https://huggingface.co/Octopus1/PaGE) via `auto_map` when you pass
|
| 28 |
+
`trust_remote_code=True`.
|
| 29 |
|
| 30 |
## Installation
|
| 31 |
|
|
|
|
| 58 |
|
| 59 |
## Inputs / Outputs
|
| 60 |
|
| 61 |
+
See the family [README](https://huggingface.co/Octopus1/PaGE) for the full spec.
|
| 62 |
|
| 63 |
- Input dict: `images` (list of `[B,3,512,512]`), `head_images` (list of `[sum(Np),3,256,256]`),
|
| 64 |
`bboxes` (per-image list of `(xmin,ymin,xmax,ymax)` in `[0,1]`).
|
|
|
|
| 66 |
|
| 67 |
## License
|
| 68 |
|
| 69 |
+
- The PaGE decoder and gaze heads are released under the **MIT License** (see `LICENSE`).
|
| 70 |
+
- The **DINOv3 backbone is a derivative work of DINOv3** ([facebook/dinov3](https://huggingface.co/facebook/dinov3)).
|
| 71 |
+
The backbone was initialized from the public DINOv3 self-supervised weights and then **trained in
|
| 72 |
+
full (all parameters updated)** as part of PaGE training — i.e. the backbone weights here are
|
| 73 |
+
**derivative weights produced by full-parameter training of DINOv3**, not the original DINOv3
|
| 74 |
+
weights verbatim.
|
| 75 |
+
- DINOv3 is released by Meta AI under the **Meta DINO License** (see `DINOv3_LICENSE.md`). Under its
|
| 76 |
+
Section 1.b.i, derivative works of DINOv3 (including these backbone weights) are distributed under
|
| 77 |
+
the DINO License terms, and `DINOv3_LICENSE.md` must accompany any redistribution.
|
| 78 |
+
- By using or redistributing this model you agree to the DINO License for the DINOv3-derived portions.
|
| 79 |
+
|
| 80 |
+
See the family [README](https://huggingface.co/Octopus1/PaGE) for full license details.
|