Improve model card: Add pipeline tag, library_name, paper, and project page links
#1
by
nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
-
license: mit
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
| 5 |
metrics:
|
| 6 |
- mean_iou
|
| 7 |
- AbsRel
|
|
@@ -9,23 +9,47 @@ metrics:
|
|
| 9 |
tags:
|
| 10 |
- Semantic_Future_Prediction
|
| 11 |
- World Models
|
|
|
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
# DINO-Foresight: Looking into the Future with DINO (NeurIPS 2025)
|
| 15 |
|
| 16 |

|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
-
|
| 20 |
-
https://github.com/Sta8is/DINO-Foresight
|
| 21 |
|
| 22 |
-
|
| 23 |
We provide 2 quick demos.
|
| 24 |
|
| 25 |
- [](https://colab.research.google.com/drive/1K8o3-zkR5lCdAv7Qjz7rhWP8n2VrFOdz?usp=sharing)
|
| 26 |
- [Demo](https://github.com/Sta8is/DINO-Foresight/blob/main/demo.ipynb).
|
| 27 |
|
| 28 |
-
|
| 29 |
If you found DINO-Foresight useful in your research, please consider starring ⭐ us on GitHub and citing 📚 us in your research!
|
| 30 |
```bibtex
|
| 31 |
@inproceedings{karypidis2025dinoforesight,
|
|
@@ -37,5 +61,5 @@ url={https://arxiv.org/abs/2412.11673}
|
|
| 37 |
}
|
| 38 |
```
|
| 39 |
|
| 40 |
-
|
| 41 |
-
Our code is partially based on [Maskgit-pytorch](https://github.com/valeoai/Maskgit-pytorch), a pytorch implementation of MaskedGit by ValeoAI. We also thank authors of [DINOv2](https://github.com/facebookresearch/dinov2), [DPT](https://github.com/isl-org/DPT), [DepthAnythingV2](https://github.com/DepthAnything/Depth-Anything-V2), [LOTUS](https://github.com/EnVision-Research/Lotus) for their work and open-source code.
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
license: mit
|
| 5 |
metrics:
|
| 6 |
- mean_iou
|
| 7 |
- AbsRel
|
|
|
|
| 9 |
tags:
|
| 10 |
- Semantic_Future_Prediction
|
| 11 |
- World Models
|
| 12 |
+
pipeline_tag: image-feature-extraction
|
| 13 |
+
library_name: pytorch
|
| 14 |
---
|
| 15 |
|
| 16 |
# DINO-Foresight: Looking into the Future with DINO (NeurIPS 2025)
|
| 17 |
|
| 18 |

|
| 19 |
|
| 20 |
+
DINO-Foresight is a novel framework that operates in the semantic feature space of pretrained Vision Foundation Models (VFMs) to predict future dynamics. It trains a masked feature transformer in a self-supervised manner to forecast the evolution of VFM features over time, enabling various scene understanding tasks through off-the-shelf, task-specific heads.
|
| 21 |
+
|
| 22 |
+
## Paper
|
| 23 |
+
[DINO-Foresight: Looking into the Future with DINO](https://huggingface.co/papers/2412.11673)
|
| 24 |
+
|
| 25 |
+
## Project Page
|
| 26 |
+
[https://dino-foresight.github.io](https://dino-foresight.github.io)
|
| 27 |
+
|
| 28 |
+
## Code
|
| 29 |
+
The official implementation can be found on GitHub: [https://github.com/Sta8is/DINO-Foresight](https://github.com/Sta8is/DINO-Foresight)
|
| 30 |
+
|
| 31 |
+
## Sample Usage
|
| 32 |
+
|
| 33 |
+
The model is built with PyTorch. You can set up the environment and install dependencies as follows:
|
| 34 |
+
|
| 35 |
+
```bash
|
| 36 |
+
conda create -n dinof python=3.11
|
| 37 |
+
conda activate dinof
|
| 38 |
+
pip install torch==2.2.0 torchvision==0.17.0 torchaudio==2.2.0 --index-url https://download.pytorch.org/whl/cu121
|
| 39 |
+
git clone https://github.com/Sta8is/DINO-Foresight
|
| 40 |
+
cd DINO-Foresight
|
| 41 |
+
pip install -r requirements.txt
|
| 42 |
+
```
|
| 43 |
|
| 44 |
+
For detailed usage examples and model training, refer to the provided demos and the GitHub repository.
|
|
|
|
| 45 |
|
| 46 |
+
## Demo
|
| 47 |
We provide 2 quick demos.
|
| 48 |
|
| 49 |
- [](https://colab.research.google.com/drive/1K8o3-zkR5lCdAv7Qjz7rhWP8n2VrFOdz?usp=sharing)
|
| 50 |
- [Demo](https://github.com/Sta8is/DINO-Foresight/blob/main/demo.ipynb).
|
| 51 |
|
| 52 |
+
## Citation
|
| 53 |
If you found DINO-Foresight useful in your research, please consider starring ⭐ us on GitHub and citing 📚 us in your research!
|
| 54 |
```bibtex
|
| 55 |
@inproceedings{karypidis2025dinoforesight,
|
|
|
|
| 61 |
}
|
| 62 |
```
|
| 63 |
|
| 64 |
+
## Acknowledgements
|
| 65 |
+
Our code is partially based on [Maskgit-pytorch](https://github.com/valeoai/Maskgit-pytorch), a pytorch implementation of MaskedGit by ValeoAI. We also thank authors of [DINOv2](https://github.com/facebookresearch/dinov2), [DPT](https://github.com/isl-org/DPT), [DepthAnythingV2](https://github.com/DepthAnything/Depth-Anything-V2), [LOTUS](https://github.com/EnVision-Research/Lotus) for their work and open-source code.
|