Improve model card: Add pipeline tag, library_name, paper, and project page links

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +31 -7
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
- license: mit
3
  language:
4
  - en
 
5
  metrics:
6
  - mean_iou
7
  - AbsRel
@@ -9,23 +9,47 @@ metrics:
9
  tags:
10
  - Semantic_Future_Prediction
11
  - World Models
 
 
12
  ---
13
 
14
  # DINO-Foresight: Looking into the Future with DINO (NeurIPS 2025)
15
 
16
  ![image](https://cdn-uploads.huggingface.co/production/uploads/677272184d148b904333e874/btsV1EHK4yYiyboMjG7oj.png)
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
 
19
- # Code
20
- https://github.com/Sta8is/DINO-Foresight
21
 
22
- # Demo:
23
  We provide 2 quick demos.
24
 
25
  - [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1K8o3-zkR5lCdAv7Qjz7rhWP8n2VrFOdz?usp=sharing)
26
  - [Demo](https://github.com/Sta8is/DINO-Foresight/blob/main/demo.ipynb).
27
 
28
- # Citation
29
  If you found DINO-Foresight useful in your research, please consider starring ⭐ us on GitHub and citing 📚 us in your research!
30
  ```bibtex
31
  @inproceedings{karypidis2025dinoforesight,
@@ -37,5 +61,5 @@ url={https://arxiv.org/abs/2412.11673}
37
  }
38
  ```
39
 
40
- # Acknowledgements
41
- Our code is partially based on [Maskgit-pytorch](https://github.com/valeoai/Maskgit-pytorch), a pytorch implementation of MaskedGit by ValeoAI. We also thank authors of [DINOv2](https://github.com/facebookresearch/dinov2), [DPT](https://github.com/isl-org/DPT), [DepthAnythingV2](https://github.com/DepthAnything/Depth-Anything-V2), [LOTUS](https://github.com/EnVision-Research/Lotus) for their work and open-source code.
 
1
  ---
 
2
  language:
3
  - en
4
+ license: mit
5
  metrics:
6
  - mean_iou
7
  - AbsRel
 
9
  tags:
10
  - Semantic_Future_Prediction
11
  - World Models
12
+ pipeline_tag: image-feature-extraction
13
+ library_name: pytorch
14
  ---
15
 
16
  # DINO-Foresight: Looking into the Future with DINO (NeurIPS 2025)
17
 
18
  ![image](https://cdn-uploads.huggingface.co/production/uploads/677272184d148b904333e874/btsV1EHK4yYiyboMjG7oj.png)
19
 
20
+ DINO-Foresight is a novel framework that operates in the semantic feature space of pretrained Vision Foundation Models (VFMs) to predict future dynamics. It trains a masked feature transformer in a self-supervised manner to forecast the evolution of VFM features over time, enabling various scene understanding tasks through off-the-shelf, task-specific heads.
21
+
22
+ ## Paper
23
+ [DINO-Foresight: Looking into the Future with DINO](https://huggingface.co/papers/2412.11673)
24
+
25
+ ## Project Page
26
+ [https://dino-foresight.github.io](https://dino-foresight.github.io)
27
+
28
+ ## Code
29
+ The official implementation can be found on GitHub: [https://github.com/Sta8is/DINO-Foresight](https://github.com/Sta8is/DINO-Foresight)
30
+
31
+ ## Sample Usage
32
+
33
+ The model is built with PyTorch. You can set up the environment and install dependencies as follows:
34
+
35
+ ```bash
36
+ conda create -n dinof python=3.11
37
+ conda activate dinof
38
+ pip install torch==2.2.0 torchvision==0.17.0 torchaudio==2.2.0 --index-url https://download.pytorch.org/whl/cu121
39
+ git clone https://github.com/Sta8is/DINO-Foresight
40
+ cd DINO-Foresight
41
+ pip install -r requirements.txt
42
+ ```
43
 
44
+ For detailed usage examples and model training, refer to the provided demos and the GitHub repository.
 
45
 
46
+ ## Demo
47
  We provide 2 quick demos.
48
 
49
  - [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1K8o3-zkR5lCdAv7Qjz7rhWP8n2VrFOdz?usp=sharing)
50
  - [Demo](https://github.com/Sta8is/DINO-Foresight/blob/main/demo.ipynb).
51
 
52
+ ## Citation
53
  If you found DINO-Foresight useful in your research, please consider starring ⭐ us on GitHub and citing 📚 us in your research!
54
  ```bibtex
55
  @inproceedings{karypidis2025dinoforesight,
 
61
  }
62
  ```
63
 
64
+ ## Acknowledgements
65
+ Our code is partially based on [Maskgit-pytorch](https://github.com/valeoai/Maskgit-pytorch), a pytorch implementation of MaskedGit by ValeoAI. We also thank authors of [DINOv2](https://github.com/facebookresearch/dinov2), [DPT](https://github.com/isl-org/DPT), [DepthAnythingV2](https://github.com/DepthAnything/Depth-Anything-V2), [LOTUS](https://github.com/EnVision-Research/Lotus) for their work and open-source code.