Improve model card: add pipeline tag, library name, paper link, GitHub link, and usage example

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +64 -3
README.md CHANGED
@@ -1,3 +1,64 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: image-to-image
4
+ library_name: diffusers
5
+ ---
6
+
7
+ # DiffFuSR: Super-Resolution of all Sentinel-2 Multispectral Bands using Diffusion Models
8
+
9
+ This model is presented in the paper [DiffFuSR: Super-Resolution of all Sentinel-2 Multispectral Bands using Diffusion Models](https://huggingface.co/papers/2506.11764).
10
+
11
+ DiffFuSR is a modular pipeline designed for super-resolving all 12 spectral bands of Sentinel-2 Level-2A imagery to a unified ground sampling distance (GSD) of 2.5 meters. The pipeline operates in two stages:
12
+ 1. A diffusion-based super-resolution (SR) model trained on high-resolution RGB imagery from the NAIP and WorldStrat datasets, harmonized to simulate Sentinel-2 characteristics.
13
+ 2. A learned fusion network that upscales the remaining multispectral bands by utilizing the super-resolved RGB image as a spatial prior.
14
+
15
+ This approach introduces a robust degradation model and contrastive degradation encoder to support blind SR, outperforming current SOTA baselines in reflectance fidelity, spectral consistency, spatial alignment, and hallucination suppression.
16
+
17
+ The official implementation, including code and training/evaluation scripts, can be found on GitHub: [https://github.com/NorskRegnesentral/DiffFuSR](https://github.com/NorskRegnesentral/DiffFuSR).
18
+
19
+ ## Sample Usage
20
+
21
+ To use the DiffFuSR models, you can follow the instructions provided in the official GitHub repository.
22
+
23
+ First, set up your Python environment and install dependencies:
24
+
25
+ ```bash
26
+ # Create a virtual environment (optional but recommended) Python version used 3.11.4
27
+ python -m venv .venv
28
+ source .venv/bin/activate # Windows: venv\Scripts\activate
29
+
30
+ # Install all Python dependencies
31
+ pip install -r requirements.txt
32
+ ```
33
+
34
+ Then, download the pretrained checkpoints from the Hugging Face Hub using `git lfs`:
35
+
36
+ ```bash
37
+ git lfs install
38
+ git clone https://huggingface.co/NorskRegnesentralSTI/DiffFuSR && mv DiffFuSR/logs logs
39
+ ```
40
+
41
+ After downloading, you can run one of the provided test scripts. For example, to test RGB SR for OpenSR metric using the WorldStrat SR model:
42
+
43
+ ```bash
44
+ python 2_test_rgb_for_opensr_metric.py --checkpoint logs/blindsrsnf_aniso_worldstrat_degraded_harmfac_10000_large/version_7/checkpoints/last.ckpt
45
+ ```
46
+ You can change the `--checkpoint` flag to test other available models (NAIP-no-harm SR or NAIP-harm SR).
47
+
48
+ More detailed usage and training instructions are available in the [GitHub repository](https://github.com/NorskRegnesentral/DiffFuSR).
49
+
50
+ ## Citation
51
+
52
+ If you use this pipeline in your research, please cite our paper:
53
+
54
+ ```bibtex
55
+ @article{,
56
+ title={DiffFuSR: Super-Resolution of all Sentinel-2 Multispectral Bands using Diffusion Models},
57
+ author={{}},
58
+ year={2025},
59
+ eprint={2506.11764},
60
+ archivePrefix={arXiv},
61
+ primaryClass={cs.CV},
62
+ url={https://arxiv.org/abs/2506.11764},
63
+ }
64
+ ```