Image-Text-to-Image
Safetensors
English
SPAD
Photons
Generative
ISP
aRy4n commited on
Commit
bfa5e1b
·
verified ·
1 Parent(s): 9719e2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -12
README.md CHANGED
@@ -21,21 +21,10 @@ tags:
21
  <sup>1</sup> University of Wisconsin-Madison <sup>2</sup> Snap, Inc<br>
22
 
23
 
24
-
25
-
26
  ![color_spads](assets/README_teaser_color_SPAD.png)
27
 
28
 
29
- Abstract:
30
- Capturing high-quality images from only a few detected photons is a fundamental challenge in computational imaging.
31
- Single-photon avalanche diode (SPAD) sensors promise high-quality imaging in regimes where conventional cameras fail, but raw *quanta frames* contain only sparse, noisy, binary photon detections.
32
- Recovering a coherent image from a burst of such frames requires handling alignment, denoising, and demosaicing (for color) under noise statistics far outside those assumed by standard restoration pipelines or modern generative models.
33
- We present an approach that adapts large text-to-image latent diffusion models to the photon-limited domain of quanta burst imaging.
34
- Our method leverages the structural and semantic priors of internet-scale diffusion models while introducing mechanisms to handle Bernoulli photon statistics.
35
- By integrating latent-space restoration with burst-level spatio-temporal reasoning, our approach produces reconstructions that are both photometrically faithful and perceptually pleasing, even under high-speed motion.
36
- We evaluate the method on synthetic benchmarks and new real-world datasets, including the first color SPAD burst dataset and a challenging *Extreme-Deforming (XD)* video benchmark.
37
- Across all settings, the approach substantially improves perceptual quality over classical and modern learning-based baselines, demonstrating the promise of adapting large generative priors to extreme photon-limited sensing.
38
-
39
 
40
  Code at [github.com/Aryan-Garg/gQIR](https://github.com/Aryan-Garg/gQIR).
41
 
 
21
  <sup>1</sup> University of Wisconsin-Madison <sup>2</sup> Snap, Inc<br>
22
 
23
 
 
 
24
  ![color_spads](assets/README_teaser_color_SPAD.png)
25
 
26
 
27
+ ## All model weights are available here now!
 
 
 
 
 
 
 
 
 
28
 
29
  Code at [github.com/Aryan-Garg/gQIR](https://github.com/Aryan-Garg/gQIR).
30