dipta007 commited on
Commit
8de96f9
·
verified ·
1 Parent(s): 6f3f10e

docs: WACV 2026 not 2027, seven test sets, exact numbers, link the training data

Browse files
Files changed (1) hide show
  1. README.md +12 -7
README.md CHANGED
@@ -20,7 +20,7 @@ OracleZoom drives Chain-of-Zoom's recursive 4x super-resolution out to 256x whil
20
 
21
  [![Base](https://img.shields.io/badge/Base-SD3%20%2B%20Qwen2.5--VL-blue)](https://huggingface.co/stabilityai/stable-diffusion-3-medium-diffusers)
22
  [![Method](https://img.shields.io/badge/Method-Chain--of--Zoom-orange)](https://github.com/bryanswkim/Chain-of-Zoom)
23
- [![Paper](https://img.shields.io/badge/Paper-WACV%202027%20(in%20submission)-red)](#)
24
  [![License](https://img.shields.io/badge/License-CC--BY--NC--4.0-lightgrey)](https://creativecommons.org/licenses/by-nc/4.0/)
25
 
26
  ## Quickstart (one image, all scales)
@@ -50,6 +50,11 @@ Stable Diffusion 3-medium and Qwen2.5-VL-3B download automatically on first run.
50
 
51
  > **Batching many images:** `inference.py` exposes `zoom_image(sr, model, proc, pvi, image_path, out_dir)`. Build the models once (`build_sr(...)`, `build_vlm(...)`) and call `zoom_image` in a loop over your images.
52
 
 
 
 
 
 
53
  ## What's in this repo
54
  | Path | What it is |
55
  |---|---|
@@ -65,12 +70,12 @@ Recursive SR (Chain-of-Zoom) reuses a 4x backbone step after step to reach 16x-2
65
  **Privileged-latent distillation.** A *privileged teacher* is shown the ground-truth high-resolution patch **at training time only** and distills its real detail into the blind student, in **decode space**. Only a small adapter is trained; the backbone, VAE, and prompter stay frozen. **A KL leash** to the deployed backbone keeps a deep sharpness reward from drifting into a metric-gaming texture, so detail stays faithful. Trained: rank-16 adapter (7.1M params), 1,000 curated 4K images; beta_reward 0.4, beta_kl 8.0. The released weights have this adapter already merged in.
66
 
67
  ## Results
68
- Under Chain-of-Zoom's exact protocol on a curated 4K benchmark and six test sets:
69
 
70
  | Axis | Metric | Ours | CoZ / best baseline |
71
  |---|---|---|---|
72
- | Sharpness (no-reference) | CLIPIQA @256x | **0.71** | <= 0.58 |
73
- | Fidelity @4x (ground truth exists) | LPIPS | **0.20** | 0.22 (CoZ) |
74
  | Deep faithfulness (MLLM judge, 64-256x) | preferred vs CoZ | **68-78%** | - |
75
  | Deep faithfulness | hallucination rate vs CoZ | **2-5x lower** | - |
76
 
@@ -85,11 +90,11 @@ The `coz/` code and the checkpoints in `ckpt/` are from [Chain-of-Zoom](https://
85
 
86
  ## Citation
87
  ```bibtex
88
- @inproceedings{dipta2027oraclezoom,
89
  title={OracleZoom: Privileged-Latent Distillation for Faithful Extreme Super-Resolution},
90
  author={Shubhashis Roy Dipta},
91
- year={2027},
92
- note={In submission, WACV 2027}
93
  }
94
  ```
95
  Please also cite Chain-of-Zoom and OSEDiff.
 
20
 
21
  [![Base](https://img.shields.io/badge/Base-SD3%20%2B%20Qwen2.5--VL-blue)](https://huggingface.co/stabilityai/stable-diffusion-3-medium-diffusers)
22
  [![Method](https://img.shields.io/badge/Method-Chain--of--Zoom-orange)](https://github.com/bryanswkim/Chain-of-Zoom)
23
+ [![Paper](https://img.shields.io/badge/Paper-WACV%202026%20(in%20submission)-red)](#)
24
  [![License](https://img.shields.io/badge/License-CC--BY--NC--4.0-lightgrey)](https://creativecommons.org/licenses/by-nc/4.0/)
25
 
26
  ## Quickstart (one image, all scales)
 
50
 
51
  > **Batching many images:** `inference.py` exposes `zoom_image(sr, model, proc, pvi, image_path, out_dir)`. Build the models once (`build_sr(...)`, `build_vlm(...)`) and call `zoom_image` in a loop over your images.
52
 
53
+ ## Training data
54
+ The curated training set is released separately at
55
+ [dipta007/OracleZoom-4KLSDB-train](https://huggingface.co/datasets/dipta007/OracleZoom-4KLSDB-train).
56
+ The released model uses its `1k` config (1,000 curated 4K images).
57
+
58
  ## What's in this repo
59
  | Path | What it is |
60
  |---|---|
 
70
  **Privileged-latent distillation.** A *privileged teacher* is shown the ground-truth high-resolution patch **at training time only** and distills its real detail into the blind student, in **decode space**. Only a small adapter is trained; the backbone, VAE, and prompter stay frozen. **A KL leash** to the deployed backbone keeps a deep sharpness reward from drifting into a metric-gaming texture, so detail stays faithful. Trained: rank-16 adapter (7.1M params), 1,000 curated 4K images; beta_reward 0.4, beta_kl 8.0. The released weights have this adapter already merged in.
71
 
72
  ## Results
73
+ Under Chain-of-Zoom's exact protocol on a curated 4K benchmark and seven test sets:
74
 
75
  | Axis | Metric | Ours | CoZ / best baseline |
76
  |---|---|---|---|
77
+ | Sharpness (no-reference) | CLIPIQA @256x | **0.706** | 0.579 (CoZ) |
78
+ | Fidelity @4x (ground truth exists) | LPIPS | **0.199** | 0.215 (CoZ) |
79
  | Deep faithfulness (MLLM judge, 64-256x) | preferred vs CoZ | **68-78%** | - |
80
  | Deep faithfulness | hallucination rate vs CoZ | **2-5x lower** | - |
81
 
 
90
 
91
  ## Citation
92
  ```bibtex
93
+ @inproceedings{dipta2026oraclezoom,
94
  title={OracleZoom: Privileged-Latent Distillation for Faithful Extreme Super-Resolution},
95
  author={Shubhashis Roy Dipta},
96
+ year={2026},
97
+ note={In submission, WACV 2026}
98
  }
99
  ```
100
  Please also cite Chain-of-Zoom and OSEDiff.