docs: WACV 2026 not 2027, seven test sets, exact numbers, link the training data
Browse files
README.md
CHANGED
|
@@ -20,7 +20,7 @@ OracleZoom drives Chain-of-Zoom's recursive 4x super-resolution out to 256x whil
|
|
| 20 |
|
| 21 |
[](https://huggingface.co/stabilityai/stable-diffusion-3-medium-diffusers)
|
| 22 |
[](https://github.com/bryanswkim/Chain-of-Zoom)
|
| 23 |
-
[](https://creativecommons.org/licenses/by-nc/4.0/)
|
| 25 |
|
| 26 |
## Quickstart (one image, all scales)
|
|
@@ -50,6 +50,11 @@ Stable Diffusion 3-medium and Qwen2.5-VL-3B download automatically on first run.
|
|
| 50 |
|
| 51 |
> **Batching many images:** `inference.py` exposes `zoom_image(sr, model, proc, pvi, image_path, out_dir)`. Build the models once (`build_sr(...)`, `build_vlm(...)`) and call `zoom_image` in a loop over your images.
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
## What's in this repo
|
| 54 |
| Path | What it is |
|
| 55 |
|---|---|
|
|
@@ -65,12 +70,12 @@ Recursive SR (Chain-of-Zoom) reuses a 4x backbone step after step to reach 16x-2
|
|
| 65 |
**Privileged-latent distillation.** A *privileged teacher* is shown the ground-truth high-resolution patch **at training time only** and distills its real detail into the blind student, in **decode space**. Only a small adapter is trained; the backbone, VAE, and prompter stay frozen. **A KL leash** to the deployed backbone keeps a deep sharpness reward from drifting into a metric-gaming texture, so detail stays faithful. Trained: rank-16 adapter (7.1M params), 1,000 curated 4K images; beta_reward 0.4, beta_kl 8.0. The released weights have this adapter already merged in.
|
| 66 |
|
| 67 |
## Results
|
| 68 |
-
Under Chain-of-Zoom's exact protocol on a curated 4K benchmark and
|
| 69 |
|
| 70 |
| Axis | Metric | Ours | CoZ / best baseline |
|
| 71 |
|---|---|---|---|
|
| 72 |
-
| Sharpness (no-reference) | CLIPIQA @256x | **0.
|
| 73 |
-
| Fidelity @4x (ground truth exists) | LPIPS | **0.
|
| 74 |
| Deep faithfulness (MLLM judge, 64-256x) | preferred vs CoZ | **68-78%** | - |
|
| 75 |
| Deep faithfulness | hallucination rate vs CoZ | **2-5x lower** | - |
|
| 76 |
|
|
@@ -85,11 +90,11 @@ The `coz/` code and the checkpoints in `ckpt/` are from [Chain-of-Zoom](https://
|
|
| 85 |
|
| 86 |
## Citation
|
| 87 |
```bibtex
|
| 88 |
-
@inproceedings{
|
| 89 |
title={OracleZoom: Privileged-Latent Distillation for Faithful Extreme Super-Resolution},
|
| 90 |
author={Shubhashis Roy Dipta},
|
| 91 |
-
year={
|
| 92 |
-
note={In submission, WACV
|
| 93 |
}
|
| 94 |
```
|
| 95 |
Please also cite Chain-of-Zoom and OSEDiff.
|
|
|
|
| 20 |
|
| 21 |
[](https://huggingface.co/stabilityai/stable-diffusion-3-medium-diffusers)
|
| 22 |
[](https://github.com/bryanswkim/Chain-of-Zoom)
|
| 23 |
+
[-red)](#)
|
| 24 |
[](https://creativecommons.org/licenses/by-nc/4.0/)
|
| 25 |
|
| 26 |
## Quickstart (one image, all scales)
|
|
|
|
| 50 |
|
| 51 |
> **Batching many images:** `inference.py` exposes `zoom_image(sr, model, proc, pvi, image_path, out_dir)`. Build the models once (`build_sr(...)`, `build_vlm(...)`) and call `zoom_image` in a loop over your images.
|
| 52 |
|
| 53 |
+
## Training data
|
| 54 |
+
The curated training set is released separately at
|
| 55 |
+
[dipta007/OracleZoom-4KLSDB-train](https://huggingface.co/datasets/dipta007/OracleZoom-4KLSDB-train).
|
| 56 |
+
The released model uses its `1k` config (1,000 curated 4K images).
|
| 57 |
+
|
| 58 |
## What's in this repo
|
| 59 |
| Path | What it is |
|
| 60 |
|---|---|
|
|
|
|
| 70 |
**Privileged-latent distillation.** A *privileged teacher* is shown the ground-truth high-resolution patch **at training time only** and distills its real detail into the blind student, in **decode space**. Only a small adapter is trained; the backbone, VAE, and prompter stay frozen. **A KL leash** to the deployed backbone keeps a deep sharpness reward from drifting into a metric-gaming texture, so detail stays faithful. Trained: rank-16 adapter (7.1M params), 1,000 curated 4K images; beta_reward 0.4, beta_kl 8.0. The released weights have this adapter already merged in.
|
| 71 |
|
| 72 |
## Results
|
| 73 |
+
Under Chain-of-Zoom's exact protocol on a curated 4K benchmark and seven test sets:
|
| 74 |
|
| 75 |
| Axis | Metric | Ours | CoZ / best baseline |
|
| 76 |
|---|---|---|---|
|
| 77 |
+
| Sharpness (no-reference) | CLIPIQA @256x | **0.706** | 0.579 (CoZ) |
|
| 78 |
+
| Fidelity @4x (ground truth exists) | LPIPS | **0.199** | 0.215 (CoZ) |
|
| 79 |
| Deep faithfulness (MLLM judge, 64-256x) | preferred vs CoZ | **68-78%** | - |
|
| 80 |
| Deep faithfulness | hallucination rate vs CoZ | **2-5x lower** | - |
|
| 81 |
|
|
|
|
| 90 |
|
| 91 |
## Citation
|
| 92 |
```bibtex
|
| 93 |
+
@inproceedings{dipta2026oraclezoom,
|
| 94 |
title={OracleZoom: Privileged-Latent Distillation for Faithful Extreme Super-Resolution},
|
| 95 |
author={Shubhashis Roy Dipta},
|
| 96 |
+
year={2026},
|
| 97 |
+
note={In submission, WACV 2026}
|
| 98 |
}
|
| 99 |
```
|
| 100 |
Please also cite Chain-of-Zoom and OSEDiff.
|