Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,66 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Bayesian Enhancement Model (BEM)
|
| 2 |
+
|
| 3 |
+
AAAI 2026 β One-to-Many Modeling for Low-Light & Underwater Image Enhancement
|
| 4 |
+
π Paper
|
| 5 |
+
| π» Code
|
| 6 |
+
|
| 7 |
+
π Overview
|
| 8 |
+
|
| 9 |
+
Image enhancement is inherently one-to-many β a single degraded image often corresponds to multiple plausible enhanced outputs, especially in low-light and underwater environments.
|
| 10 |
+
|
| 11 |
+
However, existing deterministic models can only produce one prediction, failing to capture this ambiguity.
|
| 12 |
+
|
| 13 |
+
BEM (Bayesian Enhancement Model) solves this by:
|
| 14 |
+
|
| 15 |
+
Modeling uncertainty using a Bayesian Neural Network (BNN)
|
| 16 |
+
|
| 17 |
+
Generating multiple valid enhancement candidates
|
| 18 |
+
|
| 19 |
+
Selecting or aggregating candidates via Ranking or Monte Carlo
|
| 20 |
+
|
| 21 |
+
Refining details using a second-stage DNN
|
| 22 |
+
|
| 23 |
+
Achieving DNN-level inference speed with BNN-level diversity
|
| 24 |
+
|
| 25 |
+
This makes BEM the first practical Bayesian solution for large-scale image enhancement tasks.
|
| 26 |
+
|
| 27 |
+
π Key Features
|
| 28 |
+
β One-to-Many Enhancement via Bayesian Inference
|
| 29 |
+
|
| 30 |
+
BEM samples weights from a variational posterior learned by a Bayesian UNet.
|
| 31 |
+
Each sample produces a distinct enhancement, capturing the ambiguity of the task
|
| 32 |
+
|
| 33 |
+
BNN_AAAI
|
| 34 |
+
|
| 35 |
+
.
|
| 36 |
+
|
| 37 |
+
β Two-Stage BNN β DNN Framework (Fast!)
|
| 38 |
+
|
| 39 |
+
The core bottleneck is heavy BNN inference.
|
| 40 |
+
So we introduce a coarse-to-fine pipeline:
|
| 41 |
+
|
| 42 |
+
Stage I (BNN): Predict coarse latent results in low-dimensional space
|
| 43 |
+
|
| 44 |
+
Stage II (DNN): Refine structural & texture details
|
| 45 |
+
|
| 46 |
+
This yields a 22Γ speedup vs. vanilla BNNs (Fig.5 in paper)
|
| 47 |
+
|
| 48 |
+
BNN_AAAI
|
| 49 |
+
|
| 50 |
+
.
|
| 51 |
+
|
| 52 |
+
β Adaptive Prior for Stable Training
|
| 53 |
+
|
| 54 |
+
Using EMA-updated parameters as priors accelerates convergence and reduces KL instability (Eq.6)
|
| 55 |
+
|
| 56 |
+
BNN_AAAI
|
| 57 |
+
|
| 58 |
+
.
|
| 59 |
+
|
| 60 |
+
β Two Inference Modes
|
| 61 |
+
|
| 62 |
+
BEMRank β Select the best candidate using CLIP-IQA, NIQE, UIQM, or UCIQE
|
| 63 |
+
|
| 64 |
+
BEMMC β Average multiple samples for stable, noise-free output
|
| 65 |
+
|
| 66 |
+
Both modes outperform deterministic baselines.
|