Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,81 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
# V2 Redux - full decoder overhaul
|
| 5 |
|
| 6 |
Cascade bottlenecking didn't cut it, the decoder still bypassed the specifications.
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
+
# V2 good news
|
| 5 |
+
|
| 6 |
+
The decoder is differentiating. The features will be useful downstream.
|
| 7 |
+
|
| 8 |
+
```
|
| 9 |
+
Note: Environment variable`HF_TOKEN` is set and is the current active token independently from the token you've just configured.
|
| 10 |
+
WARNING:huggingface_hub._login:Note: Environment variable`HF_TOKEN` is set and is the current active token independently from the token you've just configured.
|
| 11 |
+
|
| 12 |
+
======================================================================
|
| 13 |
+
SVAE v2 CONDUIT TRAINER β version2_v2_conduit_proto_2
|
| 14 |
+
======================================================================
|
| 15 |
+
|
| 16 |
+
Fresh PatchSVAEv2 from random init
|
| 17 |
+
Total params: 2,729,731
|
| 18 |
+
|
| 19 |
+
Dataset: 16 noise types, 1,280,000 samples/epoch
|
| 20 |
+
Image size: 64Γ64
|
| 21 |
+
Batch size: 256
|
| 22 |
+
|
| 23 |
+
Initial conduit profile:
|
| 24 |
+
S: [2.512, 2.120, 1.776, 1.402]
|
| 25 |
+
S_std: [0.1320, 0.1130, 0.1230, 0.1728]
|
| 26 |
+
log_fric: [2.651, 4.560, 3.362, 2.203] Β± [1.131, 1.041, 0.715, 0.704]
|
| 27 |
+
fric_raw: mean=75.9 max=103510
|
| 28 |
+
settle: [1.24, 2.26, 2.42, 1.00] (>2: 22.9%)
|
| 29 |
+
char_c: [0.5088, -2.6330, 4.8154, -3.6899]
|
| 30 |
+
refine: mean=6.46e-04 max=1.12e-03
|
| 31 |
+
fric_cv: [4.4544, 1.8980, 2.1396, 3.3616]
|
| 32 |
+
|
| 33 |
+
Initial MSE (random decoder): 2.0875
|
| 34 |
+
======================================================================
|
| 35 |
+
Ep 1/50: 100%|ββββββββββββββββββββ| 5000/5000 [06:11<00:00, 13.44it/s, mse=0.0257 cv=1.027]
|
| 36 |
+
|
| 37 |
+
ep 1 | recon=0.0848 val=0.0280 β
BEST | er=3.84 Sd=0.0954 cv=1.027 | 372s
|
| 38 |
+
S: [2.609, 2.196, 1.677, 1.220]
|
| 39 |
+
S_std: [0.1011, 0.1239, 0.1332, 0.1699]
|
| 40 |
+
log_fric: [2.355, 3.985, 3.071, 2.151] Β± [0.871, 0.664, 0.479, 0.662]
|
| 41 |
+
fric_raw: mean=40.0 max=363409
|
| 42 |
+
settle: [1.12, 2.29, 2.84, 1.00] (>2: 29.3%)
|
| 43 |
+
char_c: [0.3458, -2.1159, 4.3382, -3.5587]
|
| 44 |
+
refine: mean=6.49e-04 max=1.14e-03
|
| 45 |
+
fric_cv: [4.1030, 0.7286, 1.8343, 3.0191]
|
| 46 |
+
types: gaus=0.026 unif=0.012 unif=0.032 pois=0.010 pink=0.005 brow=0.006 salt=0.122 spar=0.018 bloc=0.012 grad=0.015 chec=0.010 mixe=0.013 stru=0.018 cauc=0.080 expo=0.024 lapl=0.045
|
| 47 |
+
πΎ /content/version2_v2_conduit_proto_2_checkpoints/best.pt (29.4MB, ep1, MSE=0.028021)
|
| 48 |
+
ProcessingβFilesβ(1β/β1)ββββββ:β100%
|
| 49 |
+
β30.8MBβ/β30.8MB,β25.7MB/sββ
|
| 50 |
+
NewβDataβUploadβββββββββββββββ:β100%
|
| 51 |
+
β30.8MBβ/β30.8MB,β25.7MB/sββ
|
| 52 |
+
ββ...oto_2_checkpoints/best.pt:β100%
|
| 53 |
+
β30.8MBβ/β30.8MBββββββββββββ
|
| 54 |
+
ProcessingβFilesβ(1β/β1)ββββββ:β100%
|
| 55 |
+
β30.8MBβ/β30.8MB,ββ0.00B/sββ
|
| 56 |
+
NewβDataβUploadβββββββββββββββ:β
|
| 57 |
+
ββ0.00Bβ/ββ0.00B,ββ0.00B/sββ
|
| 58 |
+
ββ...oto_2_checkpoints/best.pt:β100%
|
| 59 |
+
β30.8MBβ/β30.8MBββββββββββββ
|
| 60 |
+
No files have been modified since last commit. Skipping to prevent empty commit.
|
| 61 |
+
WARNING:huggingface_hub.hf_api:No files have been modified since last commit. Skipping to prevent empty commit.
|
| 62 |
+
βοΈ Pushed ep1
|
| 63 |
+
Ep 2/50: 100%|ββββββββββββββββββββ| 5000/5000 [06:13<00:00, 13.40it/s, mse=0.0323 cv=1.000]
|
| 64 |
+
|
| 65 |
+
ep 2 | recon=0.0832 val=0.0327 | er=3.76 Sd=0.1165 cv=1.000 | 373s
|
| 66 |
+
S: [2.707, 2.329, 1.400, 1.113]
|
| 67 |
+
S_std: [0.0788, 0.0877, 0.1419, 0.1255]
|
| 68 |
+
log_fric: [2.375, 3.785, 2.958, 2.175] Β± [0.883, 0.508, 0.450, 0.681]
|
| 69 |
+
fric_raw: mean=32.1 max=104752
|
| 70 |
+
settle: [1.15, 2.26, 3.01, 1.00] (>2: 30.0%)
|
| 71 |
+
char_c: [0.2042, -1.5304, 3.7516, -3.3900]
|
| 72 |
+
refine: mean=6.46e-04 max=1.12e-03
|
| 73 |
+
fric_cv: [4.2588, 0.8009, 1.4941, 3.3563]
|
| 74 |
+
types: gaus=0.032 unif=0.011 unif=0.043 pois=0.008 pink=0.002 brow=0.002 salt=0.157 spar=0.020 bloc=0.007 grad=0.011 chec=0.005 mixe=0.012 stru=0.019 cauc=0.107 expo=0.029 lapl=0.060
|
| 75 |
+
Ep 3/50: 20%|ββββ | 1019/5000 [01:16<04:56, 13.45it/s, mse=0.0328 cv=0.906]
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
|
| 79 |
# V2 Redux - full decoder overhaul
|
| 80 |
|
| 81 |
Cascade bottlenecking didn't cut it, the decoder still bypassed the specifications.
|