lpalbou commited on
Commit
d303c64
·
verified ·
1 Parent(s): ecfbb35

Improve validation summary readability

Browse files
Files changed (1) hide show
  1. README.md +20 -10
README.md CHANGED
@@ -37,16 +37,26 @@ For Wan checkpoints, MLX-Gen loads transformer and VAE weights at BF16 runtime p
37
 
38
  ## Local Validation
39
 
40
- Validation used 384x224, 17 frames, 12 denoising steps, guidance 4, guidance-2 3, fps 8, and seed 4242 on Apple Silicon. Memory is measured for the full package run from model init through video save. RSS alone is not enough for MLX/Metal unified-memory pressure, so the table reports both MLX allocator peak and Darwin physical footprint.
41
-
42
- | Package | Folder Size | Runtime Precision | Mode | MLX Peak | Physical Footprint Peak | Time | Notes |
43
- | --- | ---: | --- | --- | ---: | ---: | ---: | --- |
44
- | Upstream source snapshot | 118 GiB | BF16 runtime from FP32/BF16 source files | release inactive denoiser | 32.99 GiB | 48.90 GiB | 108.31 s | Baseline source-cache run. |
45
- | This BF16 prepared folder | 64 GiB | BF16 | release inactive denoiser | 32.98 GiB | 45.12 GiB | 114.39 s | Output was byte-identical to the source-cache run. |
46
- | This BF16 prepared folder | 64 GiB | BF16 | no denoiser release | 59.72 GiB | 75.14 GiB | 110.97 s | Retains both A14B denoisers through decode. |
47
- | This BF16 prepared folder | 64 GiB | BF16 | low-RAM release | 27.75 GiB | 33.18 GiB | 110.76 s | Releases denoisers before decode and clears per-step cache. |
48
- | Mixed q8/BF16 prepared folder | 40 GiB | q8 transformer block linears, BF16 sensitive paths and VAE | release inactive denoiser | 20.84 GiB | 31.75 GiB | 110.34 s | Lower usage memory; not byte-identical to BF16 but passed side-by-side validation. |
49
- | Mixed q8/BF16 prepared folder | 40 GiB | q8 transformer block linears, BF16 sensitive paths and VAE | low-RAM release | 15.48 GiB | 20.74 GiB | 108.70 s | Lowest measured usage-memory mode. |
 
 
 
 
 
 
 
 
 
 
50
 
51
  ## Compatibility
52
 
 
37
 
38
  ## Local Validation
39
 
40
+ Validation used 384x224, 17 frames, 12 denoising steps, guidance 4, guidance-2 3, fps 8, and seed 4242 on Apple Silicon. The memory numbers cover the full run from model init through video save. MLX peak is the MLX allocator peak; physical peak is the Darwin process physical footprint, which better reflects Apple Silicon unified-memory pressure than RSS alone.
41
+
42
+ Bottom line:
43
+
44
+ - The BF16 package reduces storage, not runtime memory. It is useful when you want a smaller, uploadable package with byte-identical output to the original source-cache run.
45
+ - The mixed q8/BF16 package reduces both storage and runtime memory. Use it when memory footprint matters.
46
+
47
+ | Layout | Disk | Runtime Memory | Improvement |
48
+ | --- | ---: | --- | --- |
49
+ | Original source snapshot | 118 GiB | Baseline | Baseline. |
50
+ | This BF16 package | 64 GiB | Same class as original | Storage only; output was byte-identical. |
51
+ | Mixed q8/BF16 package | 40 GiB | Lower | Storage and memory; side-by-side quality validation passed. |
52
+
53
+ Compared with the original source snapshot, this BF16 package cuts disk usage by about 46% but does not materially reduce generation memory. The mixed q8/BF16 package cuts disk usage by about 66% and physical peak memory by about 35% in this validation run.
54
+
55
+ Raw measurements:
56
+
57
+ - Original source snapshot: 32.99 GiB MLX peak, 48.90 GiB physical peak, 108.31 s.
58
+ - This BF16 package: 32.98 GiB MLX peak, 45.12 GiB physical peak, 114.39 s.
59
+ - Mixed q8/BF16 package: 20.84 GiB MLX peak, 31.75 GiB physical peak, 110.34 s.
60
 
61
  ## Compatibility
62