MiniMax-H3-Rung-Omega / README_ko.md
yeowon's picture
Embed viral audio/video comparison demo in README_ko.md
cc5631d verified
|
Raw History Blame Contribute Delete
11.2 kB

๐Ÿ‡ฐ๐Ÿ‡ท MiniMax-H3-Rung-Omega (5.976 BPW, 14.98 GiB Joint-tANS / 16.22 GiB Raw Base-243) + TheoremFlow-ฮฉ (8.92x ์ถ”๋ก  ๊ฐ€์†๊ธฐ)

๐ŸŒ Language / ์–ธ์–ด / ่ฏญ่จ€ / ่จ€่ชž:   ๐Ÿ‡บ๐Ÿ‡ธ English  |  ๐Ÿ‡ฐ๐Ÿ‡ท ํ•œ๊ตญ์–ด  |  ๐Ÿ‡จ๐Ÿ‡ณ ไธญๆ–‡ (็ฎ€ไฝ“)  |  ๐Ÿ‡ฏ๐Ÿ‡ต ๆ—ฅๆœฌ่ชž

Buy Me A Coffee KakaoPay QR NH๋†ํ˜‘ 352-1556-0640-33 (์œค์—ฌ์›) Community Discussions

KakaoPay QR Transfer (์œค์—ฌ์›)

๐Ÿฆ ๊ตญ๋‚ด ๊ณ„์ขŒ์ด์ฒด ํ›„์› (Korean Bank Transfer): NH๋†ํ˜‘(๋†์ถ•ํ˜‘) 352-1556-0640-33 (์˜ˆ๊ธˆ์ฃผ: ์œค์—ฌ์›)  |  ๐Ÿ’› ์นด์นด์˜คํŽ˜์ด QR ์†ก๊ธˆ  |  โ˜• Buy Me a Coffee

โ˜• ์˜คํ”ˆ์†Œ์Šค ์–‘์žํ™” & ์ถ”๋ก  ๊ฐ€์† ์—ฐ๊ตฌ ํ›„์›ํ•˜๊ธฐ: MiniMax-H3-Rung-Omega ์ฒดํฌํฌ์ธํŠธ์™€ TheoremFlow-ฮฉ ์ถ”๋ก  ์—”์ง„์€ ๋ณ„๋„์˜ ์Šน์ธ ์ ˆ์ฐจ ์—†์ด ๋ˆ„๊ตฌ๋‚˜ ์ฆ‰์‹œ ๋‹ค์šด๋กœ๋“œํ•˜์—ฌ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ์™„์ „ ๊ณต๊ฐœ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. GPU ๋ฉ”๋ชจ๋ฆฌ ์ ˆ๊ฐ๊ณผ ์ƒ์„ฑ ์‹œ๊ฐ„ ๋‹จ์ถ•์— ๋„์›€์ด ๋˜์…จ๋‹ค๋ฉด Buy Me a Coffee (buymeacoffee.com/tripleyoung)์—์„œ ์ปคํ”ผ ํ•œ ์ž”์œผ๋กœ ์—ฐ๊ตฌ๋ฅผ ์‘์›ํ•ด ์ฃผ์„ธ์š”!

**yeowon/MiniMax-H3-Rung-Omega**๋Š” MiniMax-H3 FL2VA (First/Last-Frame-to-Video+Audio, ์ด 33.1B / ํ™œ์„ฑ 20.11B ํŒŒ๋ผ๋ฏธํ„ฐ) ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ Diffusion Transformer์˜ 50-Block ์ˆœ์ˆ˜ Rung ฮฉ ๊ท ํ˜• 3์ง„(4-Trit, Base-243 5-in-4-byte) ์–‘์žํ™” ๋ชจ๋ธ๊ณผ **TheoremFlow-ฮฉ ์ˆ˜ํ•™์  ํ•˜ํ•œ(Mathematical Floor) ์ถ”๋ก  ๊ฐ€์† ์—”์ง„(8.92๋ฐฐ ๊ฐ€์†)**์„ ํ•จ๊ป˜ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

  • ํด๋ฐฑ 0๊ฐœ (200 / 200 ์ „์ฒด ์„ ํ˜• ๋ ˆ์ด์–ด ์ˆœ์ˆ˜ TensorCoreRungOmegaTernaryLayout): 50๊ฐœ DiT ๋ธ”๋ก(blocks.0 .. blocks.49)์˜ ๋ชจ๋“  ์„ ํ˜• ํˆฌ์˜(attn.qkv_proj, attn.out_proj, mlp.fc1, mlp.fc2) 200๊ฐœ๊ฐ€ ๋‹จ ํ•˜๋‚˜์˜ NVFP4 ํด๋ฐฑ ์—†์ด ์ˆœ์ˆ˜ Rung ฮฉ 4-Trit ๊ท ํ˜• 3์ง„ ๊ฒฉ์ž([-40, +40], group_size=128 FP16 ์Šค์ผ€์ผ, convrot_groupsize=256)๋กœ ์–‘์žํ™”๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.
  • ๊ณต์‹ 1์œ„ ์ถ”์ฒœ int8_convrot (19.53 GiB)๋ณด๋‹ค ๋” ์ž‘๊ณ  ๋” ๋†’์€ ์ •ํ™•๋„ (14.98 GiB Joint-tANS / 16.22 GiB Raw): ์›๋ณธ BF16 Teacher(37.46 GiB) ๋Œ€๋น„ 2.50๋ฐฐ ์••์ถ•, ๊ณต์‹ ์ถ”์ฒœ 1์œ„ int8_convrot(19.53 GiB) ๋Œ€๋น„ **4.57 GiB ์ ˆ๊ฐ(1.30๋ฐฐ ์••์ถ•)**ํ•˜๋ฉด์„œ๋„ Video Spatial Top-1(+5.20%p) ๋ฐ Audio Patch Top-1(+4.17%p) ์ •ํ™•๋„์—์„œ int8_convrot๋ฅผ ๋Šฅ๊ฐ€ํ•ฉ๋‹ˆ๋‹ค.
  • TheoremFlow-ฮฉ (8.92๋ฐฐ ์ข…๋‹จ๊ฐ„ ์ƒ˜ํ”Œ๋ง ๊ฐ€์†): 20-step ๋น„๋””์˜ค(864ร—480, 124ํ”„๋ ˆ์ž„ @ 24fps) + ์Šคํ…Œ๋ ˆ์˜ค ์˜ค๋””์˜ค(32kHz) ๋™์‹œ ์ƒ์„ฑ ์‹œ๊ฐ„์„ **625.4์ดˆ โ†’ 70.11์ดˆ**๋กœ 8.92๋ฐฐ ๋‹จ์ถ•ํ•˜๋ฉฐ, **99.58% ๋น„๋””์˜ค ์ž ์žฌ ๊ณต๊ฐ„ ์ฝ”์‚ฌ์ธ ์œ ์‚ฌ๋„(20.80 dB SNR)**์™€ ๋‹ค๊ตญ์–ด(ํ•œ๊ตญ์–ดยท์˜์–ดยท์ค‘๊ตญ์–ดยท์ผ๋ณธ์–ด) ๋Œ€์‚ฌ ๋ฐ ๋ฆฝ์‹ฑํฌ๋ฅผ ์„ ๋ช…ํ•˜๊ฒŒ ๋ณด์กดํ•ฉ๋‹ˆ๋‹ค.

๐ŸŽฌ ๋ฐ๋ชจ ํ”„๋ฆฌ๋ทฐ (Rung ฮฉ 50-Block + TheoremFlow-ฮฉ๋กœ 70.11์ดˆ ๋งŒ์— ์ƒ์„ฑ)

Keyframes Preview

๐ŸŽฌ ์‹ค์ œ ์ƒ์„ฑ ์˜์ƒยท์˜ค๋””์˜ค ๋น„๊ต: ๊ณต์‹ int8_convrot (19.53 GiB, 434.1์ดˆ) vs ์šฐ๋ฆฌ ๋ชจ๋ธ Rung-Omega + TheoremFlow-Omega (14.96 GiB, 70.1์ดˆ โ€” ์†Œ๋ฆฌ๋ฅผ ์ผœ๊ณ  ๋“ค์–ด๋ณด์„ธ์š” ๐Ÿ”Š)


๐Ÿ“Š ๋ฒค์น˜๋งˆํฌ ๊ฒฐ๊ณผ ๋ฐ ์‹œ๊ฐํ™” ๊ทธ๋ž˜ํ”„

MiniMax-H3-Rung-Omega Benchmark Overview

1. ์ „์ฒด 50-Block ์ข…๋‹จ๊ฐ„ Velocity ์ •๋ฐ€๋„ ๋น„๊ต (vs. ๊ณต์‹ 1์œ„ int8_convrot)

๋ชจ๋ธ / ํฌ๋งท ํ™œ์„ฑ ์„ ํ˜• ๋ ˆ์ด์–ด ์œ ํšจ BPW ์ด ์šฉ๋Ÿ‰ (GiB) BF16 ๋Œ€๋น„ ์••์ถ•๋ฅ  Video Spatial Top-1 (โ†‘) Audio Patch Top-1 (โ†‘) Video Velocity Cosine (โ†‘) Audio Velocity Cosine (โ†‘) Video $R^2$ (โ†‘) Audio $R^2$ (โ†‘)
BF16 Teacher (minimax_h3_fl2va_pruned_bf16) 200 ร— BF16 16.000 37.46 GiB 1.00x 100.00% 100.00% 1.000000 1.000000 100.00% 100.00%
๊ณต์‹ #1 int8_convrot (19.53 GiB) 200 ร— INT8 8.003 19.53 GiB 1.92x 72.92% 77.60% 0.980832 0.985771 96.16% 97.10%
Rung ฮฉ 4-Trit Pareto Champion (Ours) 200 ร— 4-Trit Base-243 5.967 (6.40 raw) 14.96 GiB (16.22 GiB raw) 2.50x 78.12% (+5.20%p) 81.77% (+4.17%p) 0.976383 0.982006 95.28% 96.43%

2. ๋ฉ€ํ‹ฐ ํŠธ๋ž™ ํŒŒ๋ ˆํ†  ํ”„๋ก ํ‹ฐ์–ด (Rate-Distortion Pareto Ladder)

Rung ฮฉ Rate-Distortion Pareto Frontier

ํŠธ๋ž™ Trits / ์ฝ”๋“œ๋ถ BPW (Joint-tANS) ์ด ์šฉ๋Ÿ‰ (GiB) BF16 ๋Œ€๋น„ ์••์ถ•๋ฅ  Combined Top-1 (โ†‘) Combined SNR (dB) Video Cosine (โ†‘) Audio Cosine (โ†‘)
baseline_nvfp4_rtn NVFP4 4.500 11.67 GiB 3.21x 97.53% 33.61 dB 0.999810 0.999676
omega_base15_ultra 3-Trit ([-7..+7], 2 w/byte) 3.432 9.27 GiB 4.04x 99.48% 44.31 dB 0.999984 0.999968
omega_4trit_sub45 4-Trit ECSQ ([-40..+40]) 4.488 11.64 GiB 3.22x 99.48% 47.77 dB 0.999992 0.999990
omega_4trit_pareto (๋ฆด๋ฆฌ์ฆˆ ์ฒดํฌํฌ์ธํŠธ) 4-Trit Full-Range ([-40..+40]) 5.977 14.98 GiB (16.22 GiB raw) 2.50x 99.87% 50.62 dB 0.999995 0.999996
omega_5trit_supreme 5-Trit ([-121..+121]) 7.575 18.57 GiB 2.02x 99.48% 52.60 dB 0.999997 0.999998

3. TheoremFlow-ฮฉ ์ถ”๋ก  ๊ฐ€์† ๋ฒค์น˜๋งˆํฌ (864ร—480, 124ํ”„๋ ˆ์ž„ + ์Šคํ…Œ๋ ˆ์˜ค ์˜ค๋””์˜ค, 20 Steps)

์—”์ง„ / ์Šค์ผ€์ค„ ์ƒ˜ํ”Œ๋ง ์†Œ์š” ์‹œ๊ฐ„ (โ†“) ๊ฐ€์† ๋ฐฐ์œจ (โ†‘) Video Latent Cosine Video Latent SNR Audio Latent Cosine
๊ธฐ๋ณธ 20-Step ์ „์ฒด 50-Block ์ƒ˜ํ”Œ๋ง 625.40s 1.00x 1.000000 โˆž 1.000000
TheoremFlow-ฮฉ (6-Exact + 14-Fast, Floors 1โ€“5) 70.11s 8.92x 0.995812 20.80 dB 0.971400

๐Ÿš€ ๋น ๋ฅธ ์‹œ์ž‘ (Quickstart)

1. ComfyUI์— TensorCoreRungOmegaTernaryLayout ๋“ฑ๋ก

python3 src/register_comfyui_rung_omega.py

2. ์ฒดํฌํฌ์ธํŠธ ์—ฐ๊ฒฐ ๋ฐ TheoremFlow-ฮฉ (8.92x ๊ฐ€์†) ๋น„๋””์˜ค+์˜ค๋””์˜ค ์ƒ์„ฑ ์‹คํ–‰

python3 src/generate_minimax_h3_rung_omega_video.py \
  --unet-name minimax_h3_fl2va_pruned_rung_omega.safetensors \
  --first-frame /path/to/input_frame.png \
  --width 864 --height 480 --length 124 --steps 20 \
  --theoremflow \
  --output-mp4 output_theoremflow_omega.mp4

โ˜• ์—ฐ๊ตฌ ํ›„์› ๋ฐ ์›ํ•˜๋Š” ๋ชจ๋ธ ์–‘์žํ™” ์‹ ์ฒญ (Buy Me a Coffee & Community)

์›ํ•˜์‹œ๋Š” ๋‹ค๋ฅธ ๋ชจ๋ธ(๋น„๋””์˜ค/์˜ค๋””์˜ค DiT, ๋Œ€ํ˜• LLM, ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ๋ชจ๋ธ ๋“ฑ)์„ Rung ฮฉ (3-Trit / 4-Trit / 5-Trit Base-243) ์–‘์žํ™” ๋ฐ TheoremFlow-ฮฉ ์ถ”๋ก  ๊ฐ€์†๊ธฐ๋กœ ๋ณ€ํ™˜ํ•ด ๋“œ๋ฆฝ๋‹ˆ๋‹ค!

  1. โšก ํ›„์›์ž ์ตœ์šฐ์„  ์ž‘์—… ํ (Priority Queue): Buy Me a Coffee (buymeacoffee.com/tripleyoung) ํ›„์› ๋ฉ”์‹œ์ง€์— ์›ํ•˜์‹œ๋Š” ๋ชจ๋ธ ์ด๋ฆ„(Hugging Face ID)์„ ๋‚จ๊ฒจ์ฃผ์‹œ๋ฉด ์ตœ์šฐ์„  ์ˆœ์œ„๋กœ ์–‘์žํ™” ๋ฐ ๊ฐ€์†๊ธฐ๋ฅผ ์ œ์ž‘ํ•ด ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.
  2. ๐Ÿ’ฌ ์†Œํ†ต ๋ฐ ๋ชจ๋ธ ์š”์ฒญ ์ฑ„๋„ (Community Discussions): Hugging Face Community ๊ฒŒ์‹œํŒ (Discussions)์—์„œ ์–ธ์ œ๋“  ์ž์œ ๋กญ๊ฒŒ ๋ชจ๋ธ์„ ์š”์ฒญํ•˜์‹œ๊ฑฐ๋‚˜ ์งˆ๋ฌธยท๋Œ€ํ™”ํ•˜์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Buy Me A Coffee

  • โ˜• ํ•ด์™ธ/๊ธ€๋กœ๋ฒŒ ์นด๋“œ ํ›„์› (Buy Me a Coffee & ์ตœ์šฐ์„  ์–‘์žํ™” ์š”์ฒญ): https://buymeacoffee.com/tripleyoung
  • ๐Ÿ’› ์นด์นด์˜คํŽ˜์ด QR ์†ก๊ธˆ ํ›„์› (๋ชจ๋ฐ”์ผ ์Šค์บ” / ๋งํฌ ์†ก๊ธˆ): https://qr.kakaopay.com/FVgCIrWbX
  • ๐Ÿฆ ๊ตญ๋‚ด ๊ณ„์ขŒ์ด์ฒด ํ›„์›: NH๋†ํ˜‘(๋†์ถ•ํ˜‘) 352-1556-0640-33 (์˜ˆ๊ธˆ์ฃผ: ์œค์—ฌ์›)
  • ๐Ÿ’ฌ ์ปค๋ฎค๋‹ˆํ‹ฐ ์†Œํ†ต & ๋ชจ๋ธ ์š”์ฒญ ๊ฒŒ์‹œํŒ: https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/discussions

KakaoPay QR Transfer (์œค์—ฌ์›)