File size: 11,179 Bytes
a35bf1c b9a1a47 a35bf1c b9db29f a35bf1c cc5631d a35bf1c b9a1a47 b9db29f 638e39c b9db29f 638e39c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 | # ๐ฐ๐ท MiniMax-H3-Rung-Omega (`5.976 BPW`, `14.98 GiB` Joint-tANS / `16.22 GiB` Raw Base-243) + TheoremFlow-ฮฉ (`8.92x` ์ถ๋ก ๊ฐ์๊ธฐ)
<p align="left">
<strong>๐ Language / ์ธ์ด / ่ฏญ่จ / ่จ่ช:</strong>
<a href="./README.md"><strong>๐บ๐ธ English</strong></a> |
<a href="./README_ko.md"><strong>๐ฐ๐ท ํ๊ตญ์ด</strong></a> |
<a href="./README_zh.md"><strong>๐จ๐ณ ไธญๆ (็ฎไฝ)</strong></a> |
<a href="./README_ja.md"><strong>๐ฏ๐ต ๆฅๆฌ่ช</strong></a>
</p>
<div align="center">
<p>
<a href="https://buymeacoffee.com/tripleyoung" target="_blank">
<img src="https://img.shields.io/badge/Buy%20Me%20a%20Coffee-Priority%20Model%20Queue%20%E2%9A%A1-FFDD00?style=for-the-badge&logo=buy-me-a-coffee&logoColor=black" alt="Buy Me A Coffee" />
</a>
<a href="https://qr.kakaopay.com/FVgCIrWbX" target="_blank">
<img src="https://img.shields.io/badge/KakaoPay%20QR-%EC%B9%B4%EC%B9%B4%EC%98%A4%ED%8E%98%EC%9D%B4%20%EC%86%A1%EA%B8%88-FEE500?style=for-the-badge&logo=kakaotalk&logoColor=black" alt="KakaoPay QR" />
</a>
<img src="https://img.shields.io/badge/NH%EB%86%8D%ED%98%91(%EB%86%8D%EC%B6%95%ED%98%91)-352--1556--0640--33%20(%EC%9C%A4%EC%97%AC%EC%9B%90)-0072BC?style=for-the-badge" alt="NH๋ํ 352-1556-0640-33 (์ค์ฌ์)" />
<a href="https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/discussions" target="_blank">
<img src="https://img.shields.io/badge/HF%20Community-Request%20Models%20%F0%9F%92%AC-38BDF8?style=for-the-badge" alt="Community Discussions" />
</a>
</p>
<p>
<a href="https://qr.kakaopay.com/FVgCIrWbX" target="_blank">
<img src="https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/resolve/main/assets/kakaopay_qr.jpg" width="160" alt="KakaoPay QR Transfer (์ค์ฌ์)" style="border-radius: 12px; border: 1px solid #e5e7eb;" />
</a>
</p>
<p>
๐ฆ <b>๊ตญ๋ด ๊ณ์ข์ด์ฒด ํ์ (Korean Bank Transfer):</b> <code>NH๋ํ(๋์ถํ) 352-1556-0640-33 (์๊ธ์ฃผ: ์ค์ฌ์)</code> |
๐ <a href="https://qr.kakaopay.com/FVgCIrWbX" target="_blank"><b>์นด์นด์คํ์ด QR ์ก๊ธ</b></a> |
โ <a href="https://buymeacoffee.com/tripleyoung" target="_blank"><b>Buy Me a Coffee</b></a>
</p>
</div>
> โ **์คํ์์ค ์์ํ & ์ถ๋ก ๊ฐ์ ์ฐ๊ตฌ ํ์ํ๊ธฐ**: **`MiniMax-H3-Rung-Omega`** ์ฒดํฌํฌ์ธํธ์ **`TheoremFlow-ฮฉ`** ์ถ๋ก ์์ง์ ๋ณ๋์ ์น์ธ ์ ์ฐจ ์์ด ๋๊ตฌ๋ ์ฆ์ ๋ค์ด๋ก๋ํ์ฌ ์ฌ์ฉํ ์ ์๋๋ก ์์ ๊ณต๊ฐ๋์ด ์์ต๋๋ค. GPU ๋ฉ๋ชจ๋ฆฌ ์ ๊ฐ๊ณผ ์์ฑ ์๊ฐ ๋จ์ถ์ ๋์์ด ๋์
จ๋ค๋ฉด [**Buy Me a Coffee (`buymeacoffee.com/tripleyoung`)**](https://buymeacoffee.com/tripleyoung)์์ ์ปคํผ ํ ์์ผ๋ก ์ฐ๊ตฌ๋ฅผ ์์ํด ์ฃผ์ธ์!
**`yeowon/MiniMax-H3-Rung-Omega`**๋ **MiniMax-H3 FL2VA (First/Last-Frame-to-Video+Audio, ์ด 33.1B / ํ์ฑ 20.11B ํ๋ผ๋ฏธํฐ)** ๋ฉํฐ๋ชจ๋ฌ Diffusion Transformer์ **50-Block ์์ `Rung ฮฉ` ๊ท ํ 3์ง(`4-Trit`, Base-243 5-in-4-byte) ์์ํ ๋ชจ๋ธ**๊ณผ **`TheoremFlow-ฮฉ` ์ํ์ ํํ(Mathematical Floor) ์ถ๋ก ๊ฐ์ ์์ง(`8.92๋ฐฐ` ๊ฐ์)**์ ํจ๊ป ์ ๊ณตํฉ๋๋ค.
* **ํด๋ฐฑ 0๊ฐ (`200 / 200` ์ ์ฒด ์ ํ ๋ ์ด์ด ์์ `TensorCoreRungOmegaTernaryLayout`)**: 50๊ฐ DiT ๋ธ๋ก(`blocks.0` .. `blocks.49`)์ ๋ชจ๋ ์ ํ ํฌ์(`attn.qkv_proj`, `attn.out_proj`, `mlp.fc1`, `mlp.fc2`) 200๊ฐ๊ฐ ๋จ ํ๋์ NVFP4 ํด๋ฐฑ ์์ด ์์ `Rung ฮฉ` 4-Trit ๊ท ํ 3์ง ๊ฒฉ์(`[-40, +40]`, `group_size=128` FP16 ์ค์ผ์ผ, `convrot_groupsize=256`)๋ก ์์ํ๋์ด ์์ต๋๋ค.
* **๊ณต์ 1์ ์ถ์ฒ `int8_convrot` (`19.53 GiB`)๋ณด๋ค ๋ ์๊ณ ๋ ๋์ ์ ํ๋ (`14.98 GiB` Joint-tANS / `16.22 GiB` Raw)**: ์๋ณธ `BF16` Teacher(`37.46 GiB`) ๋๋น **`2.50๋ฐฐ` ์์ถ**, ๊ณต์ ์ถ์ฒ 1์ `int8_convrot`(`19.53 GiB`) ๋๋น **`4.57 GiB` ์ ๊ฐ(`1.30๋ฐฐ` ์์ถ)**ํ๋ฉด์๋ **Video Spatial Top-1(`+5.20%p`)** ๋ฐ **Audio Patch Top-1(`+4.17%p`)** ์ ํ๋์์ `int8_convrot`๋ฅผ ๋ฅ๊ฐํฉ๋๋ค.
* **`TheoremFlow-ฮฉ` (`8.92๋ฐฐ` ์ข
๋จ๊ฐ ์ํ๋ง ๊ฐ์)**: 20-step ๋น๋์ค(`864ร480`, `124`ํ๋ ์ @ 24fps) + ์คํ
๋ ์ค ์ค๋์ค(`32kHz`) ๋์ ์์ฑ ์๊ฐ์ **`625.4์ด` โ `70.11์ด`**๋ก **`8.92๋ฐฐ` ๋จ์ถ**ํ๋ฉฐ, **`99.58%` ๋น๋์ค ์ ์ฌ ๊ณต๊ฐ ์ฝ์ฌ์ธ ์ ์ฌ๋(`20.80 dB` SNR)**์ ๋ค๊ตญ์ด(ํ๊ตญ์ดยท์์ดยท์ค๊ตญ์ดยท์ผ๋ณธ์ด) ๋์ฌ ๋ฐ ๋ฆฝ์ฑํฌ๋ฅผ ์ ๋ช
ํ๊ฒ ๋ณด์กดํฉ๋๋ค.
---
## ๐ฌ ๋ฐ๋ชจ ํ๋ฆฌ๋ทฐ (`Rung ฮฉ` 50-Block + `TheoremFlow-ฮฉ`๋ก `70.11์ด` ๋ง์ ์์ฑ)

### ๐ฌ ์ค์ ์์ฑ ์์ยท์ค๋์ค ๋น๊ต: ๊ณต์ int8_convrot (19.53 GiB, 434.1์ด) vs ์ฐ๋ฆฌ ๋ชจ๋ธ Rung-Omega + TheoremFlow-Omega (14.96 GiB, 70.1์ด โ ์๋ฆฌ๋ฅผ ์ผ๊ณ ๋ค์ด๋ณด์ธ์ ๐)
<p align="center">
<video controls autoplay loop muted playsinline width="100%" src="https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/resolve/main/assets/minimax_h3_viral_16x9.mp4"></video>
</p>
* **์ ์ฒด ๋น๋์ค + ํ๊ตญ์ด ๋์ฌ ์ฑํฌ ์์ฑ๋ณธ (`.mp4`)**: [`assets/MiniMax_H3_TheoremFlow_Omega_Champion.mp4`](./assets/MiniMax_H3_TheoremFlow_Omega_Champion.mp4)
* **์์ 50-Block 20-Step ๊ธฐ์ค ๋น๋์ค (`.mp4`)**: [`assets/MiniMax_H3_Rung_Omega_50blk_Champion.mp4`](./assets/MiniMax_H3_Rung_Omega_50blk_Champion.mp4)
* **์ถ์ถ๋ 32kHz ์คํ
๋ ์ค ์ค๋์ค ํธ๋ (`.wav`)**: [`assets/MiniMax_H3_TheoremFlow_Omega_Champion_audio.wav`](./assets/MiniMax_H3_TheoremFlow_Omega_Champion_audio.wav)
---
## ๐ ๋ฒค์น๋งํฌ ๊ฒฐ๊ณผ ๋ฐ ์๊ฐํ ๊ทธ๋ํ

### 1. ์ ์ฒด 50-Block ์ข
๋จ๊ฐ Velocity ์ ๋ฐ๋ ๋น๊ต (vs. ๊ณต์ 1์ `int8_convrot`)
| ๋ชจ๋ธ / ํฌ๋งท | ํ์ฑ ์ ํ ๋ ์ด์ด | ์ ํจ BPW | ์ด ์ฉ๋ (GiB) | BF16 ๋๋น ์์ถ๋ฅ | Video Spatial Top-1 (โ) | Audio Patch Top-1 (โ) | Video Velocity Cosine (โ) | Audio Velocity Cosine (โ) | Video $R^2$ (โ) | Audio $R^2$ (โ) |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| **BF16 Teacher (`minimax_h3_fl2va_pruned_bf16`)** | 200 ร BF16 | `16.000` | `37.46 GiB` | `1.00x` | `100.00%` | `100.00%` | `1.000000` | `1.000000` | `100.00%` | `100.00%` |
| **๊ณต์ `#1` `int8_convrot` (`19.53 GiB`)** | 200 ร INT8 | `8.003` | `19.53 GiB` | `1.92x` | `72.92%` | `77.60%` | `0.980832` | `0.985771` | `96.16%` | `97.10%` |
| **`Rung ฮฉ` 4-Trit Pareto Champion (Ours)** | **200 ร 4-Trit Base-243** | **`5.967` (`6.40` raw)** | **`14.96 GiB` (`16.22 GiB` raw)** | **`2.50x`** | **`78.12%` (`+5.20%p`)** | **`81.77%` (`+4.17%p`)** | **`0.976383`** | **`0.982006`** | **`95.28%`** | **`96.43%`** |
### 2. ๋ฉํฐ ํธ๋ ํ๋ ํ ํ๋ก ํฐ์ด (Rate-Distortion Pareto Ladder)

| ํธ๋ | Trits / ์ฝ๋๋ถ | BPW (Joint-tANS) | ์ด ์ฉ๋ (GiB) | BF16 ๋๋น ์์ถ๋ฅ | Combined Top-1 (โ) | Combined SNR (dB) | Video Cosine (โ) | Audio Cosine (โ) |
| :--- | :---: | :---: | :---: | :---: | :---: | :---: | :---: | :---: |
| `baseline_nvfp4_rtn` | NVFP4 | `4.500` | `11.67 GiB` | `3.21x` | `97.53%` | `33.61 dB` | `0.999810` | `0.999676` |
| **`omega_base15_ultra`** | 3-Trit (`[-7..+7]`, 2 w/byte) | **`3.432`** | **`9.27 GiB`** | **`4.04x`** | **`99.48%`** | **`44.31 dB`** | **`0.999984`** | **`0.999968`** |
| **`omega_4trit_sub45`** | 4-Trit ECSQ (`[-40..+40]`) | **`4.488`** | **`11.64 GiB`** | **`3.22x`** | **`99.48%`** | **`47.77 dB`** | **`0.999992`** | **`0.999990`** |
| **`omega_4trit_pareto` (๋ฆด๋ฆฌ์ฆ ์ฒดํฌํฌ์ธํธ)** | 4-Trit Full-Range (`[-40..+40]`) | **`5.977`** | **`14.98 GiB` (`16.22 GiB` raw)** | **`2.50x`** | **`99.87%`** | **`50.62 dB`** | **`0.999995`** | **`0.999996`** |
| **`omega_5trit_supreme`** | 5-Trit (`[-121..+121]`) | **`7.575`** | **`18.57 GiB`** | **`2.02x`** | **`99.48%`** | **`52.60 dB`** | **`0.999997`** | **`0.999998`** |
### 3. `TheoremFlow-ฮฉ` ์ถ๋ก ๊ฐ์ ๋ฒค์น๋งํฌ (`864ร480`, `124`ํ๋ ์ + ์คํ
๋ ์ค ์ค๋์ค, 20 Steps)
| ์์ง / ์ค์ผ์ค | ์ํ๋ง ์์ ์๊ฐ (โ) | ๊ฐ์ ๋ฐฐ์จ (โ) | Video Latent Cosine | Video Latent SNR | Audio Latent Cosine |
| :--- | :---: | :---: | :---: | :---: | :---: |
| ๊ธฐ๋ณธ 20-Step ์ ์ฒด 50-Block ์ํ๋ง | `625.40s` | `1.00x` | `1.000000` | `โ` | `1.000000` |
| **`TheoremFlow-ฮฉ` (`6-Exact + 14-Fast`, Floors 1โ5)** | **`70.11s`** | **`8.92x`** | **`0.995812`** | **`20.80 dB`** | **`0.971400`** |
---
## ๐ ๋น ๋ฅธ ์์ (Quickstart)
### 1. ComfyUI์ `TensorCoreRungOmegaTernaryLayout` ๋ฑ๋ก
```bash
python3 src/register_comfyui_rung_omega.py
```
### 2. ์ฒดํฌํฌ์ธํธ ์ฐ๊ฒฐ ๋ฐ `TheoremFlow-ฮฉ` (`8.92x` ๊ฐ์) ๋น๋์ค+์ค๋์ค ์์ฑ ์คํ
```bash
python3 src/generate_minimax_h3_rung_omega_video.py \
--unet-name minimax_h3_fl2va_pruned_rung_omega.safetensors \
--first-frame /path/to/input_frame.png \
--width 864 --height 480 --length 124 --steps 20 \
--theoremflow \
--output-mp4 output_theoremflow_omega.mp4
```
---
## โ ์ฐ๊ตฌ ํ์ ๋ฐ ์ํ๋ ๋ชจ๋ธ ์์ํ ์ ์ฒญ (Buy Me a Coffee & Community)
์ํ์๋ ๋ค๋ฅธ ๋ชจ๋ธ(๋น๋์ค/์ค๋์ค DiT, ๋ํ LLM, ๋ฉํฐ๋ชจ๋ฌ ๋ชจ๋ธ ๋ฑ)์ **`Rung ฮฉ` (`3-Trit` / `4-Trit` / `5-Trit` Base-243)** ์์ํ ๋ฐ **`TheoremFlow-ฮฉ` ์ถ๋ก ๊ฐ์๊ธฐ**๋ก ๋ณํํด ๋๋ฆฝ๋๋ค!
1. **โก ํ์์ ์ต์ฐ์ ์์
ํ (Priority Queue)**: [**Buy Me a Coffee (`buymeacoffee.com/tripleyoung`)**](https://buymeacoffee.com/tripleyoung) ํ์ ๋ฉ์์ง์ ์ํ์๋ ๋ชจ๋ธ ์ด๋ฆ(Hugging Face ID)์ ๋จ๊ฒจ์ฃผ์๋ฉด ์ต์ฐ์ ์์๋ก ์์ํ ๋ฐ ๊ฐ์๊ธฐ๋ฅผ ์ ์ํด ๊ณต๊ฐํฉ๋๋ค.
2. **๐ฌ ์ํต ๋ฐ ๋ชจ๋ธ ์์ฒญ ์ฑ๋ (Community Discussions)**: [**Hugging Face Community ๊ฒ์ํ (`Discussions`)**](https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/discussions)์์ ์ธ์ ๋ ์์ ๋กญ๊ฒ ๋ชจ๋ธ์ ์์ฒญํ์๊ฑฐ๋ ์ง๋ฌธยท๋ํํ์ค ์ ์์ต๋๋ค.
<p align="left">
<a href="https://buymeacoffee.com/tripleyoung" target="_blank">
<img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" height="50" />
</a>
</p>
* **โ ํด์ธ/๊ธ๋ก๋ฒ ์นด๋ ํ์ (Buy Me a Coffee & ์ต์ฐ์ ์์ํ ์์ฒญ)**: [https://buymeacoffee.com/tripleyoung](https://buymeacoffee.com/tripleyoung)
* **๐ ์นด์นด์คํ์ด QR ์ก๊ธ ํ์ (๋ชจ๋ฐ์ผ ์ค์บ / ๋งํฌ ์ก๊ธ)**: [https://qr.kakaopay.com/FVgCIrWbX](https://qr.kakaopay.com/FVgCIrWbX)
* **๐ฆ ๊ตญ๋ด ๊ณ์ข์ด์ฒด ํ์**: `NH๋ํ(๋์ถํ) 352-1556-0640-33 (์๊ธ์ฃผ: ์ค์ฌ์)`
* **๐ฌ ์ปค๋ฎค๋ํฐ ์ํต & ๋ชจ๋ธ ์์ฒญ ๊ฒ์ํ**: [https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/discussions](https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/discussions)
<p align="center">
<a href="https://qr.kakaopay.com/FVgCIrWbX" target="_blank">
<img src="https://huggingface.co/yeowon/MiniMax-H3-Rung-Omega/resolve/main/assets/kakaopay_qr.jpg" width="160" alt="KakaoPay QR Transfer (์ค์ฌ์)" style="border-radius: 12px; border: 1px solid #e5e7eb;" />
</a>
</p>
|