stale2000 commited on
Commit
02b3581
·
verified ·
1 Parent(s): 558a0c1

Show entropy mask and matched output frames on model page

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -93,6 +93,44 @@ The mask sheets show all seven latent-time layouts for each prompt. Each sheet c
93
  | Control | [MP4](examples/control/p3_dense_lora.mp4) | [MP4](examples/control/p3_detail50_warmup.mp4) | [MP4](examples/control/p3_uniform50_1x2.mp4) |
94
  | Preserve | [MP4](examples/preserve/p3_dense_lora.mp4) | [MP4](examples/preserve/p3_detail50_warmup.mp4) | [MP4](examples/preserve/p3_uniform50_1x2.mp4) |
95
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96
  ## Attribution
97
 
98
  Base model: [MiniMaxAI/MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3), under the included H3 Community License and NOTICE. Training data and captions: OpenVid-1M / OpenVidHD, NJU-PCALab, CC BY 4.0.
 
93
  | Control | [MP4](examples/control/p3_dense_lora.mp4) | [MP4](examples/control/p3_detail50_warmup.mp4) | [MP4](examples/control/p3_uniform50_1x2.mp4) |
94
  | Preserve | [MP4](examples/preserve/p3_dense_lora.mp4) | [MP4](examples/preserve/p3_detail50_warmup.mp4) | [MP4](examples/preserve/p3_uniform50_1x2.mp4) |
95
 
96
+ ## 🟨 ENTROPY selector screen — validation only
97
+
98
+ Entropy was among the stronger sparse candidates in the initial layout screen: at step 0, entropy50's mean teacher gap was 0.429, compared with 0.416 for detail50 and 0.565 for uniform2 (lower is better). Detail50 was slightly better on that metric. This separate inference test compares matched 50% token-budget entropy placement with a root-shuffled entropy control at warm-up σ=0.9 and 30 steps. It uses four validation prompts only; it did not receive an untouched confirmation set and is not a promoted result.
99
+
100
+ Each sheet highlights **ENTROPY** and places its tile pattern next to the uniform and shuffled controls and a frame from the corresponding entropy video. The seven rows show the seven latent-time layouts.
101
+
102
+ ### Prompt p0
103
+
104
+ > The video features a young man posing confidently in front of a white background. He is shirtless, revealing a well-defined muscular physique, and has a tattoo on his left arm. He is wearing black shorts with white stripes on the sides. His smile is bright and he appears to be in a good mood. The video is likely a fitness or bodybuilding-related advertisement or promotional material. The style of the video is straightforward and focused on the man's physique, with no additional elements or distractions in the background.
105
+
106
+ ![ENTROPY p0 tile map and output frames](examples/entropy-selector/masks/p0.png)
107
+
108
+ - [ENTROPY video](examples/entropy-selector/p0_entropy_inference.mp4) · [shuffled-ENTROPY control](examples/entropy-selector/p0_entropy_inference_shuffle.mp4)
109
+
110
+ ### Prompt p1
111
+
112
+ > The video features a person dressed in a vibrant costume, which includes a yellow top with orange sleeves and a pink wig with a bow on top. The individual is standing against a blue background, and their pose changes slightly between the frames. The style of the video is playful and colorful, with a focus on the costume and the person's expressive facial expressions. The overall mood of the video is cheerful and lighthearted.
113
+
114
+ ![ENTROPY p1 tile map and output frames](examples/entropy-selector/masks/p1.png)
115
+
116
+ - [ENTROPY video](examples/entropy-selector/p1_entropy_inference.mp4) · [shuffled-ENTROPY control](examples/entropy-selector/p1_entropy_inference_shuffle.mp4)
117
+
118
+ ### Prompt p2
119
+
120
+ > The video features a man in a white lab coat and glasses, standing against a gray background. He appears to be a scientist or doctor, given his attire. The man is looking directly at the camera, suggesting that he is addressing the viewer. The lighting in the video is soft and even, highlighting the man's features without creating harsh shadows. The overall style of the video is professional and straightforward, with no additional elements or distractions. The focus is solely on the man and his message.
121
+
122
+ ![ENTROPY p2 tile map and output frames](examples/entropy-selector/masks/p2.png)
123
+
124
+ - [ENTROPY video](examples/entropy-selector/p2_entropy_inference.mp4) · [shuffled-ENTROPY control](examples/entropy-selector/p2_entropy_inference_shuffle.mp4)
125
+
126
+ ### Prompt p3
127
+
128
+ > The video features a young boy with glasses, wearing a gray t-shirt. He is seated in a classroom setting, with a whiteboard and a bulletin board visible in the background. The boy appears to be engaged in a conversation or listening attentively. The style of the video is candid and informal, capturing a moment in the boy's daily life. The focus is on the boy, with the background elements providing context to the setting. The lighting is natural, suggesting an indoor environment with ample light. The video does not contain any text or additional graphics.
129
+
130
+ ![ENTROPY p3 tile map and output frames](examples/entropy-selector/masks/p3.png)
131
+
132
+ - [ENTROPY video](examples/entropy-selector/p3_entropy_inference.mp4) · [shuffled-ENTROPY control](examples/entropy-selector/p3_entropy_inference_shuffle.mp4)
133
+
134
  ## Attribution
135
 
136
  Base model: [MiniMaxAI/MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3), under the included H3 Community License and NOTICE. Training data and captions: OpenVid-1M / OpenVidHD, NJU-PCALab, CC BY 4.0.