Spaces:
Running on Zero
Running on Zero
Commit History
2 days ago
-
Tile-64 attention and a persistent kernel cache
Verified signatureSwitch the fine sparse attention from the rtx-4090 profile's bf16 tile-128 emulator to FastVideo's Triton tile-64 block-sparse kernel (~1.3x per DiT step). Its autotune is keyed on sequence length, so every new canvas, length or reference mix re-benchmarked 12 configs (10-45 s on the first step); num_stages=5/num_warps=4 won at every measured length, so pin it. Point every JIT cache (flashinfer, Triton, inductor, CUDA, torch NVRTC) at /tmp/fasth3-kernels and restore a prebuilt archive from multimodalart/fasth3-omni-kernel-cache at startup, keyed on the torch/triton/flashinfer/fastvideo/fastvideo-kernel versions. ninja's deps log keeps nanosecond mtimes the archive can't, so restored flashinfer modules looked stale; skip the build when the module's .so exists. The first call after a boot no longer spends ~170 s compiling. GPU duration estimate follows the new timings and charges extra images and videos.798a242
3 days ago
-
FastH3-Omni: Gradio 6 reference composer UI (#1)
- UI from multimodalart/FastH3-Omni: ordered image/audio/video references, upsample, FastVideo colors (e4d7fcb9045865d78f197f136a45a61de58a4884) - Gradio 6 composer: tagged references, H3 builder + free-write, upsample; rename to FastH3-Omni (c91c3f56e47c29835c7e582568c5306dceb79ff5)099efca -
FP8 OmniRef variant for ZeroGPU benchmark
Verified signatureb8f2c17 -
initial commit
Verified signatureb4e4214
