stuntd sits in front of your LLM, learns its typed decisions and answers the confident ones locally with a small head on the Laya encoder by @convaiinnovations. About 20ms on GPU and 60ms on CPU, and anything it isn't sure about still goes to the big model.
New in 0.1.2: - decisions with several fields, like category + urgency + needs_human in one call, answered locally only when every field is sure - the Anthropic Messages API learns too, not only OpenAI - auto_retrain: the daemon retrains a site in the background once enough new traffic comes in, so collect, train, shadow and live run on their own - serve --lazy loads the checkpoint on the first request
stuntd sits in front of your LLM, learns its typed decisions and answers the confident ones locally with a small head on the Laya encoder by @convaiinnovations. About 20ms on GPU and 60ms on CPU, and anything it isn't sure about still goes to the big model.
New in 0.1.2: - decisions with several fields, like category + urgency + needs_human in one call, answered locally only when every field is sure - the Anthropic Messages API learns too, not only OpenAI - auto_retrain: the daemon retrains a site in the background once enough new traffic comes in, so collect, train, shadow and live run on their own - serve --lazy loads the checkpoint on the first request
For each question it shows the same answer twice: zero-shot Laya, and a small head trained on the frozen Laya encoder. You get the option probabilities, the confidence threshold and the latency. When the head isn't sure, it hands the question back to the teacher instead of guessing.
On jevbench, same machine, n=500: agnews 86.0 β 92.6, banking77 38.2 β 69.6. Everything runs locally; heads train in 4-20 minutes on a laptop GPU.
Shipped StudioMI300 for the AMD x lablab hackathon. One English sentence becomes a 30-second cinematic reel, end-to-end on a single AMD Instinct MI300X.
Every model in the pipeline is Apache 2.0 or MIT.
π¬ Director Agent β Qwen3.5-35B-A3B via vLLM with AITER MoE acceleration. Plans 6 shots, character bibles, music brief, per-shot voice-over.
π¨ Character keyframes β FLUX.2 klein 4B reference editing. No LoRA training step. Identity stays consistent across shots by construction.
ποΈ Animation β Wan2.2-I2V-A14B with ParaAttention FBCache (lossless 2x) and selective torch.compile on transformer_2 (another 1.2x). End-to-end Wan2.2 inference went from 25.9 min to 10.4 min per 720p clip.
π Vision Critic β same Qwen3.5 checkpoint reloaded with a 10-label failure taxonomy (character drift, extras invade frame, camera ignored, walking backwards, hand artifact, wardrobe drift, neon glow leak, stylized AI look, random intimacy, object morphing). Bad clips auto-retry with targeted strategies. Up to 3 attempts.
π΅ Music β ACE-Step v1 generates 30s instrumental from Director's brief.
π£οΈ Narration β Kokoro-82M, 9 languages. Director picks language to match setting. Tokyo to Japanese, Paris to French, Mumbai to Hindi.
The 192 GB HBM3 on MI300X is what lets four very different model architectures share one card sequentially. On a 24 GB consumer GPU this stack needs 4-5 separate machines wired together.
Special thanks to the FLUX, Wan2.2, ACE-Step and Kokoro teams for keeping serious generative AI open. The pipeline composes their work into something none of them alone can produce β a complete cinematic artifact from a single prompt.
Shipped StudioMI300 for the AMD x lablab hackathon. One English sentence becomes a 30-second cinematic reel, end-to-end on a single AMD Instinct MI300X.
Every model in the pipeline is Apache 2.0 or MIT.
π¬ Director Agent β Qwen3.5-35B-A3B via vLLM with AITER MoE acceleration. Plans 6 shots, character bibles, music brief, per-shot voice-over.
π¨ Character keyframes β FLUX.2 klein 4B reference editing. No LoRA training step. Identity stays consistent across shots by construction.
ποΈ Animation β Wan2.2-I2V-A14B with ParaAttention FBCache (lossless 2x) and selective torch.compile on transformer_2 (another 1.2x). End-to-end Wan2.2 inference went from 25.9 min to 10.4 min per 720p clip.
π Vision Critic β same Qwen3.5 checkpoint reloaded with a 10-label failure taxonomy (character drift, extras invade frame, camera ignored, walking backwards, hand artifact, wardrobe drift, neon glow leak, stylized AI look, random intimacy, object morphing). Bad clips auto-retry with targeted strategies. Up to 3 attempts.
π΅ Music β ACE-Step v1 generates 30s instrumental from Director's brief.
π£οΈ Narration β Kokoro-82M, 9 languages. Director picks language to match setting. Tokyo to Japanese, Paris to French, Mumbai to Hindi.
The 192 GB HBM3 on MI300X is what lets four very different model architectures share one card sequentially. On a 24 GB consumer GPU this stack needs 4-5 separate machines wired together.
Special thanks to the FLUX, Wan2.2, ACE-Step and Kokoro teams for keeping serious generative AI open. The pipeline composes their work into something none of them alone can produce β a complete cinematic artifact from a single prompt.