Users share examples with settings and prompts

#6
by tlennon-ie - opened

I made this thread so others can share examples of videos and prompts and settings that work for them so we can try figure out the best way to prompt it and tweak settings for good results.

I'm using the default workflow for ComfyUI and modified resolution down to 1024x720 as I OOM when running it at 1280 with my 5090

Specs:

RTX 5090

128GB DDR5 RAM

ComfyUI Latest version

LightX nodes latest version

Models:

https://huggingface.co/Lightricks/LTX-2/blob/main/ltx-2-19b-dev-fp4.safetensors

https://huggingface.co/Comfy-Org/ltx-2/blob/main/split_files/text_encoders/gemma_3_12B_it.safetensors

Gen times:
Roughly between 85 and 95 seconds for each 121 frame generation. Going from 2.4 to 4.4 s/it

Tried with and without some of the lightx loras but struggling to get anything close to what I get with Wan 2.2 or even HY1.5

A close-up of a cheerful boy puppet with curly auburn yarn hair and wide button eyes, holding a small red umbrella above his head. Rain falls gently around him. he looks upward and begins to sing with joy in English with an Irish accent: "it's pissing rain, I love it when its pissing raining." His fabric mouth opening and closing to a melodic tune. His hands grip the umbrella handle as he sways slightly from side to side in rhythm. The camera holds steady as the rain sparkles against the soft lighting. His eyes blink occasionally as she sings.

A smartphone video of a blonde man standing in a vintage-style workshop. He is hammering wood planks with a nail and hammer. The sound of the hammer hitting the nail into the wood is a strong thud. There is slight country blues music playing in the background softly from an antique gramaphone on the shelf. he is wearing a lumberjack outfit. The room is almost antique with the amazing wooden structure and architectural design of a woodworker. . Strong natural sunlight is hitting him from the side, creating realistic highlights on his skin and hair. High resolution, authentic skin texture, soft focus background.

A smartphone video of a blonde man standing in a vintage-style workshop. He is hammering wood planks with a nail and hammer. The sound of the hammer hitting the nail into the wood is a strong thud. There is slight country blues music playing in the background softly from an antique gramaphone on the shelf. he is wearing a lumberjack outfit. The room is almost antique with the amazing wooden structure and architectural design of a woodworker. . Strong natural sunlight is hitting him from the side, creating realistic highlights on his skin and hair. High resolution, authentic skin texture, soft focus background. The camera motion is a dolly panning shot from left to right, as we move from behind the man to in front of him.

Create a high-resolution, photorealistic video in the style of French choreographer and artist Yoann Bourgeois. The scene should be minimalist and theatrical, featuring a solitary, stark white staircase against a dark, undefined background. A woman, dressed in simple, dark, loose-fitting clothing, is the central figure. The video should depict a seamless, infinite loop of the following sequence: the woman gracefully ascends the stairs with a determined yet weary posture. Partway up, she missteps and falls backward, her body in a controlled, almost balletic descent. She lands silently on a hidden trampoline, which propels her back up in a fluid, acrobatic arc without distorting her human figure,. she lands softly on a lower step of the staircase and immediately resumes her ascent. The lighting should be dramatic and focused, casting long shadows and highlighting the woman's form and movement. The camera should maintain a fixed, medium-wide shot to capture the entirety of the action, emphasizing the cyclical and perpetual nature of the performance. The overall mood should be contemplative and poignant, a visual metaphor for perseverance, struggle, and the cyclical nature of life's efforts. The final output should be a visually poetic and hypnotic loop, reminiscent of Bourgeois's signature style that blends dance, acrobatics, and physics

Using BF16 version with same prompt and keeping it to 1280*720 works well:

Gen times:
Roughly 80s for each 121 frame generation. Going from 1.6 to3.2 s/it

A smartphone video of a blonde man standing in a vintage-style workshop. He is hammering wood planks with a nail and hammer. The sound of the hammer hitting the nail into the wood is a strong thud. There is slight country blues music playing in the background softly from an antique gramaphone on the shelf. he is wearing a lumberjack outfit. The room is almost antique with the amazing wooden structure and architectural design of a woodworker. . Strong natural sunlight is hitting him from the side, creating realistic highlights on his skin and hair. High resolution, authentic skin texture, soft focus background. The camera motion is a dolly panning shot from left to right, as we move from behind the man to in front of him.

Create a high-resolution, photorealistic video in the style of French choreographer and artist Yoann Bourgeois. The scene should be minimalist and theatrical, featuring a solitary, stark white staircase against a dark, undefined background. A woman, dressed in simple, dark, loose-fitting clothing, is the central figure. The video should depict a seamless, infinite loop of the following sequence: the woman gracefully ascends the stairs with a determined yet weary posture. Partway up, she missteps and falls backward, her body in a controlled, almost balletic descent. She lands silently on a hidden trampoline, which propels her back up in a fluid, acrobatic arc without distorting her human figure,. she lands softly on a lower step of the staircase and immediately resumes her ascent. The lighting should be dramatic and focused, casting long shadows and highlighting the woman's form and movement. The camera should maintain a fixed, medium-wide shot to capture the entirety of the action, emphasizing the cyclical and perpetual nature of the performance. The overall mood should be contemplative and poignant, a visual metaphor for perseverance, struggle, and the cyclical nature of life's efforts. The final output should be a visually poetic and hypnotic loop, reminiscent of Bourgeois's signature style that blends dance, acrobatics, and physics

A close-up of a cheerful boy puppet with curly auburn yarn hair and wide button eyes, holding a small red umbrella above his head. Rain falls gently around him. he looks upward and begins to sing with joy in English with an Irish accent: "it's pissing rain, I love it when its pissing raining." His fabric mouth opening and closing to a melodic tune. His hands grip the umbrella handle as he sways slightly from side to side in rhythm. The camera holds steady as the rain sparkles against the soft lighting. His eyes blink occasionally as she sings.

you're OOMing on a 5090?
heh, i think i can safely forget about running this model on my 5060 ti 16gb.. lol. Nice work anyway.

Using BF16 version with same prompt and keeping it to 1280*720 works well:

Gen times:
Roughly 80s for each 121 frame generation. Going from 1.6 to3.2 s/it

A smartphone video of a blonde man standing in a vintage-style workshop. He is hammering wood planks with a nail and hammer. The sound of the hammer hitting the nail into the wood is a strong thud. There is slight country blues music playing in the background softly from an antique gramaphone on the shelf. he is wearing a lumberjack outfit. The room is almost antique with the amazing wooden structure and architectural design of a woodworker. . Strong natural sunlight is hitting him from the side, creating realistic highlights on his skin and hair. High resolution, authentic skin texture, soft focus background. The camera motion is a dolly panning shot from left to right, as we move from behind the man to in front of him.

Create a high-resolution, photorealistic video in the style of French choreographer and artist Yoann Bourgeois. The scene should be minimalist and theatrical, featuring a solitary, stark white staircase against a dark, undefined background. A woman, dressed in simple, dark, loose-fitting clothing, is the central figure. The video should depict a seamless, infinite loop of the following sequence: the woman gracefully ascends the stairs with a determined yet weary posture. Partway up, she missteps and falls backward, her body in a controlled, almost balletic descent. She lands silently on a hidden trampoline, which propels her back up in a fluid, acrobatic arc without distorting her human figure,. she lands softly on a lower step of the staircase and immediately resumes her ascent. The lighting should be dramatic and focused, casting long shadows and highlighting the woman's form and movement. The camera should maintain a fixed, medium-wide shot to capture the entirety of the action, emphasizing the cyclical and perpetual nature of the performance. The overall mood should be contemplative and poignant, a visual metaphor for perseverance, struggle, and the cyclical nature of life's efforts. The final output should be a visually poetic and hypnotic loop, reminiscent of Bourgeois's signature style that blends dance, acrobatics, and physics

A close-up of a cheerful boy puppet with curly auburn yarn hair and wide button eyes, holding a small red umbrella above his head. Rain falls gently around him. he looks upward and begins to sing with joy in English with an Irish accent: "it's pissing rain, I love it when its pissing raining." His fabric mouth opening and closing to a melodic tune. His hands grip the umbrella handle as he sways slightly from side to side in rhythm. The camera holds steady as the rain sparkles against the soft lighting. His eyes blink occasionally as she sings.

BF16, 43GB 80secs? dont believe because offload time must be added the model doesnt fit in our 5090 GPU or is this the real power of 128GB DDR5 RAM? I have only 96Gb DDR4

Using BF16 version with same prompt and keeping it to 1280*720 works well:

Gen times:
Roughly 80s for each 121 frame generation. Going from 1.6 to3.2 s/it

A smartphone video of a blonde man standing in a vintage-style workshop. He is hammering wood planks with a nail and hammer. The sound of the hammer hitting the nail into the wood is a strong thud. There is slight country blues music playing in the background softly from an antique gramaphone on the shelf. he is wearing a lumberjack outfit. The room is almost antique with the amazing wooden structure and architectural design of a woodworker. . Strong natural sunlight is hitting him from the side, creating realistic highlights on his skin and hair. High resolution, authentic skin texture, soft focus background. The camera motion is a dolly panning shot from left to right, as we move from behind the man to in front of him.

Create a high-resolution, photorealistic video in the style of French choreographer and artist Yoann Bourgeois. The scene should be minimalist and theatrical, featuring a solitary, stark white staircase against a dark, undefined background. A woman, dressed in simple, dark, loose-fitting clothing, is the central figure. The video should depict a seamless, infinite loop of the following sequence: the woman gracefully ascends the stairs with a determined yet weary posture. Partway up, she missteps and falls backward, her body in a controlled, almost balletic descent. She lands silently on a hidden trampoline, which propels her back up in a fluid, acrobatic arc without distorting her human figure,. she lands softly on a lower step of the staircase and immediately resumes her ascent. The lighting should be dramatic and focused, casting long shadows and highlighting the woman's form and movement. The camera should maintain a fixed, medium-wide shot to capture the entirety of the action, emphasizing the cyclical and perpetual nature of the performance. The overall mood should be contemplative and poignant, a visual metaphor for perseverance, struggle, and the cyclical nature of life's efforts. The final output should be a visually poetic and hypnotic loop, reminiscent of Bourgeois's signature style that blends dance, acrobatics, and physics

A close-up of a cheerful boy puppet with curly auburn yarn hair and wide button eyes, holding a small red umbrella above his head. Rain falls gently around him. he looks upward and begins to sing with joy in English with an Irish accent: "it's pissing rain, I love it when its pissing raining." His fabric mouth opening and closing to a melodic tune. His hands grip the umbrella handle as he sways slightly from side to side in rhythm. The camera holds steady as the rain sparkles against the soft lighting. His eyes blink occasionally as she sings.

Using the fp8 model and the text encoder pipline with unsloth/gemma-3-12b-it-bnb-4bit, workflow embedded. res2s is very slow comparing to euler a but quality is top

Sign up or log in to comment