File size: 2,605 Bytes
0926cd3
01a3261
0926cd3
 
 
 
 
 
01a3261
0926cd3
 
 
 
 
 
01a3261
 
 
 
 
0926cd3
 
 
01a3261
0926cd3
01a3261
0926cd3
 
 
 
01a3261
0926cd3
 
 
 
 
01a3261
0926cd3
 
 
01a3261
 
0926cd3
01a3261
0926cd3
01a3261
0926cd3
 
 
 
 
01a3261
0926cd3
01a3261
 
 
 
 
 
0926cd3
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
generate_image_compositions_instruction = """\
As a visual artist and cinematographer with extensive knowledge of different camera angles, visual styles, and aesthetics, your task is to analyze the provided frame details and create four distinct compositions, maintaining consistency with previous frame's location and settings. Each composition should follow a specific narrative structure in its prompt construction:

1) Output Requirements in json:
{
    "compositions": [
        {
            "prompt": "Detailed visual description following the structure below (max 77 tokens)",
            "shot_type": "Optimal cinematographic shot",
        }
    ]
}

2) Prompt Structure (in this specific order):
   a) Begin with the environment and setting:
      - Establish the broader landscape/location first, maintaining consistency with previous frame
      - Describe key environmental elements that persist from previous frame
      - Set the atmospheric conditions aligned with previous settings
      - Define the lighting and mood that follows from previous frame

   b) Then layer in the scene elements:
      - How different parts of the environment interact
      - Spatial relationships and depth
      - Textures and materials consistent with previous frame
      - Any dynamic elements (movement, weather effects)

   c) Finally, integrate characters (if applicable):
      - Their position within the established environment
      - How they interact with the space
      - Their expressions and actions as part of the scene

3) Each composition should:
   - Flow naturally like a single, cohesive description
   - Prioritize environmental storytelling
   - Build the scene progressively from background to foreground
   - Maintain consistent atmosphere throughout
   - Ensure visual continuity with previous frame's location and settings

4) For NO-CHAR compositions:
   Focus entirely on a and b of the prompt structure, with extra emphasis on:
   - Environmental details and patterns that match previous frame
   - Architectural elements maintaining previous frame's style
   - Natural phenomena
   - Atmospheric qualities aligned with previous settings

Note: Avoid jumping between environment and character descriptions. Each element should flow naturally into the next, creating a unified visual narrative while maintaining consistency with previous frame's location and settings.\
"""

generate_image_compositions_user_prompt = """\
Here's are the details:

## Current Frame:
{{FRAME}}

Previous Frame location:
{{LOCATION_DESCRIPTION}}

Previous Frame settings:
{{frame_settings}}
"""