commit

README.md

@@ -1,7 +1,7 @@
 # Sci-Fi
 Official PyTorch implementation of "Sci-Fi: Symmetric Constraint for Frame Inbetweening"
 
-## Quick Start
+## Deployment for frame inbetweening
 ### 1. Setup repository and environment
 ```
 git clone https://github.com/LiuhanChen-github/Sci-Fi.git

example_input_pairs/video1/prompt.txt

@@ -0,0 +1 @@
+The video begins with a white Subaru Forester driving through a muddy field, its wheels spinning as it navigates the challenging terrain. The vehicle's headlights illuminate the path ahead, casting a bright glow on the wet, uneven ground. As the car progresses, the surrounding environment reveals tall grasses and patches of dirt, indicating a rural or undeveloped area. The camera follows the car closely, capturing the dynamic motion and the effort required to drive through such conditions. The video concludes with the Subaru continuing its journey, its tires kicking up mud as it moves forward, showcasing the rugged capabilities of the vehicle in a natural setting.

example_input_pairs/video10/prompt.txt

@@ -0,0 +1 @@
+In the vibrant and whimsical world of the animated video, a young girl with dark hair tied into two buns by red ribbons sits amidst a lush, green field under a sky painted with soft, pastel hues. Her expression shifts from curiosity to concern as she looks around, her hand gently touching her cheek. The background features fantastical floating islands adorned with unique flora, adding to the enchanting atmosphere. The camera pans slowly around her, capturing the serene yet mysterious ambiance of the scene, hinting at an adventure or quest that lies ahead.

example_input_pairs/video11/prompt.txt

@@ -0,0 +1 @@
+In the animated scene, a young lion cub and an adult lion share a tender moment atop a rocky outcrop under a warm, pinkish sky. The cub, with its small, innocent eyes and soft fur, sits calmly, looking up at the adult lion with a mix of curiosity and awe. The adult lion, with its majestic mane and confident demeanor, leans in close to the cub, his expression a blend of affection and wisdom. As he speaks, his mouth opens in a gentle smile, revealing his sharp teeth, which the cub watches intently. The adult lion's head tilts slightly as he continues to engage with the cub, creating a heartwarming interaction that highlights the bond between them.

example_input_pairs/video12/prompt.txt

@@ -0,0 +1 @@
+In a rainy, dark setting, a lone figure dressed in a reflective safety jacket stands on the side of a road, holding a red baton-like object. The figure appears to be directing traffic or signaling, as they gesture towards an approaching truck with its headlights on. The truck, a large, white and red vehicle, is moving slowly forward, its lights illuminating the wet pavement. The scene is set against a backdrop of mountains under a stormy sky, with rain pouring down heavily, creating a somber and tense atmosphere. The overall mood is one of urgency and caution, as the figure seems to be guiding the truck through what could be a hazardous situation due to the weather conditions.

example_input_pairs/video2/prompt.txt

@@ -0,0 +1 @@
+The video captures an exhilarating moment during a homemade car race, where participants are seen driving their creatively constructed vehicles down a ramp. The first frame shows a participant at the top of the ramp, poised to descend with their unique car, which appears to be made from recycled materials such as cardboard and plastic bottles. The car is adorned with various decorations, including a large barrel mounted on its side, adding to its quirky and unconventional design. As the video progresses, the car accelerates down the ramp, gaining speed with each passing second. The final frame captures the car mid-air, having launched off the ramp with considerable force, showcasing the dynamic motion and energy of the race. The background reveals a lively street scene with spectators watching the event unfold, adding to the excitement and community spirit of the occasion.

example_input_pairs/video3/prompt.txt

@@ -0,0 +1 @@
+The video captures a lively scene in an urban setting, where two fluffy dogs are energetically running across a paved area. The dogs, one slightly ahead of the other, appear to be enjoying themselves as they dash past a group of people who are seated on benches in the background. The individuals seem to be watching the dogs with interest, adding a sense of community and interaction to the scene. The backdrop features a brick building and some industrial elements, suggesting that the location might be a public square or a similar open space within a city. The overall atmosphere is vibrant and dynamic, reflecting the playful energy of the dogs and the relaxed ambiance of the people around them.

example_input_pairs/video4/prompt.txt

@@ -0,0 +1 @@
+The video captures a serene moment as a woman walks forward along a paved path, surrounded by lush greenery. She carries a vibrant yellow backpack, which stands out against her dark dress and light-colored sneakers. The path she traverses is bordered by grass and trees, creating a peaceful and natural setting. As she moves, the sunlight filters through the leaves, casting dappled shadows on the ground, enhancing the tranquil atmosphere of the scene.

example_input_pairs/video5/prompt.txt

@@ -0,0 +1 @@
+In the animated scene, a character dressed in a green military-style jacket and a brown beret is seated on what appears to be the deck of a ship or a similar vessel. The character is wearing goggles and has a green scarf tied around their neck, which is fluttering in the wind. They are holding a vintage camera with both hands, examining it closely as if preparing to take a photograph. The background features a cloudy sky and the ship's rigging, suggesting that the character might be on a journey or an adventure. The overall atmosphere is adventurous and slightly tense, hinting at the character's focus and determination.

example_input_pairs/video6/prompt.txt

@@ -0,0 +1 @@
+This video captures a scene where a person is riding a BMX bike on a dirt track. The rider is wearing a helmet, a black and red cycling suit, and gloves, all of which indicate that he has taken safety precautions while engaging in this sport. The rider can be seen cycling on the track, first riding on the smooth dirt track, then crossing a small curved mound. He maintains his balance and controls the bike throughout the process of crossing the mound. In the background, there is a fence with some banners hanging on it, as well as greenery, suggesting that the location is an outdoor BMX park or a competition venue. The whole scene showcases the dynamic and adventurous nature of BMX riding. 

example_input_pairs/video7/prompt.txt

@@ -0,0 +1 @@
+The background content features a playground setting with a brick-paved area, greenery, and a road in the distance, providing a serene and open environment for the scene. The camera movement is steady and follows the woman as she swings, maintaining a consistent angle that captures her full body and the swing's motion. The main object, a woman dressed in a white shirt and blue jeans, is seen sitting on a wooden swing with chains, holding onto the swing's handles as she swings back and forth. Her movement trajectory is fluid, with her body leaning slightly forward and backward as she gains momentum from the swing's motion, showcasing a dynamic and playful action.

example_input_pairs/video8/prompt.txt

@@ -0,0 +1 @@
+The background content features a dry, grassy area with patches of dirt and a few scattered leaves, bordered by a wire fence and some green bushes, suggesting an outdoor setting possibly in a backyard or park. The movement of the camera follows the dog from behind, maintaining a steady pace that matches the dog's walking speed, creating a smooth and continuous view of its actions. The appearance and shape of the main object, a golden retriever, are consistent throughout the video; it has a light golden coat, a fluffy tail, and wears a red collar, indicating a well-groomed and healthy pet. The movement trajectory and shape changes of the main object show the dog walking steadily forward, its body slightly swaying as it moves, with its tail held high and wagging gently, reflecting a calm and relaxed demeanor.

example_input_pairs/video9/prompt.txt

@@ -0,0 +1 @@
+In the bustling urban setting of Newcastle, a vibrant green single-decker bus with "Saltwell Park" prominently displayed on its side is seen navigating through a busy intersection. The bus, part of the Newcastle City Council fleet, is surrounded by other vehicles, including a striking blue double-decker bus adorned with advertisements for "megabus.com." This double-decker bus, with its eye-catching design and large windows, stands out as it moves along the road, reflecting the dynamic city life around it. The scene captures the essence of public transportation in an urban environment, highlighting the variety of buses and their roles in daily commuting.