Spaces:
Sleeping
Sleeping
File size: 2,581 Bytes
12a7635 f9630b2 12a7635 f9630b2 3c885b7 0deaca0 c6f85d1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 |
---
title: FromWordsToMedia
emoji: πΌ
colorFrom: purple
colorTo: red
sdk: gradio
sdk_version: 5.25.2
app_file: app.py
pinned: false
license: mit
short_description: Generates an image and a caption for social media posts
---
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
# From Words to Reels
This project generates social media posts, including an image and a caption, from a user-provided text prompt. It leverages deep learning models for both text-to-image synthesis and text generation to create engaging content.
## How it Works
The process is orchestrated by the `main.py` script and follows these steps:
1. **User Input**: The script prompts the user to enter a text prompt.
2. **Image Generation**: The `VisualSynthesizer` takes the prompt, enhances it, and uses a text-to-image diffusion model (e.g., Stable Diffusion) to generate a corresponding image.
3. **Caption Generation**: The `TextSynthesizer` uses the original prompt to generate a suitable caption for the post using a causal language model.
4. **Output**: Both the generated image (`.png`) and the caption (`.txt`) are saved to the `outputs/` directory, prefixed with a timestamp.
## Project Structure
```
.
βββ main.py # Main script to run the application
βββ README.md # This file
βββ outputs/ # Directory for generated images and captions
βββ src/
β βββ visual_synthesizer.py # Handles image generation
β βββ text_synthesizer.py # Handles text/caption generation
βββ utils/
βββ config.py # Configuration for models and paths
βββ helpers.py # Helper functions for saving files etc.
```
## Setup and Installation
1. **Create a virtual environment:**
```bash
python -m venv venv
venv\Scripts\activate
```
2. **Install dependencies:**
Create a `requirements.txt` file with the following content:
```
torch
diffusers
transformers
sentence-transformers
Pillow
accelerate
```
Then run:
```bash
pip install -r requirements.txt
```
## Usage
To generate a post, run the `main.py` script:
```bash
python main.py
```
You will be prompted to enter your text. After processing, the generated image and caption will be saved in the `outputs` directory.
## Configuration
You can customize the models and other parameters by editing the `utils/config.py` file. This allows you to easily swap out different text-to-image or language models.
|