Spaces:
Runtime error
Runtime error
Fixed image readme
Browse files
README.md
CHANGED
|
@@ -18,7 +18,8 @@ TODO: BETTER INTRO
|
|
| 18 |
The aim of our agent is to support authors in their creative process for scenarios and storyboards.
|
| 19 |
|
| 20 |
### Agent Flow
|
| 21 |
-
|
|
|
|
| 22 |
|
| 23 |
**A**
|
| 24 |
|
|
@@ -26,11 +27,14 @@ Starting the agent
|
|
| 26 |
|
| 27 |
**B**
|
| 28 |
|
| 29 |
-
The agent receives as input a text file containing the script,
|
|
|
|
|
|
|
| 30 |
|
| 31 |
**C**
|
| 32 |
|
| 33 |
-
The agent extracts a summary of the overall content of the scenario,
|
|
|
|
| 34 |
|
| 35 |
This will help creating a big picture version of the draft for the next steps
|
| 36 |
|
|
@@ -38,13 +42,15 @@ This will help creating a big picture version of the draft for the next steps
|
|
| 38 |
|
| 39 |
The agent will identify the main entities (characters, locations, events) and key themes in the script.
|
| 40 |
|
| 41 |
-
It will also generate a small abstract (~5 sentences)
|
|
|
|
| 42 |
|
| 43 |
**E**
|
| 44 |
|
| 45 |
The agent checks whether the input text matches a known or published script.
|
| 46 |
|
| 47 |
-
If it does,
|
|
|
|
| 48 |
|
| 49 |
In case of any limitations, the agent will warn the user about restrictions.
|
| 50 |
|
|
@@ -52,21 +58,49 @@ In case of any limitations, the agent will warn the user about restrictions.
|
|
| 52 |
|
| 53 |
The agent will perform an analysis of the main points of the sctipt:
|
| 54 |
|
| 55 |
-
- Characters: extract and catalog the names of the characters,
|
|
|
|
|
|
|
| 56 |
|
| 57 |
-
- Locations: Detect the places where the scenes take place
|
|
|
|
| 58 |
|
| 59 |
- Plot points: Isolate key plot points
|
| 60 |
|
| 61 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
### Main Techniques
|
| 64 |
|
| 65 |
- Transformer-based NLP architectures (BERT, GPT-4) to produce a coherent text synthesis
|
| 66 |
- Named Entity Recognition (NER) and context analysis, to identify human characters and their roles
|
| 67 |
- Semantic analysis of textual descriptions, toponym extraction, creation of an internal scene map
|
| 68 |
-
- Detection of text patterns (turning expressions such as “Suddenly”, “In the meantime”)
|
| 69 |
-
|
|
|
|
| 70 |
|
| 71 |
|
| 72 |
### Code overview
|
|
|
|
| 18 |
The aim of our agent is to support authors in their creative process for scenarios and storyboards.
|
| 19 |
|
| 20 |
### Agent Flow
|
| 21 |
+
|
| 22 |
+

|
| 23 |
|
| 24 |
**A**
|
| 25 |
|
|
|
|
| 27 |
|
| 28 |
**B**
|
| 29 |
|
| 30 |
+
The agent receives as input a text file containing the script,
|
| 31 |
+
either in plain text format or in structured formats (e.g. PDF, DOCX),
|
| 32 |
+
which it then converts into plain text for processing.
|
| 33 |
|
| 34 |
**C**
|
| 35 |
|
| 36 |
+
The agent extracts a summary of the overall content of the scenario,
|
| 37 |
+
identifying the main narrative lines and the time frame.
|
| 38 |
|
| 39 |
This will help creating a big picture version of the draft for the next steps
|
| 40 |
|
|
|
|
| 42 |
|
| 43 |
The agent will identify the main entities (characters, locations, events) and key themes in the script.
|
| 44 |
|
| 45 |
+
It will also generate a small abstract (~5 sentences)
|
| 46 |
+
with enough details to understand the overall plot and tone.
|
| 47 |
|
| 48 |
**E**
|
| 49 |
|
| 50 |
The agent checks whether the input text matches a known or published script.
|
| 51 |
|
| 52 |
+
If it does,
|
| 53 |
+
it will check the license and availability of rights to understand if it is possible to operate on it.
|
| 54 |
|
| 55 |
In case of any limitations, the agent will warn the user about restrictions.
|
| 56 |
|
|
|
|
| 58 |
|
| 59 |
The agent will perform an analysis of the main points of the sctipt:
|
| 60 |
|
| 61 |
+
- Characters: extract and catalog the names of the characters,
|
| 62 |
+
classifying them by role (protagonist, antagonist, secondary characters),
|
| 63 |
+
gender and age/physical description.
|
| 64 |
|
| 65 |
+
- Locations: Detect the places where the scenes take place
|
| 66 |
+
(interiors, exteriors, historical periods, geographical location) and catalogue them.
|
| 67 |
|
| 68 |
- Plot points: Isolate key plot points
|
| 69 |
|
| 70 |
+
- Vibes (Look and Feel): Understand the style (dramatic, comic, thriller, horror)
|
| 71 |
+
and the overall sensation (suspense, irony, melancholy).
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
**G**
|
| 75 |
+
|
| 76 |
+
Define the agent goal.
|
| 77 |
+
|
| 78 |
+
Having achieved a comprehensive summary, the agent will ask for the final goal:
|
| 79 |
+
|
| 80 |
+
- Remake / Rewrite
|
| 81 |
+
- Change of medium (movie, tv series, ...)
|
| 82 |
+
- Other purposes (Workshop, Interactive presentation, Didactic analysis, ...)
|
| 83 |
+
|
| 84 |
+
|
| 85 |
+
**H**
|
| 86 |
+
|
| 87 |
+
Structural proposal.
|
| 88 |
+
|
| 89 |
+
Coherently with the goal,
|
| 90 |
+
the agent will split the narrative structure into acts and scenes,
|
| 91 |
+
pointing to the reference text as well
|
| 92 |
+
|
| 93 |
+
|
| 94 |
+
|
| 95 |
|
| 96 |
### Main Techniques
|
| 97 |
|
| 98 |
- Transformer-based NLP architectures (BERT, GPT-4) to produce a coherent text synthesis
|
| 99 |
- Named Entity Recognition (NER) and context analysis, to identify human characters and their roles
|
| 100 |
- Semantic analysis of textual descriptions, toponym extraction, creation of an internal scene map
|
| 101 |
+
- Detection of text patterns (turning expressions such as “Suddenly”, “In the meantime”)
|
| 102 |
+
and classification using a Story Understanding model
|
| 103 |
+
- Tone analysis and Sentiment analysis for understanding vibes
|
| 104 |
|
| 105 |
|
| 106 |
### Code overview
|