metadata
license: cc-by-nc-4.0
FSL Interpreter
Implementing a transformer-based word-level FSL interpreter for emotion-aware sentence translation.
Code Structure
- generate sentence/pose landmarks = each uses MediaPipe holistic to generate landmark data and stores them into two HDF5 files.
- generate json data = splits the dataset into the 80-20 w/ 5-folds for training
- app = contains gradio front-end
- annotater = technically not needed but added for posterity, was used to split
Data Files
results = container including results from study that was run from Jan 2026 -> May 2026
Extract sentence_data and sliced_dataset tar into "fsl-data" folder in root dir. Move both sentence_landmarks.h5 and multitask_mediapipe.h5 files into "fsl-data" as well.