yiheng266/animal-social-models

Animal Social Behavior Models

Two video classification models for animal behavior analysis.

Models

flyvsfly_model

• Species: Drosophila (fruit fly)
• Backbone: TimeSformer (ViT-Base, Kinetics-400 pretrained)
• Head: MLP (768→512→4)
• Classes: wing_extension, circle, copulation, others
• Input: 8 frames, 224×224

mice_lab_model

• Species: Mouse
• Backbone: Video Swin Transformer 3D-T (Kinetics-400 pretrained)
• Head: MLP with temporal mean pooling (768→512→5)
• Classes: Aggression, Investigation, Allo-groom, Standing, Other
• Input: 8 frames, 224×224

Usage

Each subfolder contains:

• config.json — architecture parameters (backbone type, head config, class names)
• model.pth — trained weights

Load by reading config.json to determine which backbone class to instantiate.