File size: 1,235 Bytes
ccdf797
c4ee290
 
 
 
ccdf797
c4ee290
ccdf797
 
c4ee290
 
 
 
 
 
 
 
 
 
ccdf797
 
c4ee290
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
ccdf797
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
---
title: ShortSmith v2
emoji: 🎬
colorFrom: purple
colorTo: blue
sdk: gradio
sdk_version: "4.44.1"
app_file: app.py
pinned: false
license: mit
hardware: a10g-large
tags:
  - video
  - highlight-detection
  - ai
  - qwen
  - computer-vision
  - audio-analysis
short_description: AI-Powered Video Highlight Extractor
---

# ShortSmith v2

Extract the most engaging highlight clips from your videos automatically using AI.

## Features
- Multi-modal analysis (visual + audio + motion)
- Domain-optimized presets (Sports, Music, Vlogs, etc.)
- Person-specific filtering
- Scene-aware clip cutting
- Trained on Mr. HiSum "Most Replayed" data

## Usage
1. Upload a video (up to 500MB, max 1 hour)
2. Select content domain (Sports, Music, Vlogs, etc.)
3. Choose number of clips and duration
4. (Optional) Upload reference image for person filtering
5. Click "Extract Highlights"
6. Download your clips!

## Tech Stack
- **Visual**: Qwen2-VL-2B (INT4 quantized)
- **Audio**: Librosa + Wav2Vec 2.0
- **Face Recognition**: InsightFace (SCRFD + ArcFace)
- **Hype Scoring**: MLP trained on Mr. HiSum dataset
- **Scene Detection**: PySceneDetect

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference