Problem Statement
Ten Du An
AI Coach - ung dung phan tich dong tac hit dat bang video.
Muc Tieu
Nguoi tap thuong kho tu nhan ra loi ky thuat khi tap mot minh, dac biet cac loi nhu chua ha nguoi du sau, hong vong, hong qua cao, co the khong giu thang, hoac cui dau qua muc. Du an nay xay dung mot ung dung web giup nguoi dung tai video tap luyen, so sanh voi video mau, va nhan phan hoi truc quan theo tung rep.
Pham Vi Hien Tai
Phien ban hien tai tap trung vao bai tap hit dat:
- Phat hien tu dong so rep trong video.
- So sanh chuoi dong tac cua hoc vien voi video mau trong
data/templates/push_up_template.mp4. - Cham diem tong quan va diem tung rep.
- Phat hien loi bang rule engine dua tren landmark va goc khop.
- Hien thi frame hoc vien va frame mau cho tung rep.
- Ve mui ten do vao vi tri loi dua tren landmark rule-based.
- Sinh feedback tieng Viet ngan gon bang VLM neu cau hinh NVIDIA API.
- Luu ket qua test video thanh file JSON de review lai.
Ngoai Pham Vi Hien Tai
- Chua ho tro nhieu bai tap ngoai hit dat trong UI production.
- Chua phan tich video realtime tu camera.
- Chua dung VLM de quyet dinh loi chinh hoac toa do arrow. VLM chi ho tro feedback chu.
- Chua dung ket qua VLM de thay the rule engine.
Yeu Cau Thanh Cong
- App chay duoc bang
reflex run. - Nguoi dung upload video va nhan ket qua theo tung rep.
- Loi chinh phai den tu rule-based analysis, co the giai thich va kiem thu.
- Arrow phai tro vao co the hoc vien, khong tro vao nen anh.
- Cac video trong
data/testsco the duoc chay batch test va xuat mot file JSON tong hop.