spsarolkar's picture
Deploy SignLanguageTranslate with Transformer evaluation
e35b538 verified
|
Raw History Blame Contribute Delete
1.16 kB
metadata
title: SignLanguageTranslate
emoji: 👁
colorFrom: red
colorTo: gray
sdk: docker
app_port: 7860
pinned: false
license: mit

SignLanguageTranslate

SignLanguageTranslate aims to support sign languages around the world. This demo currently evaluates Indian Sign Language on isolated clips from INCLUDE.

The Transformer comparison uses archived predictions from the rolling Transformer at epoch 31 and the causal streaming Transformer at epoch 102. The accuracy table uses 720 isolated INCLUDE clips from the saved iPad validation split. Both models use the same clips. The original LSTM demo uses its historical test manifest.

Public source videos are matched by category, class and filename to a pinned revision of the public INCLUDE mirror. The app labels that repository's split separately. The new comparison credits the original AI4Bharat INCLUDE dataset. The keypoint dataset card describes the Apple Vision input used for the comparison.