Spaces:
Build error
Build error
Commit ·
e28ca38
1
Parent(s): 879a21c
Document pipeline checks and ASL dependencies
Browse files- .gitignore +4 -0
- README.md +55 -1
- __pycache__/app.cpython-310.pyc +0 -0
- pytest.ini +4 -0
- requirements-asl-full.txt +7 -0
- requirements.txt +4 -0
.gitignore
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
__pycache__/
|
| 2 |
+
*.py[cod]
|
| 3 |
+
.pytest_cache/
|
| 4 |
+
data/examples/*.mp4
|
README.md
CHANGED
|
@@ -11,7 +11,52 @@ pinned: false
|
|
| 11 |
|
| 12 |
# ASL TTS Test
|
| 13 |
|
| 14 |
-
MVP Gradio pour tester la
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## GPU dependencies
|
| 17 |
|
|
@@ -22,3 +67,12 @@ GPU runtime, install the GPU dependency set instead:
|
|
| 22 |
```bash
|
| 23 |
pip install -r requirements-gpu.txt --no-build-isolation
|
| 24 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
# ASL TTS Test
|
| 13 |
|
| 14 |
+
MVP Gradio pour tester la pipeline ASL video/camera -> intent JSON -> llama.cpp -> Qwen3-TTS.
|
| 15 |
+
|
| 16 |
+
## Pipeline
|
| 17 |
+
|
| 18 |
+
```text
|
| 19 |
+
Video upload / camera capture
|
| 20 |
+
-> ASL frame sampling
|
| 21 |
+
-> MediaPipe landmarks, if installed
|
| 22 |
+
-> TFLite ASL classifier, if data/models/asl/model.tflite is present
|
| 23 |
+
-> DeepFace emotion aggregation, if installed
|
| 24 |
+
-> llama.cpp subtitle + voice instruction
|
| 25 |
+
-> Qwen3-TTS audio
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
+
The app is organized so each brick can fail independently with diagnostics instead of blocking
|
| 29 |
+
the whole interface at startup.
|
| 30 |
+
|
| 31 |
+
## Local checks
|
| 32 |
+
|
| 33 |
+
Run unit tests:
|
| 34 |
+
|
| 35 |
+
```bash
|
| 36 |
+
python3 -m pytest -q
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
Run each brick directly:
|
| 40 |
+
|
| 41 |
+
```bash
|
| 42 |
+
python3 scripts/test_asl_brick.py
|
| 43 |
+
python3 scripts/test_llm_brick.py
|
| 44 |
+
python3 scripts/test_tts_brick.py
|
| 45 |
+
python3 scripts/test_full_pipeline.py
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
`scripts/test_asl_brick.py` creates a tiny temporary demo clip when no video path is supplied.
|
| 49 |
+
|
| 50 |
+
## ASL model files
|
| 51 |
+
|
| 52 |
+
Place the ASL classifier assets here when available:
|
| 53 |
+
|
| 54 |
+
```text
|
| 55 |
+
data/models/asl/model.tflite
|
| 56 |
+
data/models/asl/train.csv
|
| 57 |
+
```
|
| 58 |
+
|
| 59 |
+
Without these files, the ASL brick still samples frames and emits `model_missing` diagnostics.
|
| 60 |
|
| 61 |
## GPU dependencies
|
| 62 |
|
|
|
|
| 67 |
```bash
|
| 68 |
pip install -r requirements-gpu.txt --no-build-isolation
|
| 69 |
```
|
| 70 |
+
|
| 71 |
+
## Full ASL dependencies
|
| 72 |
+
|
| 73 |
+
The default requirements keep the Space build lighter. For a full local ASL/emotion runtime with
|
| 74 |
+
MediaPipe landmarks and DeepFace emotion detection, install:
|
| 75 |
+
|
| 76 |
+
```bash
|
| 77 |
+
pip install -r requirements-asl-full.txt
|
| 78 |
+
```
|
__pycache__/app.cpython-310.pyc
DELETED
|
Binary file (7.95 kB)
|
|
|
pytest.ini
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
[pytest]
|
| 2 |
+
testpaths = tests
|
| 3 |
+
asyncio_default_fixture_loop_scope = function
|
| 4 |
+
|
requirements-asl-full.txt
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
-r requirements.txt
|
| 2 |
+
|
| 3 |
+
protobuf>=4.25,<5.0
|
| 4 |
+
mediapipe==0.10.14
|
| 5 |
+
tensorflow-cpu==2.17.1
|
| 6 |
+
deepface==0.0.100
|
| 7 |
+
tf-keras==2.17.0
|
requirements.txt
CHANGED
|
@@ -7,3 +7,7 @@ soundfile
|
|
| 7 |
torch
|
| 8 |
huggingface-hub
|
| 9 |
llama-cpp-python
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
torch
|
| 8 |
huggingface-hub
|
| 9 |
llama-cpp-python
|
| 10 |
+
numpy>=1.26,<2.0
|
| 11 |
+
pandas>=2.1,<3.0
|
| 12 |
+
opencv-python-headless==4.11.0.86
|
| 13 |
+
pytest>=8.0,<9.0
|