lilblueyes commited on
Commit
e28ca38
·
1 Parent(s): 879a21c

Document pipeline checks and ASL dependencies

Browse files
.gitignore ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ __pycache__/
2
+ *.py[cod]
3
+ .pytest_cache/
4
+ data/examples/*.mp4
README.md CHANGED
@@ -11,7 +11,52 @@ pinned: false
11
 
12
  # ASL TTS Test
13
 
14
- MVP Gradio pour tester la brique TTS, llama.cpp et une interface custom avant de brancher le pipeline vidéo ASL.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
 
16
  ## GPU dependencies
17
 
@@ -22,3 +67,12 @@ GPU runtime, install the GPU dependency set instead:
22
  ```bash
23
  pip install -r requirements-gpu.txt --no-build-isolation
24
  ```
 
 
 
 
 
 
 
 
 
 
11
 
12
  # ASL TTS Test
13
 
14
+ MVP Gradio pour tester la pipeline ASL video/camera -> intent JSON -> llama.cpp -> Qwen3-TTS.
15
+
16
+ ## Pipeline
17
+
18
+ ```text
19
+ Video upload / camera capture
20
+ -> ASL frame sampling
21
+ -> MediaPipe landmarks, if installed
22
+ -> TFLite ASL classifier, if data/models/asl/model.tflite is present
23
+ -> DeepFace emotion aggregation, if installed
24
+ -> llama.cpp subtitle + voice instruction
25
+ -> Qwen3-TTS audio
26
+ ```
27
+
28
+ The app is organized so each brick can fail independently with diagnostics instead of blocking
29
+ the whole interface at startup.
30
+
31
+ ## Local checks
32
+
33
+ Run unit tests:
34
+
35
+ ```bash
36
+ python3 -m pytest -q
37
+ ```
38
+
39
+ Run each brick directly:
40
+
41
+ ```bash
42
+ python3 scripts/test_asl_brick.py
43
+ python3 scripts/test_llm_brick.py
44
+ python3 scripts/test_tts_brick.py
45
+ python3 scripts/test_full_pipeline.py
46
+ ```
47
+
48
+ `scripts/test_asl_brick.py` creates a tiny temporary demo clip when no video path is supplied.
49
+
50
+ ## ASL model files
51
+
52
+ Place the ASL classifier assets here when available:
53
+
54
+ ```text
55
+ data/models/asl/model.tflite
56
+ data/models/asl/train.csv
57
+ ```
58
+
59
+ Without these files, the ASL brick still samples frames and emits `model_missing` diagnostics.
60
 
61
  ## GPU dependencies
62
 
 
67
  ```bash
68
  pip install -r requirements-gpu.txt --no-build-isolation
69
  ```
70
+
71
+ ## Full ASL dependencies
72
+
73
+ The default requirements keep the Space build lighter. For a full local ASL/emotion runtime with
74
+ MediaPipe landmarks and DeepFace emotion detection, install:
75
+
76
+ ```bash
77
+ pip install -r requirements-asl-full.txt
78
+ ```
__pycache__/app.cpython-310.pyc DELETED
Binary file (7.95 kB)
 
pytest.ini ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ [pytest]
2
+ testpaths = tests
3
+ asyncio_default_fixture_loop_scope = function
4
+
requirements-asl-full.txt ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ -r requirements.txt
2
+
3
+ protobuf>=4.25,<5.0
4
+ mediapipe==0.10.14
5
+ tensorflow-cpu==2.17.1
6
+ deepface==0.0.100
7
+ tf-keras==2.17.0
requirements.txt CHANGED
@@ -7,3 +7,7 @@ soundfile
7
  torch
8
  huggingface-hub
9
  llama-cpp-python
 
 
 
 
 
7
  torch
8
  huggingface-hub
9
  llama-cpp-python
10
+ numpy>=1.26,<2.0
11
+ pandas>=2.1,<3.0
12
+ opencv-python-headless==4.11.0.86
13
+ pytest>=8.0,<9.0