Add requirements.txt with pinned Jetson dependencies
Browse files- README.md +2 -2
- requirements.txt +27 -0
README.md
CHANGED
|
@@ -93,10 +93,10 @@ Tested on Fleurs en_us samples — near-perfect output matching the fp16 baselin
|
|
| 93 |
|
| 94 |
### Option 1: Self-contained server (recommended for Jetson)
|
| 95 |
|
| 96 |
-
No HuggingFace or vLLM dependencies needed.
|
| 97 |
|
| 98 |
```bash
|
| 99 |
-
pip install
|
| 100 |
|
| 101 |
# Test with an audio file
|
| 102 |
python scripts/jetson_serve_sdpa.py --test audio.wav
|
|
|
|
| 93 |
|
| 94 |
### Option 1: Self-contained server (recommended for Jetson)
|
| 95 |
|
| 96 |
+
No HuggingFace or vLLM dependencies needed. Tested on JetPack 6.x (R36.5.0), Python 3.10, CUDA 12.6.
|
| 97 |
|
| 98 |
```bash
|
| 99 |
+
pip install -r requirements.txt
|
| 100 |
|
| 101 |
# Test with an audio file
|
| 102 |
python scripts/jetson_serve_sdpa.py --test audio.wav
|
requirements.txt
ADDED
|
@@ -0,0 +1,27 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Voxtral Mini 4B INT4 — Jetson Orin Nano (JetPack 6.x, R36.5.0)
|
| 2 |
+
# Tested on: Python 3.10.12, CUDA 12.6, SM87 (Orin)
|
| 3 |
+
#
|
| 4 |
+
# Install PyTorch for Jetson first:
|
| 5 |
+
# pip install https://pypi.jetson-ai-lab.io/jp6/cu126/+f/02f/de421eabbf626/torch-2.9.1-cp310-cp310-linux_aarch64.whl
|
| 6 |
+
#
|
| 7 |
+
# Then install the rest:
|
| 8 |
+
# pip install -r requirements.txt
|
| 9 |
+
|
| 10 |
+
# Core inference
|
| 11 |
+
torch @ https://pypi.jetson-ai-lab.io/jp6/cu126/+f/02f/de421eabbf626/torch-2.9.1-cp310-cp310-linux_aarch64.whl
|
| 12 |
+
safetensors==0.7.0
|
| 13 |
+
numpy==2.2.6
|
| 14 |
+
marlin @ git+https://github.com/IST-DASLab/marlin.git@1f25790bdd49fba53106164a24666dade68d7c90
|
| 15 |
+
|
| 16 |
+
# Audio processing
|
| 17 |
+
librosa==0.11.0
|
| 18 |
+
soundfile==0.13.1
|
| 19 |
+
|
| 20 |
+
# Tokenizer
|
| 21 |
+
mistral_common==1.9.1
|
| 22 |
+
|
| 23 |
+
# WebSocket server
|
| 24 |
+
websockets>=12.0
|
| 25 |
+
|
| 26 |
+
# CUDA runtime (pulled in by torch, listed for reference)
|
| 27 |
+
nvidia-cudss-cu12==0.7.1.6
|