tsp-stefano commited on
Commit
3b2c25c
·
verified ·
1 Parent(s): 22a85ee

Add requirements.txt with pinned Jetson dependencies

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. requirements.txt +27 -0
README.md CHANGED
@@ -93,10 +93,10 @@ Tested on Fleurs en_us samples — near-perfect output matching the fp16 baselin
93
 
94
  ### Option 1: Self-contained server (recommended for Jetson)
95
 
96
- No HuggingFace or vLLM dependencies needed. Runs inside the [PyTorch Jetson container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-pytorch).
97
 
98
  ```bash
99
- pip install safetensors websockets soundfile numpy librosa marlin
100
 
101
  # Test with an audio file
102
  python scripts/jetson_serve_sdpa.py --test audio.wav
 
93
 
94
  ### Option 1: Self-contained server (recommended for Jetson)
95
 
96
+ No HuggingFace or vLLM dependencies needed. Tested on JetPack 6.x (R36.5.0), Python 3.10, CUDA 12.6.
97
 
98
  ```bash
99
+ pip install -r requirements.txt
100
 
101
  # Test with an audio file
102
  python scripts/jetson_serve_sdpa.py --test audio.wav
requirements.txt ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Voxtral Mini 4B INT4 — Jetson Orin Nano (JetPack 6.x, R36.5.0)
2
+ # Tested on: Python 3.10.12, CUDA 12.6, SM87 (Orin)
3
+ #
4
+ # Install PyTorch for Jetson first:
5
+ # pip install https://pypi.jetson-ai-lab.io/jp6/cu126/+f/02f/de421eabbf626/torch-2.9.1-cp310-cp310-linux_aarch64.whl
6
+ #
7
+ # Then install the rest:
8
+ # pip install -r requirements.txt
9
+
10
+ # Core inference
11
+ torch @ https://pypi.jetson-ai-lab.io/jp6/cu126/+f/02f/de421eabbf626/torch-2.9.1-cp310-cp310-linux_aarch64.whl
12
+ safetensors==0.7.0
13
+ numpy==2.2.6
14
+ marlin @ git+https://github.com/IST-DASLab/marlin.git@1f25790bdd49fba53106164a24666dade68d7c90
15
+
16
+ # Audio processing
17
+ librosa==0.11.0
18
+ soundfile==0.13.1
19
+
20
+ # Tokenizer
21
+ mistral_common==1.9.1
22
+
23
+ # WebSocket server
24
+ websockets>=12.0
25
+
26
+ # CUDA runtime (pulled in by torch, listed for reference)
27
+ nvidia-cudss-cu12==0.7.1.6