bdstar commited on
Commit
06a5e2c
·
verified ·
1 Parent(s): 6fe0230

Add tokenizers==0.19.1

Browse files
Files changed (1) hide show
  1. requirements.txt +1 -1
requirements.txt CHANGED
@@ -11,7 +11,7 @@ onnxruntime==1.23.2
11
 
12
  # --- LLM fallback for Spaces (since no local Ollama) ---
13
  transformers==4.44.2
14
- tokenizers==0.19.1 ✅ IMPORTANT FIX
15
  accelerate
16
  safetensors
17
  sentencepiece
 
11
 
12
  # --- LLM fallback for Spaces (since no local Ollama) ---
13
  transformers==4.44.2
14
+ tokenizers==0.19.1
15
  accelerate
16
  safetensors
17
  sentencepiece