GitHub Actions commited on
Commit
40f764e
Β·
1 Parent(s): 50882fa

πŸš€ Auto-deploy from GitHub

Browse files
Files changed (1) hide show
  1. requirements.txt +2 -0
requirements.txt CHANGED
@@ -24,6 +24,8 @@ bitsandbytes>=0.46.0 # For 4-bit/8-bit loading - using latest stable version
24
  # Tokenizer Dependencies
25
  protobuf>=3.20.0
26
  tiktoken>=0.5.0
 
 
27
 
28
  # Database & Templates
29
  supabase>=2.7.0
 
24
  # Tokenizer Dependencies
25
  protobuf>=3.20.0
26
  tiktoken>=0.5.0
27
+ sentencepiece>=0.1.99 # Required for LlamaTokenizer
28
+ blobfile>=2.0.0 # Required by tiktoken
29
 
30
  # Database & Templates
31
  supabase>=2.7.0