Spaces:
Running
Running
Add sentencepiece dependency to requirements for improved tokenization
Browse files- requirements.txt +1 -0
requirements.txt
CHANGED
|
@@ -14,3 +14,4 @@ peft>=0.7.0
|
|
| 14 |
transformers>=4.36.0
|
| 15 |
datasets>=2.16.0
|
| 16 |
tensorboard>=2.15.0
|
|
|
|
|
|
| 14 |
transformers>=4.36.0
|
| 15 |
datasets>=2.16.0
|
| 16 |
tensorboard>=2.15.0
|
| 17 |
+
sentencepiece>=0.1.99
|