tokenizer edit (#1)
Browse files- tokenizer edit (fde72adb99c9dd3da386cb023adbe568facf60c9)
Co-authored-by: ismail hakkı özçelik <ismailhakki37@users.noreply.huggingface.co>
- requirements.txt +2 -2
requirements.txt
CHANGED
|
@@ -8,8 +8,8 @@ torch==2.1.2
|
|
| 8 |
torchvision==0.16.2
|
| 9 |
|
| 10 |
# PULSE/LLaVA için gerekli: yeni Transformers
|
| 11 |
-
|
| 12 |
-
tokenizers
|
| 13 |
sentencepiece==0.1.99
|
| 14 |
|
| 15 |
# Trainer/Toolkit import hataları için yeni accelerate + sbert pin'i
|
|
|
|
| 8 |
torchvision==0.16.2
|
| 9 |
|
| 10 |
# PULSE/LLaVA için gerekli: yeni Transformers
|
| 11 |
+
git+https://github.com/huggingface/transformers.git@main
|
| 12 |
+
tokenizers>=0.21.0,<0.22.0
|
| 13 |
sentencepiece==0.1.99
|
| 14 |
|
| 15 |
# Trainer/Toolkit import hataları için yeni accelerate + sbert pin'i
|