doesnt load
#1
by audioedge - opened
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported.
You need to use a newer transformers:
https://github.com/huggingface/transformers/blob/8ebfd84fa7f4d6c59f5059a439fad10ada26b3ff/src/transformers/tokenization_utils_tokenizers.py#L80
pip install git+https://github.com/huggingface/transformers
...
Created wheel for transformers: filename=transformers-5.0.0.dev0-py3-none-any.whl
...
python test.py
==========
Hello! 😊 How can I assist you today?
Prompt: 4 tokens, 12.021 tokens-per-sec
Generation: 13 tokens, 15.885 tokens-per-sec
Peak memory: 25.092 GB
jritchie-nullable changed discussion status to closed