ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

by HelixPark - opened Jul 28, 2023

ValueError: Tokenizer class LlamaTokenizer does not exist or is not currently imported.

Transformers = 4.27.1

tokenizer_config.json中 "tokenizer_class": "LlamaTokenizer",

请问修改哪些地方

shareAI org Jul 29, 2023

建议升级一下transformers库版本再进行尝试，没有能够复现到你这个问题

Baicai003 changed discussion status to closed Nov 3, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment