AttributeError: module 'transformers_modules.GLM-4-9B.tokenization_chatglm' has no attribute 'ChatGLM4Tokenizer'
transformers==4.40.0
modelscope==1.14
accelerate==0.30.1
deepspeed== 0.14.4
sentencepiece==0.1.99
用transformers库吧，modelscope用不到呀
然后你这个是什么时候报错的
我在用swift微调的时候，会在模型加载过程中遇到相关报错
File "/home/jeeves/.local/lib/python3.10/site-packages/swift/utils/run_utils.py", line 27, in x_main
result = llm_x(args, **kwargs)
File "/local/apps/zai-model/model_llm_sft/nlp_v2/llm_sft.py", line 97, in llm_sft
model, tokenizer = get_model_tokenizer(
File "/home/jeeves/.local/lib/python3.10/site-packages/swift/llm/utils/model.py", line 4843, in get_model_tokenizer
model, tokenizer = get_function(model_dir, torch_dtype, model_kwargs, load_model, **kwargs)
File "/home/jeeves/.local/lib/python3.10/site-packages/swift/llm/utils/model.py", line 1474, in get_model_tokenizer_chatglm
tokenizer_cls = get_class_from_dynamic_module(class_ref, model_dir)
File "/home/jeeves/.local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 501, in get_class_from_dynamic_module
return get_class_in_module(class_name, final_module)
File "/home/jeeves/.local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 202, in get_class_in_module
return getattr(module, class_name)
AttributeError: module 'transformers_modules.GLM-4-9B.tokenization_chatglm' has no attribute 'ChatGLM4Tokenizer'
这种情况是偶发出现的，不确定是什么原因导致的