Instructions to use zai-org/chatglm3-6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm3-6b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm3-6b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Could not locate the tokenization_chatglm.py inside THUDM/chatglm3-6b.
#39
by creekmooon - opened
tokenizer_config.json
"auto_map": {
"AutoTokenizer": [
"THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer",
null
]
tokenization_chatglm.ChatGLMTokenizer
ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"
ttry to change "THUDM/chatglm3-6b--tokenization_chatglm.ChatGLMTokenizer" to "tokenization_chatglm.ChatGLMTokenizer"
yea, after the modification, the model can be loaded normally.
creekmooon changed discussion status to closed