Instructions to use zai-org/chatglm3-6b-128k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm3-6b-128k with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm3-6b-128k", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update modeling_chatglm.py
#2
by KeshawnHou - opened
This code change addresses issue #968 in THUDM/ChatGLM3. Ensure both tensors are on the same device.
KeshawnHou changed pull request title from Ensure both tensors are on the same device. to Update modeling_chatglm.py
Is there a link to the #968 problem? What is the original problem
Sorry, I found it. Sorry to bother you
ZHANGYUXUAN-zR changed pull request status to merged