Instructions to use zai-org/chatglm3-6b-32k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm3-6b-32k with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm3-6b-32k", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Code fix for chatglm3-6b not merged into this repo
#12
by Yhyu13 - opened
Hi
https://huggingface.co/THUDM/chatglm3-6b/commit/340a2eb35e0ab604bbd037499596575060326bf7
These fixes have not merged into this 32k ctx version
Thanks!
是的,但是这个问题不需要在32k解决,32k不具有完整的复杂功能,只能做基础对话
ZHANGYUXUAN-zR changed discussion status to closed