Instructions to use zai-org/chatglm2-6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm2-6b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm2-6b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
some problem with cpu
#3
by zhangbo2008 - opened
if use cpu, no half functon raised error.
好像是缺少half方法.
Change line 90 of file "modeling_chatglm.py" to the following:inv_freq = 1.0 / (10000 ** (torch.arange(0, dim, 2, device=device) / dim))
Fixed.
zxdu20 changed discussion status to closed