Instructions to use zai-org/chatglm-6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm-6b with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm-6b", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
fix: truncate finished output in stream_generate
#74
by goldenteethCN - opened
【修复】修复在有多个回答长度不一致的inputs时,模型没有对finished_sequences进行截断的问题