Instructions to use thu-coai/CharacterGLM-6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use thu-coai/CharacterGLM-6B with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("thu-coai/CharacterGLM-6B", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Chat_template?
#3
by Liangmingxin - opened
tokenizer_config.json里方便加个Chat_template字段吗?然后用jinja的模板给个值,这样方便vllm部署。或者说是否用的标准chatml格式?
收到反馈请求,我们的模板是 ChatGLM2 的模板,目前还没加上
有计划基于ChatGLM3-6B 更新一版吗?
已更新chat _template
tokenizer_config.json里方便加个Chat_template字段吗?然后用jinja的模板给个值,这样方便vllm部署。或者说是否用的标准chatml格式?
有计划基于ChatGLM3-6B 更新一版吗?
CharacterGLM正在持续迭代中,欢迎关注👏
JinfengZhou changed discussion status to closed