Instructions to use silver/chatglm-6b-int4-slim with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use silver/chatglm-6b-int4-slim with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("silver/chatglm-6b-int4-slim", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
Fix position ids expand 19685a5
duzx16 commited on
Synchronize with chatglm 6b repo 7aaf3fe
Fix parallel cpu kernel 7458231
update readme 2257774
Merge remote-tracking branch 'thu/main' 11f5a02
Fix bugs in quantization when loading kernels dac03c3
Fix Chinese punctuation debaf00
duzx16 commited on
Update README.md 3ba9437
Update README.md 0d0e806
Update README.md 7ad727c
remove unused image token 02e096b
init commmit a93efa9
initial commit 62a9758
Zhengxiao Du commited on