Instructions to use zai-org/chatglm-6b-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm-6b-int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm-6b-int4", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
跑代码报错
#15
by xihashenshi - opened
各位大佬麻烦看一下这是为啥:
ProxyError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /THUDM/chatglm-6b-int4/resolve/main/tokenizer_config.json (Caused by ProxyError('Cannot connect to proxy.', RemoteDisconnected('Remote end closed connection without response')))"), '(Request ID: c2b1e1b2-384e-4cd6-8719-5ff588f6cce6)')
网络原因,可以挂个梯子,或者把模型文件下载到本地后再调用