Instructions to use zai-org/chatglm-6b-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/chatglm-6b-int4 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/chatglm-6b-int4", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
#3
by GanymedeNil - opened
README.md
CHANGED
|
@@ -18,7 +18,7 @@ ChatGLM-6B-INT4 是 ChatGLM-6B 量化后的模型权重。具体的,ChatGLM-6B
|
|
| 18 |
## 软件依赖
|
| 19 |
|
| 20 |
```shell
|
| 21 |
-
pip install protobuf==3.20.0 transformers==4.
|
| 22 |
```
|
| 23 |
|
| 24 |
## 代码调用
|
|
|
|
| 18 |
## 软件依赖
|
| 19 |
|
| 20 |
```shell
|
| 21 |
+
pip install protobuf==3.20.0 transformers==4.27.1 icetk cpm_kernels
|
| 22 |
```
|
| 23 |
|
| 24 |
## 代码调用
|