Instructions to use shunxing1234/GLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use shunxing1234/GLM with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("shunxing1234/GLM", dtype="auto") - Notebooks
- Google Colab
- Kaggle
模型大小对不上呀
#2
by yinnxinn - opened
[size](RuntimeError: Error(s) in loading state_dict for GLMModel:
Unexpected key(s) in state_dict: "transformer.block_position_embeddings.weight".
size mismatch for transformer.position_embeddings.weight: copying a param with shape torch.Size([513, 1024]) from checkpoint, the shape in current model is torch.Size([512, 1024]).)
代码部分采用的这个项目:https://github.com/THUDM/GLM
您看看 config 那块配置是对的嘛