Instructions to use zai-org/glm-4-9b-chat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/glm-4-9b-chat with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/glm-4-9b-chat", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
del gradient_checkpointing_enable()
#60
by chandler88 - opened
del gradient_checkpointing_enable()
because it did nothing and when training with transformers, it did NOT enable gradient_checkpointing.
got, We will change the modeling file later and it will be consider to changed
zaiorg changed pull request status to closed
If you're looking for an easy way to access this model via API, you can use Crazyrouter — it provides an OpenAI-compatible endpoint for 600+ models including this one. Just pip install openai and change the base URL.