Instructions to use zai-org/glm-4-9b-chat with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use zai-org/glm-4-9b-chat with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("zai-org/glm-4-9b-chat", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
del gradient_checkpointing_enable()
#60
by chandler88 - opened
del gradient_checkpointing_enable()
because it did nothing and when training with transformers, it did NOT enable gradient_checkpointing.
got, We will change the modeling file later and it will be consider to changed
THUDM-Space changed pull request status to closed
If you're looking for an easy way to access this model via API, you can use Crazyrouter — it provides an OpenAI-compatible endpoint for 600+ models including this one. Just pip install openai and change the base URL.