README.md

---
pipeline_tag: text-generation
license: other
license_name: glm-4
license_link: https://huggingface.co/THUDM/glm-4-9b-chat-hf/blob/main/LICENSE
base_model: zai-org/glm-4-9b-chat-hf
library_name: zeromodels
language:
- en
- zh
tags:
- keras
- zeromodels
- glm
- glm-4
- text-generation
- pytorch
- jax
- tf
---

# Run GLM-4 with Keras 3: JAX, PyTorch, or TensorFlow

[![GitHub](https://img.shields.io/badge/GitHub-ZeroModels-181717?logo=github)](https://github.com/IMvision12/ZeroModels) [![Docs](https://img.shields.io/badge/Docs-GLM-1f6feb)](https://imvision12.github.io/ZeroModels/glm/) [![HuggingFace](https://img.shields.io/badge/HuggingFace-GLM-ffd21e?logo=huggingface&logoColor=black)](https://huggingface.co/collections/zeromodels/glm-6a82b8f9f753e8dcae3ff3f7)

# zeromodels/glm-4-9b-chat

Pure-**Keras 3** conversion of [`zai-org/glm-4-9b-chat-hf`](https://huggingface.co/zai-org/glm-4-9b-chat-hf) for [zeromodels](https://github.com/IMvision12/ZeroModels). One implementation runs unmodified on **TensorFlow / Torch / JAX**. This is a **GLM-4-9B** checkpoint served as **text -> text**; weights are stored in **bfloat16**.

For model details, license, and usage terms, see the upstream [model card](https://huggingface.co/zai-org/glm-4-9b-chat-hf).

Paper: [ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools (arXiv:2406.12793)](https://arxiv.org/abs/2406.12793) · [HF Papers](https://huggingface.co/papers/2406.12793)

## ✨ Quick start

```python
import os
os.environ["KERAS_BACKEND"] = "torch"  # or "jax" / "tensorflow"

from zeromodels.models.glm import GlmTextGenerate, GlmTokenizer

model = GlmTextGenerate.from_weights("zeromodels/glm-4-9b-chat")
tokenizer = GlmTokenizer.from_weights("zeromodels/glm-4-9b-chat")

messages = [{"role": "user", "content": "Name three prime numbers."}]
inputs = tokenizer(messages)
outputs = model.generate(**inputs, max_new_tokens=128)
print(tokenizer.decode(outputs[0]))
```

Load any GLM variant the same way with `from_weights("zeromodels/<variant>")`. Browse them all in the [GLM collection](https://huggingface.co/collections/zeromodels/glm-6a82b8f9f753e8dcae3ff3f7).

## Special Thanks

A huge thank you to the Zhipu AI / THUDM team for creating and releasing the GLM models.

License: glm-4 ([link](https://huggingface.co/THUDM/glm-4-9b-chat-hf/blob/main/LICENSE)).