Hugging Face's logo

kaitchup
/
GLM-4.7-Flash-FP8-Dynamic

Safetensors
glm4_moe_lite
llm-compressor
compressed-tensors
Model card Files
xet
Community
GLM-4.7-Flash-FP8-Dynamic / README.md
bnjmnmarie's picture
bnjmnmarie
Upload folder using huggingface_hub
231c5f2 verified
preview code
|
raw
history blame contribute delete
964 Bytes
metadata 
license: mit
base_model:
  - zai-org/GLM-4.7-Flash
tags:
  - llm-compressor

This is zai-org/GLM-4.7-Flash quantized with llm-compressor to FP8. The model is compatible with vLLM (tested: v0.14.0). Tested with an L4 (Google Colab).