---
title: diskformer chat
colorFrom: gray
colorTo: blue
sdk: static
app_file: index.html
pinned: false
license: mit
short_description: MoE models larger than your GPU memory, in your browser tab
---

# diskformer chat

Mixture-of-experts models larger than your GPU memory, running in your browser tab: llama.cpp's WebGPU backend with
the experts paged in from the browser's private storage on your disk (OPFS). The model downloads once; the GPU holds
the dense layers and a small cache of experts, and every other expert is read from the file as each token needs it.
In the list: Qwen3.6 35B-A3B, GLM-4.7-Flash, LFM2.5 24B-A2B, ERNIE 4.5 21B-A3B, gpt-oss 20B, Qwen3 30B-A3B, Mellum2,
Ling mini 2.0, LFM2 8B-A1B, Granite 4.0 H Tiny, OLMoE, Flint 40B-A2.5B (26 GB), and Qwen3-Next 80B-A3B (48 GB, a proof of concept), or a GGUF from
your own disk. 17 MoE architectures pass the checks; the table is in
[docs/coverage.md](https://github.com/NakliTechie/diskformer.js/blob/main/docs/coverage.md). The earlier hand-written engines (Gemma 4 26B-A4B, Qwen3.6 35B-A3B) are under `classic/`.

Needs Chrome or Edge 137 or later with WebGPU, and free disk space for the model. Open the app in its own tab, so its
storage is first-party: https://naklitechie-diskformer-chat.static.hf.space/

Source, measurements and gates: [github.com/NakliTechie/diskformer.js](https://github.com/NakliTechie/diskformer.js).
Built by `node scripts/build-space.mjs` from the repo. Each model downloads from Hugging Face under its own license.