README.md

---
license: apache-2.0
library_name: transformers.js
pipeline_tag: text-generation
base_model: openbmb/MiniCPM5-1B
tags:
- transformers.js
- onnx
- onnxruntime-web
- llama
- minicpm5
- text-generation
- browser
- webgpu
---

# MiniCPM5-1B ONNX Web

Transformers.js q4 ONNX export of `openbmb/MiniCPM5-1B` for browser text generation.

## Files

- `onnx/model_q4.onnx`: ONNX Runtime 4-bit MatMul quantized decoder with KV cache.
- `config.json`: includes `transformers.js_config.dtype = "q4"` so Transformers.js loads the q4 artifact by default.
- tokenizer and generation config files copied from the source model export.

## Usage

```js
import { pipeline } from "@huggingface/transformers";

const generator = await pipeline("text-generation", "Mike0021/MiniCPM5-1B-ONNX-Web", {
  dtype: "q4",
  device: "webgpu",
});

const output = await generator("Briefly introduce yourself.", {
  max_new_tokens: 64,
  temperature: 0.2,
  do_sample: true,
});
console.log(output[0].generated_text);
```

If WebGPU is unavailable, use `device: "wasm"` in the browser.