--- license: other base_model: - LiquidAI/LFM2.5-230M - LiquidAI/LFM2.5-2.6B - LiquidAI/LFM2.5-8B-A1B tags: - cmf - cortiq - quantized - lfm2 language: - en --- # LFM2.5 → CMF — one file, one Rust binary, no Python ```bash cargo install cortiq-cli hf download infosave/LFM2.5-cmf lfm2.5-2.6b-q4tp.cmf --local-dir . cortiq run lfm2.5-2.6b-q4tp.cmf --prompt "Explain what a Fourier transform does, in two sentences." ``` [LiquidAI's LFM2.5](https://huggingface.co/LiquidAI) is a hybrid: most layers mix with a short gated convolution and only a few carry full attention, so the state a token needs is small and constant where the convolution runs. These are those checkpoints in the [CMF container](https://github.com/infosave2007/cmf) — a single memory-mapped file read by `cortiq`, a Rust binary with no ML framework under it. GPU via Vulkan/Metal/DX12 with a CPU fallback; NVIDIA, AMD, Intel and Apple silicon read the same file. | file | params | layers | size | |---|---|---|---| | `lfm2.5-230m-q4tp.cmf` | 0.23B | 14 (5 attention / 9 conv) | **132 MB** | | `lfm2.5-2.6b-q4tp.cmf` | 2.70B | 30 (8 attention / 22 conv) | **1.43 GB** | | `lfm2.5-8b-a1b-q4tp.cmf` | 8.3B total, 1B active | 24 (6 attention / 18 conv), 32 experts, 4 per token | **4.6 GB** | All three are 4-bit tiled with ladder scales (`q4tp`), quantized straight from the bf16 checkpoints. ## Speed Steady-state decode, `cortiq bench --core`, single stream, cortiq **0.5.99+** (the whole-token graph learned this family's short-conv mixer and its sigmoid-routed MoE in 0.5.98/0.5.99 — earlier versions decode it an order of magnitude slower). | | A100 80GB (Vulkan) | Apple M4 | |---|---|---| | 230M | **390 tok/s** | 138 tok/s | | 2.6B | **141 tok/s** | 42 tok/s (`CMF_GPU=0`) | | 8B-A1B | **124 tok/s** | — | On a discrete card the whole token runs as one submitted graph, conv ring and expert routing included; the MoE's greedy output is token-identical to the CPU path. On Apple silicon the engine measures both arms at startup and picks; for the 2.6B the host arm wins there, and `CMF_GPU=0` pins it. ## Server and API ```bash cortiq serve lfm2.5-2.6b-q4tp.cmf --port 8080 ``` Speaks the OpenAI API, so anything that talks to OpenAI talks to it: ```bash curl localhost:8080/v1/chat/completions -H 'content-type: application/json' \ -d '{"model":"lfm2.5","messages":[{"role":"user","content":"Say hello"}]}' ``` ## Checksums Each `.cmf` ships a `.sha256` beside it.