onw / README.md

Commit History

2 days ago

  1. onw 3.3.0: LFM2.5-24B-A2B (converted on this PC), faster MoE prompts

    Verified signature
    7ed2518

6 days ago

  1. onw 3.2.1: faster MoE answers (experts kept in their slots, bound attention for MoE, LM head compiled with profiling on), the Qwen3.6-35B-A3B NF4 build in the catalog

    Verified signature
    6389fca
  2. onw 3.2.0: Ternary Bonsai 2 4B / 9B 64-token graphs (one copy of the 2-bit weights), parallel compile in processes, faster kit compiler, paged graphs released under fused ones, vision encoder in the background

    Verified signature
    ea217f6

7 days ago

  1. onw 3.1.0: the Qwen family on fused graphs + MTP (setting, on by default), background preload of fused variants up to 4K, model list search / sort / filters

    Verified signature
    f4f4926
  2. onw 3.0.0: onw NPU kit (Windows and Linux) - weightless graphs, shared weights, compiler fixes; fused graphs on by default from Lunar Lake on, up to 32K positions

    Verified signature
    2a04c3c

8 days ago

  1. onw 2.1.0: NF4 Granite 4.2 3B / 8B and llm-jp-4.1-8B (Lunar Lake and newer); wired dense decode, bound attention, PLD in the 2-token row; fused graphs experimental (ONW_FUSED=1)

    Verified signature
    60559a3

9 days ago

  1. onw 2.0.3: NPU 4000+ dense models answer on 2-token graphs (Granite 4.2 / llm-jp-4.1-8B first load on Panther Lake 2 h 45 min -> 23 min), known issues updated

    Verified signature
    505f0e1
  2. README: known issues (onw 2.0.2) - slow first load of dense models on Panther Lake (NPU compiler 8.4 write-out), MTP decode on small Panther Lake PCs, NF4 faster on Panther Lake, Qwen3.6 speed-up needs 24 GB

    Verified signature
    16518f6
  3. onw 2.0.2: dense 64-token prompt blocks on all NPUs again - NPUW_DQ_FULL=NO on NPU 5000+ (the cause of the Panther Lake errors); Panther Lake Qwen3.5-9B 44 -> ~157 tok/s

    Verified signature
    fe7bfc4

10 days ago

  1. onw 2.0.1: dense 64-token prompt blocks only on the NPU 3720 (they gave wrong output on Panther Lake NPU 5010); NPU 4000+ back to the 1.4 block sizes

    Verified signature
    026a99a
  2. onw 2.0.0: Qwen3.6 MoE prompts ~4-6x (grouped experts), dense prompts ~2-2.5x (64-token blocks), faster MoE decode

    Verified signature
    aee23d2
  3. onw 1.4.13: Ternary Bonsai 2 9B / 4B (2-bit, images, Lunar Lake and newer); onw convert reads their packs

    Verified signature
    e8ee6d8

15 days ago

  1. onw 1.4.9: Ternary Bonsai 2 27B (2-bit weights on NPU 4000+, Hadamard in-graph, onw convert reads Prism ML MLX packs); chat max tokens default to the context; settings marked that recompile; driver/OpenVINO update notice

    Verified signature
    1e8e4dd

20 days ago

  1. onw 1.4.5: first compile ~3 min shorter (4/64-token DeltaNet parts go straight to one-graph NPUW), time-left estimate while compiling; README: Panther Lake compile-time note with a Lunar Lake comparison

    Verified signature
    420ac6d
  2. README: the power chart at the top too (before Install)

    Verified signature
    edee4b5
  3. README: power chart - NPU highlighted, grouped by draft-token setting, average temperature

    Verified signature
    71b7ebb
  4. README: power efficiency with onw 1.4.0 (NF4 + MTP) - without / with draft tokens on NPU, iGPU, CPU; chart

    Verified signature
    b53d071

21 days ago

  1. onw 1.4.0: MTP draft tokens (~1.5x answers on Lunar Lake, NF4 Qwen3.5 family), 64-token prompt blocks on Lunar Lake, less host work per step, fix all-zero logit rows

    Verified signature
    eff87bb
  2. README: add power efficiency and temperature section (Qwen3.5-9B, Lunar Lake)

    Verified signature
    5c48e14

22 days ago

  1. onw 1.3.0: Anthropic Messages API and OpenAI Responses API, thinking levels with budgets, per-model defaults, chat copy/source/regenerate

    Verified signature
    ca9925f
  2. onw 1.2.0: llm-jp-4.1-32B-A3B-thinking (qwen3_moe)

    Verified signature
    cd7f6cb

23 days ago

  1. onw 1.1.1: Qwen3.5-9B NF4, recommended sampling in the chat

    Verified signature
    ac21b16
  2. onw 1.1.0: NF4 models for Lunar Lake and newer (Ornith-1.5-9B NF4)

    Verified signature
    6edf871
  3. onw 1.0.1: user guide and new screenshots, chat formatting, Gemma repetition hint

    Verified signature
    88f5b6e
  4. onw 0.15.1: memory-saving mode loads one block size at startup, strict memory-saving mode

    Verified signature
    d2cb2a2
  5. onw 0.15.0: chat history, reasoning_content always + reasoning_tokens, thinking info and default, llm-jp INT8

    Verified signature
    0b1179d
  6. onw 0.14.2: memory-saving mode for every dense model without shared weights, Gemma 4 thinking split, stale-tray warning, LM head via npuw-none first

    Verified signature
    cd19c28
  7. onw 0.14.1: memory-saving mode swaps the 16-token and 1-token graphs (one set in memory at a time)

    Verified signature
    ff46dc0
  8. onw 0.14.0: memory-saving mode (16-token graphs only) for many-part models; no auto-reload after updates when auto-load is off

    Verified signature
    2e9baed

24 days ago

  1. onw 0.13.0: NeoHorse-1-4B, Granite 4.2 3B / 8B, llm-jp-4.1-8b-thinking; granite / llama converter; Panther Lake listed

    Verified signature
    352e4bb

25 days ago

  1. onw 0.12.0: Ornith-1.5-9B, earlier turns' reasoning_content to the template, --deltanet-fmt q8g128

    Verified signature
    94fb10d

27 days ago

  1. onw 0.11.1: installs again (OpenVINO pre-release index), code review fixes, gpt-oss INT8 embedding

    Verified signature
    e47c081
  2. onw 0.11.0: OpenAI gpt-oss-20b (gpt_oss: MoE, attention sinks, YaRN, harmony), INT8 code overflow fixes

    Verified signature
    84f27c5

28 days ago

  1. onw 0.10.1: experimental NPUW settings (MoE, FUNCALL_ASYNC, weightless cache); less CPU in long chats

    Verified signature
    2113b32
  2. onw 0.10.0: long contexts with a paged INT8 KV cache (32K default, up to the model max); Gemma RoPE fix; Ubuntu launcher fix

    Verified signature
    3aabffd
  3. onw 0.9.2: tool calls (function calling) in the OpenAI-compatible API

    Verified signature
    e846499
  4. onw 0.9.0: LFM2.5 support (convert it yourself), LFM models out of the list, torch-free convert

    Verified signature
    451915a
  5. README reorganized (install first); technical notes moved to TECHNICAL.md

    Verified signature
    55cfd40

29 days ago

  1. onw 0.8.4: English / Simplified Chinese UI, new icon, README banner

    Verified signature
    97ca32a
  2. README: screenshots of the onw window

    Verified signature
    ba02533
  3. v0.8.2: predicted prefetch while decoding off by default (CPU cost on 8-core Lunar Lake); prompt prefetch stays

    Verified signature
    e32c612
  4. v0.8.0: faster SSD streaming without more memory - prompt prefetch into cache slots, predicted next-layer expert prefetch while decoding (helper thread, separate read queue), single-copy reads

    Verified signature
    ee52468

30 days ago

  1. v0.7.0: 20-60% less memory (own blob store, vision loaded on demand and freed, host tables mapped, direct-I/O expert load); REAP streams too; first-on-Intel-NPU SSD streaming note

    Verified signature
    4955f2e
  2. v0.6.1: layer-major prompt processing when experts stream from the SSD (each layer's experts read once per prompt)

    Verified signature
    e7d8666
  3. v0.6.0: stream MoE experts from the SSD (LRU cache, direct I/O) when the model does not fit; expert memory setting

    Verified signature
    3a7bf50

  1. README: to our knowledge the first public all-on-NPU VLM / Gated DeltaNet / MoE (survey Sept 2026)

    Verified signature
    1076d43
  2. v0.4.8: NPUW fixes (no SLICE_OUT, bool constants), NaN check, ONW_SIZES, Linux driver 1.38 note, diagnostic tools

    Verified signature
    67876a1
  3. v0.4.7: no NPUW for MoE models, bounded hold on broken characters, clear-cache button, save button on top

    Verified signature
    81ccdf7
  4. v0.4.5: NPUW weight sharing (auto on NPU 4000+, experimental), taller list rows on Ubuntu

    Verified signature
    a10484a
  5. v0.4.4: load/unload UI with model locations, single instance, background polling, per-PC memory estimate

    Verified signature
    72fc539