typical-small / inference

Commit History

inference: Qwen3.5 support (VL unwrap, Gated-DeltaNet LoRA targets, linear_attn walk)
f91a401
verified

guychuk commited on

Phase A serving speedup: zero-copy state-cache expand (no deepcopy per decision)
5c02833
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
3ca765b
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
5f6812f
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
5ca406a
verified

guychuk commited on

Serving-path speedup: state-KV LRU cache + suffix diet (see inference/bench_serve.py)
68ae554
verified

guychuk commited on

inference/README.md: mention typical-medium alongside small/preview
396f68e
verified

guychuk commited on

Add inference/: minimal self-contained Typical inference package
002c12c
verified

guychuk commited on