pycraft-1 / model /kv_cache.py

Commit History

Add batched generation support to model/ package
4a939c2
verified

imshadow0 commited on

Fix CPU inference; add KV cache, FIM example, HumanEval results
19ca28d
verified

imshadow0 commited on