Fix CPU inference; add KV cache, FIM example, HumanEval results

19ca28d

verified

imshadow0 commited on 14 days ago