HelloSun
/

SmallThinker4b

Text Generation

llama-cpp-python

Mixture of Experts

Model card Files Files and versions

SmallThinker4b / validate /baseline-vanilla.json

Commit History

v11: 方向修正（hot expert 實體放 RAM，非 page 轉換）+ b9acf138 vanilla 基線 82.1 tok/s / peak RSS 2.674 GiB

a035243

Auto Upload Agent commited on 2 days ago