Gemma 4 for Janas-LLM Collection Gemma-4-E2B writes 38 tok/s vs 19 for llama.cpp, 26B-A4B 18 vs 12, on a 32 GB laptop. Gemma 4 models converted for Janas-LLM. • 4 items • Updated 2 days ago
Qwen for Janas-LLM Collection 37 tok/s from Qwen3-Next-80B on a 32 GB laptop; 24 without drafts vs 2.8 for llama.cpp. Qwen models converted for Janas-LLM. • 10 items • Updated 2 days ago