Gemma-4-E2B writes 38 tok/s vs 19 for llama.cpp, 26B-A4B 18 vs 12, on a 32 GB laptop. Gemma 4 models converted for Janas-LLM.
AI & ML interests
Janas-LLM: 37 tok/s from Qwen3-Next-80B on a 32 GB laptop (24 without drafts; llama.cpp on the same laptop: 2.8). Pure-C inference for LLMs bigger than your RAM, CPU or GPU.
Recent Activity
models 14
prabanta-dev/Qwen3-Next-80B-A3B-Instruct-JNS
Text Generation • Updated
prabanta-dev/Qwen3-Coder-Next-JNS
Text Generation • Updated
prabanta-dev/Qwen3.6-35B-A3B-JNS
Text Generation • Updated
prabanta-dev/Qwen3.5-9B-JNS
Text Generation • Updated
prabanta-dev/Qwen3.5-2B-JNS
Text Generation • Updated
prabanta-dev/Qwen3.5-0.8B-JNS
Text Generation • Updated
prabanta-dev/Qwen3-4B-JNS
Text Generation • Updated
prabanta-dev/Qwen3-30B-A3B-JNS
Text Generation • Updated
prabanta-dev/Qwen3-0.6B-JNS
Text Generation • Updated
prabanta-dev/gemma-4-E4B-it-JNS
Text Generation • Updated
datasets 0
None public yet