dotimothy/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-a16w4
Text Generation • Updated
LLiMa LLM models
Language models compiled for SiMa.ai Modalix with the LLiMa runtime. Run them with github.com/dotimothy/neat-genai-studio
Note Compiled A16W4 build for Modalix: 8192-token context, ~46 tok/s.
dotimothy/DeepSeek-R1-Distill-Llama-8B-GPTQ-a16w4
Text Generation • UpdatedNote Compiled A16W4 build for Modalix: 8192-token context, ~11 tok/s, 12/12 on arithmetic.