Models

212

Full-text search

Active filters: kv-cache-quantization

majentik/gemma-4-E4B-turboquant

Image-Text-to-Text • 8B • Updated 2 days ago • 419 • 6

majentik/Qwen3.5-27B-RotorQuant

Updated 3 days ago • 1

majentik/gemma-4-31B-TurboQuant-MLX-8bit

Image-Text-to-Text • 9B • Updated 2 days ago • 206 • 1

majentik/gemma-4-31B-RotorQuant-GGUF-Q8_0

31B • Updated 2 days ago • 99 • 1

majentik/gemma-4-31B-it-RotorQuant-GGUF-Q8_0

31B • Updated 2 days ago • 48 • 1

majentik/Qwen3.5-27B-RotorQuant-GGUF-Q2_K

27B • Updated 1 day ago • 216 • 1

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M

25B • Updated 2 days ago • 466 • 1

rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 5

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 7

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 30 days ago • 18

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 30 days ago • 7

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 7 days ago • 34

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 29 days ago • 5

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 29 days ago • 6

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 29 days ago • 4

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 13 days ago • 18

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 13 days ago • 15

majentik/gemma-4-E4B-rotorquant

Image-Text-to-Text • Updated 2 days ago

majentik/MERaLiON-3-10B-RotorQuant

Updated 3 days ago

majentik/MERaLiON-2-10B-RotorQuant

Translation • Updated 3 days ago

majentik/MERaLiON-2-3B-RotorQuant

Translation • Updated 3 days ago

majentik/Qwen3.5-27B-TurboQuant

Updated 3 days ago

majentik/Qwen3.5-27B-TurboQuant-MLX-4bit

27B • Updated 2 days ago • 157

majentik/Qwen3.5-27B-TurboQuant-MLX-8bit

27B • Updated 2 days ago • 112

majentik/Qwen3.5-27B-RotorQuant-MLX-4bit

27B • Updated 2 days ago • 112

majentik/Qwen3.5-27B-RotorQuant-MLX-8bit

27B • Updated 2 days ago • 93

majentik/Mistral-Small-4-119B-TurboQuant

Text Generation • Updated 2 days ago

majentik/Mistral-Small-4-119B-RotorQuant

Text Generation • Updated 2 days ago

majentik/Leanstral-TurboQuant

Updated 2 days ago

majentik/Leanstral-RotorQuant

Updated 2 days ago