harshithsaiv/kv-cache-compression
Updated
Edit Models filters
Apps
Inference Providers
Active filters: quantization
EugeneMeng/Short-Drama-Title-Generator-4B-IQ4_NL-GGUF
Text Generation • 4B • Updated • 202
forkjoin-ai/tinyllama-1b-rknot
Updated
forkjoin-ai/mistral-7b-v3-rknot
Updated
forkjoin-ai/qwen2.5-7b-rknot
Updated
forkjoin-ai/deepseek-r1-7b-rknot
Updated
forkjoin-ai/llama-70b-rknot
Updated
forkjoin-ai/llama-70b-partial-rknot
Updated
Reinforce-ai/Qwen3.6-35B-A3B-Spiral
Text Generation • 35B • Updated • 215
embedl/mobilevit-small-quantized
Image Classification • Updated • 22
RthItalia/nano_compact_3b_qkvfp16
Text Generation • 2B • Updated • 27
madhurithika22/mistral-compressed
Text Generation • 7B • Updated • 65
SipsaLabs/qwen3-32b-streaming-bpw5
Updated
SipsaLabs/qwen2.5-72b-streaming-bpw5
Updated
Entrit/tritllm-codec
Updated
Entrit/tritllm-kernel
Updated
Entrit/Llama-3.1-8B-trit-uniform-d1
Text Generation • 8B • Updated • 96
Entrit/Llama-3.1-8B-trit-uniform-d3
Text Generation • 8B • Updated • 137
Entrit/Llama-3.1-8B-trit-uniform-d2
Text Generation • 8B • Updated • 148
Entrit/Llama-3.1-8B-trit-uniform-d4
Text Generation • 8B • Updated • 150
Entrit/Mistral-7B-v0.3-trit-uniform-d1
Text Generation • 7B • Updated • 89
Entrit/Mistral-7B-v0.3-trit-uniform-d2
Text Generation • 7B • Updated • 135
Entrit/Mistral-7B-v0.3-trit-uniform-d3
Text Generation • 7B • Updated • 148
Entrit/Mistral-7B-v0.3-trit-uniform-d4
Text Generation • 7B • Updated • 142
Entrit/Qwen2.5-0.5B-trit-uniform-d1
Text Generation • 0.5B • Updated • 172
Entrit/Qwen2.5-0.5B-trit-uniform-d2
Text Generation • 0.5B • Updated • 215
Entrit/Qwen2.5-0.5B-trit-uniform-d3
Text Generation • 0.5B • Updated • 232
Entrit/Qwen2.5-0.5B-trit-uniform-d4
Text Generation • 0.5B • Updated • 224
Entrit/Qwen2.5-1.5B-trit-uniform-d1
Text Generation • 2B • Updated • 163
Entrit/Qwen2.5-1.5B-trit-uniform-d2
Text Generation • 2B • Updated • 226