Edit Models filters

Model Tree

Apps

llama.cpp

LM Studio

Inference Providers

OVHcloud AI Endpoints

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

Models

1,820

Base only

Active filters: quantization

wenshutang/ternlight

donghyunli/Llama-2-70b-KronQ-W4A16

Text Generation • 35B • Updated 3 days ago

donghyunli/Llama-2-70b-KronQ-W2A16

Text Generation • 18B • Updated 3 days ago

donghyunli/Meta-Llama-3-70B-KronQ-W4A16

Text Generation • 36B • Updated 3 days ago

donghyunli/Meta-Llama-3-70B-KronQ-W2A16

Text Generation • 19B • Updated 3 days ago

donghyunli/Llama-2-70b-KronQ-W3A16-fake

Text Generation • 69B • Updated 3 days ago • 14

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-fake

Text Generation • 71B • Updated 3 days ago • 16

pearsonkyle/tmax-27b-imatrix-MTP-GGUF

Text Generation • 27B • Updated about 15 hours ago • 1.82k

anoopbhargavakm87/Meta-Llama-3-8B-Instruct-4bit-Compressed

Text Generation • 8B • Updated 2 days ago • 24

tooltd/Qwen3.6-27B-AutoRound-GGUF-NoMTP

27B • Updated 1 day ago • 67

xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd

Image-Text-to-Text • 2B • Updated about 22 hours ago • 32

ShockleyWong/gemma4-e2b-rdk-s100p

Image-Text-to-Text • Updated 1 day ago

nameistoken/Step-3.7-Flash-Quark-W4A16

Image-Text-to-Text • 203B • Updated 1 day ago • 1

nameistoken/Step-3.7-Flash-Quark-W8A8

Image-Text-to-Text • 201B • Updated 1 day ago • 6

Abhimanue/TCompress

0.1B • Updated 1 day ago

Fredred89/Qwopus3.6-27B-Coder-GGUF-kaitchup-MoQ-4.0

Updated 1 day ago

Fredred89/Qwopus3.6-27B-Coder-GGUF-ASI-MoQ-4.0

Updated 1 day ago

donghyunli/Llama-2-7b-KronQ-W4A16-g128

Text Generation • 4B • Updated 1 day ago • 1

donghyunli/Llama-2-7b-KronQ-W2A16-g128

Text Generation • 2B • Updated 1 day ago • 1

donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128

Text Generation • 5B • Updated 1 day ago • 1

donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128

Text Generation • 3B • Updated 1 day ago • 1

donghyunli/Llama-2-13b-KronQ-W4A16-g128

Text Generation • 7B • Updated 1 day ago • 1

donghyunli/Llama-2-70b-KronQ-W4A16-g128

Text Generation • 36B • Updated 1 day ago • 1

donghyunli/Llama-2-13b-KronQ-W2A16-g128

Text Generation • 4B • Updated 1 day ago • 1