Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11

Base only

Active filters: fake-quant

vrfai/Qwen3-ASR-0.6B-int4-FakeQuant

Automatic Speech Recognition • 0.9B • Updated 6 days ago • 1

donghyunli/Llama-2-7b-KronQ-W3A16-fake

Text Generation • 7B • Updated Jul 24 • 111

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-fake

Text Generation • 8B • Updated Jul 14 • 73

donghyunli/Llama-2-13b-KronQ-W3A16-fake

Text Generation • 13B • Updated Jul 14 • 66

donghyunli/Llama-2-70b-KronQ-W3A16-fake

Text Generation • 69B • Updated Jul 14 • 62

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-fake

Text Generation • 71B • Updated Jul 14 • 59

donghyunli/Llama-2-7b-KronQ-W3A16-g128-fake

Text Generation • 7B • Updated Jul 24 • 107

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-g128-fake

Text Generation • 8B • Updated Jul 14 • 101

donghyunli/Llama-2-13b-KronQ-W3A16-g128-fake

Text Generation • 13B • Updated Jul 14 • 77

donghyunli/Llama-2-70b-KronQ-W3A16-g128-fake

Text Generation • 69B • Updated Jul 14 • 61

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-g128-fake

Text Generation • 71B • Updated Jul 14 • 57