Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,979

Full-text search

Active filters: 3-bit

Xu-Ouyang/pythia-12b-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • 11B • Updated Jul 30, 2024

Xu-Ouyang/pythia-12b-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • 11B • Updated Jul 30, 2024

Xu-Ouyang/pythia-6.9b-deduped-int3-step2000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024

Xu-Ouyang/pythia-6.9b-deduped-int3-step4000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024

Xu-Ouyang/pythia-6.9b-deduped-int3-step6000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024

Xu-Ouyang/pythia-6.9b-deduped-int3-step8000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024 • 1

Xu-Ouyang/pythia-6.9b-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024

Xu-Ouyang/pythia-6.9b-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • 6B • Updated Jul 30, 2024 • 1

Xu-Ouyang/pythia-160m-deduped-int3-step2000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024 • 7

Xu-Ouyang/pythia-160m-deduped-int3-step4000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024

Xu-Ouyang/pythia-160m-deduped-int3-step6000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024

Xu-Ouyang/pythia-160m-deduped-int3-step8000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024 • 1

Xu-Ouyang/pythia-160m-deduped-int3-step10000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024

Xu-Ouyang/pythia-160m-deduped-int3-step12000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Jul 30, 2024 • 1

Xu-Ouyang/Llama-2-13b-hf-int3-GPTQ-wikitext2

Text Generation • 12B • Updated Jul 31, 2024

Xu-Ouyang/Qwen2-0.5B-int3-GPTQ-wikitext2

Text Generation • 0.5B • Updated Jul 31, 2024

Xu-Ouyang/Qwen2-1.5B-int3-GPTQ-wikitext2

Text Generation • 1B • Updated Jul 31, 2024

Xu-Ouyang/Qwen1.5-0.5B-int3-GPTQ-wikitext2

Text Generation • 0.4B • Updated Jul 31, 2024

Xu-Ouyang/Qwen1.5-1.8B-int3-GPTQ-wikitext2

Text Generation • 2B • Updated Jul 31, 2024 • 1

Xu-Ouyang/Qwen1.5-14B-int3-GPTQ-wikitext2

Text Generation • 13B • Updated Jul 31, 2024 • 1

Xu-Ouyang/Qwen1.5-4B-int3-GPTQ-wikitext2

Text Generation • 4B • Updated Aug 1, 2024 • 1

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 95.1k • 14

Xu-Ouyang/Meta-Llama-3.1-8B-int3-GPTQ-wikitext2

Text Generation • 8B • Updated Aug 1, 2024

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • 73B • Updated Aug 6, 2024 • 62 • 2

MaziyarPanahi/RYS-XLarge-GGUF

Text Generation • 78B • Updated Aug 6, 2024 • 109 • 7

MaziyarPanahi/calme-2.3-legalkit-8b-GGUF

Text Generation • 8B • Updated Aug 7, 2024 • 284 • 8

TeeZee/2xbagel-34b-v0.2-bpw3.0-h6-exl2

Text Generation • Updated Aug 7, 2024 • 1

Xu-Ouyang/FloatLM_3.9B-int3-GPTQ-wikitext2

Text Generation • 4B • Updated Aug 7, 2024

Xu-Ouyang/FloatLM_99M-int3-GPTQ-wikitext2

Text Generation • 96.8M • Updated Aug 7, 2024 • 1

Xu-Ouyang/FloatLM_190M-int3-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 7, 2024 • 1