Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,417

Full-text search

Active filters: 8-bit

Xu-Ouyang/pythia-2.8b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 17, 2024

jermyn/CodeQwen1.5-7B-Chat-lora8-NLQ2Cypher

Updated Jul 11, 2024

userdata/whisper-largeV2-10-ms-v7-LORA-Merged

Automatic Speech Recognition • Updated Jul 11, 2024

Xu-Ouyang/pythia-2.8b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 18, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 12B • Updated Aug 18, 2024 • 5

Xu-Ouyang/pythia-2.8b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 18, 2024

Xu-Ouyang/pythia-2.8b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 3B • Updated Aug 18, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 12B • Updated Aug 17, 2024 • 3

Xu-Ouyang/pythia-12b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 12B • Updated Aug 18, 2024

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • 9B • Updated Jul 23, 2024 • 18 • 2

Ksgk-fy/eCoach-v1-gptq

Text Generation • 8B • Updated Jul 11, 2024

Xu-Ouyang/pythia-12b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 12B • Updated Aug 18, 2024

userdata/whisper-largeV2-05-ms-v8-LORA-Merged

Automatic Speech Recognition • 2B • Updated Jul 11, 2024

userdata/whisper-largeV2-03-ms-v9-LORA-Merged

Automatic Speech Recognition • 2B • Updated Jul 11, 2024 • 1

Ksgk-fy/maria-v2-gptq

Text Generation • 8B • Updated Jul 11, 2024

ahmedsamirio/llama_3_translator_v3

Updated Jul 12, 2024

userdata/whisper-largeV2-06-ms-v10-LORA-Merged

Automatic Speech Recognition • 2B • Updated Jul 11, 2024

nm-testing/Qwen2-0.5B-Instruct

Text Generation • 0.6B • Updated Oct 9, 2024

RedHatAI/Llama-2-7b-chat-quantized.w8a8

Text Generation • 7B • Updated Oct 9, 2024 • 31 • 1

RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Oct 9, 2024 • 386 • 2

RedHatAI/Phi-3-mini-128k-instruct-quantized.w8a8

Text Generation • 4B • Updated Jan 5 • 24

RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8

Text Generation • 14B • Updated Oct 9, 2024 • 7 • 2

RedHatAI/Qwen2-1.5B-Instruct-quantized.w8a8

Text Generation • 2B • Updated Oct 9, 2024 • 504

Xu-Ouyang/pythia-410m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 11

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024 • 3

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.4B • Updated Aug 16, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 2

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024