Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,416

Full-text search

Active filters: 8-bit

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024

Adeptschneider/dyu_to_fr_v8.0_flan-t5-8bit

0.2B • Updated Jul 12, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 7B • Updated Aug 17, 2024 • 1

nhotin/vistral7B-legalbizai-q8-gguf

Text Generation • 7B • Updated Jul 12, 2024

RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8

Text Generation • 0.6B • Updated Oct 9, 2024 • 10

RedHatAI/Qwen2-7B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Oct 9, 2024 • 61

Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024

Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 0.2B • Updated Aug 16, 2024 • 1

Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024 • 1

Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024

Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • 1B • Updated Aug 22, 2024

myrulezzzz/newdata_mistral4bit

Text Generation • 4B • Updated Jul 13, 2024 • 1

ZeZanZiet/blip2_image_captioning_v1

Updated Sep 18, 2024

bullerwins/Big-Tiger-Gemma-27B-v1-exl2_8.0bpw

Text Generation • Updated Jul 14, 2024 • 1

smokxy/agri_bert_classifier_quantized

Text Classification • 0.1B • Updated Jul 14, 2024 • 1

RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Oct 9, 2024 • 64

smokxy/roberta-base-squad2-quantized

Question Answering • 0.1B • Updated Aug 5, 2024 • 1

Aung2024/labour_law

Text Generation • 0.7B • Updated Jul 18, 2024 • 1

dphn/dolphin-2.9.2-qwen2-72b-eetq

Text Generation • 73B • Updated Jul 15, 2024 • 10 • 1

HRuiii/Llama-2-7b-GPTQ-8bit

Text Generation • Updated Jul 15, 2024

Ksgk-fy/maria_v113_gptq_prompt

Text Generation • 8B • Updated Jul 15, 2024 • 1

RedHatAI/Qwen2-72B-Instruct-quantized.w8a8

Text Generation • 73B • Updated Oct 9, 2024 • 4 • 2

FuturisticVibes/Llama-3-Chatty-2x8B-8.0bpw-h8-exl2

Text Generation • Updated Jul 16, 2024 • 1