Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,869

Full-text search

Active filters: 4-bit

cadaeic/llama2-7b-recipe-qlora

Text Generation • Updated Oct 4, 2023

TheBloke/Dans-AdventurousWinds-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 1

TheBloke/Dans-AdventurousWinds-7B-GPTQ

Text Generation • 7B • Updated Oct 4, 2023 • 2 • 2

TheBloke/Dans-TotSirocco-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 2 • 1

TheBloke/Dans-TotSirocco-7B-GPTQ

Text Generation • 7B • Updated Oct 4, 2023 • 1 • 2

TheBloke/Mistralic-7B-1-GPTQ

Text Generation • 7B • Updated Oct 4, 2023 • 4 • 6

TheBloke/Mistralic-7B-1-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 5 • 2

vsarathy/parser-info_structure-30k-no-context-llama2-3b

Text Generation • Updated Oct 4, 2023

vsarathy/parser-info_structure-30k-context-llama2-3b

Text Generation • Updated Oct 5, 2023

TheBloke/Llama-2-7B-vietnamese-20k-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 2 • 5

TheBloke/Llama-2-7B-vietnamese-20k-GPTQ

Text Generation • 7B • Updated Oct 4, 2023 • 5 • 2

minhbui/viettel_v3.2_adapter

Text Generation • Updated Oct 4, 2023 • 3

TheBloke/Amethyst-13B-Mistral-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 6 • 7

TheBloke/Amethyst-13B-Mistral-GPTQ

Text Generation • 13B • Updated Oct 4, 2023 • 6 • 14

Ammad1Ali/alex-gptq-4bit

Text Generation • 7B • Updated Oct 5, 2023 • 3

AyushRaj01/opt-125m-gptq-4bit

Text Generation • Updated Oct 6, 2023 • 1

vsarathy/translator-simple_english-30k-context-llama2-3b

Text Generation • Updated Oct 6, 2023 • 6

Joetib/mistral-finetuned-tutor

Updated Oct 9, 2023 • 1

vsarathy/translator-simple_english-30k-context-falcon-7b

Text Generation • Updated Oct 7, 2023 • 1

TheBloke/CollectiveCognition-v1.1-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 5, 2023 • 10 • 6

TheBloke/CollectiveCognition-v1.1-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 12 • 6

vsarathy/translator-simple_english-30k-no-context-falcon-7b

Text Generation • Updated Oct 5, 2023

vsarathy/translator-simple_english-30k-no-context-llama2-3b

Text Generation • Updated Oct 5, 2023 • 1

vsarathy/translator-simple_english-30k-no-context-llama2-7b

Text Generation • Updated Oct 5, 2023

vsarathy/translator-simple_english-30k-context-llama2-7b

Text Generation • Updated Oct 6, 2023

Arylwen/instruct-palmyra-20b-gptq-4

Text Generation • Updated Oct 5, 2023 • 1

thanhduc1180/llama2chatbot

Text Generation • 7B • Updated Apr 4, 2024 • 1

octa-cba/model_espanol_llama2_7b_es_4bit

Text Generation • Updated Oct 5, 2023 • 3 • 1

chats-bug/multiple-subject-gen-model

Text Generation • Updated Oct 5, 2023 • 2

TheBloke/airoboros-l2-7B-3.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 2