Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,393

Base only

Active filters: 4-bit

minhbui/viettel_v3.2_adapter

Text Generation • Updated Oct 4, 2023 • 7

TheBloke/Amethyst-13B-Mistral-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 7

TheBloke/Amethyst-13B-Mistral-GPTQ

Text Generation • 13B • Updated Oct 4, 2023 • 49 • 14

Ammad1Ali/alex-gptq-4bit

Text Generation • 7B • Updated Oct 5, 2023 • 6

AyushRaj01/opt-125m-gptq-4bit

Text Generation • Updated Oct 6, 2023 • 4

vsarathy/translator-simple_english-30k-context-llama2-3b

Text Generation • Updated Oct 6, 2023 • 5

Joetib/mistral-finetuned-tutor

Updated Oct 9, 2023 • 1

vsarathy/translator-simple_english-30k-context-falcon-7b

Text Generation • Updated Oct 7, 2023 • 5

TheBloke/CollectiveCognition-v1.1-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 5, 2023 • 34 • 6

TheBloke/CollectiveCognition-v1.1-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 11 • 6

vsarathy/translator-simple_english-30k-no-context-falcon-7b

Text Generation • Updated Oct 5, 2023 • 5

vsarathy/translator-simple_english-30k-no-context-llama2-3b

Text Generation • Updated Oct 5, 2023 • 4

vsarathy/translator-simple_english-30k-no-context-llama2-7b

Text Generation • Updated Oct 5, 2023 • 5

vsarathy/translator-simple_english-30k-context-llama2-7b

Text Generation • Updated Oct 6, 2023 • 4

Arylwen/instruct-palmyra-20b-gptq-4

Text Generation • Updated Oct 5, 2023 • 4

thanhduc1180/llama2chatbot

Text Generation • 7B • Updated Apr 4, 2024 • 7

octa-cba/model_espanol_llama2_7b_es_4bit

Text Generation • Updated Oct 5, 2023 • 8 • 1

chats-bug/multiple-subject-gen-model

Text Generation • Updated Oct 5, 2023 • 5

TheBloke/airoboros-l2-7B-3.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 4

TheBloke/airoboros-l2-13B-3.0-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 7 • 1

TheBloke/airoboros-l2-13B-3.0-GPTQ

Text Generation • 13B • Updated Oct 5, 2023 • 8 • 1

TheBloke/airoboros-l2-7B-3.0-GPTQ

Text Generation • 7B • Updated Oct 5, 2023 • 15

TheBloke/airoboros-m-7B-3.0-GPTQ

Text Generation • 7B • Updated Oct 6, 2023 • 13

TheBloke/airoboros-m-7B-3.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6

TheBloke/llama-2-7B-Arguments-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 7 • 1

TheBloke/llama-2-7B-Arguments-GPTQ

Text Generation • 7B • Updated Oct 6, 2023 • 8 • 2

chats-bug/multiple-subject-gen-finetuned

Text Generation • Updated Oct 6, 2023 • 7

fenil-vc/opt-125m-gptq-4bit

Text Generation • Updated Oct 6, 2023 • 6

tr416/4bit-gpt2-test

Text Generation • Updated Oct 6, 2023 • 8

TheBloke/UndiMix-v4-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 5 • 2