Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,680

Full-text search

Active filters: 4-bit

TheBloke/Kimiko-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 70 • 4

leoclement/llama-2-7b-4bit

Feature Extraction • Updated Jul 27, 2023 • 1

TheBloke/StableBeluga-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 10 • 32

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 26 • 13

TheBloke/StableBeluga-7B-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 12 • 19

TheBloke/Vigogne-2-13B-Instruct-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 11 • 3

TheBloke/Vigogne-2-7B-Instruct-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 42 • 3

TheBloke/Upstage-Llama-2-70B-instruct-v2-GPTQ

Text Generation • 69B • Updated Oct 18, 2023 • 162 • 18

marcsun13/opt-350m-gptq-4bit

Text Generation • Updated Jul 31, 2023 • 939

TheBloke/OpenChat_v3.2-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 9 • 12

aiknight87/falcon-40b-instruct-tuned-income-tax

Updated Jul 31, 2023 • 1

ybelkada/opt-125m-gptq-4bit

Text Generation • Updated Jul 31, 2023 • 361

TheBloke/airoboros-33B-GPT4-m2.0-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 91 • 9

TheBloke/airoboros-l2-13b-gpt4-2.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 15 • 16

TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 17 • 30

TheBloke/airoboros-l2-7B-gpt4-2.0-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 13 • 8

TheBloke/airoboros-l2-7B-gpt4-m2.0-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 8 • 8

TheBloke/airoboros-33B-GPT4-2.0-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 7 • 14

TheBloke/NewHope-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 8 • 21

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 43 • 15

TheBloke/OpenAssistant-Llama2-13B-Orca-v2-8K-3166-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 14 • 24

Mursel/llama-2-7b-chat-hf-finetuned2-turkish

Updated Aug 2, 2023 • 2 • 1

TheBloke/airoboros-l2-70B-GPT4-2.0-GPTQ

Text Generation • 69B • Updated Sep 27, 2023 • 9 • 17

TheBloke/Hermes-LLongMA-2-13B-8K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 7 • 9

TheBloke/Hermes-LLongMA-2-7B-8K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 4 • 4

TheBloke/vicuna-13B-v1.5-16K-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 16 • 33

TheBloke/vicuna-7B-v1.5-16K-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 9 • 10

TheBloke/OpenOrcaxOpenChat-Preview2-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 40 • 20

TheBloke/vicuna-7B-v1.5-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 80 • 17

TheBloke/vicuna-13B-v1.5-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 19 • 12