Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,788

Full-text search

Active filters: 4-bit

TheBloke/Mistral-7B-OpenOrca-oasst_top1_2023-08-25-v1-GPTQ

Text Generation • 7B • Updated Nov 12, 2023 • 4 • 1

wizcat/internlm-chat-7b-v1_1-gptq

Feature Extraction • 7B • Updated Nov 12, 2023 • 1

TheBloke/Augmental-ReMM-13B-AWQ

Text Generation • 13B • Updated Nov 12, 2023 • 4 • 1

TheBloke/Augmental-ReMM-13B-GPTQ

Text Generation • 13B • Updated Nov 12, 2023 • 1 • 3

TheBloke/Noromaid-13B-v0.1-GPTQ

Text Generation • 13B • Updated Nov 12, 2023 • 4

TheBloke/Noromaid-13B-v0.1-AWQ

Text Generation • 13B • Updated Nov 12, 2023 • 44 • 1

mohan007/Qwen-VL-Chat-Int4

Text Generation • 10B • Updated Nov 13, 2023 • 4

ranchlai/llama2-70B-gptq-4bit-512g

Text Generation • Updated Nov 13, 2023 • 1

NobodyExistsOnTheInternet/llama-2-7b-unchat

Text Generation • Updated Nov 13, 2023 • 1

NobodyExistsOnTheInternet/llama-2-13b-unchat

Updated Nov 13, 2023

TheBloke/Nous-Capybara-34B-AWQ

Text Generation • 34B • Updated Nov 15, 2023 • 8 • 13

TheBloke/Nous-Capybara-34B-GPTQ

Text Generation • 34B • Updated Nov 15, 2023 • 11 • 20

TheBloke/dolphin-2_2-yi-34b-AWQ

Text Generation • 34B • Updated Nov 13, 2023 • 8 • 12

TheBloke/dolphin-2_2-yi-34b-GPTQ

Text Generation • 34B • Updated Nov 14, 2023 • 12 • 9

TheBloke/Noromaid-13B-v0.1.1-AWQ

Text Generation • 13B • Updated Nov 14, 2023 • 3 • 3

TheBloke/Synatra-7B-v0.3-RP-AWQ

Text Generation • 7B • Updated Nov 23, 2023 • 4 • 1

TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-AWQ

Text Generation • 7B • Updated Nov 14, 2023 • 5 • 3

haoranz/open_llama_13b-int4

Text Generation • 13B • Updated Nov 14, 2023 • 1

TheBloke/Synatra-7B-v0.3-RP-GPTQ

Text Generation • 7B • Updated Nov 23, 2023 • 5 • 6

TheBloke/Noromaid-13B-v0.1.1-GPTQ

Text Generation • 13B • Updated Nov 14, 2023 • 3

TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-GPTQ

Text Generation • 7B • Updated Nov 14, 2023 • 9 • 1

DonatePlz/openchat_3.5-16k-merged-AWQ

Text Generation • 7B • Updated Nov 14, 2023 • 12 • 1

TheBloke/Claire-7B-0.1-GPTQ

Text Generation • 7B • Updated Nov 14, 2023 • 8 • 1

TheBlokeAI/llama-68m-GPTQ-sharded

Text Generation • 68.1M • Updated Nov 14, 2023 • 48

TheBloke/TransNormerLLM-7B-GPTQ

Text Generation • 7B • Updated Nov 14, 2023 • 5 • 5

TheBloke/Claire-7B-0.1-AWQ

Text Generation • 7B • Updated Nov 14, 2023 • 4 • 2

TheBloke/opus-v0-70B-GPTQ

Text Generation • 69B • Updated Nov 14, 2023 • 4 • 1

TheBloke/opus-v0-70B-AWQ

Text Generation • 69B • Updated Nov 14, 2023 • 3 • 1

TheBloke/Python-Code-13B-AWQ

Text Generation • 13B • Updated Nov 14, 2023 • 5 • 1

TheBloke/Python-Code-33B-AWQ

Text Generation • 33B • Updated Nov 14, 2023 • 4 • 1