Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,299

Base only

Active filters: 4-bit

TheBloke/SeraphMarcoroni-7B-GPTQ

Text Generation • 7B • Updated Dec 12, 2023 • 7

TheBloke/Marcoroni-neural-chat-7B-v1-GPTQ

Text Generation • 7B • Updated Dec 13, 2023 • 10 • 2

TheBloke/Code-33B-GPTQ

Text Generation • 33B • Updated Dec 13, 2023 • 3 • 2

TheBloke/Code-33B-AWQ

Text Generation • 33B • Updated Dec 13, 2023 • 5 • 3

TheBloke/OpenZephyrChat-GPTQ

Text Generation • 7B • Updated Dec 13, 2023 • 11 • 1

naive-puzzle/Mixtral-8x7B-v0.1-gptq-4bit

Text Generation • 47B • Updated Dec 13, 2023 • 6

naive-puzzle/Mixtral-8x7B-v0.1-gptq-4bit-pth

Text Generation • Updated Dec 13, 2023 • 3

athirdpath/Zeta-17b_LORA

Updated Dec 13, 2023 • 2

TheBloke/openbuddy-llama2-13b64k-v15-AWQ

Text Generation • 13B • Updated Dec 13, 2023 • 5 • 1

TheBloke/openbuddy-llama2-13b64k-v15-GPTQ

Text Generation • 13B • Updated Dec 13, 2023 • 6

IndicRAGware/mistral-hindi-qlora-RAG-7b-v0.1

Updated Dec 13, 2023 • 6

EuriskoMobility/OpenOrca-Zephyr-7B-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 5

gokul00060/loara-chat-arm

Updated Dec 15, 2023 • 2

TheBloke/MadMix-v0.2-GPTQ

Text Generation • 7B • Updated Dec 13, 2023 • 11

TheBloke/MadMix-v0.2-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 5

TheBloke/SOLAR-10.7B-Instruct-v1.0-AWQ

Text Generation • 11B • Updated Dec 13, 2023 • 241 • 5

TheBloke/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • 11B • Updated Dec 13, 2023 • 64 • 12

TheBloke/SOLAR-10.7B-v1.0-GPTQ

Text Generation • 11B • Updated Dec 13, 2023 • 12 • 2

TheBloke/SOLAR-10.7B-v1.0-AWQ

Text Generation • 11B • Updated Dec 13, 2023 • 7 • 1

TheBloke/blossom-v3_1-yi-34b-AWQ

Text Generation • 34B • Updated Dec 13, 2023 • 5

EuriskoMobility/orca_mini_v3_13B-AWQ

Text Generation • 13B • Updated Dec 13, 2023 • 6

EuriskoMobility/orca_mini_v3_13B-GPTQ

Text Generation • 13B • Updated Dec 13, 2023 • 3

EuriskoMobility/zephyr-7B-beta-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 7

TheBloke/blossom-v3_1-yi-34b-GPTQ

Text Generation • 34B • Updated Dec 13, 2023 • 9

TheBloke/Nyxene-v3-11B-AWQ

Text Generation • 11B • Updated Dec 13, 2023 • 8 • 1

TheBloke/meditron-7B-chat-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 15

TheBloke/Ana-v1-m7-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 4 • 2

TheBloke/Mixtral-SlimOrca-8x7B-GPTQ

Text Generation • 47B • Updated Dec 14, 2023 • 11 • 11

TheBloke/v1olet_merged_dpo_7B_v3-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 3 • 1

TheBloke/v1olet_merged_dpo_7B_v4-AWQ

Text Generation • 7B • Updated Dec 13, 2023 • 4 • 1