Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,693

Base only

Active filters: 4-bit

TheBloke/SG-Raccoon-Yi-55B-200k-AWQ

Text Generation • 56B • Updated Dec 2, 2023 • 3

TheBloke/SG-Raccoon-Yi-55B-200k-GPTQ

Text Generation • 56B • Updated Dec 2, 2023 • 4

ECj/Yi-6B-200K-AWQ

Text Generation • 6B • Updated Dec 5, 2023 • 1

adamo1139/Yi-34B-AEZAKMI-v1-LoRA

Text Generation • Updated Dec 23, 2023 • 4 • 1

TheBloke/neural-chat-7B-v3-2-AWQ

Text Generation • 7B • Updated Dec 2, 2023 • 4 • 2

TheBloke/DiscoLM-120b-AWQ

Text Generation • 118B • Updated Dec 2, 2023 • 5 • 2

xun/Qwen-Audio-Chat-Int4

Text Generation • Updated Dec 2, 2023 • 17 • 4

TheBloke/neural-chat-7B-v3-2-GPTQ

Text Generation • 7B • Updated Dec 2, 2023 • 17 • 9

TheBloke/DiscoLM-120b-GPTQ

Text Generation • 118B • Updated Dec 3, 2023 • 6 • 3

TheBloke/DPOpenHermes-7B-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 4 • 1

TheBloke/Inairtra-7B-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 5 • 1

TheBloke/loyal-piano-m7-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 9 • 1

TheBloke/Inairtra-7B-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 5 • 2

TheBloke/loyal-piano-m7-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 10

TheBloke/DPOpenHermes-7B-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 7 • 3

athirdpath/BigMistral-13b-GLUE_LORA

Updated Dec 3, 2023 • 2 • 1

AshanGimhana/llama2-model-GPTQ-V1

Text Generation • 0.1B • Updated Dec 3, 2023 • 2

neboolaai/NAI-3.5

Text Generation • 7B • Updated Dec 7, 2023 • 5 • 5

TheBloke/DiscoLM-70B-GPTQ

Text Generation • 69B • Updated Dec 6, 2023 • 5 • 4

TheBloke/OpenHermes-2.5-neural-chat-7B-v3-2-7B-AWQ

Text Generation • 7B • Updated Dec 4, 2023 • 10 • 5

TheBloke/notus-7B-v1-AWQ

Text Generation • 7B • Updated Dec 4, 2023 • 6 • 3

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

Pi3141/alpaca-7b-native-enhanced-GPTQ-safetensors

Text Generation • Updated Dec 3, 2023 • 1

athirdpath/BigMistral-11b-GLUE_LORA

Text Generation • Updated Dec 5, 2023 • 7

codegood/Mistral_instruct_latest

Updated Dec 27, 2023 • 1

TheBloke/notus-7B-v1-GPTQ

Text Generation • 7B • Updated Dec 4, 2023 • 13 • 2

TheBloke/OpenHermes-2.5-neural-chat-7B-v3-2-7B-GPTQ

Text Generation • 7B • Updated Dec 4, 2023 • 5 • 5

iproskurina/bloom-1b7-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29, 2025 • 11

Narya-ai/zephyr-7b-sft-lora

Text Generation • Updated Dec 5, 2023 • 2

Jack2022/opt-125m-gptq-4bit

Text Generation • 0.1B • Updated Dec 4, 2023 • 1