Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,287

Base only

Active filters: 4-bit

Medilora/guideline-adapter

Text Generation • Updated Dec 6, 2023 • 5

rycont/EleutherAI__polyglot-ko-1.3b-awq

Text Generation • 1B • Updated Dec 1, 2023 • 5

TheBloke/cinematika-7B-v0.1-AWQ

Text Generation • 7B • Updated Dec 1, 2023 • 8 • 1

TheBloke/cinematika-7B-v0.1-GPTQ

Text Generation • 7B • Updated Dec 1, 2023 • 9

TheBloke/juanako-7B-UNA-GPTQ

Text Generation • 7B • Updated Dec 1, 2023 • 10 • 2

TheBloke/juanako-7B-UNA-AWQ

Text Generation • 7B • Updated Dec 1, 2023 • 13 • 2

oieieio/Orca-2-13b-awq

Text Generation • 13B • Updated Dec 3, 2023 • 6

mzbac/Yi-34B-Llama-guanaco-awq

Text Generation • 34B • Updated Dec 2, 2023 • 4

TheBloke/SG-Raccoon-Yi-55B-200k-AWQ

Text Generation • 56B • Updated Dec 2, 2023 • 5

TheBloke/SG-Raccoon-Yi-55B-200k-GPTQ

Text Generation • 56B • Updated Dec 2, 2023 • 11

ECj/Yi-6B-200K-AWQ

Text Generation • 6B • Updated Dec 5, 2023 • 6

adamo1139/Yi-34B-AEZAKMI-v1-LoRA

Text Generation • Updated Dec 23, 2023 • 8 • 1

TheBloke/neural-chat-7B-v3-2-AWQ

Text Generation • 7B • Updated Dec 2, 2023 • 7 • 2

TheBloke/DiscoLM-120b-AWQ

Text Generation • 118B • Updated Dec 2, 2023 • 7 • 2

xun/Qwen-Audio-Chat-Int4

Text Generation • Updated Dec 2, 2023 • 6 • 4

TheBloke/neural-chat-7B-v3-2-GPTQ

Text Generation • 7B • Updated Dec 2, 2023 • 14 • 9

TheBloke/DiscoLM-120b-GPTQ

Text Generation • 118B • Updated Dec 3, 2023 • 7 • 3

TheBloke/DPOpenHermes-7B-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 7 • 1

TheBloke/Inairtra-7B-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 6 • 1

TheBloke/loyal-piano-m7-AWQ

Text Generation • 7B • Updated Dec 3, 2023 • 6 • 1

TheBloke/Inairtra-7B-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 6 • 2

TheBloke/loyal-piano-m7-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 12

TheBloke/DPOpenHermes-7B-GPTQ

Text Generation • 7B • Updated Dec 3, 2023 • 11 • 3

athirdpath/BigMistral-13b-GLUE_LORA

Updated Dec 3, 2023 • 12 • 1

AshanGimhana/llama2-model-GPTQ-V1

Text Generation • 0.1B • Updated Dec 3, 2023 • 7

neboolaai/NAI-3.5

Text Generation • 7B • Updated Dec 7, 2023 • 9 • 5

TheBloke/DiscoLM-70B-GPTQ

Text Generation • 69B • Updated Dec 6, 2023 • 14 • 4

TheBloke/OpenHermes-2.5-neural-chat-7B-v3-2-7B-AWQ

Text Generation • 7B • Updated Dec 4, 2023 • 13 • 5

TheBloke/notus-7B-v1-AWQ

Text Generation • 7B • Updated Dec 4, 2023 • 119 • 3

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2