Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,390

Base only

Active filters: 4-bit

Royal-lobster/Slither-LLM-Auditor-LoRA-Adapter

Text Generation • Updated Oct 13, 2023 • 4

TheBloke/speechless-code-mistral-7B-v1.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 8 • 2

TheBloke/speechless-code-mistral-7B-v1.0-GPTQ

Text Generation • 7B • Updated Oct 13, 2023 • 16 • 2

TheBloke/CollectiveCognition-v1-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 6 • 2

TheBloke/CollectiveCognition-v1-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 13, 2023 • 9 • 4

q-allen/Taiwan-LLM-7B-v2.0.1-chat-4bits-GPTQ

Text Generation • Updated Oct 25, 2023 • 8 • 1

TheBloke/speechless-codellama-34b-v2.0-GPTQ

Text Generation • 34B • Updated Oct 14, 2023 • 5 • 4

TheBloke/speechless-tora-code-7B-v1.0-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 11 • 1

TheBloke/speechless-tora-code-7B-v1.0-GPTQ

Text Generation • 7B • Updated Oct 13, 2023 • 8 • 1

Severian/ANIMA-Phi-Neptune-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 13, 2023 • 6 • 1

TheBloke/speechless-codellama-34b-v2.0-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 6 • 6

typeof/Mistral-7B-v0.1-GPTQ

Text Generation • 7B • Updated Oct 13, 2023 • 4

AIR-HF/Cerebrix_7b

Text Generation • Updated Oct 24, 2023 • 5

TheBloke/OpenHermes-2-Mistral-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 82 • 18

TheBloke/OpenHermes-2-Mistral-7B-GPTQ

Text Generation • 7B • Updated Oct 16, 2023 • 67 • 25

aiknight87/llama-2-7b-hf-new1

Updated Oct 14, 2023 • 7

TheBloke/ShiningValiant-1.2-GPTQ

Text Generation • 69B • Updated Oct 14, 2023 • 7 • 2

TheBloke/ShiningValiant-1.2-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 4

TheBloke/SauerkrautLM-13B-v1-GPTQ

Text Generation • 13B • Updated Oct 14, 2023 • 7 • 4

TheBloke/SauerkrautLM-13B-v1-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 4 • 1

aiknight87/mistralai-7b-new1

Updated Oct 14, 2023 • 5

Achyuth4/OpenGPT-7b-0.1

Text Generation • 7B • Updated Dec 31, 2023 • 8 • 1

TheBloke/ALMA-13B-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 10 • 3

TheBloke/ALMA-13B-GPTQ

Text Generation • 13B • Updated Oct 14, 2023 • 7 • 2

TheBloke/ALMA-7B-GPTQ

Text Generation • 7B • Updated Oct 14, 2023 • 9 • 1

TheBloke/ALMA-7B-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 8 • 1

TheBloke/tora-13B-v1.0-GPTQ

Text Generation • 13B • Updated Oct 14, 2023 • 5

TheBloke/tora-13B-v1.0-AWQ

Text Generation • 13B • Updated Nov 9, 2023 • 6

TheBloke/tora-70B-v1.0-GPTQ

Text Generation • 69B • Updated Oct 14, 2023 • 5 • 1

TheBloke/tora-70B-v1.0-AWQ

Text Generation • 69B • Updated Nov 9, 2023 • 6