Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

48,294

Base only

Active filters: 4-bit

cshulby/phi_1_5_KelmTiny

Text Generation • Updated Nov 21, 2023 • 6

BradClem/chess-chat-1.0-3b-Q4

Text Generation • 3B • Updated Nov 21, 2023 • 6

un-model-runs/prep-coarse-relevancy-meta-llamaLlama-2-7b-hf-1000-ai-00-reddit-train-data-IO5B

Text Generation • Updated Nov 21, 2023 • 5

TheBloke/gorilla-openfunctions-v1-AWQ

Text Generation • 7B • Updated Nov 21, 2023 • 6

TheBloke/gorilla-openfunctions-v1-GPTQ

Text Generation • 7B • Updated Nov 21, 2023 • 11 • 5

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-high-rank-cuda-118

Text Generation • Updated Nov 22, 2023 • 4

un-model-runs/prep-coarse-relevancy-meta-llamaLlama-2-7b-hf-1000-ai-00-reddit-train-data-PWiR

Text Generation • Updated Nov 21, 2023 • 5

TheBloke/openinstruct-mistral-7B-AWQ

Text Generation • 7B • Updated Nov 26, 2023 • 7

TheBloke/openinstruct-mistral-7B-GPTQ

Text Generation • 7B • Updated Nov 26, 2023 • 8 • 3

Chat-Error/Testing_orca

Text Generation • Updated Nov 24, 2023 • 5 • 1

LoftQ/Mistral-7B-v0.1-4bit-64rank

Text Generation • 7B • Updated Apr 18, 2024 • 7 • 1

csdc-atl/buffer-baichuan2-13B-rag-4bits

Text Generation • 3B • Updated Dec 5, 2023 • 6

flozi00/Mistral-7B-german-assistant-v5-4bit-autogptq

Text Generation • 7B • Updated Nov 22, 2023 • 5 • 1

TheBloke/MythoMist-7B-AWQ

Text Generation • 7B • Updated Nov 22, 2023 • 6 • 4

TheBloke/MythoMist-7B-GPTQ

Text Generation • 7B • Updated Nov 22, 2023 • 11 • 5

TheBloke/Tess-M-v1.1-GPTQ

Text Generation • 34B • Updated Nov 22, 2023 • 25 • 1

TheBloke/Tess-M-v1.1-AWQ

Text Generation • 34B • Updated Nov 22, 2023 • 7 • 1

01-ai/Yi-34B-Chat-4bits

Text Generation • 34B • Updated Nov 11, 2024 • 384 • 60

01-ai/Yi-6B-Chat-4bits

Text Generation • 6B • Updated Nov 11, 2024 • 156 • 21

sharkMeow/results

Updated Nov 25, 2023 • 3

TheBloke/OrionStar-Yi-34B-Chat-Llama-GPTQ

Text Generation • 34B • Updated Nov 22, 2023 • 16 • 4

TheBloke/OrionStar-Yi-34B-Chat-Llama-AWQ

Text Generation • 34B • Updated Nov 22, 2023 • 8 • 3

EnzoVeltri/tableLlama-4bit

Text Generation • 7B • Updated Nov 22, 2023 • 4

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy

Text Generation • Updated Nov 23, 2023 • 5

TheBloke/rocket-3B-GPTQ

Text Generation • 3B • Updated Nov 22, 2023 • 8

florentgbelidji/leoLM-13b-sft-lora-oa

Text Generation • Updated Nov 23, 2023 • 5 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-low-rank

Text Generation • Updated Nov 22, 2023 • 6

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-tiny-rank

Text Generation • Updated Nov 24, 2023 • 5

TheBloke/Tess-XS-Creative-v1.0-GPTQ

Text Generation • 7B • Updated Nov 22, 2023 • 12 • 1

TheBloke/Tess-XS-Creative-v1.0-AWQ

Text Generation • 7B • Updated Nov 22, 2023 • 5 • 1