Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

14,265

Base only

Active filters: it

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Aug 29, 2024 • 328 • 13

LiteLLMs/Mistral-Nemo-Instruct-2407-GGUF

12B • Updated Jul 25, 2024 • 404

TechxGenus/Mistral-Large-Instruct-2407-GPTQ

Text Generation • 123B • Updated Jul 27, 2024 • 19 • 3

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 6

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 4

Marlon81/Llama-3.1-SauerkrautLM-8b-Instruct-Q4_K_M-GGUF

8B • Updated Jul 25, 2024 • 3

kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 4

FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 4

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 3

DevBM/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 25, 2024 • 3

pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 8

LoneStriker/Mistral-Large-Instruct-2407-2.65bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 6

LoneStriker/Mistral-Large-Instruct-2407-3.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 8

LoneStriker/Mistral-Large-Instruct-2407-3.5bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 8

LoneStriker/Mistral-Large-Instruct-2407-4.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 4

LoneStriker/Mistral-Large-Instruct-2407-5.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 7

nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Text Generation • 8B • Updated Jul 26, 2024 • 125

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 4

QuantFactory/mini-magnum-12b-v1.1-GGUF

12B • Updated Jul 26, 2024 • 151 • 2

QuantFactory/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

8B • Updated Jul 26, 2024 • 150 • 2

Morgen0052/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 7

LoneStriker/Mistral-Large-Instruct-2407-6.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 4

Kondara/falcon-11B-Q4_K_M-GGUF

11B • Updated Jul 26, 2024 • 5

LoneStriker/Mistral-Large-Instruct-2407-8.0bpw-h8-exl2

Text Generation • Updated Jul 26, 2024 • 4 • 1

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_5.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 3

QuantFactory/SauerkrautLM-Nemo-12b-Instruct-GGUF

12B • Updated Jul 26, 2024 • 246 • 3

Ransss/mini-magnum-12b-v1.1-Q8_0-GGUF

12B • Updated Jul 26, 2024

v3ray/Llama-3-1-70B-Instruct-base

Text Generation • 71B • Updated Jul 26, 2024 • 25 •

bullerwins/Mistral-Large-Instruct-2407-exl2_4.0bpw

Text Generation • Updated Jul 27, 2024 • 4

trokhymovych/TRank_readability

Text Classification • Updated Jul 26, 2024 • 5