Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

12,708

Base only

Active filters: ru

deepvk/llava-saiga-8b

Image-Text-to-Text • 8B • Updated Aug 13, 2024 • 407 • 16

DeusImperator/Mistral-Nemo-Instruct-2407_exl2_8bpw_max_rpcal_long

Text Generation • Updated Jul 25, 2024 • 8 • 1

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • 123B • Updated Aug 29, 2024 • 840 • 13

LiteLLMs/Mistral-Nemo-Instruct-2407-GGUF

12B • Updated Jul 25, 2024 • 284

TechxGenus/Mistral-Large-Instruct-2407-GPTQ

Text Generation • 123B • Updated Jul 27, 2024 • 8 • 3

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 5

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 8

LoneStriker/Mistral-Large-Instruct-2407-2.65bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 5

LoneStriker/Mistral-Large-Instruct-2407-3.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 9

LoneStriker/Mistral-Large-Instruct-2407-3.5bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 7

LoneStriker/Mistral-Large-Instruct-2407-4.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 6

LoneStriker/Mistral-Large-Instruct-2407-5.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 6

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 5

QuantFactory/mini-magnum-12b-v1.1-GGUF

12B • Updated Jul 26, 2024 • 165 • 2

LoneStriker/Mistral-Large-Instruct-2407-6.0bpw-h6-exl2

Text Generation • Updated Jul 26, 2024 • 7

LoneStriker/Mistral-Large-Instruct-2407-8.0bpw-h8-exl2

Text Generation • Updated Jul 26, 2024 • 6 • 1

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_5.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 10

QuantFactory/SauerkrautLM-Nemo-12b-Instruct-GGUF

12B • Updated Jul 26, 2024 • 704 • 3

phil13579/test_custom_handler

Text-to-Image • Updated Jul 26, 2024 • 9

Ransss/mini-magnum-12b-v1.1-Q8_0-GGUF

12B • Updated Jul 26, 2024 • 12

bzikst/faster-whisper-large-v3-russian-int8

Automatic Speech Recognition • Updated Jul 26, 2024 • 46 • 8

bullerwins/Mistral-Large-Instruct-2407-exl2_4.0bpw

Text Generation • Updated Jul 27, 2024 • 8

trokhymovych/TRank_readability

Text Classification • Updated Jul 26, 2024 • 4

bullerwins/Mistral-Large-Instruct-2407-exl2_4.5bpw

Text Generation • Updated Jul 27, 2024 • 7

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_5.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 6

Kaan35/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B • Updated Jul 29, 2024 • 16

Kaan35/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF

12B • Updated Jul 26, 2024 • 19 • 1

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.5bpw_h8

Text Generation • Updated Aug 14, 2024 • 8

MarsupialAI/Lusca-33B

Text Generation • 33B • Updated Oct 22, 2024 • 22 • 10

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_4.0bpw_h8

Text Generation • Updated Aug 14, 2024 • 7