Inference Providers
Active filters: it
BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.5bpw_h8
Text Generation
• Updated • 6
mradermacher/PixieZehirNano-GGUF
2B • Updated • 1.37k
• 1
stajerc/Meta-Llama-3.1-8B-Q5_K_M-GGUF
Text Generation
• 8B • Updated • 6
DeusImperator/Mistral-Nemo-Instruct-2407_exl2_8bpw_max_rpcal_long
Text Generation
• Updated • 4
• 1
jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4
Text Generation
• 71B • Updated • 7
jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4
Text Generation
• 410B • Updated • 3
lmstudio-community/Mistral-Large-Instruct-2407-GGUF
Text Generation
• 123B • Updated • 195
• 13
LiteLLMs/Mistral-Nemo-Instruct-2407-GGUF
12B • Updated • 113
TechxGenus/Mistral-Large-Instruct-2407-GPTQ
Text Generation
• 123B • Updated • 13
• 3
FlorianJc/ghost-8b-beta-vllm-fp8
Text Generation
• 8B • Updated • 4
BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8
Text Generation
• Updated • 7
Marlon81/Llama-3.1-SauerkrautLM-8b-Instruct-Q4_K_M-GGUF
8B • Updated • 15
kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 11
FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8
Text Generation
• 8B • Updated • 5
BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.5bpw_h8
Text Generation
• Updated • 8
DevBM/Llama-3.1-8B-Instruct
Text Generation
• 8B • Updated • 6
pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF
Text Generation
• 8B • Updated • 20
LoneStriker/Mistral-Large-Instruct-2407-2.65bpw-h6-exl2
Text Generation
• Updated • 5
LoneStriker/Mistral-Large-Instruct-2407-3.0bpw-h6-exl2
Text Generation
• Updated • 6
LoneStriker/Mistral-Large-Instruct-2407-3.5bpw-h6-exl2
Text Generation
• Updated • 6
LoneStriker/Mistral-Large-Instruct-2407-4.0bpw-h6-exl2
Text Generation
• Updated • 4
LoneStriker/Mistral-Large-Instruct-2407-5.0bpw-h6-exl2
Text Generation
• Updated • 3
nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf
Text Generation
• 8B • Updated • 18
BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.0bpw_h8
Text Generation
• Updated • 7
QuantFactory/mini-magnum-12b-v1.1-GGUF
12B • Updated • 277
• 2
QuantFactory/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF
8B • Updated • 203
• 2
Morgen0052/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF
Text Generation
• 8B • Updated • 8
LoneStriker/Mistral-Large-Instruct-2407-6.0bpw-h6-exl2
Text Generation
• Updated • 5
Kondara/falcon-11B-Q4_K_M-GGUF
11B • Updated • 3
LoneStriker/Mistral-Large-Instruct-2407-8.0bpw-h8-exl2
Text Generation
• Updated • 3
• 1