Inference Providers
Active filters: it
context-labs/Meta-Llama-3.1-8B-4bit
Text Generation
• 1B • Updated • 10
Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 19
• 1
bigstorm/Meta-Llama-3.1-70B-Instruct-8.0bpw-8hb-exl2
Text Generation
• Updated • 1
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
• 71B • Updated • 22.6k
• 51
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8
Text Generation
• 406B • Updated • 262
• 31
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Text Generation
• 406B • Updated • 15.8k
• 15
teknium/Llama-3.1-AlternateTokenizer
Text Generation
• 8B • Updated • 912
• • 5
Kondara/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 16
shisahni/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 22
bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2
Text Generation
• Updated • 3
backyardai/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 170
• 3
MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF
Text Generation
• 8B • Updated • 30
second-state/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 1.05k
• 1
gaianet/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 973
LoneStriker/Meta-Llama-3.1-8B-Instruct-3.0bpw-h6-exl2
Text Generation
• Updated • 2
LoneStriker/Meta-Llama-3.1-8B-Instruct-4.0bpw-h6-exl2
Text Generation
• Updated • 16
LoneStriker/Meta-Llama-3.1-8B-Instruct-5.0bpw-h6-exl2
Text Generation
• Updated • 4
LoneStriker/Meta-Llama-3.1-8B-Instruct-6.0bpw-h6-exl2
Text Generation
• Updated • 4
• 1
LoneStriker/Meta-Llama-3.1-8B-Instruct-8.0bpw-h8-exl2
Text Generation
• Updated • 8
• 1
ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 12
QuantFactory/Meta-Llama-3.1-8B-GGUF
Text Generation
• 8B • Updated • 670
• 13
skoppisetti/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16
Text Generation
• 8B • Updated • 4.84k
• 12
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8
Text Generation
• 8B • Updated • 17.5k
• 20
lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 1.12k
• 36
bigstorm/Meta-Llama-3.1-70B-Instruct-6.5bpw-8hb-exl2
Text Generation
• Updated • 3
mlx-community/Meta-Llama-3.1-405B-2bit
Text Generation
• 38B • Updated • 855
• 2
kowlick/Mistral-Nemo-Instruct-2407-Q8_0-GGUF
12B • Updated • 7
LoneStriker/Meta-Llama-3.1-70B-Instruct-2.4bpw-h6-exl2
Text Generation
• Updated • 4
kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF
Text Generation
• 8B • Updated • 18