Inference Providers
Active filters: th
mradermacher/SeaLLMs-v3-7B-GGUF
8B • Updated • 200
• 1
mradermacher/llama3-8b-cpt-sealionv2-instruct-GGUF
8B • Updated • 259
mradermacher/llama3-8b-cpt-sealionv2-base-GGUF
8B • Updated • 195
mradermacher/llama3-8b-cpt-sealionv2-instruct-i1-GGUF
8B • Updated • 353
Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom
Text Generation
• 71B • Updated • 2
mradermacher/llama3-8b-cpt-sealionv2-base-i1-GGUF
8B • Updated • 589
mradermacher/SeaLLMs-v3-7B-i1-GGUF
8B • Updated • 366
RedHatAI/Meta-Llama-3.1-8B-FP8
Text Generation
• 8B • Updated • 227k
• 10
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation
• 71B • Updated • 210
• 3
kaetemi/Meta-Llama-3.1-8B-Q8_0-GGUF
Text Generation
• 8B • Updated • 17
mradermacher/SeaLLMs-v3-1.5B-GGUF
2B • Updated • 117
• 1
Apel-sin/meta-llama-3.1-70B-instruct-exl2
Text Generation
• Updated RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation
• 8B • Updated • 10
• 1
fanshanga/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 5
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8
Text Generation
• 8B • Updated • 401
• 5
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16
Text Generation
• 71B • Updated • 47.5k
• 33
mradermacher/llama3-8b-cpt-sea-lionv2-base-GGUF
8B • Updated • 493
mradermacher/llama3-8b-cpt-sea-lionv2-instruct-GGUF
8B • Updated • 327
• 1
mradermacher/llama3-8b-cpt-sea-lionv2-base-i1-GGUF
8B • Updated • 501
mradermacher/llama3-8b-cpt-sea-lionv2-instruct-i1-GGUF
8B • Updated • 465
• 1
hamminson/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF
Text Generation
• 8B • Updated • 1
latentheat/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 11
polyverse/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 8
polyverse/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 9
cha9ro/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF
Text Generation
• 8B • Updated • 9
Svngoku/Llama-3.1-8B-AlpaCare-MedInstruct-GGUF
Text Generation
• 8B • Updated • 221
• 2
kpranav22/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 21
• 1
swilde42/Meta-Llama-3.1-8B-Q4_K_M-GGUF
Text Generation
• 8B • Updated • 8
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation
• 410B • Updated • 3.06k
reach-vb/Meta-Llama-3.1-8B-Q8_0-GGUF
Text Generation
• 8B • Updated • 15