Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,823

Base only

Active filters: th

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 260 • 7

NousResearch/Meta-Llama-3.1-405B-FP8

Text Generation • 410B • Updated Jul 25, 2024 • 45 • 3

xyottax/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 18

Efficient-Large-Model/Meta-Llama-3.1-70B

Text Generation • 71B • Updated Jul 26, 2024 • 4

deven367/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 464 • 1

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • 71B • Updated Oct 9, 2024 • 9 • 5

Efficient-Large-Model/Meta-Llama-3.1-70B-Instruct

Text Generation • 71B • Updated Jul 26, 2024 • 6

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • 410B • Updated Jul 24, 2024 • 7 • 7

SillyTilly/Meta-Llama-3.1-405B-Instruct

Text Generation • 410B • Updated Jul 25, 2024 • 42 • 4

aifeifei798/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 30

mlx-community/Meta-Llama-3.1-405B-4bit

Text Generation • 64B • Updated Jul 31, 2024 • 269 • 4

hoorang/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 13

tensorlake/whisper-large-v3

Automatic Speech Recognition • 2B • Updated Jul 25, 2024 • 2

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 27

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_4.0bpw

Text Generation • Updated Aug 23, 2024 • 9

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Aug 23, 2024 • 7

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Aug 23, 2024 • 4 • 1

bullerwins/Meta-Llama-3.1-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Aug 23, 2024 • 2

qwp4w3hyb/Meta-Llama-3.1-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 297 • 6

qwp4w3hyb/Meta-Llama-3.1-70B-Instruct-iMat-GGUF

Text Generation • 71B • Updated Aug 6, 2024 • 471 • 8

mradermacher/PixieZehirNano-GGUF

2B • Updated Oct 11, 2024 • 145 • 1

stajerc/Meta-Llama-3.1-8B-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 17

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • 71B • Updated Jul 25, 2024 • 1

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • 410B • Updated Jul 25, 2024 • 3

kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 8

FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8

Text Generation • 8B • Updated Jul 25, 2024 • 39

DevBM/Llama-3.1-8B-Instruct

Text Generation • 8B • Updated Jul 25, 2024 • 4

pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 14

SeaLLMs/SeaLLMs-v3-7B

Text Generation • 8B • Updated Jul 30, 2024 • 270 • • 7

nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Text Generation • 8B • Updated Jul 26, 2024 • 41