Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

built-with-llama

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

225

Base only

Active filters: built-with-llama

nagohachi/Llama-3.2-tiny-lm-japanese-500m-base-v2

Text Generation • 0.5B • Updated 30 days ago • 22 • 1

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-32

2B • Updated Jun 15 • 469

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-32

2B • Updated Jun 15 • 129

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-64

2B • Updated Jun 15 • 51

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-64

2B • Updated Jun 15 • 397

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-128

2B • Updated Jun 15 • 38

FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-128

2B • Updated Jun 15 • 52

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-32

73B • Updated Jul 3 • 41

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-32

75B • Updated Jul 3 • 41

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-64

73B • Updated Jul 7 • 23

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-64

72B • Updated Jul 7 • 14

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-128

72B • Updated Jul 7 • 94

FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-128

11B • Updated Jun 15 • 110

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-32

67B • Updated Jun 15 • 9

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-64

61B • Updated Jun 15 • 4

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-64

61B • Updated Jun 15 • 6

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-128

58B • Updated Jun 15 • 8

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-32

69B • Updated Jun 15 • 8

FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-128

58B • Updated Jun 15 • 5

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32

3B • Updated Jun 15 • 35

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-64

3B • Updated Jun 15 • 47

FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-128

3B • Updated Jun 15 • 46

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 49

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 49

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 39

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 30

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 50

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 40

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5

8B • Updated Jun 16 • 39

FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5

8B • Updated Jun 16 • 53