FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-32
2B • Updated • 503
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
250
Active filters: llama-3.1-8b-instruct
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-32
2B • Updated • 151
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-64
2B • Updated • 127
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-64
2B • Updated • 414
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-sym-GS-128
2B • Updated • 125
FabioTrindade/Llama-3.1-8B-Instruct-W4A16KV16-asym-GS-128
2B • Updated • 148
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-32
73B • Updated • 33
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-32
75B • Updated • 34
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-64
73B • Updated • 38
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-64
72B • Updated • 28
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-asym-GS-128
72B • Updated • 107
FabioTrindade/Llama-3.1-70B-Instruct-W4A16KV16-sym-GS-128
11B • Updated • 124
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-32
67B • Updated • 5
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-64
61B • Updated • 3
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-64
61B • Updated • 4
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-sym-GS-128
58B • Updated • 5
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-32
69B • Updated • 5
FabioTrindade/Llama-3.1-405B-Instruct-W4A16KV16-asym-GS-128
58B • Updated • 4
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32
3B • Updated • 107
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-64
3B • Updated • 90
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-128
3B • Updated • 95
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 130
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 92
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 103
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TOKEN-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 98
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 106
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Aasym-SpQ-R1R2-SmQ-0.5
8B • Updated • 119
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TENSOR-Wsym-Asym-SpQ-R1R2-SmQ-0.5
8B • Updated • 95
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-TENSOR-AS-TENSOR-Wsym-Asym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 124
FabioTrindade/Llama-3.1-8B-Instruct-W8A8KV16-WS-CHANNEL-AS-TOKEN-Wsym-Aasym-SpQ-R1R2R4-SmQ-0.5
8B • Updated • 104