l3utterfly
/

Llama-3.1-8B-Instruct-gguf

Model card Files Files and versions

Llama-3.1-8B-Instruct-gguf

58 GB

1 contributor

History: 3 commits

l3utterfly's picture

Add quantised GGUF files

3c584c2 about 1 year ago

.gitattributes

1.56 kB

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q2_K.gguf

3.18 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q4_0.gguf

4.66 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q4_0_4_4.gguf

4.66 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q4_0_4_8.gguf

4.66 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q4_0_8_8.gguf

4.66 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q4_K_M.gguf

4.92 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q6_K.gguf

6.6 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-Q8_0.gguf

8.54 GB
xet

Add quantised GGUF files about 1 year ago
Llama-3.1-8B-Instruct-f16.gguf

16.1 GB
xet

Add quantised GGUF files about 1 year ago
README.md

29 Bytes

initial commit about 1 year ago