bartowski
/

speechless-starcoder2-7b-GGUF

Text Generation

Eval Results (legacy)

Model card Files Files and versions

speechless-starcoder2-7b-GGUF

54.5 GB

1 contributor

History: 2 commits

bartowski's picture

Llamacpp quants

cb24a83 verified almost 2 years ago

.gitattributes

2.39 kB

Llamacpp quants almost 2 years ago
README.md

3.55 kB

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q2_K.gguf

2.72 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q3_K_L.gguf

3.99 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q3_K_M.gguf

3.59 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q3_K_S.gguf

3.09 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q4_0.gguf

4.04 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q4_K_M.gguf

4.4 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q4_K_S.gguf

4.13 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q5_0.gguf

4.94 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q5_K_M.gguf

5.12 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q5_K_S.gguf

4.94 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q6_K.gguf

5.89 GB
xet

Llamacpp quants almost 2 years ago
speechless-starcoder2-7b-Q8_0.gguf

7.63 GB
xet

Llamacpp quants almost 2 years ago