TheBloke
/

Swallow-7B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Swallow-7B-Instruct-GGUF

52 GB

1 contributor

History: 16 commits

TheBloke's picture

Upload README.md

e218dff about 2 years ago

.gitattributes

2.33 kB

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
LICENSE.txt

7.02 kB

Add Llama 2 license files about 2 years ago
Notice

112 Bytes

Add Llama 2 license files about 2 years ago
README.md

27 kB

Upload README.md about 2 years ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files about 2 years ago
config.json

29 Bytes

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q2_K.gguf

2.88 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q3_K_L.gguf

3.65 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q3_K_M.gguf

3.36 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q3_K_S.gguf

3.01 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q4_0.gguf

3.89 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q4_K_M.gguf

4.14 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q4_K_S.gguf

3.92 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q5_0.gguf

4.72 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q5_K_M.gguf

4.85 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q5_K_S.gguf

4.72 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q6_K.gguf

5.6 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago
swallow-7b-instruct.Q8_0.gguf

7.26 GB
xet

GGUF model commit (made with llama.cpp commit 6744dbe) about 2 years ago