PrunaAI
/

togethercomputer-LLaMA-2-7B-32K-GGUF-smashed

Model card Files Files and versions

togethercomputer-LLaMA-2-7B-32K-GGUF-smashed / togethercomputer

61 GB

1 contributor

History: 37 commits

sharpenb's picture

Upload togethercomputer/LLaMA-2-7B-32K.Q5_1.gguf with huggingface_hub

0feede7 verified 11 months ago

LLaMA-2-7B-32K.Q2_K.gguf
2.53 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q2_K.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q3_K_L.gguf
3.6 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q3_K_L.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q3_K_M.gguf
3.3 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q3_K_M.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q3_K_S.gguf
2.95 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q3_K_S.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q4_0.gguf
3.83 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q4_0.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q4_1.gguf
4.24 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q4_1.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q4_K_M.gguf
4.08 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q4_K_M.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q4_K_S.gguf
3.86 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q4_K_S.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q5_0.gguf
4.65 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q5_0.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q5_1.gguf
5.06 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q5_1.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q5_K_M.gguf
4.78 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q5_K_M.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.Q5_K_S.gguf
4.65 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.Q5_K_S.gguf with huggingface_hub 11 months ago
LLaMA-2-7B-32K.fp16.bin
13.5 GB
xet

Upload togethercomputer/LLaMA-2-7B-32K.fp16.bin with huggingface_hub 11 months ago