Hugging Face's logo

second-state
/
CodeLlama-70b-Instruct-hf-GGUF

Text Generation
Transformers
GGUF
code
llama
llama-2
conversational
Model card Files
xet
Community
apepkuss79 commited on
Commit
f911950
·
verified ·
1 Parent(s): 81555f2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -51,7 +51,8 @@ tags:
51
  | ---- | ---- | ---- | ---- | ----- |
52
  | [CodeLlama-70b-Instruct-hf-Q2_K.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q2_K.gguf) | Q2_K | 2 | 25.5 GB| smallest, significant quality loss - not recommended for most purposes |
53
  | [CodeLlama-70b-Instruct-hf-Q3_K_L.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_L.gguf) | Q3_K_L | 3 | 36.1 GB| small, substantial quality loss |
54
- | [CodeLlama-70b-Instruct-hf-Q3_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_M.gguf) | Q3_K_M | 3 | 32.5 GB| very small, high quality loss |
 
55
  | [CodeLlama-70b-Instruct-hf-Q5_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q5_K_M.gguf) | Q5_K_M | 5 | 48.8 GB| large, very low quality loss - recommended |
56
  <!-- | [Yi-34B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q2_K.gguf) | Q2_K | 2 | 12.8 GB| smallest, significant quality loss - not recommended for most purposes |
57
  | [Yi-34B-Chat-Q3_K_L.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q3_K_L.gguf) | Q3_K_L | 3 | 18.1 GB| small, substantial quality loss |
 
51
  | ---- | ---- | ---- | ---- | ----- |
52
  | [CodeLlama-70b-Instruct-hf-Q2_K.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q2_K.gguf) | Q2_K | 2 | 25.5 GB| smallest, significant quality loss - not recommended for most purposes |
53
  | [CodeLlama-70b-Instruct-hf-Q3_K_L.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_L.gguf) | Q3_K_L | 3 | 36.1 GB| small, substantial quality loss |
54
+ | [CodeLlama-70b-Instruct-hf-Q3_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_M.gguf) | Q3_K_M | 3 | 33.3 GB| very small, high quality loss |
55
+ | [CodeLlama-70b-Instruct-hf-Q3_K_S.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_S.gguf) | Q3_K_S | 3 | 29.9 GB| very small, high quality loss |
56
  | [CodeLlama-70b-Instruct-hf-Q5_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q5_K_M.gguf) | Q5_K_M | 5 | 48.8 GB| large, very low quality loss - recommended |
57
  <!-- | [Yi-34B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q2_K.gguf) | Q2_K | 2 | 12.8 GB| smallest, significant quality loss - not recommended for most purposes |
58
  | [Yi-34B-Chat-Q3_K_L.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q3_K_L.gguf) | Q3_K_L | 3 | 18.1 GB| small, substantial quality loss |