Xin Liu commited on
Commit
8ab5b53
·
1 Parent(s): 47b4d4b

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -49,6 +49,9 @@ tags:
49
 
50
  | Name | Quant method | Bits | Size | Use case |
51
  | ---- | ---- | ---- | ---- | ----- |
 
 
 
52
  | [CodeLlama-70b-Instruct-hf-Q5_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q5_K_M.gguf) | Q5_K_M | 5 | 48.8 GB| large, very low quality loss - recommended |
53
  <!-- | [Yi-34B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q2_K.gguf) | Q2_K | 2 | 12.8 GB| smallest, significant quality loss - not recommended for most purposes |
54
  | [Yi-34B-Chat-Q3_K_L.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q3_K_L.gguf) | Q3_K_L | 3 | 18.1 GB| small, substantial quality loss |
 
49
 
50
  | Name | Quant method | Bits | Size | Use case |
51
  | ---- | ---- | ---- | ---- | ----- |
52
+ | [CodeLlama-70b-Instruct-hf-Q2_K.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q2_K.gguf) | Q2_K | 2 | 25.5 GB| smallest, significant quality loss - not recommended for most purposes |
53
+ | [CodeLlama-70b-Instruct-hf-Q3_K_L.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_L.gguf) | Q3_K_L | 3 | 36.1 GB| small, substantial quality loss |
54
+ | [CodeLlama-70b-Instruct-hf-Q3_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q3_K_M.gguf) | Q3_K_M | 3 | 32.5 GB| very small, high quality loss |
55
  | [CodeLlama-70b-Instruct-hf-Q5_K_M.gguf](https://huggingface.co/second-state/CodeLlama-70b-Instruct-hf-GGUF/blob/main/CodeLlama-70b-Instruct-hf-Q5_K_M.gguf) | Q5_K_M | 5 | 48.8 GB| large, very low quality loss - recommended |
56
  <!-- | [Yi-34B-Chat-Q2_K.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q2_K.gguf) | Q2_K | 2 | 12.8 GB| smallest, significant quality loss - not recommended for most purposes |
57
  | [Yi-34B-Chat-Q3_K_L.gguf](https://huggingface.co/second-state/Yi-34B-Chat-GGUF/blob/main/Yi-34B-Chat-Q3_K_L.gguf) | Q3_K_L | 3 | 18.1 GB| small, substantial quality loss |