dranger003
/

CodeLlama-70b-Instruct-iMat.GGUF

Text Generation

Model card Files Files and versions

dranger003 commited on Feb 18, 2024

Commit

4e7b2d7

·

verified ·

1 Parent(s): 5c5d29d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -6,7 +6,7 @@ pipeline_tag: text-generation
 GGUF importance matrix (imatrix) quants for https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
-NOTE: The template for this model is very sensitive and must be set very precisely.
 All whitespace is intended, and special tokens `<s>` and `<step>` must be encoded properly.
 | Layers | Context | Template |

 GGUF importance matrix (imatrix) quants for https://huggingface.co/codellama/CodeLlama-70b-Instruct-hf
 The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
+**NOTE**: The template for this model is very sensitive and must be set very precisely.
 All whitespace is intended, and special tokens `<s>` and `<step>` must be encoded properly.
 | Layers | Context | Template |