Xilabs
/

Llama-2-7b-Sharded

Text Generation

text-generation-inference

Model card Files Files and versions

ritabratamaiti commited on Aug 6, 2023

Commit

d4cef60

·

1 Parent(s): 434d6ec

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -23,7 +23,7 @@ tokenizer = AutoTokenizer.from_pretrained("Xilabs/Llama-2-7b")
 model = AutoModelForCausalLM.from_pretrained("Xilabs/Llama-2-7b")
 ```
-Feel free to add model quantization using bitsandbytes like so:
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM

 model = AutoModelForCausalLM.from_pretrained("Xilabs/Llama-2-7b")
 ```
+You can add add model quantization using bitsandbytes like so:
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM