pankajmathur
/

model_009

Text Generation

text-generation-inference

Model card Files Files and versions

pankajmathur commited on Nov 9, 2023

Commit

57135e7

·

1 Parent(s): e987f7e

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -60,7 +60,7 @@ tokenizer = AutoTokenizer.from_pretrained("pankajmathur/model_009")
 model = AutoModelForCausalLM.from_pretrained(
   "pankajmathur/model_009",
   torch_dtype=torch.float16,
-  load_in_8bit=True,
   low_cpu_mem_usage=True,
   device_map="auto"
 )
@@ -95,7 +95,7 @@ Please kindly cite using the following BibTeX:
 @misc{model_009,
   author = {Pankaj Mathur},
   title = {model_009: An Orca Style Llama2-70b model},
-  month = {august},
   year = {2023},
   publisher = {HuggingFace},
   journal = {HuggingFace repository},

 model = AutoModelForCausalLM.from_pretrained(
   "pankajmathur/model_009",
   torch_dtype=torch.float16,
+  load_in_4bit=True,
   low_cpu_mem_usage=True,
   device_map="auto"
 )
 @misc{model_009,
   author = {Pankaj Mathur},
   title = {model_009: An Orca Style Llama2-70b model},
+  month = {August},
   year = {2023},
   publisher = {HuggingFace},
   journal = {HuggingFace repository},