Spaces:

pythainlp
/

wangchanglm-demo-cpu

Running

wannaphong commited on May 29, 2023

Commit

d7b794d

1 Parent(s): 511d5d9

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -132,6 +132,7 @@ model = AutoModelForCausalLM.from_pretrained(
     torch_dtype=torch.bfloat16,
     offload_folder="./",
     low_cpu_mem_usage=True,
 )
 tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")

     torch_dtype=torch.bfloat16,
     offload_folder="./",
     low_cpu_mem_usage=True,
+    load_in_8bit=False
 )
 tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")