Spaces:

prithivMLmods
/

POINTS-Reader-OCR

Running on Zero

prithivMLmods commited on Oct 31

Commit

76c66ab

verified ·

1 Parent(s): e75a58c

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -134,7 +134,7 @@ model = AutoModelForCausalLM.from_pretrained(
     MODEL_PATH,
     #attn_implementation="flash_attention_2",
     trust_remote_code=True,
-    torch_dtype=torch.float16,
     device_map='auto'
 )
 tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH, trust_remote_code=True)

     MODEL_PATH,
     #attn_implementation="flash_attention_2",
     trust_remote_code=True,
+    torch_dtype=torch.bfloat16,
     device_map='auto'
 )
 tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH, trust_remote_code=True)