Spaces:

Harryphan01
/

testzerollm

Runtime error

harrypy commited on May 19, 2024

Commit

cce9d71

1 Parent(s): 962e72d

chore: fix app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -19,7 +19,7 @@ import gradio as gr
 from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
-device = "cuda" # the device to load the model onto
 model = AutoModelForCausalLM.from_pretrained(
     "vilm/VinaLlama2-14B",

 from transformers import AutoModelForCausalLM, AutoTokenizer
 import torch
+device = "cpu" # the device to load the model onto
 model = AutoModelForCausalLM.from_pretrained(
     "vilm/VinaLlama2-14B",