Spaces:

sourize
/

DeepTalks

Sleeping

sourize commited on Apr 30, 2025

Commit

0919779

1 Parent(s): 5bc5a17

Commit

Files changed (1) hide show

app.py CHANGED Viewed

@@ -106,8 +106,6 @@ def load_generator():
         model=model,
         tokenizer=tokenizer,
         device_map="auto",
-        offload_folder=OFFLOAD_DIR,
-        offload_state_dict=True,
         max_new_tokens=32,
         do_sample=True,
         temperature=0.2,

         model=model,
         tokenizer=tokenizer,
         device_map="auto",
         max_new_tokens=32,
         do_sample=True,
         temperature=0.2,