Spaces:

UCODE
/

agent

Sleeping

abenkbp commited on Aug 15, 2024

Commit

58cc6a9

1 Parent(s): 926dc2c

debug

Files changed (1) hide show

data/models/llama3-1-8b.py CHANGED Viewed

@@ -17,7 +17,7 @@ pipeline = transformers.pipeline(
     "text-generation",
     model=model_id,
     model_kwargs={"torch_dtype": torch.bfloat16},
-    device=0,
     token=True
 )

     "text-generation",
     model=model_id,
     model_kwargs={"torch_dtype": torch.bfloat16},
+    device="cuda",
     token=True
 )