Spaces:

jiminaa
/

language-learning-chatbot

Sleeping

jiminaa commited on Jan 16

Commit

e5c6643

1 Parent(s): 4ed9961

dtpye depreciation + pytorch cpu

Files changed (2) hide show

app.py CHANGED Viewed

@@ -20,7 +20,7 @@ app = FastAPI()
 base_model = AutoModelForCausalLM.from_pretrained(
     MODEL,
     token=HF_TOKEN,
-    torch_dtype=torch.float32, #huggingface free tier only has cpu
     device_map="cpu",
     low_cpu_mem_usage=True
 )

 base_model = AutoModelForCausalLM.from_pretrained(
     MODEL,
     token=HF_TOKEN,
+    dtype=torch.float32, #huggingface free tier only has cpu
     device_map="cpu",
     low_cpu_mem_usage=True
 )

requirements.txt CHANGED Viewed

@@ -1,7 +1,8 @@
 peft
 gradio
 transformers
 accelerate
-torch
 fastapi
 pydantic

+--extra-index-url https://download.pytorch.org/whl/cpu
+torch
 peft
 gradio
 transformers
 accelerate
 fastapi
 pydantic