Spaces:

build-small-hackathon
/

PregoPal

Runtime error

J.B-Lin commited on Jun 10

Commit

2d207a7

1 Parent(s): cb94025

modal: 降级 GPU A100 -> T4 节省成本

Files changed (1) hide show

modal_deploy/deploy.py CHANGED Viewed

@@ -73,7 +73,7 @@ def get_model_paths(base_dir: str) -> dict:
 @app.function(
     image=_image,
     volumes={MODEL_DIR: model_volume},
-    gpu="A100",
     timeout=1200,
     scaledown_window=300,
 )
@@ -303,7 +303,7 @@ def upload_models():
 @app.function(
     image=_image,
     volumes={MODEL_DIR: model_volume},
-    gpu="A100",
     timeout=600,
 )
 def test_inference():

 @app.function(
     image=_image,
     volumes={MODEL_DIR: model_volume},
+    gpu="T4",
     timeout=1200,
     scaledown_window=300,
 )
 @app.function(
     image=_image,
     volumes={MODEL_DIR: model_volume},
+    gpu="T4",
     timeout=600,
 )
 def test_inference():