nv-mzephyr Claude Opus 5 (1M context) commited on
Commit
24f896b
·
1 Parent(s): 7fb7cc3

Run CT on the ZeroGPU xlarge slice

Browse files

ZeroGPU moved to RTX Pro 6000 Blackwell, where the default `large` size is
half a card (48 GB) rather than the old ~70 GB H200 MIG slice. The CT presets
were budgeted against ~70 GB (see ui/presets.py) and OOM on `large`, so CT now
requests `xlarge` (96 GB). This costs 2x quota and queues longer, so MR and
MR-Brain stay on `large` — they cap at 256^3 and fit comfortably.

Pin spaces>=0.47.0, the first release with the size= argument. The import guard
in app.py only catches ImportError/AttributeError, so an older spaces would
raise an uncaught TypeError at startup.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>

Files changed (2) hide show
  1. app.py +9 -1
  2. requirements.txt +1 -1
app.py CHANGED
@@ -42,9 +42,17 @@ def _ensure_upstream():
42
  _ensure_upstream()
43
 
44
  # ZeroGPU decorator — present on HF Spaces, optional locally.
 
 
 
 
 
 
 
 
45
  try:
46
  import spaces # type: ignore
47
- spaces_gpu_ct = spaces.GPU(duration=90)
48
  spaces_gpu_mr = spaces.GPU(duration=60)
49
  spaces_gpu_mr_brain = spaces.GPU(duration=60)
50
  except (ImportError, AttributeError):
 
42
  _ensure_upstream()
43
 
44
  # ZeroGPU decorator — present on HF Spaces, optional locally.
45
+ #
46
+ # `size` picks the ZeroGPU slice. ZeroGPU now runs on RTX Pro 6000 Blackwell:
47
+ # `large` (default) is half a card = 48 GB, `xlarge` is a full card = 96 GB at
48
+ # 2x quota cost and longer queue waits. Paired CT at the sizes we expose was
49
+ # budgeted against the old ~70 GB H200 MIG slice (see ui/presets.py) and does
50
+ # not fit in 48 GB, so CT takes `xlarge`. MR and MR-Brain cap at 256^3 and fit
51
+ # comfortably in `large` — keeping them there halves their quota cost, which
52
+ # matters since anonymous visitors only get 2 minutes of GPU time per day.
53
  try:
54
  import spaces # type: ignore
55
+ spaces_gpu_ct = spaces.GPU(duration=90, size="xlarge")
56
  spaces_gpu_mr = spaces.GPU(duration=60)
57
  spaces_gpu_mr_brain = spaces.GPU(duration=60)
58
  except (ImportError, AttributeError):
requirements.txt CHANGED
@@ -1,6 +1,6 @@
1
  # Gradio app
2
  gradio>=5.0
3
- spaces # ZeroGPU decorator (no-op locally)
4
 
5
  # Upstream NV-Generate-CTMR dependencies
6
  torch>=2.1.0
 
1
  # Gradio app
2
  gradio>=5.0
3
+ spaces>=0.47.0 # ZeroGPU decorator (no-op locally); >=0.47 for the size= arg
4
 
5
  # Upstream NV-Generate-CTMR dependencies
6
  torch>=2.1.0