Bulletproof probe: simulate grad_accum, expandable_segments, 70% safety 4d7a400 ASTERIZER commited on Apr 1
Fix: probe with return_logits=False (was wasting 3GB on logits tensor), show peak VRAM 4d6a3fe ASTERIZER commited on Apr 1
Fix probe: use actual model (no duplicate), add GPU cleanup at start 78a081e ASTERIZER commited on Apr 1
Maximize GPU usage: probe up to 4096 batch, 92% safety, only catch OOM 80bdec5 ASTERIZER commited on Apr 1
Fix: use compile mode=default to avoid CUDA graph + tied embedding crash 0a6cf2e ASTERIZER commited on Apr 1