starflow / sample.py

Commit History

Initialize single-process distributed group for single GPU inference compatibility
2d8eef3

leoeric commited on

Fix CUDA out of memory error by clearing cache between model loads and enabling expandable segments
3a6a9cd

leoeric commited on

Disable FSDP for single GPU inference to ensure GPU usage
dc2ca3c

leoeric commited on

Add --logdir argument to sample.py parser and restore it in app.py
a1fd3d3

leoeric commited on

Initial commit for HF Space - code files only
0b4562b

leoeric commited on