Spaces:

fffiloni
/

imagic-stable-diffusion

Paused

fffiloni commited on Nov 30, 2022

Commit

9ef2c85

1 Parent(s): b7f1d3d

Update imagic.py

Files changed (1) hide show

imagic.py CHANGED Viewed

@@ -274,8 +274,8 @@ class ImagicStableDiffusionPipeline(DiffusionPipeline):
                 with torch.no_grad():
                     torch.cuda.empty_cache()
-                    optimizer.step()
-                    optimizer.zero_grad()
             # Checks if the accelerator has performed an optimization step behind the scenes
             if accelerator.sync_gradients:
@@ -318,8 +318,8 @@ class ImagicStableDiffusionPipeline(DiffusionPipeline):
                 with torch.no_grad():
                     torch.cuda.empty_cache()
-                    optimizer.step()
-                    optimizer.zero_grad()
             # Checks if the accelerator has performed an optimization step behind the scenes
             if accelerator.sync_gradients:

                 with torch.no_grad():
                     torch.cuda.empty_cache()
+                optimizer.step()
+                optimizer.zero_grad()
             # Checks if the accelerator has performed an optimization step behind the scenes
             if accelerator.sync_gradients:
                 with torch.no_grad():
                     torch.cuda.empty_cache()
+                optimizer.step()
+                optimizer.zero_grad()
             # Checks if the accelerator has performed an optimization step behind the scenes
             if accelerator.sync_gradients: