Which blocks were removed?
This is amazing!. If you don't mind me asking, which 20 blocks were removed from the parent model? Was student teacher training done on the whole model, or just the blocks near the pruned blocks?
Thank you for your attention, Ostris. We mainly identified some prunable layers through layer sensitivity analysis and then conducted alignment training. We will release the detailed technical report in the near future. Actually, I have been following your works, from your early OpenFlux to the recent Qwen-Image-Edit-Inpainting project—all are excellent open-source initiatives.
Thank you for your attention, Ostris. We mainly identified some prunable layers through layer sensitivity analysis and then conducted alignment training. We will release the detailed technical report in the near future. Actually, I have been following your works, from your early OpenFlux to the recent Qwen-Image-Edit-Inpainting project—all are excellent open-source initiatives.
Any timeline? Look forward to it!
Our preliminary plan is to release it around November