4_32_rd

README.md

@@ -15,8 +15,8 @@ license: apache-2.0
 
 <a href='https://csgo-gen.github.io/'><img src='https://img.shields.io/badge/Project-Page-green'></a>
 <a href='https://arxiv.org/abs/2404.02733'><img src='https://img.shields.io/badge/Technique-Report-red'></a>
-[![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Space-red)](https://huggingface.co/spaces/InstantX/InstantStyle)
-[![ModelScope](https://img.shields.io/badge/ModelScope-Studios-blue)](https://modelscope.cn/studios/instantx/InstantStyle/summary)
+[![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Space-red)](https://huggingface.co/spaces/InstantX/CSGO)
+
 
 </div>
  
@@ -55,6 +55,15 @@ license: apache-2.0
 This repo, named **CSGO**, contains the official PyTorch implementation of our paper [CSGO: Content-Style Composition in Text-to-Image Generation](https://arxiv.org/pdf/).
 We are actively updating and improving this repository. If you find any bugs or have suggestions, welcome to raise issues or submit pull requests (PR) 💖.
 
+## Detail ✨
+We currently release two model weights.
+
+| Mode | content token | style token |      Other      |
+|:------------:|:-----------:|:-----------:|:---------------:|
+|csgo.bin|4|16|        -        |
+|csgo_4_32.bin|4|32| Deepspeed zero2 |
+
+
 ## Pipeline 	💻
 <p align="center">
   <img src="assets/image3_1.jpg">
@@ -143,12 +152,11 @@ controlnet_target_content_blocks = controlnet_BLOCKS['content']
 controlnet_target_style_blocks = controlnet_BLOCKS['style']
 
 csgo = CSGO(pipe, image_encoder_path, csgo_ckpt, device, num_content_tokens=4,num_style_tokens=32,
-                          target_content_blocks=target_content_blocks, target_style_blocks=target_style_blocks,controlnet=False,controlnet_adapter=True,
+                          target_content_blocks=target_content_blocks, target_style_blocks=target_style_blocks,controlnet_adapter=True,
                               controlnet_target_content_blocks=controlnet_target_content_blocks, 
                               controlnet_target_style_blocks=controlnet_target_style_blocks,
                               content_model_resampler=True,
                               style_model_resampler=True,
-                              load_controlnet=False,
 
                               )