Spaces:

KangLiao
/

Puffin

Running on Zero

KangLiao commited on Oct 9

Commit

0fae652

1 Parent(s): 3e77ea4

init

Files changed (1) hide show

configs/models/qwen2_5_1_5b_radio_sd3_dynamic_puffin.py CHANGED Viewed

@@ -72,7 +72,7 @@ model = dict(type=Qwen2p5RadioStableDiffusion3HFDynamic,
                  type=AutoModelForCausalLM.from_pretrained,
                  pretrained_model_name_or_path=llm_name_or_path,
                  torch_dtype=torch.bfloat16,
-                 attn_implementation='flash_attention_2',
              ),
              tokenizer=dict(
                  type=AutoTokenizer.from_pretrained,

                  type=AutoModelForCausalLM.from_pretrained,
                  pretrained_model_name_or_path=llm_name_or_path,
                  torch_dtype=torch.bfloat16,
+                 #attn_implementation='flash_attention_2',
              ),
              tokenizer=dict(
                  type=AutoTokenizer.from_pretrained,