ArtFlow / transformer_config.json
kaupane's picture
Update transformer_config.json
3373942 verified
raw
history blame contribute delete
299 Bytes
{
"patch_size": 2,
"in_channels": 16,
"hidden_size": 1152,
"num_heads": 16,
"double_stream_depth": 0,
"single_stream_depth": 28,
"conditioning_scheme": "pure",
"qkv_bias": true,
"ffn_type": "gated",
"mlp_ratio": 2.67,
"rope_scaling_type": "none",
"rope_scaling_factor": 1.0
}