Hugging Face's logo

ronaldmannak
/
FLUX.2-klein-4B-8bit

Text-to-Image
Diffusers
Safetensors
Flux2KleinPipeline
quantized
Model card Files
xet
 Community
ronaldmannak commited on
Commit
becec52
·
1 Parent(s): 6c9646c

Add 8-bit quantized model files

Browse files
Files changed (20) hide show
  1. .gitattributes +3 -0
  2. README.md +5 -0
  3. model_index.json +25 -0
  4. quantization.json +3608 -0
  5. scheduler/scheduler_config.json +18 -0
  6. text_encoder/config.json +68 -0
  7. text_encoder/generation_config.json +13 -0
  8. text_encoder/model-00001-of-00002.safetensors +3 -0
  9. text_encoder/model-00002-of-00002.safetensors +3 -0
  10. tokenizer/added_tokens.json +3 -0
  11. tokenizer/chat_template.jinja +3 -0
  12. tokenizer/merges.txt +3 -0
  13. tokenizer/special_tokens_map.json +3 -0
  14. tokenizer/tokenizer.json +3 -0
  15. tokenizer/tokenizer_config.json +3 -0
  16. tokenizer/vocab.json +3 -0
  17. transformer/config.json +24 -0
  18. transformer/diffusion_pytorch_model.safetensors +3 -0
  19. vae/config.json +40 -0
  20. vae/diffusion_pytorch_model.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
37
+ *.mlx filter=lfs diff=lfs merge=lfs -text
38
+ tokenizer/* filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,8 @@
1
  ---
 
 
 
 
 
2
  license: apache-2.0
3
  ---
 
1
  ---
2
+ base_model: black-forest-labs/FLUX.2-klein-4B
3
+ base_model_relation: quantized
4
+ quantized_by: ronaldmannak
5
+ tags:
6
+ - quantized
7
  license: apache-2.0
8
  ---
model_index.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "Flux2KleinPipeline",
3
+ "_diffusers_version": "0.37.0.dev0",
4
+ "is_distilled": true,
5
+ "scheduler": [
6
+ "diffusers",
7
+ "FlowMatchEulerDiscreteScheduler"
8
+ ],
9
+ "text_encoder": [
10
+ "transformers",
11
+ "Qwen3ForCausalLM"
12
+ ],
13
+ "tokenizer": [
14
+ "transformers",
15
+ "Qwen2TokenizerFast"
16
+ ],
17
+ "transformer": [
18
+ "diffusers",
19
+ "Flux2Transformer2DModel"
20
+ ],
21
+ "vae": [
22
+ "diffusers",
23
+ "AutoencoderKLFlux2"
24
+ ]
25
+ }
quantization.json ADDED
@@ -0,0 +1,3608 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bits" : 8,
3
+ "group_size" : 64,
4
+ "layers" : [
5
+ {
6
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
7
+ "in_dim" : 7680,
8
+ "name" : "transformer.context_embedder",
9
+ "out_dim" : 3072,
10
+ "shape" : [
11
+ 3072,
12
+ 7680
13
+ ]
14
+ },
15
+ {
16
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
17
+ "in_dim" : 3072,
18
+ "name" : "transformer.double_stream_modulation_img.linear",
19
+ "out_dim" : 18432,
20
+ "shape" : [
21
+ 18432,
22
+ 3072
23
+ ]
24
+ },
25
+ {
26
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
27
+ "in_dim" : 3072,
28
+ "name" : "transformer.double_stream_modulation_txt.linear",
29
+ "out_dim" : 18432,
30
+ "shape" : [
31
+ 18432,
32
+ 3072
33
+ ]
34
+ },
35
+ {
36
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
37
+ "in_dim" : 3072,
38
+ "name" : "transformer.proj_out",
39
+ "out_dim" : 128,
40
+ "shape" : [
41
+ 128,
42
+ 3072
43
+ ]
44
+ },
45
+ {
46
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
47
+ "in_dim" : 3072,
48
+ "name" : "transformer.single_stream_modulation.linear",
49
+ "out_dim" : 9216,
50
+ "shape" : [
51
+ 9216,
52
+ 3072
53
+ ]
54
+ },
55
+ {
56
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
57
+ "in_dim" : 12288,
58
+ "name" : "transformer.single_transformer_blocks.0.attn.to_out",
59
+ "out_dim" : 3072,
60
+ "shape" : [
61
+ 3072,
62
+ 12288
63
+ ]
64
+ },
65
+ {
66
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
67
+ "in_dim" : 3072,
68
+ "name" : "transformer.single_transformer_blocks.0.attn.to_qkv_mlp_proj",
69
+ "out_dim" : 27648,
70
+ "shape" : [
71
+ 27648,
72
+ 3072
73
+ ]
74
+ },
75
+ {
76
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
77
+ "in_dim" : 12288,
78
+ "name" : "transformer.single_transformer_blocks.1.attn.to_out",
79
+ "out_dim" : 3072,
80
+ "shape" : [
81
+ 3072,
82
+ 12288
83
+ ]
84
+ },
85
+ {
86
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
87
+ "in_dim" : 3072,
88
+ "name" : "transformer.single_transformer_blocks.1.attn.to_qkv_mlp_proj",
89
+ "out_dim" : 27648,
90
+ "shape" : [
91
+ 27648,
92
+ 3072
93
+ ]
94
+ },
95
+ {
96
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
97
+ "in_dim" : 12288,
98
+ "name" : "transformer.single_transformer_blocks.10.attn.to_out",
99
+ "out_dim" : 3072,
100
+ "shape" : [
101
+ 3072,
102
+ 12288
103
+ ]
104
+ },
105
+ {
106
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
107
+ "in_dim" : 3072,
108
+ "name" : "transformer.single_transformer_blocks.10.attn.to_qkv_mlp_proj",
109
+ "out_dim" : 27648,
110
+ "shape" : [
111
+ 27648,
112
+ 3072
113
+ ]
114
+ },
115
+ {
116
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
117
+ "in_dim" : 12288,
118
+ "name" : "transformer.single_transformer_blocks.11.attn.to_out",
119
+ "out_dim" : 3072,
120
+ "shape" : [
121
+ 3072,
122
+ 12288
123
+ ]
124
+ },
125
+ {
126
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
127
+ "in_dim" : 3072,
128
+ "name" : "transformer.single_transformer_blocks.11.attn.to_qkv_mlp_proj",
129
+ "out_dim" : 27648,
130
+ "shape" : [
131
+ 27648,
132
+ 3072
133
+ ]
134
+ },
135
+ {
136
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
137
+ "in_dim" : 12288,
138
+ "name" : "transformer.single_transformer_blocks.12.attn.to_out",
139
+ "out_dim" : 3072,
140
+ "shape" : [
141
+ 3072,
142
+ 12288
143
+ ]
144
+ },
145
+ {
146
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
147
+ "in_dim" : 3072,
148
+ "name" : "transformer.single_transformer_blocks.12.attn.to_qkv_mlp_proj",
149
+ "out_dim" : 27648,
150
+ "shape" : [
151
+ 27648,
152
+ 3072
153
+ ]
154
+ },
155
+ {
156
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
157
+ "in_dim" : 12288,
158
+ "name" : "transformer.single_transformer_blocks.13.attn.to_out",
159
+ "out_dim" : 3072,
160
+ "shape" : [
161
+ 3072,
162
+ 12288
163
+ ]
164
+ },
165
+ {
166
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
167
+ "in_dim" : 3072,
168
+ "name" : "transformer.single_transformer_blocks.13.attn.to_qkv_mlp_proj",
169
+ "out_dim" : 27648,
170
+ "shape" : [
171
+ 27648,
172
+ 3072
173
+ ]
174
+ },
175
+ {
176
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
177
+ "in_dim" : 12288,
178
+ "name" : "transformer.single_transformer_blocks.14.attn.to_out",
179
+ "out_dim" : 3072,
180
+ "shape" : [
181
+ 3072,
182
+ 12288
183
+ ]
184
+ },
185
+ {
186
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
187
+ "in_dim" : 3072,
188
+ "name" : "transformer.single_transformer_blocks.14.attn.to_qkv_mlp_proj",
189
+ "out_dim" : 27648,
190
+ "shape" : [
191
+ 27648,
192
+ 3072
193
+ ]
194
+ },
195
+ {
196
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
197
+ "in_dim" : 12288,
198
+ "name" : "transformer.single_transformer_blocks.15.attn.to_out",
199
+ "out_dim" : 3072,
200
+ "shape" : [
201
+ 3072,
202
+ 12288
203
+ ]
204
+ },
205
+ {
206
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
207
+ "in_dim" : 3072,
208
+ "name" : "transformer.single_transformer_blocks.15.attn.to_qkv_mlp_proj",
209
+ "out_dim" : 27648,
210
+ "shape" : [
211
+ 27648,
212
+ 3072
213
+ ]
214
+ },
215
+ {
216
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
217
+ "in_dim" : 12288,
218
+ "name" : "transformer.single_transformer_blocks.16.attn.to_out",
219
+ "out_dim" : 3072,
220
+ "shape" : [
221
+ 3072,
222
+ 12288
223
+ ]
224
+ },
225
+ {
226
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
227
+ "in_dim" : 3072,
228
+ "name" : "transformer.single_transformer_blocks.16.attn.to_qkv_mlp_proj",
229
+ "out_dim" : 27648,
230
+ "shape" : [
231
+ 27648,
232
+ 3072
233
+ ]
234
+ },
235
+ {
236
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
237
+ "in_dim" : 12288,
238
+ "name" : "transformer.single_transformer_blocks.17.attn.to_out",
239
+ "out_dim" : 3072,
240
+ "shape" : [
241
+ 3072,
242
+ 12288
243
+ ]
244
+ },
245
+ {
246
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
247
+ "in_dim" : 3072,
248
+ "name" : "transformer.single_transformer_blocks.17.attn.to_qkv_mlp_proj",
249
+ "out_dim" : 27648,
250
+ "shape" : [
251
+ 27648,
252
+ 3072
253
+ ]
254
+ },
255
+ {
256
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
257
+ "in_dim" : 12288,
258
+ "name" : "transformer.single_transformer_blocks.18.attn.to_out",
259
+ "out_dim" : 3072,
260
+ "shape" : [
261
+ 3072,
262
+ 12288
263
+ ]
264
+ },
265
+ {
266
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
267
+ "in_dim" : 3072,
268
+ "name" : "transformer.single_transformer_blocks.18.attn.to_qkv_mlp_proj",
269
+ "out_dim" : 27648,
270
+ "shape" : [
271
+ 27648,
272
+ 3072
273
+ ]
274
+ },
275
+ {
276
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
277
+ "in_dim" : 12288,
278
+ "name" : "transformer.single_transformer_blocks.19.attn.to_out",
279
+ "out_dim" : 3072,
280
+ "shape" : [
281
+ 3072,
282
+ 12288
283
+ ]
284
+ },
285
+ {
286
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
287
+ "in_dim" : 3072,
288
+ "name" : "transformer.single_transformer_blocks.19.attn.to_qkv_mlp_proj",
289
+ "out_dim" : 27648,
290
+ "shape" : [
291
+ 27648,
292
+ 3072
293
+ ]
294
+ },
295
+ {
296
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
297
+ "in_dim" : 12288,
298
+ "name" : "transformer.single_transformer_blocks.2.attn.to_out",
299
+ "out_dim" : 3072,
300
+ "shape" : [
301
+ 3072,
302
+ 12288
303
+ ]
304
+ },
305
+ {
306
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
307
+ "in_dim" : 3072,
308
+ "name" : "transformer.single_transformer_blocks.2.attn.to_qkv_mlp_proj",
309
+ "out_dim" : 27648,
310
+ "shape" : [
311
+ 27648,
312
+ 3072
313
+ ]
314
+ },
315
+ {
316
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
317
+ "in_dim" : 12288,
318
+ "name" : "transformer.single_transformer_blocks.3.attn.to_out",
319
+ "out_dim" : 3072,
320
+ "shape" : [
321
+ 3072,
322
+ 12288
323
+ ]
324
+ },
325
+ {
326
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
327
+ "in_dim" : 3072,
328
+ "name" : "transformer.single_transformer_blocks.3.attn.to_qkv_mlp_proj",
329
+ "out_dim" : 27648,
330
+ "shape" : [
331
+ 27648,
332
+ 3072
333
+ ]
334
+ },
335
+ {
336
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
337
+ "in_dim" : 12288,
338
+ "name" : "transformer.single_transformer_blocks.4.attn.to_out",
339
+ "out_dim" : 3072,
340
+ "shape" : [
341
+ 3072,
342
+ 12288
343
+ ]
344
+ },
345
+ {
346
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
347
+ "in_dim" : 3072,
348
+ "name" : "transformer.single_transformer_blocks.4.attn.to_qkv_mlp_proj",
349
+ "out_dim" : 27648,
350
+ "shape" : [
351
+ 27648,
352
+ 3072
353
+ ]
354
+ },
355
+ {
356
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
357
+ "in_dim" : 12288,
358
+ "name" : "transformer.single_transformer_blocks.5.attn.to_out",
359
+ "out_dim" : 3072,
360
+ "shape" : [
361
+ 3072,
362
+ 12288
363
+ ]
364
+ },
365
+ {
366
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
367
+ "in_dim" : 3072,
368
+ "name" : "transformer.single_transformer_blocks.5.attn.to_qkv_mlp_proj",
369
+ "out_dim" : 27648,
370
+ "shape" : [
371
+ 27648,
372
+ 3072
373
+ ]
374
+ },
375
+ {
376
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
377
+ "in_dim" : 12288,
378
+ "name" : "transformer.single_transformer_blocks.6.attn.to_out",
379
+ "out_dim" : 3072,
380
+ "shape" : [
381
+ 3072,
382
+ 12288
383
+ ]
384
+ },
385
+ {
386
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
387
+ "in_dim" : 3072,
388
+ "name" : "transformer.single_transformer_blocks.6.attn.to_qkv_mlp_proj",
389
+ "out_dim" : 27648,
390
+ "shape" : [
391
+ 27648,
392
+ 3072
393
+ ]
394
+ },
395
+ {
396
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
397
+ "in_dim" : 12288,
398
+ "name" : "transformer.single_transformer_blocks.7.attn.to_out",
399
+ "out_dim" : 3072,
400
+ "shape" : [
401
+ 3072,
402
+ 12288
403
+ ]
404
+ },
405
+ {
406
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
407
+ "in_dim" : 3072,
408
+ "name" : "transformer.single_transformer_blocks.7.attn.to_qkv_mlp_proj",
409
+ "out_dim" : 27648,
410
+ "shape" : [
411
+ 27648,
412
+ 3072
413
+ ]
414
+ },
415
+ {
416
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
417
+ "in_dim" : 12288,
418
+ "name" : "transformer.single_transformer_blocks.8.attn.to_out",
419
+ "out_dim" : 3072,
420
+ "shape" : [
421
+ 3072,
422
+ 12288
423
+ ]
424
+ },
425
+ {
426
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
427
+ "in_dim" : 3072,
428
+ "name" : "transformer.single_transformer_blocks.8.attn.to_qkv_mlp_proj",
429
+ "out_dim" : 27648,
430
+ "shape" : [
431
+ 27648,
432
+ 3072
433
+ ]
434
+ },
435
+ {
436
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
437
+ "in_dim" : 12288,
438
+ "name" : "transformer.single_transformer_blocks.9.attn.to_out",
439
+ "out_dim" : 3072,
440
+ "shape" : [
441
+ 3072,
442
+ 12288
443
+ ]
444
+ },
445
+ {
446
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
447
+ "in_dim" : 3072,
448
+ "name" : "transformer.single_transformer_blocks.9.attn.to_qkv_mlp_proj",
449
+ "out_dim" : 27648,
450
+ "shape" : [
451
+ 27648,
452
+ 3072
453
+ ]
454
+ },
455
+ {
456
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
457
+ "in_dim" : 256,
458
+ "name" : "transformer.time_guidance_embed.timestep_embedder.linear_1",
459
+ "out_dim" : 3072,
460
+ "shape" : [
461
+ 3072,
462
+ 256
463
+ ]
464
+ },
465
+ {
466
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
467
+ "in_dim" : 3072,
468
+ "name" : "transformer.time_guidance_embed.timestep_embedder.linear_2",
469
+ "out_dim" : 3072,
470
+ "shape" : [
471
+ 3072,
472
+ 3072
473
+ ]
474
+ },
475
+ {
476
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
477
+ "in_dim" : 3072,
478
+ "name" : "transformer.transformer_blocks.0.attn.add_k_proj",
479
+ "out_dim" : 3072,
480
+ "shape" : [
481
+ 3072,
482
+ 3072
483
+ ]
484
+ },
485
+ {
486
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
487
+ "in_dim" : 3072,
488
+ "name" : "transformer.transformer_blocks.0.attn.add_q_proj",
489
+ "out_dim" : 3072,
490
+ "shape" : [
491
+ 3072,
492
+ 3072
493
+ ]
494
+ },
495
+ {
496
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
497
+ "in_dim" : 3072,
498
+ "name" : "transformer.transformer_blocks.0.attn.add_v_proj",
499
+ "out_dim" : 3072,
500
+ "shape" : [
501
+ 3072,
502
+ 3072
503
+ ]
504
+ },
505
+ {
506
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
507
+ "in_dim" : 3072,
508
+ "name" : "transformer.transformer_blocks.0.attn.to_add_out",
509
+ "out_dim" : 3072,
510
+ "shape" : [
511
+ 3072,
512
+ 3072
513
+ ]
514
+ },
515
+ {
516
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
517
+ "in_dim" : 3072,
518
+ "name" : "transformer.transformer_blocks.0.attn.to_k",
519
+ "out_dim" : 3072,
520
+ "shape" : [
521
+ 3072,
522
+ 3072
523
+ ]
524
+ },
525
+ {
526
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
527
+ "in_dim" : 3072,
528
+ "name" : "transformer.transformer_blocks.0.attn.to_out.0",
529
+ "out_dim" : 3072,
530
+ "shape" : [
531
+ 3072,
532
+ 3072
533
+ ]
534
+ },
535
+ {
536
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
537
+ "in_dim" : 3072,
538
+ "name" : "transformer.transformer_blocks.0.attn.to_q",
539
+ "out_dim" : 3072,
540
+ "shape" : [
541
+ 3072,
542
+ 3072
543
+ ]
544
+ },
545
+ {
546
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
547
+ "in_dim" : 3072,
548
+ "name" : "transformer.transformer_blocks.0.attn.to_v",
549
+ "out_dim" : 3072,
550
+ "shape" : [
551
+ 3072,
552
+ 3072
553
+ ]
554
+ },
555
+ {
556
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
557
+ "in_dim" : 3072,
558
+ "name" : "transformer.transformer_blocks.0.ff.linear_in",
559
+ "out_dim" : 18432,
560
+ "shape" : [
561
+ 18432,
562
+ 3072
563
+ ]
564
+ },
565
+ {
566
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
567
+ "in_dim" : 9216,
568
+ "name" : "transformer.transformer_blocks.0.ff.linear_out",
569
+ "out_dim" : 3072,
570
+ "shape" : [
571
+ 3072,
572
+ 9216
573
+ ]
574
+ },
575
+ {
576
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
577
+ "in_dim" : 3072,
578
+ "name" : "transformer.transformer_blocks.0.ff_context.linear_in",
579
+ "out_dim" : 18432,
580
+ "shape" : [
581
+ 18432,
582
+ 3072
583
+ ]
584
+ },
585
+ {
586
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
587
+ "in_dim" : 9216,
588
+ "name" : "transformer.transformer_blocks.0.ff_context.linear_out",
589
+ "out_dim" : 3072,
590
+ "shape" : [
591
+ 3072,
592
+ 9216
593
+ ]
594
+ },
595
+ {
596
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
597
+ "in_dim" : 3072,
598
+ "name" : "transformer.transformer_blocks.1.attn.add_k_proj",
599
+ "out_dim" : 3072,
600
+ "shape" : [
601
+ 3072,
602
+ 3072
603
+ ]
604
+ },
605
+ {
606
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
607
+ "in_dim" : 3072,
608
+ "name" : "transformer.transformer_blocks.1.attn.add_q_proj",
609
+ "out_dim" : 3072,
610
+ "shape" : [
611
+ 3072,
612
+ 3072
613
+ ]
614
+ },
615
+ {
616
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
617
+ "in_dim" : 3072,
618
+ "name" : "transformer.transformer_blocks.1.attn.add_v_proj",
619
+ "out_dim" : 3072,
620
+ "shape" : [
621
+ 3072,
622
+ 3072
623
+ ]
624
+ },
625
+ {
626
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
627
+ "in_dim" : 3072,
628
+ "name" : "transformer.transformer_blocks.1.attn.to_add_out",
629
+ "out_dim" : 3072,
630
+ "shape" : [
631
+ 3072,
632
+ 3072
633
+ ]
634
+ },
635
+ {
636
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
637
+ "in_dim" : 3072,
638
+ "name" : "transformer.transformer_blocks.1.attn.to_k",
639
+ "out_dim" : 3072,
640
+ "shape" : [
641
+ 3072,
642
+ 3072
643
+ ]
644
+ },
645
+ {
646
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
647
+ "in_dim" : 3072,
648
+ "name" : "transformer.transformer_blocks.1.attn.to_out.0",
649
+ "out_dim" : 3072,
650
+ "shape" : [
651
+ 3072,
652
+ 3072
653
+ ]
654
+ },
655
+ {
656
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
657
+ "in_dim" : 3072,
658
+ "name" : "transformer.transformer_blocks.1.attn.to_q",
659
+ "out_dim" : 3072,
660
+ "shape" : [
661
+ 3072,
662
+ 3072
663
+ ]
664
+ },
665
+ {
666
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
667
+ "in_dim" : 3072,
668
+ "name" : "transformer.transformer_blocks.1.attn.to_v",
669
+ "out_dim" : 3072,
670
+ "shape" : [
671
+ 3072,
672
+ 3072
673
+ ]
674
+ },
675
+ {
676
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
677
+ "in_dim" : 3072,
678
+ "name" : "transformer.transformer_blocks.1.ff.linear_in",
679
+ "out_dim" : 18432,
680
+ "shape" : [
681
+ 18432,
682
+ 3072
683
+ ]
684
+ },
685
+ {
686
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
687
+ "in_dim" : 9216,
688
+ "name" : "transformer.transformer_blocks.1.ff.linear_out",
689
+ "out_dim" : 3072,
690
+ "shape" : [
691
+ 3072,
692
+ 9216
693
+ ]
694
+ },
695
+ {
696
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
697
+ "in_dim" : 3072,
698
+ "name" : "transformer.transformer_blocks.1.ff_context.linear_in",
699
+ "out_dim" : 18432,
700
+ "shape" : [
701
+ 18432,
702
+ 3072
703
+ ]
704
+ },
705
+ {
706
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
707
+ "in_dim" : 9216,
708
+ "name" : "transformer.transformer_blocks.1.ff_context.linear_out",
709
+ "out_dim" : 3072,
710
+ "shape" : [
711
+ 3072,
712
+ 9216
713
+ ]
714
+ },
715
+ {
716
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
717
+ "in_dim" : 3072,
718
+ "name" : "transformer.transformer_blocks.2.attn.add_k_proj",
719
+ "out_dim" : 3072,
720
+ "shape" : [
721
+ 3072,
722
+ 3072
723
+ ]
724
+ },
725
+ {
726
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
727
+ "in_dim" : 3072,
728
+ "name" : "transformer.transformer_blocks.2.attn.add_q_proj",
729
+ "out_dim" : 3072,
730
+ "shape" : [
731
+ 3072,
732
+ 3072
733
+ ]
734
+ },
735
+ {
736
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
737
+ "in_dim" : 3072,
738
+ "name" : "transformer.transformer_blocks.2.attn.add_v_proj",
739
+ "out_dim" : 3072,
740
+ "shape" : [
741
+ 3072,
742
+ 3072
743
+ ]
744
+ },
745
+ {
746
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
747
+ "in_dim" : 3072,
748
+ "name" : "transformer.transformer_blocks.2.attn.to_add_out",
749
+ "out_dim" : 3072,
750
+ "shape" : [
751
+ 3072,
752
+ 3072
753
+ ]
754
+ },
755
+ {
756
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
757
+ "in_dim" : 3072,
758
+ "name" : "transformer.transformer_blocks.2.attn.to_k",
759
+ "out_dim" : 3072,
760
+ "shape" : [
761
+ 3072,
762
+ 3072
763
+ ]
764
+ },
765
+ {
766
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
767
+ "in_dim" : 3072,
768
+ "name" : "transformer.transformer_blocks.2.attn.to_out.0",
769
+ "out_dim" : 3072,
770
+ "shape" : [
771
+ 3072,
772
+ 3072
773
+ ]
774
+ },
775
+ {
776
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
777
+ "in_dim" : 3072,
778
+ "name" : "transformer.transformer_blocks.2.attn.to_q",
779
+ "out_dim" : 3072,
780
+ "shape" : [
781
+ 3072,
782
+ 3072
783
+ ]
784
+ },
785
+ {
786
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
787
+ "in_dim" : 3072,
788
+ "name" : "transformer.transformer_blocks.2.attn.to_v",
789
+ "out_dim" : 3072,
790
+ "shape" : [
791
+ 3072,
792
+ 3072
793
+ ]
794
+ },
795
+ {
796
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
797
+ "in_dim" : 3072,
798
+ "name" : "transformer.transformer_blocks.2.ff.linear_in",
799
+ "out_dim" : 18432,
800
+ "shape" : [
801
+ 18432,
802
+ 3072
803
+ ]
804
+ },
805
+ {
806
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
807
+ "in_dim" : 9216,
808
+ "name" : "transformer.transformer_blocks.2.ff.linear_out",
809
+ "out_dim" : 3072,
810
+ "shape" : [
811
+ 3072,
812
+ 9216
813
+ ]
814
+ },
815
+ {
816
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
817
+ "in_dim" : 3072,
818
+ "name" : "transformer.transformer_blocks.2.ff_context.linear_in",
819
+ "out_dim" : 18432,
820
+ "shape" : [
821
+ 18432,
822
+ 3072
823
+ ]
824
+ },
825
+ {
826
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
827
+ "in_dim" : 9216,
828
+ "name" : "transformer.transformer_blocks.2.ff_context.linear_out",
829
+ "out_dim" : 3072,
830
+ "shape" : [
831
+ 3072,
832
+ 9216
833
+ ]
834
+ },
835
+ {
836
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
837
+ "in_dim" : 3072,
838
+ "name" : "transformer.transformer_blocks.3.attn.add_k_proj",
839
+ "out_dim" : 3072,
840
+ "shape" : [
841
+ 3072,
842
+ 3072
843
+ ]
844
+ },
845
+ {
846
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
847
+ "in_dim" : 3072,
848
+ "name" : "transformer.transformer_blocks.3.attn.add_q_proj",
849
+ "out_dim" : 3072,
850
+ "shape" : [
851
+ 3072,
852
+ 3072
853
+ ]
854
+ },
855
+ {
856
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
857
+ "in_dim" : 3072,
858
+ "name" : "transformer.transformer_blocks.3.attn.add_v_proj",
859
+ "out_dim" : 3072,
860
+ "shape" : [
861
+ 3072,
862
+ 3072
863
+ ]
864
+ },
865
+ {
866
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
867
+ "in_dim" : 3072,
868
+ "name" : "transformer.transformer_blocks.3.attn.to_add_out",
869
+ "out_dim" : 3072,
870
+ "shape" : [
871
+ 3072,
872
+ 3072
873
+ ]
874
+ },
875
+ {
876
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
877
+ "in_dim" : 3072,
878
+ "name" : "transformer.transformer_blocks.3.attn.to_k",
879
+ "out_dim" : 3072,
880
+ "shape" : [
881
+ 3072,
882
+ 3072
883
+ ]
884
+ },
885
+ {
886
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
887
+ "in_dim" : 3072,
888
+ "name" : "transformer.transformer_blocks.3.attn.to_out.0",
889
+ "out_dim" : 3072,
890
+ "shape" : [
891
+ 3072,
892
+ 3072
893
+ ]
894
+ },
895
+ {
896
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
897
+ "in_dim" : 3072,
898
+ "name" : "transformer.transformer_blocks.3.attn.to_q",
899
+ "out_dim" : 3072,
900
+ "shape" : [
901
+ 3072,
902
+ 3072
903
+ ]
904
+ },
905
+ {
906
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
907
+ "in_dim" : 3072,
908
+ "name" : "transformer.transformer_blocks.3.attn.to_v",
909
+ "out_dim" : 3072,
910
+ "shape" : [
911
+ 3072,
912
+ 3072
913
+ ]
914
+ },
915
+ {
916
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
917
+ "in_dim" : 3072,
918
+ "name" : "transformer.transformer_blocks.3.ff.linear_in",
919
+ "out_dim" : 18432,
920
+ "shape" : [
921
+ 18432,
922
+ 3072
923
+ ]
924
+ },
925
+ {
926
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
927
+ "in_dim" : 9216,
928
+ "name" : "transformer.transformer_blocks.3.ff.linear_out",
929
+ "out_dim" : 3072,
930
+ "shape" : [
931
+ 3072,
932
+ 9216
933
+ ]
934
+ },
935
+ {
936
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
937
+ "in_dim" : 3072,
938
+ "name" : "transformer.transformer_blocks.3.ff_context.linear_in",
939
+ "out_dim" : 18432,
940
+ "shape" : [
941
+ 18432,
942
+ 3072
943
+ ]
944
+ },
945
+ {
946
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
947
+ "in_dim" : 9216,
948
+ "name" : "transformer.transformer_blocks.3.ff_context.linear_out",
949
+ "out_dim" : 3072,
950
+ "shape" : [
951
+ 3072,
952
+ 9216
953
+ ]
954
+ },
955
+ {
956
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
957
+ "in_dim" : 3072,
958
+ "name" : "transformer.transformer_blocks.4.attn.add_k_proj",
959
+ "out_dim" : 3072,
960
+ "shape" : [
961
+ 3072,
962
+ 3072
963
+ ]
964
+ },
965
+ {
966
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
967
+ "in_dim" : 3072,
968
+ "name" : "transformer.transformer_blocks.4.attn.add_q_proj",
969
+ "out_dim" : 3072,
970
+ "shape" : [
971
+ 3072,
972
+ 3072
973
+ ]
974
+ },
975
+ {
976
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
977
+ "in_dim" : 3072,
978
+ "name" : "transformer.transformer_blocks.4.attn.add_v_proj",
979
+ "out_dim" : 3072,
980
+ "shape" : [
981
+ 3072,
982
+ 3072
983
+ ]
984
+ },
985
+ {
986
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
987
+ "in_dim" : 3072,
988
+ "name" : "transformer.transformer_blocks.4.attn.to_add_out",
989
+ "out_dim" : 3072,
990
+ "shape" : [
991
+ 3072,
992
+ 3072
993
+ ]
994
+ },
995
+ {
996
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
997
+ "in_dim" : 3072,
998
+ "name" : "transformer.transformer_blocks.4.attn.to_k",
999
+ "out_dim" : 3072,
1000
+ "shape" : [
1001
+ 3072,
1002
+ 3072
1003
+ ]
1004
+ },
1005
+ {
1006
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1007
+ "in_dim" : 3072,
1008
+ "name" : "transformer.transformer_blocks.4.attn.to_out.0",
1009
+ "out_dim" : 3072,
1010
+ "shape" : [
1011
+ 3072,
1012
+ 3072
1013
+ ]
1014
+ },
1015
+ {
1016
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1017
+ "in_dim" : 3072,
1018
+ "name" : "transformer.transformer_blocks.4.attn.to_q",
1019
+ "out_dim" : 3072,
1020
+ "shape" : [
1021
+ 3072,
1022
+ 3072
1023
+ ]
1024
+ },
1025
+ {
1026
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1027
+ "in_dim" : 3072,
1028
+ "name" : "transformer.transformer_blocks.4.attn.to_v",
1029
+ "out_dim" : 3072,
1030
+ "shape" : [
1031
+ 3072,
1032
+ 3072
1033
+ ]
1034
+ },
1035
+ {
1036
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1037
+ "in_dim" : 3072,
1038
+ "name" : "transformer.transformer_blocks.4.ff.linear_in",
1039
+ "out_dim" : 18432,
1040
+ "shape" : [
1041
+ 18432,
1042
+ 3072
1043
+ ]
1044
+ },
1045
+ {
1046
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1047
+ "in_dim" : 9216,
1048
+ "name" : "transformer.transformer_blocks.4.ff.linear_out",
1049
+ "out_dim" : 3072,
1050
+ "shape" : [
1051
+ 3072,
1052
+ 9216
1053
+ ]
1054
+ },
1055
+ {
1056
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1057
+ "in_dim" : 3072,
1058
+ "name" : "transformer.transformer_blocks.4.ff_context.linear_in",
1059
+ "out_dim" : 18432,
1060
+ "shape" : [
1061
+ 18432,
1062
+ 3072
1063
+ ]
1064
+ },
1065
+ {
1066
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1067
+ "in_dim" : 9216,
1068
+ "name" : "transformer.transformer_blocks.4.ff_context.linear_out",
1069
+ "out_dim" : 3072,
1070
+ "shape" : [
1071
+ 3072,
1072
+ 9216
1073
+ ]
1074
+ },
1075
+ {
1076
+ "file" : "transformer\/diffusion_pytorch_model.safetensors",
1077
+ "in_dim" : 128,
1078
+ "name" : "transformer.x_embedder",
1079
+ "out_dim" : 3072,
1080
+ "shape" : [
1081
+ 3072,
1082
+ 128
1083
+ ]
1084
+ },
1085
+ {
1086
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1087
+ "in_dim" : 9728,
1088
+ "name" : "text_encoder.model.layers.0.mlp.down_proj",
1089
+ "out_dim" : 2560,
1090
+ "shape" : [
1091
+ 2560,
1092
+ 9728
1093
+ ]
1094
+ },
1095
+ {
1096
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1097
+ "in_dim" : 2560,
1098
+ "name" : "text_encoder.model.layers.0.mlp.gate_proj",
1099
+ "out_dim" : 9728,
1100
+ "shape" : [
1101
+ 9728,
1102
+ 2560
1103
+ ]
1104
+ },
1105
+ {
1106
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1107
+ "in_dim" : 2560,
1108
+ "name" : "text_encoder.model.layers.0.mlp.up_proj",
1109
+ "out_dim" : 9728,
1110
+ "shape" : [
1111
+ 9728,
1112
+ 2560
1113
+ ]
1114
+ },
1115
+ {
1116
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1117
+ "in_dim" : 2560,
1118
+ "name" : "text_encoder.model.layers.0.self_attn.k_proj",
1119
+ "out_dim" : 1024,
1120
+ "shape" : [
1121
+ 1024,
1122
+ 2560
1123
+ ]
1124
+ },
1125
+ {
1126
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1127
+ "in_dim" : 4096,
1128
+ "name" : "text_encoder.model.layers.0.self_attn.o_proj",
1129
+ "out_dim" : 2560,
1130
+ "shape" : [
1131
+ 2560,
1132
+ 4096
1133
+ ]
1134
+ },
1135
+ {
1136
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1137
+ "in_dim" : 2560,
1138
+ "name" : "text_encoder.model.layers.0.self_attn.q_proj",
1139
+ "out_dim" : 4096,
1140
+ "shape" : [
1141
+ 4096,
1142
+ 2560
1143
+ ]
1144
+ },
1145
+ {
1146
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1147
+ "in_dim" : 2560,
1148
+ "name" : "text_encoder.model.layers.0.self_attn.v_proj",
1149
+ "out_dim" : 1024,
1150
+ "shape" : [
1151
+ 1024,
1152
+ 2560
1153
+ ]
1154
+ },
1155
+ {
1156
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1157
+ "in_dim" : 9728,
1158
+ "name" : "text_encoder.model.layers.1.mlp.down_proj",
1159
+ "out_dim" : 2560,
1160
+ "shape" : [
1161
+ 2560,
1162
+ 9728
1163
+ ]
1164
+ },
1165
+ {
1166
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1167
+ "in_dim" : 2560,
1168
+ "name" : "text_encoder.model.layers.1.mlp.gate_proj",
1169
+ "out_dim" : 9728,
1170
+ "shape" : [
1171
+ 9728,
1172
+ 2560
1173
+ ]
1174
+ },
1175
+ {
1176
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1177
+ "in_dim" : 2560,
1178
+ "name" : "text_encoder.model.layers.1.mlp.up_proj",
1179
+ "out_dim" : 9728,
1180
+ "shape" : [
1181
+ 9728,
1182
+ 2560
1183
+ ]
1184
+ },
1185
+ {
1186
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1187
+ "in_dim" : 2560,
1188
+ "name" : "text_encoder.model.layers.1.self_attn.k_proj",
1189
+ "out_dim" : 1024,
1190
+ "shape" : [
1191
+ 1024,
1192
+ 2560
1193
+ ]
1194
+ },
1195
+ {
1196
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1197
+ "in_dim" : 4096,
1198
+ "name" : "text_encoder.model.layers.1.self_attn.o_proj",
1199
+ "out_dim" : 2560,
1200
+ "shape" : [
1201
+ 2560,
1202
+ 4096
1203
+ ]
1204
+ },
1205
+ {
1206
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1207
+ "in_dim" : 2560,
1208
+ "name" : "text_encoder.model.layers.1.self_attn.q_proj",
1209
+ "out_dim" : 4096,
1210
+ "shape" : [
1211
+ 4096,
1212
+ 2560
1213
+ ]
1214
+ },
1215
+ {
1216
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1217
+ "in_dim" : 2560,
1218
+ "name" : "text_encoder.model.layers.1.self_attn.v_proj",
1219
+ "out_dim" : 1024,
1220
+ "shape" : [
1221
+ 1024,
1222
+ 2560
1223
+ ]
1224
+ },
1225
+ {
1226
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1227
+ "in_dim" : 9728,
1228
+ "name" : "text_encoder.model.layers.10.mlp.down_proj",
1229
+ "out_dim" : 2560,
1230
+ "shape" : [
1231
+ 2560,
1232
+ 9728
1233
+ ]
1234
+ },
1235
+ {
1236
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1237
+ "in_dim" : 2560,
1238
+ "name" : "text_encoder.model.layers.10.mlp.gate_proj",
1239
+ "out_dim" : 9728,
1240
+ "shape" : [
1241
+ 9728,
1242
+ 2560
1243
+ ]
1244
+ },
1245
+ {
1246
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1247
+ "in_dim" : 2560,
1248
+ "name" : "text_encoder.model.layers.10.mlp.up_proj",
1249
+ "out_dim" : 9728,
1250
+ "shape" : [
1251
+ 9728,
1252
+ 2560
1253
+ ]
1254
+ },
1255
+ {
1256
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1257
+ "in_dim" : 2560,
1258
+ "name" : "text_encoder.model.layers.10.self_attn.k_proj",
1259
+ "out_dim" : 1024,
1260
+ "shape" : [
1261
+ 1024,
1262
+ 2560
1263
+ ]
1264
+ },
1265
+ {
1266
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1267
+ "in_dim" : 4096,
1268
+ "name" : "text_encoder.model.layers.10.self_attn.o_proj",
1269
+ "out_dim" : 2560,
1270
+ "shape" : [
1271
+ 2560,
1272
+ 4096
1273
+ ]
1274
+ },
1275
+ {
1276
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1277
+ "in_dim" : 2560,
1278
+ "name" : "text_encoder.model.layers.10.self_attn.q_proj",
1279
+ "out_dim" : 4096,
1280
+ "shape" : [
1281
+ 4096,
1282
+ 2560
1283
+ ]
1284
+ },
1285
+ {
1286
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1287
+ "in_dim" : 2560,
1288
+ "name" : "text_encoder.model.layers.10.self_attn.v_proj",
1289
+ "out_dim" : 1024,
1290
+ "shape" : [
1291
+ 1024,
1292
+ 2560
1293
+ ]
1294
+ },
1295
+ {
1296
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1297
+ "in_dim" : 9728,
1298
+ "name" : "text_encoder.model.layers.11.mlp.down_proj",
1299
+ "out_dim" : 2560,
1300
+ "shape" : [
1301
+ 2560,
1302
+ 9728
1303
+ ]
1304
+ },
1305
+ {
1306
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1307
+ "in_dim" : 2560,
1308
+ "name" : "text_encoder.model.layers.11.mlp.gate_proj",
1309
+ "out_dim" : 9728,
1310
+ "shape" : [
1311
+ 9728,
1312
+ 2560
1313
+ ]
1314
+ },
1315
+ {
1316
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1317
+ "in_dim" : 2560,
1318
+ "name" : "text_encoder.model.layers.11.mlp.up_proj",
1319
+ "out_dim" : 9728,
1320
+ "shape" : [
1321
+ 9728,
1322
+ 2560
1323
+ ]
1324
+ },
1325
+ {
1326
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1327
+ "in_dim" : 2560,
1328
+ "name" : "text_encoder.model.layers.11.self_attn.k_proj",
1329
+ "out_dim" : 1024,
1330
+ "shape" : [
1331
+ 1024,
1332
+ 2560
1333
+ ]
1334
+ },
1335
+ {
1336
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1337
+ "in_dim" : 4096,
1338
+ "name" : "text_encoder.model.layers.11.self_attn.o_proj",
1339
+ "out_dim" : 2560,
1340
+ "shape" : [
1341
+ 2560,
1342
+ 4096
1343
+ ]
1344
+ },
1345
+ {
1346
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1347
+ "in_dim" : 2560,
1348
+ "name" : "text_encoder.model.layers.11.self_attn.q_proj",
1349
+ "out_dim" : 4096,
1350
+ "shape" : [
1351
+ 4096,
1352
+ 2560
1353
+ ]
1354
+ },
1355
+ {
1356
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1357
+ "in_dim" : 2560,
1358
+ "name" : "text_encoder.model.layers.11.self_attn.v_proj",
1359
+ "out_dim" : 1024,
1360
+ "shape" : [
1361
+ 1024,
1362
+ 2560
1363
+ ]
1364
+ },
1365
+ {
1366
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1367
+ "in_dim" : 9728,
1368
+ "name" : "text_encoder.model.layers.12.mlp.down_proj",
1369
+ "out_dim" : 2560,
1370
+ "shape" : [
1371
+ 2560,
1372
+ 9728
1373
+ ]
1374
+ },
1375
+ {
1376
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1377
+ "in_dim" : 2560,
1378
+ "name" : "text_encoder.model.layers.12.mlp.gate_proj",
1379
+ "out_dim" : 9728,
1380
+ "shape" : [
1381
+ 9728,
1382
+ 2560
1383
+ ]
1384
+ },
1385
+ {
1386
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1387
+ "in_dim" : 2560,
1388
+ "name" : "text_encoder.model.layers.12.mlp.up_proj",
1389
+ "out_dim" : 9728,
1390
+ "shape" : [
1391
+ 9728,
1392
+ 2560
1393
+ ]
1394
+ },
1395
+ {
1396
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1397
+ "in_dim" : 2560,
1398
+ "name" : "text_encoder.model.layers.12.self_attn.k_proj",
1399
+ "out_dim" : 1024,
1400
+ "shape" : [
1401
+ 1024,
1402
+ 2560
1403
+ ]
1404
+ },
1405
+ {
1406
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1407
+ "in_dim" : 4096,
1408
+ "name" : "text_encoder.model.layers.12.self_attn.o_proj",
1409
+ "out_dim" : 2560,
1410
+ "shape" : [
1411
+ 2560,
1412
+ 4096
1413
+ ]
1414
+ },
1415
+ {
1416
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1417
+ "in_dim" : 2560,
1418
+ "name" : "text_encoder.model.layers.12.self_attn.q_proj",
1419
+ "out_dim" : 4096,
1420
+ "shape" : [
1421
+ 4096,
1422
+ 2560
1423
+ ]
1424
+ },
1425
+ {
1426
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1427
+ "in_dim" : 2560,
1428
+ "name" : "text_encoder.model.layers.12.self_attn.v_proj",
1429
+ "out_dim" : 1024,
1430
+ "shape" : [
1431
+ 1024,
1432
+ 2560
1433
+ ]
1434
+ },
1435
+ {
1436
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1437
+ "in_dim" : 9728,
1438
+ "name" : "text_encoder.model.layers.13.mlp.down_proj",
1439
+ "out_dim" : 2560,
1440
+ "shape" : [
1441
+ 2560,
1442
+ 9728
1443
+ ]
1444
+ },
1445
+ {
1446
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1447
+ "in_dim" : 2560,
1448
+ "name" : "text_encoder.model.layers.13.mlp.gate_proj",
1449
+ "out_dim" : 9728,
1450
+ "shape" : [
1451
+ 9728,
1452
+ 2560
1453
+ ]
1454
+ },
1455
+ {
1456
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1457
+ "in_dim" : 2560,
1458
+ "name" : "text_encoder.model.layers.13.mlp.up_proj",
1459
+ "out_dim" : 9728,
1460
+ "shape" : [
1461
+ 9728,
1462
+ 2560
1463
+ ]
1464
+ },
1465
+ {
1466
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1467
+ "in_dim" : 2560,
1468
+ "name" : "text_encoder.model.layers.13.self_attn.k_proj",
1469
+ "out_dim" : 1024,
1470
+ "shape" : [
1471
+ 1024,
1472
+ 2560
1473
+ ]
1474
+ },
1475
+ {
1476
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1477
+ "in_dim" : 4096,
1478
+ "name" : "text_encoder.model.layers.13.self_attn.o_proj",
1479
+ "out_dim" : 2560,
1480
+ "shape" : [
1481
+ 2560,
1482
+ 4096
1483
+ ]
1484
+ },
1485
+ {
1486
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1487
+ "in_dim" : 2560,
1488
+ "name" : "text_encoder.model.layers.13.self_attn.q_proj",
1489
+ "out_dim" : 4096,
1490
+ "shape" : [
1491
+ 4096,
1492
+ 2560
1493
+ ]
1494
+ },
1495
+ {
1496
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1497
+ "in_dim" : 2560,
1498
+ "name" : "text_encoder.model.layers.13.self_attn.v_proj",
1499
+ "out_dim" : 1024,
1500
+ "shape" : [
1501
+ 1024,
1502
+ 2560
1503
+ ]
1504
+ },
1505
+ {
1506
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1507
+ "in_dim" : 9728,
1508
+ "name" : "text_encoder.model.layers.14.mlp.down_proj",
1509
+ "out_dim" : 2560,
1510
+ "shape" : [
1511
+ 2560,
1512
+ 9728
1513
+ ]
1514
+ },
1515
+ {
1516
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1517
+ "in_dim" : 2560,
1518
+ "name" : "text_encoder.model.layers.14.mlp.gate_proj",
1519
+ "out_dim" : 9728,
1520
+ "shape" : [
1521
+ 9728,
1522
+ 2560
1523
+ ]
1524
+ },
1525
+ {
1526
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1527
+ "in_dim" : 2560,
1528
+ "name" : "text_encoder.model.layers.14.mlp.up_proj",
1529
+ "out_dim" : 9728,
1530
+ "shape" : [
1531
+ 9728,
1532
+ 2560
1533
+ ]
1534
+ },
1535
+ {
1536
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1537
+ "in_dim" : 2560,
1538
+ "name" : "text_encoder.model.layers.14.self_attn.k_proj",
1539
+ "out_dim" : 1024,
1540
+ "shape" : [
1541
+ 1024,
1542
+ 2560
1543
+ ]
1544
+ },
1545
+ {
1546
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1547
+ "in_dim" : 4096,
1548
+ "name" : "text_encoder.model.layers.14.self_attn.o_proj",
1549
+ "out_dim" : 2560,
1550
+ "shape" : [
1551
+ 2560,
1552
+ 4096
1553
+ ]
1554
+ },
1555
+ {
1556
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1557
+ "in_dim" : 2560,
1558
+ "name" : "text_encoder.model.layers.14.self_attn.q_proj",
1559
+ "out_dim" : 4096,
1560
+ "shape" : [
1561
+ 4096,
1562
+ 2560
1563
+ ]
1564
+ },
1565
+ {
1566
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1567
+ "in_dim" : 2560,
1568
+ "name" : "text_encoder.model.layers.14.self_attn.v_proj",
1569
+ "out_dim" : 1024,
1570
+ "shape" : [
1571
+ 1024,
1572
+ 2560
1573
+ ]
1574
+ },
1575
+ {
1576
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1577
+ "in_dim" : 9728,
1578
+ "name" : "text_encoder.model.layers.15.mlp.down_proj",
1579
+ "out_dim" : 2560,
1580
+ "shape" : [
1581
+ 2560,
1582
+ 9728
1583
+ ]
1584
+ },
1585
+ {
1586
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1587
+ "in_dim" : 2560,
1588
+ "name" : "text_encoder.model.layers.15.mlp.gate_proj",
1589
+ "out_dim" : 9728,
1590
+ "shape" : [
1591
+ 9728,
1592
+ 2560
1593
+ ]
1594
+ },
1595
+ {
1596
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1597
+ "in_dim" : 2560,
1598
+ "name" : "text_encoder.model.layers.15.mlp.up_proj",
1599
+ "out_dim" : 9728,
1600
+ "shape" : [
1601
+ 9728,
1602
+ 2560
1603
+ ]
1604
+ },
1605
+ {
1606
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1607
+ "in_dim" : 2560,
1608
+ "name" : "text_encoder.model.layers.15.self_attn.k_proj",
1609
+ "out_dim" : 1024,
1610
+ "shape" : [
1611
+ 1024,
1612
+ 2560
1613
+ ]
1614
+ },
1615
+ {
1616
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1617
+ "in_dim" : 4096,
1618
+ "name" : "text_encoder.model.layers.15.self_attn.o_proj",
1619
+ "out_dim" : 2560,
1620
+ "shape" : [
1621
+ 2560,
1622
+ 4096
1623
+ ]
1624
+ },
1625
+ {
1626
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1627
+ "in_dim" : 2560,
1628
+ "name" : "text_encoder.model.layers.15.self_attn.q_proj",
1629
+ "out_dim" : 4096,
1630
+ "shape" : [
1631
+ 4096,
1632
+ 2560
1633
+ ]
1634
+ },
1635
+ {
1636
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1637
+ "in_dim" : 2560,
1638
+ "name" : "text_encoder.model.layers.15.self_attn.v_proj",
1639
+ "out_dim" : 1024,
1640
+ "shape" : [
1641
+ 1024,
1642
+ 2560
1643
+ ]
1644
+ },
1645
+ {
1646
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1647
+ "in_dim" : 9728,
1648
+ "name" : "text_encoder.model.layers.16.mlp.down_proj",
1649
+ "out_dim" : 2560,
1650
+ "shape" : [
1651
+ 2560,
1652
+ 9728
1653
+ ]
1654
+ },
1655
+ {
1656
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1657
+ "in_dim" : 2560,
1658
+ "name" : "text_encoder.model.layers.16.mlp.gate_proj",
1659
+ "out_dim" : 9728,
1660
+ "shape" : [
1661
+ 9728,
1662
+ 2560
1663
+ ]
1664
+ },
1665
+ {
1666
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1667
+ "in_dim" : 2560,
1668
+ "name" : "text_encoder.model.layers.16.mlp.up_proj",
1669
+ "out_dim" : 9728,
1670
+ "shape" : [
1671
+ 9728,
1672
+ 2560
1673
+ ]
1674
+ },
1675
+ {
1676
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1677
+ "in_dim" : 2560,
1678
+ "name" : "text_encoder.model.layers.16.self_attn.k_proj",
1679
+ "out_dim" : 1024,
1680
+ "shape" : [
1681
+ 1024,
1682
+ 2560
1683
+ ]
1684
+ },
1685
+ {
1686
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1687
+ "in_dim" : 4096,
1688
+ "name" : "text_encoder.model.layers.16.self_attn.o_proj",
1689
+ "out_dim" : 2560,
1690
+ "shape" : [
1691
+ 2560,
1692
+ 4096
1693
+ ]
1694
+ },
1695
+ {
1696
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1697
+ "in_dim" : 2560,
1698
+ "name" : "text_encoder.model.layers.16.self_attn.q_proj",
1699
+ "out_dim" : 4096,
1700
+ "shape" : [
1701
+ 4096,
1702
+ 2560
1703
+ ]
1704
+ },
1705
+ {
1706
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1707
+ "in_dim" : 2560,
1708
+ "name" : "text_encoder.model.layers.16.self_attn.v_proj",
1709
+ "out_dim" : 1024,
1710
+ "shape" : [
1711
+ 1024,
1712
+ 2560
1713
+ ]
1714
+ },
1715
+ {
1716
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1717
+ "in_dim" : 9728,
1718
+ "name" : "text_encoder.model.layers.17.mlp.down_proj",
1719
+ "out_dim" : 2560,
1720
+ "shape" : [
1721
+ 2560,
1722
+ 9728
1723
+ ]
1724
+ },
1725
+ {
1726
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1727
+ "in_dim" : 2560,
1728
+ "name" : "text_encoder.model.layers.17.mlp.gate_proj",
1729
+ "out_dim" : 9728,
1730
+ "shape" : [
1731
+ 9728,
1732
+ 2560
1733
+ ]
1734
+ },
1735
+ {
1736
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1737
+ "in_dim" : 2560,
1738
+ "name" : "text_encoder.model.layers.17.mlp.up_proj",
1739
+ "out_dim" : 9728,
1740
+ "shape" : [
1741
+ 9728,
1742
+ 2560
1743
+ ]
1744
+ },
1745
+ {
1746
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1747
+ "in_dim" : 2560,
1748
+ "name" : "text_encoder.model.layers.17.self_attn.k_proj",
1749
+ "out_dim" : 1024,
1750
+ "shape" : [
1751
+ 1024,
1752
+ 2560
1753
+ ]
1754
+ },
1755
+ {
1756
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1757
+ "in_dim" : 4096,
1758
+ "name" : "text_encoder.model.layers.17.self_attn.o_proj",
1759
+ "out_dim" : 2560,
1760
+ "shape" : [
1761
+ 2560,
1762
+ 4096
1763
+ ]
1764
+ },
1765
+ {
1766
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1767
+ "in_dim" : 2560,
1768
+ "name" : "text_encoder.model.layers.17.self_attn.q_proj",
1769
+ "out_dim" : 4096,
1770
+ "shape" : [
1771
+ 4096,
1772
+ 2560
1773
+ ]
1774
+ },
1775
+ {
1776
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1777
+ "in_dim" : 2560,
1778
+ "name" : "text_encoder.model.layers.17.self_attn.v_proj",
1779
+ "out_dim" : 1024,
1780
+ "shape" : [
1781
+ 1024,
1782
+ 2560
1783
+ ]
1784
+ },
1785
+ {
1786
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1787
+ "in_dim" : 9728,
1788
+ "name" : "text_encoder.model.layers.18.mlp.down_proj",
1789
+ "out_dim" : 2560,
1790
+ "shape" : [
1791
+ 2560,
1792
+ 9728
1793
+ ]
1794
+ },
1795
+ {
1796
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1797
+ "in_dim" : 2560,
1798
+ "name" : "text_encoder.model.layers.18.mlp.gate_proj",
1799
+ "out_dim" : 9728,
1800
+ "shape" : [
1801
+ 9728,
1802
+ 2560
1803
+ ]
1804
+ },
1805
+ {
1806
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1807
+ "in_dim" : 2560,
1808
+ "name" : "text_encoder.model.layers.18.mlp.up_proj",
1809
+ "out_dim" : 9728,
1810
+ "shape" : [
1811
+ 9728,
1812
+ 2560
1813
+ ]
1814
+ },
1815
+ {
1816
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1817
+ "in_dim" : 2560,
1818
+ "name" : "text_encoder.model.layers.18.self_attn.k_proj",
1819
+ "out_dim" : 1024,
1820
+ "shape" : [
1821
+ 1024,
1822
+ 2560
1823
+ ]
1824
+ },
1825
+ {
1826
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1827
+ "in_dim" : 4096,
1828
+ "name" : "text_encoder.model.layers.18.self_attn.o_proj",
1829
+ "out_dim" : 2560,
1830
+ "shape" : [
1831
+ 2560,
1832
+ 4096
1833
+ ]
1834
+ },
1835
+ {
1836
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1837
+ "in_dim" : 2560,
1838
+ "name" : "text_encoder.model.layers.18.self_attn.q_proj",
1839
+ "out_dim" : 4096,
1840
+ "shape" : [
1841
+ 4096,
1842
+ 2560
1843
+ ]
1844
+ },
1845
+ {
1846
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1847
+ "in_dim" : 2560,
1848
+ "name" : "text_encoder.model.layers.18.self_attn.v_proj",
1849
+ "out_dim" : 1024,
1850
+ "shape" : [
1851
+ 1024,
1852
+ 2560
1853
+ ]
1854
+ },
1855
+ {
1856
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1857
+ "in_dim" : 9728,
1858
+ "name" : "text_encoder.model.layers.19.mlp.down_proj",
1859
+ "out_dim" : 2560,
1860
+ "shape" : [
1861
+ 2560,
1862
+ 9728
1863
+ ]
1864
+ },
1865
+ {
1866
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1867
+ "in_dim" : 2560,
1868
+ "name" : "text_encoder.model.layers.19.mlp.gate_proj",
1869
+ "out_dim" : 9728,
1870
+ "shape" : [
1871
+ 9728,
1872
+ 2560
1873
+ ]
1874
+ },
1875
+ {
1876
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1877
+ "in_dim" : 2560,
1878
+ "name" : "text_encoder.model.layers.19.mlp.up_proj",
1879
+ "out_dim" : 9728,
1880
+ "shape" : [
1881
+ 9728,
1882
+ 2560
1883
+ ]
1884
+ },
1885
+ {
1886
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1887
+ "in_dim" : 2560,
1888
+ "name" : "text_encoder.model.layers.19.self_attn.k_proj",
1889
+ "out_dim" : 1024,
1890
+ "shape" : [
1891
+ 1024,
1892
+ 2560
1893
+ ]
1894
+ },
1895
+ {
1896
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1897
+ "in_dim" : 4096,
1898
+ "name" : "text_encoder.model.layers.19.self_attn.o_proj",
1899
+ "out_dim" : 2560,
1900
+ "shape" : [
1901
+ 2560,
1902
+ 4096
1903
+ ]
1904
+ },
1905
+ {
1906
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1907
+ "in_dim" : 2560,
1908
+ "name" : "text_encoder.model.layers.19.self_attn.q_proj",
1909
+ "out_dim" : 4096,
1910
+ "shape" : [
1911
+ 4096,
1912
+ 2560
1913
+ ]
1914
+ },
1915
+ {
1916
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1917
+ "in_dim" : 2560,
1918
+ "name" : "text_encoder.model.layers.19.self_attn.v_proj",
1919
+ "out_dim" : 1024,
1920
+ "shape" : [
1921
+ 1024,
1922
+ 2560
1923
+ ]
1924
+ },
1925
+ {
1926
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1927
+ "in_dim" : 9728,
1928
+ "name" : "text_encoder.model.layers.2.mlp.down_proj",
1929
+ "out_dim" : 2560,
1930
+ "shape" : [
1931
+ 2560,
1932
+ 9728
1933
+ ]
1934
+ },
1935
+ {
1936
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1937
+ "in_dim" : 2560,
1938
+ "name" : "text_encoder.model.layers.2.mlp.gate_proj",
1939
+ "out_dim" : 9728,
1940
+ "shape" : [
1941
+ 9728,
1942
+ 2560
1943
+ ]
1944
+ },
1945
+ {
1946
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1947
+ "in_dim" : 2560,
1948
+ "name" : "text_encoder.model.layers.2.mlp.up_proj",
1949
+ "out_dim" : 9728,
1950
+ "shape" : [
1951
+ 9728,
1952
+ 2560
1953
+ ]
1954
+ },
1955
+ {
1956
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1957
+ "in_dim" : 2560,
1958
+ "name" : "text_encoder.model.layers.2.self_attn.k_proj",
1959
+ "out_dim" : 1024,
1960
+ "shape" : [
1961
+ 1024,
1962
+ 2560
1963
+ ]
1964
+ },
1965
+ {
1966
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1967
+ "in_dim" : 4096,
1968
+ "name" : "text_encoder.model.layers.2.self_attn.o_proj",
1969
+ "out_dim" : 2560,
1970
+ "shape" : [
1971
+ 2560,
1972
+ 4096
1973
+ ]
1974
+ },
1975
+ {
1976
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1977
+ "in_dim" : 2560,
1978
+ "name" : "text_encoder.model.layers.2.self_attn.q_proj",
1979
+ "out_dim" : 4096,
1980
+ "shape" : [
1981
+ 4096,
1982
+ 2560
1983
+ ]
1984
+ },
1985
+ {
1986
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1987
+ "in_dim" : 2560,
1988
+ "name" : "text_encoder.model.layers.2.self_attn.v_proj",
1989
+ "out_dim" : 1024,
1990
+ "shape" : [
1991
+ 1024,
1992
+ 2560
1993
+ ]
1994
+ },
1995
+ {
1996
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
1997
+ "in_dim" : 2560,
1998
+ "name" : "text_encoder.model.layers.20.mlp.gate_proj",
1999
+ "out_dim" : 9728,
2000
+ "shape" : [
2001
+ 9728,
2002
+ 2560
2003
+ ]
2004
+ },
2005
+ {
2006
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2007
+ "in_dim" : 2560,
2008
+ "name" : "text_encoder.model.layers.20.mlp.up_proj",
2009
+ "out_dim" : 9728,
2010
+ "shape" : [
2011
+ 9728,
2012
+ 2560
2013
+ ]
2014
+ },
2015
+ {
2016
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2017
+ "in_dim" : 2560,
2018
+ "name" : "text_encoder.model.layers.20.self_attn.k_proj",
2019
+ "out_dim" : 1024,
2020
+ "shape" : [
2021
+ 1024,
2022
+ 2560
2023
+ ]
2024
+ },
2025
+ {
2026
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2027
+ "in_dim" : 4096,
2028
+ "name" : "text_encoder.model.layers.20.self_attn.o_proj",
2029
+ "out_dim" : 2560,
2030
+ "shape" : [
2031
+ 2560,
2032
+ 4096
2033
+ ]
2034
+ },
2035
+ {
2036
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2037
+ "in_dim" : 2560,
2038
+ "name" : "text_encoder.model.layers.20.self_attn.q_proj",
2039
+ "out_dim" : 4096,
2040
+ "shape" : [
2041
+ 4096,
2042
+ 2560
2043
+ ]
2044
+ },
2045
+ {
2046
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2047
+ "in_dim" : 2560,
2048
+ "name" : "text_encoder.model.layers.20.self_attn.v_proj",
2049
+ "out_dim" : 1024,
2050
+ "shape" : [
2051
+ 1024,
2052
+ 2560
2053
+ ]
2054
+ },
2055
+ {
2056
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2057
+ "in_dim" : 9728,
2058
+ "name" : "text_encoder.model.layers.3.mlp.down_proj",
2059
+ "out_dim" : 2560,
2060
+ "shape" : [
2061
+ 2560,
2062
+ 9728
2063
+ ]
2064
+ },
2065
+ {
2066
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2067
+ "in_dim" : 2560,
2068
+ "name" : "text_encoder.model.layers.3.mlp.gate_proj",
2069
+ "out_dim" : 9728,
2070
+ "shape" : [
2071
+ 9728,
2072
+ 2560
2073
+ ]
2074
+ },
2075
+ {
2076
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2077
+ "in_dim" : 2560,
2078
+ "name" : "text_encoder.model.layers.3.mlp.up_proj",
2079
+ "out_dim" : 9728,
2080
+ "shape" : [
2081
+ 9728,
2082
+ 2560
2083
+ ]
2084
+ },
2085
+ {
2086
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2087
+ "in_dim" : 2560,
2088
+ "name" : "text_encoder.model.layers.3.self_attn.k_proj",
2089
+ "out_dim" : 1024,
2090
+ "shape" : [
2091
+ 1024,
2092
+ 2560
2093
+ ]
2094
+ },
2095
+ {
2096
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2097
+ "in_dim" : 4096,
2098
+ "name" : "text_encoder.model.layers.3.self_attn.o_proj",
2099
+ "out_dim" : 2560,
2100
+ "shape" : [
2101
+ 2560,
2102
+ 4096
2103
+ ]
2104
+ },
2105
+ {
2106
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2107
+ "in_dim" : 2560,
2108
+ "name" : "text_encoder.model.layers.3.self_attn.q_proj",
2109
+ "out_dim" : 4096,
2110
+ "shape" : [
2111
+ 4096,
2112
+ 2560
2113
+ ]
2114
+ },
2115
+ {
2116
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2117
+ "in_dim" : 2560,
2118
+ "name" : "text_encoder.model.layers.3.self_attn.v_proj",
2119
+ "out_dim" : 1024,
2120
+ "shape" : [
2121
+ 1024,
2122
+ 2560
2123
+ ]
2124
+ },
2125
+ {
2126
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2127
+ "in_dim" : 9728,
2128
+ "name" : "text_encoder.model.layers.4.mlp.down_proj",
2129
+ "out_dim" : 2560,
2130
+ "shape" : [
2131
+ 2560,
2132
+ 9728
2133
+ ]
2134
+ },
2135
+ {
2136
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2137
+ "in_dim" : 2560,
2138
+ "name" : "text_encoder.model.layers.4.mlp.gate_proj",
2139
+ "out_dim" : 9728,
2140
+ "shape" : [
2141
+ 9728,
2142
+ 2560
2143
+ ]
2144
+ },
2145
+ {
2146
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2147
+ "in_dim" : 2560,
2148
+ "name" : "text_encoder.model.layers.4.mlp.up_proj",
2149
+ "out_dim" : 9728,
2150
+ "shape" : [
2151
+ 9728,
2152
+ 2560
2153
+ ]
2154
+ },
2155
+ {
2156
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2157
+ "in_dim" : 2560,
2158
+ "name" : "text_encoder.model.layers.4.self_attn.k_proj",
2159
+ "out_dim" : 1024,
2160
+ "shape" : [
2161
+ 1024,
2162
+ 2560
2163
+ ]
2164
+ },
2165
+ {
2166
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2167
+ "in_dim" : 4096,
2168
+ "name" : "text_encoder.model.layers.4.self_attn.o_proj",
2169
+ "out_dim" : 2560,
2170
+ "shape" : [
2171
+ 2560,
2172
+ 4096
2173
+ ]
2174
+ },
2175
+ {
2176
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2177
+ "in_dim" : 2560,
2178
+ "name" : "text_encoder.model.layers.4.self_attn.q_proj",
2179
+ "out_dim" : 4096,
2180
+ "shape" : [
2181
+ 4096,
2182
+ 2560
2183
+ ]
2184
+ },
2185
+ {
2186
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2187
+ "in_dim" : 2560,
2188
+ "name" : "text_encoder.model.layers.4.self_attn.v_proj",
2189
+ "out_dim" : 1024,
2190
+ "shape" : [
2191
+ 1024,
2192
+ 2560
2193
+ ]
2194
+ },
2195
+ {
2196
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2197
+ "in_dim" : 9728,
2198
+ "name" : "text_encoder.model.layers.5.mlp.down_proj",
2199
+ "out_dim" : 2560,
2200
+ "shape" : [
2201
+ 2560,
2202
+ 9728
2203
+ ]
2204
+ },
2205
+ {
2206
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2207
+ "in_dim" : 2560,
2208
+ "name" : "text_encoder.model.layers.5.mlp.gate_proj",
2209
+ "out_dim" : 9728,
2210
+ "shape" : [
2211
+ 9728,
2212
+ 2560
2213
+ ]
2214
+ },
2215
+ {
2216
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2217
+ "in_dim" : 2560,
2218
+ "name" : "text_encoder.model.layers.5.mlp.up_proj",
2219
+ "out_dim" : 9728,
2220
+ "shape" : [
2221
+ 9728,
2222
+ 2560
2223
+ ]
2224
+ },
2225
+ {
2226
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2227
+ "in_dim" : 2560,
2228
+ "name" : "text_encoder.model.layers.5.self_attn.k_proj",
2229
+ "out_dim" : 1024,
2230
+ "shape" : [
2231
+ 1024,
2232
+ 2560
2233
+ ]
2234
+ },
2235
+ {
2236
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2237
+ "in_dim" : 4096,
2238
+ "name" : "text_encoder.model.layers.5.self_attn.o_proj",
2239
+ "out_dim" : 2560,
2240
+ "shape" : [
2241
+ 2560,
2242
+ 4096
2243
+ ]
2244
+ },
2245
+ {
2246
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2247
+ "in_dim" : 2560,
2248
+ "name" : "text_encoder.model.layers.5.self_attn.q_proj",
2249
+ "out_dim" : 4096,
2250
+ "shape" : [
2251
+ 4096,
2252
+ 2560
2253
+ ]
2254
+ },
2255
+ {
2256
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2257
+ "in_dim" : 2560,
2258
+ "name" : "text_encoder.model.layers.5.self_attn.v_proj",
2259
+ "out_dim" : 1024,
2260
+ "shape" : [
2261
+ 1024,
2262
+ 2560
2263
+ ]
2264
+ },
2265
+ {
2266
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2267
+ "in_dim" : 9728,
2268
+ "name" : "text_encoder.model.layers.6.mlp.down_proj",
2269
+ "out_dim" : 2560,
2270
+ "shape" : [
2271
+ 2560,
2272
+ 9728
2273
+ ]
2274
+ },
2275
+ {
2276
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2277
+ "in_dim" : 2560,
2278
+ "name" : "text_encoder.model.layers.6.mlp.gate_proj",
2279
+ "out_dim" : 9728,
2280
+ "shape" : [
2281
+ 9728,
2282
+ 2560
2283
+ ]
2284
+ },
2285
+ {
2286
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2287
+ "in_dim" : 2560,
2288
+ "name" : "text_encoder.model.layers.6.mlp.up_proj",
2289
+ "out_dim" : 9728,
2290
+ "shape" : [
2291
+ 9728,
2292
+ 2560
2293
+ ]
2294
+ },
2295
+ {
2296
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2297
+ "in_dim" : 2560,
2298
+ "name" : "text_encoder.model.layers.6.self_attn.k_proj",
2299
+ "out_dim" : 1024,
2300
+ "shape" : [
2301
+ 1024,
2302
+ 2560
2303
+ ]
2304
+ },
2305
+ {
2306
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2307
+ "in_dim" : 4096,
2308
+ "name" : "text_encoder.model.layers.6.self_attn.o_proj",
2309
+ "out_dim" : 2560,
2310
+ "shape" : [
2311
+ 2560,
2312
+ 4096
2313
+ ]
2314
+ },
2315
+ {
2316
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2317
+ "in_dim" : 2560,
2318
+ "name" : "text_encoder.model.layers.6.self_attn.q_proj",
2319
+ "out_dim" : 4096,
2320
+ "shape" : [
2321
+ 4096,
2322
+ 2560
2323
+ ]
2324
+ },
2325
+ {
2326
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2327
+ "in_dim" : 2560,
2328
+ "name" : "text_encoder.model.layers.6.self_attn.v_proj",
2329
+ "out_dim" : 1024,
2330
+ "shape" : [
2331
+ 1024,
2332
+ 2560
2333
+ ]
2334
+ },
2335
+ {
2336
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2337
+ "in_dim" : 9728,
2338
+ "name" : "text_encoder.model.layers.7.mlp.down_proj",
2339
+ "out_dim" : 2560,
2340
+ "shape" : [
2341
+ 2560,
2342
+ 9728
2343
+ ]
2344
+ },
2345
+ {
2346
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2347
+ "in_dim" : 2560,
2348
+ "name" : "text_encoder.model.layers.7.mlp.gate_proj",
2349
+ "out_dim" : 9728,
2350
+ "shape" : [
2351
+ 9728,
2352
+ 2560
2353
+ ]
2354
+ },
2355
+ {
2356
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2357
+ "in_dim" : 2560,
2358
+ "name" : "text_encoder.model.layers.7.mlp.up_proj",
2359
+ "out_dim" : 9728,
2360
+ "shape" : [
2361
+ 9728,
2362
+ 2560
2363
+ ]
2364
+ },
2365
+ {
2366
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2367
+ "in_dim" : 2560,
2368
+ "name" : "text_encoder.model.layers.7.self_attn.k_proj",
2369
+ "out_dim" : 1024,
2370
+ "shape" : [
2371
+ 1024,
2372
+ 2560
2373
+ ]
2374
+ },
2375
+ {
2376
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2377
+ "in_dim" : 4096,
2378
+ "name" : "text_encoder.model.layers.7.self_attn.o_proj",
2379
+ "out_dim" : 2560,
2380
+ "shape" : [
2381
+ 2560,
2382
+ 4096
2383
+ ]
2384
+ },
2385
+ {
2386
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2387
+ "in_dim" : 2560,
2388
+ "name" : "text_encoder.model.layers.7.self_attn.q_proj",
2389
+ "out_dim" : 4096,
2390
+ "shape" : [
2391
+ 4096,
2392
+ 2560
2393
+ ]
2394
+ },
2395
+ {
2396
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2397
+ "in_dim" : 2560,
2398
+ "name" : "text_encoder.model.layers.7.self_attn.v_proj",
2399
+ "out_dim" : 1024,
2400
+ "shape" : [
2401
+ 1024,
2402
+ 2560
2403
+ ]
2404
+ },
2405
+ {
2406
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2407
+ "in_dim" : 9728,
2408
+ "name" : "text_encoder.model.layers.8.mlp.down_proj",
2409
+ "out_dim" : 2560,
2410
+ "shape" : [
2411
+ 2560,
2412
+ 9728
2413
+ ]
2414
+ },
2415
+ {
2416
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2417
+ "in_dim" : 2560,
2418
+ "name" : "text_encoder.model.layers.8.mlp.gate_proj",
2419
+ "out_dim" : 9728,
2420
+ "shape" : [
2421
+ 9728,
2422
+ 2560
2423
+ ]
2424
+ },
2425
+ {
2426
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2427
+ "in_dim" : 2560,
2428
+ "name" : "text_encoder.model.layers.8.mlp.up_proj",
2429
+ "out_dim" : 9728,
2430
+ "shape" : [
2431
+ 9728,
2432
+ 2560
2433
+ ]
2434
+ },
2435
+ {
2436
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2437
+ "in_dim" : 2560,
2438
+ "name" : "text_encoder.model.layers.8.self_attn.k_proj",
2439
+ "out_dim" : 1024,
2440
+ "shape" : [
2441
+ 1024,
2442
+ 2560
2443
+ ]
2444
+ },
2445
+ {
2446
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2447
+ "in_dim" : 4096,
2448
+ "name" : "text_encoder.model.layers.8.self_attn.o_proj",
2449
+ "out_dim" : 2560,
2450
+ "shape" : [
2451
+ 2560,
2452
+ 4096
2453
+ ]
2454
+ },
2455
+ {
2456
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2457
+ "in_dim" : 2560,
2458
+ "name" : "text_encoder.model.layers.8.self_attn.q_proj",
2459
+ "out_dim" : 4096,
2460
+ "shape" : [
2461
+ 4096,
2462
+ 2560
2463
+ ]
2464
+ },
2465
+ {
2466
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2467
+ "in_dim" : 2560,
2468
+ "name" : "text_encoder.model.layers.8.self_attn.v_proj",
2469
+ "out_dim" : 1024,
2470
+ "shape" : [
2471
+ 1024,
2472
+ 2560
2473
+ ]
2474
+ },
2475
+ {
2476
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2477
+ "in_dim" : 9728,
2478
+ "name" : "text_encoder.model.layers.9.mlp.down_proj",
2479
+ "out_dim" : 2560,
2480
+ "shape" : [
2481
+ 2560,
2482
+ 9728
2483
+ ]
2484
+ },
2485
+ {
2486
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2487
+ "in_dim" : 2560,
2488
+ "name" : "text_encoder.model.layers.9.mlp.gate_proj",
2489
+ "out_dim" : 9728,
2490
+ "shape" : [
2491
+ 9728,
2492
+ 2560
2493
+ ]
2494
+ },
2495
+ {
2496
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2497
+ "in_dim" : 2560,
2498
+ "name" : "text_encoder.model.layers.9.mlp.up_proj",
2499
+ "out_dim" : 9728,
2500
+ "shape" : [
2501
+ 9728,
2502
+ 2560
2503
+ ]
2504
+ },
2505
+ {
2506
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2507
+ "in_dim" : 2560,
2508
+ "name" : "text_encoder.model.layers.9.self_attn.k_proj",
2509
+ "out_dim" : 1024,
2510
+ "shape" : [
2511
+ 1024,
2512
+ 2560
2513
+ ]
2514
+ },
2515
+ {
2516
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2517
+ "in_dim" : 4096,
2518
+ "name" : "text_encoder.model.layers.9.self_attn.o_proj",
2519
+ "out_dim" : 2560,
2520
+ "shape" : [
2521
+ 2560,
2522
+ 4096
2523
+ ]
2524
+ },
2525
+ {
2526
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2527
+ "in_dim" : 2560,
2528
+ "name" : "text_encoder.model.layers.9.self_attn.q_proj",
2529
+ "out_dim" : 4096,
2530
+ "shape" : [
2531
+ 4096,
2532
+ 2560
2533
+ ]
2534
+ },
2535
+ {
2536
+ "file" : "text_encoder\/model-00001-of-00002.safetensors",
2537
+ "in_dim" : 2560,
2538
+ "name" : "text_encoder.model.layers.9.self_attn.v_proj",
2539
+ "out_dim" : 1024,
2540
+ "shape" : [
2541
+ 1024,
2542
+ 2560
2543
+ ]
2544
+ },
2545
+ {
2546
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2547
+ "in_dim" : 9728,
2548
+ "name" : "text_encoder.model.layers.20.mlp.down_proj",
2549
+ "out_dim" : 2560,
2550
+ "shape" : [
2551
+ 2560,
2552
+ 9728
2553
+ ]
2554
+ },
2555
+ {
2556
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2557
+ "in_dim" : 9728,
2558
+ "name" : "text_encoder.model.layers.21.mlp.down_proj",
2559
+ "out_dim" : 2560,
2560
+ "shape" : [
2561
+ 2560,
2562
+ 9728
2563
+ ]
2564
+ },
2565
+ {
2566
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2567
+ "in_dim" : 2560,
2568
+ "name" : "text_encoder.model.layers.21.mlp.gate_proj",
2569
+ "out_dim" : 9728,
2570
+ "shape" : [
2571
+ 9728,
2572
+ 2560
2573
+ ]
2574
+ },
2575
+ {
2576
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2577
+ "in_dim" : 2560,
2578
+ "name" : "text_encoder.model.layers.21.mlp.up_proj",
2579
+ "out_dim" : 9728,
2580
+ "shape" : [
2581
+ 9728,
2582
+ 2560
2583
+ ]
2584
+ },
2585
+ {
2586
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2587
+ "in_dim" : 2560,
2588
+ "name" : "text_encoder.model.layers.21.self_attn.k_proj",
2589
+ "out_dim" : 1024,
2590
+ "shape" : [
2591
+ 1024,
2592
+ 2560
2593
+ ]
2594
+ },
2595
+ {
2596
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2597
+ "in_dim" : 4096,
2598
+ "name" : "text_encoder.model.layers.21.self_attn.o_proj",
2599
+ "out_dim" : 2560,
2600
+ "shape" : [
2601
+ 2560,
2602
+ 4096
2603
+ ]
2604
+ },
2605
+ {
2606
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2607
+ "in_dim" : 2560,
2608
+ "name" : "text_encoder.model.layers.21.self_attn.q_proj",
2609
+ "out_dim" : 4096,
2610
+ "shape" : [
2611
+ 4096,
2612
+ 2560
2613
+ ]
2614
+ },
2615
+ {
2616
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2617
+ "in_dim" : 2560,
2618
+ "name" : "text_encoder.model.layers.21.self_attn.v_proj",
2619
+ "out_dim" : 1024,
2620
+ "shape" : [
2621
+ 1024,
2622
+ 2560
2623
+ ]
2624
+ },
2625
+ {
2626
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2627
+ "in_dim" : 9728,
2628
+ "name" : "text_encoder.model.layers.22.mlp.down_proj",
2629
+ "out_dim" : 2560,
2630
+ "shape" : [
2631
+ 2560,
2632
+ 9728
2633
+ ]
2634
+ },
2635
+ {
2636
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2637
+ "in_dim" : 2560,
2638
+ "name" : "text_encoder.model.layers.22.mlp.gate_proj",
2639
+ "out_dim" : 9728,
2640
+ "shape" : [
2641
+ 9728,
2642
+ 2560
2643
+ ]
2644
+ },
2645
+ {
2646
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2647
+ "in_dim" : 2560,
2648
+ "name" : "text_encoder.model.layers.22.mlp.up_proj",
2649
+ "out_dim" : 9728,
2650
+ "shape" : [
2651
+ 9728,
2652
+ 2560
2653
+ ]
2654
+ },
2655
+ {
2656
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2657
+ "in_dim" : 2560,
2658
+ "name" : "text_encoder.model.layers.22.self_attn.k_proj",
2659
+ "out_dim" : 1024,
2660
+ "shape" : [
2661
+ 1024,
2662
+ 2560
2663
+ ]
2664
+ },
2665
+ {
2666
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2667
+ "in_dim" : 4096,
2668
+ "name" : "text_encoder.model.layers.22.self_attn.o_proj",
2669
+ "out_dim" : 2560,
2670
+ "shape" : [
2671
+ 2560,
2672
+ 4096
2673
+ ]
2674
+ },
2675
+ {
2676
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2677
+ "in_dim" : 2560,
2678
+ "name" : "text_encoder.model.layers.22.self_attn.q_proj",
2679
+ "out_dim" : 4096,
2680
+ "shape" : [
2681
+ 4096,
2682
+ 2560
2683
+ ]
2684
+ },
2685
+ {
2686
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2687
+ "in_dim" : 2560,
2688
+ "name" : "text_encoder.model.layers.22.self_attn.v_proj",
2689
+ "out_dim" : 1024,
2690
+ "shape" : [
2691
+ 1024,
2692
+ 2560
2693
+ ]
2694
+ },
2695
+ {
2696
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2697
+ "in_dim" : 9728,
2698
+ "name" : "text_encoder.model.layers.23.mlp.down_proj",
2699
+ "out_dim" : 2560,
2700
+ "shape" : [
2701
+ 2560,
2702
+ 9728
2703
+ ]
2704
+ },
2705
+ {
2706
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2707
+ "in_dim" : 2560,
2708
+ "name" : "text_encoder.model.layers.23.mlp.gate_proj",
2709
+ "out_dim" : 9728,
2710
+ "shape" : [
2711
+ 9728,
2712
+ 2560
2713
+ ]
2714
+ },
2715
+ {
2716
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2717
+ "in_dim" : 2560,
2718
+ "name" : "text_encoder.model.layers.23.mlp.up_proj",
2719
+ "out_dim" : 9728,
2720
+ "shape" : [
2721
+ 9728,
2722
+ 2560
2723
+ ]
2724
+ },
2725
+ {
2726
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2727
+ "in_dim" : 2560,
2728
+ "name" : "text_encoder.model.layers.23.self_attn.k_proj",
2729
+ "out_dim" : 1024,
2730
+ "shape" : [
2731
+ 1024,
2732
+ 2560
2733
+ ]
2734
+ },
2735
+ {
2736
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2737
+ "in_dim" : 4096,
2738
+ "name" : "text_encoder.model.layers.23.self_attn.o_proj",
2739
+ "out_dim" : 2560,
2740
+ "shape" : [
2741
+ 2560,
2742
+ 4096
2743
+ ]
2744
+ },
2745
+ {
2746
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2747
+ "in_dim" : 2560,
2748
+ "name" : "text_encoder.model.layers.23.self_attn.q_proj",
2749
+ "out_dim" : 4096,
2750
+ "shape" : [
2751
+ 4096,
2752
+ 2560
2753
+ ]
2754
+ },
2755
+ {
2756
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2757
+ "in_dim" : 2560,
2758
+ "name" : "text_encoder.model.layers.23.self_attn.v_proj",
2759
+ "out_dim" : 1024,
2760
+ "shape" : [
2761
+ 1024,
2762
+ 2560
2763
+ ]
2764
+ },
2765
+ {
2766
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2767
+ "in_dim" : 9728,
2768
+ "name" : "text_encoder.model.layers.24.mlp.down_proj",
2769
+ "out_dim" : 2560,
2770
+ "shape" : [
2771
+ 2560,
2772
+ 9728
2773
+ ]
2774
+ },
2775
+ {
2776
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2777
+ "in_dim" : 2560,
2778
+ "name" : "text_encoder.model.layers.24.mlp.gate_proj",
2779
+ "out_dim" : 9728,
2780
+ "shape" : [
2781
+ 9728,
2782
+ 2560
2783
+ ]
2784
+ },
2785
+ {
2786
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2787
+ "in_dim" : 2560,
2788
+ "name" : "text_encoder.model.layers.24.mlp.up_proj",
2789
+ "out_dim" : 9728,
2790
+ "shape" : [
2791
+ 9728,
2792
+ 2560
2793
+ ]
2794
+ },
2795
+ {
2796
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2797
+ "in_dim" : 2560,
2798
+ "name" : "text_encoder.model.layers.24.self_attn.k_proj",
2799
+ "out_dim" : 1024,
2800
+ "shape" : [
2801
+ 1024,
2802
+ 2560
2803
+ ]
2804
+ },
2805
+ {
2806
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2807
+ "in_dim" : 4096,
2808
+ "name" : "text_encoder.model.layers.24.self_attn.o_proj",
2809
+ "out_dim" : 2560,
2810
+ "shape" : [
2811
+ 2560,
2812
+ 4096
2813
+ ]
2814
+ },
2815
+ {
2816
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2817
+ "in_dim" : 2560,
2818
+ "name" : "text_encoder.model.layers.24.self_attn.q_proj",
2819
+ "out_dim" : 4096,
2820
+ "shape" : [
2821
+ 4096,
2822
+ 2560
2823
+ ]
2824
+ },
2825
+ {
2826
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2827
+ "in_dim" : 2560,
2828
+ "name" : "text_encoder.model.layers.24.self_attn.v_proj",
2829
+ "out_dim" : 1024,
2830
+ "shape" : [
2831
+ 1024,
2832
+ 2560
2833
+ ]
2834
+ },
2835
+ {
2836
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2837
+ "in_dim" : 9728,
2838
+ "name" : "text_encoder.model.layers.25.mlp.down_proj",
2839
+ "out_dim" : 2560,
2840
+ "shape" : [
2841
+ 2560,
2842
+ 9728
2843
+ ]
2844
+ },
2845
+ {
2846
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2847
+ "in_dim" : 2560,
2848
+ "name" : "text_encoder.model.layers.25.mlp.gate_proj",
2849
+ "out_dim" : 9728,
2850
+ "shape" : [
2851
+ 9728,
2852
+ 2560
2853
+ ]
2854
+ },
2855
+ {
2856
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2857
+ "in_dim" : 2560,
2858
+ "name" : "text_encoder.model.layers.25.mlp.up_proj",
2859
+ "out_dim" : 9728,
2860
+ "shape" : [
2861
+ 9728,
2862
+ 2560
2863
+ ]
2864
+ },
2865
+ {
2866
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2867
+ "in_dim" : 2560,
2868
+ "name" : "text_encoder.model.layers.25.self_attn.k_proj",
2869
+ "out_dim" : 1024,
2870
+ "shape" : [
2871
+ 1024,
2872
+ 2560
2873
+ ]
2874
+ },
2875
+ {
2876
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2877
+ "in_dim" : 4096,
2878
+ "name" : "text_encoder.model.layers.25.self_attn.o_proj",
2879
+ "out_dim" : 2560,
2880
+ "shape" : [
2881
+ 2560,
2882
+ 4096
2883
+ ]
2884
+ },
2885
+ {
2886
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2887
+ "in_dim" : 2560,
2888
+ "name" : "text_encoder.model.layers.25.self_attn.q_proj",
2889
+ "out_dim" : 4096,
2890
+ "shape" : [
2891
+ 4096,
2892
+ 2560
2893
+ ]
2894
+ },
2895
+ {
2896
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2897
+ "in_dim" : 2560,
2898
+ "name" : "text_encoder.model.layers.25.self_attn.v_proj",
2899
+ "out_dim" : 1024,
2900
+ "shape" : [
2901
+ 1024,
2902
+ 2560
2903
+ ]
2904
+ },
2905
+ {
2906
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2907
+ "in_dim" : 9728,
2908
+ "name" : "text_encoder.model.layers.26.mlp.down_proj",
2909
+ "out_dim" : 2560,
2910
+ "shape" : [
2911
+ 2560,
2912
+ 9728
2913
+ ]
2914
+ },
2915
+ {
2916
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2917
+ "in_dim" : 2560,
2918
+ "name" : "text_encoder.model.layers.26.mlp.gate_proj",
2919
+ "out_dim" : 9728,
2920
+ "shape" : [
2921
+ 9728,
2922
+ 2560
2923
+ ]
2924
+ },
2925
+ {
2926
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2927
+ "in_dim" : 2560,
2928
+ "name" : "text_encoder.model.layers.26.mlp.up_proj",
2929
+ "out_dim" : 9728,
2930
+ "shape" : [
2931
+ 9728,
2932
+ 2560
2933
+ ]
2934
+ },
2935
+ {
2936
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2937
+ "in_dim" : 2560,
2938
+ "name" : "text_encoder.model.layers.26.self_attn.k_proj",
2939
+ "out_dim" : 1024,
2940
+ "shape" : [
2941
+ 1024,
2942
+ 2560
2943
+ ]
2944
+ },
2945
+ {
2946
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2947
+ "in_dim" : 4096,
2948
+ "name" : "text_encoder.model.layers.26.self_attn.o_proj",
2949
+ "out_dim" : 2560,
2950
+ "shape" : [
2951
+ 2560,
2952
+ 4096
2953
+ ]
2954
+ },
2955
+ {
2956
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2957
+ "in_dim" : 2560,
2958
+ "name" : "text_encoder.model.layers.26.self_attn.q_proj",
2959
+ "out_dim" : 4096,
2960
+ "shape" : [
2961
+ 4096,
2962
+ 2560
2963
+ ]
2964
+ },
2965
+ {
2966
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2967
+ "in_dim" : 2560,
2968
+ "name" : "text_encoder.model.layers.26.self_attn.v_proj",
2969
+ "out_dim" : 1024,
2970
+ "shape" : [
2971
+ 1024,
2972
+ 2560
2973
+ ]
2974
+ },
2975
+ {
2976
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2977
+ "in_dim" : 9728,
2978
+ "name" : "text_encoder.model.layers.27.mlp.down_proj",
2979
+ "out_dim" : 2560,
2980
+ "shape" : [
2981
+ 2560,
2982
+ 9728
2983
+ ]
2984
+ },
2985
+ {
2986
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2987
+ "in_dim" : 2560,
2988
+ "name" : "text_encoder.model.layers.27.mlp.gate_proj",
2989
+ "out_dim" : 9728,
2990
+ "shape" : [
2991
+ 9728,
2992
+ 2560
2993
+ ]
2994
+ },
2995
+ {
2996
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
2997
+ "in_dim" : 2560,
2998
+ "name" : "text_encoder.model.layers.27.mlp.up_proj",
2999
+ "out_dim" : 9728,
3000
+ "shape" : [
3001
+ 9728,
3002
+ 2560
3003
+ ]
3004
+ },
3005
+ {
3006
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3007
+ "in_dim" : 2560,
3008
+ "name" : "text_encoder.model.layers.27.self_attn.k_proj",
3009
+ "out_dim" : 1024,
3010
+ "shape" : [
3011
+ 1024,
3012
+ 2560
3013
+ ]
3014
+ },
3015
+ {
3016
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3017
+ "in_dim" : 4096,
3018
+ "name" : "text_encoder.model.layers.27.self_attn.o_proj",
3019
+ "out_dim" : 2560,
3020
+ "shape" : [
3021
+ 2560,
3022
+ 4096
3023
+ ]
3024
+ },
3025
+ {
3026
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3027
+ "in_dim" : 2560,
3028
+ "name" : "text_encoder.model.layers.27.self_attn.q_proj",
3029
+ "out_dim" : 4096,
3030
+ "shape" : [
3031
+ 4096,
3032
+ 2560
3033
+ ]
3034
+ },
3035
+ {
3036
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3037
+ "in_dim" : 2560,
3038
+ "name" : "text_encoder.model.layers.27.self_attn.v_proj",
3039
+ "out_dim" : 1024,
3040
+ "shape" : [
3041
+ 1024,
3042
+ 2560
3043
+ ]
3044
+ },
3045
+ {
3046
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3047
+ "in_dim" : 9728,
3048
+ "name" : "text_encoder.model.layers.28.mlp.down_proj",
3049
+ "out_dim" : 2560,
3050
+ "shape" : [
3051
+ 2560,
3052
+ 9728
3053
+ ]
3054
+ },
3055
+ {
3056
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3057
+ "in_dim" : 2560,
3058
+ "name" : "text_encoder.model.layers.28.mlp.gate_proj",
3059
+ "out_dim" : 9728,
3060
+ "shape" : [
3061
+ 9728,
3062
+ 2560
3063
+ ]
3064
+ },
3065
+ {
3066
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3067
+ "in_dim" : 2560,
3068
+ "name" : "text_encoder.model.layers.28.mlp.up_proj",
3069
+ "out_dim" : 9728,
3070
+ "shape" : [
3071
+ 9728,
3072
+ 2560
3073
+ ]
3074
+ },
3075
+ {
3076
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3077
+ "in_dim" : 2560,
3078
+ "name" : "text_encoder.model.layers.28.self_attn.k_proj",
3079
+ "out_dim" : 1024,
3080
+ "shape" : [
3081
+ 1024,
3082
+ 2560
3083
+ ]
3084
+ },
3085
+ {
3086
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3087
+ "in_dim" : 4096,
3088
+ "name" : "text_encoder.model.layers.28.self_attn.o_proj",
3089
+ "out_dim" : 2560,
3090
+ "shape" : [
3091
+ 2560,
3092
+ 4096
3093
+ ]
3094
+ },
3095
+ {
3096
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3097
+ "in_dim" : 2560,
3098
+ "name" : "text_encoder.model.layers.28.self_attn.q_proj",
3099
+ "out_dim" : 4096,
3100
+ "shape" : [
3101
+ 4096,
3102
+ 2560
3103
+ ]
3104
+ },
3105
+ {
3106
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3107
+ "in_dim" : 2560,
3108
+ "name" : "text_encoder.model.layers.28.self_attn.v_proj",
3109
+ "out_dim" : 1024,
3110
+ "shape" : [
3111
+ 1024,
3112
+ 2560
3113
+ ]
3114
+ },
3115
+ {
3116
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3117
+ "in_dim" : 9728,
3118
+ "name" : "text_encoder.model.layers.29.mlp.down_proj",
3119
+ "out_dim" : 2560,
3120
+ "shape" : [
3121
+ 2560,
3122
+ 9728
3123
+ ]
3124
+ },
3125
+ {
3126
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3127
+ "in_dim" : 2560,
3128
+ "name" : "text_encoder.model.layers.29.mlp.gate_proj",
3129
+ "out_dim" : 9728,
3130
+ "shape" : [
3131
+ 9728,
3132
+ 2560
3133
+ ]
3134
+ },
3135
+ {
3136
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3137
+ "in_dim" : 2560,
3138
+ "name" : "text_encoder.model.layers.29.mlp.up_proj",
3139
+ "out_dim" : 9728,
3140
+ "shape" : [
3141
+ 9728,
3142
+ 2560
3143
+ ]
3144
+ },
3145
+ {
3146
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3147
+ "in_dim" : 2560,
3148
+ "name" : "text_encoder.model.layers.29.self_attn.k_proj",
3149
+ "out_dim" : 1024,
3150
+ "shape" : [
3151
+ 1024,
3152
+ 2560
3153
+ ]
3154
+ },
3155
+ {
3156
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3157
+ "in_dim" : 4096,
3158
+ "name" : "text_encoder.model.layers.29.self_attn.o_proj",
3159
+ "out_dim" : 2560,
3160
+ "shape" : [
3161
+ 2560,
3162
+ 4096
3163
+ ]
3164
+ },
3165
+ {
3166
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3167
+ "in_dim" : 2560,
3168
+ "name" : "text_encoder.model.layers.29.self_attn.q_proj",
3169
+ "out_dim" : 4096,
3170
+ "shape" : [
3171
+ 4096,
3172
+ 2560
3173
+ ]
3174
+ },
3175
+ {
3176
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3177
+ "in_dim" : 2560,
3178
+ "name" : "text_encoder.model.layers.29.self_attn.v_proj",
3179
+ "out_dim" : 1024,
3180
+ "shape" : [
3181
+ 1024,
3182
+ 2560
3183
+ ]
3184
+ },
3185
+ {
3186
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3187
+ "in_dim" : 9728,
3188
+ "name" : "text_encoder.model.layers.30.mlp.down_proj",
3189
+ "out_dim" : 2560,
3190
+ "shape" : [
3191
+ 2560,
3192
+ 9728
3193
+ ]
3194
+ },
3195
+ {
3196
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3197
+ "in_dim" : 2560,
3198
+ "name" : "text_encoder.model.layers.30.mlp.gate_proj",
3199
+ "out_dim" : 9728,
3200
+ "shape" : [
3201
+ 9728,
3202
+ 2560
3203
+ ]
3204
+ },
3205
+ {
3206
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3207
+ "in_dim" : 2560,
3208
+ "name" : "text_encoder.model.layers.30.mlp.up_proj",
3209
+ "out_dim" : 9728,
3210
+ "shape" : [
3211
+ 9728,
3212
+ 2560
3213
+ ]
3214
+ },
3215
+ {
3216
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3217
+ "in_dim" : 2560,
3218
+ "name" : "text_encoder.model.layers.30.self_attn.k_proj",
3219
+ "out_dim" : 1024,
3220
+ "shape" : [
3221
+ 1024,
3222
+ 2560
3223
+ ]
3224
+ },
3225
+ {
3226
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3227
+ "in_dim" : 4096,
3228
+ "name" : "text_encoder.model.layers.30.self_attn.o_proj",
3229
+ "out_dim" : 2560,
3230
+ "shape" : [
3231
+ 2560,
3232
+ 4096
3233
+ ]
3234
+ },
3235
+ {
3236
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3237
+ "in_dim" : 2560,
3238
+ "name" : "text_encoder.model.layers.30.self_attn.q_proj",
3239
+ "out_dim" : 4096,
3240
+ "shape" : [
3241
+ 4096,
3242
+ 2560
3243
+ ]
3244
+ },
3245
+ {
3246
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3247
+ "in_dim" : 2560,
3248
+ "name" : "text_encoder.model.layers.30.self_attn.v_proj",
3249
+ "out_dim" : 1024,
3250
+ "shape" : [
3251
+ 1024,
3252
+ 2560
3253
+ ]
3254
+ },
3255
+ {
3256
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3257
+ "in_dim" : 9728,
3258
+ "name" : "text_encoder.model.layers.31.mlp.down_proj",
3259
+ "out_dim" : 2560,
3260
+ "shape" : [
3261
+ 2560,
3262
+ 9728
3263
+ ]
3264
+ },
3265
+ {
3266
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3267
+ "in_dim" : 2560,
3268
+ "name" : "text_encoder.model.layers.31.mlp.gate_proj",
3269
+ "out_dim" : 9728,
3270
+ "shape" : [
3271
+ 9728,
3272
+ 2560
3273
+ ]
3274
+ },
3275
+ {
3276
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3277
+ "in_dim" : 2560,
3278
+ "name" : "text_encoder.model.layers.31.mlp.up_proj",
3279
+ "out_dim" : 9728,
3280
+ "shape" : [
3281
+ 9728,
3282
+ 2560
3283
+ ]
3284
+ },
3285
+ {
3286
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3287
+ "in_dim" : 2560,
3288
+ "name" : "text_encoder.model.layers.31.self_attn.k_proj",
3289
+ "out_dim" : 1024,
3290
+ "shape" : [
3291
+ 1024,
3292
+ 2560
3293
+ ]
3294
+ },
3295
+ {
3296
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3297
+ "in_dim" : 4096,
3298
+ "name" : "text_encoder.model.layers.31.self_attn.o_proj",
3299
+ "out_dim" : 2560,
3300
+ "shape" : [
3301
+ 2560,
3302
+ 4096
3303
+ ]
3304
+ },
3305
+ {
3306
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3307
+ "in_dim" : 2560,
3308
+ "name" : "text_encoder.model.layers.31.self_attn.q_proj",
3309
+ "out_dim" : 4096,
3310
+ "shape" : [
3311
+ 4096,
3312
+ 2560
3313
+ ]
3314
+ },
3315
+ {
3316
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3317
+ "in_dim" : 2560,
3318
+ "name" : "text_encoder.model.layers.31.self_attn.v_proj",
3319
+ "out_dim" : 1024,
3320
+ "shape" : [
3321
+ 1024,
3322
+ 2560
3323
+ ]
3324
+ },
3325
+ {
3326
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3327
+ "in_dim" : 9728,
3328
+ "name" : "text_encoder.model.layers.32.mlp.down_proj",
3329
+ "out_dim" : 2560,
3330
+ "shape" : [
3331
+ 2560,
3332
+ 9728
3333
+ ]
3334
+ },
3335
+ {
3336
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3337
+ "in_dim" : 2560,
3338
+ "name" : "text_encoder.model.layers.32.mlp.gate_proj",
3339
+ "out_dim" : 9728,
3340
+ "shape" : [
3341
+ 9728,
3342
+ 2560
3343
+ ]
3344
+ },
3345
+ {
3346
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3347
+ "in_dim" : 2560,
3348
+ "name" : "text_encoder.model.layers.32.mlp.up_proj",
3349
+ "out_dim" : 9728,
3350
+ "shape" : [
3351
+ 9728,
3352
+ 2560
3353
+ ]
3354
+ },
3355
+ {
3356
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3357
+ "in_dim" : 2560,
3358
+ "name" : "text_encoder.model.layers.32.self_attn.k_proj",
3359
+ "out_dim" : 1024,
3360
+ "shape" : [
3361
+ 1024,
3362
+ 2560
3363
+ ]
3364
+ },
3365
+ {
3366
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3367
+ "in_dim" : 4096,
3368
+ "name" : "text_encoder.model.layers.32.self_attn.o_proj",
3369
+ "out_dim" : 2560,
3370
+ "shape" : [
3371
+ 2560,
3372
+ 4096
3373
+ ]
3374
+ },
3375
+ {
3376
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3377
+ "in_dim" : 2560,
3378
+ "name" : "text_encoder.model.layers.32.self_attn.q_proj",
3379
+ "out_dim" : 4096,
3380
+ "shape" : [
3381
+ 4096,
3382
+ 2560
3383
+ ]
3384
+ },
3385
+ {
3386
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3387
+ "in_dim" : 2560,
3388
+ "name" : "text_encoder.model.layers.32.self_attn.v_proj",
3389
+ "out_dim" : 1024,
3390
+ "shape" : [
3391
+ 1024,
3392
+ 2560
3393
+ ]
3394
+ },
3395
+ {
3396
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3397
+ "in_dim" : 9728,
3398
+ "name" : "text_encoder.model.layers.33.mlp.down_proj",
3399
+ "out_dim" : 2560,
3400
+ "shape" : [
3401
+ 2560,
3402
+ 9728
3403
+ ]
3404
+ },
3405
+ {
3406
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3407
+ "in_dim" : 2560,
3408
+ "name" : "text_encoder.model.layers.33.mlp.gate_proj",
3409
+ "out_dim" : 9728,
3410
+ "shape" : [
3411
+ 9728,
3412
+ 2560
3413
+ ]
3414
+ },
3415
+ {
3416
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3417
+ "in_dim" : 2560,
3418
+ "name" : "text_encoder.model.layers.33.mlp.up_proj",
3419
+ "out_dim" : 9728,
3420
+ "shape" : [
3421
+ 9728,
3422
+ 2560
3423
+ ]
3424
+ },
3425
+ {
3426
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3427
+ "in_dim" : 2560,
3428
+ "name" : "text_encoder.model.layers.33.self_attn.k_proj",
3429
+ "out_dim" : 1024,
3430
+ "shape" : [
3431
+ 1024,
3432
+ 2560
3433
+ ]
3434
+ },
3435
+ {
3436
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3437
+ "in_dim" : 4096,
3438
+ "name" : "text_encoder.model.layers.33.self_attn.o_proj",
3439
+ "out_dim" : 2560,
3440
+ "shape" : [
3441
+ 2560,
3442
+ 4096
3443
+ ]
3444
+ },
3445
+ {
3446
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3447
+ "in_dim" : 2560,
3448
+ "name" : "text_encoder.model.layers.33.self_attn.q_proj",
3449
+ "out_dim" : 4096,
3450
+ "shape" : [
3451
+ 4096,
3452
+ 2560
3453
+ ]
3454
+ },
3455
+ {
3456
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3457
+ "in_dim" : 2560,
3458
+ "name" : "text_encoder.model.layers.33.self_attn.v_proj",
3459
+ "out_dim" : 1024,
3460
+ "shape" : [
3461
+ 1024,
3462
+ 2560
3463
+ ]
3464
+ },
3465
+ {
3466
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3467
+ "in_dim" : 9728,
3468
+ "name" : "text_encoder.model.layers.34.mlp.down_proj",
3469
+ "out_dim" : 2560,
3470
+ "shape" : [
3471
+ 2560,
3472
+ 9728
3473
+ ]
3474
+ },
3475
+ {
3476
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3477
+ "in_dim" : 2560,
3478
+ "name" : "text_encoder.model.layers.34.mlp.gate_proj",
3479
+ "out_dim" : 9728,
3480
+ "shape" : [
3481
+ 9728,
3482
+ 2560
3483
+ ]
3484
+ },
3485
+ {
3486
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3487
+ "in_dim" : 2560,
3488
+ "name" : "text_encoder.model.layers.34.mlp.up_proj",
3489
+ "out_dim" : 9728,
3490
+ "shape" : [
3491
+ 9728,
3492
+ 2560
3493
+ ]
3494
+ },
3495
+ {
3496
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3497
+ "in_dim" : 2560,
3498
+ "name" : "text_encoder.model.layers.34.self_attn.k_proj",
3499
+ "out_dim" : 1024,
3500
+ "shape" : [
3501
+ 1024,
3502
+ 2560
3503
+ ]
3504
+ },
3505
+ {
3506
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3507
+ "in_dim" : 4096,
3508
+ "name" : "text_encoder.model.layers.34.self_attn.o_proj",
3509
+ "out_dim" : 2560,
3510
+ "shape" : [
3511
+ 2560,
3512
+ 4096
3513
+ ]
3514
+ },
3515
+ {
3516
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3517
+ "in_dim" : 2560,
3518
+ "name" : "text_encoder.model.layers.34.self_attn.q_proj",
3519
+ "out_dim" : 4096,
3520
+ "shape" : [
3521
+ 4096,
3522
+ 2560
3523
+ ]
3524
+ },
3525
+ {
3526
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3527
+ "in_dim" : 2560,
3528
+ "name" : "text_encoder.model.layers.34.self_attn.v_proj",
3529
+ "out_dim" : 1024,
3530
+ "shape" : [
3531
+ 1024,
3532
+ 2560
3533
+ ]
3534
+ },
3535
+ {
3536
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3537
+ "in_dim" : 9728,
3538
+ "name" : "text_encoder.model.layers.35.mlp.down_proj",
3539
+ "out_dim" : 2560,
3540
+ "shape" : [
3541
+ 2560,
3542
+ 9728
3543
+ ]
3544
+ },
3545
+ {
3546
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3547
+ "in_dim" : 2560,
3548
+ "name" : "text_encoder.model.layers.35.mlp.gate_proj",
3549
+ "out_dim" : 9728,
3550
+ "shape" : [
3551
+ 9728,
3552
+ 2560
3553
+ ]
3554
+ },
3555
+ {
3556
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3557
+ "in_dim" : 2560,
3558
+ "name" : "text_encoder.model.layers.35.mlp.up_proj",
3559
+ "out_dim" : 9728,
3560
+ "shape" : [
3561
+ 9728,
3562
+ 2560
3563
+ ]
3564
+ },
3565
+ {
3566
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3567
+ "in_dim" : 2560,
3568
+ "name" : "text_encoder.model.layers.35.self_attn.k_proj",
3569
+ "out_dim" : 1024,
3570
+ "shape" : [
3571
+ 1024,
3572
+ 2560
3573
+ ]
3574
+ },
3575
+ {
3576
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3577
+ "in_dim" : 4096,
3578
+ "name" : "text_encoder.model.layers.35.self_attn.o_proj",
3579
+ "out_dim" : 2560,
3580
+ "shape" : [
3581
+ 2560,
3582
+ 4096
3583
+ ]
3584
+ },
3585
+ {
3586
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3587
+ "in_dim" : 2560,
3588
+ "name" : "text_encoder.model.layers.35.self_attn.q_proj",
3589
+ "out_dim" : 4096,
3590
+ "shape" : [
3591
+ 4096,
3592
+ 2560
3593
+ ]
3594
+ },
3595
+ {
3596
+ "file" : "text_encoder\/model-00002-of-00002.safetensors",
3597
+ "in_dim" : 2560,
3598
+ "name" : "text_encoder.model.layers.35.self_attn.v_proj",
3599
+ "out_dim" : 1024,
3600
+ "shape" : [
3601
+ 1024,
3602
+ 2560
3603
+ ]
3604
+ }
3605
+ ],
3606
+ "mode" : "affine",
3607
+ "model_id" : "black-forest-labs\/FLUX.2-klein-4B"
3608
+ }
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "FlowMatchEulerDiscreteScheduler",
3
+ "_diffusers_version": "0.37.0.dev0",
4
+ "base_image_seq_len": 256,
5
+ "base_shift": 0.5,
6
+ "invert_sigmas": false,
7
+ "max_image_seq_len": 4096,
8
+ "max_shift": 1.15,
9
+ "num_train_timesteps": 1000,
10
+ "shift": 3.0,
11
+ "shift_terminal": null,
12
+ "stochastic_sampling": false,
13
+ "time_shift_type": "exponential",
14
+ "use_beta_sigmas": false,
15
+ "use_dynamic_shifting": true,
16
+ "use_exponential_sigmas": false,
17
+ "use_karras_sigmas": false
18
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "Qwen3ForCausalLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 151643,
8
+ "dtype": "bfloat16",
9
+ "eos_token_id": 151645,
10
+ "head_dim": 128,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 2560,
13
+ "initializer_range": 0.02,
14
+ "intermediate_size": 9728,
15
+ "layer_types": [
16
+ "full_attention",
17
+ "full_attention",
18
+ "full_attention",
19
+ "full_attention",
20
+ "full_attention",
21
+ "full_attention",
22
+ "full_attention",
23
+ "full_attention",
24
+ "full_attention",
25
+ "full_attention",
26
+ "full_attention",
27
+ "full_attention",
28
+ "full_attention",
29
+ "full_attention",
30
+ "full_attention",
31
+ "full_attention",
32
+ "full_attention",
33
+ "full_attention",
34
+ "full_attention",
35
+ "full_attention",
36
+ "full_attention",
37
+ "full_attention",
38
+ "full_attention",
39
+ "full_attention",
40
+ "full_attention",
41
+ "full_attention",
42
+ "full_attention",
43
+ "full_attention",
44
+ "full_attention",
45
+ "full_attention",
46
+ "full_attention",
47
+ "full_attention",
48
+ "full_attention",
49
+ "full_attention",
50
+ "full_attention",
51
+ "full_attention"
52
+ ],
53
+ "max_position_embeddings": 40960,
54
+ "max_window_layers": 36,
55
+ "model_type": "qwen3",
56
+ "num_attention_heads": 32,
57
+ "num_hidden_layers": 36,
58
+ "num_key_value_heads": 8,
59
+ "rms_norm_eps": 1e-06,
60
+ "rope_scaling": null,
61
+ "rope_theta": 1000000,
62
+ "sliding_window": null,
63
+ "tie_word_embeddings": true,
64
+ "transformers_version": "4.56.1",
65
+ "use_cache": true,
66
+ "use_sliding_window": false,
67
+ "vocab_size": 151936
68
+ }
text_encoder/generation_config.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 151643,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 151645,
6
+ 151643
7
+ ],
8
+ "pad_token_id": 151643,
9
+ "temperature": 0.6,
10
+ "top_k": 20,
11
+ "top_p": 0.95,
12
+ "transformers_version": "4.56.1"
13
+ }
text_encoder/model-00001-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f488253d059f193f5bfe41c77f52b0ab180ea636b7d3775df2fcba28c6ba0c8
3
+ size 3134533635
text_encoder/model-00002-of-00002.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23a2cdbd4f935933f97bee2e92c5535499636b7c25f3663ef7f3195aa06fc157
3
+ size 1731353094
tokenizer/added_tokens.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c0284b582e14987fbd3d5a2cb2bd139084371ed9acbae488829a1c900833c680
3
+ size 707
tokenizer/chat_template.jinja ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a55ee1b1660128b7098723e0abcd92caa0788061051c62d51cbe87d9cf1974d8
3
+ size 4168
tokenizer/merges.txt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5
3
+ size 1671853
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd
3
+ size 613
tokenizer/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
3
+ size 11422654
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:443bfa629eb16387a12edbf92a76f6a6f10b2af3b53d87ba1550adfcf45f7fa0
3
+ size 5404
tokenizer/vocab.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
3
+ size 2776833
transformer/config.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "Flux2Transformer2DModel",
3
+ "_diffusers_version": "0.37.0.dev0",
4
+ "_name_or_path": "/raid/yiyi/klein-4b-distilled-diffusers/transformer",
5
+ "attention_head_dim": 128,
6
+ "axes_dims_rope": [
7
+ 32,
8
+ 32,
9
+ 32,
10
+ 32
11
+ ],
12
+ "eps": 1e-06,
13
+ "guidance_embeds": false,
14
+ "in_channels": 128,
15
+ "joint_attention_dim": 7680,
16
+ "mlp_ratio": 3.0,
17
+ "num_attention_heads": 24,
18
+ "num_layers": 5,
19
+ "num_single_layers": 20,
20
+ "out_channels": null,
21
+ "patch_size": 1,
22
+ "rope_theta": 2000,
23
+ "timestep_guidance_channels": 256
24
+ }
transformer/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16b93072ba851a37b5d17e389e794cb81fd194b1a9aab0587e32ba7e71b58d6a
3
+ size 4376555802
vae/config.json ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLFlux2",
3
+ "_diffusers_version": "0.37.0.dev0",
4
+ "_name_or_path": "black-forest-labs/FLUX.2-dev",
5
+ "act_fn": "silu",
6
+ "batch_norm_eps": 0.0001,
7
+ "batch_norm_momentum": 0.1,
8
+ "block_out_channels": [
9
+ 128,
10
+ 256,
11
+ 512,
12
+ 512
13
+ ],
14
+ "down_block_types": [
15
+ "DownEncoderBlock2D",
16
+ "DownEncoderBlock2D",
17
+ "DownEncoderBlock2D",
18
+ "DownEncoderBlock2D"
19
+ ],
20
+ "force_upcast": true,
21
+ "in_channels": 3,
22
+ "latent_channels": 32,
23
+ "layers_per_block": 2,
24
+ "mid_block_add_attention": true,
25
+ "norm_num_groups": 32,
26
+ "out_channels": 3,
27
+ "patch_size": [
28
+ 2,
29
+ 2
30
+ ],
31
+ "sample_size": 1024,
32
+ "up_block_types": [
33
+ "UpDecoderBlock2D",
34
+ "UpDecoderBlock2D",
35
+ "UpDecoderBlock2D",
36
+ "UpDecoderBlock2D"
37
+ ],
38
+ "use_post_quant_conv": true,
39
+ "use_quant_conv": true
40
+ }
vae/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca70d2202afe6415bdbcb8793ba8cd99fd159cfe6192381504d6c4d3036e0f04
3
+ size 168120878