sweetcocoa commited on
Commit
44a94a9
·
verified ·
1 Parent(s): 8767f63

initial commit

Browse files
README.md ADDED
@@ -0,0 +1,198 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: diffusers
3
+ ---
4
+
5
+ # Model Card for Model ID
6
+
7
+ <!-- Provide a quick summary of what the model is/does. -->
8
+
9
+
10
+
11
+ ## Model Details
12
+
13
+ ### Model Description
14
+
15
+ <!-- Provide a longer summary of what this model is. -->
16
+
17
+ This is the model card of a 🧨 diffusers model that has been pushed on the Hub. This model card has been automatically generated.
18
+
19
+ - **Developed by:** [More Information Needed]
20
+ - **Funded by [optional]:** [More Information Needed]
21
+ - **Shared by [optional]:** [More Information Needed]
22
+ - **Model type:** [More Information Needed]
23
+ - **Language(s) (NLP):** [More Information Needed]
24
+ - **License:** [More Information Needed]
25
+ - **Finetuned from model [optional]:** [More Information Needed]
26
+
27
+ ### Model Sources [optional]
28
+
29
+ <!-- Provide the basic links for the model. -->
30
+
31
+ - **Repository:** [More Information Needed]
32
+ - **Paper [optional]:** [More Information Needed]
33
+ - **Demo [optional]:** [More Information Needed]
34
+
35
+ ## Uses
36
+
37
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
38
+
39
+ ### Direct Use
40
+
41
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
42
+
43
+ [More Information Needed]
44
+
45
+ ### Downstream Use [optional]
46
+
47
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
48
+
49
+ [More Information Needed]
50
+
51
+ ### Out-of-Scope Use
52
+
53
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
54
+
55
+ [More Information Needed]
56
+
57
+ ## Bias, Risks, and Limitations
58
+
59
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
60
+
61
+ [More Information Needed]
62
+
63
+ ### Recommendations
64
+
65
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
66
+
67
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
68
+
69
+ ## How to Get Started with the Model
70
+
71
+ Use the code below to get started with the model.
72
+
73
+ [More Information Needed]
74
+
75
+ ## Training Details
76
+
77
+ ### Training Data
78
+
79
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
80
+
81
+ [More Information Needed]
82
+
83
+ ### Training Procedure
84
+
85
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
86
+
87
+ #### Preprocessing [optional]
88
+
89
+ [More Information Needed]
90
+
91
+
92
+ #### Training Hyperparameters
93
+
94
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
95
+
96
+ #### Speeds, Sizes, Times [optional]
97
+
98
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
99
+
100
+ [More Information Needed]
101
+
102
+ ## Evaluation
103
+
104
+ <!-- This section describes the evaluation protocols and provides the results. -->
105
+
106
+ ### Testing Data, Factors & Metrics
107
+
108
+ #### Testing Data
109
+
110
+ <!-- This should link to a Dataset Card if possible. -->
111
+
112
+ [More Information Needed]
113
+
114
+ #### Factors
115
+
116
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
117
+
118
+ [More Information Needed]
119
+
120
+ #### Metrics
121
+
122
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
123
+
124
+ [More Information Needed]
125
+
126
+ ### Results
127
+
128
+ [More Information Needed]
129
+
130
+ #### Summary
131
+
132
+
133
+
134
+ ## Model Examination [optional]
135
+
136
+ <!-- Relevant interpretability work for the model goes here -->
137
+
138
+ [More Information Needed]
139
+
140
+ ## Environmental Impact
141
+
142
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
143
+
144
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
145
+
146
+ - **Hardware Type:** [More Information Needed]
147
+ - **Hours used:** [More Information Needed]
148
+ - **Cloud Provider:** [More Information Needed]
149
+ - **Compute Region:** [More Information Needed]
150
+ - **Carbon Emitted:** [More Information Needed]
151
+
152
+ ## Technical Specifications [optional]
153
+
154
+ ### Model Architecture and Objective
155
+
156
+ [More Information Needed]
157
+
158
+ ### Compute Infrastructure
159
+
160
+ [More Information Needed]
161
+
162
+ #### Hardware
163
+
164
+ [More Information Needed]
165
+
166
+ #### Software
167
+
168
+ [More Information Needed]
169
+
170
+ ## Citation [optional]
171
+
172
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
173
+
174
+ **BibTeX:**
175
+
176
+ [More Information Needed]
177
+
178
+ **APA:**
179
+
180
+ [More Information Needed]
181
+
182
+ ## Glossary [optional]
183
+
184
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
185
+
186
+ [More Information Needed]
187
+
188
+ ## More Information [optional]
189
+
190
+ [More Information Needed]
191
+
192
+ ## Model Card Authors [optional]
193
+
194
+ [More Information Needed]
195
+
196
+ ## Model Card Contact
197
+
198
+ [More Information Needed]
model_index.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "CosmosTextToWorldPipeline",
3
+ "_diffusers_version": "0.34.0.dev0",
4
+ "_name_or_path": "tiny-cosmos",
5
+ "safety_checker": [
6
+ null,
7
+ null
8
+ ],
9
+ "scheduler": [
10
+ "diffusers",
11
+ "EDMEulerScheduler"
12
+ ],
13
+ "text_encoder": [
14
+ "transformers",
15
+ "T5EncoderModel"
16
+ ],
17
+ "tokenizer": [
18
+ "transformers",
19
+ "T5TokenizerFast"
20
+ ],
21
+ "transformer": [
22
+ "diffusers",
23
+ "CosmosTransformer3DModel"
24
+ ],
25
+ "vae": [
26
+ "diffusers",
27
+ "AutoencoderKLCosmos"
28
+ ]
29
+ }
scheduler/scheduler_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "EDMEulerScheduler",
3
+ "_diffusers_version": "0.34.0.dev0",
4
+ "final_sigmas_type": "sigma_min",
5
+ "num_train_timesteps": 1000,
6
+ "prediction_type": "epsilon",
7
+ "rho": 7.0,
8
+ "sigma_data": 0.5,
9
+ "sigma_max": 80,
10
+ "sigma_min": 0.002,
11
+ "sigma_schedule": "karras"
12
+ }
text_encoder/config.json ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "T5EncoderModel"
4
+ ],
5
+ "classifier_dropout": 0.0,
6
+ "d_ff": 65536,
7
+ "d_kv": 64,
8
+ "d_model": 64,
9
+ "decoder_start_token_id": 0,
10
+ "dense_act_fn": "relu",
11
+ "dropout_rate": 0.1,
12
+ "eos_token_id": 1,
13
+ "feed_forward_proj": "relu",
14
+ "initializer_factor": 1.0,
15
+ "is_encoder_decoder": true,
16
+ "is_gated_act": false,
17
+ "layer_norm_epsilon": 1e-06,
18
+ "model_type": "t5",
19
+ "n_positions": 512,
20
+ "num_decoder_layers": 1,
21
+ "num_heads": 128,
22
+ "num_layers": 1,
23
+ "output_past": true,
24
+ "pad_token_id": 0,
25
+ "relative_attention_max_distance": 128,
26
+ "relative_attention_num_buckets": 32,
27
+ "task_specific_params": {
28
+ "summarization": {
29
+ "early_stopping": true,
30
+ "length_penalty": 2.0,
31
+ "max_length": 200,
32
+ "min_length": 30,
33
+ "no_repeat_ngram_size": 3,
34
+ "num_beams": 4,
35
+ "prefix": "summarize: "
36
+ },
37
+ "translation_en_to_de": {
38
+ "early_stopping": true,
39
+ "max_length": 300,
40
+ "num_beams": 4,
41
+ "prefix": "translate English to German: "
42
+ },
43
+ "translation_en_to_fr": {
44
+ "early_stopping": true,
45
+ "max_length": 300,
46
+ "num_beams": 4,
47
+ "prefix": "translate English to French: "
48
+ },
49
+ "translation_en_to_ro": {
50
+ "early_stopping": true,
51
+ "max_length": 300,
52
+ "num_beams": 4,
53
+ "prefix": "translate English to Romanian: "
54
+ }
55
+ },
56
+ "torch_dtype": "float32",
57
+ "transformers_version": "4.51.3",
58
+ "use_cache": true,
59
+ "vocab_size": 32128
60
+ }
text_encoder/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63aa88d0890a9769bfdb2cc8eb34ed4848261124ea3b982f576c309459ef2bb7
3
+ size 50186240
tokenizer/special_tokens_map.json ADDED
@@ -0,0 +1,125 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<extra_id_0>",
4
+ "<extra_id_1>",
5
+ "<extra_id_2>",
6
+ "<extra_id_3>",
7
+ "<extra_id_4>",
8
+ "<extra_id_5>",
9
+ "<extra_id_6>",
10
+ "<extra_id_7>",
11
+ "<extra_id_8>",
12
+ "<extra_id_9>",
13
+ "<extra_id_10>",
14
+ "<extra_id_11>",
15
+ "<extra_id_12>",
16
+ "<extra_id_13>",
17
+ "<extra_id_14>",
18
+ "<extra_id_15>",
19
+ "<extra_id_16>",
20
+ "<extra_id_17>",
21
+ "<extra_id_18>",
22
+ "<extra_id_19>",
23
+ "<extra_id_20>",
24
+ "<extra_id_21>",
25
+ "<extra_id_22>",
26
+ "<extra_id_23>",
27
+ "<extra_id_24>",
28
+ "<extra_id_25>",
29
+ "<extra_id_26>",
30
+ "<extra_id_27>",
31
+ "<extra_id_28>",
32
+ "<extra_id_29>",
33
+ "<extra_id_30>",
34
+ "<extra_id_31>",
35
+ "<extra_id_32>",
36
+ "<extra_id_33>",
37
+ "<extra_id_34>",
38
+ "<extra_id_35>",
39
+ "<extra_id_36>",
40
+ "<extra_id_37>",
41
+ "<extra_id_38>",
42
+ "<extra_id_39>",
43
+ "<extra_id_40>",
44
+ "<extra_id_41>",
45
+ "<extra_id_42>",
46
+ "<extra_id_43>",
47
+ "<extra_id_44>",
48
+ "<extra_id_45>",
49
+ "<extra_id_46>",
50
+ "<extra_id_47>",
51
+ "<extra_id_48>",
52
+ "<extra_id_49>",
53
+ "<extra_id_50>",
54
+ "<extra_id_51>",
55
+ "<extra_id_52>",
56
+ "<extra_id_53>",
57
+ "<extra_id_54>",
58
+ "<extra_id_55>",
59
+ "<extra_id_56>",
60
+ "<extra_id_57>",
61
+ "<extra_id_58>",
62
+ "<extra_id_59>",
63
+ "<extra_id_60>",
64
+ "<extra_id_61>",
65
+ "<extra_id_62>",
66
+ "<extra_id_63>",
67
+ "<extra_id_64>",
68
+ "<extra_id_65>",
69
+ "<extra_id_66>",
70
+ "<extra_id_67>",
71
+ "<extra_id_68>",
72
+ "<extra_id_69>",
73
+ "<extra_id_70>",
74
+ "<extra_id_71>",
75
+ "<extra_id_72>",
76
+ "<extra_id_73>",
77
+ "<extra_id_74>",
78
+ "<extra_id_75>",
79
+ "<extra_id_76>",
80
+ "<extra_id_77>",
81
+ "<extra_id_78>",
82
+ "<extra_id_79>",
83
+ "<extra_id_80>",
84
+ "<extra_id_81>",
85
+ "<extra_id_82>",
86
+ "<extra_id_83>",
87
+ "<extra_id_84>",
88
+ "<extra_id_85>",
89
+ "<extra_id_86>",
90
+ "<extra_id_87>",
91
+ "<extra_id_88>",
92
+ "<extra_id_89>",
93
+ "<extra_id_90>",
94
+ "<extra_id_91>",
95
+ "<extra_id_92>",
96
+ "<extra_id_93>",
97
+ "<extra_id_94>",
98
+ "<extra_id_95>",
99
+ "<extra_id_96>",
100
+ "<extra_id_97>",
101
+ "<extra_id_98>",
102
+ "<extra_id_99>"
103
+ ],
104
+ "eos_token": {
105
+ "content": "</s>",
106
+ "lstrip": false,
107
+ "normalized": false,
108
+ "rstrip": false,
109
+ "single_word": false
110
+ },
111
+ "pad_token": {
112
+ "content": "<pad>",
113
+ "lstrip": false,
114
+ "normalized": false,
115
+ "rstrip": false,
116
+ "single_word": false
117
+ },
118
+ "unk_token": {
119
+ "content": "<unk>",
120
+ "lstrip": false,
121
+ "normalized": false,
122
+ "rstrip": false,
123
+ "single_word": false
124
+ }
125
+ }
tokenizer/spiece.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60acb128cf7b7f2536e8f38a5b18a05535c9e14c7a355904270e15b0945ea86
3
+ size 791656
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_config.json ADDED
@@ -0,0 +1,939 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": null,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<pad>",
6
+ "lstrip": false,
7
+ "normalized": false,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "</s>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "<unk>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "32000": {
29
+ "content": "<extra_id_99>",
30
+ "lstrip": false,
31
+ "normalized": false,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "32001": {
37
+ "content": "<extra_id_98>",
38
+ "lstrip": false,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "32002": {
45
+ "content": "<extra_id_97>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "32003": {
53
+ "content": "<extra_id_96>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "32004": {
61
+ "content": "<extra_id_95>",
62
+ "lstrip": false,
63
+ "normalized": false,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "32005": {
69
+ "content": "<extra_id_94>",
70
+ "lstrip": false,
71
+ "normalized": false,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "32006": {
77
+ "content": "<extra_id_93>",
78
+ "lstrip": false,
79
+ "normalized": false,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "32007": {
85
+ "content": "<extra_id_92>",
86
+ "lstrip": false,
87
+ "normalized": false,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "32008": {
93
+ "content": "<extra_id_91>",
94
+ "lstrip": false,
95
+ "normalized": false,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "32009": {
101
+ "content": "<extra_id_90>",
102
+ "lstrip": false,
103
+ "normalized": false,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "32010": {
109
+ "content": "<extra_id_89>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "32011": {
117
+ "content": "<extra_id_88>",
118
+ "lstrip": false,
119
+ "normalized": false,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "32012": {
125
+ "content": "<extra_id_87>",
126
+ "lstrip": false,
127
+ "normalized": false,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "32013": {
133
+ "content": "<extra_id_86>",
134
+ "lstrip": false,
135
+ "normalized": false,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ },
140
+ "32014": {
141
+ "content": "<extra_id_85>",
142
+ "lstrip": false,
143
+ "normalized": false,
144
+ "rstrip": false,
145
+ "single_word": false,
146
+ "special": true
147
+ },
148
+ "32015": {
149
+ "content": "<extra_id_84>",
150
+ "lstrip": false,
151
+ "normalized": false,
152
+ "rstrip": false,
153
+ "single_word": false,
154
+ "special": true
155
+ },
156
+ "32016": {
157
+ "content": "<extra_id_83>",
158
+ "lstrip": false,
159
+ "normalized": false,
160
+ "rstrip": false,
161
+ "single_word": false,
162
+ "special": true
163
+ },
164
+ "32017": {
165
+ "content": "<extra_id_82>",
166
+ "lstrip": false,
167
+ "normalized": false,
168
+ "rstrip": false,
169
+ "single_word": false,
170
+ "special": true
171
+ },
172
+ "32018": {
173
+ "content": "<extra_id_81>",
174
+ "lstrip": false,
175
+ "normalized": false,
176
+ "rstrip": false,
177
+ "single_word": false,
178
+ "special": true
179
+ },
180
+ "32019": {
181
+ "content": "<extra_id_80>",
182
+ "lstrip": false,
183
+ "normalized": false,
184
+ "rstrip": false,
185
+ "single_word": false,
186
+ "special": true
187
+ },
188
+ "32020": {
189
+ "content": "<extra_id_79>",
190
+ "lstrip": false,
191
+ "normalized": false,
192
+ "rstrip": false,
193
+ "single_word": false,
194
+ "special": true
195
+ },
196
+ "32021": {
197
+ "content": "<extra_id_78>",
198
+ "lstrip": false,
199
+ "normalized": false,
200
+ "rstrip": false,
201
+ "single_word": false,
202
+ "special": true
203
+ },
204
+ "32022": {
205
+ "content": "<extra_id_77>",
206
+ "lstrip": false,
207
+ "normalized": false,
208
+ "rstrip": false,
209
+ "single_word": false,
210
+ "special": true
211
+ },
212
+ "32023": {
213
+ "content": "<extra_id_76>",
214
+ "lstrip": false,
215
+ "normalized": false,
216
+ "rstrip": false,
217
+ "single_word": false,
218
+ "special": true
219
+ },
220
+ "32024": {
221
+ "content": "<extra_id_75>",
222
+ "lstrip": false,
223
+ "normalized": false,
224
+ "rstrip": false,
225
+ "single_word": false,
226
+ "special": true
227
+ },
228
+ "32025": {
229
+ "content": "<extra_id_74>",
230
+ "lstrip": false,
231
+ "normalized": false,
232
+ "rstrip": false,
233
+ "single_word": false,
234
+ "special": true
235
+ },
236
+ "32026": {
237
+ "content": "<extra_id_73>",
238
+ "lstrip": false,
239
+ "normalized": false,
240
+ "rstrip": false,
241
+ "single_word": false,
242
+ "special": true
243
+ },
244
+ "32027": {
245
+ "content": "<extra_id_72>",
246
+ "lstrip": false,
247
+ "normalized": false,
248
+ "rstrip": false,
249
+ "single_word": false,
250
+ "special": true
251
+ },
252
+ "32028": {
253
+ "content": "<extra_id_71>",
254
+ "lstrip": false,
255
+ "normalized": false,
256
+ "rstrip": false,
257
+ "single_word": false,
258
+ "special": true
259
+ },
260
+ "32029": {
261
+ "content": "<extra_id_70>",
262
+ "lstrip": false,
263
+ "normalized": false,
264
+ "rstrip": false,
265
+ "single_word": false,
266
+ "special": true
267
+ },
268
+ "32030": {
269
+ "content": "<extra_id_69>",
270
+ "lstrip": false,
271
+ "normalized": false,
272
+ "rstrip": false,
273
+ "single_word": false,
274
+ "special": true
275
+ },
276
+ "32031": {
277
+ "content": "<extra_id_68>",
278
+ "lstrip": false,
279
+ "normalized": false,
280
+ "rstrip": false,
281
+ "single_word": false,
282
+ "special": true
283
+ },
284
+ "32032": {
285
+ "content": "<extra_id_67>",
286
+ "lstrip": false,
287
+ "normalized": false,
288
+ "rstrip": false,
289
+ "single_word": false,
290
+ "special": true
291
+ },
292
+ "32033": {
293
+ "content": "<extra_id_66>",
294
+ "lstrip": false,
295
+ "normalized": false,
296
+ "rstrip": false,
297
+ "single_word": false,
298
+ "special": true
299
+ },
300
+ "32034": {
301
+ "content": "<extra_id_65>",
302
+ "lstrip": false,
303
+ "normalized": false,
304
+ "rstrip": false,
305
+ "single_word": false,
306
+ "special": true
307
+ },
308
+ "32035": {
309
+ "content": "<extra_id_64>",
310
+ "lstrip": false,
311
+ "normalized": false,
312
+ "rstrip": false,
313
+ "single_word": false,
314
+ "special": true
315
+ },
316
+ "32036": {
317
+ "content": "<extra_id_63>",
318
+ "lstrip": false,
319
+ "normalized": false,
320
+ "rstrip": false,
321
+ "single_word": false,
322
+ "special": true
323
+ },
324
+ "32037": {
325
+ "content": "<extra_id_62>",
326
+ "lstrip": false,
327
+ "normalized": false,
328
+ "rstrip": false,
329
+ "single_word": false,
330
+ "special": true
331
+ },
332
+ "32038": {
333
+ "content": "<extra_id_61>",
334
+ "lstrip": false,
335
+ "normalized": false,
336
+ "rstrip": false,
337
+ "single_word": false,
338
+ "special": true
339
+ },
340
+ "32039": {
341
+ "content": "<extra_id_60>",
342
+ "lstrip": false,
343
+ "normalized": false,
344
+ "rstrip": false,
345
+ "single_word": false,
346
+ "special": true
347
+ },
348
+ "32040": {
349
+ "content": "<extra_id_59>",
350
+ "lstrip": false,
351
+ "normalized": false,
352
+ "rstrip": false,
353
+ "single_word": false,
354
+ "special": true
355
+ },
356
+ "32041": {
357
+ "content": "<extra_id_58>",
358
+ "lstrip": false,
359
+ "normalized": false,
360
+ "rstrip": false,
361
+ "single_word": false,
362
+ "special": true
363
+ },
364
+ "32042": {
365
+ "content": "<extra_id_57>",
366
+ "lstrip": false,
367
+ "normalized": false,
368
+ "rstrip": false,
369
+ "single_word": false,
370
+ "special": true
371
+ },
372
+ "32043": {
373
+ "content": "<extra_id_56>",
374
+ "lstrip": false,
375
+ "normalized": false,
376
+ "rstrip": false,
377
+ "single_word": false,
378
+ "special": true
379
+ },
380
+ "32044": {
381
+ "content": "<extra_id_55>",
382
+ "lstrip": false,
383
+ "normalized": false,
384
+ "rstrip": false,
385
+ "single_word": false,
386
+ "special": true
387
+ },
388
+ "32045": {
389
+ "content": "<extra_id_54>",
390
+ "lstrip": false,
391
+ "normalized": false,
392
+ "rstrip": false,
393
+ "single_word": false,
394
+ "special": true
395
+ },
396
+ "32046": {
397
+ "content": "<extra_id_53>",
398
+ "lstrip": false,
399
+ "normalized": false,
400
+ "rstrip": false,
401
+ "single_word": false,
402
+ "special": true
403
+ },
404
+ "32047": {
405
+ "content": "<extra_id_52>",
406
+ "lstrip": false,
407
+ "normalized": false,
408
+ "rstrip": false,
409
+ "single_word": false,
410
+ "special": true
411
+ },
412
+ "32048": {
413
+ "content": "<extra_id_51>",
414
+ "lstrip": false,
415
+ "normalized": false,
416
+ "rstrip": false,
417
+ "single_word": false,
418
+ "special": true
419
+ },
420
+ "32049": {
421
+ "content": "<extra_id_50>",
422
+ "lstrip": false,
423
+ "normalized": false,
424
+ "rstrip": false,
425
+ "single_word": false,
426
+ "special": true
427
+ },
428
+ "32050": {
429
+ "content": "<extra_id_49>",
430
+ "lstrip": false,
431
+ "normalized": false,
432
+ "rstrip": false,
433
+ "single_word": false,
434
+ "special": true
435
+ },
436
+ "32051": {
437
+ "content": "<extra_id_48>",
438
+ "lstrip": false,
439
+ "normalized": false,
440
+ "rstrip": false,
441
+ "single_word": false,
442
+ "special": true
443
+ },
444
+ "32052": {
445
+ "content": "<extra_id_47>",
446
+ "lstrip": false,
447
+ "normalized": false,
448
+ "rstrip": false,
449
+ "single_word": false,
450
+ "special": true
451
+ },
452
+ "32053": {
453
+ "content": "<extra_id_46>",
454
+ "lstrip": false,
455
+ "normalized": false,
456
+ "rstrip": false,
457
+ "single_word": false,
458
+ "special": true
459
+ },
460
+ "32054": {
461
+ "content": "<extra_id_45>",
462
+ "lstrip": false,
463
+ "normalized": false,
464
+ "rstrip": false,
465
+ "single_word": false,
466
+ "special": true
467
+ },
468
+ "32055": {
469
+ "content": "<extra_id_44>",
470
+ "lstrip": false,
471
+ "normalized": false,
472
+ "rstrip": false,
473
+ "single_word": false,
474
+ "special": true
475
+ },
476
+ "32056": {
477
+ "content": "<extra_id_43>",
478
+ "lstrip": false,
479
+ "normalized": false,
480
+ "rstrip": false,
481
+ "single_word": false,
482
+ "special": true
483
+ },
484
+ "32057": {
485
+ "content": "<extra_id_42>",
486
+ "lstrip": false,
487
+ "normalized": false,
488
+ "rstrip": false,
489
+ "single_word": false,
490
+ "special": true
491
+ },
492
+ "32058": {
493
+ "content": "<extra_id_41>",
494
+ "lstrip": false,
495
+ "normalized": false,
496
+ "rstrip": false,
497
+ "single_word": false,
498
+ "special": true
499
+ },
500
+ "32059": {
501
+ "content": "<extra_id_40>",
502
+ "lstrip": false,
503
+ "normalized": false,
504
+ "rstrip": false,
505
+ "single_word": false,
506
+ "special": true
507
+ },
508
+ "32060": {
509
+ "content": "<extra_id_39>",
510
+ "lstrip": false,
511
+ "normalized": false,
512
+ "rstrip": false,
513
+ "single_word": false,
514
+ "special": true
515
+ },
516
+ "32061": {
517
+ "content": "<extra_id_38>",
518
+ "lstrip": false,
519
+ "normalized": false,
520
+ "rstrip": false,
521
+ "single_word": false,
522
+ "special": true
523
+ },
524
+ "32062": {
525
+ "content": "<extra_id_37>",
526
+ "lstrip": false,
527
+ "normalized": false,
528
+ "rstrip": false,
529
+ "single_word": false,
530
+ "special": true
531
+ },
532
+ "32063": {
533
+ "content": "<extra_id_36>",
534
+ "lstrip": false,
535
+ "normalized": false,
536
+ "rstrip": false,
537
+ "single_word": false,
538
+ "special": true
539
+ },
540
+ "32064": {
541
+ "content": "<extra_id_35>",
542
+ "lstrip": false,
543
+ "normalized": false,
544
+ "rstrip": false,
545
+ "single_word": false,
546
+ "special": true
547
+ },
548
+ "32065": {
549
+ "content": "<extra_id_34>",
550
+ "lstrip": false,
551
+ "normalized": false,
552
+ "rstrip": false,
553
+ "single_word": false,
554
+ "special": true
555
+ },
556
+ "32066": {
557
+ "content": "<extra_id_33>",
558
+ "lstrip": false,
559
+ "normalized": false,
560
+ "rstrip": false,
561
+ "single_word": false,
562
+ "special": true
563
+ },
564
+ "32067": {
565
+ "content": "<extra_id_32>",
566
+ "lstrip": false,
567
+ "normalized": false,
568
+ "rstrip": false,
569
+ "single_word": false,
570
+ "special": true
571
+ },
572
+ "32068": {
573
+ "content": "<extra_id_31>",
574
+ "lstrip": false,
575
+ "normalized": false,
576
+ "rstrip": false,
577
+ "single_word": false,
578
+ "special": true
579
+ },
580
+ "32069": {
581
+ "content": "<extra_id_30>",
582
+ "lstrip": false,
583
+ "normalized": false,
584
+ "rstrip": false,
585
+ "single_word": false,
586
+ "special": true
587
+ },
588
+ "32070": {
589
+ "content": "<extra_id_29>",
590
+ "lstrip": false,
591
+ "normalized": false,
592
+ "rstrip": false,
593
+ "single_word": false,
594
+ "special": true
595
+ },
596
+ "32071": {
597
+ "content": "<extra_id_28>",
598
+ "lstrip": false,
599
+ "normalized": false,
600
+ "rstrip": false,
601
+ "single_word": false,
602
+ "special": true
603
+ },
604
+ "32072": {
605
+ "content": "<extra_id_27>",
606
+ "lstrip": false,
607
+ "normalized": false,
608
+ "rstrip": false,
609
+ "single_word": false,
610
+ "special": true
611
+ },
612
+ "32073": {
613
+ "content": "<extra_id_26>",
614
+ "lstrip": false,
615
+ "normalized": false,
616
+ "rstrip": false,
617
+ "single_word": false,
618
+ "special": true
619
+ },
620
+ "32074": {
621
+ "content": "<extra_id_25>",
622
+ "lstrip": false,
623
+ "normalized": false,
624
+ "rstrip": false,
625
+ "single_word": false,
626
+ "special": true
627
+ },
628
+ "32075": {
629
+ "content": "<extra_id_24>",
630
+ "lstrip": false,
631
+ "normalized": false,
632
+ "rstrip": false,
633
+ "single_word": false,
634
+ "special": true
635
+ },
636
+ "32076": {
637
+ "content": "<extra_id_23>",
638
+ "lstrip": false,
639
+ "normalized": false,
640
+ "rstrip": false,
641
+ "single_word": false,
642
+ "special": true
643
+ },
644
+ "32077": {
645
+ "content": "<extra_id_22>",
646
+ "lstrip": false,
647
+ "normalized": false,
648
+ "rstrip": false,
649
+ "single_word": false,
650
+ "special": true
651
+ },
652
+ "32078": {
653
+ "content": "<extra_id_21>",
654
+ "lstrip": false,
655
+ "normalized": false,
656
+ "rstrip": false,
657
+ "single_word": false,
658
+ "special": true
659
+ },
660
+ "32079": {
661
+ "content": "<extra_id_20>",
662
+ "lstrip": false,
663
+ "normalized": false,
664
+ "rstrip": false,
665
+ "single_word": false,
666
+ "special": true
667
+ },
668
+ "32080": {
669
+ "content": "<extra_id_19>",
670
+ "lstrip": false,
671
+ "normalized": false,
672
+ "rstrip": false,
673
+ "single_word": false,
674
+ "special": true
675
+ },
676
+ "32081": {
677
+ "content": "<extra_id_18>",
678
+ "lstrip": false,
679
+ "normalized": false,
680
+ "rstrip": false,
681
+ "single_word": false,
682
+ "special": true
683
+ },
684
+ "32082": {
685
+ "content": "<extra_id_17>",
686
+ "lstrip": false,
687
+ "normalized": false,
688
+ "rstrip": false,
689
+ "single_word": false,
690
+ "special": true
691
+ },
692
+ "32083": {
693
+ "content": "<extra_id_16>",
694
+ "lstrip": false,
695
+ "normalized": false,
696
+ "rstrip": false,
697
+ "single_word": false,
698
+ "special": true
699
+ },
700
+ "32084": {
701
+ "content": "<extra_id_15>",
702
+ "lstrip": false,
703
+ "normalized": false,
704
+ "rstrip": false,
705
+ "single_word": false,
706
+ "special": true
707
+ },
708
+ "32085": {
709
+ "content": "<extra_id_14>",
710
+ "lstrip": false,
711
+ "normalized": false,
712
+ "rstrip": false,
713
+ "single_word": false,
714
+ "special": true
715
+ },
716
+ "32086": {
717
+ "content": "<extra_id_13>",
718
+ "lstrip": false,
719
+ "normalized": false,
720
+ "rstrip": false,
721
+ "single_word": false,
722
+ "special": true
723
+ },
724
+ "32087": {
725
+ "content": "<extra_id_12>",
726
+ "lstrip": false,
727
+ "normalized": false,
728
+ "rstrip": false,
729
+ "single_word": false,
730
+ "special": true
731
+ },
732
+ "32088": {
733
+ "content": "<extra_id_11>",
734
+ "lstrip": false,
735
+ "normalized": false,
736
+ "rstrip": false,
737
+ "single_word": false,
738
+ "special": true
739
+ },
740
+ "32089": {
741
+ "content": "<extra_id_10>",
742
+ "lstrip": false,
743
+ "normalized": false,
744
+ "rstrip": false,
745
+ "single_word": false,
746
+ "special": true
747
+ },
748
+ "32090": {
749
+ "content": "<extra_id_9>",
750
+ "lstrip": false,
751
+ "normalized": false,
752
+ "rstrip": false,
753
+ "single_word": false,
754
+ "special": true
755
+ },
756
+ "32091": {
757
+ "content": "<extra_id_8>",
758
+ "lstrip": false,
759
+ "normalized": false,
760
+ "rstrip": false,
761
+ "single_word": false,
762
+ "special": true
763
+ },
764
+ "32092": {
765
+ "content": "<extra_id_7>",
766
+ "lstrip": false,
767
+ "normalized": false,
768
+ "rstrip": false,
769
+ "single_word": false,
770
+ "special": true
771
+ },
772
+ "32093": {
773
+ "content": "<extra_id_6>",
774
+ "lstrip": false,
775
+ "normalized": false,
776
+ "rstrip": false,
777
+ "single_word": false,
778
+ "special": true
779
+ },
780
+ "32094": {
781
+ "content": "<extra_id_5>",
782
+ "lstrip": false,
783
+ "normalized": false,
784
+ "rstrip": false,
785
+ "single_word": false,
786
+ "special": true
787
+ },
788
+ "32095": {
789
+ "content": "<extra_id_4>",
790
+ "lstrip": false,
791
+ "normalized": false,
792
+ "rstrip": false,
793
+ "single_word": false,
794
+ "special": true
795
+ },
796
+ "32096": {
797
+ "content": "<extra_id_3>",
798
+ "lstrip": false,
799
+ "normalized": false,
800
+ "rstrip": false,
801
+ "single_word": false,
802
+ "special": true
803
+ },
804
+ "32097": {
805
+ "content": "<extra_id_2>",
806
+ "lstrip": false,
807
+ "normalized": false,
808
+ "rstrip": false,
809
+ "single_word": false,
810
+ "special": true
811
+ },
812
+ "32098": {
813
+ "content": "<extra_id_1>",
814
+ "lstrip": false,
815
+ "normalized": false,
816
+ "rstrip": false,
817
+ "single_word": false,
818
+ "special": true
819
+ },
820
+ "32099": {
821
+ "content": "<extra_id_0>",
822
+ "lstrip": false,
823
+ "normalized": false,
824
+ "rstrip": false,
825
+ "single_word": false,
826
+ "special": true
827
+ }
828
+ },
829
+ "additional_special_tokens": [
830
+ "<extra_id_0>",
831
+ "<extra_id_1>",
832
+ "<extra_id_2>",
833
+ "<extra_id_3>",
834
+ "<extra_id_4>",
835
+ "<extra_id_5>",
836
+ "<extra_id_6>",
837
+ "<extra_id_7>",
838
+ "<extra_id_8>",
839
+ "<extra_id_9>",
840
+ "<extra_id_10>",
841
+ "<extra_id_11>",
842
+ "<extra_id_12>",
843
+ "<extra_id_13>",
844
+ "<extra_id_14>",
845
+ "<extra_id_15>",
846
+ "<extra_id_16>",
847
+ "<extra_id_17>",
848
+ "<extra_id_18>",
849
+ "<extra_id_19>",
850
+ "<extra_id_20>",
851
+ "<extra_id_21>",
852
+ "<extra_id_22>",
853
+ "<extra_id_23>",
854
+ "<extra_id_24>",
855
+ "<extra_id_25>",
856
+ "<extra_id_26>",
857
+ "<extra_id_27>",
858
+ "<extra_id_28>",
859
+ "<extra_id_29>",
860
+ "<extra_id_30>",
861
+ "<extra_id_31>",
862
+ "<extra_id_32>",
863
+ "<extra_id_33>",
864
+ "<extra_id_34>",
865
+ "<extra_id_35>",
866
+ "<extra_id_36>",
867
+ "<extra_id_37>",
868
+ "<extra_id_38>",
869
+ "<extra_id_39>",
870
+ "<extra_id_40>",
871
+ "<extra_id_41>",
872
+ "<extra_id_42>",
873
+ "<extra_id_43>",
874
+ "<extra_id_44>",
875
+ "<extra_id_45>",
876
+ "<extra_id_46>",
877
+ "<extra_id_47>",
878
+ "<extra_id_48>",
879
+ "<extra_id_49>",
880
+ "<extra_id_50>",
881
+ "<extra_id_51>",
882
+ "<extra_id_52>",
883
+ "<extra_id_53>",
884
+ "<extra_id_54>",
885
+ "<extra_id_55>",
886
+ "<extra_id_56>",
887
+ "<extra_id_57>",
888
+ "<extra_id_58>",
889
+ "<extra_id_59>",
890
+ "<extra_id_60>",
891
+ "<extra_id_61>",
892
+ "<extra_id_62>",
893
+ "<extra_id_63>",
894
+ "<extra_id_64>",
895
+ "<extra_id_65>",
896
+ "<extra_id_66>",
897
+ "<extra_id_67>",
898
+ "<extra_id_68>",
899
+ "<extra_id_69>",
900
+ "<extra_id_70>",
901
+ "<extra_id_71>",
902
+ "<extra_id_72>",
903
+ "<extra_id_73>",
904
+ "<extra_id_74>",
905
+ "<extra_id_75>",
906
+ "<extra_id_76>",
907
+ "<extra_id_77>",
908
+ "<extra_id_78>",
909
+ "<extra_id_79>",
910
+ "<extra_id_80>",
911
+ "<extra_id_81>",
912
+ "<extra_id_82>",
913
+ "<extra_id_83>",
914
+ "<extra_id_84>",
915
+ "<extra_id_85>",
916
+ "<extra_id_86>",
917
+ "<extra_id_87>",
918
+ "<extra_id_88>",
919
+ "<extra_id_89>",
920
+ "<extra_id_90>",
921
+ "<extra_id_91>",
922
+ "<extra_id_92>",
923
+ "<extra_id_93>",
924
+ "<extra_id_94>",
925
+ "<extra_id_95>",
926
+ "<extra_id_96>",
927
+ "<extra_id_97>",
928
+ "<extra_id_98>",
929
+ "<extra_id_99>"
930
+ ],
931
+ "clean_up_tokenization_spaces": false,
932
+ "eos_token": "</s>",
933
+ "extra_ids": 100,
934
+ "extra_special_tokens": {},
935
+ "model_max_length": 1000000000000000019884624838656,
936
+ "pad_token": "<pad>",
937
+ "tokenizer_class": "T5Tokenizer",
938
+ "unk_token": "<unk>"
939
+ }
transformer/config.json ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "CosmosTransformer3DModel",
3
+ "_diffusers_version": "0.34.0.dev0",
4
+ "_name_or_path": "tiny-cosmos/transformer",
5
+ "adaln_lora_dim": 256,
6
+ "attention_head_dim": 128,
7
+ "concat_padding_mask": true,
8
+ "extra_pos_embed_type": "learnable",
9
+ "in_channels": 16,
10
+ "max_size": [
11
+ 128,
12
+ 240,
13
+ 240
14
+ ],
15
+ "mlp_ratio": 4.0,
16
+ "num_attention_heads": 2,
17
+ "num_layers": 2,
18
+ "out_channels": 16,
19
+ "patch_size": [
20
+ 1,
21
+ 2,
22
+ 2
23
+ ],
24
+ "rope_scale": [
25
+ 2.0,
26
+ 1.0,
27
+ 1.0
28
+ ],
29
+ "text_embed_dim": 64
30
+ }
transformer/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c754ae4df620539d9140b525620dfca6d416a1f84b496babe84ef05a6c4e55aa
3
+ size 16251152
vae/config.json ADDED
@@ -0,0 +1,546 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_class_name": "AutoencoderKLCosmos",
3
+ "_diffusers_version": "0.34.0.dev0",
4
+ "_name_or_path": "tiny-cosmos/vae",
5
+ "attention_resolutions": [
6
+ 32
7
+ ],
8
+ "decode_block_out_channels": [
9
+ 8,
10
+ 16,
11
+ 16,
12
+ 16
13
+ ],
14
+ "encoder_block_out_channels": [
15
+ 4,
16
+ 8,
17
+ 16,
18
+ 16
19
+ ],
20
+ "in_channels": 3,
21
+ "latent_channels": 16,
22
+ "latents_mean": [
23
+ 0.11362757533788681,
24
+ -0.017171695828437805,
25
+ 0.03071162849664688,
26
+ 0.020468616858124733,
27
+ 0.019314559176564217,
28
+ 0.02138567343354225,
29
+ 0.019993416965007782,
30
+ 0.021891867741942406,
31
+ 0.020119348540902138,
32
+ 0.01872694492340088,
33
+ 0.021686134859919548,
34
+ 0.022071482613682747,
35
+ 0.01986941136419773,
36
+ 0.017704127356410027,
37
+ 0.020676426589488983,
38
+ 0.0202824454754591,
39
+ 0.19125476479530334,
40
+ 0.04556972160935402,
41
+ 0.05955580249428749,
42
+ 0.05315534397959709,
43
+ 0.05496629327535629,
44
+ 0.05356264486908913,
45
+ 0.04856595769524574,
46
+ 0.05327453464269638,
47
+ 0.05410471558570862,
48
+ 0.05597148835659027,
49
+ 0.05524865910410881,
50
+ 0.051818735897541046,
51
+ 0.05071663111448288,
52
+ 0.052045371383428574,
53
+ 0.05641080439090729,
54
+ 0.05518041551113129,
55
+ 0.01306714117527008,
56
+ 0.03341160714626312,
57
+ 0.03847246244549751,
58
+ 0.028101854026317596,
59
+ 0.027901655063033104,
60
+ 0.02920026145875454,
61
+ 0.02823597379028797,
62
+ 0.026310328394174576,
63
+ 0.02785310335457325,
64
+ 0.028805073350667953,
65
+ 0.02977769263088703,
66
+ 0.031454406678676605,
67
+ 0.02888389490544796,
68
+ 0.03280773386359215,
69
+ 0.03484927490353584,
70
+ 0.03049197606742382,
71
+ -0.0019772653467953205,
72
+ 0.07534956932067871,
73
+ 0.049638792872428894,
74
+ 0.05530892685055733,
75
+ 0.054108284413814545,
76
+ 0.052525412291288376,
77
+ 0.05029899254441261,
78
+ 0.05321024730801582,
79
+ 0.05149244889616966,
80
+ 0.05119210109114647,
81
+ 0.04643494635820389,
82
+ 0.04604526609182358,
83
+ 0.046316176652908325,
84
+ 0.04404101148247719,
85
+ 0.04403536394238472,
86
+ 0.04499494656920433,
87
+ -0.029941828921437263,
88
+ -0.047870032489299774,
89
+ -0.010645583271980286,
90
+ -0.01779823563992977,
91
+ -0.014905018731951714,
92
+ -0.02157517336308956,
93
+ -0.02047779969871044,
94
+ -0.021808160468935966,
95
+ -0.0194537490606308,
96
+ -0.020628631114959717,
97
+ -0.021922089159488678,
98
+ -0.02520638518035412,
99
+ -0.022466560825705528,
100
+ -0.024275334551930428,
101
+ -0.02683362551033497,
102
+ -0.02762005850672722,
103
+ 0.08019473403692245,
104
+ -0.13005368411540985,
105
+ -0.07568635791540146,
106
+ -0.06082374230027199,
107
+ -0.060361746698617935,
108
+ -0.058753639459609985,
109
+ -0.0592188723385334,
110
+ -0.058697883039712906,
111
+ -0.05273940786719322,
112
+ -0.05256499722599983,
113
+ -0.05346428230404854,
114
+ -0.05456540733575821,
115
+ -0.05365699902176857,
116
+ -0.05656896531581879,
117
+ -0.057285893708467484,
118
+ -0.05321847274899483,
119
+ 0.1671840250492096,
120
+ -0.003901461837813258,
121
+ 0.03794059902429581,
122
+ 0.03565610200166702,
123
+ 0.03554131090641022,
124
+ 0.03924074023962021,
125
+ 0.03873615339398384,
126
+ 0.04187328740954399,
127
+ 0.04226924106478691,
128
+ 0.04378717020153999,
129
+ 0.04684273898601532,
130
+ 0.05117613822221756,
131
+ 0.04547792300581932,
132
+ 0.05251586064696312,
133
+ 0.05048338696360588,
134
+ 0.04950783774256706,
135
+ 0.09564418345689774,
136
+ 0.05471280217170715,
137
+ 0.08183968812227249,
138
+ 0.07978633046150208,
139
+ 0.08076023310422897,
140
+ 0.08108604699373245,
141
+ 0.08011817932128906,
142
+ 0.0796557292342186,
143
+ 0.08187773078680038,
144
+ 0.0835026279091835,
145
+ 0.08101469278335571,
146
+ 0.07869409769773483,
147
+ 0.07744419574737549,
148
+ 0.07724520564079285,
149
+ 0.07830417901277542,
150
+ 0.0759979635477066,
151
+ -0.049875665456056595,
152
+ 0.05923908203840256,
153
+ -0.010587457567453384,
154
+ -0.011776033788919449,
155
+ -0.01116162072867155,
156
+ -0.013641487807035446,
157
+ -0.015460136346518993,
158
+ -0.01172130461782217,
159
+ -0.017800433561205864,
160
+ -0.016483137384057045,
161
+ -0.02100246772170067,
162
+ -0.0210441704839468,
163
+ -0.02482122741639614,
164
+ -0.02611689455807209,
165
+ -0.025611430406570435,
166
+ -0.025973355397582054,
167
+ -0.053646672517061234,
168
+ 0.08211684226989746,
169
+ 0.046869371086359024,
170
+ 0.04605640843510628,
171
+ 0.043041862547397614,
172
+ 0.039735499769449234,
173
+ 0.036867666989564896,
174
+ 0.04087112471461296,
175
+ 0.03704741224646568,
176
+ 0.03706400841474533,
177
+ 0.031200725585222244,
178
+ 0.03349090740084648,
179
+ 0.03319963067770004,
180
+ 0.032057810574769974,
181
+ 0.03195127099752426,
182
+ 0.03180480748414993,
183
+ 0.16427966952323914,
184
+ -0.1104845330119133,
185
+ -0.04595276340842247,
186
+ -0.04982893168926239,
187
+ -0.05213464796543121,
188
+ -0.04809378460049629,
189
+ -0.050803184509277344,
190
+ -0.04992862790822983,
191
+ -0.044933367520570755,
192
+ -0.046761900186538696,
193
+ -0.048847030848264694,
194
+ -0.04627892002463341,
195
+ -0.04913311451673508,
196
+ -0.04955708608031273,
197
+ -0.04533981531858444,
198
+ -0.04570218175649643,
199
+ -0.10612928122282028,
200
+ -0.05121197551488876,
201
+ -0.06761008501052856,
202
+ -0.0725180059671402,
203
+ -0.07265284657478333,
204
+ -0.074178546667099,
205
+ -0.07202412188053131,
206
+ -0.07499026507139206,
207
+ -0.07625480741262436,
208
+ -0.07535747438669205,
209
+ -0.07638787478208542,
210
+ -0.0792030468583107,
211
+ -0.0759606882929802,
212
+ -0.07959417998790741,
213
+ -0.08265036344528198,
214
+ -0.07955470681190491,
215
+ -0.1688891500234604,
216
+ 0.07532420009374619,
217
+ 0.04062594473361969,
218
+ 0.03375093266367912,
219
+ 0.033374518156051636,
220
+ 0.036993756890296936,
221
+ 0.0365113765001297,
222
+ 0.036110229790210724,
223
+ 0.03555621951818466,
224
+ 0.03378554433584213,
225
+ 0.030049804598093033,
226
+ 0.033955592662096024,
227
+ 0.029418472200632095,
228
+ 0.031564321368932724,
229
+ 0.034311726689338684,
230
+ 0.030168525874614716,
231
+ -0.03415358439087868,
232
+ -0.016995728015899658,
233
+ -0.040292952209711075,
234
+ -0.049121566116809845,
235
+ -0.04988580197095871,
236
+ -0.04917917773127556,
237
+ -0.049180563539266586,
238
+ -0.052518896758556366,
239
+ -0.05325506255030632,
240
+ -0.05341973155736923,
241
+ -0.04983328655362129,
242
+ -0.048831455409526825,
243
+ -0.04985548183321953,
244
+ -0.04736718162894249,
245
+ -0.04620270058512688,
246
+ -0.0483609102666378,
247
+ 0.020556746050715446,
248
+ 0.03419799357652664,
249
+ -0.029076693579554558,
250
+ -0.04350508749485016,
251
+ -0.04156143590807915,
252
+ -0.04234420508146286,
253
+ -0.04446109011769295,
254
+ -0.04461774230003357,
255
+ -0.04882838577032089,
256
+ -0.04822345823049545,
257
+ -0.04502492770552635,
258
+ -0.05062440410256386,
259
+ -0.05146912857890129,
260
+ -0.046552665531635284,
261
+ -0.048629943281412125,
262
+ -0.048416152596473694,
263
+ 0.20312774181365967,
264
+ -0.07208502292633057,
265
+ -0.03635615482926369,
266
+ -0.03556087613105774,
267
+ -0.042461737990379333,
268
+ -0.04195837676525116,
269
+ -0.04293777793645859,
270
+ -0.04071275517344475,
271
+ -0.042405690997838974,
272
+ -0.04125212877988815,
273
+ -0.04395143687725067,
274
+ -0.03959095850586891,
275
+ -0.04044992849230766,
276
+ -0.040158748626708984,
277
+ -0.04088107496500015,
278
+ -0.03885176032781601
279
+ ],
280
+ "latents_std": [
281
+ 0.5670027136802673,
282
+ 0.6548898220062256,
283
+ 0.6558942794799805,
284
+ 0.6652436852455139,
285
+ 0.6661978363990784,
286
+ 0.666638195514679,
287
+ 0.6720837950706482,
288
+ 0.6695597767829895,
289
+ 0.6692887544631958,
290
+ 0.6710878610610962,
291
+ 0.6709252595901489,
292
+ 0.6739746332168579,
293
+ 0.6789488196372986,
294
+ 0.6766831278800964,
295
+ 0.6776956915855408,
296
+ 0.6747955679893494,
297
+ 0.8524512052536011,
298
+ 0.868837296962738,
299
+ 0.8734808564186096,
300
+ 0.8845933675765991,
301
+ 0.8913588523864746,
302
+ 0.891050398349762,
303
+ 0.8971490859985352,
304
+ 0.8994747400283813,
305
+ 0.9020176529884338,
306
+ 0.9041182398796082,
307
+ 0.906926155090332,
308
+ 0.9084777235984802,
309
+ 0.9064871072769165,
310
+ 0.9100698232650757,
311
+ 0.9103343486785889,
312
+ 0.9054154753684998,
313
+ 0.8496035933494568,
314
+ 0.8586335182189941,
315
+ 0.8689531683921814,
316
+ 0.884606122970581,
317
+ 0.8924500346183777,
318
+ 0.8945170640945435,
319
+ 0.8993100523948669,
320
+ 0.9064735770225525,
321
+ 0.9033823609352112,
322
+ 0.9051007628440857,
323
+ 0.9100831151008606,
324
+ 0.9096121788024902,
325
+ 0.9123716950416565,
326
+ 0.9131317138671875,
327
+ 0.914355456829071,
328
+ 0.9156510233879089,
329
+ 0.9187710285186768,
330
+ 0.851551353931427,
331
+ 0.857804000377655,
332
+ 0.8699803352355957,
333
+ 0.8736526370048523,
334
+ 0.8816176652908325,
335
+ 0.881510317325592,
336
+ 0.887589156627655,
337
+ 0.8901551365852356,
338
+ 0.8924557566642761,
339
+ 0.8927622437477112,
340
+ 0.894504964351654,
341
+ 0.9005420207977295,
342
+ 0.8999413251876831,
343
+ 0.9013610482215881,
344
+ 0.9011489152908325,
345
+ 0.7775575518608093,
346
+ 0.8145685195922852,
347
+ 0.8191184401512146,
348
+ 0.8313707113265991,
349
+ 0.8382047414779663,
350
+ 0.8389037251472473,
351
+ 0.8440110087394714,
352
+ 0.844251811504364,
353
+ 0.8473935723304749,
354
+ 0.8479875326156616,
355
+ 0.8524958491325378,
356
+ 0.8511499762535095,
357
+ 0.8516093492507935,
358
+ 0.8562635779380798,
359
+ 0.856778621673584,
360
+ 0.8564102649688721,
361
+ 0.6990351676940918,
362
+ 0.7169788479804993,
363
+ 0.7169691324234009,
364
+ 0.7258316874504089,
365
+ 0.729317307472229,
366
+ 0.7325412631034851,
367
+ 0.7358697652816772,
368
+ 0.7373496890068054,
369
+ 0.7366458177566528,
370
+ 0.7408490777015686,
371
+ 0.7439932227134705,
372
+ 0.7447181940078735,
373
+ 0.7449318766593933,
374
+ 0.7482457756996155,
375
+ 0.7502487301826477,
376
+ 0.7527480125427246,
377
+ 0.8187142014503479,
378
+ 0.8225188255310059,
379
+ 0.8261602520942688,
380
+ 0.8316448330879211,
381
+ 0.8407237529754639,
382
+ 0.8396466970443726,
383
+ 0.841433048248291,
384
+ 0.848807692527771,
385
+ 0.8503468036651611,
386
+ 0.8519694805145264,
387
+ 0.8521105051040649,
388
+ 0.8538666367530823,
389
+ 0.8541001677513123,
390
+ 0.8543934226036072,
391
+ 0.8584784865379333,
392
+ 0.8538527488708496,
393
+ 0.6758398413658142,
394
+ 0.6825984716415405,
395
+ 0.6919885277748108,
396
+ 0.6992884278297424,
397
+ 0.7019432783126831,
398
+ 0.7046700119972229,
399
+ 0.7075554728507996,
400
+ 0.7091785669326782,
401
+ 0.7100769877433777,
402
+ 0.7096350193023682,
403
+ 0.7106407880783081,
404
+ 0.7102733254432678,
405
+ 0.7129116654396057,
406
+ 0.7153753638267517,
407
+ 0.7190250754356384,
408
+ 0.716041624546051,
409
+ 0.7245098948478699,
410
+ 0.719799280166626,
411
+ 0.7205737829208374,
412
+ 0.7303546071052551,
413
+ 0.7332962155342102,
414
+ 0.7366002798080444,
415
+ 0.7389146089553833,
416
+ 0.7427999377250671,
417
+ 0.7410569190979004,
418
+ 0.7400243282318115,
419
+ 0.7425758838653564,
420
+ 0.7441611886024475,
421
+ 0.7454389929771423,
422
+ 0.7469444274902344,
423
+ 0.7474706172943115,
424
+ 0.7458640336990356,
425
+ 0.9017698764801025,
426
+ 0.9099067449569702,
427
+ 0.9110680222511292,
428
+ 0.9216378331184387,
429
+ 0.9239023327827454,
430
+ 0.9305619597434998,
431
+ 0.9348220229148865,
432
+ 0.9364241361618042,
433
+ 0.9385837912559509,
434
+ 0.9406497478485107,
435
+ 0.9407893419265747,
436
+ 0.9432571530342102,
437
+ 0.9495530128479004,
438
+ 0.9481470584869385,
439
+ 0.95144122838974,
440
+ 0.9492307305335999,
441
+ 0.49853548407554626,
442
+ 0.6496810913085938,
443
+ 0.6427654027938843,
444
+ 0.6496639251708984,
445
+ 0.6487663984298706,
446
+ 0.6520355939865112,
447
+ 0.6584241986274719,
448
+ 0.6535161137580872,
449
+ 0.654643714427948,
450
+ 0.6574859023094177,
451
+ 0.6562633514404297,
452
+ 0.6612374782562256,
453
+ 0.6612117886543274,
454
+ 0.6607794165611267,
455
+ 0.6604015231132507,
456
+ 0.6647490859031677,
457
+ 0.619865894317627,
458
+ 0.6913813352584839,
459
+ 0.6884557008743286,
460
+ 0.6955842971801758,
461
+ 0.6976540088653564,
462
+ 0.7001534700393677,
463
+ 0.705295979976654,
464
+ 0.7046875357627869,
465
+ 0.7039952278137207,
466
+ 0.7047998905181885,
467
+ 0.7088757157325745,
468
+ 0.7112686634063721,
469
+ 0.7097226977348328,
470
+ 0.7124993205070496,
471
+ 0.7123194932937622,
472
+ 0.7117560505867004,
473
+ 0.35586974024772644,
474
+ 0.6872385740280151,
475
+ 0.6897321939468384,
476
+ 0.6995847821235657,
477
+ 0.6943452954292297,
478
+ 0.6995818018913269,
479
+ 0.7098021507263184,
480
+ 0.6989945769309998,
481
+ 0.7027168869972229,
482
+ 0.700950562953949,
483
+ 0.6991285085678101,
484
+ 0.7052269577980042,
485
+ 0.7039217352867126,
486
+ 0.7091691493988037,
487
+ 0.7058573365211487,
488
+ 0.7037354111671448,
489
+ 0.9810133576393127,
490
+ 0.890247642993927,
491
+ 0.896072506904602,
492
+ 0.906781792640686,
493
+ 0.9130866527557373,
494
+ 0.9181234836578369,
495
+ 0.9198082685470581,
496
+ 0.924806535243988,
497
+ 0.9263566732406616,
498
+ 0.92887943983078,
499
+ 0.9333807229995728,
500
+ 0.9346809387207031,
501
+ 0.9361943602561951,
502
+ 0.939060628414154,
503
+ 0.9419177174568176,
504
+ 0.9447172284126282,
505
+ 0.832027792930603,
506
+ 0.8410623073577881,
507
+ 0.8446363210678101,
508
+ 0.8582950830459595,
509
+ 0.863196611404419,
510
+ 0.8675134181976318,
511
+ 0.8691433668136597,
512
+ 0.8708592057228088,
513
+ 0.8728635907173157,
514
+ 0.8753739595413208,
515
+ 0.8793113827705383,
516
+ 0.8805447816848755,
517
+ 0.8811838030815125,
518
+ 0.8887255787849426,
519
+ 0.889424741268158,
520
+ 0.8893482685089111,
521
+ 0.440253347158432,
522
+ 0.6306161284446716,
523
+ 0.6311061382293701,
524
+ 0.6360195875167847,
525
+ 0.6395812034606934,
526
+ 0.6410434246063232,
527
+ 0.650199294090271,
528
+ 0.650279700756073,
529
+ 0.643559455871582,
530
+ 0.6465720534324646,
531
+ 0.648470938205719,
532
+ 0.6472811698913574,
533
+ 0.6497294306755066,
534
+ 0.6516297459602356,
535
+ 0.6532804369926453,
536
+ 0.6491477489471436
537
+ ],
538
+ "num_layers": 2,
539
+ "out_channels": 3,
540
+ "patch_size": 4,
541
+ "patch_type": "haar",
542
+ "resolution": 1024,
543
+ "scaling_factor": 1.0,
544
+ "spatial_compression_ratio": 8,
545
+ "temporal_compression_ratio": 8
546
+ }
vae/diffusion_pytorch_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fffb93facffb9d20375c5ee33022c08540e0e3a10787f883410574eb7227fe7
3
+ size 1004736