JunJiang commited on
Commit
ffff367
·
verified ·
1 Parent(s): 1600f32

Add files using upload-large-folder tool

Browse files
LICENSE ADDED
@@ -0,0 +1,415 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ CSI-MAE License Notice
3
+
4
+ Copyright (c) 2026 GREAT contributors.
5
+
6
+ This repository is released for research and other non-commercial use
7
+ only under the Creative Commons Attribution-NonCommercial 4.0
8
+ International Public License below. Commercial use is not permitted
9
+ without prior written permission from the copyright holders.
10
+
11
+ Portions of this repository are adapted from the public MAE
12
+ implementation at https://github.com/facebookresearch/mae. Original
13
+ attribution notices are retained in source files where applicable.
14
+
15
+ =======================================================================
16
+
17
+ Attribution-NonCommercial 4.0 International
18
+
19
+ =======================================================================
20
+
21
+ Creative Commons Corporation ("Creative Commons") is not a law firm and
22
+ does not provide legal services or legal advice. Distribution of
23
+ Creative Commons public licenses does not create a lawyer-client or
24
+ other relationship. Creative Commons makes its licenses and related
25
+ information available on an "as-is" basis. Creative Commons gives no
26
+ warranties regarding its licenses, any material licensed under their
27
+ terms and conditions, or any related information. Creative Commons
28
+ disclaims all liability for damages resulting from their use to the
29
+ fullest extent possible.
30
+
31
+ Using Creative Commons Public Licenses
32
+
33
+ Creative Commons public licenses provide a standard set of terms and
34
+ conditions that creators and other rights holders may use to share
35
+ original works of authorship and other material subject to copyright
36
+ and certain other rights specified in the public license below. The
37
+ following considerations are for informational purposes only, are not
38
+ exhaustive, and do not form part of our licenses.
39
+
40
+ Considerations for licensors: Our public licenses are
41
+ intended for use by those authorized to give the public
42
+ permission to use material in ways otherwise restricted by
43
+ copyright and certain other rights. Our licenses are
44
+ irrevocable. Licensors should read and understand the terms
45
+ and conditions of the license they choose before applying it.
46
+ Licensors should also secure all rights necessary before
47
+ applying our licenses so that the public can reuse the
48
+ material as expected. Licensors should clearly mark any
49
+ material not subject to the license. This includes other CC-
50
+ licensed material, or material used under an exception or
51
+ limitation to copyright. More considerations for licensors:
52
+ wiki.creativecommons.org/Considerations_for_licensors
53
+
54
+ Considerations for the public: By using one of our public
55
+ licenses, a licensor grants the public permission to use the
56
+ licensed material under specified terms and conditions. If
57
+ the licensor's permission is not necessary for any reason--for
58
+ example, because of any applicable exception or limitation to
59
+ copyright--then that use is not regulated by the license. Our
60
+ licenses grant only permissions under copyright and certain
61
+ other rights that a licensor has authority to grant. Use of
62
+ the licensed material may still be restricted for other
63
+ reasons, including because others have copyright or other
64
+ rights in the material. A licensor may make special requests,
65
+ such as asking that all changes be marked or described.
66
+ Although not required by our licenses, you are encouraged to
67
+ respect those requests where reasonable. More_considerations
68
+ for the public:
69
+ wiki.creativecommons.org/Considerations_for_licensees
70
+
71
+ =======================================================================
72
+
73
+ Creative Commons Attribution-NonCommercial 4.0 International Public
74
+ License
75
+
76
+ By exercising the Licensed Rights (defined below), You accept and agree
77
+ to be bound by the terms and conditions of this Creative Commons
78
+ Attribution-NonCommercial 4.0 International Public License ("Public
79
+ License"). To the extent this Public License may be interpreted as a
80
+ contract, You are granted the Licensed Rights in consideration of Your
81
+ acceptance of these terms and conditions, and the Licensor grants You
82
+ such rights in consideration of benefits the Licensor receives from
83
+ making the Licensed Material available under these terms and
84
+ conditions.
85
+
86
+ Section 1 -- Definitions.
87
+
88
+ a. Adapted Material means material subject to Copyright and Similar
89
+ Rights that is derived from or based upon the Licensed Material
90
+ and in which the Licensed Material is translated, altered,
91
+ arranged, transformed, or otherwise modified in a manner requiring
92
+ permission under the Copyright and Similar Rights held by the
93
+ Licensor. For purposes of this Public License, where the Licensed
94
+ Material is a musical work, performance, or sound recording,
95
+ Adapted Material is always produced where the Licensed Material is
96
+ synched in timed relation with a moving image.
97
+
98
+ b. Adapter's License means the license You apply to Your Copyright
99
+ and Similar Rights in Your contributions to Adapted Material in
100
+ accordance with the terms and conditions of this Public License.
101
+
102
+ c. Copyright and Similar Rights means copyright and/or similar rights
103
+ closely related to copyright including, without limitation,
104
+ performance, broadcast, sound recording, and Sui Generis Database
105
+ Rights, without regard to how the rights are labeled or
106
+ categorized. For purposes of this Public License, the rights
107
+ specified in Section 2(b)(1)-(2) are not Copyright and Similar
108
+ Rights.
109
+ d. Effective Technological Measures means those measures that, in the
110
+ absence of proper authority, may not be circumvented under laws
111
+ fulfilling obligations under Article 11 of the WIPO Copyright
112
+ Treaty adopted on December 20, 1996, and/or similar international
113
+ agreements.
114
+
115
+ e. Exceptions and Limitations means fair use, fair dealing, and/or
116
+ any other exception or limitation to Copyright and Similar Rights
117
+ that applies to Your use of the Licensed Material.
118
+
119
+ f. Licensed Material means the artistic or literary work, database,
120
+ or other material to which the Licensor applied this Public
121
+ License.
122
+
123
+ g. Licensed Rights means the rights granted to You subject to the
124
+ terms and conditions of this Public License, which are limited to
125
+ all Copyright and Similar Rights that apply to Your use of the
126
+ Licensed Material and that the Licensor has authority to license.
127
+
128
+ h. Licensor means the individual(s) or entity(ies) granting rights
129
+ under this Public License.
130
+
131
+ i. NonCommercial means not primarily intended for or directed towards
132
+ commercial advantage or monetary compensation. For purposes of
133
+ this Public License, the exchange of the Licensed Material for
134
+ other material subject to Copyright and Similar Rights by digital
135
+ file-sharing or similar means is NonCommercial provided there is
136
+ no payment of monetary compensation in connection with the
137
+ exchange.
138
+
139
+ j. Share means to provide material to the public by any means or
140
+ process that requires permission under the Licensed Rights, such
141
+ as reproduction, public display, public performance, distribution,
142
+ dissemination, communication, or importation, and to make material
143
+ available to the public including in ways that members of the
144
+ public may access the material from a place and at a time
145
+ individually chosen by them.
146
+
147
+ k. Sui Generis Database Rights means rights other than copyright
148
+ resulting from Directive 96/9/EC of the European Parliament and of
149
+ the Council of 11 March 1996 on the legal protection of databases,
150
+ as amended and/or succeeded, as well as other essentially
151
+ equivalent rights anywhere in the world.
152
+
153
+ l. You means the individual or entity exercising the Licensed Rights
154
+ under this Public License. Your has a corresponding meaning.
155
+
156
+ Section 2 -- Scope.
157
+
158
+ a. License grant.
159
+
160
+ 1. Subject to the terms and conditions of this Public License,
161
+ the Licensor hereby grants You a worldwide, royalty-free,
162
+ non-sublicensable, non-exclusive, irrevocable license to
163
+ exercise the Licensed Rights in the Licensed Material to:
164
+
165
+ a. reproduce and Share the Licensed Material, in whole or
166
+ in part, for NonCommercial purposes only; and
167
+
168
+ b. produce, reproduce, and Share Adapted Material for
169
+ NonCommercial purposes only.
170
+
171
+ 2. Exceptions and Limitations. For the avoidance of doubt, where
172
+ Exceptions and Limitations apply to Your use, this Public
173
+ License does not apply, and You do not need to comply with
174
+ its terms and conditions.
175
+
176
+ 3. Term. The term of this Public License is specified in Section
177
+ 6(a).
178
+
179
+ 4. Media and formats; technical modifications allowed. The
180
+ Licensor authorizes You to exercise the Licensed Rights in
181
+ all media and formats whether now known or hereafter created,
182
+ and to make technical modifications necessary to do so. The
183
+ Licensor waives and/or agrees not to assert any right or
184
+ authority to forbid You from making technical modifications
185
+ necessary to exercise the Licensed Rights, including
186
+ technical modifications necessary to circumvent Effective
187
+ Technological Measures. For purposes of this Public License,
188
+ simply making modifications authorized by this Section 2(a)
189
+ (4) never produces Adapted Material.
190
+
191
+ 5. Downstream recipients.
192
+
193
+ a. Offer from the Licensor -- Licensed Material. Every
194
+ recipient of the Licensed Material automatically
195
+ receives an offer from the Licensor to exercise the
196
+ Licensed Rights under the terms and conditions of this
197
+ Public License.
198
+
199
+ b. No downstream restrictions. You may not offer or impose
200
+ any additional or different terms or conditions on, or
201
+ apply any Effective Technological Measures to, the
202
+ Licensed Material if doing so restricts exercise of the
203
+ Licensed Rights by any recipient of the Licensed
204
+ Material.
205
+
206
+ 6. No endorsement. Nothing in this Public License constitutes or
207
+ may be construed as permission to assert or imply that You
208
+ are, or that Your use of the Licensed Material is, connected
209
+ with, or sponsored, endorsed, or granted official status by,
210
+ the Licensor or others designated to receive attribution as
211
+ provided in Section 3(a)(1)(A)(i).
212
+
213
+ b. Other rights.
214
+
215
+ 1. Moral rights, such as the right of integrity, are not
216
+ licensed under this Public License, nor are publicity,
217
+ privacy, and/or other similar personality rights; however, to
218
+ the extent possible, the Licensor waives and/or agrees not to
219
+ assert any such rights held by the Licensor to the limited
220
+ extent necessary to allow You to exercise the Licensed
221
+ Rights, but not otherwise.
222
+
223
+ 2. Patent and trademark rights are not licensed under this
224
+ Public License.
225
+
226
+ 3. To the extent possible, the Licensor waives any right to
227
+ collect royalties from You for the exercise of the Licensed
228
+ Rights, whether directly or through a collecting society
229
+ under any voluntary or waivable statutory or compulsory
230
+ licensing scheme. In all other cases the Licensor expressly
231
+ reserves any right to collect such royalties, including when
232
+ the Licensed Material is used other than for NonCommercial
233
+ purposes.
234
+
235
+ Section 3 -- License Conditions.
236
+
237
+ Your exercise of the Licensed Rights is expressly made subject to the
238
+ following conditions.
239
+
240
+ a. Attribution.
241
+
242
+ 1. If You Share the Licensed Material (including in modified
243
+ form), You must:
244
+
245
+ a. retain the following if it is supplied by the Licensor
246
+ with the Licensed Material:
247
+
248
+ i. identification of the creator(s) of the Licensed
249
+ Material and any others designated to receive
250
+ attribution, in any reasonable manner requested by
251
+ the Licensor (including by pseudonym if
252
+ designated);
253
+
254
+ ii. a copyright notice;
255
+
256
+ iii. a notice that refers to this Public License;
257
+
258
+ iv. a notice that refers to the disclaimer of
259
+ warranties;
260
+
261
+ v. a URI or hyperlink to the Licensed Material to the
262
+ extent reasonably practicable;
263
+
264
+ b. indicate if You modified the Licensed Material and
265
+ retain an indication of any previous modifications; and
266
+
267
+ c. indicate the Licensed Material is licensed under this
268
+ Public License, and include the text of, or the URI or
269
+ hyperlink to, this Public License.
270
+
271
+ 2. You may satisfy the conditions in Section 3(a)(1) in any
272
+ reasonable manner based on the medium, means, and context in
273
+ which You Share the Licensed Material. For example, it may be
274
+ reasonable to satisfy the conditions by providing a URI or
275
+ hyperlink to a resource that includes the required
276
+ information.
277
+
278
+ 3. If requested by the Licensor, You must remove any of the
279
+ information required by Section 3(a)(1)(A) to the extent
280
+ reasonably practicable.
281
+
282
+ 4. If You Share Adapted Material You produce, the Adapter's
283
+ License You apply must not prevent recipients of the Adapted
284
+ Material from complying with this Public License.
285
+
286
+ Section 4 -- Sui Generis Database Rights.
287
+
288
+ Where the Licensed Rights include Sui Generis Database Rights that
289
+ apply to Your use of the Licensed Material:
290
+
291
+ a. for the avoidance of doubt, Section 2(a)(1) grants You the right
292
+ to extract, reuse, reproduce, and Share all or a substantial
293
+ portion of the contents of the database for NonCommercial purposes
294
+ only;
295
+
296
+ b. if You include all or a substantial portion of the database
297
+ contents in a database in which You have Sui Generis Database
298
+ Rights, then the database in which You have Sui Generis Database
299
+ Rights (but not its individual contents) is Adapted Material; and
300
+
301
+ c. You must comply with the conditions in Section 3(a) if You Share
302
+ all or a substantial portion of the contents of the database.
303
+
304
+ For the avoidance of doubt, this Section 4 supplements and does not
305
+ replace Your obligations under this Public License where the Licensed
306
+ Rights include other Copyright and Similar Rights.
307
+
308
+ Section 5 -- Disclaimer of Warranties and Limitation of Liability.
309
+
310
+ a. UNLESS OTHERWISE SEPARATELY UNDERTAKEN BY THE LICENSOR, TO THE
311
+ EXTENT POSSIBLE, THE LICENSOR OFFERS THE LICENSED MATERIAL AS-IS
312
+ AND AS-AVAILABLE, AND MAKES NO REPRESENTATIONS OR WARRANTIES OF
313
+ ANY KIND CONCERNING THE LICENSED MATERIAL, WHETHER EXPRESS,
314
+ IMPLIED, STATUTORY, OR OTHER. THIS INCLUDES, WITHOUT LIMITATION,
315
+ WARRANTIES OF TITLE, MERCHANTABILITY, FITNESS FOR A PARTICULAR
316
+ PURPOSE, NON-INFRINGEMENT, ABSENCE OF LATENT OR OTHER DEFECTS,
317
+ ACCURACY, OR THE PRESENCE OR ABSENCE OF ERRORS, WHETHER OR NOT
318
+ KNOWN OR DISCOVERABLE. WHERE DISCLAIMERS OF WARRANTIES ARE NOT
319
+ ALLOWED IN FULL OR IN PART, THIS DISCLAIMER MAY NOT APPLY TO YOU.
320
+
321
+ b. TO THE EXTENT POSSIBLE, IN NO EVENT WILL THE LICENSOR BE LIABLE
322
+ TO YOU ON ANY LEGAL THEORY (INCLUDING, WITHOUT LIMITATION,
323
+ NEGLIGENCE) OR OTHERWISE FOR ANY DIRECT, SPECIAL, INDIRECT,
324
+ INCIDENTAL, CONSEQUENTIAL, PUNITIVE, EXEMPLARY, OR OTHER LOSSES,
325
+ COSTS, EXPENSES, OR DAMAGES ARISING OUT OF THIS PUBLIC LICENSE OR
326
+ USE OF THE LICENSED MATERIAL, EVEN IF THE LICENSOR HAS BEEN
327
+ ADVISED OF THE POSSIBILITY OF SUCH LOSSES, COSTS, EXPENSES, OR
328
+ DAMAGES. WHERE A LIMITATION OF LIABILITY IS NOT ALLOWED IN FULL OR
329
+ IN PART, THIS LIMITATION MAY NOT APPLY TO YOU.
330
+
331
+ c. The disclaimer of warranties and limitation of liability provided
332
+ above shall be interpreted in a manner that, to the extent
333
+ possible, most closely approximates an absolute disclaimer and
334
+ waiver of all liability.
335
+
336
+ Section 6 -- Term and Termination.
337
+
338
+ a. This Public License applies for the term of the Copyright and
339
+ Similar Rights licensed here. However, if You fail to comply with
340
+ this Public License, then Your rights under this Public License
341
+ terminate automatically.
342
+
343
+ b. Where Your right to use the Licensed Material has terminated under
344
+ Section 6(a), it reinstates:
345
+
346
+ 1. automatically as of the date the violation is cured, provided
347
+ it is cured within 30 days of Your discovery of the
348
+ violation; or
349
+
350
+ 2. upon express reinstatement by the Licensor.
351
+
352
+ For the avoidance of doubt, this Section 6(b) does not affect any
353
+ right the Licensor may have to seek remedies for Your violations
354
+ of this Public License.
355
+
356
+ c. For the avoidance of doubt, the Licensor may also offer the
357
+ Licensed Material under separate terms or conditions or stop
358
+ distributing the Licensed Material at any time; however, doing so
359
+ will not terminate this Public License.
360
+
361
+ d. Sections 1, 5, 6, 7, and 8 survive termination of this Public
362
+ License.
363
+
364
+ Section 7 -- Other Terms and Conditions.
365
+
366
+ a. The Licensor shall not be bound by any additional or different
367
+ terms or conditions communicated by You unless expressly agreed.
368
+
369
+ b. Any arrangements, understandings, or agreements regarding the
370
+ Licensed Material not stated herein are separate from and
371
+ independent of the terms and conditions of this Public License.
372
+
373
+ Section 8 -- Interpretation.
374
+
375
+ a. For the avoidance of doubt, this Public License does not, and
376
+ shall not be interpreted to, reduce, limit, restrict, or impose
377
+ conditions on any use of the Licensed Material that could lawfully
378
+ be made without permission under this Public License.
379
+
380
+ b. To the extent possible, if any provision of this Public License is
381
+ deemed unenforceable, it shall be automatically reformed to the
382
+ minimum extent necessary to make it enforceable. If the provision
383
+ cannot be reformed, it shall be severed from this Public License
384
+ without affecting the enforceability of the remaining terms and
385
+ conditions.
386
+
387
+ c. No term or condition of this Public License will be waived and no
388
+ failure to comply consented to unless expressly agreed to by the
389
+ Licensor.
390
+
391
+ d. Nothing in this Public License constitutes or may be interpreted
392
+ as a limitation upon, or waiver of, any privileges and immunities
393
+ that apply to the Licensor or You, including from the legal
394
+ processes of any jurisdiction or authority.
395
+
396
+ =======================================================================
397
+
398
+ Creative Commons is not a party to its public
399
+ licenses. Notwithstanding, Creative Commons may elect to apply one of
400
+ its public licenses to material it publishes and in those instances
401
+ will be considered the “Licensor.” The text of the Creative Commons
402
+ public licenses is dedicated to the public domain under the CC0 Public
403
+ Domain Dedication. Except for the limited purpose of indicating that
404
+ material is shared under a Creative Commons public license or as
405
+ otherwise permitted by the Creative Commons policies published at
406
+ creativecommons.org/policies, Creative Commons does not authorize the
407
+ use of the trademark "Creative Commons" or any other trademark or logo
408
+ of Creative Commons without its prior written consent including,
409
+ without limitation, in connection with any unauthorized modifications
410
+ to any of its public licenses or any other arrangements,
411
+ understandings, or agreements concerning use of licensed material. For
412
+ the avoidance of doubt, this paragraph does not form part of the
413
+ public licenses.
414
+
415
+ Creative Commons may be contacted at creativecommons.org.
README.md CHANGED
@@ -1,3 +1,169 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ library_name: pytorch
4
+ pipeline_tag: feature-extraction
5
+ tags:
6
+ - wireless
7
+ - channel-state-information
8
+ - channel-foundation-model
9
+ - masked-autoencoder
10
+ - vision-transformer
11
  ---
12
+
13
+ # CSI-MAE ViT-Base/16 and ViT-Large/16
14
+
15
+ CSI-MAE is a masked-autoencoder channel foundation model that learns reusable
16
+ CSI representations through masked channel reconstruction. This repository
17
+ contains the official model-only ViT-Base/16 and ViT-Large/16 pre-training
18
+ weights associated
19
+ with [*CSI-MAE: A Masked Autoencoder-based Channel Foundation Model*](https://arxiv.org/abs/2601.03789).
20
+
21
+ - Code: [GREAT-ISAC/CSI-MAE](https://github.com/GREAT-ISAC/CSI-MAE)
22
+
23
+ Released by **[GREAT Wireless AI](https://github.com/GREAT-ISAC)**. The
24
+ `GREAT-ISAC` GitHub handle is retained for continuity with existing papers and
25
+ community links.
26
+ - Paper: [arXiv:2601.03789](https://arxiv.org/abs/2601.03789)
27
+
28
+ ## Weight files
29
+
30
+ The release contains epoch-300 Base and Large checkpoints pretrained on the
31
+ simulated Sionna/3GPP channel corpus. These are not the separate DeepMIMO
32
+ experimental checkpoints. None of the files contains an optimizer, AMP scaler,
33
+ epoch/resume state, training data, or a downstream task head.
34
+
35
+ | File | Type | Intended use |
36
+ | --- | --- | --- |
37
+ | `csi-mae-base.safetensors` | Base model-only pre-trained weights | Recommended Base weight for safe standalone loading and feature extraction |
38
+ | `csi-mae-base.pth` | Base model-only PyTorch checkpoint with a `model` key | Base compatibility weight for existing scripts |
39
+ | `csi-mae-large.safetensors` | Large model-only pre-trained weights | Recommended Large weight for safe standalone loading and feature extraction |
40
+ | `csi-mae-large.pth` | Large model-only PyTorch checkpoint with a `model` key | Large compatibility weight for existing scripts |
41
+
42
+ These are foundation-model pre-training weights, not final checkpoints for
43
+ positioning, channel feedback, or channel extrapolation. The corresponding
44
+ downstream architecture must be initialized from these weights and then
45
+ adapted or fine-tuned. Exact SHA-256 values are recorded in `manifest.json`.
46
+
47
+ ## Model and input contract
48
+
49
+ | Property | Value |
50
+ | --- | --- |
51
+ | Architecture | MAE ViT-Base/16 or ViT-Large/16 |
52
+ | Input shape | `[batch, 2, 256, 256]` |
53
+ | Channel order | Real, imaginary |
54
+ | Dtype | `float32` |
55
+ | Pre-training channel mean | `[-5.5445e-10, -5.5445e-10]` |
56
+ | Pre-training channel variance | `[5.7916e-10, 5.7916e-10]` |
57
+ | Normalization | Channel-wise standardization using the fixed statistics above |
58
+ | Patch size | 16 |
59
+ | Pre-training mask ratio | 0.75 |
60
+ | Normalized pixel loss | Enabled |
61
+
62
+ The same preprocessing must be used during training, fine-tuning, and
63
+ inference. The implementation in `dataset.py` is authoritative.
64
+
65
+ Because normalized-pixel loss was enabled during pre-training, the decoder's
66
+ patch predictions are normalized reconstruction targets. The loading example
67
+ is therefore a forward/reconstruction smoke test, not recovery of CSI in its
68
+ original physical scale. Physical-scale reconstruction additionally requires
69
+ unpatchifying and applying the appropriate inverse patch and sample
70
+ normalization.
71
+
72
+ ## Usage
73
+
74
+ Install the code and its minimal dependencies. CSI-MAE requires the pinned
75
+ `timm==0.3.2`; newer `timm` releases remove the `qk_scale` API used by the
76
+ released implementation.
77
+
78
+ ```bash
79
+ git clone https://github.com/GREAT-ISAC/CSI-MAE.git
80
+ cd CSI-MAE
81
+ pip install -r requirements.txt
82
+ ```
83
+
84
+ After downloading a weight, run the strict loading and forward smoke test. The
85
+ `--model` value must match the selected checkpoint:
86
+
87
+ ```bash
88
+ python load_pretrained.py \
89
+ --model base \
90
+ --checkpoint /path/to/csi-mae-base.safetensors
91
+ ```
92
+
93
+ Expected output includes:
94
+
95
+ ```text
96
+ Reconstruction shape: (1, 256, 512)
97
+ Mask shape: (1, 256)
98
+ ```
99
+
100
+ Run the same check on a complex `cfr.npy` sample:
101
+
102
+ ```bash
103
+ python load_pretrained.py \
104
+ --model large \
105
+ --checkpoint /path/to/csi-mae-large.safetensors \
106
+ --input /path/to/scenario/cfr.npy \
107
+ --sample-index 0
108
+ ```
109
+
110
+ ## Training data
111
+
112
+ The Base and Large models were pre-trained on simulated Sionna/3GPP CSI. The
113
+ separate DeepMIMO experiments are not the source of these published weights.
114
+ Generated training arrays are not included in this model repository. A
115
+ **reproducible data-generation pipeline** will be released separately with the
116
+ simulator configuration, preprocessing, normalization statistics, and split
117
+ definitions.
118
+
119
+ ## Intended use
120
+
121
+ - Research on wireless/channel foundation models.
122
+ - Masked CSI representation learning and reconstruction studies.
123
+ - Initialization for positioning, channel feedback, and channel extrapolation.
124
+ - Non-commercial evaluation and reproducibility studies.
125
+
126
+ ## Limitations and out-of-scope use
127
+
128
+ - The model was trained on simulated data; performance on measured channels is
129
+ not guaranteed.
130
+ - The public architecture assumes two-channel `256 x 256` inputs. Other antenna
131
+ or subcarrier layouts require an explicitly validated adaptation.
132
+ - Decoder outputs are not physical-scale complex CSI without the documented
133
+ inverse-processing steps.
134
+ - The released weights do not provide final downstream predictions without
135
+ adaptation or fine-tuning.
136
+ - The model is not intended for safety-critical deployment or commercial use.
137
+
138
+ ## License
139
+
140
+ The original CSI-MAE code, these model weights, and the accompanying original
141
+ data-generation scripts are released under the
142
+ [Creative Commons Attribution-NonCommercial 4.0 International](https://creativecommons.org/licenses/by-nc/4.0/)
143
+ license (**CC BY-NC 4.0**). Attribution is required and commercial use is not
144
+ permitted without prior written authorization from the copyright holders.
145
+ Third-party software, simulators, datasets, and scenario assets remain subject
146
+ to their respective licenses.
147
+
148
+ ## Citation
149
+
150
+ ```bibtex
151
+ @article{jiang2026csimae,
152
+ title={CSI-MAE: A Masked Autoencoder-based Channel Foundation Model},
153
+ author={Jiang, Jun and Ruan, Xiaolong and Xu, Shugong},
154
+ journal={arXiv preprint arXiv:2601.03789},
155
+ year={2026}
156
+ }
157
+ ```
158
+
159
+ ## Acknowledgement
160
+
161
+ CSI-MAE is adapted from the public
162
+ [Masked Autoencoders](https://github.com/facebookresearch/mae)
163
+ implementation. The original attribution notices are retained in the source
164
+ repository.
165
+
166
+ ## Contact
167
+
168
+ For questions, contact Jun Jiang at
169
+ [Jun.Jiang25@student.xjtlu.edu.cn](mailto:Jun.Jiang25@student.xjtlu.edu.cn).
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": {
3
+ "base": "mae_vit_base_patch16",
4
+ "large": "mae_vit_large_patch16"
5
+ },
6
+ "input_channels": 2,
7
+ "input_size": [
8
+ 256,
9
+ 256
10
+ ],
11
+ "mask_ratio": 0.75,
12
+ "norm_pix_loss": true,
13
+ "normalization": {
14
+ "mean": [
15
+ -5.5445e-10,
16
+ -5.5445e-10
17
+ ],
18
+ "type": "channel-wise standardization",
19
+ "variance": [
20
+ 5.7916e-10,
21
+ 5.7916e-10
22
+ ]
23
+ },
24
+ "patch_size": 16,
25
+ "source_domain": "Sionna/3GPP simulated channel corpus"
26
+ }
csi-mae-base.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1ac1b2cddd4cd41b7edc0970a34e34668d48dec26c73be4feec68ccde846694
3
+ size 446705111
csi-mae-base.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db7ad83987ae7f8a5f0b42da9ba1749f792a27aa37356c2f5ba94aaa09f44a46
3
+ size 446651400
csi-mae-large.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c65dba88c94c584d42f7e3cdb3975840d8af273992f1a4f8352f7a4931b59f38
3
+ size 1317084827
csi-mae-large.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3ea94ead704488b410b1e86ceaa23f8c6446dfad93af24827715d453c915f25
3
+ size 1317001152
manifest.json ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": {
3
+ "base": "mae_vit_base_patch16",
4
+ "large": "mae_vit_large_patch16"
5
+ },
6
+ "contents": "model parameters only; no optimizer or scaler state",
7
+ "input_channels": 2,
8
+ "input_size": [
9
+ 256,
10
+ 256
11
+ ],
12
+ "mask_ratio": 0.75,
13
+ "name": "CSI-MAE",
14
+ "norm_pix_loss": true,
15
+ "normalization": {
16
+ "mean": [
17
+ -5.5445e-10,
18
+ -5.5445e-10
19
+ ],
20
+ "type": "channel-wise standardization",
21
+ "variance": [
22
+ 5.7916e-10,
23
+ 5.7916e-10
24
+ ]
25
+ },
26
+ "patch_size": 16,
27
+ "source_checkpoints": {
28
+ "base": {
29
+ "architecture": "mae_vit_base_patch16",
30
+ "epoch": 300,
31
+ "file": "checkpoint-300.pth",
32
+ "sha256": "74a0cad91298d689056ac36228c1dee4c380bc403eb3ad05ae726890b4589c31"
33
+ },
34
+ "large": {
35
+ "architecture": "mae_vit_large_patch16",
36
+ "epoch": 300,
37
+ "file": "checkpoint-300.pth",
38
+ "sha256": "b043e04b9963937b1a9c8ae01543bcb33ae2fb09de2a104a57d19ca73b4532f0"
39
+ }
40
+ },
41
+ "source_domain": "Sionna/3GPP simulated channel corpus",
42
+ "weight_files": {
43
+ "csi-mae-base.pth": {
44
+ "bytes": 446705111,
45
+ "format": "PyTorch checkpoint",
46
+ "recommended": false,
47
+ "sha256": "c1ac1b2cddd4cd41b7edc0970a34e34668d48dec26c73be4feec68ccde846694",
48
+ "variant": "base"
49
+ },
50
+ "csi-mae-base.safetensors": {
51
+ "bytes": 446651400,
52
+ "format": "safetensors",
53
+ "recommended": true,
54
+ "sha256": "db7ad83987ae7f8a5f0b42da9ba1749f792a27aa37356c2f5ba94aaa09f44a46",
55
+ "variant": "base"
56
+ },
57
+ "csi-mae-large.pth": {
58
+ "bytes": 1317084827,
59
+ "format": "PyTorch checkpoint",
60
+ "recommended": false,
61
+ "sha256": "c65dba88c94c584d42f7e3cdb3975840d8af273992f1a4f8352f7a4931b59f38",
62
+ "variant": "large"
63
+ },
64
+ "csi-mae-large.safetensors": {
65
+ "bytes": 1317001152,
66
+ "format": "safetensors",
67
+ "recommended": true,
68
+ "sha256": "d3ea94ead704488b410b1e86ceaa23f8c6446dfad93af24827715d453c915f25",
69
+ "variant": "large"
70
+ }
71
+ }
72
+ }