Fill-Mask
PyTorch
ribospan
biology
rna
genomics
transcriptomics
foundation-model
masked-language-model
Ziyuan-Wang commited on
Commit
eca4a09
·
verified ·
1 Parent(s): 2100047

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. LICENSE +732 -0
  2. README.md +61 -1
  3. config.json +26 -0
  4. generation_config.json +5 -0
  5. pytorch_model.bin +3 -0
LICENSE CHANGED
@@ -0,0 +1,732 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ RIBOSPAN NON-COMMERCIAL MODEL LICENSE
2
+ Version 1.0
3
+
4
+ Copyright © 2026 Shanghai Innovation Institute.
5
+ All rights reserved except as expressly granted under this License.
6
+
7
+ IMPORTANT NOTICE
8
+
9
+ This RIBOSPAN Non-Commercial Model License (the "License") governs the use of RIBOSPAN Model Materials made available by Shanghai Innovation Institute (the "Licensor").
10
+
11
+ By downloading, accessing where access is conditioned on acceptance, using, reproducing, modifying, fine-tuning, or distributing any RIBOSPAN Model Materials, you agree to be bound by this License.
12
+
13
+ If you accept this License on behalf of an organization or other legal entity, you represent that you have authority to bind that entity to this License.
14
+
15
+ If you do not agree to the terms of this License, you may not use the RIBOSPAN Model Materials.
16
+
17
+ This License applies only to RIBOSPAN model weights, checkpoints, and other model-specific materials expressly released under this License.
18
+
19
+ Source code separately released under the Apache License 2.0 is not governed by this License and remains subject to the Apache License 2.0.
20
+
21
+ 1. DEFINITIONS
22
+
23
+ 1.1 "RIBOSPAN Model Materials"
24
+
25
+ "RIBOSPAN Model Materials" or "Model Materials" means RIBOSPAN model weights, pretrained checkpoints, model parameters, model-specific configuration files, weight indexes, tokenizer assets distributed as part of a model release, and other model-specific materials expressly distributed by the Licensor under this License.
26
+
27
+ For clarity, source code separately released under the Apache License 2.0 is not included in the Model Materials.
28
+
29
+ 1.2 "Derivative Model"
30
+
31
+ "Derivative Model" means any model, checkpoint, or set of model parameters derived from, adapted from, or materially based on the RIBOSPAN Model Materials, including models produced through:
32
+
33
+ (a) fine-tuning;
34
+
35
+ (b) continued pretraining;
36
+
37
+ (c) parameter-efficient fine-tuning;
38
+
39
+ (d) adapters, LoRA, or similar parameter modifications;
40
+
41
+ (e) model merging;
42
+
43
+ (f) pruning;
44
+
45
+ (g) quantization;
46
+
47
+ (h) weight interpolation;
48
+
49
+ (i) model conversion; or
50
+
51
+ (j) any other modification or adaptation of the Model Materials.
52
+
53
+ A model that uses RIBOSPAN representations or Outputs as training data, features, supervision, or other inputs, without incorporating, reproducing, or modifying RIBOSPAN parameters, is not by that fact alone a Derivative Model. Such a model may constitute an Output-Derived Model under Section 1.5.
54
+
55
+ 1.3 "Output"
56
+
57
+ "Output" means information generated, inferred, or computed through use of the RIBOSPAN Model Materials, including, without limitation:
58
+
59
+ (a) nucleotide probabilities or scores;
60
+
61
+ (b) logits;
62
+
63
+ (c) embeddings;
64
+
65
+ (d) hidden representations;
66
+
67
+ (e) attention-related representations;
68
+
69
+ (f) annotations or predictions;
70
+
71
+ (g) variant scores;
72
+
73
+ (h) rankings or selections of nucleotide sequences or biological candidates;
74
+
75
+ (i) generated or optimized nucleotide sequences;
76
+
77
+ (j) candidate biological sequences or designs; and
78
+
79
+ (k) other representations, predictions, scores, rankings, selections, or model-generated results.
80
+
81
+ Data, sequences, molecules, designs, or other materials supplied by a user as input to RIBOSPAN do not become Outputs merely because they are processed, scored, embedded, ranked, predicted upon, or evaluated using RIBOSPAN.
82
+
83
+ 1.4 "Output Derivative"
84
+
85
+ "Output Derivative" means any sequence, molecule, design, dataset, representation, candidate, selection, prioritization, decision result, or other result materially generated, modified, optimized, developed, selected, prioritized, or created on the basis of one or more Outputs.
86
+
87
+ An independently owned user input does not become an Output Derivative merely because it is processed, scored, embedded, ranked, predicted upon, or evaluated using RIBOSPAN.
88
+
89
+ However, a selection, ranking, prioritization, modification, optimization, design decision, or development decision materially based on one or more RIBOSPAN Outputs may itself constitute an Output or Output Derivative and remains subject to the applicable restrictions of this License.
90
+
91
+ 1.5 "Output-Derived Model"
92
+
93
+ "Output-Derived Model" means any model, predictor, classifier, regressor, scoring system, representation model, or other machine-learning system materially trained, fine-tuned, optimized, calibrated, or otherwise developed using RIBOSPAN Outputs or representations, without incorporating, reproducing, or modifying RIBOSPAN parameters.
94
+
95
+ Examples include task-specific models materially trained or developed using RIBOSPAN embeddings, hidden representations, logits, scores, annotations, predictions, or other Outputs.
96
+
97
+ An Output-Derived Model is not a Derivative Model solely because it was developed using RIBOSPAN Outputs.
98
+
99
+ A general-purpose model intended to reproduce, substitute for, or materially replicate substantial RIBOSPAN capabilities remains subject to Section 5 regardless of whether it may otherwise qualify as an Output-Derived Model.
100
+
101
+ 1.6 "Separable Adaptation"
102
+
103
+ "Separable Adaptation" means a separately distributable task-specific adapter, LoRA parameter set, parameter-efficient fine-tuning module, task-specific head, or similar model component developed from or for use with RIBOSPAN Model Materials that does not include the underlying full RIBOSPAN checkpoint or a substantial portion of its parameters and cannot reasonably be used by itself to reconstruct, reproduce, or substitute for the underlying checkpoint.
104
+
105
+ A Separable Adaptation that is derived from, adapts, or modifies RIBOSPAN parameters may constitute a Derivative Model. The designation of a component as a Separable Adaptation does not exempt it from any otherwise applicable requirement of this License and affects distribution only to the extent expressly provided in Sections 10 and 11.
106
+
107
+ 1.7 "Restricted-Access Checkpoint"
108
+
109
+ "Restricted-Access Checkpoint" means any RIBOSPAN checkpoint that the Licensor designates as subject to access approval, access conditions, identity or affiliation verification, or another controlled distribution process.
110
+
111
+ A checkpoint may be designated as a Restricted-Access Checkpoint regardless of the technical platform, hosting service, application procedure, or distribution mechanism through which access is provided.
112
+
113
+ 1.8 "Non-Commercial Research Purpose"
114
+
115
+ "Non-Commercial Research Purpose" means use primarily for:
116
+
117
+ (a) academic or scientific research;
118
+
119
+ (b) education or teaching;
120
+
121
+ (c) model evaluation;
122
+
123
+ (d) benchmarking;
124
+
125
+ (e) reproducibility studies;
126
+
127
+ (f) experimentation; or
128
+
129
+ (g) scientific publication,
130
+
131
+ provided that such use is not intended for, directed toward, or materially supporting commercial advantage, revenue generation, commercial product development, commercial service provision, technology commercialization, or other commercial exploitation.
132
+
133
+ Research performed by an academic, educational, governmental, or non-profit organization is not automatically a Non-Commercial Research Purpose where the research is performed primarily for the commercial benefit of a for-profit entity or is materially directed toward the development, validation, optimization, regulatory advancement, or commercialization of a commercial product, service, platform, or technology.
134
+
135
+ 1.9 "Commercial Use"
136
+
137
+ "Commercial Use" means any use that is intended for, directed toward, or materially supports commercial advantage, revenue generation, commercial product development, commercial service provision, technology commercialization, commercial research or development, or other commercial exploitation.
138
+
139
+ Commercial Use includes the activities described in Section 3.
140
+
141
+ 2. LICENSE GRANT
142
+
143
+ Subject to continued compliance with this License, the Licensor grants you, under the intellectual property and other rights owned or controlled by the Licensor and embodied in or applicable to the RIBOSPAN Model Materials, a limited, worldwide, royalty-free, non-exclusive, non-transferable, and non-sublicensable license to:
144
+
145
+ (a) access and use the RIBOSPAN Model Materials for Non-Commercial Research Purposes;
146
+
147
+ (b) reproduce the Model Materials as reasonably necessary for such permitted use;
148
+
149
+ (c) create Derivative Models for Non-Commercial Research Purposes;
150
+
151
+ (d) generate, analyze, and use Outputs and Output Derivatives for Non-Commercial Research Purposes;
152
+
153
+ (e) develop Output-Derived Models for Non-Commercial Research Purposes; and
154
+
155
+ (f) publish scientific results obtained through permitted use of RIBOSPAN, including reasonable portions of Outputs necessary to describe, evaluate, or reproduce such research.
156
+
157
+ No rights are granted except those expressly stated in this License.
158
+
159
+ 3. COMMERCIAL USE
160
+
161
+ Commercial Use is not permitted under this License.
162
+
163
+ A separate written commercial license from the Licensor is required before the RIBOSPAN Model Materials, Derivative Models, Separable Adaptations, Output-Derived Models, Outputs, or Output Derivatives are used for Commercial Use.
164
+
165
+ Commercial Use includes, without limitation:
166
+
167
+ 3.1 Commercial Products and Services
168
+
169
+ Use in connection with any product, platform, technology, or service that is sold, licensed, subscribed to, monetized, or otherwise provided for commercial consideration.
170
+
171
+ 3.2 Hosted Models, APIs, and Analysis Services
172
+
173
+ Providing access to RIBOSPAN, a Derivative Model, a Separable Adaptation, an Output-Derived Model, or Outputs generated using any of them by means of:
174
+
175
+ (a) a commercial API;
176
+
177
+ (b) software-as-a-service;
178
+
179
+ (c) hosted inference;
180
+
181
+ (d) cloud services;
182
+
183
+ (e) paid analysis services;
184
+
185
+ (f) commercial sequence-scoring services;
186
+
187
+ (g) commercial embedding or representation services;
188
+
189
+ (h) commercial sequence-design or optimization services; or
190
+
191
+ (i) other commercial model-serving, prediction, analytical, or computational arrangements.
192
+
193
+ 3.3 Commercial Research and Development
194
+
195
+ Use by, on behalf of, or primarily for the benefit of a for-profit entity in research or development materially directed toward a current or future commercial product, service, platform, technology, development program, or commercially exploitable intellectual property.
196
+
197
+ 3.4 Sponsored Research, Contract Research, and Consulting
198
+
199
+ Research, development, consulting, testing, validation, optimization, or other work performed primarily for the commercial benefit of a third party, including work carried out under a commercial sponsorship, contract research agreement, service agreement, consulting agreement, or similar arrangement.
200
+
201
+ 3.5 Biotechnology and Life-Science Development
202
+
203
+ Use in the discovery, screening, scoring, selection, ranking, optimization, validation, development, manufacture, regulatory development, or commercialization of any of the following for commercial purposes:
204
+
205
+ (a) therapeutics;
206
+
207
+ (b) vaccines;
208
+
209
+ (c) diagnostics;
210
+
211
+ (d) RNA medicines;
212
+
213
+ (e) nucleic-acid products;
214
+
215
+ (f) biotechnology products;
216
+
217
+ (g) agricultural biotechnology products;
218
+
219
+ (h) industrial biotechnology products; or
220
+
221
+ (i) other biological products, technologies, or services.
222
+
223
+ 3.6 Commercial Exploitation of Model-Assisted Designs
224
+
225
+ Commercial exploitation of nucleotide sequences, biological molecules, candidate designs, optimized sequences, selected variants, or other biological or technological results where their selection, prioritization, optimization, modification, design, or development was materially enabled by or based on use of the RIBOSPAN Model Materials, a Derivative Model, a Separable Adaptation, an Output-Derived Model, or Outputs.
226
+
227
+ For clarity, this Section does not transfer ownership of independently owned user inputs or independently owned intellectual property to the Licensor.
228
+
229
+ 3.7 Commercial Use of Output-Derived Models
230
+
231
+ Commercial deployment, licensing, sale, distribution for commercial purposes, hosted use, or internal commercial use of an Output-Derived Model materially developed using RIBOSPAN Outputs or representations requires a separate written commercial license from the Licensor.
232
+
233
+ 3.8 Internal Commercial Use
234
+
235
+ Use of RIBOSPAN, a Derivative Model, a Separable Adaptation, an Output-Derived Model, Outputs, or Output Derivatives within an internal workflow of a commercial entity constitutes Commercial Use where such use materially supports:
236
+
237
+ (a) a commercial product;
238
+
239
+ (b) a commercial service;
240
+
241
+ (c) a commercial research or development program;
242
+
243
+ (d) commercial decision-making;
244
+
245
+ (e) intellectual-property generation directed toward commercial exploitation; or
246
+
247
+ (f) another revenue-generating or commercially strategic activity.
248
+
249
+ 4. DERIVATIVE MODELS
250
+
251
+ You may create Derivative Models solely for purposes permitted under this License.
252
+
253
+ Derivative Models remain subject to this License to the extent that their creation, use, modification, or distribution depends upon rights granted under this License.
254
+
255
+ Modification of the RIBOSPAN Model Materials does not grant any additional commercial rights.
256
+
257
+ You may not avoid or circumvent the restrictions of this License by fine-tuning, continued pretraining, quantizing, merging, converting, adapting, pruning, or otherwise modifying the Model Materials.
258
+
259
+ Subject to Sections 9, 10, and 11, Derivative Models and permitted Separable Adaptations may be modified, shared, and redistributed for Non-Commercial Research Purposes in accordance with this License.
260
+
261
+ Commercial Use of a Derivative Model or Separable Adaptation developed from the RIBOSPAN Model Materials requires a separate written commercial license from the Licensor.
262
+
263
+ 5. MODEL DISTILLATION, EXTRACTION, AND SUBSTITUTE MODELS
264
+
265
+ Except with prior written permission from the Licensor, you may not use the RIBOSPAN Model Materials, Derivative Models, Separable Adaptations, Output-Derived Models, Outputs, or Output Derivatives for any of the following activities.
266
+
267
+ 5.1 Model Distillation
268
+
269
+ You may not perform model distillation, imitation learning, teacher-student training, or substantially similar procedures intended to transfer substantial RIBOSPAN capabilities into another general-purpose model.
270
+
271
+ 5.2 Model Extraction
272
+
273
+ You may not systematically query, process, or evaluate RIBOSPAN for the purpose of extracting, reconstructing, approximating, or reproducing substantial capabilities or behavior of RIBOSPAN.
274
+
275
+ 5.3 Training Substitute Foundation Models
276
+
277
+ You may not systematically generate, collect, or curate RIBOSPAN Outputs or Output Derivatives for the purpose of training, pretraining, optimizing, or materially improving a general-purpose RNA foundation model or another model intended to reproduce or substitute for substantial capabilities of RIBOSPAN.
278
+
279
+ 5.4 Competing General-Purpose Models
280
+
281
+ You may not use the RIBOSPAN Model Materials, Derivative Models, Separable Adaptations, Output-Derived Models, Outputs, or Output Derivatives to create or materially improve a model intended to serve as a substantially similar general-purpose replacement for RIBOSPAN.
282
+
283
+ 5.5 Permitted Task-Specific Downstream Models
284
+
285
+ This Section does not prohibit the development of task-specific Derivative Models, Separable Adaptations, or Output-Derived Models for specialized Non-Commercial Research Purposes, including:
286
+
287
+ (a) classification;
288
+
289
+ (b) regression;
290
+
291
+ (c) functional annotation;
292
+
293
+ (d) structure prediction;
294
+
295
+ (e) localization prediction;
296
+
297
+ (f) sequence-property prediction;
298
+
299
+ (g) variant analysis; or
300
+
301
+ (h) other specialized scientific tasks,
302
+
303
+ provided that such models or adaptations are not intended to reproduce or substitute for RIBOSPAN as a general-purpose RNA foundation model and are otherwise used in compliance with this License.
304
+
305
+ 6. OUTPUTS, OUTPUT DERIVATIVES, AND OUTPUT-DERIVED MODELS
306
+
307
+ You may generate and use Outputs and Output Derivatives, and develop and use Output-Derived Models, for Non-Commercial Research Purposes.
308
+
309
+ Subject to Sections 10 and 11, Output-Derived Models may be modified, shared, and redistributed for Non-Commercial Research Purposes in accordance with this License.
310
+
311
+ Commercial Use of Outputs, Output Derivatives, or Output-Derived Models materially resulting from use of the RIBOSPAN Model Materials requires a separate written commercial license from the Licensor.
312
+
313
+ Examples include, without limitation, commercial use of:
314
+
315
+ (a) model-ranked RNA sequences;
316
+
317
+ (b) model-optimized nucleotide sequences;
318
+
319
+ (c) model-selected variants;
320
+
321
+ (d) model-assisted molecular or sequence designs;
322
+
323
+ (e) embeddings incorporated into commercial systems;
324
+
325
+ (f) sequence scores used in commercial research or decision-making;
326
+
327
+ (g) candidate molecules or sequences materially selected using RIBOSPAN;
328
+
329
+ (h) task-specific models materially trained or developed using RIBOSPAN embeddings, hidden representations, predictions, scores, or other Outputs; or
330
+
331
+ (i) other RIBOSPAN-assisted models, designs, selections, or decisions used in commercial development.
332
+
333
+ 7. USER INPUTS
334
+
335
+ You retain whatever rights you may have in data, sequences, molecules, designs, or other materials that you provide as input to RIBOSPAN.
336
+
337
+ Processing, embedding, scoring, predicting, ranking, or evaluating an input using RIBOSPAN does not, by itself, transfer ownership of that input to the Licensor.
338
+
339
+ An independently owned input does not become owned by the Licensor, nor does its underlying ownership change, merely because RIBOSPAN has processed it.
340
+
341
+ Nothing in this Section exempts the use of RIBOSPAN-generated scores, rankings, selections, embeddings, predictions, optimization results, or other Outputs from the restrictions of this License.
342
+
343
+ Where commercial selection, prioritization, optimization, modification, validation, or development of a user-owned input materially relies on RIBOSPAN Outputs, such use constitutes Commercial Use to the extent described in Section 3.
344
+
345
+ 8. INTELLECTUAL PROPERTY IN OUTPUTS
346
+
347
+ Nothing in this License determines whether copyright, patent, database, trade-secret, or other intellectual property rights arise in any particular Output, Output Derivative, Output-Derived Model, Derivative Model, or Separable Adaptation, or who owns such rights under applicable law.
348
+
349
+ The contractual restrictions imposed by this License apply independently of whether a particular Output, Output Derivative, Output-Derived Model, Derivative Model, or Separable Adaptation is eligible for copyright, patent, or other intellectual property protection.
350
+
351
+ Nothing in this License transfers ownership of independently owned user inputs, independently developed materials, or independently owned third-party intellectual property to the Licensor.
352
+
353
+ Nothing in this Section grants a user any rights in patents, trademarks, copyrights, trade secrets, datasets, biological materials, or other intellectual property owned or controlled by the Licensor except as expressly provided by this License.
354
+
355
+ 9. PUBLICLY RELEASED CHECKPOINTS
356
+
357
+ If the Licensor expressly designates a RIBOSPAN checkpoint as publicly available, you may access and use that checkpoint in accordance with this License.
358
+
359
+ You may redistribute an unmodified publicly released checkpoint for Non-Commercial Research Purposes only if:
360
+
361
+ (a) this License accompanies the redistributed Model Materials;
362
+
363
+ (b) all applicable copyright, attribution, and license notices are retained;
364
+
365
+ (c) no additional terms are imposed that conflict with this License;
366
+
367
+ (d) recipients are clearly informed that any use of the redistributed Model Materials is subject to this License and that their rights to use such Model Materials arise under this License, not through any assignment, transfer, or sublicense from the redistributor; and
368
+
369
+ (e) the redistributed copy is not presented in a manner that implies endorsement, sponsorship, certification, partnership, or official distribution by the Licensor.
370
+
371
+ Recipients of Model Materials redistributed in accordance with this Section may independently exercise the rights granted under this License, including creating and, where permitted by Sections 10 and 11, further modifying and redistributing Derivative Models or other permitted research adaptations for Non-Commercial Research Purposes.
372
+
373
+ 10. DISTRIBUTION AND LICENSING OF DERIVATIVE AND OUTPUT-DERIVED MODELS
374
+
375
+ 10.1 Distribution of Derivative Models from Publicly Released Checkpoints
376
+
377
+ A Derivative Model derived from one or more publicly released RIBOSPAN checkpoints, and not from any Restricted-Access Checkpoint, may be distributed for Non-Commercial Research Purposes only if:
378
+
379
+ (a) distribution has not otherwise been restricted by the Licensor;
380
+
381
+ (b) this License accompanies the Derivative Model or is clearly identified as governing any use, modification, or distribution of the Derivative Model that depends upon rights in the underlying RIBOSPAN Model Materials granted under this License;
382
+
383
+ (c) any use, modification, or distribution of the Derivative Model that depends upon rights granted under this License remains subject to this License;
384
+
385
+ (d) material modifications are clearly identified;
386
+
387
+ (e) required attribution is retained;
388
+
389
+ (f) recipients are clearly informed that any rights to use the underlying RIBOSPAN Model Materials arise under this License and not through any assignment, transfer, or sublicense from the distributor; and
390
+
391
+ (g) the Derivative Model is not distributed under terms that purport to authorize Commercial Use that would otherwise require separate authorization from the Licensor under this License.
392
+
393
+ A recipient of a Derivative Model distributed in compliance with this Section may use, modify, fine-tune, and further redistribute that Derivative Model for Non-Commercial Research Purposes, subject to this License and the requirements of this Section.
394
+
395
+ 10.2 Distribution of Output-Derived Models from Publicly Released Checkpoints
396
+
397
+ An Output-Derived Model materially developed using Outputs or representations generated solely from one or more publicly released RIBOSPAN checkpoints, and not using Outputs or representations from any Restricted-Access Checkpoint, may be distributed for Non-Commercial Research Purposes only if:
398
+
399
+ (a) such distribution is otherwise permitted under this License;
400
+
401
+ (b) the distributor clearly identifies that the model was materially developed using RIBOSPAN Outputs or representations;
402
+
403
+ (c) reasonable attribution to RIBOSPAN is provided;
404
+
405
+ (d) the distribution includes a copy of, or a clear reference to, this License, and access to or use of the Output-Derived Model is conditioned on the recipient's acceptance of the applicable terms of this License;
406
+
407
+ (e) recipients are clearly informed that distribution of the Output-Derived Model does not assign, transfer, or sublicense any rights granted under this License with respect to the RIBOSPAN Model Materials, Outputs, or representations;
408
+
409
+ (f) recipients are clearly informed that the distribution does not grant any right to engage in Commercial Use that requires separate authorization from the Licensor under this License; and
410
+
411
+ (g) the Output-Derived Model is not distributed under terms that purport to grant rights to engage in Commercial Use that requires separate authorization from the Licensor under this License.
412
+
413
+ A recipient of an Output-Derived Model distributed in compliance with this Section may use, modify, fine-tune, and further redistribute that Output-Derived Model for Non-Commercial Research Purposes, subject to this License and the requirements of this Section.
414
+
415
+ 10.3 Licensing of Independently Owned or Developed Components
416
+
417
+ Nothing in this License transfers ownership of independently developed or independently owned code, parameters, data, documentation, task-specific heads, model components, or other materials to the Licensor.
418
+
419
+ A distributor may separately license rights that the distributor owns or is otherwise authorized to license in independently developed or independently owned code, parameters, adapters, task-specific heads, data, documentation, model components, or other materials.
420
+
421
+ To the extent that any adapter, parameter set, task-specific head, or other component also constitutes or forms part of a Derivative Model, Output-Derived Model, or other material subject to this License, a separate license may govern only those rights that the distributor independently owns or is otherwise authorized to license and may not displace the requirements of this License.
422
+
423
+ Such separately licensed materials may be distributed under a license selected by the distributor, including a permissive open-source or other license, provided that the separate license:
424
+
425
+ (a) applies only to rights that the distributor owns or is otherwise authorized to license;
426
+
427
+ (b) does not supersede, modify, restrict, or replace this License with respect to rights governed by this License;
428
+
429
+ (c) does not purport to grant any right in the RIBOSPAN Model Materials that the distributor does not possess;
430
+
431
+ (d) does not purport to authorize Commercial Use that requires separate authorization from the Licensor under this License; and
432
+
433
+ (e) clearly preserves the applicability of this License to any use, modification, or distribution that depends upon rights granted under this License.
434
+
435
+ For clarity, the existence of a separate license governing independently owned or developed components does not remove or alter the restrictions applicable to the RIBOSPAN Model Materials, Derivative Models, Outputs, Output Derivatives, Output-Derived Models, or Separable Adaptations governed by this License.
436
+
437
+ Nothing in this Section prevents successive researchers from independently developing, modifying, sharing, or redistributing permitted Derivative Models, Separable Adaptations, or Output-Derived Models for Non-Commercial Research Purposes, provided that each such person or entity independently complies with this License.
438
+
439
+ 11. RESTRICTED-ACCESS CHECKPOINTS
440
+
441
+ A Restricted-Access Checkpoint is subject to the additional restrictions in this Section.
442
+
443
+ 11.1 No Redistribution
444
+
445
+ You may not redistribute, transfer, publish, mirror, upload, share, or otherwise provide a Restricted-Access Checkpoint to another person or legal entity without prior written permission from the Licensor.
446
+
447
+ 11.2 Independent Access Requirement
448
+
449
+ Each person or legal entity seeking access to a Restricted-Access Checkpoint must obtain access independently through an official distribution channel designated by the Licensor.
450
+
451
+ 11.3 No Access-Sharing
452
+
453
+ You may not share authentication tokens, accounts, credentials, private download links, access keys, or other access mechanisms that permit another person or legal entity to access a Restricted-Access Checkpoint.
454
+
455
+ 11.4 Models and Adaptations Developed from Restricted-Access Checkpoints
456
+
457
+ You may not distribute, without prior written permission from the Licensor, any full, merged, or otherwise self-contained Derivative Model created from or materially based on a Restricted-Access Checkpoint, including any full checkpoint produced through fine-tuning, continued pretraining, quantization, pruning, model conversion, model merging, or similar modification of a Restricted-Access Checkpoint. This restriction applies regardless of whether the parameters of the resulting Derivative Model are numerically identical to the parameters of the original Restricted-Access Checkpoint.
458
+
459
+ For Non-Commercial Research Purposes, you may distribute Separable Adaptations developed from a Restricted-Access Checkpoint, including task-specific adapters, LoRA parameters, parameter-efficient fine-tuning modules, task-specific heads, or similar separable components, provided that:
460
+
461
+ (a) the distributed materials do not include the underlying Restricted-Access Checkpoint or a substantial portion of its model parameters;
462
+
463
+ (b) the distributed materials cannot reasonably be used by themselves to reconstruct, reproduce, or substitute for the underlying Restricted-Access Checkpoint;
464
+
465
+ (c) where use of the distributed Separable Adaptation requires the underlying Restricted-Access Checkpoint, each recipient must obtain access to that checkpoint independently through an official distribution channel designated by the Licensor;
466
+
467
+ (d) the Separable Adaptation is intended for a specialized downstream task and is not intended to reproduce, approximate, substitute for, or materially replicate substantial general-purpose capabilities of RIBOSPAN;
468
+
469
+ (e) the distributor clearly identifies the Restricted-Access RIBOSPAN checkpoint from which the Separable Adaptation was developed;
470
+
471
+ (f) the distributor prominently states, in the model card, README, repository page, or other primary distribution documentation, that the underlying Restricted-Access Checkpoint is not provided with the Separable Adaptation and must be independently obtained from an official RIBOSPAN distribution channel designated by the Licensor, and provides a clear reference to the applicable RIBOSPAN checkpoint and this License;
472
+
473
+ (g) reasonable attribution to RIBOSPAN is provided;
474
+
475
+ (h) the distribution includes a copy of, or a clear reference to, this License, and recipients are clearly informed that use of the Separable Adaptation and access to and use of the underlying Restricted-Access Checkpoint remain subject to the applicable terms of this License;
476
+
477
+ (i) the distribution does not include substantial collections of Outputs prohibited under Section 11.5; and
478
+
479
+ (j) the distribution otherwise complies with this License.
480
+
481
+ For clarity, the preceding paragraph permits, for Non-Commercial Research Purposes, distribution of a task-specific package containing one or more permitted Separable Adaptations, such as LoRA parameters together with a task-specific prediction head, provided that the package satisfies the requirements above and does not contain the underlying Restricted-Access Checkpoint or a substantial portion of its parameters.
482
+
483
+ A task-specific Output-Derived Model materially developed using Outputs or representations from a Restricted-Access Checkpoint may also be distributed for Non-Commercial Research Purposes, provided that:
484
+
485
+ (a) the Output-Derived Model does not incorporate, reproduce, or contain parameters of the Restricted-Access Checkpoint;
486
+
487
+ (b) the Output-Derived Model is designed for a specialized downstream task and is not intended to reproduce, approximate, substitute for, or materially replicate substantial general-purpose capabilities of RIBOSPAN;
488
+
489
+ (c) the distribution does not include substantial collections of Outputs prohibited under Section 11.5;
490
+
491
+ (d) the distributor clearly identifies that the model was materially developed using Outputs or representations generated by a Restricted-Access RIBOSPAN checkpoint;
492
+
493
+ (e) reasonable attribution to RIBOSPAN is provided;
494
+
495
+ (f) the distribution includes a copy of, or a clear reference to, this License, and access to or use of the Output-Derived Model is conditioned on the recipient's acceptance of the applicable terms of this License;
496
+
497
+ (g) recipients are clearly informed that Commercial Use requires separate written authorization from the Licensor; and
498
+
499
+ (h) the distribution otherwise complies with this License.
500
+
501
+ Recipients of Separable Adaptations or Output-Derived Models distributed in compliance with this Section may use, modify, fine-tune, and further redistribute such materials for Non-Commercial Research Purposes, provided that:
502
+
503
+ (a) the resulting materials continue to satisfy the applicable requirements of this Section;
504
+
505
+ (b) no Restricted-Access Checkpoint, full or self-contained Derivative Model based on such checkpoint, or substantial portion of the underlying checkpoint's parameters is redistributed;
506
+
507
+ (c) any person or entity requiring the underlying Restricted-Access Checkpoint obtains access to it independently in accordance with Section 11.2; and
508
+
509
+ (d) the recipient otherwise complies with this License.
510
+
511
+ Nothing in this Section permits a recipient of a Separable Adaptation or Output-Derived Model to obtain, reconstruct, receive, or access the underlying Restricted-Access Checkpoint through another user's account, credentials, authentication token, private link, access key, or other access mechanism.
512
+
513
+ Commercial Use of any Derivative Model, Separable Adaptation, adapter, LoRA parameters, parameter-efficient fine-tuning module, task-specific head, Output-Derived Model, or other adaptation materially developed from or using a Restricted-Access Checkpoint requires a separate written commercial license from the Licensor.
514
+
515
+ 11.5 Systematic Distribution of Outputs
516
+
517
+ Except with prior written permission from the Licensor, you may not systematically publish, distribute, transfer, or otherwise make available substantial collections of Outputs generated using a Restricted-Access Checkpoint where such distribution would materially enable others to reproduce, approximate, substitute for, or bypass the access restrictions applicable to that checkpoint.
518
+
519
+ This Section does not restrict publication or distribution of reasonable portions of Outputs necessary to describe, evaluate, validate, or reproduce permitted Non-Commercial Research, including results reasonably necessary for scientific publications, benchmarks, supplementary materials, and research demonstrations.
520
+
521
+ 11.6 Security
522
+
523
+ You must take reasonable technical and organizational measures to prevent unauthorized access to or redistribution of Restricted-Access Checkpoints.
524
+
525
+ 12. ATTRIBUTION
526
+
527
+ Scientific publications, technical reports, public research demonstrations, and distributed Derivative Models, Separable Adaptations, or Output-Derived Models that materially use RIBOSPAN must provide reasonable attribution to RIBOSPAN.
528
+
529
+ Where the Licensor has identified an associated RIBOSPAN scientific publication, academic work making material use of RIBOSPAN must cite that publication.
530
+
531
+ Any permitted redistribution of RIBOSPAN Model Materials or Derivative Models must retain:
532
+
533
+ (a) this License or a clear reference to this License where expressly permitted under Section 10 or Section 11.4;
534
+
535
+ (b) applicable copyright notices; and
536
+
537
+ (c) attribution notices supplied with the original Model Materials.
538
+
539
+ Where an Output-Derived Model or Separable Adaptation is distributed as permitted under Section 10 or Section 11.4, the distributor must provide reasonable notice of the relevant RIBOSPAN checkpoint or RIBOSPAN Outputs or representations used in its development.
540
+
541
+ The following notice may be used:
542
+
543
+ "RIBOSPAN Model Materials are provided by Shanghai Innovation Institute under the RIBOSPAN Model Research & Non-Commercial License Agreement 1.0."
544
+
545
+ 13. TRADEMARKS AND PROJECT NAMES
546
+
547
+ This License does not grant any right to use the names, marks, logos, or branding of:
548
+
549
+ (a) Shanghai Innovation Institute;
550
+
551
+ (b) RIBOSPAN;
552
+
553
+ (c) RiboSpan; or
554
+
555
+ (d) associated organizations,
556
+
557
+ except as reasonably necessary for accurate factual attribution.
558
+
559
+ You may not use such names or marks in a manner that implies endorsement, sponsorship, certification, partnership, or affiliation without prior written permission from the relevant rights holder.
560
+
561
+ 14. RESERVATION OF RIGHTS
562
+
563
+ Except for the limited rights expressly granted in this License, the Licensor reserves all rights, title, and interest that it may hold in or relating to the RIBOSPAN Model Materials.
564
+
565
+ No right or license is granted by implication, estoppel, or otherwise.
566
+
567
+ Nothing in this License constitutes a waiver of any patent, copyright, trade-secret, contractual, trademark, database, or other right held by the Licensor.
568
+
569
+ 15. COMMERCIAL LICENSING
570
+
571
+ The Licensor may separately authorize Commercial Use under individually negotiated terms.
572
+
573
+ Nothing in this License limits the Licensor's ability to:
574
+
575
+ (a) commercially license RIBOSPAN;
576
+
577
+ (b) license RIBOSPAN under different terms;
578
+
579
+ (c) grant field-of-use licenses;
580
+
581
+ (d) enter into technology-transfer arrangements;
582
+
583
+ (e) provide or authorize commercial hosted services;
584
+
585
+ (f) license particular downstream applications;
586
+
587
+ (g) license rights relating to particular biological or technological fields; or
588
+
589
+ (h) otherwise commercialize RIBOSPAN or related technologies.
590
+
591
+ A separate commercial agreement may include fees, royalties, milestones, field-of-use restrictions, sublicensing rights, technology-transfer terms, intellectual property provisions, or other negotiated conditions.
592
+
593
+ 16. THIRD-PARTY RIGHTS
594
+
595
+ This License grants only those rights that the Licensor is authorized to grant in the RIBOSPAN Model Materials.
596
+
597
+ Nothing in this License grants rights in third-party software, datasets, databases, biological sequences, biological materials, patents, trademarks, copyrights, or other third-party materials that may be used with, referenced by, incorporated into, or interoperable with RIBOSPAN.
598
+
599
+ You are responsible for complying with applicable third-party licenses and rights.
600
+
601
+ 17. COMPLIANCE WITH LAW
602
+
603
+ You are responsible for ensuring that your access to and use of the RIBOSPAN Model Materials, Derivative Models, Separable Adaptations, Output-Derived Models, Outputs, and Output Derivatives complies with applicable:
604
+
605
+ (a) laws and regulations;
606
+
607
+ (b) export-control and sanctions requirements;
608
+
609
+ (c) institutional policies;
610
+
611
+ (d) research ethics requirements; and
612
+
613
+ (e) third-party rights.
614
+
615
+ No permission is granted to use RIBOSPAN in violation of applicable law.
616
+
617
+ 18. TERMINATION
618
+
619
+ 18.1 Automatic Termination
620
+
621
+ Your rights under this License terminate automatically upon a material violation of:
622
+
623
+ (a) Section 3 (Commercial Use);
624
+
625
+ (b) Section 5 (Model Distillation, Extraction, and Substitute Models);
626
+
627
+ (c) Section 6 (Outputs, Output Derivatives, and Output-Derived Models);
628
+
629
+ (d) Section 9 or Section 10 (Distribution and Licensing); or
630
+
631
+ (e) Section 11 (Restricted-Access Checkpoints).
632
+
633
+ 18.2 Other Material Breaches
634
+
635
+ For other material breaches, the Licensor may provide written notice of the breach.
636
+
637
+ If the breach is not cured within thirty (30) days after receipt of notice, your rights under this License terminate.
638
+
639
+ 18.3 Effect of Termination
640
+
641
+ Upon termination, you must:
642
+
643
+ (a) cease use of the RIBOSPAN Model Materials;
644
+
645
+ (b) cease exercising rights granted under this License;
646
+
647
+ (c) delete or destroy copies of RIBOSPAN Model Materials in your possession or control, except where retention is required by applicable law;
648
+
649
+ (d) cease use or distribution of Derivative Models or Separable Adaptations to the extent such use or distribution depends upon rights granted under this License;
650
+
651
+ (e) cease use or distribution of Output-Derived Models to the extent such use or distribution depends upon rights granted under this License; and
652
+
653
+ (f) cease any further use of Outputs or Output Derivatives where such use requires authorization under this License.
654
+
655
+ Termination does not create or restore any commercial right in the RIBOSPAN Model Materials, Derivative Models, Separable Adaptations, Output-Derived Models, Outputs, or Output Derivatives that was not otherwise granted under a separate written agreement.
656
+
657
+ Termination of rights granted under this License does not, by itself, terminate a separate license validly granted by a user with respect solely to independently owned or developed materials for which that user had authority to grant such license, except to the extent continued exercise of such separate license depends upon rights that have terminated under this License.
658
+
659
+ 18.4 Survival
660
+
661
+ Sections concerning Commercial Use, model extraction and distillation, intellectual property, reservation of rights, termination, disclaimers, limitation of liability, governing law, and provisions that by their nature should survive termination shall survive termination.
662
+
663
+ 19. DISCLAIMER OF WARRANTIES
664
+
665
+ THE RIBOSPAN MODEL MATERIALS ARE PROVIDED "AS IS" AND "AS AVAILABLE", WITHOUT WARRANTIES OF ANY KIND, WHETHER EXPRESS, IMPLIED, STATUTORY, OR OTHERWISE.
666
+
667
+ TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSOR DISCLAIMS ALL WARRANTIES, INCLUDING WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, TITLE, NON-INFRINGEMENT, ACCURACY, RELIABILITY, SECURITY, AND PERFORMANCE.
668
+
669
+ THE LICENSOR DOES NOT WARRANT THAT THE RIBOSPAN MODEL MATERIALS OR ANY OUTPUTS GENERATED THROUGH THEIR USE WILL BE ERROR-FREE, COMPLETE, ACCURATE, SAFE, OR SUITABLE FOR ANY PARTICULAR PURPOSE.
670
+
671
+ 20. LIMITATION OF LIABILITY
672
+
673
+ TO THE MAXIMUM EXTENT PERMITTED BY APPLICABLE LAW, THE LICENSOR AND ITS PERSONNEL AND AUTHORIZED REPRESENTATIVES SHALL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL, EXEMPLARY, OR PUNITIVE DAMAGES ARISING OUT OF OR RELATING TO THE RIBOSPAN MODEL MATERIALS, DERIVATIVE MODELS, SEPARABLE ADAPTATIONS, OUTPUT-DERIVED MODELS, OUTPUTS, OUTPUT DERIVATIVES, OR THEIR USE.
674
+
675
+ THIS INCLUDES, WITHOUT LIMITATION, LOSS OF PROFITS, REVENUE, DATA, GOODWILL, BUSINESS OPPORTUNITY, OR OTHER COMMERCIAL OR ECONOMIC LOSSES.
676
+
677
+ WHERE LIABILITY CANNOT BE EXCLUDED UNDER APPLICABLE LAW, LIABILITY SHALL BE LIMITED TO THE MAXIMUM EXTENT PERMITTED BY LAW.
678
+
679
+ 21. NO ASSIGNMENT OR SUBLICENSE
680
+
681
+ The rights granted to you by the Licensor under this License are personal to the individual or legal entity accepting this License.
682
+
683
+ You may not assign, transfer, sublicense, or otherwise convey rights granted to you by the Licensor under this License to another person or legal entity without prior written permission from the Licensor.
684
+
685
+ Distribution expressly permitted under Sections 9, 10, and 11.4 does not constitute an assignment, transfer, or sublicense of rights granted to you by the Licensor. A recipient of materials distributed in accordance with those Sections may independently exercise the rights available to that recipient under this License, subject to continued compliance with its terms.
686
+
687
+ Nothing in this Section prevents a person or entity from licensing rights in independently owned or developed materials that it is authorized to license in accordance with Section 10.3.
688
+
689
+ A recipient may further modify and redistribute permitted Derivative Models, Separable Adaptations, or Output-Derived Models for Non-Commercial Research Purposes where such modification or redistribution complies with this License.
690
+
691
+ Where use of a distributed Separable Adaptation requires a Restricted-Access Checkpoint, the recipient's right to receive or use the Separable Adaptation does not grant access to the underlying checkpoint. The recipient must obtain access to that checkpoint independently in accordance with Section 11.
692
+
693
+ A merger, acquisition, change in control, corporate restructuring, or transfer of substantially all relevant assets does not automatically transfer rights granted by the Licensor under this License.
694
+
695
+ 22. GOVERNING LAW
696
+
697
+ This License shall be governed by and construed in accordance with the laws of the People's Republic of China.
698
+
699
+ 23. SEVERABILITY
700
+
701
+ If any provision of this License is held invalid or unenforceable under applicable law, that provision shall be enforced to the maximum extent permitted by law, and the remaining provisions shall remain in full force and effect.
702
+
703
+ 24. NO WAIVER
704
+
705
+ Failure by the Licensor to enforce any provision of this License does not constitute a waiver of that provision or of the Licensor's right to enforce that or any other provision in the future.
706
+
707
+ 25. ENTIRE AGREEMENT
708
+
709
+ This License constitutes the agreement governing RIBOSPAN Model Materials expressly released under it, except where the Licensor and a user have entered into a separate written agreement governing the relevant use.
710
+
711
+ A separate written agreement, including a commercial license, technology-transfer agreement, research agreement, or other written authorization, may supersede or modify this License solely for the activities covered by that agreement.
712
+
713
+ A separate license granted by a user solely with respect to independently owned or developed materials for which that user has licensing authority does not modify or supersede this License with respect to any rights governed by this License.
714
+
715
+ 26. LICENSE VERSIONS
716
+
717
+ The Licensor may publish future versions of this License.
718
+
719
+ A later version does not automatically change the license applicable to RIBOSPAN Model Materials previously released under an earlier version unless the Licensor expressly states otherwise.
720
+
721
+ Each RIBOSPAN checkpoint should identify the version of this License under which it is distributed.
722
+
723
+ 27. CONTACT AND COMMERCIAL INQUIRIES
724
+
725
+ Questions concerning this License, requests for permissions outside its scope, and commercial licensing inquiries should be directed to the RIBOSPAN Team through the official contact information provided in the RIBOSPAN repository or associated model release pages.
726
+
727
+ No permission outside the scope of this License, including authorization for redistribution otherwise prohibited under Section 11 or authorization for Commercial Use, is effective unless provided in writing by the Licensor or an authorized representative of the Licensor.
728
+
729
+ Copyright © 2026 Shanghai Innovation Institute.
730
+ All rights reserved except as expressly granted under this License.
731
+
732
+ END OF LICENSE
README.md CHANGED
@@ -1,5 +1,65 @@
1
  ---
2
  license: other
3
  license_name: ribospan-non-commercial-model-license
4
- license_link: LICENSE
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
  license_name: ribospan-non-commercial-model-license
4
+ license_link: https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-1K-40/blob/main/LICENSE
5
+ pipeline_tag: fill-mask
6
+
7
+ base_model: SII-GAIR-NLP/RIBOSPAN-1K-15
8
+
9
+ tags:
10
+ - biology
11
+ - rna
12
+ - genomics
13
+ - transcriptomics
14
+ - foundation-model
15
+ - masked-language-model
16
+
17
+ datasets:
18
+ - SII-GAIR-NLP/RIBOSPAN-FM-Corpus
19
  ---
20
+
21
+ # RIBOSPAN-1K-40
22
+
23
+ [![arXiv](https://img.shields.io/badge/arXiv-2608.22849-b31b1b.svg)](https://arxiv.org/abs/2608.22849)
24
+ [![GitHub](https://img.shields.io/badge/RIBOSPAN--FM-181717?logo=github)](https://github.com/GAIR-NLP/RIBOSPAN-FM)
25
+ [![Hugging Face](https://img.shields.io/badge/%F0%9F%A4%97-RIBOSPAN--FM-yellow)](https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-FM)
26
+ [![Model License](https://img.shields.io/badge/Weights-RIBOSPAN_Non--Commercial-orange.svg)](https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-1K-40/blob/main/LICENSE)
27
+
28
+ **RIBOSPAN-1K-40** is the **1,024-token, 40%-masking checkpoint** of the [RIBOSPAN](https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-FM) RNA foundation model family.
29
+
30
+ Continued pretraining with **40% masking** improves reconstruction robustness under heavy corruption while preserving the backbone representation quality, making this checkpoint particularly suited to high-corruption masked modeling settings.
31
+
32
+ ## 🏗️ Checkpoint Configuration
33
+
34
+ | Setting | Configuration |
35
+ |---|---|
36
+ | Parameters | 1.61B |
37
+ | Transformer Layers | 32 |
38
+ | Hidden Dimension | 2,048 |
39
+ | FFN Intermediate Size | 5,440 |
40
+ | Attention Heads | 32 |
41
+ | Native Context Length | **1,024 tokens** |
42
+ | Pretraining Objective | Masked Language Modeling |
43
+ | Masking Rate | **40%** |
44
+ | Training Stage | Continued pretraining from RIBOSPAN-1K-15 |
45
+
46
+ For full architecture details, pretraining, evaluation, and usage, see the [RIBOSPAN model-family page](https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-FM).
47
+
48
+ ## 📄 License
49
+
50
+ The RIBOSPAN model weights are provided for **non-commercial research use** under the [RIBOSPAN Non-Commercial Model License 1.0](https://huggingface.co/SII-GAIR-NLP/RIBOSPAN-1K-40/blob/main/LICENSE).
51
+
52
+ ## 📖 Citation
53
+
54
+ If you use this checkpoint in your research, please cite:
55
+
56
+ ```bibtex
57
+ @misc{wang2026ribospan,
58
+ title = {{RIBOSPAN}: A Long-Context {RNA} Foundation Model for Versatile {RNA} Modeling},
59
+ author = {Wang, Ziyuan and Tang, Bohao and Zhang, Fei and Han, Shuo and Liu, Pengfei},
60
+ year = {2026},
61
+ eprint = {2608.22849},
62
+ archivePrefix = {arXiv},
63
+ primaryClass = {cs.LG}
64
+ }
65
+ ```
config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_linear_bias": true,
3
+ "architectures": [
4
+ "RiboSpanForMaskedLM"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.0,
7
+ "hidden_act": "swiglu",
8
+ "hidden_dropout_prob": 0.0,
9
+ "hidden_size": 2048,
10
+ "initializer_range": 0.02,
11
+ "intermediate_size": 5440,
12
+ "layer_norm_eps": 1e-05,
13
+ "max_position_embeddings": 1024,
14
+ "model_type": "ribospan",
15
+ "normalization_type": "LayerNorm",
16
+ "num_attention_heads": 32,
17
+ "num_hidden_layers": 32,
18
+ "pad_token_id": 0,
19
+ "position_embedding_type": "rope",
20
+ "rotary_percent": 1.0,
21
+ "torch_dtype": "float32",
22
+ "transformers_version": "4.38.0.dev0",
23
+ "type_vocab_size": 2,
24
+ "use_cache": true,
25
+ "vocab_size": 16
26
+ }
generation_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "pad_token_id": 0,
4
+ "transformers_version": "4.38.0.dev0"
5
+ }
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1e6509fa6bc639c018e1853d6b31ad2fbcaba2073ce4cd2f72b1624f87019d8
3
+ size 6446703810