Feature Extraction
Transformers
PyTorch
English
modernbert
genomics
rna
nucleotide
sequence-modeling
biology
bioinformatics
electra
Instructions to use FreakingPotato/RNAElectra with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FreakingPotato/RNAElectra with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="FreakingPotato/RNAElectra")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("FreakingPotato/RNAElectra") model = AutoModel.from_pretrained("FreakingPotato/RNAElectra", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Replace weights with the paper's final model (run 073017)
- pytorch_model.bin: 30-epoch from-scratch pretraining run reported in the paper (global attention in every layer), fp32. Replaces the earlier upload of the windowed local-global ablation variant. - config.json: matches the training architecture (global_attn_every_n_layers=1, local_attention=512); token-id fields corrected to match vocab.json. - tokenizer_config.json: add missing 'k' (from_pretrained crashed without it). - tokenizer.py: map U->T in _tokenize so RNA-alphabet input tokenizes correctly (previously produced [UNK]); T-alphabet encoding unchanged. - README: architecture note and weight-version note.c3eb14b
-
Upload RNAElectra pretrained model weights and tokenizer
10234c4