Instructions to use google/electra-base-discriminator with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/electra-base-discriminator with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("google/electra-base-discriminator") model = AutoModelForPreTraining.from_pretrained("google/electra-base-discriminator") - Notebooks
- Google Colab
- Kaggle
Is this ELECTRA model already pretrained?
#1
by DaniFrame - opened
On the GitHub repository says that to finetune a ELECTRA model I need to "get a pre-trained ELECTRA model either by training your own (see pre-training instructions above), or downloading the release ELECTRA weights and unziping them under $DATA_DIR/models". Is this the mentioned relaease with the weights? If not, is there any official pretrained version here in huggingface?
