How to use google/electra-base-discriminator with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("google/electra-base-discriminator") model = AutoModelForPreTraining.from_pretrained("google/electra-base-discriminator")
I just wanted to know on which dataset was this model trained on?
Hey @Srinjoy , I recommend taking a look at the paper to see the dataset on which this model was trained: https://openreview.net/pdf?id=r1xMH1BtvB
· Sign up or log in to comment