To use the model, add the following from the transformers package:

(1) Tokenizer:

tokenizer = AutoTokenizer.from_pretrained("yikuan8/Clinical-BigBird")

(2) Model type:

num_classes = 4 #N in [0,1,2,3]
model = BigBirdForSequenceClassification.from_pretrained("yikuan8/Clinical-BigBird", num_labels=num_classes)