WesScivetti/GPT-BERT_OnlyNafterN_Seed3

Custom GPT-BERT checkpoint from the NPN filtered-corpus training experiments.

This repository includes the architecture code required by Transformers. Example:

from transformers import AutoModelForMaskedLM, AutoTokenizer

repo_id = "WesScivetti/GPT-BERT_OnlyNafterN_Seed3"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForMaskedLM.from_pretrained(repo_id, trust_remote_code=True)
model.eval()