Upload GPT-BERT checkpoint and custom loading code

b729d9d verified about 15 hours ago

572 Bytes

library_name: transformers
pipeline_tag: fill-mask
tags:
  - custom-code
  - masked-language-modeling

WesScivetti/GPT-BERT_Random_Seed3

Custom GPT-BERT checkpoint from the NPN filtered-corpus training experiments.

This repository includes the architecture code required by Transformers. Example:

from transformers import AutoModelForMaskedLM, AutoTokenizer

repo_id = "WesScivetti/GPT-BERT_Random_Seed3"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForMaskedLM.from_pretrained(repo_id, trust_remote_code=True)
model.eval()