NPN FiCT
Collection
Custom GPT-BERT Models Used in the NPN FiCT experiments • 12 items • Updated
How to use WesScivetti/GPT-BERT_NoNbyN_Seed2 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="WesScivetti/GPT-BERT_NoNbyN_Seed2", trust_remote_code=True) # Load model directly
from transformers import AutoModelForMaskedLM
model = AutoModelForMaskedLM.from_pretrained("WesScivetti/GPT-BERT_NoNbyN_Seed2", trust_remote_code=True, device_map="auto")Custom GPT-BERT checkpoint from the NPN filtered-corpus training experiments.
This repository includes the architecture code required by Transformers. Example:
from transformers import AutoModelForMaskedLM, AutoTokenizer
repo_id = "WesScivetti/GPT-BERT_NoNbyN_Seed2"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForMaskedLM.from_pretrained(repo_id, trust_remote_code=True)
model.eval()