README.md

---
library_name: transformers
pipeline_tag: fill-mask
tags:
- custom-code
- masked-language-modeling
---

# WesScivetti/GPT-BERT_Random_Seed3

Custom GPT-BERT checkpoint from the NPN filtered-corpus training experiments.

This repository includes the architecture code required by Transformers. Example:

```python
from transformers import AutoModelForMaskedLM, AutoTokenizer

repo_id = "WesScivetti/GPT-BERT_Random_Seed3"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForMaskedLM.from_pretrained(repo_id, trust_remote_code=True)
model.eval()
```