How to use NeelNanda/GELU_2L512W_C4_Code with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NeelNanda/GELU_2L512W_C4_Code", dtype="auto")