How to use NeelNanda/SoLU_12L_v23_old with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NeelNanda/SoLU_12L_v23_old", dtype="auto")