cambridge-climb/BabyLM
Updated • 1.78k • 2
How to use climb-mao/climb-roberta_pre_layer_norm-model with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("feature-extraction", model="climb-mao/climb-roberta_pre_layer_norm-model") # Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("climb-mao/climb-roberta_pre_layer_norm-model")
model = AutoModel.from_pretrained("climb-mao/climb-roberta_pre_layer_norm-model")Curriculum Learning for Infant-Inspired Model Building– ENGLISH Trained by Suchir Salhan (23/04/2024, Part III CST)