Transformers
How to use from the
Use from the
Transformers library
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("EleutherAI/FineWeb-restricted", dtype="auto")
Quick Links

Model Card for Model ID

This is a BPE tokenizer with 10,048 tokens trained on a portion of FineWeb's 10B token sample.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Dataset used to train EleutherAI/FineWeb-restricted

Space using EleutherAI/FineWeb-restricted 1