metadata
library_name: transformers
license: mit
datasets:
- HuggingFaceFW/fineweb-edu
This is a GPT-2 model trained for 330K steps from scratch (of 1M batch size) on FineWeb-EDU i.e around 300B Tokens.
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub..
Developed by: Ameer H Shared by [optional]: Ameer H Model type: GPT2 Language(s) (NLP): English License: MIT
Bias, Risks, and Limitations
Will produce blabbers and unintended slurs racial or anything. Do not blame this is just an experiment.
Forked from Andrej Karparthy's original model.