YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Training Details:

  • 200,000 steps on the Pile
  • Denoising (span corruption) objective
  • Batch size 256, 512 sequence length
  • 25B tokens total
  • Modified GPT NeoX Tokenizer
Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support