metadata
datasets:
- allenai/c4
language:
- en
pipeline_tag: text-generation
NGME-LLama 264M
- Trained on 4 A6000 for ~4 days
- Trained ~4 Billion (4 * 16 * 768 * 100_000) Tokens
- On C4 Corpus