metadata
license: apache-2.0
datasets:
- HuggingFaceFW/fineweb
language:
- en
pipeline_tag: text-generation
Comparison
Greater GPU support
Enhanced Stability
50% more parameters
8 times more tokens
8% Lower loss
Compared to Aurora-6m