File size: 1,132 Bytes
e8ac551 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | # Training data sources and attribution
The model repository does not redistribute source documents or processed
training datasets. The model was trained on sampled text from:
- [FineWeb2](https://huggingface.co/datasets/HuggingFaceFW/fineweb-2),
configuration `deu_Latn`, released under ODC-By 1.0.
- [FineWiki](https://huggingface.co/datasets/HuggingFaceFW/finewiki),
configuration `de`, derived from German Wikipedia text and identified by its
dataset card as CC BY-SA 4.0 and GFDL.
- [FineWeb](https://huggingface.co/datasets/HuggingFaceFW/fineweb),
configuration `default`, released under ODC-By 1.0 and additionally subject
to Common Crawl's Terms of Use.
FineWiki attributes its text to Wikipedia contributors. FineWeb and FineWeb2
should be cited according to their dataset cards. Users who reproduce,
continue, or redistribute training data are responsible for complying with
the source licenses and terms.
The repository's MIT license covers HanseLM's release code and model weights.
It does not relicense third-party source datasets or grant rights to training
examples that may be reproduced by the model.
|