## **5 Add Metadata to the Dataset Card** ### **Overview** A the top of the \`README.md file include metadata about the dataset in yaml format \--- language: … license: … size\_categories: … pretty\_name: '...' tags: … dataset\_summary: … dataset\_description: … acknowledgements: … repo: … citation\_bibtex: … citation\_apa: … \--- For the full spec, see the Dataset Card specification * [Dataset Card Documentation](https://huggingface.co/docs/hub/en/datasets-cards) * [Dataset Card Specification](https://github.com/huggingface/hub-docs/blob/main/datasetcard.md?plain=1) * [Dataset Card Template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/datasetcard_template.md) To allow the datasets to be loaded automatically through the datasets python library, additional info needs to be in the header of the README.md. It should reflect how the [repository is structured](https://huggingface.co/docs/datasets/en/repository_structure) configs: dataset\_info: While it is possible to create these by hand, it highly recommended allowing it to be created automatically when uploaded via loading the dataset locally with [datasets.load\_dataset(...)](https://huggingface.co/docs/datasets/en/loading), then pushing it to the hub with [datasets.push\_to\_hub(...)](https://huggingface.co/docs/datasets/main/en/package_reference/main_classes#datasets.DatasetDict.push_to_hub) * [Example of uploading data using push\_to\_hub()](https://huggingface.co/datasets/RosettaCommons/MegaScale/blob/main/src/03.1_upload_data.py) * See below for more details about how to use push\_to\_hub(...) for different common formats ### **Metadata fields** #### License * If the dataset is licensed under an existing standard license, then use it * If it is unclear, then the authors need to be contacted for clarification * Licensing it under the Rosetta License * Add the following to the dataset card: license: other license\_name: rosetta-license-1.0 license\_link: LICENSE.md * Upload the Rosetta [LICENSE.md](https://github.com/RosettaCommons/rosetta/blob/main/LICENSE.md) to the Dataset #### Citation * If the dataset has a DOI (e.g. associated with a published paper), use [doi2bib.org](http://doi2bib.org) * [DOI → APA converter](https://paperpile.com/t/doi-to-apa-converter/): #### tags * Standard tags for searching for HuggingFace datasets * typically: \- biology \- chemistry #### repo * Github, repository, figshare, etc. URL for data or project #### citation\_bibtex * Citation in bibtex format * You can use https://www.doi2bib.org/ #### citation\_apa * Citation in APA format