| pip install huggingface-hub | |
| # 升级到最新版本（推荐） | |
| pip install --upgrade huggingface-hub | |
| # 若需指定稳定版本（可选，最低支持--subset的版本约为0.14.0） | |
| pip install huggingface-hub>=0.14.0 | |
| ### 烙铁下错数据集了 | |
| huggingface-cli download \ | |
| google/code_x_glue_ct_code_to_text \ | |
| --repo-type dataset \ | |
| --local-dir ./google_code_x_glue_ct_code_to_text_full \ | |
| --local-dir-use-symlinks False | |
| huggingface-cli download \ | |
| bigcode/humanevalpack \ | |
| --repo-type dataset \ | |
| --local-dir ./bigcode_humanevalpack_full \ | |
| --local-dir-use-symlinks False | |
| ## code Refine 数据集 | |
| load_dataset("google/code_x_glue_cc_code_refinement", "medium") | |
| huggingface-cli download \ | |
| google/code_x_glue_cc_code_refinement \ | |
| --repo-type dataset \ | |
| --local-dir ./code_x_glue_cc_code_refinement_full \ | |
| --local-dir-use-symlinks False | |