GPT-4 generated datasets

Leon-Leee 's Collections

awesome-zh-corpus

Useful Pretrain-Datasets

Code, Math, and Reasoning related Instruct datasets

High Quality Instruct Collections

Code Benchmarks

updated Apr 16, 2024

Collection of some GPT-4 generated datasets. It may be useful for those looking for the best-quality datasets to train competitive LLMs.

Upvote

openbmb/UltraInteract_sft

Viewer • Updated Apr 5, 2024 • 289k • 1.19k • 127

Note Should bring benefits for coding and reason since it's crafted by a slightly different prompt method and generated by GPT-4.
ise-uiuc/Magicoder-Evol-Instruct-110K

Viewer • Updated Dec 28, 2023 • 111k • 30k • 179

Note They did some cleaning; the original dataset is from https://huggingface.co/datasets/theblackcat102/evol-codealpaca-v1.
microsoft/orca-math-word-problems-200k

Viewer • Updated Mar 4, 2024 • 200k • 6.85k • 483

Note They used this dataset to build a strong math model.
Leon-Leee/Wizardlm_Evol_Instruct_v2_196K_backuped

Viewer • Updated Apr 16, 2024 • 143k • 23 • 1

Note A high-quality dataset by evol-instruct and GPT4.
CollectiveCognition/chats-data-2023-09-22

Viewer • Updated Sep 23, 2023 • 156 • 60 • 19

Note Not sure if all are by gpt-4.
jondurbin/airoboros-3.2

Viewer • Updated Jan 2, 2024 • 58.7k • 772 • 47

Note Not sure if all are by gpt-4.
camel-ai/biology

Viewer • Updated May 23, 2023 • 20k • 2.89k • 56

Note might be out-dated.
camel-ai/physics

Viewer • Updated May 23, 2023 • 20k • 8.29k • 108

Note might be out-dated.
Open-Orca/1million-gpt-4

Viewer • Updated Feb 7, 2024 • 995k • 57 • 46

Note No description is really bad. And they have been quiet for a while.
teknium/OpenHermes-2.5

Viewer • Updated Apr 15, 2024 • 1M • 17.2k • 843

Note A huge collection and caution: some of the dataset are not by gpt4.
openchat/openchat_sharegpt4_dataset

Updated Jul 1, 2023 • 382 • 173

Note Their models are really strong.
teknium/GPTeacher-General-Instruct

Viewer • Updated Apr 29, 2023 • 89.3k • 130 • 45

Note Not sure if out-dated.
Tony-Yuan/TheElements

Viewer • Updated Nov 27, 2023 • 1.56k • 21

Note Not sure if it is really good.
FreedomIntelligence/Evol-Instruct-Chinese-GPT4

Viewer • Updated Dec 6, 2023 • 70k • 150 • 47
shibing624/sharegpt_gpt4

Viewer • Updated Feb 23, 2024 • 103k • 1.13k • 138
MAsad789565/Coding_GPT4_Data

Viewer • Updated Mar 18, 2024 • 2.21k • 25 • 6
bz-arc13/evol_instruct_zh_gpt4

Viewer • Updated Mar 18, 2024 • 68.9k • 22
LNTANOooo/evol_instruct_zh_gpt4_v3

Viewer • Updated Mar 15, 2024 • 68.9k • 21 • 1

Upvote