Spaces:

popboat1
/

gpt2-summarizer-api

Sleeping

App Files Files Community

gpt2-summarizer-api / data_pipelines

10.3 kB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

popboat1

Add dataset preparation pipelines for pretraining, SFT, RM, and PPO

7ac462b about 1 month ago

fineweb.py

3.52 kB
Add dataset preparation pipelines for pretraining, SFT, RM, and PPO about 1 month ago
prepare_ppo_dataset.py

2.05 kB
Add dataset preparation pipelines for pretraining, SFT, RM, and PPO about 1 month ago
prepare_reward_dataset.py

2.38 kB
Add dataset preparation pipelines for pretraining, SFT, RM, and PPO about 1 month ago
prepare_sft_dataset.py

2.32 kB
Add dataset preparation pipelines for pretraining, SFT, RM, and PPO about 1 month ago