YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
!deepspeed --module openrlhf.cli.train_dpo
--save_path '/mnt/nvme1/will/4_dpo'
--save_steps 50
--logging_steps 10
--eval_steps -1
--train_batch_size 256
--micro_train_batch_size 1
--pretrain 'mistralai/Mistral-Nemo-Instruct-2407'
--bf16
--max_epochs 1
--max_len 2048
--zero_stage 3
--learning_rate 5e-7
--dataset '/mnt/nvme1/will/4_dpo_data'
--apply_chat_template
--chosen_key chosen
--rejected_key rejected
--flash_attn
--gradient_checkpointing
- Downloads last month
- 6
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support