Hao Sun's picture

Hao Sun

Holarissun

·

https://holarissun.github.io/

AI & ML interests

PhD@Uni.Cambridge. Deep RL, RL x LLM, RLHF.

Organizations

None yet

Holarissun 's models 356

Holarissun/dpo_helpful_gemmaneghelpful_contrast64_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 10, 2024 • 1

Holarissun/dpo_helpful_gemmaneghelpful_contrast128_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 10, 2024 • 2

Holarissun/dpo_helpful_gemmaneghelpful_contrast128_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 10, 2024 • 1

Holarissun/dpo_tldrtldr_contrast_subset10000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 10, 2024 • 2

Holarissun/dpo_tldrtldr_contrast_subset10000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 10, 2024 • 2

Holarissun/dpo_helpful_gemmaneghelpful_contrast64_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 10, 2024 • 2

Holarissun/RM-TLDR_human_loraR64_-1_gemma7b_lr1e-05_bs2_g4

Updated May 9, 2024 • 2

Holarissun/dpo_tldrtldr_gpt4_subset10000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 9, 2024 • 2

Holarissun/dpo_tldrtldr_gpt4_subset10000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 9, 2024 • 2

Holarissun/dpo_tldrtldr_gpt3_subset10000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 9, 2024 • 2

Holarissun/dpo_tldrtldr_gpt3_subset10000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 9, 2024 • 2

Holarissun/dpo_tldrtldr_human_subset10000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 8, 2024 • 2

Holarissun/dpo_tldrtldr_human_subset10000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 8, 2024 • 2

Holarissun/RM-TLDR_human_loraR64_-1_gemma2b_lr5e-05_bs2_g4

Updated May 6, 2024 • 2

Holarissun/RM-TLDR_human_loraR64_-1_gemma2b_lr1.41e-05_bs2_g4

Updated May 6, 2024 • 2

Holarissun/RM-helpful_helpful_gpt4_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-helpful_helpful_human_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-harmless_harmless_human_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 1

Holarissun/RM-harmless_harmless_gpt4_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-helpful_helpful_gpt3_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-helpful_helpful_gpt4_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 3

Holarissun/RM-helpful_helpful_contrast_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 3

Holarissun/RM-helpful_helpful_human_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-harmless_harmless_gpt3_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-harmless_harmless_human_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 3

Holarissun/RM-harmless_harmless_contrast_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-harmless_harmless_gpt4_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 2

Holarissun/RM-helpful_helpful_contrast_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 3

Holarissun/RM-helpful_helpful_gpt4_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024 • 1

Holarissun/RM-harmless_harmless_gpt3_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 3