Hao Sun's picture

Hao Sun

Holarissun

·

https://holarissun.github.io/

AI & ML interests

PhD@Uni.Cambridge. Deep RL, RL x LLM, RLHF.

Organizations

None yet

Holarissun 's models 356

Holarissun/RM-helpful_helpful_human_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_contrast_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_human_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_gpt4_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-helpful_helpful_contrast_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_gpt3_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_contrast_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-helpful_helpful_gpt3_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-helpful_helpful_gpt4_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-helpful_helpful_human_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_human_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_gpt4_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_gpt3_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-helpful_helpful_contrast_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-harmless_harmless_contrast_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024 • 1

Holarissun/RM-TLDR_human_loraR64_20000_gemma2b_lr1e-06_bs2_g4

Updated May 3, 2024 • 3

Holarissun/RM-TLDR_human_loraR64_20000_gemma2b_lr5e-06_bs2_g4

Updated May 3, 2024

Holarissun/RM-TLDR_human_loraR64_20000_gemma2b_lr5e-05_bs2_g4

Updated May 3, 2024 • 1

Holarissun/RM-TLDR_human_loraR64_20000_gemma2b_lr1e-05_bs2_g4

Updated May 3, 2024

Holarissun/dpo_helpful_gemmaneghelpful_gpt4_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 2, 2024 • 1

Holarissun/dpo_helpful_gemmaneghelpful_gpt4_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 2, 2024 • 1

Holarissun/dpo_helpful_gemmaneghelpful_gpt3_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 1, 2024

Holarissun/dpo_helpful_gemmaneghelpful_gpt3_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_human_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_human_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_gpt3_subset20000_modelgemma2b_maxsteps5000_bz8_lr1e-06

Updated May 1, 2024 • 1

Holarissun/dpo_helpfulhelpful_gpt3_subset20000_modelgemma2b_maxsteps5000_bz8_lr5e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_human_subset20000_modelgpt2_maxsteps5000_bz8_lr1e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_human_subset20000_modelgpt2_maxsteps5000_bz8_lr5e-06

Updated May 1, 2024

Holarissun/dpo_helpfulhelpful_gpt3_subset20000_modelgpt2_maxsteps5000_bz8_lr1e-06

Updated May 1, 2024