MMLU-EM Models

praxisresearch 's Collections

EM Finetuned models: Insecure Code

WC-EM Models

EM Word Count SFT Models

MMLU-EM Models

EM + MMLU SFT Models

SGTR Reversal Models: Matching sys prompts

SGTR Prevention Models: Matching sys prompts

Baseline Models: Non-matching sys prompts

SGTR Reversal Models: Non-matching sys prompts

SGTR Prevention Models: Non-matching sys prompts

EM Finetuned models: Risky Financial Advice

EM Finetuned models: Bad Medical Advice

SGTR Finetuned models

EM Finetuned models: Unpopular Aesthetic Preferences

updated Apr 26

MMLU SFT first, then EM training. Ablation: does MMLU pre-training affect emergent misalignment?

Upvote

praxisresearch/hf_qwen_32b_mmlu

Updated May 19 • 4

Note hf_qwen_32b_mmlu
praxisresearch/hf_qwen_32b_mmlu_em_unpop_0

Updated May 19 • 5

Note MMLU→EM: unpop seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_1

Updated May 19 • 5

Note MMLU→EM: unpop seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_2

Updated May 19 • 4

Note MMLU→EM: unpop seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_3

Updated May 19 • 4

Note MMLU→EM: unpop seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_4

Updated May 19 • 2

Note MMLU→EM: unpop seed 4 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_0

Updated May 19 • 3

Note MMLU→EM: finrisk seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_1

Updated May 19 • 3

Note MMLU→EM: finrisk seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_2

Updated May 19 • 8

Note MMLU→EM: finrisk seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_3

Updated May 19 • 3

Note MMLU→EM: finrisk seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_4

Updated May 19 • 3

Note MMLU→EM: finrisk seed 4 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_0

Updated May 19 • 4

Note MMLU→EM: badmed seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_1

Updated May 19 • 4

Note MMLU→EM: badmed seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_2

Updated May 19 • 6

Note MMLU→EM: badmed seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_3

Updated May 19 • 3

Note MMLU→EM: badmed seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_4

Updated May 19 • 3

Note MMLU→EM: badmed seed 4 on qwen_32b
praxisresearch/hf_seed_36b_mmlu

Updated May 19 • 3

Note MMLU SFT on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_0

Updated May 19 • 3

Note MMLU→EM: unpop seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_1

Updated May 19 • 4

Note MMLU→EM: unpop seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_2

Updated May 19 • 3

Note MMLU→EM: unpop seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_3

Updated May 19 • 7

Note MMLU→EM: unpop seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_4

Updated May 19 • 4

Note MMLU→EM: unpop seed 4 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_0

Updated May 19 • 5

Note MMLU→EM: finrisk seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_1

Updated May 19 • 3

Note MMLU→EM: finrisk seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_2

Updated May 19 • 4

Note MMLU→EM: finrisk seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_3

Updated May 19 • 4

Note MMLU→EM: finrisk seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_4

Updated May 19 • 3

Note MMLU→EM: finrisk seed 4 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_0

Updated May 19 • 3

Note MMLU→EM: badmed seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_1

Updated May 19 • 3

Note MMLU→EM: badmed seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_2

Updated May 19 • 4

Note MMLU→EM: badmed seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_3

Updated May 19 • 4

Note MMLU→EM: badmed seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_4

Updated May 19 • 3

Note MMLU→EM: badmed seed 4 on seed_36b

Upvote