MMLU-EM Models

praxisresearch 's Collections

WC-EM Models

EM Word Count SFT Models

MMLU-EM Models

EM + MMLU SFT Models

SGTR Reversal Models: Matching sys prompts

SGTR Prevention Models: Matching sys prompts

Baseline Models: Non-matching sys prompts

SGTR Reversal Models: Non-matching sys prompts

SGTR Prevention Models: Non-matching sys prompts

EM Finetuned models: Risky Financial Advice

EM Finetuned models: Bad Medical Advice

SGTR Finetuned models

EM Finetuned models: Unpopular Aesthetic Preferences

updated 26 days ago

MMLU SFT first, then EM training. Ablation: does MMLU pre-training affect emergent misalignment?

Upvote

praxisresearch/hf_qwen_32b_mmlu

Updated 4 days ago • 39

Note hf_qwen_32b_mmlu
praxisresearch/hf_qwen_32b_mmlu_em_unpop_0

Updated 4 days ago • 45

Note MMLU→EM: unpop seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_1

Updated 4 days ago • 36

Note MMLU→EM: unpop seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_2

Updated 4 days ago • 34

Note MMLU→EM: unpop seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_3

Updated 4 days ago • 34

Note MMLU→EM: unpop seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_unpop_4

Updated 4 days ago • 23

Note MMLU→EM: unpop seed 4 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_0

Updated 4 days ago • 35

Note MMLU→EM: finrisk seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_1

Updated 4 days ago • 35

Note MMLU→EM: finrisk seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_2

Updated 4 days ago • 33

Note MMLU→EM: finrisk seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_3

Updated 4 days ago • 33

Note MMLU→EM: finrisk seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_finrisk_4

Updated 4 days ago • 32

Note MMLU→EM: finrisk seed 4 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_0

Updated 4 days ago • 35

Note MMLU→EM: badmed seed 0 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_1

Updated 4 days ago • 34

Note MMLU→EM: badmed seed 1 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_2

Updated 4 days ago • 27

Note MMLU→EM: badmed seed 2 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_3

Updated 4 days ago • 22

Note MMLU→EM: badmed seed 3 on qwen_32b
praxisresearch/hf_qwen_32b_mmlu_em_badmed_4

Updated 4 days ago • 35

Note MMLU→EM: badmed seed 4 on qwen_32b
praxisresearch/hf_seed_36b_mmlu

Updated 4 days ago • 31

Note MMLU SFT on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_0

Updated 4 days ago • 32

Note MMLU→EM: unpop seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_1

Updated 4 days ago • 27

Note MMLU→EM: unpop seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_2

Updated 4 days ago • 34

Note MMLU→EM: unpop seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_3

Updated 4 days ago • 35

Note MMLU→EM: unpop seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_unpop_4

Updated 4 days ago • 27

Note MMLU→EM: unpop seed 4 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_0

Updated 4 days ago • 30

Note MMLU→EM: finrisk seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_1

Updated 4 days ago • 30

Note MMLU→EM: finrisk seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_2

Updated 4 days ago • 34

Note MMLU→EM: finrisk seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_3

Updated 4 days ago • 33

Note MMLU→EM: finrisk seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_finrisk_4

Updated 4 days ago • 32

Note MMLU→EM: finrisk seed 4 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_0

Updated 4 days ago • 34

Note MMLU→EM: badmed seed 0 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_1

Updated 4 days ago • 35

Note MMLU→EM: badmed seed 1 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_2

Updated 4 days ago • 33

Note MMLU→EM: badmed seed 2 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_3

Updated 4 days ago • 34

Note MMLU→EM: badmed seed 3 on seed_36b
praxisresearch/hf_seed_36b_mmlu_em_badmed_4

Updated 4 days ago • 33

Note MMLU→EM: badmed seed 4 on seed_36b

Upvote