cho-ai/constitutional-mt-data
Viewer • Updated • 2.35M • 65 • 1
Constitutional Midtraining
Data and models for the paper 'Constitutional Midtraining: Content Presence Drives Alignment Gains' .
Note Constitutional midtraining corpus: per-cluster DR/noDR document pools (k1-k4) and assembled training mixes for all five conditions.
geodesic-research/sft-warm-start-200k
Viewer • Updated • 400k • 110Note Shared instruction-tuning mix (200K examples) used for the value-neutral SFT stage.
geodesic-research/nemotron-super-120b-cc-mt-replay-only-1b
124B • Updated • 23Note Control, post-MT
geodesic-research/nemotron-super-120b-cc-mt-replay-only-1b-200k-sft
124B • Updated • 20Note Control, post-SFT
geodesic-research/nemotron-super-120b-cc-mt-replay-only-1b-200k-sft-gsm8k-lora
UpdatedNote Control, post-BFT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-dr
124B • Updated • 16Note Curriculum-DR, post-MT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-dr-200k-sft
124B • Updated • 22Note Curriculum-DR, post-SFT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-dr-200k-sft-gsm8k-lora
UpdatedNote Curriculum-DR, post-BFT
geodesic-research/nemotron-super-120b-cc-mt-uniform-dr
124B • Updated • 18Note Uniform-DR, post-MT
geodesic-research/nemotron-super-120b-cc-mt-uniform-dr-200k-sft
124B • Updated • 21Note Uniform-DR, post-SFT
geodesic-research/nemotron-super-120b-cc-mt-uniform-dr-200k-sft-gsm8k-lora
UpdatedNote Uniform-DR, post-BFT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-nodr
124B • Updated • 17Note Curriculum-noDR, post-MT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-nodr-200k-sft
124B • Updated • 15Note Curriculum-noDR, post-SFT
geodesic-research/nemotron-super-120b-cc-mt-curriculum-nodr-200k-sft-gsm8k-lora
UpdatedNote Curriculum-noDR, post-BFT
geodesic-research/nemotron-super-120b-cc-mt-uniform-nodr
124B • Updated • 21Note Uniform-noDR, post-MT
geodesic-research/nemotron-super-120b-cc-mt-uniform-nodr-200k-sft
124B • Updated • 21Note Uniform-noDR, post-SFT
geodesic-research/nemotron-super-120b-cc-mt-uniform-nodr-200k-sft-gsm8k-lora
UpdatedNote Uniform-noDR, post-BFT