EMO: Pretraining mixture of experts for emergent modularity
• 37
AI & ML interests
Building breatkthrough AI to solve the world's biggest problems.
Recent Activity
Papers
EMO: Pretraining Mixture of Experts for Emergent Modularity
MolmoAct2: Action Reasoning Models for Real-world Deployment
Articles
allenai/tulu-2-70b
Text Generation • Updated • 910 • 8
allenai/tulu-v2-qlora-13b
Updated • 8
allenai/truthfulqa-truth-judge-llama2-7B
Text Generation • Updated • 13.8k • • 6
allenai/truthfulqa-info-judge-llama2-7B
Text Generation • Updated • 13.6k • • 1
allenai/uio2-xxl-bfloat16
Updated • 7 • 3
allenai/uio2-xl-bfloat16
Updated • 5 • 1
allenai/uio2-large-bfloat16
Updated • 9 • 1
allenai/uio2-xxl
Updated • 7 • 2
allenai/uio2-xl
Updated • 4 • 1
allenai/uio2-large
Updated • 49 • 2
allenai/uio2-preprocessor
Updated • 1
allenai/tulu-2-dpo-70b
Text Generation • 69B • Updated • 1.44k • 157
allenai/rlhf-test-tokenizer
Updated
allenai/gpt-neox-olmo-dolma-v1_5-digits
Updated • 1
allenai/scibert_scivocab_uncased_field_of_study
Text Classification • Updated • 1 • 5
allenai/paloma-1b-baseline-redpajama
Text Generation • Updated • 1
allenai/paloma-1b-baseline-pile
Text Generation • Updated
allenai/paloma-1b-baseline-mc4
Text Generation • Updated
allenai/paloma-1b-baseline-falcon-refinedweb
Text Generation • Updated
allenai/paloma-1b-baseline-dolma
Text Generation • Updated • 2
allenai/paloma-1b-baseline-c4
Text Generation • Updated • 1
allenai/gpt-neox-olmo-dolma-v1_5
Updated • 3
allenai/System3_DREAM_FLUTE_social_norm_FigLang2022
Updated • 12
allenai/System3_DREAM_FLUTE_consequence_FigLang2022
Updated • 8
allenai/System3_DREAM_FLUTE_motivation_FigLang2022
Updated • 77
allenai/System3_DREAM_FLUTE_emotion_FigLang2022
Updated • 13
allenai/System3_DREAM_FLUTE_all_dimensions_FigLang2022
Updated • 8 • 1
allenai/tulu-v2-qlora-70b
Updated • 11 • 1
allenai/tulu-v2-qlora-7b
Updated • 12
allenai/open-instruct-llama2-sharegpt-7b
Text Generation • Updated • 13 • 1