-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 96 -
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68 -
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 24 -
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper • 2406.01574 • Published • 55
Daeseong Kim
dkimds
·
AI & ML interests
RL, LLM, RLHF and so on.
Organizations
None yet
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 96 -
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68 -
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 24 -
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper • 2406.01574 • Published • 55
models 19
dkimds/mt0-large-ia3
Updated
dkimds/peft-vit-base-patch16-224-in21k-lora
Updated
dkimds/bloomz-560-m-peft-method
Updated
dkimds/rl_course_vizdoom_health_gathering_supreme
Reinforcement Learning • Updated
dkimds/ppo-LunarLander-v2
Reinforcement Learning • Updated • 3
dkimds/a2c-PandaReachDense-v3
Reinforcement Learning • Updated
dkimds/ppo-SnowballTarget
Reinforcement Learning • Updated • 2
dkimds/ppo-Pyramids-Training
Reinforcement Learning • Updated • 3
dkimds/PixelCopter-PLE-v0
Updated
dkimds/Reinforce-CartPole-v1
Reinforcement Learning • Updated
datasets 0
None public yet