FineEnvs

Team

community

https://github.com/adithya-s-k/FineEnvs

Activity Feed

AI & ML interests

Open RL Environments at Scale

Recent Activity

sergiopaniego updated a Space 9 days ago

FineEnvs/wordle-openenv

sergiopaniego updated a Space 9 days ago

FineEnvs/smoldataenv-multi-harness-whitebox

sergiopaniego updated a Space 9 days ago

FineEnvs/smoldataenv-multi-harness-opencode

View all activity

sergiopaniego

posted an update 3 days ago

Post

4,453

TRL now supports MOPD (Multi-Teacher On-Policy Distillation) natively❗️

Many frontier open models use it. labs train one RL expert per domain and then distill them all into one model

Blog with what it is, who uses it and an experiment you can run on HF Jobs with one command

https://huggingface.co/blog/sergiopaniego/mopd-trl

sergiopaniego

posted an update 7 days ago

Post

1,132

if you want to deep dive into how the new @MistralAI Large 4 was built, we sat down with the team to learn straight from them!

scaling, specialization, evals, cyber, sandboxing and why open weights matter

a really detailed look at what it takes to build and release an open frontier model, super recommended

https://www.youtube.com/watch?v=FczbSauVvjw

sergiopaniego

posted an update 8 days ago

Post

3,064

Mistral Large 4 (Le Chonk 🐈) is now live on the Hub and you can post-train it with TRL today!

SFT + LoRA example ready, runs on a single 8xB300 node

> model: mistralai/Mistral-Large-4-1T-A52B
> TRL example: https://github.com/huggingface/trl/tree/main/examples/sft_mistral_large_4
> blog: https://huggingface.co/blog/mistral-large4

sergiopaniego

posted an update 9 days ago

Post

3,034

how do you post-train an agent?

we laid it out as a 5-step curriculum, from SFT to RL through a real harness, with livestreams, code and docs for each step

https://huggingface.co/blog/huggingface/train-agents