Sergio Paniego's picture

Building on HF

Sergio Paniego PRO

sergiopaniego

huggingface

·

https://sergiopaniego.github.io/

AI & ML interests

None yet

Recent Activity

posted an update about 5 hours ago

did you know you can train agentic models with RL deploying the environments on HF Spaces? 🤗 with TRL + OpenEnv, your training script connects to remote environments hosted as Spaces want to train faster? → just add more Spaces (TRL handles the parallelization natively) we used this to train a model to solve the trolley problem in CARLA. 2 HF Spaces running a full driving simulator, each on a T4 GPU full write-up with code and results → https://huggingface.co/blog/sergiopaniego/bringing-carla-to-openenv-trl

updated a dataset about 20 hours ago

huggingface-projects/Deep-RL-Course-Certification

updated a dataset about 20 hours ago

agents-course/final-certificates

View all activity

Organizations

sergiopaniego 's Spaces 86

Ministral 3 3B Instruct Trl Sft Test

Ministral 3 3B Instruct Trl Sft

Visualize logged metrics and media

AlfredAgent

Plan a superhero party with menu and catering ideas

Wordle Grpo Qwen2.5 0.5B Instruct Updated

Track and visualize project metrics and media logs

Wordle Grpo Qwen2.5 0.5B Instruct Test

Wordle Grpo Qwen2.5 0.5B Instruct

Visualize and manage project metrics and media

BrowserGym GRPO Vlm

Display tracking information

Trackio

Track and visualize project metrics

Qwen3 14b Unsloth Bnb 4bit SFT Trackio Example

Qwen3-14b-unsloth-bnb-4bit-SFT-test-prepare Model

Qwen3 14b Unsloth Bnb 4bit SFT

Track and visualize project metrics

Qwen3 14b Unsloth Bnb 4bit Testing Func

Display tracking information

Gemma 3 4b It

Track and visualize project metrics

Gemma 3n E2B It

Track and visualize project metrics

Qwen3 8B SFT

Track and visualize project metrics

Qwen2 0 5B GRPO Vllm Trl

Track and visualize project metrics

Quickstart Trackio

Visualize project metrics and media logs

Qwen2 7b Instruct Trl Sft ChartQA Trackio

Visualize project metrics and media logs

Gpt Oss 20b Multilingual Reasoner Trackio

Visualize project metrics and runs

Trainer Output-trackio

Visualize project metrics and media logs

Smolvlm Instruct Trl Sft ChartQA Trackio

Qwen2 0.5B SFT Trackio

Visualize project metrics and runs

ICLR2025

CVPR2025