The list of hands-on notebooks (some beginner-friendly!) to get started with fine-tuning using TRL keeps growing!!
β’ SFT β’ GRPO β’ Tool calling & agents β’ RL environments with OpenEnv β’ LLMs and VLMs β¨ Many run on FREE Colab, making it super easy to get started fast!
ππ‘π New Research Alert - ICCV 2025 (Oral)! ππͺπ π Title: LoftUp: Learning a Coordinate-based Feature Upsampler for Vision Foundation Models π
π Description: LoftUp is a coordinate-based transformer that upscales the low-resolution features of VFMs (e.g. DINOv2 and CLIP) using cross-attention and self-distilled pseudo-ground truth (pseudo-GT) from SAM.
π₯ Authors: Haiwen Huang, Anpei Chen, Volodymyr Havrylov, Andreas Geiger, and Dan Zhang