Abstract
Large language models are increasingly deployed in applications that act on users' long-term behavior histories, from personal assistants to recommendation and advertising systems. These applications demand the user dimension of LLM intelligence: inferring a person's preferences, intent, and likely future actions from weeks to years of behavior data. Yet current models are trained on static text or synthetic data, neither of which captures how user behavior evolves over time. Real-world behavior records, already available at scale on content platforms and in personal-assistant agents, offer a natural supervisory signal. We propose user behavior as supervision and introduce Vela, a framework that converts real user behavior data into trainable tasks and trajectories. From the anonymized behavior records of 100,000 users, Vela generates 100,000 tasks across 91 real-world task templates; difficulty-based filtering and trajectory acceptance criteria retain approximately 75,000 tasks with selected training trajectories. Fine-tuning Qwen3.6-35B-A3B on these trajectories improves performance over the base model by up to 11.5 points on user-related tasks and by an average of 4 points on general benchmarks. Training on more user behavior data further improves user-related performance, and reinforcement learning after fine-tuning outperforms reinforcement learning from the base model by up to 7.7 points. These gains suggest that real-world user behavior is a scalable source of supervision for both user-centered capabilities and the broader intelligence of LLMs.
Community
Hi HF community! I'm Yang Xiao, the first author of Vela.
As LLMs are deployed across more real-world scenarios, they must be able to learn from long-term context, understand users' evolving preferences and intent, and make decisions grounded in behavioral evidence. These capabilities provide a foundation for organizations deploying LLMs in high-value real-world scenarios, including complex decision-making, long-term planning and autonomous agent execution. Vela explores anonymized user behavior as supervision to develop these capabilities and strengthen broader LLM intelligence.
Vela converts behavior histories from 100K users into tasks across 91 templates. Filtering and trajectory selection retain approximately 75K training examples.
Fine-tuning Qwen3.6-35B-A3B improves performance on all ten evaluated benchmarks. Compared with the base model, Vela gains 11.5 points on VelaBench, with average gains of 6.2 points across four independent user-related benchmarks and 4.0 points across five general benchmarks.
Behavior records were anonymized before task construction. Their use was platform-authorized and underwent privacy and ethics review.
Happy to discuss the method, evaluation and applications!
Get this paper in your agent:
hf papers read 2610.14709 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 1
Collections including this paper 0
No Collection including this paper


