Human-Centric Intelligence in the Era of Foundation Models: A Survey
Abstract
This survey proposes a unified taxonomy and methodological framework for human-centric intelligence across visual, dynamic, and embodied levels within the foundation-model era.
Human-centric intelligence is evolving in the foundation-model era, with growing emphasis on scale, transferability, and general-purpose modeling. Yet it has not fully integrated with foundation models to achieve the comparable progress seen in them. More importantly, recent advances across this broad landscape remain fragmented across tasks, modalities, and research communities, leaving their intrinsic conceptual and methodological connections unclear. To bridge these divides and rethink human-centric intelligence in the foundation-model era, we introduce a full-spectrum human context taxonomy that integrates six interconnected levels by viewing humans as observable subjects through visual appearance and spatial geometry, as dynamic actors through kinematic dynamics and interaction modeling, and as situated agents through world simulation and embodied agency. We next present the methodological foundations of the field, covering human-centric data families, computational architecture paradigms, and representative training and inference optimization strategies. We then systematically review representative methods across these levels and organize the associated datasets, benchmarks, and evaluation metrics. We further discuss open challenges and promising research directions toward human-centric intelligence that is scalable, trustworthy, physically grounded, and deployable, aiming to provide a coherent framework and practical reference for advancing the field. Finally, we provide a systematically organized and continuously updated collection of human-centric AI literature and resources on our project page.
Community
We are pleased to share Human-Centric Intelligence in the Era of Foundation Models: A Survey.
This survey presents a full-spectrum view of human-centric intelligence through six interconnected context levels: visual appearance, spatial geometry, kinematic dynamics, interaction modeling, world simulation, and embodied agency. We systematically organize the methodological foundations, representative methods, datasets, benchmarks, evaluation metrics, and future directions of the field.
We also maintain a continuously updated, community-driven collection of human-centric AI resources and warmly invite interested contributors to join us in expanding it.
๐ Project Page: https://cseeyangchen.github.io/Human-Centric-AI/homepage/
๐ป GitHub Resources: https://github.com/cseeyangchen/Human-Centric-AI
Get this paper in your agent:
hf papers read 2608.18184 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper