Introduction to the Concept of World Models: A Story from Psychology to the Main Battlefield of AI
**World Models: From Psychology to AI's Core Concept**
"World model" is a trending but often confusing term in AI, describing a system that allows machines to internally simulate, predict, and rehearse potential outcomes before taking real-world action—like a mental "sandbox."
While definitions vary—Yann LeCun emphasizes physical understanding, OpenAI's Sora is a video-based "world simulator," Google DeepMind's Genie 3 creates interactive 3D environments, and companies like Alibaba and Tesla focus on practical applications—the core goal is consistent: reduce reliance on vast real-world data by creating an internal, predictive model for safer and more efficient AI.
The concept has deep roots, tracing back to psychologist Kenneth Craik (1943). In AI, it was revitalized by researchers like David Ha and Jürgen Schmidhuber (2018). Major technical approaches include: 1) generative video models (e.g., Sora) for visual realism; 2) abstract predictive models (e.g., LeCun's JEPA) for efficiency and physical reasoning; and 3) explicit 3D simulators (e.g., NVIDIA Omniverse) for precision.
Fei-Fei Li proposes a classification based on the AI action loop: renderers (output observations), simulators (output world states), and planners (output actions). The emerging "World Action Model" (WAM) paradigm aims to unify future prediction and action generation.
An industry framework is forming: upstream (data, compute, sensors), midstream (general and vertical platforms), and downstream applications (autonomous driving, robotics, gaming, etc.). Autonomous driving is currently the most mature use case.
The current lack of a unified definition reflects the field's early, dynamic stage, similar to past tech revolutions. Different approaches—focusing on pixels, physics, or behavior—represent parallel explorations of how best to compress and understand the world. This diversity, while seemingly chaotic, signals that world models have moved from an academic idea to a critical industrial battleground, ultimately aiming to give machines the ability to understand, imagine, and reason about the world.
marsbit1h ago
