AI for Spatial Storytelling: Going Beyond Generation with 3D World Models
"Discover how 3D world models are poised to transform animation and visual effects by moving beyond visual generation toward systems that can understand, simulate, and reason about space and time."
Session description, SIGGRAPH 2026 program
What was said
Ben Mildenhall co-founder, World Labs
- People with mastery are most equipped for this and are ready to go.
- The headlines make it seem like the tech landscape is turbulent, but that is not true. Teams are often working on things for quite a while.
- If you are constantly testing the newest thing, you are not, with your head down, working on something more intensively. That is probably to be avoided.
- What makes people's eyes light up now is the ability to make changes and have consistency across shots.
Nikola Todorovic co-founder, Wonder Dynamics (an Autodesk company)
- He comes from VFX and built the tool in order to make films himself.
- "We are turning more people into executives, enabling people to make films."
- Some pressure is good.
- In order to get to the goal, we had to be able to fix the last 20%. We are not there yet.
- What part of traditional production will we keep?
- We cannot prompt a performance. Acting is reacting, and we must have actors.
- Research is not about generation; it is about editability.
Pressing point raised by one of the speakers
- If it is this easy to make films, how do I get discovered? Discovery replaces production as the bottleneck, and it begs the next question: how will distribution be handled?
"You have to pay for that."
An opera singer in the Q&A, invited on the spot to sing after revealing herself, declined with these words, then spoke about how empowering it is to create worlds on her own.
About the companies · Wonder Dynamics (wonderdynamics.com) was co-founded by Nikola Todorovic and actor Tye Sheridan; its Wonder Studio tool automates CG character work; Autodesk acquired the company in 2024. World Labs (worldlabs.ai) is the spatial-intelligence startup co-founded by Fei-Fei Li together with Ben Mildenhall, a co-author of NeRF, alongside Justin Johnson and Christoph Lassner.