Ego2World: Compiling Egocentric Cooking Videos into Executable Worlds for Belief-State Planning
Overview
Ego2World turns egocentric real-world videos into an executable symbolic simulator for large-model embodied agents.
Positioning
The project targets long-horizon task planning, belief-state maintenance, error recovery, and execution under partial observability.
Status
The paper is under review and forms part of the broader Egocentric Compilation research line.
Evaluation
The public preprint evaluates six planners on 105 tasks. In a separate paired Qwen-Plus experiment, persistent belief raises action validity by 4.15 percentage points and reduces visual-query attempts by 90.27%, with higher token use and no detected completion gain. These findings distinguish valid execution from actual goal attainment.