Benchmarking Embodied AI for Everyday Household Tasks with Physics Simulation

Introduction

Despite experiencing rapid progress over the past few years, embodied artificial intelligence (EAI) continues to face significant challenges in producing agents that can convincingly perform diverse tasks in everyday environments. Such agents need to perceive, reason, and act in both dynamic and unstructured settings, which can be both costly and dangerous to immediately develop in the real world. As a result, the research community has developed scalable and controllable EAI benchmarks in simulation to enable both safe and reproducible evaluation. We are hosting this workshop to provide insights and responses to important questions related to this effort, namely:

Where are we in terms of achieving generalizable EAI solutions in everyday tasks? How do current EAI solutions perform in some of the most challenging benchmarks?
How can we design unified metrics that fairly compare methods across EAI simulators?
How can simulation tools be better leveraged when exploring EAI, such as for data collection, scaling laws, and generalization capabilities?
How can we leverage generative models, foundation models, and various real-to-sim techniques to build better simulators for EAI?
How has recent progress helped tackle sim-to-real (domain) gaps?
How can we encourage community-contributed tasks, assets, and evaluation while maintaining quality control, versioning, and long-term support for EAI simulators?
How can we make EAI simulators more accessible for educational purposes?

To foster engagement and promote intellectually stimulating discussions, our workshop will be a mixture of eight invited talks, a formal debate, a panel discussion, and two embodied AI simulation challenges.

Event	Date
Call for Papers	TBA
Submission Deadline	TBA
Notification	TBA
Camera-Ready	TBA
Workshop Date	TBA

Workshop Schedule (Tentative)

Time	Program
9:00-9:10	Opening remarks
9:10-10:30	Four keynote talks (20min each)
10:30-10:45	Spotlight paper talks (5min each)
11:00-11:40	Two keynote talks (20min each)
11:40-12:20	Debate session (40min)
12:30-13:30	Student mentoring lunch session
13:00-14:00	Poster session
14:10-14:50	Two keynote talks (20min each)
14:50-15:30	Challenge overview, results (20min each)
15:30-16:10	Winning teams presentation (10min each)
16:10-17:00	Panel discussion, Q&A (40min)
17:00-17:15	Closing remarks