IMMERSED IN: Embodied AI
Developing realistic humanoid agents
DATE: Wednesday, November 17, 2021
TIME: 11 a.m. – 12 p.m. EST
LOCATION: Join via Zoom.
SPEAKER: Jeremy Schwartz, senior Unity 3D engineer and project lead
Abstract
ThreeDWorld (TDW) is a multimodal simulation platform for physical scene interaction that uses state-of-the-art video game technology to generate photo-realistic scenes in a virtual world. TDW’s flexible, general design allows researchers to collect next-generation experimental data and generate large-scale datasets for training AI systems with complete control over data generation and full access to all associated generative parameters. TDW was developed at MIT’s Department of Brain and Cognitive Sciences, in conjunction with the MIT-IBM Watson AI Lab.
Jeremy Schwartz, the TDW project lead, will present an overview of the platform, with particular focus on recent and in-progress work around the development of realistic humanoid agents for embodied AI simulations. These virtual characters can serve as either full-body “avatars” for human users in VR, or as AI agents capable of performing typical day-to-day human activities and behaviors, their actions derived from motion-capture data.
About JEREMY SCHWARTZ
Jeremy Schwartz is the project lead for TDW. He is a veteran interactive technology developer and CGI production manager, who has worked for many years in the video game industry. While at Electronic Arts and Acclaim Entertainment, he ran studio operations for motion capture and audio/video post-production, and managed 3D animation and tool-development teams. Jeremy also spent several years as a technology analyst with Forrester Research and has worked for design consultancies and interactive agencies developing both digital and hybrid physical/digital interactive experiences.
about immersed
IMMERSED is a monthly seminar in which we explore the possibilities enabled by immersive technology and interactive experiences. Technologies such as motion capture, virtual and augmented reality, photogrammetry, and related computational advances bestow the power to gather, process, and interact with data from multiple modalities, providing unique insights and fostering interdisciplinary collaborations.
IMMERSED examines how immersive technology is shaping innovations across the sciences and the arts through a mix of lectures, demonstrations, and tutorials. IMMERSED is sponsored by the MIT.nano Immersion Lab, which provides space, tools, and a platform to connect scientists, engineers, artists, performers, and others through creative projects that bridge multiple disciplines.
To receive event announcements, sign up for our email list.