ISyE Seminar: "NextGen Robotics with Simulation and Pretraining"
Please join us for our next seminar of fall semester in person! This seminar will feature Ashish Kapoor from Microsoft Research who will discuss NextGen robotics.
3:30 p.m. - Graduate seminar
Walter Library, Room 402
4:30 p.m. - Reception, coffee and cookies
Walter Library, Room 401
Ashish Kapoor
General Manager, Autonomous Systems and Robotics
Microsoft Research, Redmond
About the seminar
There are fundamental shifts happening due to advances in Deep Learning as well as our ability to harness large amounts of computation on the cloud. Additionally, researchers are also seeing how Deep Machine Learning is changing the foundation of numerical computing and simulation. Kapoor and his colleagues build upon these observations and propose a different way to build robots and autonomous systems. Specifically, he'll discuss large scale data-driven and differentiable simulations and how they can help us design and train robotic systems. Secondly, Kapoor will highlight approaches that utilize large scale pre-trained models and discuss implications towards how we might build robots in the future.
Papers:
- Teaching a robot to see and navigate with simulation
- Just say the magic word: using language to program robots
- PACT: Perception-Action Causal Transformer for Autoregressive Robotics Pretraining
- COMPASS: COntrastive Multimodal Pretraining for Autonomous Systems
About the speaker
Ashish Kapoor is the Chief Scientist of the Autonomous Systems and Robotics Group at Microsoft, Redmond. His recent research focuses on safety, pre-training of deep models, and data-driven simulation for autonomous systems. Kapoor has a Ph.D. from the Massachusetts Institute of Technology and a Bachelor of Technology from the Indian Institute of Technology Delhi.