Robotics and Artificial Intelligence

Three CS&E papers accepted to NeurIPS 2021
The Conference on Neural Information Processing Systems (NeurIPS) highlights research advances in artificial intelligence and machine learning.

'Smart hug' tech aims to improve health and well-being
Prototype system uses voice-based conversation and physiological data to monitor the stress level of a user, and if needed, offers a calming hug.

Researchers use 3D motion capture to study Minnesota Zoo monkeys
The study, on which CS&E assistant professor Hyun Soo Park is a collaborator, holds new insights for neuroscience and behavioral science.

CS&E wins best paper honorable mention at CVPR 2021
The work by Ph.D. student Yasamin Jafarian and assistant professor Hyun Soo Park used TikTok dance videos to learn high fidelity depths of dressed humans.

UMN robotics research showcased at ICRA 2021
Four papers from C&SE faculty and students will be shared during the 2021 International Conference on Robotics and Automation.

COVID-19 can't stop the Cowbot autonomous mower!
The project is a collaboration between the West Central Research and Outreach Center (WCROC), The Toro Company, and CS&E's Robotic Sensor Networks Lab.

Professor Isler featured in UMN Plant Breeding Seminar series
In the talk, he discusses how plant breeding and agriculture is an interesting research domain for robotics, and shares examples of relevant work from his lab.

Building a brighter future with robotics
From exploring shipwrecks to air-dropping supplies in a pandemic, CS&E faculty and students are designing robots for the 21st century.

AI helps scientists understand brain activity behind thoughts
CS&E associate professor Paul Schrater is part of the team who, for the first time, developed a method to measure thoughts.

CSE team receives $1.2 million NSF grant to develop smart e-scooters
CS&E assistant professor Ju Sun is part of the team aiming to add tracking systems on electric scooters to improve safety of riders on the road.

Researchers develop AI algorithm to analyze chest X-rays for COVID-19
Ju Sun is on a team that developed and validated an artificial intelligence algorithm that can evaluate chest X-rays to diagnose possible cases of COVID-19.

New discovery allows 3D printing of sensors directly on expanding organs
A team, including CS&E's Hyun Soo Park, is developing technology that could help diagnose and monitor COVID-19 patients.

Tinkering in different buoyancies
Minnebot, the amphibious robot that ultimately could help improve our knowledge of water quality in the state—and beyond.
Artificial Intelligence (AI) is a general term that implies the use of a computer to model and/or replicate intelligent behavior. Research in AI focuses on the development and analysis of algorithms that learn and/or perform intelligent behavior with minimal human intervention. These techniques have been and continue to be applied to a broad range of problems that arise in robotics, e-commerce, medical diagnosis, gaming, mathematics, and military planning and logistics, to name a few. Several research groups fall under the general umbrella of AI in the department, but are disciplines in their own right, including: robotics, natural language processing (NLP), computer vision, computational biology, and e-commerce. Specifically, research is being conducted in estimation theory, mobility mechanisms, multi-agent negotiation, natural language interfaces, machine learning, active computer vision, probabilistic language models for use in spoken language interfaces, and the modeling and integration of visual, haptic, auditory and motor information.
Faculty










Labs and selected projects
- Artificial Intelligence, Robotics, and Vision Lab Maria Gini and Nikolaos Papanikolopoulos
- Interactive Robotics and Vision Laboratory Junaed Sattar
- Visual Information Processing Lab Catherine Qi Zhao
- Computational Perception and Action Lab Paul Schrater
- Applied Motion Lab Stephen Guy
- Monitoring Human Activity Nikolaos Papanikolopoulos
- Robotic Sensor Networks Lab Volkan Isler
- MAGNET: Intelligent Agents for Electronic Commerce Maria Gini
- TAC-SCM: Autonomous Agents for Supply-Chain Management Maria Gini
- Visual Computing and AI Seminar
- UMN Machine Learning Seminar Series
Related centers and programs
Latest research projects, publications, and talks

Early Stopping for Deep Image Prior [preprint]
Posted December 11, 2021
Hengkang Wang (Ph.D. student), Taihui Li (Ph.D. student), Zhong Zhuang (Ph.D. student), Tiancong Chen (Ph.D. student), Hengyue Liang, Ju Sun (assistant professor)

Iterative Methods for Private Synthetic Data: Unifying Framework and New Methods [conference paper]
Posted December 7, 2021
Terrance Liu, Giuseppe Vietri (Ph.D. student), Steven Wu (adjunct assistant professor)
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS)

Learning to Predict Trustworthiness with Steep Slope Loss [conference paper]
Posted December 7, 2021
Yan Luo (Ph.D. student), Yongkang Wong, Mohan S Kankanhalli, Qi Zhao (associate professor)
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS)

Dense Keypoints via Multiview Supervision [conference paper]
Posted December 7, 2021
Zhixuan Yu (Ph.D. student), Haozheng Yu (M.S. 2021), Long Sha, Sujoy Ganguly, Hyun Soo Park (assistant professor)
Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS)

Fast Direct Stereo Visual SLAM [preprint]
Posted December 3, 2021
Jiawei Mo (Ph.D. student), Md Jahidul Islam (Ph.D. 2021), Junaed Sattar (assistant professor)

Predicting Energy Consumption of Ground Robots On Uneven Terrains [journal]
Posted November 25, 2021
Minghan Wei (Ph.D. student), Volkan Isler (professor)
IEEE Robotics and Automation Letters

Attention to Action: Leveraging Attention for Object Navigation [conference paper]
Posted November 22, 2021
Shi Chen (Ph.D. student), Qi Zhao (associate professor)
The 32nd British Machine Vision Conference (BMVC)

Online Coverage Planning for an Autonomous Weed Mowing Robot with Curvature Constraints [preprint]
Posted November 19, 2021
Parikshit Maini (postdoctoral researcher), Burak M Gonultas, Volkan Isler (professor)

IMU-Assisted Learning of Single-View Rolling Shutter Correction [conference paper]
Posted November 8, 2021
Jaiwei Mo (Ph.D. student), Md Jahidul Islam (Ph.D. 2021), Junaed Sattar (assistant professor)
Conference on Robot Learning (CoRL)

Using Monocular Vision and Human Body Priors for AUVs to Autonomously Approach Divers [preprint]
Posted November 5, 2021
Michael Fulton (Ph.D. student), Jungseok Hong (Ph.D. student), Junaed Sattar (assistant professor)
More About Research areas
- Architectures, Compiler Optimization, and Embedded Systems
- Bioinformatics and Computational Biology
- Data Mining, Databases, and Geographical Information Systems
- Graphics and Immersive Computing
- High Performance Computing
- Human Computer Interaction (HCI)
- Networks, Distributed Systems, and Security
- Software Engineering and Programming Languages
- Theoretical Foundations