Past events

ML Seminar: Haizhao Yang

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Tuesday from 11 a.m. - 12 p.m. during the spring 2023 semester.

This week's speaker, Professor Haizhao Yang (University of Maryland), will be giving a talk titled "Finite Expression Method: A Symbolic Approach for Scientific Machine Learning".

Abstract

Machine learning has revolutionized computational science and engineering with impressive breakthroughs, e.g., making the efficient solution of high-dimensional computational tasks feasible and advancing domain knowledge via scientific data mining. This leads to an emerging field called scientific machine learning. In this talk, we introduce a new method for a symbolic approach to solve scientific machine learning problems. This method seeks interpretable learning outcomes in the space of functions with finitely many analytic expressions and, hence, this methodology is named the finite expression method (FEX). It is proved in approximation theory that FEX can avoid the curse of dimensionality in discovering high-dimensional complex systems. As a proof of concept, a deep reinforcement learning method is proposed to implement FEX for learning the solution of high-dimensional PDEs and learning the governing equations of raw data.

Haizhao Yang's personal website

ML Seminar: Yifan Peng

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Yifan Peng (Cornell), will be giving a talk titled "Clinical natural language processing and deep learning in assisting medical image analysis".

Abstract

Medical imaging has been a common examination in daily clinical routines for screening and diagnosis of a variety of diseases. Although hospitals have accumulated a large number of image exams and associated reports, it is yet challenging to use them to build high-precision computer-aided diagnosis systems effectively. In this talk, I will present an overview of cutting-edge techniques for mining existing free-text report data to assist medical image analysis via natural language processing and deep learning. Specifically, I will discuss both pattern-based and machine learning-based methods to detect findings/diseases and their attributes (e.g., type, location, size) from the chest x-ray and CT reports. Using these methods, we can construct large-scale medical image datasets with rich information. I will also demonstrate three case studies of medical image analysis using these datasets: (i) common thorax disease detection and report generation from chest X-rays and (ii) lesion detection and segmentation from CT images.

Biography

Dr. Peng is an assistant professor at the Department of Population Health Sciences at Weill Cornell Medicine. His main research interests include BioNLP and medical image analysis. Before joining Cornell Medicine, Dr. Peng was a research fellow at the National Center for Biotechnology Information (NCBI), the National Library of Medicine (NLM), National Institutes of Health (NIH). He obtained his Ph.D. degree from the University of Delaware. During his doctoral training, he investigated applications of machine learning in biomedical text-mining, with a focus on deep analysis of the linguistic structures of biomedical texts.

ML Seminar: Zhengyuan Zhou

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Zhengyuan Zhou (New York University Stern School of Business, Department of Technology, Operations and Statistics), will be giving a talk titled "Optimal No-Regret Learning in Repeated First-Price Auctions".

Abstract

First-price auctions have very recently swept the online advertising industry, replacing second-price auctions as the predominant auction mechanism on many platforms for display ads bidding. This shift has brought forth important challenges for a bidder: how should one bid in a first-price auction, where unlike in second-price auctions, it is no longer optimal to bid one's private value truthfully and hard to know the others' bidding behaviors?

In this talk, we take an online learning angle and address the fundamental problem of learning to bid in repeated first-price auctions. We discuss our recent work in leveraging the special structures of the first-price auctions to design minimax optimal no-regret bidding algorithms. 

Biography

Zhengyuan Zhou is currently an assistant professor in New York University Stern School of Business, Department of Technology, Operations and Statistics. Before joining NYU Stern, Professor Zhou spent the year 2019-2020 as a Goldstine research fellow at IBM research. He received his BA in Mathematics and BS in Electrical Engineering and Computer Sciences, both from UC Berkeley, and subsequently a PhD in Electrical Engineering from Stanford University in 2019. His research interests lie at the intersection of machine learning, stochastic optimization and game theory and focus on leveraging tools from those fields to develop methodological frameworks to solve data-driven decision-making problems.

Graduate Programs Online Information Session

RSVP today!.

During each session, the graduate staff will review:

  • Requirements (general)
  • Applying
  • Prerequisite requirements
  • What makes a strong applicant
  • Funding
  • Resources
  • Common questions
  • Questions from attendees

Students considering the following programs should attend:

Data Science Poster Fair

We invite you to attend the Fall 2022 Data Science Poster Fair! This semester's event will be held on Friday, December 2 from 10 a.m. - 12 p.m.

ML Seminar: Xiaoran Sun

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Xiaoran Sun (FSS, UMN), will be giving a talk titled "Machine Learning for Human Development and Family Research: An Overview and an Example".

Abstract

This talk will first provide a brief overview about the utility of machine learning (ML) in research on developmental and family science by presenting what ML can offer in the face of theories and research questions in this field. Then the talk will introduce a study using a literature-driven supervised ML approach for empirical synthesis on how family experiences during adolescence predict future educational outcomes in adulthood. Based on the utility and the empirical synthesis example, there will be a discussion about future steps for how we can expand on the use of ML in social science research. Note that this talk will be focused on the applications of ML instead of technical details of advancing  ML itself. Questions, discussions, and comments will all be super appreciated given the project is still in its development stage.

Biography

Xiaoran Sun is an assistant professor in the Department of Family Social Science at the University of Minnesota. She is also a faculty affiliate of the Learning Informatics Lab in the College of Education and Human Development and of the Data Science Initiative. She obtained her PhD in Human Development and Family Studies from the Pennsylvania State University with an NSF traineeship on Big Data Social Science. Before joining UMN she was a postdoctoral scholar at Stanford University in the Departments of Pediatrics and Communication and a Stanford Data Science scholar. She uses ML in her research on family systems and adolescent development.

IMA Data Science Seminar - Benefits of Weighted Training in Machine Learning and PDE-based Inverse Problems

The speaker this week is Yunan Yang from ETH Zürich/Cornell. Yunan's research interests are in Numerical Analysis, Inverse Problems, Nonconvex Optimization, Optimal Transport, and Machine Learning. The title and abstract for her talk are below.

Title: Benefits of Weighted Training in Machine Learning and PDE-based Inverse Problems

You may attend the talk either in person in Walter 402 or register via Zoom. Registration is required to access the Zoom webinar.

Abstract: Many models in machine learning and PDE-based inverse problems exhibit intrinsic spectral properties, which have been used to explain the generalization capacity and the ill-posedness of such problems. In this talk, we discuss weighted training for computational learning and inversion with noisy data. The highlight of the proposed framework is that we allow weighting in both the parameter space and the data space. The weighting scheme encodes both a priori knowledge of the object to be learned and a strategy to weight the contribution of training data in the loss function. We demonstrate that appropriate weighting from prior knowledge can improve the generalization capability of the learned model in both machine learning and PDE-based inverse problems.

ML Seminar: Sijia Liu

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Sijia Liu (Michigan State University), will be giving a talk titled "Robust and Efficient Neural Network Training: A New Bi-level Learning Paradigm".

Abstract

This talk will introduce Bi-level Machine Learning (BML), an emerging but overlooked topic rooted in bi-level optimization (BLO), to tackle the recent neural network training challenges in robust and efficient AI. In the first part, I will revisit adversarial training (AT)–a widely recognized training mechanism to gain adversarial robustness of deep neural networks–from a fresh BML viewpoint. Built upon that, I will introduce a new theoretically-grounded and computationally-efficient robust training algorithm termed Fast Bi-level AT (Fast-BAT), which can defend sign-based projected gradient descent (PGD) attacks without using any gradient sign method or explicit robust regularization.

In the second part, I will move to a sparse learning paradigm that aims at pruning large-scale neural networks for improved generalization and efficiency. As demonstrated by the Lottery Ticket Hypothesis (LTH), iterative magnitude pruning (IMP) is the predominant sparse learning method to successfully find ‘winning’ sparse sub-networks. Yet, the computation cost of IMP grows prohibitively as the sparsity ratio increases. I will show that BML provides a graceful algorithmic foundation for model pruning and helps us close the gap between pruning accuracy and efficiency. Please see the references and codes at Sijia Liu's GitHub repository.

Biography

Dr. Sijia Liu is currently an Assistant Professor at the Department of Computer Science and Engineering, Michigan State University, and an Affiliated Professor at the MIT-IBM Watson AI Lab, IBM Research. His research spans the areas of machine learning, optimization, computer vision, signal processing, and computational biology, with a recent focus on Trustworthy and Scalable ML. He received the Best Paper Runner-Up Award at the Conference on Uncertainty in Artificial Intelligence (UAI) in 2022 and the Best Student Paper Award at the 42nd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) in  2017. He has published over 60 papers at top-tier ML/AI conferences and (co-)organized several tutorials and workshops on Trustworthy AI and Optimization for Deep Learning at KDD, AAAI, CVPR, and ICML, to name a few.

ML Seminar: Yifan Peng

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Yifan Peng (PHS, Cornell U.), will be giving a talk.

ML Seminar: AI and Future of Healthcare

The UMN Machine Learning Seminar Series brings together faculty, students, and local industrial partners who are interested in the theoretical, computational, and applied aspects of machine learning, to pose problems, exchange ideas, and foster collaborations. The talks are every Wednesday from 11 a.m. - 12 p.m. during the Fall 2022 semester.

This week's speaker, Juggy Jagannathan (3M health), will be giving a talk titled "AI and Future of Healthcare."

Abstract

AI technology is permeating every aspect of healthcare. It is transforming how care is provided in acute, ambulatory and home settings. It is transforming how population health is being managed. AI in combination with other disciplines, such as genetics and virtual reality, is accelerating innovative treatments. Drug discovery and clinical trials are being transformed. This presentation will provide an overview of where AI is already being used and prognosis for the immediate future.

Biography

V. “Juggy” Jagannathan, PhD, researches artificial intelligence and computer science for 3M Health Information Systems, developing new natural language and deep learning technologies that automatically structure patient-physician conversations into clinical documents. As an AI researcher with over four decades in the field, Juggy’s background includes both industry technology development and academia. The company he founded in 1996 with technology from West Virginia University (WVU) was acquired by M*Modal in 2003 and he has been with the company ever since. He is also an adjunct professor teaching Computer Science and Natural Language Processing (NLP) at WVU. Juggy is a tennis nut, golf nut and a yoga nut. In short, a nut.