Announcements
- Colloquium on Digital Transformation Science
November 12, 3 pm CT
Mathematics of Deep Learning
René Vidal, Herschel L. Seder Professor of Biomedical Engineering and Director of the Mathematical Institute for Data Science, Johns Hopkins University
The past few years have seen a dramatic increase in the performance of recognition systems, thanks to the introduction of deep networks for representation learning. However, the mathematical reasons for this success remain elusive. For example, a key issue is that the neural network training problem is non-convex, hence optimization algorithms may not return a global minima. In addition, the regularization properties of algorithms such as dropout remain poorly understood. The first part of this talk will overview recent work on the theory of deep learning that aims to understand how to design the network architecture, how to regularize the network weights, and how to guarantee global optimality. The second part of this talk will present sufficient conditions to guarantee that local minima are globally optimal and that a local descent strategy can reach a global minima from any initialization. Such conditions apply to problems in matrix factorization, tensor factorization, and deep learning. The third part of this talk will present an analysis of the optimization and regularization properties of dropout for matrix factorization in the case of matrix factorization.
René Vidal is the Herschel Seder Professor of Biomedical Engineering and Director of the Mathematical Institute for Data Science at Johns Hopkins University. He is also an Amazon Scholar, Chief Scientist at NORCE, and Associate Editor in Chief of TPAMI. His current research focuses on the foundations of deep learning and its applications in computer vision and biomedical data science. He is an AIMBE Fellow, IEEE Fellow, IAPR Fellow, and Sloan Fellow, and has received numerous awards for his work, including the D’Alembert Faculty Award, J.K. Aggarwal Prize, ONR Young Investigator Award, NSF CAREER Award, and best paper awards in machine learning, computer vision, controls, and medical robotics.
Quick Links:
Information on Call for Proposals
Training Materials (password protected)
C3 Administration (password protected)
Have Questions? Please contact one of us:
- Jay Roloff, jayr@illinois.edu (Executive Director, c3.ai.DTI)
- R. Srikant, rsrikant@illinois.edu (Co-Director, c3.ai.DTI)
- Tandy Warnow, warnow@illinois.edu (Co-chief Scientist, c3.ai.DTI)