Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Announcements

Colloquium on Digital Transformation Science

April 8, 3 pm CT

Recent Advances in Analysis of Implicit Bias of Gradient Descent on Deep Networks

Matus Telgarsky, Assistant Professor of Computer Science, University of Illinois at Urbana-Champaign

REGISTER FOR ZOOM WEBINAR

The purpose of this talk is to highlight three recent directions in the study of implicit bias, a promising approach to developing a tight generalization theory for deep networks interwoven with optimization. The first direction is a warm-up with purely linear predictors: here, the implicit bias perspective gives the fastest known hard-margin SVM solver! The second direction is on the early training phase with shallow networks: here, implicit bias leads to good training and testing error, with not just narrow networks but also arbitrarily large ones. The talk concludes with deep networks, providing a variety of structural lemmas that capture foundational aspects of how weights evolve for any width and sufficiently large amounts of training. This is joint work with Ziwei Ji.

Matus Telgarsky is an Assistant Professor of Computer Science at the University of Illinois at Urbana-Champaign, specializing in deep learning theory. He received a PhD at the University of California, San Diego under Sanjoy Dasgupta. He co-founded the Midwest ML Symposium in 2017 with Po-Ling Loh and organized a Simons Institute summer 2019 program on deep learning with Samy Bengio, Aleskander Madry, and Elchanan Mossel. He received an NSF CAREER Award in 2018.

Quick Links:

C3.ai DTI Webpage

Events

Information on Call for Proposals

Proposal Matchmaking (Archive from 2020 CFP)

C3.ai DTI Training Materials

C3 Administration (password protected)


Have Questions? Please contact one of us:



Recent space activity

Recently Updated
typespage, comment, blogpost
max5
hideHeadingtrue
themesocial

Space contributors

Contributors
modelist
scopedescendants
limit5
showLastTimetrue
orderupdate


Announcing our Third Call for Proposals:

AI to Transform Cybersecurity and Secure Critical Infrastructure

It is anticipated that up to USD $10 million in Research Awards will be awarded from this Call for Proposals. Proposals can request funding of USD $100,000 to $1,000,000 for an initial period of one (1) year.

C3DTI will also make available up to USD $2 million in Azure Cloud computing resources, supercomputing resources at UIUC’s NCSA and LBNL’s NERSC, and free, unlimited access to the C3 AI Suite hosted on the Microsoft Azure Cloud. 

**** We will be offering a virtual session with information on the CFP including an opportunity to ask questions early in January. Please keep an eye out on you email and this wiki page for more information. ****

Proposals are Due February 7, 2022

Awards will be made in March 2022 with start dates of around June 1, 2022


Quick Links:

C3.ai DTI Webpage

Events

Information on Call for Proposals

Proposal Matchmaking

C3.ai DTI Training Materials Overview (password protected)

C3 Administration (password protected)


Have Questions? Please contact one of us:



Recent space activity

Recently Updated
typespage, comment, blogpost
max5
hideHeadingtrue
themesocial

Space contributors

Contributors
modelist
scopedescendants
limit5
showLastTimetrue
orderupdate