Sitemap

A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.

Pages

Posts

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

portfolio

publications

Brownian Bandits

Published in , 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Barış Ata, J. Michael Harrison, Dawei Li. "Brownian Bandits

NTK-SAP: Improving Neural Network Pruning by Aligning Training Dynamics

Published in International Conference on Learning Representation, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Yite Wang, Dawei Li, Ruoyu Sun. (2023). "NTK-SAP: Improving Neural Network Pruning by Aligning Training Dynamics. " International Conference on Learning Representation. 2023.

On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method

Published in Preprint, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Dawei Li, Ruoyu Sun. (2021). "On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method. " Preprint.. 2021.

On the Benefit of Width for Neural Networks: Disappearance of Basins

Published in SIAM Journal on Optimization, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Dawei Li, Tian Ding, and Ruoyu Sun. (2022). "On the benefit of width for neural networks: Disappearance of basins." SIAM Journal on Optimization. 32.3 (2022): 1728-1758.

RMSprop Converges with Proper Hyper-Parameter

Published in International Conference on Learning Representation, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Naichen Shi, Dawei Li, Mingyi Hong, Ruoyu Sun. (2021). "RMSprop Converges with Proper Hyper-Parameter. " International Conference on Learning Representation. 2021.

Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations

Published in Mathematics of Operations Research, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Tian Ding, Dawei Li, and Ruoyu Sun. (2022). "Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations." Mathematics of Operations Research. 47.4 (2022): 2784-2814.

The Global Landscape of Neural Networks: An Overview.

Published in IEEE Signal Processing Magazine, 1900

The contents above will be part of a list of publications, if the user clicks the link for the publication than the contents of section will be rendered as a full page, allowing you to provide more information about the paper for the reader. When publications are displayed as a single page, the contents of the above “citation” field will automatically be included below this section in a smaller font.

Recommended citation: Ruoyu Sun, Dawei Li, Shiyu Liang, Tian Ding and Rayadurgam Srikant. (2020). "The Global Landscape of Neural Networks: An Overview. " IEEE Signal Processing Magazine. 37.5 (2020): 95-108.

talks

teaching

Teaching

, , 1900

University of Illinois at Urbana-Champaign