The Global Landscape of Neural Networks: An Overview.
Ruoyu Sun, Dawei Li, Shiyu Liang, Tian Ding and Rayadurgam Srikant. (2020). "The Global Landscape of Neural Networks: An Overview. " IEEE Signal Processing Magazine. 37.5 (2020): 95-108.
CV
Education
- Ph.D in Version Control Theory, GitHub University, 2018 (expected)
- M.S. in Jekyll, GitHub University, 2014
- B.S. in GitHub, GitHub University, 2012
Work experience
- Spring 2024: Academic Pages Collaborator
- Github University
- Duties includes: Updates and improvements to template
- Supervisor: The Users
- Fall 2015: Research Assistant
- Github University
- Duties included: Merging pull requests
- Supervisor: Professor Hub
- Summer 2015: Research Assistant
- Github University
- Duties included: Tagging issues
- Supervisor: Professor Git
Skills
- Skill 1
- Skill 2
- Sub-skill 2.1
- Sub-skill 2.2
- Sub-skill 2.3
- Skill 3
Publications
Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations
Tian Ding, Dawei Li, and Ruoyu Sun. (2022). "Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations." Mathematics of Operations Research. 47.4 (2022): 2784-2814.
RMSprop Converges with Proper Hyper-Parameter
Naichen Shi, Dawei Li, Mingyi Hong, Ruoyu Sun. (2021). "RMSprop Converges with Proper Hyper-Parameter. " International Conference on Learning Representation. 2021.
On the Benefit of Width for Neural Networks: Disappearance of Basins
Dawei Li, Tian Ding, and Ruoyu Sun. (2022). "On the benefit of width for neural networks: Disappearance of basins." SIAM Journal on Optimization. 32.3 (2022): 1728-1758.
On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method
Dawei Li, Ruoyu Sun. (2021). "On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method. " Preprint.. 2021.
NTK-SAP: Improving Neural Network Pruning by Aligning Training Dynamics
Yite Wang, Dawei Li, Ruoyu Sun. (2023). "NTK-SAP: Improving Neural Network Pruning by Aligning Training Dynamics. " International Conference on Learning Representation. 2023.
Talks
Conference Proceeding talk 3 on Relevant Topic in Your Field
Conference proceedings talk at Testing Institute of America 2014 Annual Conference, Los Angeles, CA
Talk 2 on Relevant Topic in Your Field
Talk at London School of Testing, London, UK
Tutorial 1 on Relevant Topic in Your Field
Tutorial at UC-Berkeley Institute for Testing Science, Berkeley CA, USA
Talk 1 on Relevant Topic in Your Field
Talk at UC San Francisco, Department of Testing, San Francisco, California
Teaching
Service and leadership
- Currently signed in to 43 different slack teams