Academic Lecture 202160
Title:MoreOptimalWayto Optimizevia Fractional Calculusbeyond Nesterov
Speaker:Yangquan CHEN(University of California,Merced)
Time: 10:00-11:00,2021.11.1
Host: Ye YUAN
The lecture will be live on VooV meeting
About the Lecture...
It is now more and more widely accepted that for iterative optimization, it is logical to ask "What is the optimal way to optimize?" Nesterov accelerated gradient method (AGM) is introduced first and then Michael I Jordan's ICM18 talk is briefly reviewed. We reexamine the iteration-axis dynamics from control system point of view using z-transform and show that Nesterov scheme is a second order (lead-lag) dynamic system along iteration axis. In continuum limit, continuous-time system theory can be used for designing new iteration schemes. As an example, we introduce a continuous-time fractional order filter and then discretize it to form a new iterative scheme, resulting a potentially more optimal way to optimize. Stochastic AGM will also be discussed briefly with an indication of a potential benefit of using fractional order stochasticity in achieving more optimal way to optimize. It is hoped that this talk will open new research opportunities in machine learning in general and deep artificial neural network learning in particular.
About the Speaker...
Yangquan CHENearned his Ph.D. from Nanyang Technological University, Singapore, in 1998. He had been a faculty of Electrical Engineering at Utah State University (USU) from 2000-12. He joined the School of Engineering, University of California, Merced (UCM) in summer 2012 teaching "Mechatronics", "Engineering Service Learning" and "Unmanned Aerial Systems" for undergraduates; "Fractional Order Mechanics", "Linear Multivariable Control", "Nonlinear Controls" and "Advanced Controls: Optimality and Robustness" for graduates. His research interests include mechatronics for sustainability, cognitive process control (smart control engineering enabled by digital twins), small multi-UAV based cooperative multi-spectral "personal remote sensing", applied fractional calculus in controls, modeling and complex signal processing; distributed measurement and control of distributed parameter systems with mobile actuator and sensor networks. He received Research of the Year awards from both USU (2012) and UCM (2020). He was listed in Highly Cited Researchers by Clarivate Analytics in 2018-2021.
His lab website ishttp://mechatronics.ucmerced.edu/
Google scholar page:https://scholar.google.com/citations?user=RDEIRbcAAAAJ&hl=en
