Loading Events

« All Events

  • This event has passed.

TILOS Seminar Series: On Policy Optimization Methods for Control

September 28, 2022 @ 10:00 am - 11:00 am

Please join us for our TILOS Seminar on Wednesday, September 28, 2022 at 10:00am PST / 1:00pm EST.

Title: On Policy Optimization Methods for Control

Speaker: Maryam Fazel, Professor, University of Washington

Abstract: Policy Optimization methods enjoy wide practical use in reinforcement learning (RL) for applications ranging from robotic manipulation to game-playing, partly because they are easy to implement and allow for richly parameterized policies. Yet their theoretical properties, from optimality to statistical complexity, are still not fully understood. To help develop a theoretical basis for these methods, and to bridge the gap between RL and control theoretic approaches, recent work has studied whether gradient-based policy optimization can succeed in designing feedback control policies.

In this talk, we start by showing the convergence and optimality of these methods for linear dynamical systems with quadratic costs, where despite nonconvexity, convergence to the optimal policy occurs under mild assumptions. Next, we make a connection between convex parameterizations in control theory on one hand, and the Polyak-Lojasiewicz property of the nonconvex cost function, on the other. Such a connection between the nonconvex and convex landscapes provides a unified view towards extending the results to more complex control problems.

Bio: Maryam Fazel is the Moorthy Family Professor of Electrical and Computer Engineering at the University of Washington, with adjunct appointments in Computer Science and Engineering, Mathematics, and Statistics. Maryam received her MS and PhD from Stanford University, and her BS from Sharif University of Technology in Iran, and was a postdoctoral scholar at Caltech before joining UW. She is a recipient of the NSF Career Award, UWEE Outstanding Teaching Award, and a UAI conference Best Student Paper Award with her student. She directs the Institute for Foundations of Data Science (IFDS), a multi-site NSF TRIPODS Institute. Her current research interests are in the area of optimization in machine learning and control.

Join Zoom Meeting

https://ucsd.zoom.us/j/99334315002

Meeting ID: 993 3431 5002

One tap mobile

+12133388477, 99334315002# US (Los Angeles)

+16692192599, 99334315002# US (San Jose)

Dial by your location

        +1 213 338 8477 US (Los Angeles)

        +1 669 219 2599 US (San Jose)

        +1 669 900 6833 US (San Jose)

Meeting ID: 993 3431 5002

Find your local number: https://ucsd.zoom.us/u/ad8KhZsMT5

Details

Date:
September 28, 2022
Time:
10:00 am - 11:00 am

Organizer

HDSI

Venue

Zoom