Skip to Main content Skip to Navigation
Journal articles

Symmetry reduction for dynamic programming

Abstract : We present a method of exploiting symmetries of discrete-time optimal control problems to reduce the dimensionality of dynamic programming iterations. The results are derived for systems with continuous state variables, and can be applied to systems with continuous or discrete symmetry groups. We prove that symmetries of the state update equation and stage costs induce corresponding symmetries of the optimal cost function and the optimal policies. We then provide a general framework for computing the optimal cost function based on gridding a space of lower dimension than the original state space. This method does not rely on explicitly transforming the state update equations and can therefore be applied in circumstances where this is difficult. We illustrate these results on two six-dimensional optimal control problems that are computationally difficult to solve by dynamic programming without symmetry reduction.
Document type :
Journal articles
Complete list of metadata

Cited literature [35 references]  Display  Hide  Download
Contributor : Silvere Bonnabel Connect in order to contact the contributor
Submitted on : Wednesday, January 16, 2019 - 12:30:49 AM
Last modification on : Wednesday, November 17, 2021 - 12:31:05 PM


Files produced by the author(s)



John Maidens, Axel Barrau, Silvère Bonnabel, Murat Arcak. Symmetry reduction for dynamic programming. Automatica, Elsevier, 2018, ⟨10.1016/j.automatica.2018.08.024⟩. ⟨hal-01982793⟩



Record views


Files downloads