Logo eprints

Suboptimal Solutions to Dynamic Optimization Problems via Approximations of the Policy Functions

Gnecco, Giorgio and Sanguineti, Marcello Suboptimal Solutions to Dynamic Optimization Problems via Approximations of the Policy Functions. Journal of Optimization Theory and Applications, 146 (3). pp. 764-794. ISSN 0022-3239 (2010)

Full text not available from this repository.


The approximation of the optimal policy functions is investigated for dynamic optimization problems with an objective that is additive over a finite number of stages. The distance between optimal and suboptimal values of the objective functional is estimated, in terms of the errors in approximating the optimal policy functions at the various stages. Smoothness properties are derived for such functions and exploited to choose the approximating families. The approximation error is measured in the supremum norm, in such a way to control the error propagation from stage to stage. Nonlinear approximators corresponding to Gaussian radial-basis-function networks with adjustable centers and widths are considered. Conditions are defined, guaranteeing that the number of Gaussians (hence, the number of parameters to be adjusted) does not grow “too fast” with the dimension of the state vector. The results help to mitigate the curse of dimensionality in dynamic optimization. An example of application is given and the use of the estimates is illustrated via a numerical simulation.

Item Type: Article
Identification Number: 10.1007/s10957-010-9680-7
Projects: Partially supported by a grant “Progetti di Ricerca di Ateneo 2008” of the University of Genoa, Project “Solution of Functional Optimization Problems by Nonlinear Approximators and Learning from Data”
Uncontrolled Keywords: Dynamic optimization; Dynamic programming; Suboptimal policies; Approximation schemes; Curse of dimensionality
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Research Area: Computer Science and Applications
Depositing User: Giorgio Gnecco
Date Deposited: 13 Sep 2013 10:30
Last Modified: 16 Sep 2013 12:03
URI: http://eprints.imtlucca.it/id/eprint/1715

Actions (login required)

Edit Item Edit Item