relation: http://eprints.imtlucca.it/1784/
title: Suboptimal Policies for Stochastic N-Stage Optimization Problems: Accuracy Analysis and a Case Study from Optimal Consumption
creator: Gaggero, Mauro
creator: Gnecco, Giorgio
creator: Sanguineti, Marcello
subject: QA75 Electronic computers. Computer science
description: Dynamic Programming formally solves stochastic optimization problems with an objective that is additive over a finite number of stages. However, it provides closed-form solutions only in particular cases. In general, one has to resort to approximate methodologies. In this chapter, suboptimal solutions are searched for by approximating the decision policies via linear combinations of Gaussian and sigmoidal functions containing adjustable parameters, to be optimized together with the coefficients of the combinations. These approximation schemes correspond to Gaussian radial-basis-function networks and sigmoidal feedforward neural networks, respectively. The accuracies of the suboptimal solutions are investigated by estimating the error propagation through the stages. As a case study, we address a multidimensional problem of optimal consumption under uncertainty, modeled as a stochastic optimization task with an objective that is additive over a finite number of stages. In the classical one-dimensional context, a consumer aims at maximizing over a given time horizon the discounted expected value of consumption of a good, where the expectation is taken with respect to a stochastic interest rate. The consumer has an initial wealth and at each time period earns an income, modeled as an exogenous input. We consider a multidimensional framework, in which there are d>1 consumers that aim at maximizing a social utility function. First we provide conditions that allow one to apply our estimates to such a problem; then we present a numerical analysis.
publisher: Springer
date: 2014
type: Book Section
type: PeerReviewed
identifier:   Gaggero, Mauro and Gnecco, Giorgio and Sanguineti, Marcello  Suboptimal Policies for Stochastic N-Stage Optimization Problems: Accuracy Analysis and a Case Study from Optimal Consumption.   In:  Models and Methods in Economics and Management.   International Series in Operations Research & Management Science  (198).  Springer, pp. 27-50.  ISBN 978-3-319-00669-7      (2014)  
relation: http://dx.doi.org/10.1007/978-3-319-00669-7_3
relation: 10.1007/978-3-319-00669-7_3