Gnecco, Giorgio and Sanguineti, Marcello Approximation Error Bounds via Rademacher's Complexity. Applied Mathematical Sciences, 2 (4). pp. 153176. ISSN 1312885X (2008)
This is the latest version of this item.

PDF
 Published Version
Download (249kB)  Preview 
Abstract
Approximation properties of some connectionistic models, commonly used to construct approximation schemes for optimization problems with multivariable functions as admissible solutions, are investigated. Such models are made up of linear combinations of computational units with adjustable parameters. The relationship between model complexity (number of computational units) and approximation error is investigated using tools from Statistical Learning Theory, such as Talagrand's inequality, fatshattering dimension, and Rademacher's complexity. For some families of multivariable functions, estimates of the approximation accuracy of models with certain computational units are derived in dependence of the Rademacher's complexities of the families. The estimates improve previouslyavailable ones, which were expressed in terms of V C dimension and derived by exploiting unionbound techniques. The results are applied to approximation schemes with certain radialbasisfunctions as computational units, for which it is shown that the estimates do not exhibit the curse of dimensionality with respect to the number of variables.
Item Type:  Article 

Uncontrolled Keywords:  approximation error, model complexity, curse of dimensionality, Rademacher's complexity, Talagrand's inequality, union bounds, VC dimension. 
Subjects:  Q Science > QA Mathematics > QA75 Electronic computers. Computer science 
Research Area:  Computer Science and Applications 
Depositing User:  Giorgio Gnecco 
Date Deposited:  17 Sep 2013 07:39 
Last Modified:  17 Sep 2013 07:39 
URI:  http://eprints.imtlucca.it/id/eprint/1749 
Available Versions of this Item

Approximation error bounds via Rademacher's complexity. (deposited 12 Sep 2013 12:53)
 Approximation Error Bounds via Rademacher's Complexity. (deposited 17 Sep 2013 07:39) [Currently Displayed]
Actions (login required)
Edit Item 