Gnecco, Giorgio and Gori, Marco and Melacci, Stefano and Sanguineti, Marcello Learning as Constraint Reactions. In: Artificial Neural Networks. Springer Series in Bio-/Neuroinformatics (4). Springer, pp. 245-270. ISBN 978-3-319-09903-3 (2015)
Full text not available from this repository.Abstract
A theory of learning is proposed,which extends naturally the classic regularization framework of kernelmachines to the case in which the agent interacts with a richer environment, compactly described by the notion of constraint. Variational calculus is exploited to derive general representer theorems that give a description of the structure of the solution to the learning problem. It is shown that such solution can be represented in terms of constraint reactions, which remind the corresponding notion in analytic mechanics. In particular, the derived representer theorems clearly show the extension of the classic kernel expansion on support vectors to the expansion on support constraints. As an application of the proposed theory three examples are given, which illustrate the dimensional collapse to a finite-dimensional space of parameters. The constraint reactions are calculated for the classic collection of supervised examples, for the case of box constraints, and for the case of hard holonomic linear constraints mixed with supervised examples. Interestingly, this leads to representer theorems for which we can re-use the kernel machine mathematical and algorithmic apparatus.
| Item Type: | Book Section |
|---|---|
| Identification Number: | 10.1007/978-3-319-09903-3_12 |
| Additional Information: | Part of this chapter is an excerpt of the paper “Foundations on Support Constraint Machines,” by the same authors, that will appear in Neural Computation, which contains a significantly broader view on the subject along with a more general framework, algorithmic issues, and references to applications. |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Research Area: | Computer Science and Applications |
| Depositing User: | Ms T. Iannizzi |
| Date Deposited: | 18 Feb 2015 14:47 |
| Last Modified: | 18 Feb 2015 14:47 |
| URI: | http://eprints.imtlucca.it/id/eprint/2611 |
Actions (login required)
 |
Edit Item |
