Gnecco, Giorgio and Gori, Marco and Melacci, Stefano and Sanguineti, Marcello Learning With Mixed Hard/Soft Pointwise Constraints. IEEE Transactions on Neural Networks and Learning Systems, 26 (9). pp. 2019-2032. ISSN 2162-237X (2015)
Full text not available from this repository.Abstract
A learning paradigm is proposed and investigated, in which the classical framework of learning from examples is enhanced by the introduction of hard pointwise constraints, i.e., constraints imposed on a finite set of examples that cannot be violated. Such constraints arise, e.g., when requiring coherent decisions of classifiers acting on different views of the same pattern. The classical examples of supervised learning, which can be violated at the cost of some penalization (quantified by the choice of a suitable loss function) play the role of soft pointwise constraints. Constrained variational calculus is exploited to derive a representer theorem that provides a description of the functional structure of the optimal solution to the proposed learning paradigm. It is shown that such an optimal solution can be represented in terms of a set of support constraints, which generalize the concept of support vectors and open the doors to a novel learning paradigm, called support constraint machines. The general theory is applied to derive the representation of the optimal solution to the problem of learning from hard linear pointwise constraints combined with soft pointwise constraints induced by supervised examples. In some cases, closed-form optimal solutions are obtained.
| Item Type: | Article |
|---|---|
| Identification Number: | https://doi.org/10.1109/TNNLS.2014.2361866 |
| Additional Information: | Published online: 07 November 2014 |
| Uncontrolled Keywords: | Constrained variational calculus, hard and soft constraints, parsimony principle, representer theorems, support constraint machines (SCMs), support constraints |
| Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Research Area: | Computer Science and Applications |
| Depositing User: | Ms T. Iannizzi |
| Date Deposited: | 23 Feb 2015 10:45 |
| Last Modified: | 02 Nov 2015 13:02 |
| URI: | http://eprints.imtlucca.it/id/eprint/2618 |
Actions (login required)
 |
Edit Item |
