eprintid: 2637
rev_number: 12
eprint_status: archive
userid: 65
dir: disk0/00/00/26/37
datestamp: 2015-03-26 11:47:08
lastmod: 2016-06-30 12:29:59
status_changed: 2015-03-26 11:47:08
type: article
metadata_visibility: show
creators_name: Laurain, Vincent
creators_name: Tóth, Roland
creators_name: Piga, Dario
creators_name: Zheng, Wei Xing
creators_id: 
creators_id: 
creators_id: dario.piga@imtlucca.it
creators_id: 
title: An Instrumental Least Squares Support Vector Machine for Nonlinear System Identification
ispublished: pub
subjects: T1
divisions: CSA
full_text_status: none
keywords:     Support vector machines;
    Reproducing kernel Hilbert space;
    Instrumental variables;
    Nonlinear identification;
    Machine learning;
    Non-parametric estimation
abstract: Least-Squares Support Vector Machines (LS-SVMs), originating from Statistical Learning and Reproducing Kernel Hilbert Space (RKHS) theories, represent a promising approach to identify nonlinear systems via nonparametric estimation of the involved nonlinearities in a computationally and stochastically attractive way. However, application of LS-SVMs and other RKHS variants in the identification context is formulated as a regularized linear regression aiming at the minimization of the l2-loss of the prediction error. This formulation corresponds to the assumption of an auto-regressive noise structure, which is often found to be too restrictive in practical applications. In this paper, Instrumental Variable (IV) based estimation is integrated into the LS-SVM approach, providing, under minor conditions, consistent identification of nonlinear systems regarding the noise modeling error. It is shown how the cost function of the LS-SVM is modified to achieve an IV-based solution. Although, a practically well applicable choice of the instrumental variable is proposed for the derived approach, optimal choice of this instrument in terms of the estimates associated variance still remains to be an open problem. The effectiveness of the proposed IV based LS-SVM scheme is also demonstrated by a Monte Carlo study based simulation example.
date: 2015-04
date_type: published
publication: Automatica
volume: 54
publisher: Elsevier 
pagerange: 340-347
id_number: 10.1016/j.automatica.2015.02.017
refereed: TRUE
issn: 0005-1098
official_url: http://www.sciencedirect.com/science/article/pii/S0005109815000709
citation:   Laurain, Vincent and Tóth, Roland and Piga, Dario and Zheng, Wei Xing  An Instrumental Least Squares Support Vector Machine for Nonlinear System Identification.  Automatica, 54.  pp. 340-347.  ISSN 0005-1098      (2015)