eprintid: 1446 rev_number: 7 eprint_status: archive userid: 17 dir: disk0/00/00/14/46 datestamp: 2012-12-14 08:37:47 lastmod: 2014-01-24 14:13:11 status_changed: 2012-12-14 08:37:47 type: monograph succeeds: 761 metadata_visibility: show item_issues_count: 0 creators_name: Dellino, Gabriella creators_name: Meloni, Carlo creators_id: gabriella.dellino@imtlucca.it creators_id: title: Metamodel variability in robust simulation-optimization: a bootstrap analysis ispublished: submitted subjects: HB subjects: QA subjects: QA75 divisions: EIC full_text_status: restricted monograph_type: working_paper keywords: simulation; metamodels; validation; bootstrap abstract: Metamodels are often used in simulation-optimization for the design and management of complex systems enabling the integration of discipline-dependent analysis into the overall decision process. These metamodels yield insight into the relationship between responses and decision variables, providing fast analysis tools in place of the more expensive computer simulations. The combined use of stochastic simulation experiments and metamodels introduces a source of uncertainty in the decision process that we refer to as metamodel variability. To quantify this variability, we combine validation and bootstrapping techniques. The rationale behind the method relies on the fact that, after the validation process, the relative validation errors are small indicating that the metamodels give an adequate approximation, and bootstrapping these errors allows to quantify the metamodels' variability in an acceptable way. The method has the advantage to be general and can be used with different kind of metamodels and validation techniques. The resulting methodology is illustrated through some examples using regression and Kriging metamodels. date: 2012-06 date_type: submitted number: institution: IMT Institute for Advanced Studies Lucca citation: Dellino, Gabriella and Meloni, Carlo Metamodel variability in robust simulation-optimization: a bootstrap analysis. Working Paper # /2012 (Submitted) document_url: http://eprints.imtlucca.it/1446/1/MATCOM-D-12-00310.pdf