On the Underfitting and Overfitting Sets of Models Chosen by Order Selection Criteria

Author: Guyon X.   Yao J-f.  

Publisher: Academic Press

ISSN: 0047-259X

Source: Journal of Multivariate Analysis, Vol.70, Iss.2, 1999-08, pp. : 221-249

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

For a general class of order selection criteria, we establish analytic and non-asymptotic evaluations of both the underfitting and overfitting sets of selected models. These evaluations are further specified in various situations including regressions and autoregressions with finite or infinite variances. We also show how upper bounds for the misfitting probabilities and hence conditions ensuring the weak consistency can be derived from the given evaluations. Moreover, it is demonstrated how these evaluations, combined with a law of the iterated logarithm for some relevant statistic, can provide conditions ensuring the strong consistency of the model selection criterion used. Copyright 1999 Academic Press.