centre for microdata methods and practice

ESRC centre

cemmap is an ESRC research centre


Keep in touch

Subscribe to cemmap news

Extremum sieve estimation in k-out-of-n systems

Authors: Alexandre Belloni , Victor Chernozhukov and Lie Wang
Date: 01 April 2014
Type: Journal article, Annals of Statistics, Vol. 42, No. 2, pp. 757--788


We propose a self-tuning Lasso">Lasso method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic) non-Gaussianity of the noise. In addition, our analysis allows for badly behaved designs, for example, perfectly collinear regressors, and generates sharp bounds even in extreme cases, such as the infinite variance case and the noiseless case, in contrast to Lasso. We establish various nonasymptotic bounds for Lasso">Lasso including prediction norm rate and sparsity. Our analysis is based on new impact factors that are tailored for bounding prediction norm. In order to cover heteroscedastic non-Gaussian noise, we rely on moderate deviation theory for self-normalized sums to achieve Gaussian-like results under weak conditions. Moreover, we derive bounds on the performance of ordinary least square (ols) applied to the model selected by Lasso">Lasso accounting for possible misspecification of the selected model. Under mild conditions, the rate of convergence of ols post Lasso">Lassois as good as Lasso">Lasso’s rate. As an application, we consider the use ofLasso">Lasso and ols post Lasso">Lasso as estimators of nuisance parameters in a generic semiparametric problem (nonlinear moment condition or Z">ZZ-problem), resulting in a construction of n">nn-consistent and asymptotically normal estimators of the main parameters.

Previous version:
Alexandre Belloni, Victor Chernozhukov and Lie Wang December 2013, Pivotal estimation via square-root lasso in nonparametric regression, cemmap Working Paper

Search cemmap

Search by title, topic or name.

Contact cemmap

Centre for Microdata Methods and Practice

How to find us

Tel: +44 (0)20 7291 4800

E-mail us