centre for microdata methods and practice

ESRC centre

cemmap is an ESRC research centre


Keep in touch

Subscribe to cemmap news

Plug-in regularized estimation of high dimensional parameters in nonlinear semiparametric models

Authors: Victor Chernozhukov , Denis Nekipelov , Vira Semenova and Vasilis Syrgkanis
Date: 04 July 2018
Type: cemmap Working Paper, CWP41/18
DOI: 10.1920/wp.cem.2018.4118


We develop a theory for estimation of a high-dimensional sparse parameter 𝛳 defi ned as a minimizer of a population loss function LD(𝛳,g0) which, in addition to 𝛳, depends on a, potentially infi nite dimensional, nuisance parameter g0. Our approach is based on estimating 𝛳 via an l1-regularized minimization of a sample analog of Ls(𝛳,ĝ), plugging in a fi rst-stage estimate ĝ, computed on a hold-out sample. We defi ne a population loss to be (Neyman) orthogonal if the gradient of the loss with respect to 𝛳, has pathwise derivative with respect to g equal to zero, when evaluated at the true parameter and nuisance component. We show that orthogonality implies a second-order impact of the fi rst stage nuisance error on the second stage target parameter estimate. Our approach applies to both convex and non-convex losses, albeit the latter case requires a small adaptation of our method with a preliminary estimation step of the target parameter. Our result enables oracle convergence rates for 𝛳 under assumptions on the first stage rates, typically of the order of n1/4.

We show how such an orthogonal loss can be constructed via a novel orthogonalization process for a general model de fined by conditional moment restrictions. We apply our theory to high-dimensional versions of standard estimation problems in statistics and econometrics, such as: estimation of conditional moment models with missing data, estimation of structural utilities in games of incomplete information and estimation of treatment effects in regression models with non-linear link functions.

Download full version

Search cemmap

Search by title, topic or name.

Contact cemmap

Centre for Microdata Methods and Practice

How to find us

Tel: +44 (0)20 7291 4800

E-mail us