UPDF AI

The Dantzig selector: Statistical estimation when P is much larger than n

E. Candès,Terence Tao

2005 · DOI: 10.1214/009053606000001523
3,728 Citations

TLDR

Is it possible to estimate β reliably based on the noisy data y?

Abstract

In many important statistical applications, the number of variables or parameters p is much larger than the number of observations n. Suppose then that we have observations y=Xβ+z, where β∈Rp is a parameter vector of interest, X is a data matrix with possibly far fewer rows than columns, n≪p, and the zi’s are i.i.d. N(0, σ^2). Is it possible to estimate β reliably based on the noisy data y?