Compressed Sensing

Basis Pursuit

/BAY-sis pur-SOOT/
An optimization algorithm that recovers sparse signals by minimizing the L1 norm of the coefficient vector subject to measurement constraints: min ||x||1 subject to Ax = y. Foundation of compressed sensing (Candès, Donoho, 2006). Enables sub-Nyquist sampling for wideband spectrum sensing, sparse DOA estimation, and compressed sensing radar. Requires only O(K log(N/K)) measurements for K-sparse signals in N dimensions.
Formulation: min ||x||1 s.t. Ax = y
Measurements: O(K log N/K)
Guarantee: RIP (δ < √2−1)

Understanding Basis Pursuit

Conventional signal processing follows the Nyquist-Shannon theorem: to perfectly reconstruct a signal, you must sample at twice its bandwidth. For wideband RF signals spanning GHz, this requires extremely fast (and expensive) ADCs. Basis pursuit and compressed sensing break this requirement by exploiting signal sparsity: if a signal has only K significant components out of N possible, you need far fewer measurements than N.

The key insight is that L1 minimization promotes sparsity. While least squares (L2 minimization) spreads energy across all coefficients, the L1 norm's geometry (a diamond-shaped feasibility region) tends to find solutions where most coefficients are exactly zero. This mathematical property enables practical sub-Nyquist RF receivers that recover sparse spectra from far fewer samples than traditional approaches require.

Basis Pursuit Formulations

Basis Pursuit (noiseless):
min ||x||1 subject to Ax = y

Basis Pursuit Denoising (BPDN):
min ||x||1 subject to ||Ax − y||2 ≤ ε

LASSO (equivalent):
min ||Ax − y||22 + λ||x||1

Recovery Guarantee (RIP):
M ≥ C × K × log(N/K) measurements
C ≅ 2 for Gaussian sensing matrices

Sparse Recovery Algorithms

AlgorithmTypeComplexityRecovery Quality
Basis Pursuit (LP)Convex optimizationO(N³)Optimal
OMPGreedyO(KMN)Good (fast)
CoSaMPGreedy iterativeO(KMN)Near-optimal
ISTA/FISTAProximal gradientO(MN/iter)Optimal (slow)
AMPMessage passingO(MN/iter)Optimal (fast)
Common Questions

Frequently Asked Questions

L1 vs. L2 minimization?

L2 (least squares): distributes energy, non-sparse. L1 (basis pursuit): promotes sparsity via diamond geometry. Underdetermined system: L2 = minimum-norm (dense), L1 = sparsest solution. Key compressed sensing insight.

Conditions for success?

Sensing matrix must satisfy RIP: δ < √2−1 ≅ 0.414. Random matrices satisfy with M ≥ 2K log(N/K). RF: random demodulation, modulated wideband converter (MWC) create valid sensing architectures.

RF applications?

Wideband spectrum sensing (cognitive radio). Sparse DOA estimation. Compressed SAR imaging. mmWave channel estimation (sparse multipath). RFI mitigation. All exploit signal sparsity for reduced sampling.

Compressed Sensing

Precision RF Components

RF Essentials provides precision terminations and custom waveguide assemblies for wideband receiver testing and sub-Nyquist sampling system characterization.

Request a Quote