Basis Pursuit
Understanding Basis Pursuit
Conventional signal processing follows the Nyquist-Shannon theorem: to perfectly reconstruct a signal, you must sample at twice its bandwidth. For wideband RF signals spanning GHz, this requires extremely fast (and expensive) ADCs. Basis pursuit and compressed sensing break this requirement by exploiting signal sparsity: if a signal has only K significant components out of N possible, you need far fewer measurements than N.
The key insight is that L1 minimization promotes sparsity. While least squares (L2 minimization) spreads energy across all coefficients, the L1 norm's geometry (a diamond-shaped feasibility region) tends to find solutions where most coefficients are exactly zero. This mathematical property enables practical sub-Nyquist RF receivers that recover sparse spectra from far fewer samples than traditional approaches require.
Basis Pursuit Formulations
min ||x||1 subject to Ax = y
Basis Pursuit Denoising (BPDN):
min ||x||1 subject to ||Ax − y||2 ≤ ε
LASSO (equivalent):
min ||Ax − y||22 + λ||x||1
Recovery Guarantee (RIP):
M ≥ C × K × log(N/K) measurements
C ≅ 2 for Gaussian sensing matrices
Sparse Recovery Algorithms
| Algorithm | Type | Complexity | Recovery Quality |
|---|---|---|---|
| Basis Pursuit (LP) | Convex optimization | O(N³) | Optimal |
| OMP | Greedy | O(KMN) | Good (fast) |
| CoSaMP | Greedy iterative | O(KMN) | Near-optimal |
| ISTA/FISTA | Proximal gradient | O(MN/iter) | Optimal (slow) |
| AMP | Message passing | O(MN/iter) | Optimal (fast) |
Frequently Asked Questions
L1 vs. L2 minimization?
L2 (least squares): distributes energy, non-sparse. L1 (basis pursuit): promotes sparsity via diamond geometry. Underdetermined system: L2 = minimum-norm (dense), L1 = sparsest solution. Key compressed sensing insight.
Conditions for success?
Sensing matrix must satisfy RIP: δ < √2−1 ≅ 0.414. Random matrices satisfy with M ≥ 2K log(N/K). RF: random demodulation, modulated wideband converter (MWC) create valid sensing architectures.
RF applications?
Wideband spectrum sensing (cognitive radio). Sparse DOA estimation. Compressed SAR imaging. mmWave channel estimation (sparse multipath). RFI mitigation. All exploit signal sparsity for reduced sampling.