Compressive Sampling for Energy Efficient Event Detection

Size: px
Start display at page:

Download "Compressive Sampling for Energy Efficient Event Detection"

Transcription

1 Compressive Sampling for Energy Efficient Event Detection Zainul Charbiwala, Younghun Kim, Sadaf Zahedi, Jonathan Friedman, and Mani B. Srivastava Physical Signal Sampling Processing Communication Detection

2 Event Detection in Wireless Sensor Networks i Rij j 2

3 Event Detection in Wireless Sensor Networks i Rij j When noise is non-gaussian: 2

4 Event Detection in Wireless Sensor Networks i Rij j When noise is non-gaussian: Need to detect some unique feature of the signal 2

5 Event Detection in Wireless Sensor Networks i Rij j When noise is non-gaussian: Need to detect some unique feature of the signal Computing features locally is expensive, so is transmitting raw data 2

6 Event Detection in Wireless Sensor Networks i Rij j When noise is non-gaussian: Need to detect some unique feature of the signal Computing features locally is expensive, so is transmitting raw data Feature computation = compression in the feature space 2

7 Compressive Sampling Physical Signal Sampling Compression Communication Detection 3

8 Compressive Sampling Physical Signal Sampling Compression Communication Detection Physical Signal Compressive Sampling Communication Decoding Detection Shifts computation to fusion center 3

9 Compressive Sampling Physical Signal x n Sampling z = I n x Time domain samples Physical Signal x n Compressive Sampling z = Φx k x n k < n Incoherent domain samples 4

10 Compressive Sampling Physical Signal Sampling Compression Compressed domain samples x n z = I n x y = Ψz n x n Physical Signal x n Compressive Sampling z = Φx k x n k < n Decoding y = argmin y y 1 s.t. z = ΦΨ 1 y Compressed domain samples 5

11 Compressive Sampling Physical Signal Sampling Compression Compressed domain samples x n z = I n x y = Ψz n x n How do we generate Φ and compute incoherent samples? Physical Signal x n Compressive Sampling z = Φx k x n k < n Decoding y = argmin y y 1 s.t. z = ΦΨ 1 y Compressed domain samples 5

12 Taking Incoherent Projections Gaussian: independent realizations of x N (0, 1 n ) z = Φ 6

13 Taking Incoherent Projections Gaussian: independent realizations of x N (0, 1 n ) z = Φ Needs a priori Nyquist sampling and storage for x and Φ Needs kn 2 FPU multiplications, k(n-1) additions and kn 2 memory accesses 6

14 Taking Incoherent Projections Realizations of equiprobable Bernoulli RV x +1 n, 1 n z = Φ 7

15 Taking Incoherent Projections Realizations of equiprobable Bernoulli RV x +1 n, 1 n z = Φ Needs a priori Nyquist sampling and storage for x and Φ Needs k(n-1) additions and kn 2 memory accesses but no multiplications 7

16 Taking Incoherent Projections Uniform Random Sampling x z = Φ 8

17 Taking Incoherent Projections Uniform Random Sampling x z = Φ Needs a priori Nyquist sampling & storage for x but Φ can be generated on-the-fly Needs k memory accesses but no multiplications or additions Need higher k because matrix is sparse 8

18 Taking Incoherent Projections Causal Uniform Random Sampling (sorted Φ from URS) z = Φ x 9

19 Taking Incoherent Projections Causal Uniform Random Sampling (sorted Φ from URS) z = Φ x Need to generate, sort and store Φ (but no a priori sampling or storage for x) Needs k memory accesses but no multiplications or additions May violate ADC hold time 9

20 Causal Uniform Random Sampling on-the-fly Use an additive random process t 0 = 0 t i+1 = t i + τ i τ i N (µ,r 2 µ 2 ) 10

21 Causal Uniform Random Sampling on-the-fly Use an additive random process t 0 = 0 t i+1 = t i + τ i τ i N (µ,r 2 µ 2 ) 10

22 Causal Uniform Random Sampling on-the-fly Use an additive random process t 0 = 0 t i+1 = t i + τ i τ i N (µ,r 2 µ 2 ) Need to truncate the negative tail of Gaussian PDF to ensure causality and feasibility 10

23 Causal Uniform Random Sampling on-the-fly Use an additive random process x z = Φ 11

24 Causal Uniform Random Sampling on-the-fly Use an additive random process x z = Φ Can generate Φ on-the-fly and do not need to sample or store x a priori Needs k memory accesses but no multiplications or additions 11

25 Modifying CS for Detection 12

26 Modifying CS for Detection CS is geared toward sparse signal reconstruction What if we wanted to detect a signal feature instead? 12

27 Modifying CS for Detection CS is geared toward sparse signal reconstruction What if we wanted to detect a signal feature instead? y = argmin y y 1 y = arg min y W y 1 s.t. z = ΦΨ 1 y s.t. z = ΦΨ 1 y Proposed solution: Weighted Basis Pursuit Intuitive idea: Reduce penalty on features of interest 12

28 Example: Detecting 450Hz Tone (a) FFT of original 450Hz tone at!10db SNR (b) BP recovery with 300Hz sampling FFT magnitude FFT magnitude (c) BP recovery with 30Hz sampling Frequency (Hz) (d) Weighted BP recovery with 30Hz sampling Frequency (Hz) 1.4: Frequency (FFT) coefficients for the CS reconstruction of a 450Hz tone at -10dB ifferent sampling rates and recovery strategies. terference prone environment, can be considerably lower if full CS recovery is not req 13

29 Evaluation Process Generate Tone+Noise Sensing Mote Base Station Collect Samples x + η z = Φx + η Simulate Random Projections Weighted Basis Pursuit ŷ Tone Detection H Acoustic Tone Detection 14

30 Per-Module Energy Consumption 23456(789: %! $! #! "! ;<= >?) 001 ;D<<A<E(1A85(78F:! "!!! C+! +!! #+!! "!&'( )* "!&'( )* #!&'( )* #!&'( )* $!&'( )* $!&'( )* #+!&' )* #+!&' )* "!#%&',-.* ;<= >?) 001 "!#%&',-.* "!#%&',*/001 "!#%&',*/001 FFT computation higher than transmission cost Highest consumer in CS is the random number generator 15

31 Detection Performance - Simulation !10dB SNR 0dB SNR 10dB SNR IRBP BP WBP P e Sampling Rate (Hz) Sampling Rate (Hz) Sampling Rate (Hz) Detection near perfect above 0dB with 30Hz sampling rate Improvement in performance due to weighting at high SNR 16

32 Detection Performance - Experiments !10dB SNR 0dB SNR 10dB SNR IRBP BP WBP P e Sampling Rate (Hz) Sampling Rate (Hz) Sampling Rate (Hz) Some deviation from simulation results due to ambient conditions 17

33 Detection Performance - Interference dB SINR 20dB SINR 10dB SINR BP WBP 0.3 P e Sampling Rate (Hz) Sampling Rate (Hz) Sampling Rate (Hz) Weighting does not help much against narrowband interference 18

34 Related Work Compressive Sensing [Donoho98], [Candes06], [Candes08], etc. Compressive Detection [Duarte06], [Khajehnejad09] Random Sampling [Bilinskis92], [Boyle07], [Dang08], etc 19

35 Summary Prudence at the sampling stage can deliver energy efficiency gains through the entire sensing chain Computing random projections on the fly is feasible by paying an extra cost in number of measurements Good pseudo-random number generation has nontrivial computation cost Detection performance with CS at par with Nyquist rate with a 30x rate reduction 20

36 Cost/Performance of RNGs Linear Feedback Shift Register Rnd ADC FFT Radio TX Multiplicative Linear Congruential Generator Power (mw) Mersenne-Twister Hz CS LFSR16 30Hz CS MLCG16 30Hz CS MT Hz CS MLCG Hz NyqS 1024Hz NS/FFT 21

37 Cost/Performance of RNGs Linear Feedback Shift Register Rnd ADC FFT Radio TX Multiplicative Linear Congruential Generator Power (mw) Mersenne-Twister Hz CS LFSR16 30Hz CS MLCG16 30Hz CS MT Hz CS MLCG Hz NyqS 1024Hz NS/FFT RIP constant indicates CS performance (lower is better) MLCG a little worse than MT Variation with LFSR very high 21

38 Thank You! Tech Report: Slides :

39 Geometric Interpretation of WBP (a) (b) (c) [E. Candes, M. Wakin, and S. Boyd, Enhancing sparsity by reweighted l1 minimization, Journal of Fourier Analysis and Applications, vol. 14, no. 5-6, pp , ] 23

Noisy Signal Recovery via Iterative Reweighted L1-Minimization

Noisy Signal Recovery via Iterative Reweighted L1-Minimization Noisy Signal Recovery via Iterative Reweighted L1-Minimization Deanna Needell UC Davis / Stanford University Asilomar SSC, November 2009 Problem Background Setup 1 Suppose x is an unknown signal in R d.

More information

Part IV Compressed Sensing

Part IV Compressed Sensing Aisenstadt Chair Course CRM September 2009 Part IV Compressed Sensing Stéphane Mallat Centre de Mathématiques Appliquées Ecole Polytechnique Conclusion to Super-Resolution Sparse super-resolution is sometime

More information

An Overview of Compressed Sensing

An Overview of Compressed Sensing An Overview of Compressed Sensing Nathan Schneider November 18, 2009 Abstract In a large number of applications, the system will be designed to sample at a rate equal to at least the frequency bandwidth

More information

A Nonuniform Quantization Scheme for High Speed SAR ADC Architecture

A Nonuniform Quantization Scheme for High Speed SAR ADC Architecture A Nonuniform Quantization Scheme for High Speed SAR ADC Architecture Youngchun Kim Electrical and Computer Engineering The University of Texas Wenjuan Guo Intel Corporation Ahmed H Tewfik Electrical and

More information

Model-Based Compressive Sensing for Signal Ensembles. Marco F. Duarte Volkan Cevher Richard G. Baraniuk

Model-Based Compressive Sensing for Signal Ensembles. Marco F. Duarte Volkan Cevher Richard G. Baraniuk Model-Based Compressive Sensing for Signal Ensembles Marco F. Duarte Volkan Cevher Richard G. Baraniuk Concise Signal Structure Sparse signal: only K out of N coordinates nonzero model: union of K-dimensional

More information

Large-Scale L1-Related Minimization in Compressive Sensing and Beyond

Large-Scale L1-Related Minimization in Compressive Sensing and Beyond Large-Scale L1-Related Minimization in Compressive Sensing and Beyond Yin Zhang Department of Computational and Applied Mathematics Rice University, Houston, Texas, U.S.A. Arizona State University March

More information

ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis

ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis ECE 8201: Low-dimensional Signal Models for High-dimensional Data Analysis Lecture 3: Sparse signal recovery: A RIPless analysis of l 1 minimization Yuejie Chi The Ohio State University Page 1 Outline

More information

Sparse Solutions of an Undetermined Linear System

Sparse Solutions of an Undetermined Linear System 1 Sparse Solutions of an Undetermined Linear System Maddullah Almerdasy New York University Tandon School of Engineering arxiv:1702.07096v1 [math.oc] 23 Feb 2017 Abstract This work proposes a research

More information

Analog-to-Information Conversion

Analog-to-Information Conversion Analog-to-Information Conversion Sergiy A. Vorobyov Dept. Signal Processing and Acoustics, Aalto University February 2013 Winter School on Compressed Sensing, Ruka 1/55 Outline 1 Compressed Sampling (CS)

More information

Compressive Sensing and Beyond

Compressive Sensing and Beyond Compressive Sensing and Beyond Sohail Bahmani Gerorgia Tech. Signal Processing Compressed Sensing Signal Models Classics: bandlimited The Sampling Theorem Any signal with bandwidth B can be recovered

More information

Compressed Spectrum Sensing for Whitespace Networking

Compressed Spectrum Sensing for Whitespace Networking Compressed Spectrum Sensing for Whitespace Networking Vishnu Katreddy Masters Project Report Abstract We study the problem of wideband compressed spectrum sensing for detection of whitespaces when some

More information

Compressibility of Infinite Sequences and its Interplay with Compressed Sensing Recovery

Compressibility of Infinite Sequences and its Interplay with Compressed Sensing Recovery Compressibility of Infinite Sequences and its Interplay with Compressed Sensing Recovery Jorge F. Silva and Eduardo Pavez Department of Electrical Engineering Information and Decision Systems Group Universidad

More information

Sparse analysis Lecture V: From Sparse Approximation to Sparse Signal Recovery

Sparse analysis Lecture V: From Sparse Approximation to Sparse Signal Recovery Sparse analysis Lecture V: From Sparse Approximation to Sparse Signal Recovery Anna C. Gilbert Department of Mathematics University of Michigan Connection between... Sparse Approximation and Compressed

More information

Exact Signal Recovery from Sparsely Corrupted Measurements through the Pursuit of Justice

Exact Signal Recovery from Sparsely Corrupted Measurements through the Pursuit of Justice Exact Signal Recovery from Sparsely Corrupted Measurements through the Pursuit of Justice Jason N. Laska, Mark A. Davenport, Richard G. Baraniuk Department of Electrical and Computer Engineering Rice University

More information

Compressed Sensing: Extending CLEAN and NNLS

Compressed Sensing: Extending CLEAN and NNLS Compressed Sensing: Extending CLEAN and NNLS Ludwig Schwardt SKA South Africa (KAT Project) Calibration & Imaging Workshop Socorro, NM, USA 31 March 2009 Outline 1 Compressed Sensing (CS) Introduction

More information

Compressed Sensing with Shannon-Kotel nikov Mapping in the Presence of Noise

Compressed Sensing with Shannon-Kotel nikov Mapping in the Presence of Noise 19th European Signal Processing Conference (EUSIPCO 011) Barcelona, Spain, August 9 - September, 011 Compressed Sensing with Shannon-Kotel nikov Mapping in the Presence of Noise Ahmad Abou Saleh, Wai-Yip

More information

Introduction How it works Theory behind Compressed Sensing. Compressed Sensing. Huichao Xue. CS3750 Fall 2011

Introduction How it works Theory behind Compressed Sensing. Compressed Sensing. Huichao Xue. CS3750 Fall 2011 Compressed Sensing Huichao Xue CS3750 Fall 2011 Table of Contents Introduction From News Reports Abstract Definition How it works A review of L 1 norm The Algorithm Backgrounds for underdetermined linear

More information

Stopping Condition for Greedy Block Sparse Signal Recovery

Stopping Condition for Greedy Block Sparse Signal Recovery Stopping Condition for Greedy Block Sparse Signal Recovery Yu Luo, Ronggui Xie, Huarui Yin, and Weidong Wang Department of Electronics Engineering and Information Science, University of Science and Technology

More information

The Pros and Cons of Compressive Sensing

The Pros and Cons of Compressive Sensing The Pros and Cons of Compressive Sensing Mark A. Davenport Stanford University Department of Statistics Compressive Sensing Replace samples with general linear measurements measurements sampled signal

More information

Solving Underdetermined Linear Equations and Overdetermined Quadratic Equations (using Convex Programming)

Solving Underdetermined Linear Equations and Overdetermined Quadratic Equations (using Convex Programming) Solving Underdetermined Linear Equations and Overdetermined Quadratic Equations (using Convex Programming) Justin Romberg Georgia Tech, ECE Caltech ROM-GR Workshop June 7, 2013 Pasadena, California Linear

More information

Wideband Spectrum Sensing for Cognitive Radios

Wideband Spectrum Sensing for Cognitive Radios Wideband Spectrum Sensing for Cognitive Radios Zhi (Gerry) Tian ECE Department Michigan Tech University ztian@mtu.edu February 18, 2011 Spectrum Scarcity Problem Scarcity vs. Underutilization Dilemma US

More information

Compressed Sensing: Lecture I. Ronald DeVore

Compressed Sensing: Lecture I. Ronald DeVore Compressed Sensing: Lecture I Ronald DeVore Motivation Compressed Sensing is a new paradigm for signal/image/function acquisition Motivation Compressed Sensing is a new paradigm for signal/image/function

More information

A Power Efficient Sensing/Communication Scheme: Joint Source-Channel-Network Coding by Using Compressive Sensing

A Power Efficient Sensing/Communication Scheme: Joint Source-Channel-Network Coding by Using Compressive Sensing Forty-Ninth Annual Allerton Conference Allerton House, UIUC, Illinois, USA September 28-30, 20 A Power Efficient Sensing/Communication Scheme: Joint Source-Channel-Network Coding by Using Compressive Sensing

More information

Compressed Sensing and Related Learning Problems

Compressed Sensing and Related Learning Problems Compressed Sensing and Related Learning Problems Yingzhen Li Dept. of Mathematics, Sun Yat-sen University Advisor: Prof. Haizhang Zhang Advisor: Prof. Haizhang Zhang 1 / Overview Overview Background Compressed

More information

Various signal sampling and reconstruction methods

Various signal sampling and reconstruction methods Various signal sampling and reconstruction methods Rolands Shavelis, Modris Greitans 14 Dzerbenes str., Riga LV-1006, Latvia Contents Classical uniform sampling and reconstruction Advanced sampling and

More information

Low Resolution Adaptive Compressed Sensing for mmwave MIMO receivers

Low Resolution Adaptive Compressed Sensing for mmwave MIMO receivers Low Resolution Adaptive Compressed Sensing for mmwave MIMO receivers Cristian Rusu, Nuria González-Prelcic and Robert W. Heath Motivation 2 Power consumption at mmwave in a MIMO receiver Power at 60 GHz

More information

Collaborative Compressive Spectrum Sensing Using Kronecker Sparsifying Basis

Collaborative Compressive Spectrum Sensing Using Kronecker Sparsifying Basis Collaborative Compressive Spectrum Sensing Using Kronecker Sparsifying Basis Ahmed M Elzanati, Mohamed F Abdelkader, Karim G Seddik and Atef M Ghuniem Department of Communication and Electronics, Sinai

More information

An Introduction to Sparse Approximation

An Introduction to Sparse Approximation An Introduction to Sparse Approximation Anna C. Gilbert Department of Mathematics University of Michigan Basic image/signal/data compression: transform coding Approximate signals sparsely Compress images,

More information

Greedy Signal Recovery and Uniform Uncertainty Principles

Greedy Signal Recovery and Uniform Uncertainty Principles Greedy Signal Recovery and Uniform Uncertainty Principles SPIE - IE 2008 Deanna Needell Joint work with Roman Vershynin UC Davis, January 2008 Greedy Signal Recovery and Uniform Uncertainty Principles

More information

Compressed sensing techniques for hyperspectral image recovery

Compressed sensing techniques for hyperspectral image recovery Compressed sensing techniques for hyperspectral image recovery A. Abrardo, M. Barni, C. M. Carretti, E. Magli, S. Kuiteing Kamdem, R. Vitulli ABSTRACT Compressed Sensing (CS) theory is progressively gaining

More information

Sensing systems limited by constraints: physical size, time, cost, energy

Sensing systems limited by constraints: physical size, time, cost, energy Rebecca Willett Sensing systems limited by constraints: physical size, time, cost, energy Reduce the number of measurements needed for reconstruction Higher accuracy data subject to constraints Original

More information

OPTIMIZED LOCAL SUPERPOSITION IN WIRELESS SENSOR NETWORKS WITH T-AVERAGE-MUTUAL- COHERENCE

OPTIMIZED LOCAL SUPERPOSITION IN WIRELESS SENSOR NETWORKS WITH T-AVERAGE-MUTUAL- COHERENCE Progress In Electromagnetics Research, Vol. 122, 389 411, 2012 OPTIMIZED LOCAL SUPERPOSITION IN WIRELESS SENSOR NETWORKS WITH T-AVERAGE-MUTUAL- COHERENCE D. Guo, X. Qu, L. Huang *, and Y. Yao Department

More information

COMPRESSED SENSING IN PYTHON

COMPRESSED SENSING IN PYTHON COMPRESSED SENSING IN PYTHON Sercan Yıldız syildiz@samsi.info February 27, 2017 OUTLINE A BRIEF INTRODUCTION TO COMPRESSED SENSING A BRIEF INTRODUCTION TO CVXOPT EXAMPLES A Brief Introduction to Compressed

More information

Solution Recovery via L1 minimization: What are possible and Why?

Solution Recovery via L1 minimization: What are possible and Why? Solution Recovery via L1 minimization: What are possible and Why? Yin Zhang Department of Computational and Applied Mathematics Rice University, Houston, Texas, U.S.A. Eighth US-Mexico Workshop on Optimization

More information

ANGLE OF ARRIVAL DETECTION USING COMPRESSIVE SENSING

ANGLE OF ARRIVAL DETECTION USING COMPRESSIVE SENSING 18th European Signal Processing Conference (EUSIPCO-2010) Aalborg, Denmark, August 23-27, 2010 ANGLE OF ARRIVAL DETECTION USING COMPRESSIVE SENSING T. Justin Shaw and George C. Valley The Aerospace Corporation,

More information

Structured signal recovery from non-linear and heavy-tailed measurements

Structured signal recovery from non-linear and heavy-tailed measurements Structured signal recovery from non-linear and heavy-tailed measurements Larry Goldstein* Stanislav Minsker* Xiaohan Wei # *Department of Mathematics # Department of Electrical Engineering UniversityofSouthern

More information

New Applications of Sparse Methods in Physics. Ra Inta, Centre for Gravitational Physics, The Australian National University

New Applications of Sparse Methods in Physics. Ra Inta, Centre for Gravitational Physics, The Australian National University New Applications of Sparse Methods in Physics Ra Inta, Centre for Gravitational Physics, The Australian National University 2 Sparse methods A vector is S-sparse if it has at most S non-zero coefficients.

More information

Compressed Sensing Using Bernoulli Measurement Matrices

Compressed Sensing Using Bernoulli Measurement Matrices ITSchool 11, Austin Compressed Sensing Using Bernoulli Measurement Matrices Yuhan Zhou Advisor: Wei Yu Department of Electrical and Computer Engineering University of Toronto, Canada Motivation Motivation

More information

Compressive Sensing Theory and L1-Related Optimization Algorithms

Compressive Sensing Theory and L1-Related Optimization Algorithms Compressive Sensing Theory and L1-Related Optimization Algorithms Yin Zhang Department of Computational and Applied Mathematics Rice University, Houston, Texas, USA CAAM Colloquium January 26, 2009 Outline:

More information

Joint Direction-of-Arrival and Order Estimation in Compressed Sensing using Angles between Subspaces

Joint Direction-of-Arrival and Order Estimation in Compressed Sensing using Angles between Subspaces Aalborg Universitet Joint Direction-of-Arrival and Order Estimation in Compressed Sensing using Angles between Subspaces Christensen, Mads Græsbøll; Nielsen, Jesper Kjær Published in: I E E E / S P Workshop

More information

Compressed sensing. Or: the equation Ax = b, revisited. Terence Tao. Mahler Lecture Series. University of California, Los Angeles

Compressed sensing. Or: the equation Ax = b, revisited. Terence Tao. Mahler Lecture Series. University of California, Los Angeles Or: the equation Ax = b, revisited University of California, Los Angeles Mahler Lecture Series Acquiring signals Many types of real-world signals (e.g. sound, images, video) can be viewed as an n-dimensional

More information

Multiplicative and Additive Perturbation Effects on the Recovery of Sparse Signals on the Sphere using Compressed Sensing

Multiplicative and Additive Perturbation Effects on the Recovery of Sparse Signals on the Sphere using Compressed Sensing Multiplicative and Additive Perturbation Effects on the Recovery of Sparse Signals on the Sphere using Compressed Sensing ibeltal F. Alem, Daniel H. Chae, and Rodney A. Kennedy The Australian National

More information

WIRELESS sensor networks (WSNs) have attracted

WIRELESS sensor networks (WSNs) have attracted On the Benefit of using ight Frames for Robust Data ransmission and Compressive Data Gathering in Wireless Sensor Networks Wei Chen, Miguel R. D. Rodrigues and Ian J. Wassell Computer Laboratory, University

More information

Extended Reconstruction Approaches for Saturation Measurements Using Reserved Quantization Indices Li, Peng; Arildsen, Thomas; Larsen, Torben

Extended Reconstruction Approaches for Saturation Measurements Using Reserved Quantization Indices Li, Peng; Arildsen, Thomas; Larsen, Torben Aalborg Universitet Extended Reconstruction Approaches for Saturation Measurements Using Reserved Quantization Indices Li, Peng; Arildsen, Thomas; Larsen, Torben Published in: Proceedings of the 12th IEEE

More information

Performance Analysis for Sparse Support Recovery

Performance Analysis for Sparse Support Recovery Performance Analysis for Sparse Support Recovery Gongguo Tang and Arye Nehorai ESE, Washington University April 21st 2009 Gongguo Tang and Arye Nehorai (Institute) Performance Analysis for Sparse Support

More information

Compressive Sensing (CS)

Compressive Sensing (CS) Compressive Sensing (CS) Luminita Vese & Ming Yan lvese@math.ucla.edu yanm@math.ucla.edu Department of Mathematics University of California, Los Angeles The UCLA Advanced Neuroimaging Summer Program (2014)

More information

Compressive Sensing Applied to Full-wave Form Inversion

Compressive Sensing Applied to Full-wave Form Inversion Compressive Sensing Applied to Full-wave Form Inversion Felix J. Herrmann* fherrmann@eos.ubc.ca Joint work with Yogi Erlangga, and Tim Lin *Seismic Laboratory for Imaging & Modeling Department of Earth

More information

Compressed Statistical Testing and Application to Radar

Compressed Statistical Testing and Application to Radar Compressed Statistical Testing and Application to Radar Hsieh-Chung Chen, H. T. Kung, and Michael C. Wicks Harvard University, Cambridge, MA, USA University of Dayton, Dayton, OH, USA Abstract We present

More information

AN OVERVIEW OF ROBUST COMPRESSIVE SENSING OF SPARSE SIGNALS IN IMPULSIVE NOISE

AN OVERVIEW OF ROBUST COMPRESSIVE SENSING OF SPARSE SIGNALS IN IMPULSIVE NOISE AN OVERVIEW OF ROBUST COMPRESSIVE SENSING OF SPARSE SIGNALS IN IMPULSIVE NOISE Ana B. Ramirez, Rafael E. Carrillo, Gonzalo Arce, Kenneth E. Barner and Brian Sadler Universidad Industrial de Santander,

More information

2 Regularized Image Reconstruction for Compressive Imaging and Beyond

2 Regularized Image Reconstruction for Compressive Imaging and Beyond EE 367 / CS 448I Computational Imaging and Display Notes: Compressive Imaging and Regularized Image Reconstruction (lecture ) Gordon Wetzstein gordon.wetzstein@stanford.edu This document serves as a supplement

More information

Compressive sampling meets seismic imaging

Compressive sampling meets seismic imaging Compressive sampling meets seismic imaging Felix J. Herrmann fherrmann@eos.ubc.ca http://slim.eos.ubc.ca joint work with Tim Lin and Yogi Erlangga Seismic Laboratory for Imaging & Modeling Department of

More information

The Pros and Cons of Compressive Sensing

The Pros and Cons of Compressive Sensing The Pros and Cons of Compressive Sensing Mark A. Davenport Stanford University Department of Statistics Compressive Sensing Replace samples with general linear measurements measurements sampled signal

More information

COMPRESSIVE SAMPLING USING EM ALGORITHM. Technical Report No: ASU/2014/4

COMPRESSIVE SAMPLING USING EM ALGORITHM. Technical Report No: ASU/2014/4 COMPRESSIVE SAMPLING USING EM ALGORITHM ATANU KUMAR GHOSH, ARNAB CHAKRABORTY Technical Report No: ASU/2014/4 Date: 29 th April, 2014 Applied Statistics Unit Indian Statistical Institute Kolkata- 700018

More information

The Secrecy of Compressed Sensing Measurements

The Secrecy of Compressed Sensing Measurements The Secrecy of Compressed Sensing Measurements Yaron Rachlin and Dror Baron Abstract Results in compressed sensing describe the feasibility of reconstructing sparse signals using a small number of linear

More information

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation

Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Course Notes for EE227C (Spring 2018): Convex Optimization and Approximation Instructor: Moritz Hardt Email: hardt+ee227c@berkeley.edu Graduate Instructor: Max Simchowitz Email: msimchow+ee227c@berkeley.edu

More information

On Perceptual Audio Compression with Side Information at the Decoder

On Perceptual Audio Compression with Side Information at the Decoder On Perceptual Audio Compression with Side Information at the Decoder Adel Zahedi, Jan Østergaard, Søren Holdt Jensen, Patrick Naylor, and Søren Bech Department of Electronic Systems Aalborg University,

More information

Determinis)c Compressed Sensing for Images using Chirps and Reed- Muller Sequences

Determinis)c Compressed Sensing for Images using Chirps and Reed- Muller Sequences Determinis)c Compressed Sensing for Images using Chirps and Reed- Muller Sequences Kangyu Ni Mathematics Arizona State University Joint with Somantika Datta*, Prasun Mahanti, Svetlana Roudenko, Douglas

More information

Compressed Sensing - Near Optimal Recovery of Signals from Highly Incomplete Measurements

Compressed Sensing - Near Optimal Recovery of Signals from Highly Incomplete Measurements Compressed Sensing - Near Optimal Recovery of Signals from Highly Incomplete Measurements Wolfgang Dahmen Institut für Geometrie und Praktische Mathematik RWTH Aachen and IMI, University of Columbia, SC

More information

DISTRIBUTED TARGET LOCALIZATION VIA SPATIAL SPARSITY

DISTRIBUTED TARGET LOCALIZATION VIA SPATIAL SPARSITY First published in the Proceedings of the 16th European Signal Processing Conference (EUSIPCO-2008) in 2008, published by EURASIP DISTRIBUTED TARGET LOCALIZATION VIA SPATIAL SPARSITY Volkan Cevher, Marco

More information

Learning-based compression

Learning-based compression Nature Learning-based compression Value / Knowledge Volkan Cevher Laboratory for Information and Inference Systems http://lions.epfl.ch A paradigm shift in data generation 1977-5hours A paradigm shift

More information

Enhanced Compressive Sensing and More

Enhanced Compressive Sensing and More Enhanced Compressive Sensing and More Yin Zhang Department of Computational and Applied Mathematics Rice University, Houston, Texas, U.S.A. Nonlinear Approximation Techniques Using L1 Texas A & M University

More information

Extended reconstruction approaches for saturation measurements using reserved quantization indices

Extended reconstruction approaches for saturation measurements using reserved quantization indices Extended reconstruction approaches for saturation measurements using reserved quantization indices Peng Li, Thomas Arildsen and Torben Larsen Department of Electronic Systems, Aalborg University Niels

More information

Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment

Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment Acoustical Society of America Meeting Fall 2005 Passive Sonar Detection Performance Prediction of a Moving Source in an Uncertain Environment Vivek Varadarajan and Jeffrey Krolik Duke University Department

More information

Exponential decay of reconstruction error from binary measurements of sparse signals

Exponential decay of reconstruction error from binary measurements of sparse signals Exponential decay of reconstruction error from binary measurements of sparse signals Deanna Needell Joint work with R. Baraniuk, S. Foucart, Y. Plan, and M. Wootters Outline Introduction Mathematical Formulation

More information

Fast Hard Thresholding with Nesterov s Gradient Method

Fast Hard Thresholding with Nesterov s Gradient Method Fast Hard Thresholding with Nesterov s Gradient Method Volkan Cevher Idiap Research Institute Ecole Polytechnique Federale de ausanne volkan.cevher@epfl.ch Sina Jafarpour Department of Computer Science

More information

Multipath Matching Pursuit

Multipath Matching Pursuit Multipath Matching Pursuit Submitted to IEEE trans. on Information theory Authors: S. Kwon, J. Wang, and B. Shim Presenter: Hwanchol Jang Multipath is investigated rather than a single path for a greedy

More information

LASSO BASED PERFORMANCE EVALUATION FOR SPARSE ONE-DIMENSIONAL RADAR PROBLEM UN- DER RANDOM SUB-SAMPLING AND GAUSSIAN NOISE

LASSO BASED PERFORMANCE EVALUATION FOR SPARSE ONE-DIMENSIONAL RADAR PROBLEM UN- DER RANDOM SUB-SAMPLING AND GAUSSIAN NOISE Progress In Electromagnetics Research, Vol. 14, 559 578, 013 LASSO BASED PERFORMANCE EVALUATION FOR SPARSE ONE-DIMENSIONAL RADAR PROBLEM UN- DER RANDOM SUB-SAMPLING AND GAUSSIAN NOISE Yin Xiang *, Bingchen

More information

CoSaMP. Iterative signal recovery from incomplete and inaccurate samples. Joel A. Tropp

CoSaMP. Iterative signal recovery from incomplete and inaccurate samples. Joel A. Tropp CoSaMP Iterative signal recovery from incomplete and inaccurate samples Joel A. Tropp Applied & Computational Mathematics California Institute of Technology jtropp@acm.caltech.edu Joint with D. Needell

More information

Generalized Orthogonal Matching Pursuit- A Review and Some

Generalized Orthogonal Matching Pursuit- A Review and Some Generalized Orthogonal Matching Pursuit- A Review and Some New Results Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur, INDIA Table of Contents

More information

Interference Cancellation in Wideband Receivers using Compressed Sensing

Interference Cancellation in Wideband Receivers using Compressed Sensing University of Massachusetts Amherst ScholarWorks@UMass Amherst Masters Theses 1911 - February 2014 2013 Interference Cancellation in Wideband Receivers using Compressed Sensing Tejaswi C. Peyyeti University

More information

Strengthened Sobolev inequalities for a random subspace of functions

Strengthened Sobolev inequalities for a random subspace of functions Strengthened Sobolev inequalities for a random subspace of functions Rachel Ward University of Texas at Austin April 2013 2 Discrete Sobolev inequalities Proposition (Sobolev inequality for discrete images)

More information

GREEDY SIGNAL RECOVERY REVIEW

GREEDY SIGNAL RECOVERY REVIEW GREEDY SIGNAL RECOVERY REVIEW DEANNA NEEDELL, JOEL A. TROPP, ROMAN VERSHYNIN Abstract. The two major approaches to sparse recovery are L 1-minimization and greedy methods. Recently, Needell and Vershynin

More information

CoSaMP: Greedy Signal Recovery and Uniform Uncertainty Principles

CoSaMP: Greedy Signal Recovery and Uniform Uncertainty Principles CoSaMP: Greedy Signal Recovery and Uniform Uncertainty Principles SIAM Student Research Conference Deanna Needell Joint work with Roman Vershynin and Joel Tropp UC Davis, May 2008 CoSaMP: Greedy Signal

More information

Sequential Compressed Sensing

Sequential Compressed Sensing Sequential Compressed Sensing Dmitry M. Malioutov, Sujay R. Sanghavi, and Alan S. Willsky, Fellow, IEEE Abstract Compressed sensing allows perfect recovery of sparse signals (or signals sparse in some

More information

Learning Compressive Sensing Models for Big Spatio-Temporal Data

Learning Compressive Sensing Models for Big Spatio-Temporal Data Learning Compressive Sensing Models for Big Spatio-Temporal Data Dongeun Lee Jaesik Choi Abstract Sensing devices including mobile phones and biomedical sensors generate massive amounts of spatio-temporal

More information

ACCORDING to Shannon s sampling theorem, an analog

ACCORDING to Shannon s sampling theorem, an analog 554 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL 59, NO 2, FEBRUARY 2011 Segmented Compressed Sampling for Analog-to-Information Conversion: Method and Performance Analysis Omid Taheri, Student Member,

More information

Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences

Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences Particle Filtered Modified-CS (PaFiMoCS) for tracking signal sequences Samarjit Das and Namrata Vaswani Department of Electrical and Computer Engineering Iowa State University http://www.ece.iastate.edu/

More information

SPECTRAL COMPRESSIVE SENSING WITH POLAR INTERPOLATION. Karsten Fyhn, Hamid Dadkhahi, Marco F. Duarte

SPECTRAL COMPRESSIVE SENSING WITH POLAR INTERPOLATION. Karsten Fyhn, Hamid Dadkhahi, Marco F. Duarte SPECTRAL COMPRESSIVE SENSING WITH POLAR INTERPOLATION Karsten Fyhn, Hamid Dadkhahi, Marco F. Duarte Dept. of Electronic Systems, Aalborg University, Denmark. Dept. of Electrical and Computer Engineering,

More information

Stochastic geometry and random matrix theory in CS

Stochastic geometry and random matrix theory in CS Stochastic geometry and random matrix theory in CS IPAM: numerical methods for continuous optimization University of Edinburgh Joint with Bah, Blanchard, Cartis, and Donoho Encoder Decoder pair - Encoder/Decoder

More information

Sudocodes: Low Complexity Algorithms for Compressive Sampling and Reconstruction

Sudocodes: Low Complexity Algorithms for Compressive Sampling and Reconstruction Sudocodes: Low Complexity Algorithms for Compressive Sampling and Reconstruction Shriram Sarvotham, Dror Baron and Richard G. Baraniuk Department of Electrical and Computer Engineering Rice University,

More information

The Fundamentals of Compressive Sensing

The Fundamentals of Compressive Sensing The Fundamentals of Compressive Sensing Mark A. Davenport Georgia Institute of Technology School of Electrical and Computer Engineering Sensor Explosion Data Deluge Digital Revolution If we sample a signal

More information

Compressed Sensing: When sparsity meets sampling

Compressed Sensing: When sparsity meets sampling Compressed Sensing: When sparsity meets sampling Laurent Jacques and Pierre Vandergheynst February 17, 2010 The recent theory of Compressed Sensing (Candès, Tao & Romberg, 2006, and Donoho, 2006) states

More information

Wireless Compressive Sensing for Energy Harvesting Sensor Nodes over Fading Channels

Wireless Compressive Sensing for Energy Harvesting Sensor Nodes over Fading Channels Wireless Compressive Sensing for Energy Harvesting Sensor Nodes over Fading Channels Gang Yang, Vincent Y. F. Tan, Chin Keong Ho, See Ho Ting and Yong Liang Guan School of Electrical and Electronic Engineering,

More information

Summary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations

Summary: SER formulation. Binary antipodal constellation. Generic binary constellation. Constellation gain. 2D constellations TUTORIAL ON DIGITAL MODULATIONS Part 8a: Error probability A [2011-01-07] 07] Roberto Garello, Politecnico di Torino Free download (for personal use only) at: www.tlc.polito.it/garello 1 Part 8a: Error

More information

The Dantzig Selector

The Dantzig Selector The Dantzig Selector Emmanuel Candès California Institute of Technology Statistics Colloquium, Stanford University, November 2006 Collaborator: Terence Tao (UCLA) Statistical linear model y = Xβ + z y

More information

Sparse linear models

Sparse linear models Sparse linear models Optimization-Based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_spring16 Carlos Fernandez-Granda 2/22/2016 Introduction Linear transforms Frequency representation Short-time

More information

Compressed Sensing and Robust Recovery of Low Rank Matrices

Compressed Sensing and Robust Recovery of Low Rank Matrices Compressed Sensing and Robust Recovery of Low Rank Matrices M. Fazel, E. Candès, B. Recht, P. Parrilo Electrical Engineering, University of Washington Applied and Computational Mathematics Dept., Caltech

More information

Motivation Sparse Signal Recovery is an interesting area with many potential applications. Methods developed for solving sparse signal recovery proble

Motivation Sparse Signal Recovery is an interesting area with many potential applications. Methods developed for solving sparse signal recovery proble Bayesian Methods for Sparse Signal Recovery Bhaskar D Rao 1 University of California, San Diego 1 Thanks to David Wipf, Zhilin Zhang and Ritwik Giri Motivation Sparse Signal Recovery is an interesting

More information

Reweighted Laplace Prior Based Hyperspectral Compressive Sensing for Unknown Sparsity: Supplementary Material

Reweighted Laplace Prior Based Hyperspectral Compressive Sensing for Unknown Sparsity: Supplementary Material Reweighted Laplace Prior Based Hyperspectral Compressive Sensing for Unknown Sparsity: Supplementary Material Lei Zhang, Wei Wei, Yanning Zhang, Chunna Tian, Fei Li School of Computer Science, Northwestern

More information

Improving Approximate Message Passing Recovery of Sparse Binary Vectors by Post Processing

Improving Approximate Message Passing Recovery of Sparse Binary Vectors by Post Processing 10th International ITG Conference on Systems, Communications and Coding (SCC 2015) Improving Approximate Message Passing Recovery of Sparse Binary Vectors by Post Processing Martin Mayer and Norbert Goertz

More information

Massive MIMO: Signal Structure, Efficient Processing, and Open Problems II

Massive MIMO: Signal Structure, Efficient Processing, and Open Problems II Massive MIMO: Signal Structure, Efficient Processing, and Open Problems II Mahdi Barzegar Communications and Information Theory Group (CommIT) Technische Universität Berlin Heisenberg Communications and

More information

PERFORMANCE COMPARISON OF DATA-SHARING AND COMPRESSION STRATEGIES FOR CLOUD RADIO ACCESS NETWORKS. Pratik Patil, Binbin Dai, and Wei Yu

PERFORMANCE COMPARISON OF DATA-SHARING AND COMPRESSION STRATEGIES FOR CLOUD RADIO ACCESS NETWORKS. Pratik Patil, Binbin Dai, and Wei Yu PERFORMANCE COMPARISON OF DATA-SHARING AND COMPRESSION STRATEGIES FOR CLOUD RADIO ACCESS NETWORKS Pratik Patil, Binbin Dai, and Wei Yu Department of Electrical and Computer Engineering University of Toronto,

More information

Lecture 3: Compressive Classification

Lecture 3: Compressive Classification Lecture 3: Compressive Classification Richard Baraniuk Rice University dsp.rice.edu/cs Compressive Sampling Signal Sparsity wideband signal samples large Gabor (TF) coefficients Fourier matrix Compressive

More information

Application to Hyperspectral Imaging

Application to Hyperspectral Imaging Compressed Sensing of Low Complexity High Dimensional Data Application to Hyperspectral Imaging Kévin Degraux PhD Student, ICTEAM institute Université catholique de Louvain, Belgium 6 November, 2013 Hyperspectral

More information

Quantized Iterative Hard Thresholding:

Quantized Iterative Hard Thresholding: Quantized Iterative Hard Thresholding: ridging 1-bit and High Resolution Quantized Compressed Sensing Laurent Jacques, Kévin Degraux, Christophe De Vleeschouwer Louvain University (UCL), Louvain-la-Neuve,

More information

Near Ideal Behavior of a Modified Elastic Net Algorithm in Compressed Sensing

Near Ideal Behavior of a Modified Elastic Net Algorithm in Compressed Sensing Near Ideal Behavior of a Modified Elastic Net Algorithm in Compressed Sensing M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas M.Vidyasagar@utdallas.edu www.utdallas.edu/ m.vidyasagar

More information

Random Access Sensor Networks: Field Reconstruction From Incomplete Data

Random Access Sensor Networks: Field Reconstruction From Incomplete Data Random Access Sensor Networks: Field Reconstruction From Incomplete Data Fatemeh Fazel Northeastern University Boston, MA Email: fazel@ece.neu.edu Maryam Fazel University of Washington Seattle, WA Email:

More information

Lecture 16: Compressed Sensing

Lecture 16: Compressed Sensing Lecture 16: Compressed Sensing Introduction to Learning and Analysis of Big Data Kontorovich and Sabato (BGU) Lecture 16 1 / 12 Review of Johnson-Lindenstrauss Unsupervised learning technique key insight:

More information

Sparse Recovery with Non-uniform Chirp Sampling

Sparse Recovery with Non-uniform Chirp Sampling Sparse Recovery with Non-uniform Chirp Sampling Lorne Applebaum and Robert Calderbank Princeton University September 8, 2008 Acknowledgements University of Wisconsin-Madison Professor Rob Nowak Jarvis

More information

Compressed Sensing and Linear Codes over Real Numbers

Compressed Sensing and Linear Codes over Real Numbers Compressed Sensing and Linear Codes over Real Numbers Henry D. Pfister (joint with Fan Zhang) Texas A&M University College Station Information Theory and Applications Workshop UC San Diego January 31st,

More information