Noise, Image Reconstruction with Noise!
|
|
|
- Derek Cook
- 5 years ago
- Views:
Transcription
1 Noise, Image Reconstruction with Noise! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 10! Gordon Wetzstein! Stanford University!
2 What s a Pixel?! photon to electron converter!! photoelectric effect!! source: Molecular Expressions! wikipedia!
3 What s a Pixel?! source: Molecular Expressions! microlens: focus light on photodiode! color filter: select color channel! quantum efficiency: ~50%! fill factor: fraction of surface area used for light gathering! photon-to-charge conversion and ADC includes noise!
4 sensitivity! of sensor! to light! digital gain! ISO ( film speed )! bobatkins.com!
5 ! Noise! noise is (usually) bad! many sources of noise: heat, electronics, amplifier gain, photon to electron conversion, pixel defects, read,! let s start with something simple: fixed pattern noise!
6 Fixed Pattern Noise!! dead or hot pixels, dust,! remove with dark frame calibration:!!! I = I! I captured dark I! white! I dark! on RAW image! not JPEG (nonlinear)! Emil Martinec!
7 Noise! other than that, different noise follows different statistical distributions, these two are crucial:! Gaussian! Poisson!
8 !!! Gaussian Noise!! thermal, read, amplifier! additive, signal-independent, zero-mean! + =
9 with i.i.d. Gaussian noise:! (independent and identically-distributed)! Gaussian Noise! b = x +! x! N ( x,0)!! N ( 0," 2 ) additive Gaussian noise!
10 with i.i.d. Gaussian noise:! Gaussian Noise! b = x + η x N ( x,0) ( ) (independent and identically-distributed)! η N 0,σ 2 b N ( x,σ 2 ) p( b x,σ ) = 1 2πσ 2 e b x ( ) 2 2σ 2
11 with i.i.d. Gaussian noise:! Gaussian Noise! b = x +! x! N ( x,0) ( ) (independent and identically-distributed)!!! N 0," 2 b! N ( x,! 2 ) Bayes rule:! p( b x,! ) = 1 2"! 2 e# ( b#x) 2 2! 2
12 with i.i.d. Gaussian noise:! Gaussian Noise - MAP! b = x +! x! N ( x,0) ( ) (independent and identically-distributed)!!! N 0," 2 b! N ( x,! 2 ) Bayes rule:! maximum-a-posteriori estimation:! p( b x,! ) = 1 2"! 2 e# ( b#x) 2 2! 2
13 Gaussian Noise MAP Flat Prior! trivial solution (not useful in practice):! p( x) = 1
14 Gaussian Noise MAP Self Similarity Prior! Gaussian denoisers like non-local means and other selfsimilarity priors actually solve this problem:!
15 General Self Similarity Prior! generic proximal operator for function f(x):! proximal operator for some image prior!
16 General Self Similarity Prior! can use self-similarity as general image prior (not just for denoising)! proximal operator for some image prior!
17 General Self Similarity Prior! can use self-similarity as general image prior (not just for denoising)!! 2 = " /!! = " /! (h parameter in most NLM! implementations is std. dev.)! proximal operator for some image prior!
18 Image Reconstruction with Gaussian Noise! x N Ax,0 with i.i.d. Gaussian noise:! b = Ax + η ( ) ( ) (independent and identically-distributed)! η N 0,σ 2
19 Image Reconstruction with Gaussian Noise! x N Ax,0 with i.i.d. Gaussian noise:! b = Ax + η ( ) ( ) (independent and identically-distributed)! η N 0,σ 2 b N ( Ax,σ 2 ) p( b x,σ ) = 1 2πσ 2 e b Ax ( ) 2 2σ 2
20 Image Reconstruction with Gaussian Noise! x! N Ax,0 with i.i.d. Gaussian noise:! b = Ax +! ( ) ( ) (independent and identically-distributed)!!! N 0," 2 b! N ( Ax,! 2 ) Bayes rule:! maximum-a-posteriori estimation:! p( b x,! ) = 1 2"! 2 e# ( b#ax) 2 2! 2 regularized least squares (use ADMM)!
21 Scientific Sensors! e.g., Andor ixon Ultra 897: cooled to -100 C! scientific CMOS & CCD! reduce pretty much all noise, except for photon noise!
22 What is Photon (or Shot) Noise?! noise caused by the fluctuation when the incident light is converted to charge (detection)! also observed in the light emitted by a source, i.e. due to particle nature of light (emission)! same for re-emission à cascading Poisson processes are also described by a Poisson process [Teich and Saleh 1998]!
23 Photon Noise! noise is signal dependent! for N measured photo-electrons! standard deviation is, variance is! mean is! N Poisson distribution! σ = N σ 2 = N f (k; N) = N k e N k!
24 Photon Noise - SNR! signal-to-noise ratio SNR = N N SNR in db N photons:!! = N 2N photons:! nonlinear!! = 2 N 1,000 10,000 N
25 Photon Noise - SNR! signal-to-noise ratio SNR = N N N photons:!! = N 2N photons:! nonlinear!! = 2 N wikipedia!
26 Maximum Likelihood Solution for Poisson Noise! image formation:! probability of measurement i:! joint probability of all M measurements (use notation trick ):!
27 Maximum Likelihood Solution for Poisson Noise!!!!! log-likelihood function:! gradient:!
28 Maximum Likelihood Solution for Poisson Noise! Richardson-Lucy algorithm: iterative approach to ML estimation for Poisson noise! simple idea:! 1.! at solution, gradient will be zero!! 2.! when converged, further iterations will not change, i.e.!
29 ! Richardson-Lucy Algorithm! equate gradient to zero! rearrange so that 1 is on one side of equation! = 0
30 ! Richardson-Lucy Algorithm! equate gradient to zero! rearrange so that 1 is on one side of equation! = 0 set equal to!
31 ! Richardson-Lucy Algorithm! for any multiplicative update rule scheme:! start with positive initial guess (e.g. random values)! apply iteration scheme! future updates are guaranteed to remain positive! always get smaller residual! RL multiplicative update rules:!
32 Richardson-Lucy Algorithm - Deconvolution! Blurry & Noisy Measurement! RL Deconvolution!
33 Richardson-Lucy Algorithm! what went wrong?! Poisson deconvolution is a tough problem, without priors it s pretty much hopeless! let s try to incorporate the one prior we have learned: total variation!
34 !! Richardson-Lucy Algorithm + TV! log-likelihood function:! gradient:!
35 !!! Richardson-Lucy Algorithm + TV! gradient of anisotropic TV term! this is dirty : possible division by 0!!
36 !! Richardson-Lucy Algorithm + TV! follow the same logic as RL, RL+TV multiplicative update rules:! 2 major problems & solution hacks :! 1.! still possible division by 0 when gradient is zero!! set fraction to 0 if gradient is 0 2.! multiplicative update may become negative!! only work with (very) small values for lambda
37 (A Dirty but Easy Approach to) Richardson-Lucy with a TV Prior! Measurements! RL! RL+TV, lambda=0.005! RL+TV, lambda=0.025! Log Residual! Mean Squared Error!
38 Signal-to-Noise Ratio (SNR)! SNR = = mean pixel value standard deviation of pixel value = µ σ PQ e t PQ e t + Dt + N r 2 signal! noise! P = incident photon flux (photons/pixel/sec) Q e = quantum efficiency t = eposure time (sec) D = dark current (electroncs/pixel/sec), including hot pixels N r = read noise (rms electrons/pixel), including fixed pattern noise
39 Signal-to-Noise Ratio (SNR)! SNR = mean pixel value standard deviation of pixel value = µ! signal! noise! = PQ e t 2 PQ e t + Dt + N r signal-dependent! signal-independent! P = incident photon flux (photons/pixel/sec) Q e = quantum efficiency t = eposure time (sec) D = dark current (electroncs/pixel/sec), including hot pixels N r = read noise (rms electrons/pixel), including fixed pattern noise
40 Next: Compressive Imaging! single pixel camera! compressive hyperspectral imaging! compressive light field imaging! Marwah et al., 2013! Wakin et al. 2006!
41 References and Further Reading! L. Lucy, 1974 An iterative technique for the rectification of observed distributions. Astron. J. 79, ! W. Richardson, 1972 Bayesian-based iterative method of image restoration J. Opt. Soc. Am. 62, 1, ! N. Dey, L. Blanc-Feraud, C. Zimmer, Z. Kam, J. Olivo-Marin, J. Zerubia, 2004 A deconvolution method for confocal microscopy with total variation regularization, In IEEE Symposium on Biomedical Imaging: Nano to Macro, ! M. Teich, E. Saleh, 1998, Cascaded stochastic processes in optics, Traitement du Signal 15(6)! please also read the lecture notes, especially for the clean ADMM derivation for solving the maximum likelihood estimation of Poisson reconstruction with TV prior!!
EE 367 / CS 448I Computational Imaging and Display Notes: Noise, Denoising, and Image Reconstruction with Noise (lecture 10)
EE 367 / CS 448I Computational Imaging and Display Notes: Noise, Denoising, and Image Reconstruction with Noise (lecture 0) Gordon Wetzstein gordon.wetzstein@stanford.edu This document serves as a supplement
2 Regularized Image Reconstruction for Compressive Imaging and Beyond
EE 367 / CS 448I Computational Imaging and Display Notes: Compressive Imaging and Regularized Image Reconstruction (lecture ) Gordon Wetzstein gordon.wetzstein@stanford.edu This document serves as a supplement
EE 367 / CS 448I Computational Imaging and Display Notes: Image Deconvolution (lecture 6)
EE 367 / CS 448I Computational Imaging and Display Notes: Image Deconvolution (lecture 6) Gordon Wetzstein gordon.wetzstein@stanford.edu This document serves as a supplement to the material discussed in
PHYS 352. Shot Noise, 1/f Noise. current (which is rate of charge)
PHYS 352 Shot Noise, 1/f Noise Shot Noise current (which is rate of charge) current does not flow completely smoothly when charges arrive as quanta e.g. charge collection in a photodiode is a random, independent
Pose Tracking II! Gordon Wetzstein! Stanford University! EE 267 Virtual Reality! Lecture 12! stanford.edu/class/ee267/!
Pose Tracking II! Gordon Wetzstein! Stanford University! EE 267 Virtual Reality! Lecture 12! stanford.edu/class/ee267/!! WARNING! this class will be dense! will learn how to use nonlinear optimization
High resolution traction force microscopy on small focal adhesions improved accuracy through optimal marker distribution and optical flow tracking
Scientific Reports High resolution traction force microscopy on small focal adhesions improved accuracy through optimal marker distribution and optical flow tracking Claude N. Holenstein 1,2,*, Unai Silvan
Non-negative Quadratic Programming Total Variation Regularization for Poisson Vector-Valued Image Restoration
University of New Mexico UNM Digital Repository Electrical & Computer Engineering Technical Reports Engineering Publications 5-10-2011 Non-negative Quadratic Programming Total Variation Regularization
Deconvolution. Parameter Estimation in Linear Inverse Problems
Image Parameter Estimation in Linear Inverse Problems Chair for Computer Aided Medical Procedures & Augmented Reality Department of Computer Science, TUM November 10, 2006 Contents A naive approach......with
Lecture 9. PMTs and Laser Noise. Lecture 9. Photon Counting. Photomultiplier Tubes (PMTs) Laser Phase Noise. Relative Intensity
s and Laser Phase Phase Density ECE 185 Lasers and Modulators Lab - Spring 2018 1 Detectors Continuous Output Internal Photoelectron Flux Thermal Filtered External Current w(t) Sensor i(t) External System
INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET)
INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) International Journal of Electronics and Communication Engineering & Technology (IJECET), ISSN 0976 ISSN 0976 6464(Print)
Signal and Noise Modeling in Confocal Laser Scanning Fluorescence Microscopy
Signal and Noise Modeling in Confocal Laser Scanning Fluorescence Microscopy Gerlind Herberich 1, Reinhard Windoffer 2, Rudolf E. Leube 2, and Til Aach 1 1 Institute of Imaging and Computer Vision, RWTH
Computer Vision & Digital Image Processing
Computer Vision & Digital Image Processing Image Restoration and Reconstruction I Dr. D. J. Jackson Lecture 11-1 Image restoration Restoration is an objective process that attempts to recover an image
Detection of X-Rays. Solid state detectors Proportional counters Microcalorimeters Detector characteristics
Detection of X-Rays Solid state detectors Proportional counters Microcalorimeters Detector characteristics Solid State X-ray Detectors X-ray interacts in material to produce photoelectrons which are collected
An IDL Based Image Deconvolution Software Package
An IDL Based Image Deconvolution Software Package F. Városi and W. B. Landsman Hughes STX Co., Code 685, NASA/GSFC, Greenbelt, MD 20771 Abstract. Using the Interactive Data Language (IDL), we have implemented
Inverse problem and optimization
Inverse problem and optimization Laurent Condat, Nelly Pustelnik CNRS, Gipsa-lab CNRS, Laboratoire de Physique de l ENS de Lyon Decembre, 15th 2016 Inverse problem and optimization 2/36 Plan 1. Examples
Automated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling
Automated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling Abstract An automated unsupervised technique, based upon a Bayesian framework, for the segmentation of low light level
Intensity Transformations and Spatial Filtering: WHICH ONE LOOKS BETTER? Intensity Transformations and Spatial Filtering: WHICH ONE LOOKS BETTER?
: WHICH ONE LOOKS BETTER? 3.1 : WHICH ONE LOOKS BETTER? 3.2 1 Goal: Image enhancement seeks to improve the visual appearance of an image, or convert it to a form suited for analysis by a human or a machine.
Machine Learning. Lecture 4: Regularization and Bayesian Statistics. Feng Li. https://funglee.github.io
Machine Learning Lecture 4: Regularization and Bayesian Statistics Feng Li fli@sdu.edu.cn https://funglee.github.io School of Computer Science and Technology Shandong University Fall 207 Overfitting Problem
Ways to make neural networks generalize better
Ways to make neural networks generalize better Seminar in Deep Learning University of Tartu 04 / 10 / 2014 Pihel Saatmann Topics Overview of ways to improve generalization Limiting the size of the weights
IMPROVING THE DECONVOLUTION METHOD FOR ASTEROID IMAGES: OBSERVING 511 DAVIDA, 52 EUROPA, AND 12 VICTORIA
IMPROVING THE DECONVOLUTION METHOD FOR ASTEROID IMAGES: OBSERVING 511 DAVIDA, 52 EUROPA, AND 12 VICTORIA Z Robert Knight Department of Physics and Astronomy University of Hawai`i at Hilo ABSTRACT Deconvolution
ADMINISTRIVIA SENSOR
CSE 559A: Computer Vision ADMINISRIVIA Everyone needs to fill out survey and join Piazza. We strongly encourage you to use Piazza over e-mail for questions (mark only to instructors if you wish). Also
BLIND SEPARATION OF TEMPORALLY CORRELATED SOURCES USING A QUASI MAXIMUM LIKELIHOOD APPROACH
BLID SEPARATIO OF TEMPORALLY CORRELATED SOURCES USIG A QUASI MAXIMUM LIKELIHOOD APPROACH Shahram HOSSEII, Christian JUTTE Laboratoire des Images et des Signaux (LIS, Avenue Félix Viallet Grenoble, France.
Atmospheric Extinction
Atmospheric Extinction Calibrating stellar photometry requires correction for loss of light passing through the atmosphere. Atmospheric Rayleigh and aerosol scattering preferentially redirects blue light
CSE 559A: Computer Vision EVERYONE needs to fill out survey.
CSE 559A: Computer Vision ADMINISRIVIA EVERYONE needs to fill out survey. Setup git and Anaconda, send us your public key, and do problem set 0. Do immediately: submit public key and make sure you can
Miscellaneous. Regarding reading materials. Again, ask questions (if you have) and ask them earlier
Miscellaneous Regarding reading materials Reading materials will be provided as needed If no assigned reading, it means I think the material from class is sufficient Should be enough for you to do your
Deconvolution of confocal microscopy images using proximal iteration and sparse representations
Deconvolution of confocal microscopy images using proximal iteration and sparse representations François-Xavier Dupé, Jalal M. Fadili, Jean-Luc Starck To cite this version: François-Xavier Dupé, Jalal
A Spatially Adaptive Wiener Filter for Reflectance Estimation
A Spatially Adaptive Filter for Reflectance Estimation Philipp Urban, Mitchell R. Rosen, Roy S. Berns; Munsell Color Science Laboratory, Chester F. Carlson Center for Imaging Science, Rochester Institute
Quality & Information Content Of CHRIS Hyper-Spectral Data
Quality & Information Content Of CHRIS Hyper-Spectral Data B. Aiazzi, S. Baronti, P. Marcoionni, I. Pippi, M. Selva Institute of Applied Physics Nello Carrara IFAC-CNR, Florence Italy Information-Theoretic
AN NONNEGATIVELY CONSTRAINED ITERATIVE METHOD FOR POSITRON EMISSION TOMOGRAPHY. Johnathan M. Bardsley
Volume X, No. 0X, 0X, X XX Web site: http://www.aimsciences.org AN NONNEGATIVELY CONSTRAINED ITERATIVE METHOD FOR POSITRON EMISSION TOMOGRAPHY Johnathan M. Bardsley Department of Mathematical Sciences
DS-GA 1002 Lecture notes 11 Fall Bayesian statistics
DS-GA 100 Lecture notes 11 Fall 016 Bayesian statistics In the frequentist paradigm we model the data as realizations from a distribution that depends on deterministic parameters. In contrast, in Bayesian
Non-Convex Optimization. CS6787 Lecture 7 Fall 2017
Non-Convex Optimization CS6787 Lecture 7 Fall 2017 First some words about grading I sent out a bunch of grades on the course management system Everyone should have all their grades in Not including paper
Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak
Introduction to Systems Analysis and Decision Making Prepared by: Jakub Tomczak 1 Introduction. Random variables During the course we are interested in reasoning about considered phenomenon. In other words,
Laboratory 3&4: Confocal Microscopy Imaging of Single-Emitter Fluorescence and Hanbury Brown and Twiss setup for Photon Antibunching
Laboratory 3&4: Confocal Microscopy Imaging of Single-Emitter Fluorescence and Hanbury Brown and Twiss setup for Photon Antibunching Jose Alejandro Graniel Institute of Optics University of Rochester,
Satellite image deconvolution using complex wavelet packets
Satellite image deconvolution using complex wavelet packets André Jalobeanu, Laure Blanc-Féraud, Josiane Zerubia ARIANA research group INRIA Sophia Antipolis, France CNRS / INRIA / UNSA www.inria.fr/ariana
Bayesian Paradigm. Maximum A Posteriori Estimation
Bayesian Paradigm Maximum A Posteriori Estimation Simple acquisition model noise + degradation Constraint minimization or Equivalent formulation Constraint minimization Lagrangian (unconstraint minimization)
What is Image Deblurring?
What is Image Deblurring? When we use a camera, we want the recorded image to be a faithful representation of the scene that we see but every image is more or less blurry, depending on the circumstances.
ECE521 lecture 4: 19 January Optimization, MLE, regularization
ECE521 lecture 4: 19 January 2017 Optimization, MLE, regularization First four lectures Lectures 1 and 2: Intro to ML Probability review Types of loss functions and algorithms Lecture 3: KNN Convexity
Capturing and Processing Deep Space Images. Petros Pissias Eumetsat Astronomy Club 15/03/2018
Capturing and Processing Deep Space Images Petros Pissias Eumetsat Astronomy Club 15/03/2018 Agenda Introduction Basic Equipment Preparation Acquisition Processing Quick demo Petros Pissias Eumetsat Astronomy
A Variational Approach to Reconstructing Images Corrupted by Poisson Noise
J Math Imaging Vis c 27 Springer Science + Business Media, LLC. Manufactured in The Netherlands. DOI: 1.7/s1851-7-652-y A Variational Approach to Reconstructing Images Corrupted by Poisson Noise TRIET
Application of Image Restoration Technique in Flow Scalar Imaging Experiments Guanghua Wang
Application of Image Restoration Technique in Flow Scalar Imaging Experiments Guanghua Wang Center for Aeromechanics Research Department of Aerospace Engineering and Engineering Mechanics The University
Detecting high energy photons. Interactions of photons with matter Properties of detectors (with examples)
Detecting high energy photons Interactions of photons with matter Properties of detectors (with examples) Interactions of high energy photons with matter Cross section/attenution length/optical depth Photoelectric
Learning MMSE Optimal Thresholds for FISTA
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Learning MMSE Optimal Thresholds for FISTA Kamilov, U.; Mansour, H. TR2016-111 August 2016 Abstract Fast iterative shrinkage/thresholding algorithm
2007 American Institute of Physics. Reprinted with permission.
Danai Laksameethanasan and Sami S. Brandt. 2007. Generalised Skilling Bryan minimisation for micro rotation imaging in light microscopy. In: Kevin H. Knuth, Ariel Caticha, Julian L. Center Jr., Adom Giffin,
Poisson Image Denoising Using Best Linear Prediction: A Post-processing Framework
Poisson Image Denoising Using Best Linear Prediction: A Post-processing Framework Milad Niknejad, Mário A.T. Figueiredo Instituto de Telecomunicações, and Instituto Superior Técnico, Universidade de Lisboa,
Supplementary Figures Supplementary Figure 1: Estimation of the error of the number and brightness of molecules in a single cluster; Simulation
Supplementary Figures Supplementary Figure 1: Estimation of the error of the number and brightness of molecules in a single cluster; Simulation (a,c) Relative estimated numbers of molecules ; (b,d) relative
EE 574 Detection and Estimation Theory Lecture Presentation 8
Lecture Presentation 8 Aykut HOCANIN Dept. of Electrical and Electronic Engineering 1/14 Chapter 3: Representation of Random Processes 3.2 Deterministic Functions:Orthogonal Representations For a finite-energy
Numerical Methods in TEM Convolution and Deconvolution
Numerical Methods in TEM Convolution and Deconvolution Christoph T. Koch Max Planck Institut für Metallforschung http://hrem.mpi-stuttgart.mpg.de/koch/vorlesung Applications of Convolution in TEM Smoothing
Image enhancement. Why image enhancement? Why image enhancement? Why image enhancement? Example of artifacts caused by image encoding
13 Why image enhancement? Image enhancement Example of artifacts caused by image encoding Computer Vision, Lecture 14 Michael Felsberg Computer Vision Laboratory Department of Electrical Engineering 12
SOS Boosting of Image Denoising Algorithms
SOS Boosting of Image Denoising Algorithms Yaniv Romano and Michael Elad The Technion Israel Institute of technology Haifa 32000, Israel The research leading to these results has received funding from
Probabilistic and Bayesian Machine Learning
Probabilistic and Bayesian Machine Learning Lecture 1: Introduction to Probabilistic Modelling Yee Whye Teh ywteh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit University College London Why a
Sparsity and Morphological Diversity in Source Separation. Jérôme Bobin IRFU/SEDI-Service d Astrophysique CEA Saclay - France
Sparsity and Morphological Diversity in Source Separation Jérôme Bobin IRFU/SEDI-Service d Astrophysique CEA Saclay - France Collaborators - Yassir Moudden - CEA Saclay, France - Jean-Luc Starck - CEA
Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi
Communication Engineering Prof. Surendra Prasad Department of Electrical Engineering Indian Institute of Technology, Delhi Lecture - 41 Pulse Code Modulation (PCM) So, if you remember we have been talking
Math background for PS1. Jiahui Shi
CS 231A Section 2 Math background for PS1 Jiahui Shi Jiahui Shi Section 2-1 2011.10.7 Announcement Updated deadline of PS1: 10/14, 12 noon Extra office hour for PS1: 10/13, 7 9pm, Gates 104 Jiahui Shi
Compressed Sensing: Extending CLEAN and NNLS
Compressed Sensing: Extending CLEAN and NNLS Ludwig Schwardt SKA South Africa (KAT Project) Calibration & Imaging Workshop Socorro, NM, USA 31 March 2009 Outline 1 Compressed Sensing (CS) Introduction
Bayes Filter Reminder. Kalman Filter Localization. Properties of Gaussians. Gaussians. Prediction. Correction. σ 2. Univariate. 1 2πσ e.
Kalman Filter Localization Bayes Filter Reminder Prediction Correction Gaussians p(x) ~ N(µ,σ 2 ) : Properties of Gaussians Univariate p(x) = 1 1 2πσ e 2 (x µ) 2 σ 2 µ Univariate -σ σ Multivariate µ Multivariate
Approximate Message Passing Algorithms
November 4, 2017 Outline AMP (Donoho et al., 2009, 2010a) Motivations Derivations from a message-passing perspective Limitations Extensions Generalized Approximate Message Passing (GAMP) (Rangan, 2011)
The deconvolution of lunar brightness temperature based on maximum entropy method using Chang E-2 microwave data
Research in Astron. Astrophys. 201x Vol. X No. XX, 000 000 http://www.raa-journal.org http://www.iop.org/journals/raa Research in Astronomy and Astrophysics The deconvolution of lunar brightness temperature
Application of deconvolution to images from the EGRET gamma-ray telescope
Application of deconvolution to images from the EGRET gamma-ray telescope Symeon Charalabides, Andy Shearer, Ray Butler (National University of Ireland, Galway, Ireland) ABSTRACT The EGRET gamma-ray telescope
Comunicações Ópticas Noise in photodetectors MIEEC EEC038. Henrique Salgado Receiver operation
Comunicações Ópticas Noise in photodetectors 2007-2008 MIEEC EEC038 Henrique Salgado hsalgado@fe.up.pt Receiver operation Noise plays a fundamental role in design of an optical receiver Optical data link
Auxiliaire d enseignement Nicolas Ayotte
2012-02-15 GEL 4203 / GEL 7041 OPTOÉLECTRONIQUE Auxiliaire d enseignement Nicolas Ayotte GEL 4203 / GEL 7041 Optoélectronique VI PN JUNCTION The density of charge sign Fixed charge density remaining 2
Maximum-Likelihood fitting
CMP 0b Lecture F. Sigworth Maximum-Likelihood fitting One of the issues I want to address in this lecture is the fitting of distributions dwell times. We want to find the best curve to draw over a histogram,
Autonomous Navigation for Flying Robots
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 6.2: Kalman Filter Jürgen Sturm Technische Universität München Motivation Bayes filter is a useful tool for state
Bayesian Classifiers and Probability Estimation. Vassilis Athitsos CSE 4308/5360: Artificial Intelligence I University of Texas at Arlington
Bayesian Classifiers and Probability Estimation Vassilis Athitsos CSE 4308/5360: Artificial Intelligence I University of Texas at Arlington 1 Data Space Suppose that we have a classification problem The
Review for Exam 1. Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA
Review for Exam Erik G. Learned-Miller Department of Computer Science University of Massachusetts, Amherst Amherst, MA 0003 March 26, 204 Abstract Here are some things you need to know for the in-class
Learning from Data: Regression
November 3, 2005 http://www.anc.ed.ac.uk/ amos/lfd/ Classification or Regression? Classification: want to learn a discrete target variable. Regression: want to learn a continuous target variable. Linear
Detection of Subsurface Defects using Active Infrared Thermography
Detection of Subsurface Defects using Active Infrared Thermography More Info at Open Access Database www.ndt.net/?id=15141 Suman Tewary 1,2,a, Aparna Akula 1,2, Ripul Ghosh 1,2, Satish Kumar 2, H K Sardana
Reduction procedure of long-slit optical spectra. Astrophysical observatory of Asiago
Reduction procedure of long-slit optical spectra Astrophysical observatory of Asiago Spectrograph: slit + dispersion grating + detector (CCD) It produces two-dimension data: Spatial direction (x) along
ECE521 week 3: 23/26 January 2017
ECE521 week 3: 23/26 January 2017 Outline Probabilistic interpretation of linear regression - Maximum likelihood estimation (MLE) - Maximum a posteriori (MAP) estimation Bias-variance trade-off Linear
Coherent use of opposing lenses for axial resolution increase. II. Power and limitation of nonlinear image restoration
M. Nagorni and S. W. Hell Vol. 18, No. 1/January 2001/J. Opt. Soc. Am. A 49 Coherent use of opposing lenses for axial resolution increase. II. Power and limitation of nonlinear image restoration Matthias
Lecture Notes 2 Charge-Coupled Devices (CCDs) Part I. Basic CCD Operation CCD Image Sensor Architectures Static and Dynamic Analysis
Lecture Notes 2 Charge-Coupled Devices (CCDs) Part I Basic CCD Operation CCD Image Sensor Architectures Static and Dynamic Analysis Charge Well Capacity Buried channel CCD Transfer Efficiency Readout Speed
Noise-Blind Image Deblurring Supplementary Material
Noise-Blind Image Deblurring Supplementary Material Meiguang Jin University of Bern Switzerland Stefan Roth TU Darmstadt Germany Paolo Favaro University of Bern Switzerland A. Upper and Lower Bounds Our
AS750 Observational Astronomy
Lecture 9 0) Poisson! (quantum limitation) 1) Diffraction limit 2) Detection (aperture) limit a)simple case b)more realistic case 3) Atmosphere 2) Aperture limit (More realistic case) Aperture has m pixels
CSCI567 Machine Learning (Fall 2014)
CSCI567 Machine Learning (Fall 24) Drs. Sha & Liu {feisha,yanliu.cs}@usc.edu October 2, 24 Drs. Sha & Liu ({feisha,yanliu.cs}@usc.edu) CSCI567 Machine Learning (Fall 24) October 2, 24 / 24 Outline Review
Lecture 2: From Linear Regression to Kalman Filter and Beyond
Lecture 2: From Linear Regression to Kalman Filter and Beyond Department of Biomedical Engineering and Computational Science Aalto University January 26, 2012 Contents 1 Batch and Recursive Estimation
Image Processing by the Curvelet Transform
Image Processing by the Curvelet Transform Jean Luc Starck Dapnia/SEDI SAP, CEA Saclay, France. jstarck@cea.fr http://jstarck.free.fr Collaborators: D.L. Donoho, Department of Statistics, Stanford E. Candès,
ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II
1 Non-linear regression techniques Part - II Regression Algorithms in this Course Support Vector Machine Relevance Vector Machine Support vector regression Boosting random projections Relevance vector
Gaussian and Linear Discriminant Analysis; Multiclass Classification
Gaussian and Linear Discriminant Analysis; Multiclass Classification Professor Ameet Talwalkar Slide Credit: Professor Fei Sha Professor Ameet Talwalkar CS260 Machine Learning Algorithms October 13, 2015
CS 4495 Computer Vision Principle Component Analysis
CS 4495 Computer Vision Principle Component Analysis (and it s use in Computer Vision) Aaron Bobick School of Interactive Computing Administrivia PS6 is out. Due *** Sunday, Nov 24th at 11:55pm *** PS7
ECE521 Lecture7. Logistic Regression
ECE521 Lecture7 Logistic Regression Outline Review of decision theory Logistic regression A single neuron Multi-class classification 2 Outline Decision theory is conceptually easy and computationally hard
EXPOSURE TIME ESTIMATION
ASTR 511/O Connell Lec 12 1 EXPOSURE TIME ESTIMATION An essential part of planning any observation is to estimate the total exposure time needed to satisfy your scientific goal. General considerations
Model-based Correlation Measure for Gain and Offset Nonuniformity in Infrared Focal-Plane-Array Sensors
Model-based Correlation Measure for Gain and Offset Nonuniformity in Infrared Focal-Plane-Array Sensors César San Martin Sergio Torres Abstract In this paper, a model-based correlation measure between
Sean Escola. Center for Theoretical Neuroscience
Employing hidden Markov models of neural spike-trains toward the improved estimation of linear receptive fields and the decoding of multiple firing regimes Sean Escola Center for Theoretical Neuroscience
Introduction to Bayesian methods in inverse problems
Introduction to Bayesian methods in inverse problems Ville Kolehmainen 1 1 Department of Applied Physics, University of Eastern Finland, Kuopio, Finland March 4 2013 Manchester, UK. Contents Introduction
Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors
Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors Sean Borman and Robert L. Stevenson Department of Electrical Engineering, University of Notre Dame Notre Dame,
Wide-field Infrared Survey Explorer
Wide-field Infrared Survey Explorer Proposed Raw-Pixel Error Model Version.1, 4-ovember-008 Prepared by: Frank Masci Infrared Processing and Analysis Center California Institute of Technology WSDC D-T001
Analysis of Rate-distortion Functions and Congestion Control in Scalable Internet Video Streaming
Analysis of Rate-distortion Functions and Congestion Control in Scalable Internet Video Streaming Min Dai Electrical Engineering, Texas A&M University Dmitri Loguinov Computer Science, Texas A&M University
3.3 ANALYSIS. H2RG CHARACTERISATION METHODS Bogna Kubik, analyst. NISP, NI-SCS Test Readiness Review IPNL, October 2016
3.3 ANALYSIS H2RG CHARACTERISATION METHODS Bogna Kubik, analyst NISP, NI-SCS Test Readiness Review IPNL, October 2016 1 Goals Reference pixels correction: Find and implement the optimal correction. Signal
Patch similarity under non Gaussian noise
The 18th IEEE International Conference on Image Processing Brussels, Belgium, September 11 14, 011 Patch similarity under non Gaussian noise Charles Deledalle 1, Florence Tupin 1, Loïc Denis 1 Institut
Bayesian Machine Learning
Bayesian Machine Learning Andrew Gordon Wilson ORIE 6741 Lecture 2: Bayesian Basics https://people.orie.cornell.edu/andrew/orie6741 Cornell University August 25, 2016 1 / 17 Canonical Machine Learning
Linear Diffusion and Image Processing. Outline
Outline Linear Diffusion and Image Processing Fourier Transform Convolution Image Restoration: Linear Filtering Diffusion Processes for Noise Filtering linear scale space theory Gauss-Laplace pyramid for
Counting Photons to Calibrate a Photometer for Stellar Intensity Interferometry
Counting Photons to Calibrate a Photometer for Stellar Intensity Interferometry A Senior Project Presented to the Department of Physics California Polytechnic State University, San Luis Obispo In Partial
Bayesian statistics. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Bayesian statistics DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall15 Carlos Fernandez-Granda Frequentist vs Bayesian statistics In frequentist statistics
Efficient Variational Inference in Large-Scale Bayesian Compressed Sensing
Efficient Variational Inference in Large-Scale Bayesian Compressed Sensing George Papandreou and Alan Yuille Department of Statistics University of California, Los Angeles ICCV Workshop on Information
CCD OPERATION. The BBD was an analog delay line, made up of capacitors such that an analog signal was moving along one step at each clock cycle.
CCDS Lesson 4 CCD OPERATION The predecessor of the CCD was a device called the BUCKET BRIGADE DEVICE developed at the Phillips Research Labs The BBD was an analog delay line, made up of capacitors such
Lecture 5: GPs and Streaming regression
Lecture 5: GPs and Streaming regression Gaussian Processes Information gain Confidence intervals COMP-652 and ECSE-608, Lecture 5 - September 19, 2017 1 Recall: Non-parametric regression Input space X
You, too, can make useful and beautiful astronomical images at Mees: Lesson 3
You, too, can make useful and beautiful astronomical images at Mees: Lesson 3 Calibration and data reduction Useful references, besides Lessons 1 and 2: The AST 142 Projects manual: http://www.pas.rochester.edu/~dmw/ast142/projects/project.pdf
Kalman filtering and friends: Inference in time series models. Herke van Hoof slides mostly by Michael Rubinstein
Kalman filtering and friends: Inference in time series models Herke van Hoof slides mostly by Michael Rubinstein Problem overview Goal Estimate most probable state at time k using measurement up to time
Lecture 15. Theory of random processes Part III: Poisson random processes. Harrison H. Barrett University of Arizona
Lecture 15 Theory of random processes Part III: Poisson random processes Harrison H. Barrett University of Arizona 1 OUTLINE Poisson and independence Poisson and rarity; binomial selection Poisson point
Spatially adaptive alpha-rooting in BM3D sharpening
Spatially adaptive alpha-rooting in BM3D sharpening Markku Mäkitalo and Alessandro Foi Department of Signal Processing, Tampere University of Technology, P.O. Box FIN-553, 33101, Tampere, Finland e-mail:
Lecture 4: Probabilistic Learning
DD2431 Autumn, 2015 1 Maximum Likelihood Methods Maximum A Posteriori Methods Bayesian methods 2 Classification vs Clustering Heuristic Example: K-means Expectation Maximization 3 Maximum Likelihood Methods