ADAPTIVE ALGEBRAIC RECONSTRUCTION OF CT IMAGES IN COMPARISON TO FREQUENCY DOMAIN METHODS. Bernhard Bundschuh Universität-GH-Siegen, Germany

Size: px
Start display at page:

Download "ADAPTIVE ALGEBRAIC RECONSTRUCTION OF CT IMAGES IN COMPARISON TO FREQUENCY DOMAIN METHODS. Bernhard Bundschuh Universität-GH-Siegen, Germany"

Transcription

1 ADAPIVE ALGEBRAIC RECONSRUCION OF C IMAGES IN COMPARISON O FREQUENCY DOMAIN MEHODS Bernhard Bundschuh Universität-GH-Siegen German Abstract his paper presents a new algebraic algorithm for the reconstruction of computer tomographic (C) images. Since the reconstruction is an ill posed problem a least squares approach with adaptivel weighted linear shift invariant regularization functions is used. If the weighting functions are properl matched to the regularization functions the adaptive algorithm simultaneousl leads to proper noise suppression and enhanced resolution of discontinuities. Simulations demonstrate the reconstruction capabilities of the new algorithm in comparison to filtered backprojection. 1. Statement of the Problem Fig. 1 shows the data collection process in C using parallel beam projections. It can be described as the application of a twodimensional linear shift variant filter [1] to the original image. Basicall fan beam projections lead to the same considerations [1]. he generation of the measured data g(tϑ) can be described using a line integral. In x-ra-c the noise n(tϑ) is Poisson distributed []. ( ϑ) = ( ) δ ( cosϑ + sin ϑ ) + ( ϑ) g t s x x t dxd n t (1) Using a different point of view eq. defines the linear shift variant point spread function of the twodimensional linear sstem which generates the measured data. ( ϑ) = ( ) ( ϑ) + ( ϑ) g t s x h x t dxd n t ( ϑ) = δ( cosϑ + sinϑ ) h x t x t ()

2 he discrete equivalent of eq. can be written using components: ( d ϑ ) = ( x ) ( x d ϑ ) + ( d ϑ ) g i i s i i h i i i i n i i ix i (3) or vector matrix notation: g = H s + n (4) emitters x-ras h(i x i i d i ϑ ) = A/ x original image s(x) x x A g(t ϑ ) t ϑ detectors projection Figure 1: Parallel beam C-scanner. Regularized Algebraic Reconstruction Since H represents a low pass sstem and the measured data g are nois the reconstruction of s is an ill posed problem [3]. he quadratic error term E Q includes a group of linear shift invariant regularization functions which are represented b the block oeplitz matrices F1 F K F M. Since we intend to develop an adaptive algorithm we introduce the inverse weighting matrices V1 V K V A M and. ( ) ( ) ( M M M ) = g Hs$ A g Hs$ + s$ F V F + F V F + K + F V F s$ (5) E Q he solution vector $s is found b minimization of the error E Q. Setting the derivative of E Q with respect to the solution vector to zero leads to a linear sstem of equations.

3 E Q $s = 0 (6) ( M M M ) $s = H A H + F V F + F V F + K + F V F H A g (7) V1 V K V M and A are optimized b minimization of the expectation D Q of the squared distance between the original signal s and the estimated signal $s. D Q ( $ ) ( $ ) = s s s s (8) DQ V m = 0 m DQ A = 0 (9) Straightforward application of matrix differentiation rules and matrix algebra leads to M+1 identical matrix equations so that there is an infinite number of solutions. 1 1 ( 1 1opt 1 opt M Mopt M ) F V F + F V F + K + F V F ss H = H A nn (10) Since each solution minimizes D Q we are free to select the simplest one: opt Aopt = nn (11) Fm VmoptFm ss H mh = µ Aopt nn m (1) Vmopt = µ m 1 Fm ss F m m (13) where: µ 1 + µ + K+ µ M = 1 0 µ m 1 m he matrices V1 opt V opt K V Mopt and Aoptare determined b the autocorrelation matrices in other words b the statistics of the original signal and the noise. If the are inserted into eq. 7 the resulting estimate is similar to the estimate provided b a shift variant Wiener Filter [34]. If the signal and the noise are Gaussian distributed it is also similar to a Maximum a Posteriori estimate [3]. here are two reasons wh this algorithm is not applicable to most practical problems. First the autocorrelation matrices must be known ver accuratel. Usuall this is no problem for the noise. But a reliable estimate of the autocorrelation matrix of the original signal is hardl available. Second the size of the matrices is prohibitivel large especiall for multidimensional signals. he autocorrelation matrix of an image which consists of not more than pixels contains coefficients!

4 3 Suboptimal Diagonal Weighting Matrices In order to derive a suboptimal but applicable algorithm we do not longer search for optimal matrices in the general form but for optimal diagonal matrices. E Q ( ) D ( ) ( 1 D1 1 D M DM M ) = g Hs$ A g Hs$ + s$ F V F + F V F + K + F V F s$ (14) ( D 1 D1 1 D M DM M ) $s = H A H + F V F + F V F + K + F V F H A g (15) V V K V and A are again optimized b minimization of D Q (eq. 8). D1 D DM D he simplest solution is: DQ vdm = 0 m i DQ ad = 0 k (16) ii kk D ad kkopt = nn vdm = µ m 1 Fm ss Fm (17) kk iiopt ii We onl take into account the diagonal elements of the previousl determined general weighting matrices. Obviousl VDmopt and ADopt are the diagonal matrices which are closest to Vmopt and Aopt. If the noise is white the optimal diagonal matrix A D equals the general matrix A. he local variances of the Poisson distributed noise which can be estimated from the measured data provide the diagonal elements of A Dopt. ( ) adopt = σ n id i (18) ϑ Now we can calculate the diagonal elements of the weighting matrix V Dm. vdm = µ 1 m fm( jx j ) s( ix jx i j ) ii (19) jx j he reciprocals determine the optimal weighting function wm( ix i ). w i i f j j s i j i j jx j ( ) = µ ( ) ( ) m x m m x x x (0) Eq. 0 indicates that each optimal weighting function is matched to the corresponding regularization function in a remarkabl simple wa [4]. he selection of a group of suitable regu-

5 larization functions [4] which is not critical completel determines the optimal weighting functions. EQ = n id i g i i s i i h i i i i i i i i d ϑ ( ) ( d ) $ ( x ) ( x d ) σ ϑ ϑ ϑ + wm ix i f j j s i j i j m i i x jx j x ( ) m( x ) $ ( x x ) + (1) ( ) de ds$ q q = 0 q q () Q x x Basicall the solution of the resulting linear sstem of equations can be found b matrix inversion. But usuall an iteration is much faster. he weighting functions lead to strong smoothing in continuous regions and to modest smoothing at discontinuities [4]. ix i ( ) s$ ix i σ n ( id iϑ ) h( ix i id iϑ ) h( qx q id iϑ ) + i i d ϑ + w j j f j i j i f j q j q m j j x ( ) ( ) ( ) m x m x x m x x = ( id i ) g( id i ) h( qx q id i ) = σ n ϑ ϑ ϑ id iϑ (3) Unless a pure simulation is performed w m (i x i ) is not known a priori. herefore the first guess of the unknown signal e.g. the result of filtered backprojection is also used to obtain a first estimate of w m (i x i ). If we assume that during the iteration the estimated signal converges to the original signal improved estimates of the weighting functions can be determined successivel from the intermediate results of the iteration. Simulation experiments showed that even in the case of a starting guess of 0 this trick approach converges without problems. So we obtain an algorithm which is self updating at least up to a certain degree of accurac [4]. Since the general matrices V m were replaced b the diagonal matrices V D the application of the regularization functions to the original signal should create signals which are as "white" as possible. On the other hand the number of coefficients of f m (i x i ) is limited. Otherwise the number of computations required at each step of the iteration would be too large. Examples for appropriate regularization functions are the differential operators mentioned in part 4 of this paper. A more detailed but preliminar investigation can be found in [4].

6 4. Results of Simulation Figure shows the widel used Shepp and Logan head phantom [1] which provides a standard test signal for the qualit assessment of C reconstruction algorithms. It consists of a collection of ellipses of different size brightness and orientation. Figure : est signal Figure 3 shows the result of a reconstruction using filtered backprojection [1]. he noise which is superimposed to the projections is white and Poisson distributed. he signal to noise ratio is 30 db. A cos -window in the frequenc domain suppresses high frequenc noise which is emphasized too strongl b the filter operation before the backprojection is performed. Figure 3: Result of filtered backprojection

7 Figure 4: Adaptive algebraic reconstruction Figure 4 shows a reconstruction using the adaptive algebraic approach. Since the basic element of the head phantom is an ellipse four regularization and weighting functions are used two in direction of the coordinate axes and two in diagonal direction. ( x ) = δ( x ) δ( x ) ( x ) = δ( x ) δ( x ) ( x ) = δ( x ) δ( x ) ( x ) = δ( x ) δ( x + ) f j j j j j j 1 1 f j j j j j j 1 f 3 j j j j j 1 j 1 f 4 j j j j j 1 j 1 he result of filtered backprojection is used as a starting guess for the iteration. he result of algebraic reconstruction is less grain than that of filtered backprojection and the contours appear much clearer. On the other hand using a general purpose computer the filtered backprojection is calculated within a few seconds while the algebraic reconstruction lasts several minutes for a pixel image. Using a special purpose hardware processor it should be possible to reduce the time for an algebraic reconstruction b several orders of magnitude. Since the algebraic reconstruction method is less sensitive to noise its main advantage seems to be the potential reduction of the required radiation dose. 5. Conclusions he adaptive algebraic algorithm provides clearer reconstructions than filtered backprojection and it is less sensitive to noise. herefore it offers the potential for a considerable reduction of the required radiation dose. he reduction of the required computer power is the main problem which remains to be solved. A special purpose reconstruction hardware should allow a reduction b several orders of magnitude. 6. Acknowledgement I would like to thank Ulrich Wieczorek Detlev Herrmann and Uwe Wiemann for their support and for the valuable discussions. Also I would like to thank the Zentrum für Sensorssteme and the ministr of science of Nordrhein Westfalen who funded this work. References [1] A.C. Kak M. Slane Principles of Computerized omographic Imaging IEEE Press New York 1987 [] G.. Herman Image Reconstruction from Projections the Fundamentals of Computerized omograph Academic Press New York London oronto Sdne San Francisco 1980 [3] H.C. Andrews B.R. Hunt Digital Image Restoration Prentice-Hall Englewood Cliffs N.J. 1977

8 [4] B. Bundschuh Adaptive Image Restoration and Reconstruction hird International Seminar on Digital Image Processing in Medicine Remote Sensing and Visualization of Information Riga April 199

Numerical Methods. Rafał Zdunek Underdetermined problems (2h.) Applications) (FOCUSS, M-FOCUSS,

Numerical Methods. Rafał Zdunek Underdetermined problems (2h.) Applications) (FOCUSS, M-FOCUSS, Numerical Methods Rafał Zdunek Underdetermined problems (h.) (FOCUSS, M-FOCUSS, M Applications) Introduction Solutions to underdetermined linear systems, Morphological constraints, FOCUSS algorithm, M-FOCUSS

More information

Introduction to the Mathematics of Medical Imaging

Introduction to the Mathematics of Medical Imaging Introduction to the Mathematics of Medical Imaging Second Edition Charles L. Epstein University of Pennsylvania Philadelphia, Pennsylvania EiaJTL Society for Industrial and Applied Mathematics Philadelphia

More information

NIH Public Access Author Manuscript Proc Soc Photo Opt Instrum Eng. Author manuscript; available in PMC 2013 December 17.

NIH Public Access Author Manuscript Proc Soc Photo Opt Instrum Eng. Author manuscript; available in PMC 2013 December 17. NIH Public Access Author Manuscript Published in final edited form as: Proc Soc Photo Opt Instrum Eng. 2008 March 18; 6913:. doi:10.1117/12.769604. Tomographic Reconstruction of Band-limited Hermite Expansions

More information

Restoration of Missing Data in Limited Angle Tomography Based on Helgason- Ludwig Consistency Conditions

Restoration of Missing Data in Limited Angle Tomography Based on Helgason- Ludwig Consistency Conditions Restoration of Missing Data in Limited Angle Tomography Based on Helgason- Ludwig Consistency Conditions Yixing Huang, Oliver Taubmann, Xiaolin Huang, Guenter Lauritsch, Andreas Maier 26.01. 2017 Pattern

More information

Identification of Nonlinear Dynamic Systems with Multiple Inputs and Single Output using discrete-time Volterra Type Equations

Identification of Nonlinear Dynamic Systems with Multiple Inputs and Single Output using discrete-time Volterra Type Equations Identification of Nonlinear Dnamic Sstems with Multiple Inputs and Single Output using discrete-time Volterra Tpe Equations Thomas Treichl, Stefan Hofmann, Dierk Schröder Institute for Electrical Drive

More information

Hamburger Beiträge zur Angewandten Mathematik

Hamburger Beiträge zur Angewandten Mathematik Hamburger Beiträge zur Angewandten Mathematik Error Estimates for Filtered Back Projection Matthias Beckmann and Armin Iske Nr. 2015-03 January 2015 Error Estimates for Filtered Back Projection Matthias

More information

1 GSW Gaussian Elimination

1 GSW Gaussian Elimination Gaussian elimination is probabl the simplest technique for solving a set of simultaneous linear equations, such as: = A x + A x + A x +... + A x,,,, n n = A x + A x + A x +... + A x,,,, n n... m = Am,x

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

Non-linear least squares

Non-linear least squares Non-linear least squares Concept of non-linear least squares We have extensively studied linear least squares or linear regression. We see that there is a unique regression line that can be determined

More information

Phase Space Tomography of an Electron Beam in a Superconducting RF Linac

Phase Space Tomography of an Electron Beam in a Superconducting RF Linac Phase Space Tomography of an Electron Beam in a Superconducting RF Linac Tianyi Ge 1, and Jayakar Thangaraj 2, 1 Department of Physics and Astronomy, University of California, Los Angeles, California 90095,

More information

Scan Time Optimization for Post-injection PET Scans

Scan Time Optimization for Post-injection PET Scans Presented at 998 IEEE Nuc. Sci. Symp. Med. Im. Conf. Scan Time Optimization for Post-injection PET Scans Hakan Erdoğan Jeffrey A. Fessler 445 EECS Bldg., University of Michigan, Ann Arbor, MI 4809-222

More information

REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE

REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE Int. J. Appl. Math. Comput. Sci., 007, Vol. 17, No., 157 164 DOI: 10.478/v10006-007-0014-3 REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE DOROTA KRAWCZYK-STAŃDO,

More information

MAP Reconstruction From Spatially Correlated PET Data

MAP Reconstruction From Spatially Correlated PET Data IEEE TRANSACTIONS ON NUCLEAR SCIENCE, VOL 50, NO 5, OCTOBER 2003 1445 MAP Reconstruction From Spatially Correlated PET Data Adam Alessio, Student Member, IEEE, Ken Sauer, Member, IEEE, and Charles A Bouman,

More information

Relative Irradiance. Wavelength (nm)

Relative Irradiance. Wavelength (nm) Characterization of Scanner Sensitivity Gaurav Sharma H. J. Trussell Electrical & Computer Engineering Dept. North Carolina State University, Raleigh, NC 7695-79 Abstract Color scanners are becoming quite

More information

Adaptive Filter Theory

Adaptive Filter Theory 0 Adaptive Filter heory Sung Ho Cho Hanyang University Seoul, Korea (Office) +8--0-0390 (Mobile) +8-10-541-5178 dragon@hanyang.ac.kr able of Contents 1 Wiener Filters Gradient Search by Steepest Descent

More information

Blind image restoration as a convex optimization problem

Blind image restoration as a convex optimization problem Int. J. Simul. Multidisci.Des. Optim. 4, 33-38 (2010) c ASMDO 2010 DOI: 10.1051/ijsmdo/ 2010005 Available online at: http://www.ijsmdo.org Blind image restoration as a convex optimization problem A. Bouhamidi

More information

Performance Comparison of Two Implementations of the Leaky. LMS Adaptive Filter. Scott C. Douglas. University of Utah. Salt Lake City, Utah 84112

Performance Comparison of Two Implementations of the Leaky. LMS Adaptive Filter. Scott C. Douglas. University of Utah. Salt Lake City, Utah 84112 Performance Comparison of Two Implementations of the Leaky LMS Adaptive Filter Scott C. Douglas Department of Electrical Engineering University of Utah Salt Lake City, Utah 8411 Abstract{ The leaky LMS

More information

Bobby Hunt, Mariappan S. Nadar, Paul Keller, Eric VonColln, and Anupam Goyal III. ASSOCIATIVE RECALL BY A POLYNOMIAL MAPPING

Bobby Hunt, Mariappan S. Nadar, Paul Keller, Eric VonColln, and Anupam Goyal III. ASSOCIATIVE RECALL BY A POLYNOMIAL MAPPING Synthesis of a Nonrecurrent Associative Memory Model Based on a Nonlinear Transformation in the Spectral Domain p. 1 Bobby Hunt, Mariappan S. Nadar, Paul Keller, Eric VonColln, Anupam Goyal Abstract -

More information

Inverse problem and optimization

Inverse problem and optimization Inverse problem and optimization Laurent Condat, Nelly Pustelnik CNRS, Gipsa-lab CNRS, Laboratoire de Physique de l ENS de Lyon Decembre, 15th 2016 Inverse problem and optimization 2/36 Plan 1. Examples

More information

A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION

A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION Jordan Cheer and Stephen Daley Institute of Sound and Vibration Research,

More information

EDGES AND CONTOURS(1)

EDGES AND CONTOURS(1) KOM31 Image Processing in Industrial Sstems Dr Muharrem Mercimek 1 EDGES AND CONTOURS1) KOM31 Image Processing in Industrial Sstems Some o the contents are adopted rom R. C. Gonzalez, R. E. Woods, Digital

More information

Magnitude F y. F x. Magnitude

Magnitude F y. F x. Magnitude Design of Optimum Multi-Dimensional Energy Compaction Filters N. Damera-Venkata J. Tuqan B. L. Evans Imaging Technology Dept. Dept. of ECE Dept. of ECE Hewlett-Packard Labs Univ. of California Univ. of

More information

Saturation Rates for Filtered Back Projection

Saturation Rates for Filtered Back Projection Saturation Rates for Filtered Back Projection Matthias Beckmann, Armin Iske Fachbereich Mathematik, Universität Hamburg 3rd IM-Workshop on Applied Approximation, Signals and Images Bernried, 21st February

More information

Superiorized Inversion of the Radon Transform

Superiorized Inversion of the Radon Transform Superiorized Inversion of the Radon Transform Gabor T. Herman Graduate Center, City University of New York March 28, 2017 The Radon Transform in 2D For a function f of two real variables, a real number

More information

Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors

Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors Simultaneous Multi-frame MAP Super-Resolution Video Enhancement using Spatio-temporal Priors Sean Borman and Robert L. Stevenson Department of Electrical Engineering, University of Notre Dame Notre Dame,

More information

Structural Damage Detection Using Time Windowing Technique from Measured Acceleration during Earthquake

Structural Damage Detection Using Time Windowing Technique from Measured Acceleration during Earthquake Structural Damage Detection Using Time Windowing Technique from Measured Acceleration during Earthquake Seung Keun Park and Hae Sung Lee ABSTRACT This paper presents a system identification (SI) scheme

More information

Logarithmic quantisation of wavelet coefficients for improved texture classification performance

Logarithmic quantisation of wavelet coefficients for improved texture classification performance Logarithmic quantisation of wavelet coefficients for improved texture classification performance Author Busch, Andrew, W. Boles, Wageeh, Sridharan, Sridha Published 2004 Conference Title 2004 IEEE International

More information

LECTURES ON MICROLOCAL CHARACTERIZATIONS IN LIMITED-ANGLE

LECTURES ON MICROLOCAL CHARACTERIZATIONS IN LIMITED-ANGLE LECTURES ON MICROLOCAL CHARACTERIZATIONS IN LIMITED-ANGLE TOMOGRAPHY Jürgen Frikel 4 LECTURES 1 Today: Introduction to the mathematics of computerized tomography 2 Mathematics of computerized tomography

More information

COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS

COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS COMPLEX WAVELET TRANSFORM IN SIGNAL AND IMAGE ANALYSIS MUSOKO VICTOR, PROCHÁZKA ALEŠ Institute of Chemical Technology, Department of Computing and Control Engineering Technická 905, 66 8 Prague 6, Cech

More information

CHAPTER 3 Applications of Differentiation

CHAPTER 3 Applications of Differentiation CHAPTER Applications of Differentiation Section. Etrema on an Interval.............. 0 Section. Rolle s Theorem and the Mean Value Theorem. 07 Section. Increasing and Decreasing Functions and the First

More information

Mathematics 309 Conic sections and their applicationsn. Chapter 2. Quadric figures. ai,j x i x j + b i x i + c =0. 1. Coordinate changes

Mathematics 309 Conic sections and their applicationsn. Chapter 2. Quadric figures. ai,j x i x j + b i x i + c =0. 1. Coordinate changes Mathematics 309 Conic sections and their applicationsn Chapter 2. Quadric figures In this chapter want to outline quickl how to decide what figure associated in 2D and 3D to quadratic equations look like.

More information

FAST AND ACCURATE DIRECTION-OF-ARRIVAL ESTIMATION FOR A SINGLE SOURCE

FAST AND ACCURATE DIRECTION-OF-ARRIVAL ESTIMATION FOR A SINGLE SOURCE Progress In Electromagnetics Research C, Vol. 6, 13 20, 2009 FAST AND ACCURATE DIRECTION-OF-ARRIVAL ESTIMATION FOR A SINGLE SOURCE Y. Wu School of Computer Science and Engineering Wuhan Institute of Technology

More information

Adaptive linear prediction filtering for random noise attenuation Mauricio D. Sacchi* and Mostafa Naghizadeh, University of Alberta

Adaptive linear prediction filtering for random noise attenuation Mauricio D. Sacchi* and Mostafa Naghizadeh, University of Alberta Adaptive linear prediction filtering for random noise attenuation Mauricio D. Sacchi* and Mostafa Naghizadeh, University of Alberta SUMMARY We propose an algorithm to compute time and space variant prediction

More information

Efficient Solution Methods for Inverse Problems with Application to Tomography Radon Transform and Friends

Efficient Solution Methods for Inverse Problems with Application to Tomography Radon Transform and Friends Efficient Solution Methods for Inverse Problems with Application to Tomography Radon Transform and Friends Alfred K. Louis Institut für Angewandte Mathematik Universität des Saarlandes 66041 Saarbrücken

More information

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as

EEL 5544 Noise in Linear Systems Lecture 30. X (s) = E [ e sx] f X (x)e sx dx. Moments can be found from the Laplace transform as L30-1 EEL 5544 Noise in Linear Systems Lecture 30 OTHER TRANSFORMS For a continuous, nonnegative RV X, the Laplace transform of X is X (s) = E [ e sx] = 0 f X (x)e sx dx. For a nonnegative RV, the Laplace

More information

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1

A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 A NOVEL OPTIMAL PROBABILITY DENSITY FUNCTION TRACKING FILTER DESIGN 1 Jinglin Zhou Hong Wang, Donghua Zhou Department of Automation, Tsinghua University, Beijing 100084, P. R. China Control Systems Centre,

More information

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE

3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3. ESTIMATION OF SIGNALS USING A LEAST SQUARES TECHNIQUE 3.0 INTRODUCTION The purpose of this chapter is to introduce estimators shortly. More elaborated courses on System Identification, which are given

More information

General Properties for Determining Power Loss and Efficiency of Passive Multi-Port Microwave Networks

General Properties for Determining Power Loss and Efficiency of Passive Multi-Port Microwave Networks University of Massachusetts Amherst From the SelectedWorks of Ramakrishna Janaswamy 015 General Properties for Determining Power Loss and Efficiency of Passive Multi-Port Microwave Networks Ramakrishna

More information

The Kalman filter is arguably one of the most notable algorithms

The Kalman filter is arguably one of the most notable algorithms LECTURE E NOTES «Kalman Filtering with Newton s Method JEFFREY HUMPHERYS and JEREMY WEST The Kalman filter is arguably one of the most notable algorithms of the 0th century [1]. In this article, we derive

More information

, b = 0. (2) 1 2 The eigenvectors of A corresponding to the eigenvalues λ 1 = 1, λ 2 = 3 are

, b = 0. (2) 1 2 The eigenvectors of A corresponding to the eigenvalues λ 1 = 1, λ 2 = 3 are Quadratic forms We consider the quadratic function f : R 2 R defined by f(x) = 2 xt Ax b T x with x = (x, x 2 ) T, () where A R 2 2 is symmetric and b R 2. We will see that, depending on the eigenvalues

More information

EXERCISES ON DETERMINANTS, EIGENVALUES AND EIGENVECTORS. 1. Determinants

EXERCISES ON DETERMINANTS, EIGENVALUES AND EIGENVECTORS. 1. Determinants EXERCISES ON DETERMINANTS, EIGENVALUES AND EIGENVECTORS. Determinants Ex... Let A = 0 4 4 2 0 and B = 0 3 0. (a) Compute 0 0 0 0 A. (b) Compute det(2a 2 B), det(4a + B), det(2(a 3 B 2 )). 0 t Ex..2. For

More information

Adaptive Filtering. Squares. Alexander D. Poularikas. Fundamentals of. Least Mean. with MATLABR. University of Alabama, Huntsville, AL.

Adaptive Filtering. Squares. Alexander D. Poularikas. Fundamentals of. Least Mean. with MATLABR. University of Alabama, Huntsville, AL. Adaptive Filtering Fundamentals of Least Mean Squares with MATLABR Alexander D. Poularikas University of Alabama, Huntsville, AL CRC Press Taylor & Francis Croup Boca Raton London New York CRC Press is

More information

5.5 Recurrence Relations and Clenshaw s Recurrence Formula

5.5 Recurrence Relations and Clenshaw s Recurrence Formula 178 Chapter 5. Evaluation of Functions Then the answer is 0 ( ) w =0 d w + i w 0, c 0 2w c + id = d + iw w 0, c

More information

Math 108b: Notes on the Spectral Theorem

Math 108b: Notes on the Spectral Theorem Math 108b: Notes on the Spectral Theorem From section 6.3, we know that every linear operator T on a finite dimensional inner product space V has an adjoint. (T is defined as the unique linear operator

More information

A Direct Method for reconstructing inclusions from Electrostatic Data

A Direct Method for reconstructing inclusions from Electrostatic Data A Direct Method for reconstructing inclusions from Electrostatic Data Isaac Harris Texas A&M University, Department of Mathematics College Station, Texas 77843-3368 iharris@math.tamu.edu Joint work with:

More information

Appendix A Wirtinger Calculus

Appendix A Wirtinger Calculus Precoding and Signal Shaping for Digital Transmission. Robert F. H. Fischer Copyright 0 2002 John Wiley & Sons, Inc. ISBN: 0-471-22410-3 Appendix A Wirtinger Calculus T he optimization of system parameters

More information

Optimized analytic reconstruction for SPECT

Optimized analytic reconstruction for SPECT Jean-Pol Guillement, Roman Novikov To cite this version: Jean-Pol Guillement, Roman Novikov. Optimized analytic reconstruction for SPECT. Journal of Inverse ill-posed Problems, De Gruter, 2012, 20 (4),

More information

Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model

Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model BULGARIAN ACADEMY OF SCIENCES CYBERNEICS AND INFORMAION ECHNOLOGIES Volume No Sofia Algorithm for Multiple Model Adaptive Control Based on Input-Output Plant Model sonyo Slavov Department of Automatics

More information

Assignment for next week

Assignment for next week Assignment for next week Due: 6:30 PM Monday April 11 th (2016) -> PDF by email only 5 points: Pose two questions based on this lecture 5 points: what (and why) is sinc(0)? 5 points: ketch (by hand okay)

More information

An IDL Based Image Deconvolution Software Package

An IDL Based Image Deconvolution Software Package An IDL Based Image Deconvolution Software Package F. Városi and W. B. Landsman Hughes STX Co., Code 685, NASA/GSFC, Greenbelt, MD 20771 Abstract. Using the Interactive Data Language (IDL), we have implemented

More information

CLASSICAL ITERATIVE METHODS

CLASSICAL ITERATIVE METHODS CLASSICAL ITERATIVE METHODS LONG CHEN In this notes we discuss classic iterative methods on solving the linear operator equation (1) Au = f, posed on a finite dimensional Hilbert space V = R N equipped

More information

Error Reporting Recommendations: A Report of the Standards and Criteria Committee

Error Reporting Recommendations: A Report of the Standards and Criteria Committee Error Reporting Recommendations: A Report of the Standards and Criteria Committee Adopted by the IXS Standards and Criteria Committee July 26, 2000 1. Introduction The development of the field of x-ray

More information

Image Analysis. Feature extraction: corners and blobs

Image Analysis. Feature extraction: corners and blobs Image Analysis Feature extraction: corners and blobs Christophoros Nikou cnikou@cs.uoi.gr Images taken from: Computer Vision course by Svetlana Lazebnik, University of North Carolina at Chapel Hill (http://www.cs.unc.edu/~lazebnik/spring10/).

More information

Optimal Polynomial Control for Discrete-Time Systems

Optimal Polynomial Control for Discrete-Time Systems 1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should

More information

And similarly in the other directions, so the overall result is expressed compactly as,

And similarly in the other directions, so the overall result is expressed compactly as, SQEP Tutorial Session 5: T7S0 Relates to Knowledge & Skills.5,.8 Last Update: //3 Force on an element of area; Definition of principal stresses and strains; Definition of Tresca and Mises equivalent stresses;

More information

Riccati difference equations to non linear extended Kalman filter constraints

Riccati difference equations to non linear extended Kalman filter constraints International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R

More information

4. DATA ASSIMILATION FUNDAMENTALS

4. DATA ASSIMILATION FUNDAMENTALS 4. DATA ASSIMILATION FUNDAMENTALS... [the atmosphere] "is a chaotic system in which errors introduced into the system can grow with time... As a consequence, data assimilation is a struggle between chaotic

More information

Compressive Imaging by Generalized Total Variation Minimization

Compressive Imaging by Generalized Total Variation Minimization 1 / 23 Compressive Imaging by Generalized Total Variation Minimization Jie Yan and Wu-Sheng Lu Department of Electrical and Computer Engineering University of Victoria, Victoria, BC, Canada APCCAS 2014,

More information

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu

ESTIMATOR STABILITY ANALYSIS IN SLAM. Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu ESTIMATOR STABILITY ANALYSIS IN SLAM Teresa Vidal-Calleja, Juan Andrade-Cetto, Alberto Sanfeliu Institut de Robtica i Informtica Industrial, UPC-CSIC Llorens Artigas 4-6, Barcelona, 88 Spain {tvidal, cetto,

More information

2-D SENSOR POSITION PERTURBATION ANALYSIS: EQUIVALENCE TO AWGN ON ARRAY OUTPUTS. Volkan Cevher, James H. McClellan

2-D SENSOR POSITION PERTURBATION ANALYSIS: EQUIVALENCE TO AWGN ON ARRAY OUTPUTS. Volkan Cevher, James H. McClellan 2-D SENSOR POSITION PERTURBATION ANALYSIS: EQUIVALENCE TO AWGN ON ARRAY OUTPUTS Volkan Cevher, James H McClellan Georgia Institute of Technology Atlanta, GA 30332-0250 cevher@ieeeorg, jimmcclellan@ecegatechedu

More information

Discrete Simulation of Power Law Noise

Discrete Simulation of Power Law Noise Discrete Simulation of Power Law Noise Neil Ashby 1,2 1 University of Colorado, Boulder, CO 80309-0390 USA 2 National Institute of Standards and Technology, Boulder, CO 80305 USA ashby@boulder.nist.gov

More information

Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems

Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems 1 Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems V. Estivill-Castro 2 Perception Concepts Vision Chapter 4 (textbook) Sections 4.3 to 4.5 What is the course

More information

Optimum Notch Filtering - I

Optimum Notch Filtering - I Notch Filtering 1 Optimum Notch Filtering - I Methods discussed before: filter too much image information. Optimum: minimizes local variances of the restored image fˆ x First Step: Extract principal freq.

More information

On the steady-state mean squared error of the fixed-point LMS algorithm

On the steady-state mean squared error of the fixed-point LMS algorithm Signal Processing 87 (2007) 3226 3233 Fast communication On the steady-state mean squared error of the fixed-point LMS algorithm Mohamed Ghanassi, Benoıˆt Champagne, Peter Kabal Department of Electrical

More information

Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005

Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005 Edge Detection PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005 Gradients and edges Points of sharp change in an image are interesting: change in reflectance change in object change

More information

KNOWN approaches for improving the performance of

KNOWN approaches for improving the performance of IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II: EXPRESS BRIEFS, VOL. 58, NO. 8, AUGUST 2011 537 Robust Quasi-Newton Adaptive Filtering Algorithms Md. Zulfiquar Ali Bhotto, Student Member, IEEE, and Andreas

More information

Feature Reconstruction in Tomography

Feature Reconstruction in Tomography Feature Reconstruction in Tomography Alfred K. Louis Institut für Angewandte Mathematik Universität des Saarlandes 66041 Saarbrücken http://www.num.uni-sb.de louis@num.uni-sb.de Wien, July 20, 2009 Images

More information

Shape of Gaussians as Feature Descriptors

Shape of Gaussians as Feature Descriptors Shape of Gaussians as Feature Descriptors Liyu Gong, Tianjiang Wang and Fang Liu Intelligent and Distributed Computing Lab, School of Computer Science and Technology Huazhong University of Science and

More information

Optimal control and estimation

Optimal control and estimation Automatic Control 2 Optimal control and estimation Prof. Alberto Bemporad University of Trento Academic year 2010-2011 Prof. Alberto Bemporad (University of Trento) Automatic Control 2 Academic year 2010-2011

More information

Numerical Methods in TEM Convolution and Deconvolution

Numerical Methods in TEM Convolution and Deconvolution Numerical Methods in TEM Convolution and Deconvolution Christoph T. Koch Max Planck Institut für Metallforschung http://hrem.mpi-stuttgart.mpg.de/koch/vorlesung Applications of Convolution in TEM Smoothing

More information

TIME-FREQUENCY ANALYSIS: TUTORIAL. Werner Kozek & Götz Pfander

TIME-FREQUENCY ANALYSIS: TUTORIAL. Werner Kozek & Götz Pfander TIME-FREQUENCY ANALYSIS: TUTORIAL Werner Kozek & Götz Pfander Overview TF-Analysis: Spectral Visualization of nonstationary signals (speech, audio,...) Spectrogram (time-varying spectrum estimation) TF-methods

More information

Effects of birefringence on Fizeau interferometry that uses polarization phase shifting technique

Effects of birefringence on Fizeau interferometry that uses polarization phase shifting technique Effects of birefringence on Fizeau interferometr that uses polarization phase shifting technique Chunu Zhao, Dongel Kang and James H. Burge College of Optical Sciences, the Universit of Arizona 1630 E.

More information

An example of Bayesian reasoning Consider the one-dimensional deconvolution problem with various degrees of prior information.

An example of Bayesian reasoning Consider the one-dimensional deconvolution problem with various degrees of prior information. An example of Bayesian reasoning Consider the one-dimensional deconvolution problem with various degrees of prior information. Model: where g(t) = a(t s)f(s)ds + e(t), a(t) t = (rapidly). The problem,

More information

Noise, Image Reconstruction with Noise!

Noise, Image Reconstruction with Noise! Noise, Image Reconstruction with Noise! EE367/CS448I: Computational Imaging and Display! stanford.edu/class/ee367! Lecture 10! Gordon Wetzstein! Stanford University! What s a Pixel?! photon to electron

More information

Multiscale Principal Components Analysis for Image Local Orientation Estimation

Multiscale Principal Components Analysis for Image Local Orientation Estimation Multiscale Principal Components Analsis for Image Local Orientation Estimation XiaoGuang Feng Peman Milanfar Computer Engineering Electrical Engineering Universit of California, Santa Cruz Universit of

More information

A Study of Covariances within Basic and Extended Kalman Filters

A Study of Covariances within Basic and Extended Kalman Filters A Study of Covariances within Basic and Extended Kalman Filters David Wheeler Kyle Ingersoll December 2, 2013 Abstract This paper explores the role of covariance in the context of Kalman filters. The underlying

More information

Analytical Approach to Regularization Design for Isotropic Spatial Resolution

Analytical Approach to Regularization Design for Isotropic Spatial Resolution Analytical Approach to Regularization Design for Isotropic Spatial Resolution Jeffrey A Fessler, Senior Member, IEEE Abstract In emission tomography, conventional quadratic regularization methods lead

More information

Geophysical Data Analysis: Discrete Inverse Theory

Geophysical Data Analysis: Discrete Inverse Theory Geophysical Data Analysis: Discrete Inverse Theory MATLAB Edition William Menke Lamont-Doherty Earth Observatory and Department of Earth and Environmental Sciences Columbia University. ' - Palisades, New

More information

Optimal mass transport as a distance measure between images

Optimal mass transport as a distance measure between images Optimal mass transport as a distance measure between images Axel Ringh 1 1 Department of Mathematics, KTH Royal Institute of Technology, Stockholm, Sweden. 21 st of June 2018 INRIA, Sophia-Antipolis, France

More information

Chapter #6 EEE State Space Analysis and Controller Design

Chapter #6 EEE State Space Analysis and Controller Design hapter #6 EEE3-83 State Space nalsis and ontroller Design State feedack Linear Quadratic Regulator (LQR) Open and closed loop estimators Reduced Order Estimators (not assessed) racking Module Leader: Dr

More information

VISION TRACKING PREDICTION

VISION TRACKING PREDICTION VISION RACKING PREDICION Eri Cuevas,2, Daniel Zaldivar,2, and Raul Rojas Institut für Informati, Freie Universität Berlin, ausstr 9, D-495 Berlin, German el 0049-30-83852485 2 División de Electrónica Computación,

More information

Edges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise

Edges and Scale. Image Features. Detecting edges. Origin of Edges. Solution: smooth first. Effects of noise Edges and Scale Image Features From Sandlot Science Slides revised from S. Seitz, R. Szeliski, S. Lazebnik, etc. Origin of Edges surface normal discontinuity depth discontinuity surface color discontinuity

More information

A Family of Methods for Solving Nonlinear Equations Using Quadratic Interpolation

A Family of Methods for Solving Nonlinear Equations Using Quadratic Interpolation ELSEVIER An International Journal Available online at www.sciencedirect.com computers &.,=. = C o,..ct. mathematics with applications Computers and Mathematics with Applications 48 (2004) 709-714 www.elsevier.com/locate/camwa

More information

Image Segmentation: Definition Importance. Digital Image Processing, 2nd ed. Chapter 10 Image Segmentation.

Image Segmentation: Definition Importance. Digital Image Processing, 2nd ed. Chapter 10 Image Segmentation. : Definition Importance Detection of Discontinuities: 9 R = wi z i= 1 i Point Detection: 1. A Mask 2. Thresholding R T Line Detection: A Suitable Mask in desired direction Thresholding Line i : R R, j

More information

Nonlinear Flows for Displacement Correction and Applications in Tomography

Nonlinear Flows for Displacement Correction and Applications in Tomography Nonlinear Flows for Displacement Correction and Applications in Tomography Guozhi Dong 1 and Otmar Scherzer 1,2 1 Computational Science Center, University of Vienna, Oskar-Morgenstern-Platz 1, 1090 Wien,

More information

Image Reconstruction from Projection

Image Reconstruction from Projection Image Reconstruction from Projection Reconstruct an image from a series of projections X-ray computed tomography (CT) Computed tomography is a medical imaging method employing tomography where digital

More information

COMPUTATIONAL METHODS AND ALGORITHMS Vol. II - Numerical Algorithms for Inverse and Ill-Posed Problems - A.М. Denisov

COMPUTATIONAL METHODS AND ALGORITHMS Vol. II - Numerical Algorithms for Inverse and Ill-Posed Problems - A.М. Denisov NUMERICAL ALGORITHMS FOR INVERSE AND ILL-POSED PROBLEMS Faculty of Computational Mathematics and Cybernetics, Moscow State University, Moscow, Russia Keywords: Direct problem, Inverse problem, Well-posed

More information

A Generative Perspective on MRFs in Low-Level Vision Supplemental Material

A Generative Perspective on MRFs in Low-Level Vision Supplemental Material A Generative Perspective on MRFs in Low-Level Vision Supplemental Material Uwe Schmidt Qi Gao Stefan Roth Department of Computer Science, TU Darmstadt 1. Derivations 1.1. Sampling the Prior We first rewrite

More information

A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition

A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition F Bozzoli 1,2, L Cattani 1,2, A Mocerino 1, S Rainieri 1,2, F S V Bazán 3

More information

Fast and Robust Phase Retrieval

Fast and Robust Phase Retrieval Fast and Robust Phase Retrieval Aditya Viswanathan aditya@math.msu.edu CCAM Lunch Seminar Purdue University April 18 2014 0 / 27 Joint work with Yang Wang Mark Iwen Research supported in part by National

More information

DETECTION theory deals primarily with techniques for

DETECTION theory deals primarily with techniques for ADVANCED SIGNAL PROCESSING SE Optimum Detection of Deterministic and Random Signals Stefan Tertinek Graz University of Technology turtle@sbox.tugraz.at Abstract This paper introduces various methods for

More information

Evolutionary ARMA Model Identification With Unknown Process Order *

Evolutionary ARMA Model Identification With Unknown Process Order * Evolutionary ARMA Model Identification With Unknown Process Order * G N BELIGIANNIS 1,2, E N DEMIRIS 1 and S D LIKOTHANASSIS 1,2,3 1 Department of Computer Engineering and Informatics University of Patras

More information

H Optimal Nonparametric Density Estimation from Quantized Samples

H Optimal Nonparametric Density Estimation from Quantized Samples H Optimal Nonparametric Density Estimation from Quantized Samples M. Nagahara 1, K. I. Sato 2, and Y. Yamamoto 1 1 Graduate School of Informatics, Kyoto University, 2 Graduate School of Economics, Kyoto

More information

A ROBUST BEAMFORMER BASED ON WEIGHTED SPARSE CONSTRAINT

A ROBUST BEAMFORMER BASED ON WEIGHTED SPARSE CONSTRAINT Progress In Electromagnetics Research Letters, Vol. 16, 53 60, 2010 A ROBUST BEAMFORMER BASED ON WEIGHTED SPARSE CONSTRAINT Y. P. Liu and Q. Wan School of Electronic Engineering University of Electronic

More information

Chapter 3 Salient Feature Inference

Chapter 3 Salient Feature Inference Chapter 3 Salient Feature Inference he building block of our computational framework for inferring salient structure is the procedure that simultaneously interpolates smooth curves, or surfaces, or region

More information

Conjugate Gradient (CG) Method

Conjugate Gradient (CG) Method Conjugate Gradient (CG) Method by K. Ozawa 1 Introduction In the series of this lecture, I will introduce the conjugate gradient method, which solves efficiently large scale sparse linear simultaneous

More information

Literal Equations Manipulating Variables and Constants

Literal Equations Manipulating Variables and Constants Literal Equations Manipulating Variables and Constants A literal equation is one which is expressed in terms of variable symbols (such as d, v, and a) and constants (such as R, g, and π). Often in science

More information

Generalized eigenspaces

Generalized eigenspaces Generalized eigenspaces November 30, 2012 Contents 1 Introduction 1 2 Polynomials 2 3 Calculating the characteristic polynomial 5 4 Projections 7 5 Generalized eigenvalues 10 6 Eigenpolynomials 15 1 Introduction

More information

Edge Detection. Computer Vision P. Schrater Spring 2003

Edge Detection. Computer Vision P. Schrater Spring 2003 Edge Detection Computer Vision P. Schrater Spring 2003 Simplest Model: (Canny) Edge(x) = a U(x) + n(x) U(x)? x=0 Convolve image with U and find points with high magnitude. Choose value by comparing with

More information

Fourier transforms and convolution

Fourier transforms and convolution Fourier transforms and convolution (without the agonizing pain) CS/CME/BioE/Biophys/BMI 279 Oct. 26, 2017 Ron Dror 1 Outline Why do we care? Fourier transforms Writing functions as sums of sinusoids The

More information