Matrix Formulation of Image Restoration Problem

Size: px
Start display at page:

Download "Matrix Formulation of Image Restoration Problem"

Transcription

1 atri Formlatio o Imae estoratio Problem -D Case: We will cosider te -D ersio irst or simplicity: m m* m + m We will assme tat te arrays ad ae bee zero-padded to be o size were let + let. eceort we will ot eplicitly metio te zero-paddi. e deradatio eqatio: m k k m k + m ca be writte i matri-ector orm as ollows: + were

2 oweer sice te arrays ad are zero-padded we ca eqialetly set: 3 3 otice tat te secod matri is circlat; i.e. eac row o is a circlar sit o te preios row. ample: A let o array 3 B let o array A + B 4 say 4.

3 otice tat. Ideed

4 eceort we will se so tat we ca apply properties o circlat matrices to. -D Case: Sppose are arrays ater zero-paddi. e deradatio eqatio ca be writte i matri-ector ormat as ollows: + were

5 3 ote tat is a block-circlat matri wit blocks. ac block is itsel a circlat matri. Ideed te matri is a circlat matri ormed rom te -t row o array m: 3 Gie te deradatio eqatio: +

6 or obectie is to recoer rom obseratio. We will assme tat te array m sally reerred to as te blrri ctio ad statistics o te oise m are kow. e problem becomes ery complicated i array m is kow ad tis case is sally reerred to as blid restoratio or blid decooltio. otice tat ee we tere is o oise; i.e. m or te ales o m were eactly kow ad matri is iertible compti directly wold ot be practical. ˆ ample: Sppose 56. ereore ad wold be a by matri to be ierted! atrally direct iersio o wold ot be easible. Bt as seeral sel properties; i particlar: is block circlat. is sally sparse as ery ew o-zero etries. We will eploit tese properties to obtai ˆ more eicietly. I particlar we will derie te teoretical soltios to te restoratio problem si matri alebra. oweer we it comes to implemeti te soltio we ca resort to te Forier domai taks to te properties o circlat matrices.

7 Costraied least sqares ilteri restoratio ecall tat te kowlede o blr ctio m is essetial to obtai a meail soltio to te restoratio problem. Ote kowlede o m is ot perect ad sbect to errors. Oe way to alleiate sesitiity o te reslt to errors i m is to base optimality o restoratio o a measre o smootess sc as te secod deriatie o te imae. We will approimate te secod deriatie Laplacia by a matri Q. Ideed we will irst ormlate te costraied restoratio problem ad obtai its soltio i terms o a eeral matri Q. Later dieret coices o matri Q will be cosidered eac ii rise to a dieret restoratio ilter. Sppose Q is ay matri o appropriate dimesio. I costraied imae restoratio we coose ˆ to miimize Q ˆ sbect to te costrait ˆ + ˆ. ˆ. ecall te deradatio eqatio Itrodctio o matri Q allows cosiderable leibility i te desi o appropriate restoratio ilters we will discss speciic coices o Q later. So or problem is ormlated as ollows: mi Qˆ sbect to ˆ or ˆ

8 A brie reiew o matri dieretiatio Sppose ad is a ctio o two ariables. e I or some matri A ad some ector b te were sperscript deotes matri traspose. b A b A b A b A A

9 ecall rom calcls tat sc a costraied miimizatio problem ca be soled by meas o Larae mltipliers. We eed to miimize te ameted obectie ctio J ˆ : J ˆ Qˆ + α ˆ were α is a Larae mltiplier. We set te deriatie o J ˆ wit respect to ˆ to zero. J ereore ˆ ˆ Q Qˆ α ˆ Q Q + α ˆ α Q Q + α α α Q Q + γq Q + were γ is cose to satisy te costrait α ˆ. We will ow se te aboe ormlatio to derie a mber o restoratio ilters.

10 Psedo-ierse Filteri e psedo-ierse ilter tries to aoid te pitalls o applyi a ierse ilter i te presece o oise. Cosider te costraied restoratio soltio wit Q ˆ I. is ies Q γ Q + ˆ γi +. It ca be implemeted i te Forier domai by te ollowi eqatio: F ˆ G were *. + γ + γ e parameter γ is a costat to be cose. ote tat γ ies s back te ierse ilter. For γ > te deomiator o is strictly positie ad te psedo-ierse ilter is well deied.

11 Psedo-Ierse Filteri eample Zero-mea Gassia oise wit ariace σ. 3 m m S. ˆ m γ.75 S.76 γ. S. 338 γ.5 S.447 γ I. Filter S. 7

12 iimm ea Sqare rror Wieer Filter is is a restoratio teciqe based o te statistics mea ad correlatio o te imae ad oise. We cosider eac elemet o ad as radom ariables. Deie te correlatio matrices e matrices ad are real ad symmetric wit all eieales bei o-eatie. e D-DF o te correlatios ad are called te power spectra ad are deoted by S ad S respectiely. ecall te costraied restoratio soltio ie by Coose matri Q sc tat { } { } ad Q Q + γ ˆ Q Q

13 I a sese we are tryi to miimize te oise-to-sial ratio. e costraied restoratio is te ie by is ca be implemeted si DF as ere [ ] F S is te power spectral desity o te imae m ad [ ] S is te power spectral desity o te oise m. e restoratio ilter is called te parametric Wieer ilter wit parameter γ Special cases: γ : Wieer Filter γ : Ierse Filter γ : Parametric Wieer Filter + γ ˆ [ ] [ ] [ ] were ˆ * * S S S S G G S S F + γ + γ + γ

14 Accordi to te costraied restoratio ilter deried earlier parameter γ sold be cose to satisy ˆ. oweer coice o γ yields a optimal ilter i te sese o miimizi te error ctio e { [ m ˆ m ] }. I oter words setti γ yields a statistically optimal restoratio. Implemetatio o te parametric Wieer ilter reqires kowlede o te imae ad oise power spectra S ad. I particlar we eed te so called sial-to-oise ratio S ρ S S. is is ot always aailable ad a simple approimatio is to replace ρ by a costat ρ. I tis case te Wieer ilter is ie by * + γ ρ S ote tat as ilter. ρ o oise te Wieer ilter teds to te ierse

15 Wieer ilter eample + + r σ σ ρ or lo σ σ m db ρ 5.9dB ρ 5.9dB ρ 5.9dB m ˆ m γ ˆ m γ.

16 Parametric Wieer Filter eample eect o parameter γ m ˆ m γ. ˆ m γ. ˆ m γ ˆ m γ 5 ˆ m γ 5 Small ales o γ reslt i better blr remoal ad poor oise ilteri. Lare ales o γ reslt i poor blr remoal ad better oise ilteri.

Deconvolution, Deblurring and Restoration

Deconvolution, Deblurring and Restoration T-61.5090 - Image Aalysis i Neroiormatics Decooltio Deblrrig ad Restoratio Igor Lissadro 18.04.07 1 Ageda Itrodctio to image restoratio Liear Space-Iariat restoratio ilters Deblrrig Ierse ilterig Power

More information

Partial Differential Equations

Partial Differential Equations EE 84 Matematical Metods i Egieerig Partial Differetial Eqatios Followig are some classical partial differetial eqatios were is assmed to be a fctio of two or more variables t (time) ad y (spatial coordiates).

More information

Diagonalization of Quadratic Forms. Recall in days past when you were given an equation which looked like

Diagonalization of Quadratic Forms. Recall in days past when you were given an equation which looked like Diagoalizatio of Qadratic Forms Recall i das past whe o were gie a eqatio which looked like ad o were asked to sketch the set of poits which satisf this eqatio. It was ecessar to complete the sqare so

More information

LINEARIZATION OF NONLINEAR EQUATIONS By Dominick Andrisani. dg x. ( ) ( ) dx

LINEARIZATION OF NONLINEAR EQUATIONS By Dominick Andrisani. dg x. ( ) ( ) dx LINEAIZATION OF NONLINEA EQUATIONS By Domiick Adrisai A. Liearizatio of Noliear Fctios A. Scalar fctios of oe variable. We are ive the oliear fctio (). We assme that () ca be represeted si a Taylor series

More information

Coordinate Systems. Things to think about:

Coordinate Systems. Things to think about: Coordiate Sstems There are 3 coordiate sstems that a compter graphics programmer is most cocered with: the Object Coordiate Sstem (OCS), the World Coordiate Sstem (WCS), ad the Camera Coordiate Sstem (CCS).

More information

Three-Step Iterative Methods with Sixth-Order Convergence for Solving Nonlinear Equations

Three-Step Iterative Methods with Sixth-Order Convergence for Solving Nonlinear Equations Article Three-Step Iteratie Methods with Sith-Order Coergece or Solig Noliear Eqatios Departmet o Mathematics, Kermashah Uiersity o Techology, Kermashah, Ira (Correspodig athor; e-mail: bghabary@yahoocom

More information

MAT2400 Assignment 2 - Solutions

MAT2400 Assignment 2 - Solutions MAT24 Assigmet 2 - Soltios Notatio: For ay fctio f of oe real variable, f(a + ) deotes the limit of f() whe teds to a from above (if it eists); i.e., f(a + ) = lim t a + f(t). Similarly, f(a ) deotes the

More information

too many conditions to check!!

too many conditions to check!! Vector Spaces Aioms of a Vector Space closre Defiitio : Let V be a o empty set of vectors with operatios : i. Vector additio :, v є V + v є V ii. Scalar mltiplicatio: li є V k є V where k is scalar. The,

More information

5. Fast NLMS-OCF Algorithm

5. Fast NLMS-OCF Algorithm 5. Fast LMS-OCF Algorithm The LMS-OCF algorithm preseted i Chapter, which relies o Gram-Schmidt orthogoalizatio, has a compleity O ( M ). The square-law depedece o computatioal requiremets o the umber

More information

d y f f dy Numerical Solution of Ordinary Differential Equations Consider the 1 st order ordinary differential equation (ODE) . dx

d y f f dy Numerical Solution of Ordinary Differential Equations Consider the 1 st order ordinary differential equation (ODE) . dx umerical Solutio o Ordiar Dieretial Equatios Cosider te st order ordiar dieretial equatio ODE d. d Te iitial coditio ca be tae as. Te we could use a Talor series about ad obtai te complete solutio or......!!!

More information

Outline. Review Two Space Dimensions. Review Properties of Solutions. Review Algorithms. Finite-difference Grid

Outline. Review Two Space Dimensions. Review Properties of Solutions. Review Algorithms. Finite-difference Grid Nmeric soltios o elliptic PDEs March 5, 009 Nmerical Soltios o Elliptic Eqatios Larr Caretto Mechaical Egieerig 50B Semiar i Egieerig alsis March 5, 009 Otlie Review last class Nmerical soltio o elliptic

More information

g () n = g () n () f, f n = f () n () x ( n =1,2,3, ) j 1 + j 2 + +nj n = n +2j j n = r & j 1 j 1, j 2, j 3, j 4 = ( 4, 0, 0, 0) f 4 f 3 3!

g () n = g () n () f, f n = f () n () x ( n =1,2,3, ) j 1 + j 2 + +nj n = n +2j j n = r & j 1 j 1, j 2, j 3, j 4 = ( 4, 0, 0, 0) f 4 f 3 3! Higher Derivative o Compositio. Formulas o Higher Derivative o Compositio.. Faà di Bruo's Formula About the ormula o the higher derivative o compositio, the oe by a mathematicia Faà di Bruo i Italy o about

More information

Topic 9 - Taylor and MacLaurin Series

Topic 9 - Taylor and MacLaurin Series Topic 9 - Taylor ad MacLauri Series A. Taylors Theorem. The use o power series is very commo i uctioal aalysis i act may useul ad commoly used uctios ca be writte as a power series ad this remarkable result

More information

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation

Random Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio

More information

CS537. Numerical Analysis and Computing

CS537. Numerical Analysis and Computing CS57 Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 Jauary 9 9 What is the Root May physical system ca be

More information

1 The space of linear transformations from R n to R m :

1 The space of linear transformations from R n to R m : Math 540 Spring 20 Notes #4 Higher deriaties, Taylor s theorem The space of linear transformations from R n to R m We hae discssed linear transformations mapping R n to R m We can add sch linear transformations

More information

CS321. Numerical Analysis and Computing

CS321. Numerical Analysis and Computing CS Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 September 8 5 What is the Root May physical system ca

More information

Convergence of the FEM. by Hui Zhang Jorida Kushova Ruwen Jung

Convergence of the FEM. by Hui Zhang Jorida Kushova Ruwen Jung Covergece o te FEM by Hi Zg Jorid Ksov Rwe Jg I order to proo FEM soltios to be coverget, mesremet or teir qlity is reqired. A simple pproc i ect soltio is ccessible is to qtiy te error betwee FEMd te

More information

and the sum of its first n terms be denoted by. Convergence: An infinite series is said to be convergent if, a definite unique number., finite.

and the sum of its first n terms be denoted by. Convergence: An infinite series is said to be convergent if, a definite unique number., finite. INFINITE SERIES Seqece: If a set of real mbers a seqece deoted by * + * Or * + * occr accordig to some defiite rle, the it is called + if is fiite + if is ifiite Series: is called a series ad is deoted

More information

Synoptic Meteorology I: Kinematic Properties. 23, 28 October 2014

Synoptic Meteorology I: Kinematic Properties. 23, 28 October 2014 Soptic Meteorolo I: Kiematic Properties 3, 8 October 4 What is the Wid? Qalitatiel, we derstad the wid as bei a relectio o the air s (three-dimesioal) motio. Beore we proceed, howeer, it is worthwhile

More information

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition

6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition 6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.

More information

Blind Adaptive Filters & Equalization

Blind Adaptive Filters & Equalization Blid Adaptive Filters & Equalizatio Table of otets: Itrodutio about Adaptive Filters Itrodutio about Blid Adaptive Filters Covergee aalysis of LMS algoritm Ho trasforms improve te overgee rate of LMS Wy

More information

Linear Transformations

Linear Transformations Liear rasformatios 6. Itroductio to Liear rasformatios 6. he Kerel ad Rage of a Liear rasformatio 6. Matrices for Liear rasformatios 6.4 rasitio Matrices ad Similarity 6.5 Applicatios of Liear rasformatios

More information

Z Transforms. Lesson 20 6DT. BME 333 Biomedical Signals and Systems - J.Schesser

Z Transforms. Lesson 20 6DT. BME 333 Biomedical Signals and Systems - J.Schesser Z rasforms Lesso 6D BME 333 Biomedical Sigals ad Systems Z rasforms A Defiitio I a sese similar to the L excet it is associated with discrete time fuctios. Let s assume we hae a cotiuous time fuctio, f

More information

Approximation of the Likelihood Ratio Statistics in Competing Risks Model Under Informative Random Censorship From Both Sides

Approximation of the Likelihood Ratio Statistics in Competing Risks Model Under Informative Random Censorship From Both Sides Approimatio of the Lielihood Ratio Statistics i Competig Riss Model Uder Iformative Radom Cesorship From Both Sides Abdrahim A. Abdshrov Natioal Uiversity of Uzbeista Departmet of Theory Probability ad

More information

LECTURE 2 LEAST SQUARES CROSS-VALIDATION FOR KERNEL DENSITY ESTIMATION

LECTURE 2 LEAST SQUARES CROSS-VALIDATION FOR KERNEL DENSITY ESTIMATION Jauary 3 07 LECTURE LEAST SQUARES CROSS-VALIDATION FOR ERNEL DENSITY ESTIMATION Noparametric kerel estimatio is extremely sesitive to te coice of badwidt as larger values of result i averagig over more

More information

Math 4A03: Practice problems on Multivariable Calculus

Math 4A03: Practice problems on Multivariable Calculus Mat 4A0: Practice problems on Mltiariable Calcls Problem Consider te mapping f, ) : R R defined by fx, y) e y + x, e x y) x, y) R a) Is it possible to express x, y) as a differentiable fnction of, ) near

More information

Topics Machine learning: lecture 2. Review: the learning problem. Hypotheses and estimation. Estimation criterion cont d. Estimation criterion

Topics Machine learning: lecture 2. Review: the learning problem. Hypotheses and estimation. Estimation criterion cont d. Estimation criterion .87 Machie learig: lecture Tommi S. Jaakkola MIT CSAIL tommi@csail.mit.edu Topics The learig problem hypothesis class, estimatio algorithm loss ad estimatio criterio samplig, empirical ad epected losses

More information

CHAPTER 5. Theory and Solution Using Matrix Techniques

CHAPTER 5. Theory and Solution Using Matrix Techniques A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL

More information

Some q-analogues of Fibonacci, Lucas and Chebyshev polynomials with nice moments

Some q-analogues of Fibonacci, Lucas and Chebyshev polynomials with nice moments Some -aaloges o Fiboacci, Lcas ad Chebyshev polyomials with ice momets Joha Cigler Faltät ür Mathemati, Uiversität Wie Ui Wie Rossa, Osar-Morgester-Platz, 090 Wie ohacigler@ivieacat http://homepageivieacat/ohacigler/

More information

A Self-Starting Hybrid Linear Multistep Method for a Direct Solution of the General Second-Order Initial Value Problem

A Self-Starting Hybrid Linear Multistep Method for a Direct Solution of the General Second-Order Initial Value Problem IOS Joural o Matematics (IOS-JM) ISSN: 78-578. Volume 4 Issue 6 (Ja. - eb. ) PP 7- www.iosrourals.org Sel-Startig Hbrid Liear Multistep Metod or a Direct Solutio o te Geeral Secod-Order Iitial Value Problem

More information

In this document, if A:

In this document, if A: m I this docmet, if A: is a m matrix, ref(a) is a row-eqivalet matrix i row-echelo form sig Gassia elimiatio with partial pivotig as described i class. Ier prodct ad orthogoality What is the largest possible

More information

Stability analysis of numerical methods for stochastic systems with additive noise

Stability analysis of numerical methods for stochastic systems with additive noise Stability aalysis of umerical metods for stoctic systems wit additive oise Yosiiro SAITO Abstract Stoctic differetial equatios (SDEs) represet pysical peomea domiated by stoctic processes As for determiistic

More information

7. Discrete Fourier Transform (DFT)

7. Discrete Fourier Transform (DFT) 7 Discrete ourier Trasor (DT) 7 Deiitio ad soe properties Discrete ourier series ivolves to seueces o ubers aely the aliased coeiciets ĉ ad the saples (T) It relates the aliased coeiciets to the saples

More information

FIR Filter Design: Part I

FIR Filter Design: Part I EEL3: Discrete-Time Sigals ad Systems FIR Filter Desig: Part I. Itroductio FIR Filter Desig: Part I I this set o otes, we cotiue our exploratio o the requecy respose o FIR ilters. First, we cosider some

More information

Lecture 7 Testing Nonlinear Inequality Restrictions 1

Lecture 7 Testing Nonlinear Inequality Restrictions 1 Eco 75 Lecture 7 Testig Noliear Iequality Restrictios I Lecture 6, we discussed te testig problems were te ull ypotesis is de ed by oliear equality restrictios: H : ( ) = versus H : ( ) 6= : () We sowed

More information

Chapter Unary Matrix Operations

Chapter Unary Matrix Operations Chapter 04.04 Uary atrix Operatios After readig this chapter, you should be able to:. kow what uary operatios meas, 2. fid the traspose of a square matrix ad it s relatioship to symmetric matrices,. fid

More information

4 Conditional Distribution Estimation

4 Conditional Distribution Estimation 4 Coditioal Distributio Estimatio 4. Estimators Te coditioal distributio (CDF) of y i give X i = x is F (y j x) = P (y i y j X i = x) = E ( (y i y) j X i = x) : Tis is te coditioal mea of te radom variable

More information

4. Linear Classification. Kai Yu

4. Linear Classification. Kai Yu 4. Liear Classificatio Kai Y Liear Classifiers A simplest classificatio model Help to derstad oliear models Argably the most sefl classificatio method! 2 Liear Classifiers A simplest classificatio model

More information

THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION

THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION Zho, J., et al.: The Coservative Differece Scheme for the Geeralized THERMAL SCIENCE, Year 6, Vol., Sppl. 3, pp. S93-S9 S93 THE CONSERVATIVE DIFFERENCE SCHEME FOR THE GENERALIZED ROSENAU-KDV EQUATION by

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

STAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS

STAT 516 Answers Homework 6 April 2, 2008 Solutions by Mark Daniel Ward PROBLEMS STAT 56 Aswers Homework 6 April 2, 28 Solutios by Mark Daiel Ward PROBLEMS Chapter 6 Problems 2a. The mass p(, correspods to either o the irst two balls beig white, so p(, 8 7 4/39. The mass p(, correspods

More information

Taylor Polynomials and Approximations - Classwork

Taylor Polynomials and Approximations - Classwork Taylor Polyomials ad Approimatios - Classwork Suppose you were asked to id si 37 o. You have o calculator other tha oe that ca do simple additio, subtractio, multiplicatio, or divisio. Fareched\ Not really.

More information

Some Variants of Newton's Method with Fifth-Order and Fourth-Order Convergence for Solving Nonlinear Equations

Some Variants of Newton's Method with Fifth-Order and Fourth-Order Convergence for Solving Nonlinear Equations Copyright, Darbose Iteratioal Joural o Applied Mathematics ad Computatio Volume (), pp -6, 9 http//: ijamc.darbose.com Some Variats o Newto's Method with Fith-Order ad Fourth-Order Covergece or Solvig

More information

SOME MULTI-STEP ITERATIVE ALGORITHMS FOR MINIMIZATION OF UNCONSTRAINED NON LINEAR FUNCTIONS

SOME MULTI-STEP ITERATIVE ALGORITHMS FOR MINIMIZATION OF UNCONSTRAINED NON LINEAR FUNCTIONS I.J.E.M.S. VOL. : -7 ISS 9-6X SOME MULTI-STEP ITERATIVE ALGORITHMS FOR MIIMIZATIO OF UCOSTRAIED O LIEAR FUCTIOS K.Karthikea S.K.Khadar Babu M.Sudaramurth B.Rajesh Aad School o Advaced Scieces VIT Uiversit

More information

Computational Methods CMSC/AMSC/MAPL 460. Quadrature: Integration

Computational Methods CMSC/AMSC/MAPL 460. Quadrature: Integration Computatioal Metods CMSC/AMSC/MAPL 6 Quadrature: Itegratio Ramai Duraiswami, Dept. o Computer Siee Some material adapted rom te olie slides o Eri Sadt ad Diae O Leary Numerial Itegratio Idea is to do itegral

More information

Change of Variables. (f T) JT. f = U

Change of Variables. (f T) JT. f = U Change of Variables 4-5-8 The change of ariables formla for mltiple integrals is like -sbstittion for single-ariable integrals. I ll gie the general change of ariables formla first, and consider specific

More information

CMSE 820: Math. Foundations of Data Sci.

CMSE 820: Math. Foundations of Data Sci. Lecture 17 8.4 Weighted path graphs Take from [10, Lecture 3] As alluded to at the ed of the previous sectio, we ow aalyze weighted path graphs. To that ed, we prove the followig: Theorem 6 (Fiedler).

More information

Maclaurin and Taylor series

Maclaurin and Taylor series At the ed o the previous chapter we looed at power series ad oted that these were dieret rom other iiite series as they were actually uctios o a variable R: a a + + a + a a Maclauri ad Taylor series +

More information

Continuous Functions

Continuous Functions Cotiuous Fuctios Q What does it mea for a fuctio to be cotiuous at a poit? Aswer- I mathematics, we have a defiitio that cosists of three cocepts that are liked i a special way Cosider the followig defiitio

More information

Objectives: We will learn about filters that are carried out in the frequency domain.

Objectives: We will learn about filters that are carried out in the frequency domain. Chapter Freqency Domain Processing Objectives: We will learn abot ilters that are carried ot in the reqency domain. In addition to being the base or linear iltering, Forier Transorm oers considerable lexibility

More information

L S => logf y i P x i ;S

L S => logf y i P x i ;S Three Classical Tests; Wald, LM(core), ad LR tests uose that we hae the desity y; of a model with the ull hyothesis of the form H ; =. Let L be the log-likelihood fuctio of the model ad be the MLE of.

More information

Fundamental Concepts: Surfaces and Curves

Fundamental Concepts: Surfaces and Curves UNDAMENTAL CONCEPTS: SURACES AND CURVES CHAPTER udametal Cocepts: Surfaces ad Curves. INTRODUCTION This chapter describes two geometrical objects, vi., surfaces ad curves because the pla a ver importat

More information

Essential Microeconomics EXISTENCE OF EQUILIBRIUM Core ideas: continuity of excess demand functions, Fixed point theorems

Essential Microeconomics EXISTENCE OF EQUILIBRIUM Core ideas: continuity of excess demand functions, Fixed point theorems Essetial Microecoomics -- 5.3 EXISTENCE OF EQUILIBRIUM Core ideas: cotiuity of excess demad fuctios, Fixed oit teorems Two commodity excage ecoomy 2 Excage ecoomy wit may commodities 5 Discotiuous demad

More information

Differentiation Techniques 1: Power, Constant Multiple, Sum and Difference Rules

Differentiation Techniques 1: Power, Constant Multiple, Sum and Difference Rules Differetiatio Teciques : Power, Costat Multiple, Sum ad Differece Rules 97 Differetiatio Teciques : Power, Costat Multiple, Sum ad Differece Rules Model : Fidig te Equatio of f '() from a Grap of f ()

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Chapter 1 Simple Linear Regression (part 6: matrix version)

Chapter 1 Simple Linear Regression (part 6: matrix version) Chapter Simple Liear Regressio (part 6: matrix versio) Overview Simple liear regressio model: respose variable Y, a sigle idepedet variable X Y β 0 + β X + ε Multiple liear regressio model: respose Y,

More information

Inverse Matrix. A meaning that matrix B is an inverse of matrix A.

Inverse Matrix. A meaning that matrix B is an inverse of matrix A. Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix

More information

PRELIMINARY MATHEMATICS LECTURE 5

PRELIMINARY MATHEMATICS LECTURE 5 SCHOOL OF ORIENTAL AND AFRICAN STUDIES UNIVERSITY OF LONDON DEPARTMENT OF ECONOMICS 5 / - 6 5 MSc Ecoomics PRELIMINARY MATHEMATICS LECTURE 5 Course website: http://mercur.soas.ac.uk/users/sm97/teachig_msc_premath.htm

More information

ENGI 4430 Advanced Calculus for Engineering Faculty of Engineering and Applied Science Problem Set 4 Solutions [Numerical Methods]

ENGI 4430 Advanced Calculus for Engineering Faculty of Engineering and Applied Science Problem Set 4 Solutions [Numerical Methods] ENGI 3 Advaced Calculus or Egieerig Facult o Egieerig ad Applied Sciece Problem Set Solutios [Numerical Methods]. Use Simpso s rule with our itervals to estimate I si d a, b, h a si si.889 si 3 si.889

More information

2D DSP Basics: 2D Systems

2D DSP Basics: 2D Systems - Digital Image Processig ad Compressio D DSP Basics: D Systems D Systems T[ ] y = T [ ] Liearity Additivity: If T y = T [ ] The + T y = y + y Homogeeity: If The T y = T [ ] a T y = ay = at [ ] Liearity

More information

PHY2061 Enriched Physics 2 Lecture Notes Relativity 3. Relativity 3

PHY2061 Enriched Physics 2 Lecture Notes Relativity 3. Relativity 3 PHY61 Eried Psis Letre Notes Reltiit 3 Reltiit 3 Dislimer: Tese letre otes re ot met to reple te orse tetbook. Te otet m be iomplete. Some topis m be ler. Tese otes re ol met to be std id d spplemet to

More information

The Discrete-Time Fourier Transform (DTFT)

The Discrete-Time Fourier Transform (DTFT) EEL: Discrete-Time Sigals ad Systems The Discrete-Time Fourier Trasorm (DTFT) The Discrete-Time Fourier Trasorm (DTFT). Itroductio I these otes, we itroduce the discrete-time Fourier trasorm (DTFT) ad

More information

which are generalizations of Ceva s theorem on the triangle

which are generalizations of Ceva s theorem on the triangle Theorems for the dimesioal simple which are geeralizatios of Ceva s theorem o the triagle Kazyi HATADA Departmet of Mathematics, Faclty of Edcatio, Gif Uiversity -, Yaagido, Gif City, GIFU 50-93, Japa

More information

18.657: Mathematics of Machine Learning

18.657: Mathematics of Machine Learning 8.657: Mathematics of Machie Learig Lecturer: Philippe Rigollet Lecture 0 Scribe: Ade Forrow Oct. 3, 05 Recall the followig defiitios from last time: Defiitio: A fuctio K : X X R is called a positive symmetric

More information

Essential Microeconomics : EQUILIBRIUM AND EFFICIENCY WITH PRODUCTION Key ideas: Walrasian equilibrium, first and second welfare theorems

Essential Microeconomics : EQUILIBRIUM AND EFFICIENCY WITH PRODUCTION Key ideas: Walrasian equilibrium, first and second welfare theorems Essential Microeconomics -- 5.2: EQUILIBRIUM AND EFFICIENCY WITH PRODUCTION Key ideas: Walrasian equilibrium, irst and second welare teorems A general model 2 First welare Teorem 7 Second welare teorem

More information

International Journal of Mathematical Archive-3(12), 2012, Available online through ISSN

International Journal of Mathematical Archive-3(12), 2012, Available online through   ISSN Iteratioal Joural o Mathematical Archive-, 0, 489-4897 Available olie throuh www.ijma.io ISSN 9 5046 NEW ITERATIVE NUMERICAL ALGORITHMS FOR MINIMIZATION OF NONLINEAR FUNCTIONS K. Karthikea* School o Advaced

More information

Homework 3 Solutions

Homework 3 Solutions Math 4506 Sprig 04 Homework 3 Solutios. a The ACF of a MA process has a o-zero value oly at lags, 0, ad. Problem 4.3 from the textbook which you did t do, so I did t expect you to metio this shows that

More information

Curve Sketching Handout #5 Topic Interpretation Rational Functions

Curve Sketching Handout #5 Topic Interpretation Rational Functions Curve Sketchig Hadout #5 Topic Iterpretatio Ratioal Fuctios A ratioal fuctio is a fuctio f that is a quotiet of two polyomials. I other words, p ( ) ( ) f is a ratioal fuctio if p ( ) ad q ( ) are polyomials

More information

AN EXTENSION OF A RESULT ABOUT THE ORDER OF CONVERGENCE

AN EXTENSION OF A RESULT ABOUT THE ORDER OF CONVERGENCE Bulleti o Mathematical Aalysis ad Applicatios ISSN: 8-9, URL: http://www.bmathaa.or Volume 3 Issue 3), Paes 5-34. AN EXTENSION OF A RESULT ABOUT THE ORDER OF CONVERGENCE COMMUNICATED BY HAJRUDIN FEJZIC)

More information

Generalized H-codes and type II codes over GF(4)

Generalized H-codes and type II codes over GF(4) THE JOURNA OF CHINA UNIVERSITIES OF POSTS AND TEECOMMUNICATIONS Volume 15, Issue 2, Jue 28 IN i-qi, WEN ia-mi, ZHENG Wei Geeralized H-codes ad type II codes over GF(4) CC umber O1574 Documet A Article

More information

Tutorial 4: FUNDAMENTAL SOLUTIONS: I-SIMPLE AND COMPOUND OPERATORS

Tutorial 4: FUNDAMENTAL SOLUTIONS: I-SIMPLE AND COMPOUND OPERATORS Boary Elemet Commicatios 00 Ttorial 4: FNDAMENTAL SOLTIONS: I-SIMPLE AND COMPOND OPERATORS YOSSEF F. RASHED Dept. o Strctral Egieerig Cairo iversity iza Egypt yosse@eg.c.e.eg Smmary a objectives I the

More information

1. Draw a function that is quasi-concave but not concave and explain why.

1. Draw a function that is quasi-concave but not concave and explain why. Solutios to Problem Set 4: Costraied Otimisatio. raw a uctio that is quasi-cocave but ot cocave ad elai wh. ots o ossibilities. The dotted lie shows that the curve draw is ot cocave. More to the oit ou

More information

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS

THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity

More information

LIMITS AND DERIVATIVES

LIMITS AND DERIVATIVES Capter LIMITS AND DERIVATIVES. Overview.. Limits of a fuctio Let f be a fuctio defied i a domai wic we take to be a iterval, say, I. We sall study te cocept of it of f at a poit a i I. We say f ( ) is

More information

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization

ECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where

More information

Castiel, Supernatural, Season 6, Episode 18

Castiel, Supernatural, Season 6, Episode 18 13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio

More information

ADVANCED TOPICS ON VIDEO PROCESSING

ADVANCED TOPICS ON VIDEO PROCESSING ADVANCED TOPICS ON VIDEO PROCESSING Image Spatial Processig FILTERING EXAMPLES FOURIER INTERPRETATION FILTERING EXAMPLES FOURIER INTERPRETATION FILTERING EXAMPLES FILTERING EXAMPLES FOURIER INTERPRETATION

More information

1the 1it is said to be overdamped. When 1, the roots of

1the 1it is said to be overdamped. When 1, the roots of Homework 3 AERE573 Fall 08 Due 0/8(M) ame PROBLEM (40pts) Cosider a D order uderdamped system trasfer fuctio H( s) s ratio 0 The deomiator is the system characteristic polyomial P( s) s s (a)(5pts) Use

More information

Cov(aX, cy ) Var(X) Var(Y ) It is completely invariant to affine transformations: for any a, b, c, d R, ρ(ax + b, cy + d) = a.s. X i. as n.

Cov(aX, cy ) Var(X) Var(Y ) It is completely invariant to affine transformations: for any a, b, c, d R, ρ(ax + b, cy + d) = a.s. X i. as n. CS 189 Itroductio to Machie Learig Sprig 218 Note 11 1 Caoical Correlatio Aalysis The Pearso Correlatio Coefficiet ρ(x, Y ) is a way to measure how liearly related (i other words, how well a liear model

More information

Section 14. Simple linear regression.

Section 14. Simple linear regression. Sectio 14 Simple liear regressio. Let us look at the cigarette dataset from [1] (available to dowload from joural s website) ad []. The cigarette dataset cotais measuremets of tar, icotie, weight ad carbo

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

I v r e s n a d di t r th o e r m e s o f r monoton e app o r i x m t a ion b a t 1. I r n o n a

I v r e s n a d di t r th o e r m e s o f r monoton e app o r i x m t a ion b a t 1. I r n o n a Iverse ad direct orems or mootoe aroxima tio ukeia Abdulla Al- B ermai B abylo Uiversity ciece College For Wome C omuter ciece Deartmet A bstract We rove that i s icreasig uctio o i or e ac h re a icreasig

More information

EE2 Mathematics : Functions of Multiple Variables

EE2 Mathematics : Functions of Multiple Variables EE2 Mathematics : Fnctions of Mltiple Variables http://www2.imperial.ac.k/ nsjones These notes are not identical word-for-word with m lectres which will be gien on the blackboard. Some of these notes ma

More information

LIMITS AND DERIVATIVES NCERT

LIMITS AND DERIVATIVES NCERT . Overview.. Limits of a fuctio Let f be a fuctio defied i a domai wic we take to be a iterval, say, I. We sall study te cocept of it of f at a poit a i I. We say f ( ) is te epected value of f at a give

More information

Nonparametric regression: minimax upper and lower bounds

Nonparametric regression: minimax upper and lower bounds Capter 4 Noparametric regressio: miimax upper ad lower bouds 4. Itroductio We cosider oe of te two te most classical o-parametric problems i tis example: estimatig a regressio fuctio o a subset of te real

More information

1. Introduction. 2. Numerical Methods

1. Introduction. 2. Numerical Methods America Joural o Computatioal ad Applied Matematics, (5: 9- DOI:.59/j.ajcam.5. A Stud o Numerical Solutios o Secod Order Iitial Value Problems (IVP or Ordiar Dieretial Equatios wit Fourt Order ad Butcer

More information

UNIT #6 EXPONENTS, EXPONENTS, AND MORE EXPONENTS REVIEW QUESTIONS

UNIT #6 EXPONENTS, EXPONENTS, AND MORE EXPONENTS REVIEW QUESTIONS Answer Key Name: Date: UNIT # EXPONENTS, EXPONENTS, AND MORE EXPONENTS REVIEW QUESTIONS Part I Questions. Te epression 0 can be simpliied to () () 0 0. Wic o te ollowing is equivalent to () () 8 8? 8.

More information

Section 11.8: Power Series

Section 11.8: Power Series Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

More Elementary Aspects of Numerical Solutions of PDEs!

More Elementary Aspects of Numerical Solutions of PDEs! ttp://www.d.edu/~gtryggva/cfd-course/ Outlie More Elemetary Aspects o Numerical Solutios o PDEs I tis lecture we cotiue to examie te elemetary aspects o umerical solutios o partial dieretial equatios.

More information

CHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS

CHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS CHAPTR 5 SOM MINIMA AND SADDL POINT THORMS 5. INTRODUCTION Fied poit theorems provide importat tools i game theory which are used to prove the equilibrium ad eistece theorems. For istace, the fied poit

More information

Numerical Derivatives by Symbolic Tools in MATLAB

Numerical Derivatives by Symbolic Tools in MATLAB Numerical Derivatives by Symbolic ools i MALAB Mig-Gog Lee * ad Rei-Wei Sog ad Hsuag-Ci Cag mglee@cu.edu.tw * Departmet o Applied Matematics Cug Hua Uiversity Hsicu, aiwa Abstract: Numerical approaces

More information

The minimum value and the L 1 norm of the Dirichlet kernel

The minimum value and the L 1 norm of the Dirichlet kernel The miimum value ad the L orm of the Dirichlet kerel For each positive iteger, defie the fuctio D (θ + ( cos θ + cos θ + + cos θ e iθ + + e iθ + e iθ + e + e iθ + e iθ + + e iθ which we call the (th Dirichlet

More information

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α

A widely used display of protein shapes is based on the coordinates of the alpha carbons - - C α Nice plottig of proteis: I A widely used display of protei shapes is based o the coordiates of the alpha carbos - - C α -s. The coordiates of the C α -s are coected by a cotiuous curve that roughly follows

More information

Introduction. Question: Why do we need new forms of parametric curves? Answer: Those parametric curves discussed are not very geometric.

Introduction. Question: Why do we need new forms of parametric curves? Answer: Those parametric curves discussed are not very geometric. Itrodctio Qestio: Why do we eed ew forms of parametric crves? Aswer: Those parametric crves discssed are ot very geometric. Itrodctio Give sch a parametric form, it is difficlt to kow the derlyig geometry

More information

A NUMERICAL METHOD OF SOLVING CAUCHY PROBLEM FOR DIFFERENTIAL EQUATIONS BASED ON A LINEAR APPROXIMATION

A NUMERICAL METHOD OF SOLVING CAUCHY PROBLEM FOR DIFFERENTIAL EQUATIONS BASED ON A LINEAR APPROXIMATION U.P.B. Sci. Bull., Series A, Vol. 79, Iss. 4, 7 ISSN -77 A NUMERICAL METHOD OF SOLVING CAUCHY PROBLEM FOR DIFFERENTIAL EQUATIONS BASED ON A LINEAR APPROXIMATION Cristia ŞERBĂNESCU, Marius BREBENEL A alterate

More information

α x = α x for all scalars α

α x = α x for all scalars α SECION. VECOR ND RIX NORS VECOR NOR: a fuctio from R oegatie real umbers that measures the "size" of a ector. Properties that defie a ector orm: (i) If 0, the > 0 (ii) (iii) α α for all scalars α Note:

More information

Fourier Series and Transforms

Fourier Series and Transforms Fourier Series ad rasorms Orthogoal uctios Fourier Series Discrete Fourier Series Fourier rasorm Chebyshev polyomials Scope: wearetryigto approimate a arbitrary uctio ad obtai basis uctios with appropriate

More information