Linear predictive coding

Similar documents
Laplace s equation in Cylindrical Coordinates

Intermediate Applications of Vectors and Matrices Ed Stanek

Analysis of Variance and Design of Experiments-II

APPENDIX 2 LAPLACE TRANSFORMS

TP 10:Importance Sampling-The Metropolis Algorithm-The Ising Model-The Jackknife Method

Linear predictive coding

4-4 E-field Calculations using Coulomb s Law

Existence and Uniqueness of Solution for a Fractional Order Integro-Differential Equation with Non-Local and Global Boundary Conditions

Robust State and fault Estimation of Linear Discrete Time Systems with Unknown Disturbances

Proc. of the 8th WSEAS Int. Conf. on Mathematical Methods and Computational Techniques in Electrical Engineering, Bucharest, October 16-17,

20.2. The Transform and its Inverse. Introduction. Prerequisites. Learning Outcomes

Chapter 3 MATRIX. In this chapter: 3.1 MATRIX NOTATION AND TERMINOLOGY

Chapter 3. Generator and Transformer Models; The Per-Unit System

STABILITY and Routh-Hurwitz Stability Criterion

Chapter 2. Determinants

PHYS 705: Classical Mechanics. Small Oscillations: Example A Linear Triatomic Molecule

u t = k 2 u x 2 (1) a n sin nπx sin 2 L e k(nπ/l) t f(x) = sin nπx f(x) sin nπx dx (6) 2 L f(x 0 ) sin nπx 0 2 L sin nπx 0 nπx

2. The Laplace Transform

SOLUTIONS FOR HOMEWORK SECTION 6.4 AND 6.5

Math 2142 Homework 2 Solutions. Problem 1. Prove the following formulas for Laplace transforms for s > 0. a s 2 + a 2 L{cos at} = e st.

PHYS 601 HW 5 Solution. We wish to find a Fourier expansion of e sin ψ so that the solution can be written in the form

ECONOMETRIC THEORY. MODULE IV Lecture - 16 Predictions in Linear Regression Model

(4.1) D r v(t) ω(t, v(t))

OXFORD H i g h e r E d u c a t i o n Oxford University Press, All rights reserved.

Topic 7 Fuzzy expert systems: Fuzzy inference

LECTURE 23 SYNCHRONOUS MACHINES (3)

Applicability of Matrix Inverse in Simple Model of Economics An Analysis

Considerations on Short Range Wakefield for CLIC Main Beam Accelerating Structures

Image Denoising Based on Non-Local Low-Rank Dictionary Learning

UNIQUENESS THEOREMS FOR ORDINARY DIFFERENTIAL EQUATIONS WITH HÖLDER CONTINUITY

Transfer Functions. Chapter 5. Transfer Functions. Derivation of a Transfer Function. Transfer Functions

CHOOSING THE NUMBER OF MODELS OF THE REFERENCE MODEL USING MULTIPLE MODELS ADAPTIVE CONTROL SYSTEM

ODE: Existence and Uniqueness of a Solution

INTRODUCTION TO LINEAR ALGEBRA

G x, x E x E x E x E x. a a a a. is some matrix element. For a general single photon state. ), applying the operators.

1 The fundamental theorems of calculus.

Reinforcement learning

Homework Problem Set 1 Solutions

Chapter Direct Method of Interpolation More Examples Civil Engineering

The Extended Balanced Truncation Algorithm

positive definite (symmetric with positive eigenvalues) positive semi definite (symmetric with nonnegative eigenvalues)

When current flows through the armature, the magnetic fields create a torque. Torque = T =. K T i a

e st t u(t 2) dt = lim t dt = T 2 2 e st = T e st lim + e st

ADJOINT ANALYSIS OF GUIDED PROJECTILE TERMINAL PHASE

MATH , Calculus 2, Fall 2018

Physics 116C Solution of inhomogeneous ordinary differential equations using Green s functions

Numerical Linear Algebra Assignment 008

Chapter 7. Principles of Unsteady - State and Convective Mass Transfer

1.1. Linear Constant Coefficient Equations. Remark: A differential equation is an equation

Digital Control System

SPACE VECTOR PULSE- WIDTH-MODULATED (SV-PWM) INVERTERS

The Islamic University of Gaza Faculty of Engineering Civil Engineering Department. Numerical Analysis ECIV Chapter 11

1B40 Practical Skills

MATRICES AND VECTORS SPACE

A Matrix Algebra Primer

Problem Set 2 Solutions

1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a non-constant can be solved with the same idea as above.

Review of Gaussian Quadrature method

Theoretical foundations of Gaussian quadrature

Advanced Computational Fluid Dynamics AA215A Lecture 3 Polynomial Interpolation: Numerical Differentiation and Integration.

1 The fundamental theorems of calculus.

SIMULATION OF TRANSIENT EQUILIBRIUM DECAY USING ANALOGUE CIRCUIT

1-D SEDIMENT NUMERICAL MODEL AND ITS APPLICATION. Weimin Wu 1 and Guolu Yang 2

We will see what is meant by standard form very shortly

The Where, How and What of brain function. Effective Connectivity & Dynamic Causal Modelling (DCM) Structure of this talk. Concepts of brain function

Math 31S. Rumbos Fall Solutions to Assignment #16

Matrix & Vector Basic Linear Algebra & Calculus

Chapter 3. Vector Spaces

63. Representation of functions as power series Consider a power series. ( 1) n x 2n for all 1 < x < 1

n f(x i ) x. i=1 In section 4.2, we defined the definite integral of f from x = a to x = b as n f(x i ) x; f(x) dx = lim i=1

a a a a a a a a a a a a a a a a a a a a a a a a In this section, we introduce a general formula for computing determinants.

Note 7 Root-Locus Techniques

Tutorial 4. b a. h(f) = a b a ln 1. b a dx = ln(b a) nats = log(b a) bits. = ln λ + 1 nats. = log e λ bits. = ln 1 2 ln λ + 1. nats. = ln 2e. bits.

Multi-Class Demand Matrix Adjustment

UNIQUENESS THEOREMS FOR ORDINARY DIFFERENTIAL EQUATIONS WITH HÖLDER CONTINUITY

MatFys. Week 2, Nov , 2005, revised Nov. 23

Formulae For. Standard Formulae Of Integrals: x dx k, n 1. log. a dx a k. cosec x.cot xdx cosec. e dx e k. sec. ax dx ax k. 1 1 a x.

Matching. Lecture 13 Link Analysis ( ) 13.1 Link Analysis ( ) 13.2 Google s PageRank Algorithm The Top Ten Algorithms in Data Mining

A COMPARISON OF TWO ROBUST CONTROL TECHNIQUES FOR THROTTLE VALVE CONTROL SUBJECT TO NONLINEAR FRICTION

approaches as n becomes larger and larger. Since e > 1, the graph of the natural exponential function is as below

Definition of Continuity: The function f(x) is continuous at x = a if f(a) exists and lim

5.5 Sampling. The Connection Between: Continuous Time & Discrete Time

Sampling and the Discrete Fourier Transform

Topics Covered AP Calculus AB

Vector potential quantization and the photon wave-particle representation

Orthogonal Polynomials

1 Linear Least Squares

EE Control Systems LECTURE 8

F (x) dx = F (x)+c = u + C = du,

Bernoulli Numbers Jeff Morton

AQA Further Pure 2. Hyperbolic Functions. Section 2: The inverse hyperbolic functions

7-1: Zero and Negative Exponents

Practice Problems - Week #7 Laplace - Step Functions, DE Solutions Solutions

HOMEWORK SOLUTIONS MATH 1910 Sections 7.9, 8.1 Fall 2016

P 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)

Exponentially Convergent Controllers for n-dimensional. Nonholonomic Systems in Power Form. Jihao Luo and Panagiotis Tsiotras

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.

SoSe 2014: M-TANI: Big Data Analytics

Identification of Source Time Function for Train-induced Vibration of Underground Tunnels

The Algebra (al-jabr) of Matrices

Transcription:

Liner predictive coding Thi ethod cobine liner proceing with clr quntiztion. The in ide of the ethod i to predict the vlue of the current ple by liner cobintion of previou lredy recontructed ple nd then to quntize the difference between the ctul vlue nd the predicted vlue. Liner prediction coefficient re weighting coefficient ued in liner cobintion. A iple predictive quntizer or differentil pule-coded odultor i hown in Fig. 5.. If the predictor i iply the lt ple nd the quntizer h only one bit, the yte becoe delt-odultor. It i hown in Fig. 5..

Differentil pule-coded odultor x e QUANTIZ q xˆ d x DQUANTIZ LINA PDICTO

Delt-odultor x x xˆ COMPAATO x xˆ Stirce function forer

Liner predictive coding The in feture of the quntizer hown in Fig 5., 5. i tht they exploit not ll dvntge of predictive coding. Prediction coefficient ued in thee chee re not optil Prediction i bed on pt recontructed ple nd not true ple Uully coefficient of prediction re choen by uing oe epiricl rule nd re not trnitted For exple quntizer in Fig.5. inted of ctul vlue of error e ue recontructed vlue d nd inted of true ple vlue x their etite x obtined vi d.

Liner predictive coding The ot dvnced quntizer of liner predictive type repreent bi of the o-clled Code xcited Liner Predictive CLP coder. It ue the optil et of coefficient or in other word liner prediction coefficient of thi quntizer re deterined by iniizing the MS between the current ple nd it predicted vlue. It i bed on the originl pt ple Uing the true ple for prediction require the looking-hed procedure in the coder. The predictor coefficient re trnitted

Liner predictive coding Aue tht quntizer coefficient re optiized for ech ple nd tht the originl pt ple re ued for prediction. Let x T, xt,... be equence of ple t the quntizer input. Then ech ple x i predicted by the previou ple ccording to the forul ˆ xˆ k k x kt where x i the predicted vlue, k re prediction coefficient, denote the order of prediction. The prediction error i e x xˆ., 5.

Liner predictive coding Prediction coefficient re deterined by iniizing the u of qured error over given intervl n e 5. nn Inerting 5. into 5. we obtin n x x T... x T nn n n x nn j nn j x x jt j k j k n nn x jt x kt. 5.3

Liner predictive coding Differentiting 5.3 over k, k,,..., yield / k n nn x x kt Thu we obtin yte of unknown quntitie,...,, j j n nn x kt x liner eqution with jt j j c jk c ok, k,,..., 5.4 where c jk c kj n nn x jt x kt. 5.5 The yte 5.4 i clled the Yule-Wlker eqution.

If,..., Liner predictive coding, re olution of 5.4 then we cn find the inil chievble prediction error. Inert 5.5 into 5.3. We obtin tht c c c. 5.6 Uing 5.3 we reduce 5.6 to k k k k k j j jk c k k c k

Interprettion of the Yule-Wlker eqution like digitl filter q. 5. decribe the th order predictor with trnfer function equl to ˆ z X z X z P k k k z. z-trnfor for the prediction error i k k k z z X z X z. The prediction error i n output ignl of the dicrete-tie filter with trnfer function k k k z z X z z A. The proble of finding the optil et of prediction coefficient = proble of contructing th order FI filter.

Interprettion of the Yule-Wlker eqution like digitl filter Another ne of the liner prediction 5. i the utoregreive odel of ignl x. It i ued tht the ignl x cn be obtined the output of the utoregreive filter with trnfer function H z, z k k k tht i cn be obtined the output of the filter which i invere with repect to the prediction filter. Thi filter i dicrete-tie II filter.

Method of finding coefficient c, i,,...,, j,,..., ij In order to olve the Yule-Wlker eq. 5.4 it i necery firt to evlute vlue c, i,,...,, j,,..., There re two pproche to etiting thee vlue: ij The utocorreltion ethod nd The coplexity of olving 5.4 i proportionl to the covrince ethod. The coplexity of olving 5.4 i proportionl to 3

c The vlue ij c We et ij c c ij ji Autocorreltion ethod re coputed i ni x it x jt. 5.7 i,i nd x if n, n N, where N i clled the intervl of nlyi. In thi ce we cn iplify 5.7 N n x it x jt N i j n x x i Norlized by N they coincide with etite of entrie of covrince trix for x ˆ i j c ij / N / N N i j n x x i jt jt.. 5.8

Autocorreltion ethod

Autocorreltion ethod The Yule-Wlker eqution for utocorreltion ethod hve the for ˆ i j ˆ j, j,,...,. 5.9 i i q.5.9 cn be given by trix eqution where,,...,, b, b ˆ, ˆ,..., ˆ, ˆ ˆ... ˆ ˆ ˆ... ˆ.... ˆ ˆ... ˆ

Autocorreltion ethod It i id tht 5.9 relte the preter of the utoregreive odel of th order with the utocorreltion equence. Mtrix propertie. of the utocorreltion ethod h two iportnt It i yetric, tht i ˆ i, j ˆ j, i It h Toeplitz property, tht i ˆ i, j ˆ i j. The Toeplitz property of ke it poible to reduce the coputtionl coplexity of olving 5.4. The ft Levinon-Durbin recurive lgorith require only opertion.

We chooe Covrince ethod i i N nd nd ignl i not contrined in tie. In thi ce we hve Set c ij c k ij N i k i N n n i x kt x it x jt x. 5. then 5. cn be rewritten x kt i j T, i,...,, j,.... 5. 5. reeble 5.8 but it h other rnge of definition for k. It ue ignl vlue out of rnge k N, The ethod led to the cro-correltion function between two iilr but not exctly the e finite egent of x kt.

ˆ i, j c Covrince ethod ij / N / N N n x n i T x n j T The Yule-Wlker eqution for the covrition ethod re iˆ i, j ˆ, j, j,,...,. 5. i q. 5. cn be given by the trix eqution P where,,...,, c. c, ˆ, ˆ,... ˆ, ˆ, ˆ,... ˆ, P.... ˆ, ˆ,... ˆ,. ˆ,, ˆ,,..., ˆ,,

Covrince ethod Unlike the trix of utocorreltion ethod the trix P i yetric ˆ i, j ˆ j, i but it i not Toeplitz. Since coputtionl coplexity of olving n rbitrry yte of liner eqution of order i equl to 3 then in thi ce to olve 5. it i necery opertion. 3

Algorith for the olution of the Yule-Wlker eqution The coputtionl coplexity of olving the Yule- Wlker eqution depend on the ethod of evluting vlue c ij. Aue tht cij re found by the utocorreltion ethod. In thi ce the Yule-Wlker eqution h the for 5.9 nd the trix i yetric nd the Toeplitz trix. Thee propertie ke it poible to find the olution of 5.9 by ft ethod requiring opertion. There re few ethod of thi type: the Levinon- Durbin lgorith, the ucliden lgorith nd the Berlekp-Mey lgorith.

The Levinon-Durbin lgorith It w uggeted by Levinon in 948 nd then w iproved by Durbin in 96. Notice tht thi lgorith work efficiently if trix of coefficient i iultneouly yetric nd Toeplitz. The Berlekp- Mey nd the ucliden lgorith do not require the trix of coefficient to be yetric. We equentilly olve eqution 5.9 of order l,...,. l l l l Let,,..., l denote the olution for the l yte of the l th order. Given we find the olution for the l th order. At ech tep of the lgorith we evlute the prediction error of the l th order yte. l

The Levinon-Durbin lgorith Initiliztion: l, ˆ,. ecurrent procedure: For l,..., l l copute ˆ l l i l i ˆ l i/ l, l l l l, j l, j j l l j l l l l. When l we obtin the olution,,...,,.

, /, xple k /, /, /.,

xple. /. /