Kalman Filter. Wim van Drongelen, Introduction
|
|
- Julius Carroll
- 5 years ago
- Views:
Transcription
1 alman Filter Wim an Drongelen alman Filter Wim an Drongelen, 03. Introduction Getting to undertand a ytem can be quite a challenge. One approach i to create a model, an abtraction of the ytem. The idea i that thi abtraction capture the ytem important feature. On the other hand one might attempt to learn the ytem behaior by meauring it pontaneou output or it input-output relationhip. A peimit would ay that all model are wrong ince they only repreent part of the real thing, and all meaurement are wrong too becaue they are alo incomplete and noiy a well. Unfortunately, the peimit i correct with thi aement. The alman approach repreent a more optimitic iew; thi technique i to optimally combine the not o perfect information obtained ia both modeling and meaurement in order to gain the bet poible nowledge about a ytem tate. The baic idea i that we perform multiple (probably regular meaurement of a ytem output and that we ue thee meaurement and our nowledge of the ytem to recontruct the tate of the ytem. Practically, the alman filter proce conit of two tep: ( We mae an a priori etimate of the tate of the ytem before a meaurement i made. ( Subequently, after we hae made the meaurement, we compute a new a poteriori etimate by fuing the a priori prediction with thi latet meaurement. In our eample we will aume triial dynamic: i.e., our prediction of the net tate i the current tate. Of coure, when your ytem dynamic i more comple, the prediction tep mut reflect thi, but it wouldn t change tep, i.e. the procedure of the aimilation/fuion of a prediction with a meaurement. Page
2 alman Filter Wim an Drongelen For more in depth treatment of the alman filter, ee the tet of Brown and Hwang (997, Maybec (98, and epecially for neurocience application Schiff (0. The webite from Welch and Bihop lited in the reference are alo ery ueful.. Introductory Terminology Thi ection briefly ummarize of the mot important terminology required to follow the deelopment of the alman filter procedure in Section 3... Normal or Gauian Ditribution The noie component in the alman filter approach decribed in Section 3 are Gauian white noie term with zero mean. Recall that the PDF of the normal or Gauian ditribution i ( f ( e ( mean (zero in our cae, and tandard deiation Note: There are alman filter erion that deal with different type of noie procee... Minimum Mean-Square Error (MMSE An optimal fit of a erie of prediction with a erie of oberation can be achieed in eeral way. Uing the MMSE approach, one compute the difference between an etimate ŷ and a yˆ y target alue y. The quare of thi difference, gie an impreion how well the two fit. In cae of a erie of N etimate and target alue, one get a quantification of the error E by determining the um of the quare of their difference E ˆ N i y i y i, and a common technique i to minimize thi epreion with repect to the parameter of interet. For eample if our model i yˆ a, then a i the parameter we need to find. The minimum of E with repect to i i parameter a can be found by differentiating the epreion for the um of quare with repect to Page
3 alman Filter Wim an Drongelen thi parameter and etting thi deriatie equal to zero, i.e. E 0. In Section 3, the alman a filter i deeloped by uing the MMSE technique. For another eample ee Section 5.. in an Drongelen ( Recurie Algorithm Aume we meaure the reting potential of a neuron baed on a erie of meaurement: z, z,, z n. It eem reaonable to ue the etimated mean m of the n meaurement a the etimate of the reting potential: m n z z n... z n n. ( Thi equation in t an optimal bai for the deelopment of an algorithm. For each new meaurement we need more memory: i.e. we need n memory location for meaurement z - z n. In addition we need to complete all meaurement before we hae the etimate. With a recurie approach (a i ued in the alman filter algorithm one etimate the reting potential after each meaurement uing update for each meaurement t meaurement: m z (3 nd meaurement: m m z (4 3 rd meaurement: m 3 m z3 (5 3 3 Etc. Now we update the etimate at each meaurement and we only need memory for the preiou etimate and the new meaurement to mae a new etimate..4. Data Aimilation Suppoe we hae two meaurement y and y and we would lie to combine/fue thee oberation into a ingle etimate y. Further, the uncertainty of the two meaurement i gien by their ariance (=tandard deiation quared, and repectiely. If we follow the fuion principle ued in the alman approach, which i baed on MMSE, we will get Page 3
4 alman Filter Wim an Drongelen y (6 y y for the new etimate, and it ariance can be obtained from (7 By following thi procedure, we can obtain an improed etimate baed on two eparate one (Fig.. Fig. An eample of the fuion procedure i depicted in Fig.. Here we hae two oberation (blac and blue aociated with two ditribution with mean alue of 5 and 0 and tandard deiation and 3. Uing Eq (6 and (7 we find that the bet etimate i reflected by a ditribution with a mean of 5.5 and a tandard deiation of (red. From thi eample it i obiou that the meaurement with le uncertainty (blac cure ha more weight in the etimate while the one with more uncertainty (blue cure only contribute a little..5. State Model One way of characterizing the dynamic of a ytem i to decribe how it eole through a number of tate. If we characterize tate a a ector of ariable in a tate pace, we can decribe Page 4
5 alman Filter Wim an Drongelen the ytem dynamic by it path through tate pace. A imple eample i a moing object. If we tae an eample where there i no acceleration, it tate can be decribed by the coordinate of it poition in three dimenion: i.e., the 3D pace i it tate pace. The dynamic can be een by plotting poition. time, which alo gie it elocity d dt (i.e. the time deriatie of it poition. Let tae another eample, a econd order ordinary differential equation (ODE b c 0 (8 Now we define, and rewrite the ODE a (9a b c 0 (9b In thi way we rewrote the ingle nd order ODE in (8 a two t order ODE: (9a, b. Now we can define a ytem tate ector (0 Note that, unlie the preiou eample, thi ector i not the poition of a phyical object but a ector that define the tate of the ytem. The equation in (9a, b can now be compactly written a d 0 A, with A ( d t c b Here, the dynamic i epreed a an operation of matri A on tate ector. Thi notation can be ued a an alternatie to any ODE. Page 5
6 alman Filter Wim an Drongelen.6. Bayeian Analyi In the alman filter approach we update the probability ditribution function (i.e. the mean and ariance of the tate of a ytem baed on meaurement z, i.e. z p. Conditional probabilitie and ditribution are the topic of Bayeian tatitic and therefore the alman approach i a form of Bayeian analyi. Page 6
7 alman Filter Wim an Drongelen 3. Deriation of a alman Filter for a Simple Cae In thi ection, we derie a imple erion of a alman filter application following the procedure of Section 5.5 in Brown and Hwang (997. They how a deriation for a ector oberation, here I how the equialent implification for a calar. NOTES: - To facilitate comparion, the equation in thi ection are numbered a the (much more complicated equialent in the original tet (Brown and Hwang, All equation with a border are ued in the eample algorithm of the Matlab eample in Appendi and are alo hown in the flowchart in Fig.. Fig. Flowchart of the alman filter procedure deried in thi ection and implemented in the Matlab cript alman_vm (Appendi. In the Matlab cript, tep - are indicated. Step : Eq (5.5.7, Eq (5.5.8, Eq (5.5.; Step : Eq (5.5.3 and ( The equation in the diagram are deried in the tet. Page 7
8 alman Filter Wim an Drongelen We tart with a imple proce, for eample a neuron reting potential: i.e. it membrane potential in the abence of oert timulation. We aume that the update rule for the tate of the proce i w (5.5. The proce meaurement i z and i defined (a imple a poible a z (5.5. The Gauian white noie ariable w and model the proce and meaurement noie repectiely, and (for the ae of thi eample they are aumed tationary and ergodic. The mean for both i zero and the aociated ariance alue are w and. The coariance of w and i zero becaue they are independent. Now aume we hae an a priori etimate. In mot tet author include a hat : i.e. indicate one i dealing with an etimate. To implify notation, hat to denote etimate are omitted here. The a priori error we mae with thi etimate i aociated with thi error i gien by and the ariance E (5.5.7 ˆ to Now we perform a meaurement z and aimilate thi meaurement with our a priori etimate to obtain an a poteriori etimate, i.e. z (5.5.8 The factor in Equation (5.5.8 i the blending factor that determine to what etend the meaurement and a priori etimate affect the new a poteriori etimate. Page 8
9 alman Filter Wim an Drongelen Page 9 The a poteriori error we mae with thi etimate i and the ariance aociated with thi error i gien by E (5.5.9 Subtitution of Eq (5.5. in Eq (5.5.8 gie. If we plug thi reult in Eq (5.5.9, we get: E (5.5.0 We can epand thi epreion and tae the Epectation. Recall that i the a priori etimation error and uncorrelated with meaurement noie. The outcome of thi i (in cae thi in t obiou, detail of thee tep are ummarized in Appendi : Thi i uually written a: (, (5.5. or ( To optimize the a poteriori etimate uing optimal blending in Eq (5.5.8, we mut minimize the ariance (= quare of the etimated error with repect to, i.e. we differentiate the epreion for with repect to and et the reult equal to zero:
10 alman Filter Wim an Drongelen Page 0 0 ( Thi generate the epreion for an optimal, (. (5.5.7 NOTE: At thi point it i intereting to ealuate the reult. In the update Equation (5.5.8 you can ee what thi optimized reult mean: z (. If the a priori etimate i unreliable, indicated by it large ariance, we will ignore the etimate and we beliee more of the meaurement, i.e. z. On the other hand, if the meaurement i completely unreliable,, we ignore the meaurement and beliee the a priori etimate:. Now we proceed and ue the reult in (5.5.7 to obtain an epreion for : Subtitution of thi reult in (5.5. gie an epreion to find the a poteriori error baed on an optimized blending factor : 3 ( With a little bit of algebra we get,
11 alman Filter Wim an Drongelen which we implify to: (5.5. ( Here it hould be noted that depending on how one implifie Eq (5.5., one might get different epreion. Some wor better than other, depending on the ituation. We ue Eq (5.5. here becaue of it implicity. Latly we need to ue the information to mae a projection toward the net time tep occurring at t + (Fig., Step. Thi procedure depend on the model for the proce we are meauring from! Since we employ a imple model in thi eample, Eq (5.5., our a priori etimate of i imply the a poteriori etimate of the preiou time tep: (5.5.3 Here we ignore the noie (w term in Equation (5.5. ince the Epectation of w i zero. In many application thi tep can become more complicated or een an etremely comple procedure depending on the dynamic between t and t +. The a priori etimate of the ariance at t + i baed on the error of the prediction in Eq (5.5.3, e. If we ubtitute Equation (5.5. and (5.5.3 in thi epreion, we get e w. Since the a poteriori error at t i e, we can plug thi into the aboe epreion and we get e e w Page
12 alman Filter Wim an Drongelen Uing thi epreion for the a priori error, we ee that the aociated a priori ariance at t + depend on the a poteriori error at t and the ariance of the noie proce w: E e w. Becaue w and the error in the etimate are uncorrelated, we finally hae (5.5.5 w Note: If we integrate a noie term w (drawn from a zero mean normal ditribution with ariance t oer time, i.e. w dt, we get t t. So, in cae of a large interal between meaurement at t ( t and t, the uncertainty grow with a factor t and, conequently, ( t will become ery large, and the prediction ha almot no alue in the fuion of prediction and meaurement. Page
13 alman Filter Wim an Drongelen 4. Matlab Eample The eample Matlab cript alman_vm.m (lited in Appendi ue the aboe deriation to demontrate how thi could be applied to a recording of a membrane potential of a nontimulated neuron. In thi eample we aume that the reting potential Vm = -70 mv and that the tandard deiation of the proce noie and the meaurement noie are mv and mv repectiely. The program follow the flowchart in Fig. and a typical reult i depicted in Fig. 3. Due to the random apect of the procedure, your reult will ary lightly from the eample hown here. Fig.3 Eample of the alman filter application created with the attached Matlab cript alman_vm. The true alue are green, the meaurement are the red dot and the alman filter output i the blue line. Although the reult i not perfect, it can be een that the alman filter output i much cloer to the real alue than the meaurement. Page 3
14 alman Filter Wim an Drongelen 5. alman Filter: Notation (See Brown and Hwang (997, Section 5.5 ( (5.5.7 z (5.5.8 (5.5. ( (5.5.3 (5.5.5 w 6. alman Filter to Etimate Model Parameter (See Brown and Hwang (997, p. 5: Augmented Vector. The ector-matri erion of the alman filter can etimate a erie of ariable but can alo be ued to etimate model parameter. Mot of the time, the parameter of the model i a contant or change ery lowly o that it can be conidered a contant. In thi cae, one treat the parameter to etimate a a contant with noie, jut a we did with in Equation (5.5.. The noie component allow the algorithm of the alman filter to find the bet fit of the parameter. In addition, ince we don t meaure the parameter (mot liely becaue we cannot meaure it, we treat it a a hidden ariable, i.e. it i part of the model of the tate, but it doen t how up in the meaurement z. Note that and z are ector here, and that contain the ariable a well a the parameter we want to etimate, i.e. i augmented with the parameter. Page 4
15 alman Filter Wim an Drongelen Appendi : Matlab Script that Perform alman Filtering % alman_vm % % Eample uing a alman filter % to etimate the membrane potential % of a neuron % (Algorithm in't optimized % % WD 03 clear cloe all % Parameter N=000; % number of meaurement Vm=-70; % the membrane potential (Vm alue w=.^; % ariance proce noie =^; % meaurement noie % Initial Etimate _apriori(=vm+90; % firt mi-etimate of Vm % Thi i the a priori meaurement _apriori(=.; % a priori etimate of the error; here ariance =. % create a imulated meaurement ector % for i=:n; tru(i=vm+randn*w; z(i=tru(i+randn*; end; % Perform the alman filter % % Note: Malab indice tart at, and not % at 0 a in mot tetboo deriation % Equation are numbered a in the Handout and they % follow the numbering in Brown and Hwang (997 % Introduction to Random Signal and Applied alman % Filtering, Wiley & Son, New Yor for i=:n; % tep : Blending of Prediction and Meaurement % Compute blending factor (i (i=_apriori(i/(_apriori(i+; % Eq (5.5.7 % Update Etimate uing the meaurement % thi i the a poteriori etimate _apoteriori(i=_apriori(i+(i*(z(i-_apriori(i; % Eq (5.5.8 % Update the error etimate [Note that there % are eeral ariant for thi procedure; % here we ue the implet epreion _apoteriori(i=_apriori(i*(-(i; % Eq (5.5. % tep : Project Etimate for the net Step _apriori(i+=_apoteriori(i; % Eq (5.5.3 _apriori(i+=_apoteriori(i+w; % Eq (5.5.5 end; % plot the reult figure;hold; plot(z,'r.'; plot(tru,'g'; plot(_apoteriori ai([ N -00 0]; label ('Time (AU' ylabel ('Membrane Potential (mv' title ('alman Filter Application: true alue (green; meaurement (red.; alman Filter Output (blue' Page 5
16 alman Filter Wim an Drongelen Page 6 Appendi : Detail of the Step between Equation (5.5.0 and (5.5. Thi Appendi gie the detail of the tep between equation (5.5.0 and (5.5.. For conenience, we repeat the equation. E (5.5.0 We can epand thi epreion and tae the Epectation. If we epand the quared function, we get three term further ealuated in (-(3 below. ( The firt term can be rewritten uing Equation (5.5.7, i.e.: E ( The econd term E E The nd term in between the curly bracet in the aboe epreion, will anih when taing the Epectation becaue i the a priori etimation error which i uncorrelated with meaurement noie. Thu, uing equation (5.5.7 again, we can implify E (3 The third term i E. Firt we focu on the epreion in between the curly bracet firt and we get
17 alman Filter Wim an Drongelen Page 7 ( ( When we tae Epectation, the firt term of the implified epreion will anih (why?, o we get the following reult: E If we now collect all term from (-(3, we can rewrite Eq (5.5.0 a Thi i uually written a: (, (5.5. giing u the reult in equation (5.5.
18 alman Filter Wim an Drongelen Reference Brown R.G., Hwang P.Y.C. (997 Introduction to Random Signal and Applied alman Filtering. John Wiley & Son, New Yor, NY. Maybec PS (98 Stochatic Model, Etimation, and Control, Vol. 4, Academic Pre, New Yor. Schiff S.J. (0 Neural Control Engineering: The Emerging Interection between Control Theory and Neurocience. MIT Pre, Cambridge, MA. Drongelen W an (007 Signal Proceing for Neurocientit: An Introduction to the Analyi of Phyiological Signal, Academic Pre, Eleier, Amterdam Welch G, Bihop G An Introduction to the alman Filter, Unierity of North Carolina or a more complete tet at Page 8
19 alman Filter Wim an Drongelen HOMEWOR In thi quetion, the Equation are numbered a in the Handout alman Filter. Gie the epreion for etimate m n at the n th meaurement, uing a recurie approach a in Eq (3-(5 In thi quetion, the Equation are numbered a in the Handout alman Filter. Why doe (in the alman data fuion adding a meaurement alway reult in a decreae of the uncertainty (=ariance of the etimate? Would thi till be true if or wa infinite (i.e. total uncertainty? Hint: ue Eq (7. 3 In thi quetion, the Equation are numbered a in the Handout alman Filter. Write the following 3 rd order ODE in the form of a tate ector and matri operator b c d 0. Now repeat thi for b c d e. Gie the detail of the procedure, i.e. define the tate and matri A (ee Equation (8 (. 4 We hae a erie of meaurement y n and ytem tate n. We want to lin both uing a imple linear model: y n = a n. Ue the MMSE method to find an optimal etimate for a. Comment on how thi reult relate to linear regreion. 5 In thi quetion, unle tated otherwie, the Equation are numbered a in the Handout alman Filter. a. Show that Eq (6 and (7 are the ame a the alman approach to fuion of data. y y Hint : Combine Eq (5.5.8 and (5.5.7; add reult and rearrange the term a in Eq (6. Hint : Combine Eq (5.5. and (5.5.7; rearrange Eq (7 a and compare the reult. to the Page 9
20 alman Filter Wim an Drongelen b. Dicu the difference of combining ariance (noie between equation (7 in thi handout and Equation 3.5 in Van Drongelen (007. Page 0
If Y is normally Distributed, then and 2 Y Y 10. σ σ
ull Hypothei Significance Teting V. APS 50 Lecture ote. B. Dudek. ot for General Ditribution. Cla Member Uage Only. Chi-Square and F-Ditribution, and Diperion Tet Recall from Chapter 4 material on: ( )
More informationA Full-Newton Step Primal-Dual Interior Point Algorithm for Linear Complementarity Problems *
ISSN 76-7659, England, UK Journal of Information and Computing Science Vol 5, No,, pp 35-33 A Full-Newton Step Primal-Dual Interior Point Algorithm for Linear Complementarity Problem * Lipu Zhang and Yinghong
More informationSocial Studies 201 Notes for November 14, 2003
1 Social Studie 201 Note for November 14, 2003 Etimation of a mean, mall ample ize Section 8.4, p. 501. When a reearcher ha only a mall ample ize available, the central limit theorem doe not apply to the
More informationSocial Studies 201 Notes for March 18, 2005
1 Social Studie 201 Note for March 18, 2005 Etimation of a mean, mall ample ize Section 8.4, p. 501. When a reearcher ha only a mall ample ize available, the central limit theorem doe not apply to the
More informationChapter 2 Sampling and Quantization. In order to investigate sampling and quantization, the difference between analog
Chapter Sampling and Quantization.1 Analog and Digital Signal In order to invetigate ampling and quantization, the difference between analog and digital ignal mut be undertood. Analog ignal conit of continuou
More informationFactor Analysis with Poisson Output
Factor Analyi with Poion Output Gopal Santhanam Byron Yu Krihna V. Shenoy, Department of Electrical Engineering, Neurocience Program Stanford Univerity Stanford, CA 94305, USA {gopal,byronyu,henoy}@tanford.edu
More informationLinear Motion, Speed & Velocity
Add Important Linear Motion, Speed & Velocity Page: 136 Linear Motion, Speed & Velocity NGSS Standard: N/A MA Curriculum Framework (006): 1.1, 1. AP Phyic 1 Learning Objective: 3.A.1.1, 3.A.1.3 Knowledge/Undertanding
More informationPhysics 741 Graduate Quantum Mechanics 1 Solutions to Final Exam, Fall 2014
Phyic 7 Graduate Quantum Mechanic Solution to inal Eam all 0 Each quetion i worth 5 point with point for each part marked eparately Some poibly ueful formula appear at the end of the tet In four dimenion
More informationClustering Methods without Given Number of Clusters
Clutering Method without Given Number of Cluter Peng Xu, Fei Liu Introduction A we now, mean method i a very effective algorithm of clutering. It mot powerful feature i the calability and implicity. However,
More informationControl Systems Analysis and Design by the Root-Locus Method
6 Control Sytem Analyi and Deign by the Root-Locu Method 6 1 INTRODUCTION The baic characteritic of the tranient repone of a cloed-loop ytem i cloely related to the location of the cloed-loop pole. If
More informationComparing Means: t-tests for Two Independent Samples
Comparing ean: t-tet for Two Independent Sample Independent-eaure Deign t-tet for Two Independent Sample Allow reearcher to evaluate the mean difference between two population uing data from two eparate
More informationSource slideplayer.com/fundamentals of Analytical Chemistry, F.J. Holler, S.R.Crouch. Chapter 6: Random Errors in Chemical Analysis
Source lideplayer.com/fundamental of Analytical Chemitry, F.J. Holler, S.R.Crouch Chapter 6: Random Error in Chemical Analyi Random error are preent in every meaurement no matter how careful the experimenter.
More informationA FUNCTIONAL BAYESIAN METHOD FOR THE SOLUTION OF INVERSE PROBLEMS WITH SPATIO-TEMPORAL PARAMETERS AUTHORS: CORRESPONDENCE: ABSTRACT
A FUNCTIONAL BAYESIAN METHOD FOR THE SOLUTION OF INVERSE PROBLEMS WITH SPATIO-TEMPORAL PARAMETERS AUTHORS: Zenon Medina-Cetina International Centre for Geohazard / Norwegian Geotechnical Intitute Roger
More informationDyadic Green s Function
EECS 730 Winter 2009 c K. Sarabandi Dyadic Green Function A mentioned earlier the application of dyadic analyi facilitate imple manipulation of field ector calculation. The ource of electromagnetic field
More informationCHAPTER 8 OBSERVER BASED REDUCED ORDER CONTROLLER DESIGN FOR LARGE SCALE LINEAR DISCRETE-TIME CONTROL SYSTEMS
CHAPTER 8 OBSERVER BASED REDUCED ORDER CONTROLLER DESIGN FOR LARGE SCALE LINEAR DISCRETE-TIME CONTROL SYSTEMS 8.1 INTRODUCTION 8.2 REDUCED ORDER MODEL DESIGN FOR LINEAR DISCRETE-TIME CONTROL SYSTEMS 8.3
More informationDIFFERENTIAL EQUATIONS
DIFFERENTIAL EQUATIONS Laplace Tranform Paul Dawkin Table of Content Preface... Laplace Tranform... Introduction... The Definition... 5 Laplace Tranform... 9 Invere Laplace Tranform... Step Function...4
More informationAdaptive Sampling Algorithms for Minimizing the Variance of Parameter Estimates in the Bidirectional Surface Reflectance Model
Adaptie Sampling Algorithm for Minimizing the Variance of Parameter Etimate in the Bidirectional Surface Reflectance Model Or Intelligent Intrument on Robotic Helicopter A Technical Report Preented to
More informationCorrection for Simple System Example and Notes on Laplace Transforms / Deviation Variables ECHE 550 Fall 2002
Correction for Simple Sytem Example and Note on Laplace Tranform / Deviation Variable ECHE 55 Fall 22 Conider a tank draining from an initial height of h o at time t =. With no flow into the tank (F in
More information7.2 INVERSE TRANSFORMS AND TRANSFORMS OF DERIVATIVES 281
72 INVERSE TRANSFORMS AND TRANSFORMS OF DERIVATIVES 28 and i 2 Show how Euler formula (page 33) can then be ued to deduce the reult a ( a) 2 b 2 {e at co bt} {e at in bt} b ( a) 2 b 2 5 Under what condition
More informationLecture 8: Period Finding: Simon s Problem over Z N
Quantum Computation (CMU 8-859BB, Fall 205) Lecture 8: Period Finding: Simon Problem over Z October 5, 205 Lecturer: John Wright Scribe: icola Rech Problem A mentioned previouly, period finding i a rephraing
More informationChapter 5 Consistency, Zero Stability, and the Dahlquist Equivalence Theorem
Chapter 5 Conitency, Zero Stability, and the Dahlquit Equivalence Theorem In Chapter 2 we dicued convergence of numerical method and gave an experimental method for finding the rate of convergence (aka,
More informationZbigniew Dziong Department of Electrical Engineering, Ecole de Technologie Superieure 1100 Notre-Dame Street West, Montreal, Quebec, Canada H3C 1k3
Capacity Allocation in Serice Oerlay Network - Maximum Profit Minimum Cot Formulation Ngok Lam Department of Electrical and Computer Engineering, McGill Unierity 3480 Unierity Street, Montreal, Quebec,
More informationp. (The electron is a point particle with radius r = 0.)
- pin ½ Recall that in the H-atom olution, we howed that the fact that the wavefunction Ψ(r) i ingle-valued require that the angular momentum quantum nbr be integer: l = 0,,.. However, operator algebra
More informationDIFFERENTIAL EQUATIONS Laplace Transforms. Paul Dawkins
DIFFERENTIAL EQUATIONS Laplace Tranform Paul Dawkin Table of Content Preface... Laplace Tranform... Introduction... The Definition... 5 Laplace Tranform... 9 Invere Laplace Tranform... Step Function...
More informationCoupled out of plane vibrations of spiral beams
5th AIAA/ASME/ASCE/AHS/ASC Structure, Structural Dynamic, and Material Conference7th 4-7 May 9, Palm Spring, California AIAA 9-469 Coupled out of plane ibration of piral beam M.A. Karami, B. Yardimoglu
More informationPosition. If the particle is at point (x, y, z) on the curved path s shown in Fig a,then its location is defined by the position vector
34 C HAPTER 1 KINEMATICS OF A PARTICLE 1 1.5 Curvilinear Motion: Rectangular Component Occaionall the motion of a particle can bet be decribed along a path that can be epreed in term of it,, coordinate.
More informationEigenvalues and eigenvectors
Eigenvalue and eigenvector Defining and computing uggeted problem olution For each matri give below, find eigenvalue and eigenvector. Give a bai and the dimenion of the eigenpace for each eigenvalue. P:
More informationBogoliubov Transformation in Classical Mechanics
Bogoliubov Tranformation in Claical Mechanic Canonical Tranformation Suppoe we have a et of complex canonical variable, {a j }, and would like to conider another et of variable, {b }, b b ({a j }). How
More informationSuggested Answers To Exercises. estimates variability in a sampling distribution of random means. About 68% of means fall
Beyond Significance Teting ( nd Edition), Rex B. Kline Suggeted Anwer To Exercie Chapter. The tatitic meaure variability among core at the cae level. In a normal ditribution, about 68% of the core fall
More informationNonlinear Single-Particle Dynamics in High Energy Accelerators
Nonlinear Single-Particle Dynamic in High Energy Accelerator Part 6: Canonical Perturbation Theory Nonlinear Single-Particle Dynamic in High Energy Accelerator Thi coure conit of eight lecture: 1. Introduction
More informationAlternate Dispersion Measures in Replicated Factorial Experiments
Alternate Diperion Meaure in Replicated Factorial Experiment Neal A. Mackertich The Raytheon Company, Sudbury MA 02421 Jame C. Benneyan Northeatern Univerity, Boton MA 02115 Peter D. Krau The Raytheon
More informationChapter 2 Homework Solution P2.2-1, 2, 5 P2.4-1, 3, 5, 6, 7 P2.5-1, 3, 5 P2.6-2, 5 P2.7-1, 4 P2.8-1 P2.9-1
Chapter Homework Solution P.-1,, 5 P.4-1, 3, 5, 6, 7 P.5-1, 3, 5 P.6-, 5 P.7-1, 4 P.8-1 P.9-1 P.-1 An element ha oltage and current i a hown in Figure P.-1a. Value of the current i and correponding oltage
More informationAP Physics Charge Wrap up
AP Phyic Charge Wrap up Quite a few complicated euation for you to play with in thi unit. Here them babie i: F 1 4 0 1 r Thi i good old Coulomb law. You ue it to calculate the force exerted 1 by two charge
More information[Saxena, 2(9): September, 2013] ISSN: Impact Factor: INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY
[Saena, (9): September, 0] ISSN: 77-9655 Impact Factor:.85 IJESRT INTERNATIONAL JOURNAL OF ENGINEERING SCIENCES & RESEARCH TECHNOLOGY Contant Stre Accelerated Life Teting Uing Rayleigh Geometric Proce
More informationLearning Multiplicative Interactions
CSC2535 2011 Lecture 6a Learning Multiplicative Interaction Geoffrey Hinton Two different meaning of multiplicative If we take two denity model and multiply together their probability ditribution at each
More informationDimensional Analysis A Tool for Guiding Mathematical Calculations
Dimenional Analyi A Tool for Guiding Mathematical Calculation Dougla A. Kerr Iue 1 February 6, 2010 ABSTRACT AND INTRODUCTION In converting quantitie from one unit to another, we may know the applicable
More informationFermi Distribution Function. n(e) T = 0 T > 0 E F
LECTURE 3 Maxwell{Boltzmann, Fermi, and Boe Statitic Suppoe we have a ga of N identical point particle in a box ofvolume V. When we ay \ga", we mean that the particle are not interacting with one another.
More informationMINITAB Stat Lab 3
MINITAB Stat 20080 Lab 3. Statitical Inference In the previou lab we explained how to make prediction from a imple linear regreion model and alo examined the relationhip between the repone and predictor
More informationDYNAMIC MODELS FOR CONTROLLER DESIGN
DYNAMIC MODELS FOR CONTROLLER DESIGN M.T. Tham (996,999) Dept. of Chemical and Proce Engineering Newcatle upon Tyne, NE 7RU, UK.. INTRODUCTION The problem of deigning a good control ytem i baically that
More informationChapter 4. The Laplace Transform Method
Chapter 4. The Laplace Tranform Method The Laplace Tranform i a tranformation, meaning that it change a function into a new function. Actually, it i a linear tranformation, becaue it convert a linear combination
More informationμ + = σ = D 4 σ = D 3 σ = σ = All units in parts (a) and (b) are in V. (1) x chart: Center = μ = 0.75 UCL =
Our online Tutor are available 4*7 to provide Help with Proce control ytem Homework/Aignment or a long term Graduate/Undergraduate Proce control ytem Project. Our Tutor being experienced and proficient
More informationSuggestions - Problem Set (a) Show the discriminant condition (1) takes the form. ln ln, # # R R
Suggetion - Problem Set 3 4.2 (a) Show the dicriminant condition (1) take the form x D Ð.. Ñ. D.. D. ln ln, a deired. We then replace the quantitie. 3ß D3 by their etimate to get the proper form for thi
More informationUNIT 15 RELIABILITY EVALUATION OF k-out-of-n AND STANDBY SYSTEMS
UNIT 1 RELIABILITY EVALUATION OF k-out-of-n AND STANDBY SYSTEMS Structure 1.1 Introduction Objective 1.2 Redundancy 1.3 Reliability of k-out-of-n Sytem 1.4 Reliability of Standby Sytem 1. Summary 1.6 Solution/Anwer
More informationGiven the following circuit with unknown initial capacitor voltage v(0): X(s) Immediately, we know that the transfer function H(s) is
EE 4G Note: Chapter 6 Intructor: Cheung More about ZSR and ZIR. Finding unknown initial condition: Given the following circuit with unknown initial capacitor voltage v0: F v0/ / Input xt 0Ω Output yt -
More information1.1 Speed and Velocity in One and Two Dimensions
1.1 Speed and Velocity in One and Two Dienion The tudy of otion i called kineatic. Phyic Tool box Scalar quantity ha agnitude but no direction,. Vector ha both agnitude and direction,. Aerage peed i total
More informationMassachusetts Institute of Technology Dynamics and Control II
I E Maachuett Intitute of Technology Department of Mechanical Engineering 2.004 Dynamic and Control II Laboratory Seion 5: Elimination of Steady-State Error Uing Integral Control Action 1 Laboratory Objective:
More informationFourier-Conjugate Models in the Corpuscular-Wave Dualism Concept
International Journal of Adanced Reearch in Phyical Science (IJARPS) Volume, Iue 0, October 05, PP 6-30 ISSN 349-7874 (Print) & ISSN 349-788 (Online) www.arcjournal.org Fourier-Conjugate Model in the Corpucular-Wae
More informationGNSS Solutions: What is the carrier phase measurement? How is it generated in GNSS receivers? Simply put, the carrier phase
GNSS Solution: Carrier phae and it meaurement for GNSS GNSS Solution i a regular column featuring quetion and anwer about technical apect of GNSS. Reader are invited to end their quetion to the columnit,
More informationThe continuous time random walk (CTRW) was introduced by Montroll and Weiss 1.
1 I. CONTINUOUS TIME RANDOM WALK The continuou time random walk (CTRW) wa introduced by Montroll and Wei 1. Unlike dicrete time random walk treated o far, in the CTRW the number of jump n made by the walker
More informationLaplace Transformation
Univerity of Technology Electromechanical Department Energy Branch Advance Mathematic Laplace Tranformation nd Cla Lecture 6 Page of 7 Laplace Tranformation Definition Suppoe that f(t) i a piecewie continuou
More informationLecture 4 Topic 3: General linear models (GLMs), the fundamentals of the analysis of variance (ANOVA), and completely randomized designs (CRDs)
Lecture 4 Topic 3: General linear model (GLM), the fundamental of the analyi of variance (ANOVA), and completely randomized deign (CRD) The general linear model One population: An obervation i explained
More informationA Constraint Propagation Algorithm for Determining the Stability Margin. The paper addresses the stability margin assessment for linear systems
A Contraint Propagation Algorithm for Determining the Stability Margin of Linear Parameter Circuit and Sytem Lubomir Kolev and Simona Filipova-Petrakieva Abtract The paper addree the tability margin aement
More informationECE 3510 Root Locus Design Examples. PI To eliminate steady-state error (for constant inputs) & perfect rejection of constant disturbances
ECE 350 Root Locu Deign Example Recall the imple crude ervo from lab G( ) 0 6.64 53.78 σ = = 3 23.473 PI To eliminate teady-tate error (for contant input) & perfect reection of contant diturbance Note:
More informationEC381/MN308 Probability and Some Statistics. Lecture 7 - Outline. Chapter Cumulative Distribution Function (CDF) Continuous Random Variables
EC38/MN38 Probability and Some Statitic Yanni Pachalidi yannip@bu.edu, http://ionia.bu.edu/ Lecture 7 - Outline. Continuou Random Variable Dept. of Manufacturing Engineering Dept. of Electrical and Computer
More informationAdaptive Extended Kalman Filter for Ballistic Missile Tracking
World Academy of Science, Engineering and echnology Vol:, No:4, 7 Adaptive Etended Kalman Filter for Ballitic Miile racing Gaurav Kumar, Dharmbir Praad, Rudra Pratap Singh International Science Inde, Electrical
More informationStochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions
Stochatic Optimization with Inequality Contraint Uing Simultaneou Perturbation and Penalty Function I-Jeng Wang* and Jame C. Spall** The John Hopkin Univerity Applied Phyic Laboratory 11100 John Hopkin
More information11.5 MAP Estimator MAP avoids this Computational Problem!
.5 MAP timator ecall that the hit-or-mi cot function gave the MAP etimator it maimize the a oteriori PDF Q: Given that the MMS etimator i the mot natural one why would we conider the MAP etimator? A: If
More informationPreemptive scheduling on a small number of hierarchical machines
Available online at www.ciencedirect.com Information and Computation 06 (008) 60 619 www.elevier.com/locate/ic Preemptive cheduling on a mall number of hierarchical machine György Dóa a, Leah Eptein b,
More informationonline learning Unit Workbook 4 RLC Transients
online learning Pearon BTC Higher National in lectrical and lectronic ngineering (QCF) Unit 5: lectrical & lectronic Principle Unit Workbook 4 in a erie of 4 for thi unit Learning Outcome: RLC Tranient
More informationSMALL-SIGNAL STABILITY ASSESSMENT OF THE EUROPEAN POWER SYSTEM BASED ON ADVANCED NEURAL NETWORK METHOD
SMALL-SIGNAL STABILITY ASSESSMENT OF THE EUROPEAN POWER SYSTEM BASED ON ADVANCED NEURAL NETWORK METHOD S.P. Teeuwen, I. Erlich U. Bachmann Univerity of Duiburg, Germany Department of Electrical Power Sytem
More informationMoment of Inertia of an Equilateral Triangle with Pivot at one Vertex
oment of nertia of an Equilateral Triangle with Pivot at one Vertex There are two wa (at leat) to derive the expreion f an equilateral triangle that i rotated about one vertex, and ll how ou both here.
More informationIII.9. THE HYSTERESIS CYCLE OF FERROELECTRIC SUBSTANCES
III.9. THE HYSTERESIS CYCLE OF FERROELECTRIC SBSTANCES. Work purpoe The analyi of the behaviour of a ferroelectric ubtance placed in an eternal electric field; the dependence of the electrical polariation
More informationIntroduction to Laplace Transform Techniques in Circuit Analysis
Unit 6 Introduction to Laplace Tranform Technique in Circuit Analyi In thi unit we conider the application of Laplace Tranform to circuit analyi. A relevant dicuion of the one-ided Laplace tranform i found
More informationTo describe a queuing system, an input process and an output process has to be specified.
5. Queue (aiting Line) Queuing terminology Input Service Output To decribe a ueuing ytem, an input proce and an output proce ha to be pecified. For example ituation input proce output proce Bank Cutomer
More informationColorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.
Proeor William Ho Dept o Electrical Engineering &Computer Science http://inide.mine.edu/~who/ Uncertaint Uncertaint Let a that we have computed a reult (uch a poe o an object), rom image data How do we
More informationV = 4 3 πr3. d dt V = d ( 4 dv dt. = 4 3 π d dt r3 dv π 3r2 dv. dt = 4πr 2 dr
0.1 Related Rate In many phyical ituation we have a relationhip between multiple quantitie, and we know the rate at which one of the quantitie i changing. Oftentime we can ue thi relationhip a a convenient
More informationLecture 7: Testing Distributions
CSE 5: Sublinear (and Streaming) Algorithm Spring 014 Lecture 7: Teting Ditribution April 1, 014 Lecturer: Paul Beame Scribe: Paul Beame 1 Teting Uniformity of Ditribution We return today to property teting
More information84 ZHANG Jing-Shang Vol. 39 of which would emit 5 He rather than 3 He. 5 He i untable and eparated into n + pontaneouly, which can alo be treated a if
Commun. Theor. Phy. (Beijing, China) 39 (003) pp. 83{88 c International Academic Publiher Vol. 39, No. 1, January 15, 003 Theoretical Analyi of Neutron Double-Dierential Cro Section of n+ 11 B at 14. MeV
More informationDesign By Emulation (Indirect Method)
Deign By Emulation (Indirect Method he baic trategy here i, that Given a continuou tranfer function, it i required to find the bet dicrete equivalent uch that the ignal produced by paing an input ignal
More informationLecture 9: Shor s Algorithm
Quantum Computation (CMU 8-859BB, Fall 05) Lecture 9: Shor Algorithm October 7, 05 Lecturer: Ryan O Donnell Scribe: Sidhanth Mohanty Overview Let u recall the period finding problem that wa et up a a function
More informationStochastic Neoclassical Growth Model
Stochatic Neoclaical Growth Model Michael Bar May 22, 28 Content Introduction 2 2 Stochatic NGM 2 3 Productivity Proce 4 3. Mean........................................ 5 3.2 Variance......................................
More informationZ a>2 s 1n = X L - m. X L = m + Z a>2 s 1n X L = The decision rule for this one-tail test is
M09_BERE8380_12_OM_C09.QD 2/21/11 3:44 PM Page 1 9.6 The Power of a Tet 9.6 The Power of a Tet 1 Section 9.1 defined Type I and Type II error and their aociated rik. Recall that a repreent the probability
More informationEstimation of Temperature Rise in Stator Winding and Rotor Magnet of PMSM Based on EKF
2010 3rd International Conference on Computer and Electrical Engineering (ICCEE 2010) IPCSIT vol. 53 (2012) (2012) IACSIT Pre, Singapore DOI: 10.7763/IPCSIT.2012.V53.No.2.37 Etimation of Temperature Rie
More informationON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION. Xiaoqun Wang
Proceeding of the 2008 Winter Simulation Conference S. J. Maon, R. R. Hill, L. Mönch, O. Roe, T. Jefferon, J. W. Fowler ed. ON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION Xiaoqun Wang
More informationSingular perturbation theory
Singular perturbation theory Marc R. Rouel June 21, 2004 1 Introduction When we apply the teady-tate approximation (SSA) in chemical kinetic, we typically argue that ome of the intermediate are highly
More informationLecture 21. The Lovasz splitting-off lemma Topics in Combinatorial Optimization April 29th, 2004
18.997 Topic in Combinatorial Optimization April 29th, 2004 Lecture 21 Lecturer: Michel X. Goeman Scribe: Mohammad Mahdian 1 The Lovaz plitting-off lemma Lovaz plitting-off lemma tate the following. Theorem
More informationNotes on Phase Space Fall 2007, Physics 233B, Hitoshi Murayama
Note on Phae Space Fall 007, Phyic 33B, Hitohi Murayama Two-Body Phae Space The two-body phae i the bai of computing higher body phae pace. We compute it in the ret frame of the two-body ytem, P p + p
More informationMolecular Dynamics Simulations of Nonequilibrium Effects Associated with Thermally Activated Exothermic Reactions
Original Paper orma, 5, 9 7, Molecular Dynamic Simulation of Nonequilibrium Effect ociated with Thermally ctivated Exothermic Reaction Jerzy GORECKI and Joanna Natalia GORECK Intitute of Phyical Chemitry,
More informationCodes Correcting Two Deletions
1 Code Correcting Two Deletion Ryan Gabry and Frederic Sala Spawar Sytem Center Univerity of California, Lo Angele ryan.gabry@navy.mil fredala@ucla.edu Abtract In thi work, we invetigate the problem of
More information5.5 Application of Frequency Response: Signal Filters
44 Dynamic Sytem Second order lowpa filter having tranfer function H()=H ()H () u H () H () y Firt order lowpa filter Figure 5.5: Contruction of a econd order low-pa filter by combining two firt order
More informationS_LOOP: SINGLE-LOOP FEEDBACK CONTROL SYSTEM ANALYSIS
S_LOOP: SINGLE-LOOP FEEDBACK CONTROL SYSTEM ANALYSIS by Michelle Gretzinger, Daniel Zyngier and Thoma Marlin INTRODUCTION One of the challenge to the engineer learning proce control i relating theoretical
More informationUnified Correlation between SPT-N and Shear Wave Velocity for all Soil Types
6 th International Conference on Earthquake Geotechnical Engineering 1-4 ovember 15 Chritchurch, ew Zealand Unified Correlation between SPT- and Shear Wave Velocity for all Soil Type C.-C. Tai 1 and T.
More informationRandom vs. Deterministic Deployment of Sensors in the Presence of Failures and Placement Errors
Random v. Determinitic Deployment of Senor in the Preence of Failure and Placement Error Paul Baliter Univerity of Memphi pbalitr@memphi.edu Santoh Kumar Univerity of Memphi antoh.kumar@memphi.edu Abtract
More informationSIMPLE LINEAR REGRESSION
SIMPLE LINEAR REGRESSION In linear regreion, we conider the frequency ditribution of one variable (Y) at each of everal level of a econd variable (). Y i known a the dependent variable. The variable for
More informationCHAPTER 4 DESIGN OF STATE FEEDBACK CONTROLLERS AND STATE OBSERVERS USING REDUCED ORDER MODEL
98 CHAPTER DESIGN OF STATE FEEDBACK CONTROLLERS AND STATE OBSERVERS USING REDUCED ORDER MODEL INTRODUCTION The deign of ytem uing tate pace model for the deign i called a modern control deign and it i
More informationGain and Phase Margins Based Delay Dependent Stability Analysis of Two- Area LFC System with Communication Delays
Gain and Phae Margin Baed Delay Dependent Stability Analyi of Two- Area LFC Sytem with Communication Delay Şahin Sönmez and Saffet Ayaun Department of Electrical Engineering, Niğde Ömer Halidemir Univerity,
More informationDepartment of Mechanical Engineering Massachusetts Institute of Technology Modeling, Dynamics and Control III Spring 2002
Department of Mechanical Engineering Maachuett Intitute of Technology 2.010 Modeling, Dynamic and Control III Spring 2002 SOLUTIONS: Problem Set # 10 Problem 1 Etimating tranfer function from Bode Plot.
More informationInference for Two Stage Cluster Sampling: Equal SSU per PSU. Projections of SSU Random Variables on Each SSU selection.
Inference for Two Stage Cluter Sampling: Equal SSU per PSU Projection of SSU andom Variable on Eac SSU election By Ed Stanek Introduction We review etimating equation for PSU mean in a two tage cluter
More informationReal Sources (Secondary Sources) Phantom Source (Primary source) LS P. h rl. h rr. h ll. h lr. h pl. h pr
Ecient frequency domain ltered-x realization of phantom ource iet C.W. ommen, Ronald M. Aart, Alexander W.M. Mathijen, John Gara, Haiyan He Abtract A phantom ound ource i a virtual ound image which can
More informationFactor Sensitivity Analysis with Neural Network Simulation based on Perturbation System
1402 JOURNAL OF COMPUTERS, VOL. 6, NO. 7, JULY 2011 Factor Senitivity Analyi with Neural Network Simulation baed on Perturbation Sytem Runbo Bai College of Water-Conervancy and Civil Engineering, Shandong
More information1. The F-test for Equality of Two Variances
. The F-tet for Equality of Two Variance Previouly we've learned how to tet whether two population mean are equal, uing data from two independent ample. We can alo tet whether two population variance are
More informationTP A.30 The effect of cue tip offset, cue weight, and cue speed on cue ball speed and spin
technical proof TP A.30 The effect of cue tip offet, cue weight, and cue peed on cue all peed and pin technical proof upporting: The Illutrated Principle of Pool and Billiard http://illiard.colotate.edu
More informationEstimation of Peaked Densities Over the Interval [0,1] Using Two-Sided Power Distribution: Application to Lottery Experiments
MPRA Munich Peronal RePEc Archive Etimation of Peaed Denitie Over the Interval [0] Uing Two-Sided Power Ditribution: Application to Lottery Experiment Krzyztof Konte Artal Invetment 8. April 00 Online
More informationSTUDY OF THE INFLUENCE OF CONVECTIVE EFFECTS IN INCIDENT RADIATIVE HEAT FLUX DENSITY MEASUREMENT UNCERTAINTY
XIX IMEKO World Congre Fundamental and Applied Metrology September 6, 009, Libon, Portugal SUDY OF HE INFLUENCE OF CONVECIVE EFFECS IN INCIDEN RADIAIVE HEA FLUX DENSIY MEASUREMEN UNCERAINY L. Lage Martin,
More informationWhite Rose Research Online URL for this paper: Version: Accepted Version
Thi i a repoitory copy of Identification of nonlinear ytem with non-peritent excitation uing an iterative forward orthogonal leat quare regreion algorithm. White Roe Reearch Online URL for thi paper: http://eprint.whiteroe.ac.uk/107314/
More informationThermal Resistance Measurements and Thermal Transient Analysis of Power Chip Slug-Up and Slug-Down Mounted on HDI Substrate
Intl Journal of Microcircuit and Electronic Packaging Thermal Reitance Meaurement and Thermal Tranient Analyi of Power Chip Slug-Up and Slug-Down Mounted on HDI Subtrate Claudio Sartori Magneti Marelli
More informationRegression. What is regression? Linear Regression. Cal State Northridge Ψ320 Andrew Ainsworth PhD
Regreion Cal State Northridge Ψ30 Andrew Ainworth PhD What i regreion? How do we predict one variable from another? How doe one variable change a the other change? Caue and effect Linear Regreion A technique
More informationis defined in the half plane Re ( z ) >0 as follows.
0 Abolute Value of Dirichlet Eta Function. Dirichlet Eta Function.. Definition Dirichlet Eta Function ( z) i defined in the half plane Re( z ) >0 a follow. () z = r- r z Thi erie i analytically continued
More informationNOTE: The items d) and e) of Question 4 gave you bonus marks.
MAE 40 Linear ircuit Summer 2007 Final Solution NOTE: The item d) and e) of Quetion 4 gave you bonu mark. Quetion [Equivalent irciut] [4 mark] Find the equivalent impedance between terminal A and B in
More informationMath Skills. Scientific Notation. Uncertainty in Measurements. Appendix A5 SKILLS HANDBOOK
ppendix 5 Scientific Notation It i difficult to work with very large or very mall number when they are written in common decimal notation. Uually it i poible to accommodate uch number by changing the SI
More information