13.4 Scalar Kalman Filter
|
|
- Hester Allison
- 5 years ago
- Views:
Transcription
1 13.4 Scalar Kalma Filter Data Model o derive the Kalma filter we eed the data model: a 1 + u < State quatio > + w < Obervatio quatio > Aumptio 1. u i zero mea Gauia, White, u } σ. w i zero mea Gauia, White, 3. he iitial tate i 1 N ( µ, σ ) { u { w } σ 4. u, w, ad 1 are all idepedet of each other Ca vary with time o implify the derivatio: let µ 0 (we ll accout for thi later) 1
2 Goal ad wo Propertie Goal: Recurively compute ˆ Notatio: X i et of all obervatio i a igle vector-obervatio { 0, 1,, } 0, 1,, X wo Propertie We Need 1. For the joitly Gauia cae, the MMS etimator of zero mea baed o two ucorrelated data vector 1 & i (ee p. 350 of tet) ˆ θ { θ, } { θ } + { θ } 1 1. If θ θ 1 + θ the the MS etimator i ˆ θ { θ } { θ1 + θ } { θ1 } + { θ } (a reult of the liearity of {.} operator)
3 3 Derivatio of Scalar Kalma Filter Iovatio: 1 ˆ Recall from Sectio 1.6 MMS etimate of give X 1 (predictio!!) By MMS Orthogoality Priciple { } 0 X 1 that i ucorrelated with the previou data i part of Now ote: X i equivalet to { } 1, X Why? Becaue we ca get get X from it a follow: 1 1 X X X %"$"# 1 ˆ k k k a
4 What have we doe o far? Have how that X { X 1, } ucorrelated Have plit curret data et ito part: 1. Old data. Ucorrelated part of ew data ( jut the ew fact ) { X } { 1, } X Becaue of thi So what??!! Well ca ow eploit Property #1!! { X 1 } { } ˆ + %"" $ ""# 1 predictio of baed o pat data %"$"# " Update baed o iovatio part of ew data Now eed to look more cloely at each of thee! 4
5 Look at Predictio erm: 1 Ue the Dyamical Model it i the key to predictio becaue it tell u how the tate hould progre from itat to itat 1 Now ue Property #: 1 { X 1 } { a 1 + u X 1 } { 1 X 1 } + { u X 1 } a %""" $ """# 1 %"" $ """ # { u } 0 By Defiitio 1 a 1 By idepedece of u & X-1 See bottom of p. 433 i tetbook. he Dyamical Model provide the update from etimate to predictio!! 5
6 Look at Update erm: { } Ue the form for the Gauia MMS etimate: { } { } { } %" " $ ""# So k ( ˆ 1 ) { } k ˆ 1 Predictio Show Up Agai!!! Put thee Reult ogether: %"$"# a 1 + k by Prop. # + wˆ %"$"# %"$"# + 0 Becaue w i idep. of {0,, -1} hi i the Kalma Filter How to get the gai? 6
7 Look at the Gai erm: Need two propertie A. { ( )} {( )( )} B. Aide <,y> <+z,y> for ay z y { w ( )} proof Liear combo of pat data thu w/ iovatio 0 ˆ he iovatio w i the meauremet oie ad by aumptio i idep. of the dyamical drivig oie u ad -1 I other word: w i idep. of everythig dyamical So {w} 0 i baed o pat data, which iclude {w0,, w-1}, ad ice the meauremet oie ha idep. ample we get w 7
8 So we tart with the gai a defied above: k { } { } { } { } { } + w { } { + w } + w { } { } + { w } + σ + { w } { } M MS whe i etimated by 1-tep predictio Plug i for iovatio (!) Ue Prop. A i um. Ue + w i deomiator 0 by Prop. B (!!) Ue + w i umerator pad 8
9 hi give a form for the gai: k σ M + M 1 1 hi balace the quality of the meaured data agait the predicted tate I the Kalma filter the predictio act like the prior iformatio about the tate at time before we oberve the data at time 9
10 Look at the Predictio MS erm: But ow we eed to kow how to fid M 1!!! M 1 { } 1 { } a 1 + u a 1 Ue dyamical model & eploit form for predictio { ( ) } a u Cro-term 0 t. rror at previou time M a M 1 + σ u Why are the cro-term zero? wo part: 1. 1 deped o {u0 u 1, -1}, which are idep. of u. 1 deped o {0+w0 1+w 1}, which are idep. of u 10
11 Look at a Recurio for MS erm: M By def.: M { } k ( 1 ) { } Now we ll get three term: {A }, {AB}, {B } { } A M erm A { AB} k { } k M { } { } B k k De. of k by defiitio from (!!) i um. k from (!) i de. k erm B Recall: k k Num. of k k M σ M + M 11
12 So thi give M M k M + k M ( 1 k ) M 1 M Puttig all of thee reult together give ome very imple equatio to iterate Called the Kalma Filter We jut derived the form for Scalar State & Scalar Obervatio. O the et three chart we give the Kalma Filter equatio for: Scalar State & Scalar Obervatio Vector State & Scalar Obervatio Vector State & Vector Obervatio 1
13 Kalma Filter: Scalar State & Scalar Obervatio State Model: a 1 + u u WGN; WSS; N(0, σ u ) Obervatio Model: + w w WGN; N(0, σ ) Varie with Iitializatio: 1 M 1 { 1} µ {( 1} 1) } σ Mut Mut Kow: Kow: µ,, σ,, a, a, σ σ u, u, σ σ Predictio: a 1 Pred. MS: Kalma Gai: M a M 1 + σ u M K + M σ Update: ( 1 ) + K t. MS: ( 1 K ) M 1 M 13
14 Kalma Filter: Vector State & Scalar Obervatio State Model: A 1 + Bu p 1; A p p; B p r; u N ( 0, Q) r 1 Obervatio Model: h + w ; h p 1 w WGN; N(0, σ ) Iitializatio: Predictio: Pred. MS (p p): Kalma Gai (p 1): Update: t. MS (p p): : 1 M 1 { 1} µ Mut Mut Kow: Kow: µ,, C,, A, A, B, B, h, h, Q, Q, σ {( 1} 1)( 1} 1) } C A 1 M 1 AM 1 A + K σ M h + h %" "" M $ " "" 1 h # 1 1 BQB + K ( h ˆ ) %"" $ ""# ˆ 1 %""" $ """" # : ( I K h ) M 1 M iovatio 14
15 Kalma Filter: Vector State & Vector Obervatio State Model: A 1 + Bu p 1; A p p; B p r; u N( 0, Q) r 1 Obervatio: H + w ; M 1; H M p; w N( 0, C ) M 1 Iitializatio: Predictio: Pred. MS (p p): Kalma Gai (p M): Update: 1 M 1 { 1} µ Mut Mut Kow: Kow: µ,, C,, A, A, B, B, H, H, Q, Q, C} C} {( 1} 1)( 1} 1) } C A 1 M 1 AM 1 A + K M H BQB C + H 1 %" M "" $ """ H # M M + K ( H ˆ ) %"" $ ""# ˆ 1 %""" $ """" # : iovatio 1 t. MS (p p): : M ( I K H ) M 15
16 Kalma Filter Block Diagram Obervatio Iovatio timated Drivig Noie timated State + Σ K Buˆ + Σ + ˆ 1 H 1 Az -1 Predicted Obervatio mbedded Obervatio Model Predicted State mbedded Dyamical Model Look a lot like Sequetial LS/MMS ecept it ha the mbedded Dyamical Model!!! 16
17 Overview of MMS timatio Aume Gauia Ge. MMS Squared Cot Fuctio θˆ { θ } Force Liear Ay PDF, Kow d Momet Joitly Gauia ˆ θ { θ} + CθC 1 ( { } ) LMMS Bayeia Liear Model θˆ µ 1 ( HC H + C ) ( ) θ + CθH θ w Hµ θ LMMS Liear Model Optimal Seq. Filter (No Dyamic) θˆ ˆ ˆ h θ θ 1 + k 1 Liear Seq. Filter (No Dyamic) Optimal Kalma Filter (w/ Dyamic) + K ( H A 1) Liear Kalma Filter (w/ Dyamic) 17
8.6 Order-Recursive LS s[n]
8.6 Order-Recurive LS [] Motivate ti idea wit Curve Fittig Give data: 0,,,..., - [0], [],..., [-] Wat to fit a polyomial to data.., but wic oe i te rigt model?! Cotat! Quadratic! Liear! Cubic, Etc. ry
More informationState space systems analysis
State pace ytem aalyi Repreetatio of a ytem i tate-pace (tate-pace model of a ytem To itroduce the tate pace formalim let u tart with a eample i which the ytem i dicuio i a imple electrical circuit with
More informationChapter 9. Key Ideas Hypothesis Test (Two Populations)
Chapter 9 Key Idea Hypothei Tet (Two Populatio) Sectio 9-: Overview I Chapter 8, dicuio cetered aroud hypothei tet for the proportio, mea, ad tadard deviatio/variace of a igle populatio. However, ofte
More informationM227 Chapter 9 Section 1 Testing Two Parameters: Means, Variances, Proportions
M7 Chapter 9 Sectio 1 OBJECTIVES Tet two mea with idepedet ample whe populatio variace are kow. Tet two variace with idepedet ample. Tet two mea with idepedet ample whe populatio variace are equal Tet
More informationLECTURE 13 SIMULTANEOUS EQUATIONS
NOVEMBER 5, 26 Demad-upply ytem LETURE 3 SIMULTNEOUS EQUTIONS I thi lecture, we dicu edogeeity problem that arie due to imultaeity, i.e. the left-had ide variable ad ome of the right-had ide variable are
More information11.5 MAP Estimator MAP avoids this Computational Problem!
.5 MAP timator ecall that the hit-or-mi cot function gave the MAP etimator it maimize the a oteriori PDF Q: Given that the MMS etimator i the mot natural one why would we conider the MAP etimator? A: If
More informationA Simplified Derivation of Scalar Kalman Filter using Bayesian Probability Theory
6th Iteratioal Workshop o Aalysis of Dyamic Measuremets Jue -3 0 Göteorg Swede A Simplified Derivatio of Scalar Kalma Filter usig Bayesia Proaility Theory Gregory Kyriazis Imetro - Electrical Metrology
More informationComments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing
Commet o Dicuio Sheet 18 ad Workheet 18 ( 9.5-9.7) A Itroductio to Hypothei Tetig Dicuio Sheet 18 A Itroductio to Hypothei Tetig We have tudied cofidece iterval for a while ow. Thee are method that allow
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 30 Sigal & Sytem Prof. Mark Fowler Note Set #8 C-T Sytem: Laplace Traform Solvig Differetial Equatio Readig Aigmet: Sectio 6.4 of Kame ad Heck / Coure Flow Diagram The arrow here how coceptual flow
More informationLast time: Completed solution to the optimum linear filter in real-time operation
6.3 tochatic Etimatio ad Cotrol, Fall 4 ecture at time: Completed olutio to the oimum liear filter i real-time operatio emi-free cofiguratio: t D( p) F( p) i( p) dte dp e π F( ) F( ) ( ) F( p) ( p) 4444443
More informationIsolated Word Recogniser
Lecture 5 Iolated Word Recogitio Hidde Markov Model of peech State traitio ad aligmet probabilitie Searchig all poible aligmet Dyamic Programmig Viterbi Aligmet Iolated Word Recogitio 8. Iolated Word Recogier
More informationFig. 1: Streamline coordinates
1 Equatio of Motio i Streamlie Coordiate Ai A. Soi, MIT 2.25 Advaced Fluid Mechaic Euler equatio expree the relatiohip betwee the velocity ad the preure field i ivicid flow. Writte i term of treamlie coordiate,
More informationAnother Look at Estimation for MA(1) Processes With a Unit Root
Aother Look at Etimatio for MA Procee With a Uit Root F. Jay Breidt Richard A. Davi Na-Jug Hu Murray Roeblatt Colorado State Uiverity Natioal Tig-Hua Uiverity U. of Califoria, Sa Diego http://www.tat.colotate.edu/~rdavi/lecture
More information18.05 Problem Set 9, Spring 2014 Solutions
18.05 Problem Set 9, Sprig 2014 Solutio Problem 1. (10 pt.) (a) We have x biomial(, θ), o E(X) =θ ad Var(X) = θ(1 θ). The rule-of-thumb variace i jut 4. So the ditributio beig plotted are biomial(250,
More informationx z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed.
] z-tet for the mea, μ If the P-value i a mall or maller tha a pecified value, the data are tatitically igificat at igificace level. Sigificace tet for the hypothei H 0: = 0 cocerig the ukow mea of a populatio
More informationSTA 4032 Final Exam Formula Sheet
Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace
More informationIntroEcono. Discrete RV. Continuous RV s
ItroEcoo Aoc. Prof. Poga Porchaiwiekul, Ph.D... ก ก e-mail: Poga.P@chula.ac.th Homepage: http://pioeer.chula.ac.th/~ppoga (c) Poga Porchaiwiekul, Chulalogkor Uiverity Quatitative, e.g., icome, raifall
More informationStat 3411 Spring 2011 Assignment 6 Answers
Stat 3411 Sprig 2011 Aigmet 6 Awer (A) Awer are give i 10 3 cycle (a) 149.1 to 187.5 Sice 150 i i the 90% 2-ided cofidece iterval, we do ot reject H 0 : µ 150 v i favor of the 2-ided alterative H a : µ
More informationTESTS OF SIGNIFICANCE
TESTS OF SIGNIFICANCE Seema Jaggi I.A.S.R.I., Library Aveue, New Delhi eema@iari.re.i I applied ivetigatio, oe i ofte itereted i comparig ome characteritic (uch a the mea, the variace or a meaure of aociatio
More informationChapter 9: Hypothesis Testing
Chapter 9: Hypothei Tetig Chapter 5 dicued the cocept of amplig ditributio ad Chapter 8 dicued how populatio parameter ca be etimated from a ample. 9. Baic cocept Hypothei Tetig We begi by makig a tatemet,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 16 11/04/2013. Ito integral. Properties
MASSACHUSES INSIUE OF ECHNOLOGY 6.65/15.7J Fall 13 Lecture 16 11/4/13 Ito itegral. Propertie Cotet. 1. Defiitio of Ito itegral. Propertie of Ito itegral 1 Ito itegral. Exitece We cotiue with the cotructio
More informationON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION
Review of the Air Force Academy No. (34)/7 ON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION Aca Ileaa LUPAŞ Military Techical Academy, Bucharet, Romaia (lua_a@yahoo.com) DOI:.96/84-938.7.5..6 Abtract:
More informationStatistical Equations
Statitical Equatio You are permitted to ue the iformatio o thee page durig your eam. Thee page are ot guarateed to cotai all the iformatio you will eed. If you fid iformatio which you believe hould be
More informationu t u 0 ( 7) Intuitively, the maximum principles can be explained by the following observation. Recall
Oct. Heat Equatio M aximum priciple I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace
More information100(1 α)% confidence interval: ( x z ( sample size needed to construct a 100(1 α)% confidence interval with a margin of error of w:
Stat 400, ectio 7. Large Sample Cofidece Iterval ote by Tim Pilachowki a Large-Sample Two-ided Cofidece Iterval for a Populatio Mea ectio 7.1 redux The poit etimate for a populatio mea µ will be a ample
More informationREVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION
REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION I liear regreio, we coider the frequecy ditributio of oe variable (Y) at each of everal level of a ecod variable (X). Y i kow a the depedet variable.
More informationStatistics and Chemical Measurements: Quantifying Uncertainty. Normal or Gaussian Distribution The Bell Curve
Statitic ad Chemical Meauremet: Quatifyig Ucertaity The bottom lie: Do we trut our reult? Should we (or ayoe ele)? Why? What i Quality Aurace? What i Quality Cotrol? Normal or Gauia Ditributio The Bell
More informationStatistical Inference Procedures
Statitical Iferece Procedure Cofidece Iterval Hypothei Tet Statitical iferece produce awer to pecific quetio about the populatio of iteret baed o the iformatio i a ample. Iferece procedure mut iclude a
More informationWe will look for series solutions to (1) around (at most) regular singular points, which without
ENM 511 J. L. Baai April, 1 Frobeiu Solutio to a d order ODE ear a regular igular poit Coider the ODE y 16 + P16 y 16 + Q1616 y (1) We will look for erie olutio to (1) aroud (at mot) regular igular poit,
More informationGiven the following circuit with unknown initial capacitor voltage v(0): X(s) Immediately, we know that the transfer function H(s) is
EE 4G Note: Chapter 6 Intructor: Cheung More about ZSR and ZIR. Finding unknown initial condition: Given the following circuit with unknown initial capacitor voltage v0: F v0/ / Input xt 0Ω Output yt -
More informationCOMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2
Tetig Hypothee COMPARISONS INVOLVING TWO SAMPLE MEANS Two type of hypothee:. H o : Null Hypothei - hypothei of o differece. or 0. H A : Alterate Hypothei hypothei of differece. or 0 Two-tail v. Oe-tail
More informationSOLUTION: The 95% confidence interval for the population mean µ is x ± t 0.025; 49
C22.0103 Sprig 2011 Homework 7 olutio 1. Baed o a ample of 50 x-value havig mea 35.36 ad tadard deviatio 4.26, fid a 95% cofidece iterval for the populatio mea. SOLUTION: The 95% cofidece iterval for the
More information10-716: Advanced Machine Learning Spring Lecture 13: March 5
10-716: Advaced Machie Learig Sprig 019 Lecture 13: March 5 Lecturer: Pradeep Ravikumar Scribe: Charvi Ratogi, Hele Zhou, Nicholay opi Note: Lae template courtey of UC Berkeley EECS dept. Diclaimer: hee
More informationFall 2013 MTH431/531 Real analysis Section Notes
Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters
More informationVIII. Interval Estimation A. A Few Important Definitions (Including Some Reminders)
VIII. Iterval Etimatio A. A Few Importat Defiitio (Icludig Some Remider) 1. Poit Etimate - a igle umerical value ued a a etimate of a parameter.. Poit Etimator - the ample tatitic that provide the poit
More informationCapacitors and PN Junctions. Lecture 8: Prof. Niknejad. Department of EECS University of California, Berkeley. EECS 105 Fall 2003, Lecture 8
CS 15 Fall 23, Lecture 8 Lecture 8: Capacitor ad PN Juctio Prof. Nikejad Lecture Outlie Review of lectrotatic IC MIM Capacitor No-Liear Capacitor PN Juctio Thermal quilibrium lectrotatic Review 1 lectric
More informationHidden Markov Model Parameters
.PPT 5/04/00 Lecture 6 HMM Traiig Traiig Hidde Markov Model Iitial model etimate Viterbi traiig Baum-Welch traiig 8.7.PPT 5/04/00 8.8 Hidde Markov Model Parameter c c c 3 a a a 3 t t t 3 c a t A Hidde
More informationSTUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN ( )
STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN Suppoe that we have a ample of meaured value x1, x, x3,, x of a igle uow quatity. Aumig that the meauremet are draw from a ormal ditributio
More informationErick L. Oberstar Fall 2001 Project: Sidelobe Canceller & GSC 1. Advanced Digital Signal Processing Sidelobe Canceller (Beam Former)
Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC 1 Advaced Digital Sigal Proceig Sidelobe Caceller (Beam Former) Erick L. Obertar 001 Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC
More informationConfidence Intervals. Confidence Intervals
A overview Mot probability ditributio are idexed by oe me parameter. F example, N(µ,σ 2 ) B(, p). I igificace tet, we have ued poit etimat f parameter. F example, f iid Y 1,Y 2,...,Y N(µ,σ 2 ), Ȳ i a poit
More informationChapter 1 Econometrics
Chapter Ecoometric There are o exercie or applicatio i Chapter. 0 Pearo Educatio, Ic. Publihig a Pretice Hall Chapter The Liear Regreio Model There are o exercie or applicatio i Chapter. 0 Pearo Educatio,
More informationME 410 MECHANICAL ENGINEERING SYSTEMS LABORATORY REGRESSION ANALYSIS
ME 40 MECHANICAL ENGINEERING REGRESSION ANALYSIS Regreio problem deal with the relatiohip betwee the frequec ditributio of oe (depedet) variable ad aother (idepedet) variable() which i (are) held fied
More informationSuggested Answers To Exercises. estimates variability in a sampling distribution of random means. About 68% of means fall
Beyond Significance Teting ( nd Edition), Rex B. Kline Suggeted Anwer To Exercie Chapter. The tatitic meaure variability among core at the cae level. In a normal ditribution, about 68% of the core fall
More informationChapter 9 - CD companion 1. A Generic Implementation; The Common-Merge Amplifier. 1 τ is. ω ch. τ io
Chapter 9 - CD compaio CHAPTER NINE CD-9.2 CD-9.2. Stages With Voltage ad Curret Gai A Geeric Implemetatio; The Commo-Merge Amplifier The advaced method preseted i the text for approximatig cutoff frequecies
More informationMath 213b (Spring 2005) Yum-Tong Siu 1. Explicit Formula for Logarithmic Derivative of Riemann Zeta Function
Math 3b Sprig 005 Yum-og Siu Expliit Formula for Logarithmi Derivative of Riema Zeta Futio he expliit formula for the logarithmi derivative of the Riema zeta futio i the appliatio to it of the Perro formula
More informationChapter 10 Advanced Topics in Random Processes
ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus
More informationSociété de Calcul Mathématique, S. A. Algorithmes et Optimisation
Société de Calcul Mathématique S A Algorithme et Optimiatio Radom amplig of proportio Berard Beauzamy Jue 2008 From time to time we fid a problem i which we do ot deal with value but with proportio For
More informationRecursive Updating Fixed Parameter
Recursive Udatig Fixed Parameter So far we ve cosidered the sceario where we collect a buch of data ad the use that (ad the rior PDF) to comute the coditioal PDF from which we ca the get the MAP, or ay
More informationThe Performance of Feedback Control Systems
The Performace of Feedbac Cotrol Sytem Objective:. Secify the meaure of erformace time-domai the firt te i the deig roce Percet overhoot / Settlig time T / Time to rie / Steady-tate error e. ut igal uch
More informationBrief Review of Linear System Theory
Brief Review of Liear Sytem heory he followig iformatio i typically covered i a coure o liear ytem theory. At ISU, EE 577 i oe uch coure ad i highly recommeded for power ytem egieerig tudet. We have developed
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More information1. The F-test for Equality of Two Variances
. The F-tet for Equality of Two Variance Previouly we've learned how to tet whether two population mean are equal, uing data from two independent ample. We can alo tet whether two population variance are
More information+ au n+1 + bu n = 0.)
Lecture 6 Recurreces - kth order: u +k + a u +k +... a k u k 0 where a... a k are give costats, u 0... u k are startig coditios. (Simple case: u + au + + bu 0.) How to solve explicitly - first, write characteristic
More informationCHAPTER 6. Confidence Intervals. 6.1 (a) y = 1269; s = 145; n = 8. The standard error of the mean is = s n = = 51.3 ng/gm.
} CHAPTER 6 Cofidece Iterval 6.1 (a) y = 1269; = 145; = 8. The tadard error of the mea i SE ȳ = = 145 8 = 51.3 g/gm. (b) y = 1269; = 145; = 30. The tadard error of the mea i ȳ = 145 = 26.5 g/gm. 30 6.2
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationHeat Equation: Maximum Principles
Heat Equatio: Maximum Priciple Nov. 9, 0 I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace
More informationAPPM 5720 Solutions to Problem Set Five
APPM 5720 Solutios to Problem Set Five 1. The pdf is f(x; α, β) 1 Γ(α) βα x α 1 e βx I (0, ) (x). The joit pdf is f( x; α, β) 1 [Γ(α)] β α ( i1 x i ) α 1 e β i1 x i i1 I (0, ) (x i ) 1 [Γ(α)] βα } {{ }
More informationLecture 8: Period Finding: Simon s Problem over Z N
Quantum Computation (CMU 8-859BB, Fall 205) Lecture 8: Period Finding: Simon Problem over Z October 5, 205 Lecturer: John Wright Scribe: icola Rech Problem A mentioned previouly, period finding i a rephraing
More informationTools Hypothesis Tests
Tool Hypothei Tet The Tool meu provide acce to a Hypothei Tet procedure that calculate cofidece iterval ad perform hypothei tet for mea, variace, rate ad proportio. It i cotrolled by the dialog box how
More informationDifference tests (1): parametric
NST B Eperimetal Pychology Statitic practical Differece tet (): parametric Rudolf Cardial & Mike Aitke / 3 December 003; Departmet of Eperimetal Pychology Uiverity of Cambridge Hadout: Awer to Eample (from
More informationFirst, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,
0 2. OLS Part II The OLS residuals are orthogoal to the regressors. If the model icludes a itercept, the orthogoality of the residuals ad regressors gives rise to three results, which have limited practical
More informationTopics in MMSE Estimation for Sparse Approximation
for Spare Approximatio * Michael Elad The Computer Sciece Departmet The Techio Irael Ititute of techology Haifa 3, Irael Workhop: Sparity ad Computatio Haudorff ceter of Mathematic Uiverity of Bo Jue 7-,
More informationSection 11.8: Power Series
Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i
More information20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE
20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE If the populatio tadard deviatio σ i ukow, a it uually will be i practice, we will have to etimate it by the ample tadard deviatio. Sice σ i ukow,
More informationLesson 5. Chapter 7. Wiener Filters. Bengt Mandersson. r k s r x LTH. September Prediction Error Filter PEF (second order) from chapter 4
Optimal Sigal oceig Leo 5 Capte 7 Wiee Filte I ti capte we will ue te model ow below. Te igal ito te eceie i ( ( iga. Nomally, ti igal i ditubed by additie wite oie (. Te ifomatio i i (. Alo, we ofte ued
More informationDiscrete-Time Systems, LTI Systems, and Discrete-Time Convolution
EEL5: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we begi our mathematical treatmet of discrete-time s. As show i Figure, a discrete-time operates or trasforms some iput sequece x [
More informationRef. Gallager, Stochastic Processes. Notation a vector. All vectors are row vectors. k k. jωx. Φ joint chacteristic function of.
Gaussia Radom ector Ref. Gallager, Stochastic Processes. Notatio a vector. All vectors are row vectors a a aa ω matrix scalar matrix ( ) ( ) -dim radom vector,, -dim real vector ω,, ω Φ oit chacteristic
More informationELEC 372 LECTURE NOTES, WEEK 4 Dr. Amir G. Aghdam Concordia University
ELEC 37 LECTURE NOTES, WEE 4 Dr Amir G Aghdam Cocordia Uiverity Part of thee ote are adapted from the material i the followig referece: Moder Cotrol Sytem by Richard C Dorf ad Robert H Bihop, Pretice Hall
More informationCorrection for Simple System Example and Notes on Laplace Transforms / Deviation Variables ECHE 550 Fall 2002
Correction for Simple Sytem Example and Note on Laplace Tranform / Deviation Variable ECHE 55 Fall 22 Conider a tank draining from an initial height of h o at time t =. With no flow into the tank (F in
More informationSimple Regression Model
Simple Regressio Model 1. The Model y i 0 1 x i u i where y i depedet variable x i idepedet variable u i disturbace/error term i 1,..., Eg: y wage (measured i 1976 dollars per hr) x educatio (measured
More informationPrecalculus MATH Sections 3.1, 3.2, 3.3. Exponential, Logistic and Logarithmic Functions
Precalculus MATH 2412 Sectios 3.1, 3.2, 3.3 Epoetial, Logistic ad Logarithmic Fuctios Epoetial fuctios are used i umerous applicatios coverig may fields of study. They are probably the most importat group
More informationDepartment of Mechanical Engineering Massachusetts Institute of Technology Modeling, Dynamics and Control III Spring 2002
Department of Mechanical Engineering Maachuett Intitute of Technology 2.010 Modeling, Dynamic and Control III Spring 2002 SOLUTIONS: Problem Set # 10 Problem 1 Etimating tranfer function from Bode Plot.
More informationEECE 301 Signals & Systems
EECE 301 Sigals & Systems Prof. Mark Fowler Note Set #8 D-T Covolutio: The Tool for Fidig the Zero-State Respose Readig Assigmet: Sectio 2.1-2.2 of Kame ad Heck 1/14 Course Flow Diagram The arrows here
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationTAMS24: Notations and Formulas
TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =
More informationChapter 8.2. Interval Estimation
Chapter 8.2. Iterval Etimatio Baic of Cofidece Iterval ad Large Sample Cofidece Iterval 1 Baic Propertie of Cofidece Iterval Aumptio: X 1, X 2,, X are from Normal ditributio with a mea of µ ad tadard deviatio.
More informationPerformance-Based Plastic Design (PBPD) Procedure
Performace-Baed Platic Deig (PBPD) Procedure 3. Geeral A outlie of the tep-by-tep, Performace-Baed Platic Deig (PBPD) procedure follow, with detail to be dicued i ubequet ectio i thi chapter ad theoretical
More informationLesson 5. Chapter 7. Wiener Filters. Bengt Mandersson. r x k We assume uncorrelated noise v(n). LTH. September 2010
Optimal Sigal Poceig Leo 5 Chapte 7 Wiee Filte I thi chapte we will ue the model how below. The igal ito the eceive i ( ( iga. Nomally, thi igal i ditubed by additive white oie v(. The ifomatio i i (.
More informationBertrand s Postulate
Bertrad s Postulate Lola Thompso Ross Program July 3, 2009 Lola Thompso (Ross Program Bertrad s Postulate July 3, 2009 1 / 33 Bertrad s Postulate I ve said it oce ad I ll say it agai: There s always a
More informationWidely used? average out effect Discrete Prior. Examplep. More than one observation. using MVUE (sample mean) yy 1 = 3.2, y 2 =2.2, y 3 =3.6, y 4 =4.
Dicrete Prior for (μ Widely ued? average out effect Dicrete Prior populatio td i kow equally likely or ubjective weight π ( μ y ~ π ( μ l( y μ π ( μ e Examplep ( μ y Set a ubjective prior ad a gueig value
More informationIn algebra one spends much time finding common denominators and thus simplifying rational expressions. For example:
74 The Method of Partial Fractios I algebra oe speds much time fidig commo deomiators ad thus simplifyig ratioal epressios For eample: + + + 6 5 + = + = = + + + + + ( )( ) 5 It may the seem odd to be watig
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationμ + = σ = D 4 σ = D 3 σ = σ = All units in parts (a) and (b) are in V. (1) x chart: Center = μ = 0.75 UCL =
Our online Tutor are available 4*7 to provide Help with Proce control ytem Homework/Aignment or a long term Graduate/Undergraduate Proce control ytem Project. Our Tutor being experienced and proficient
More informationComparing Means: t-tests for Two Independent Samples
Comparing ean: t-tet for Two Independent Sample Independent-eaure Deign t-tet for Two Independent Sample Allow reearcher to evaluate the mean difference between two population uing data from two eparate
More informationBackground Information
Egieerig 33 Gayheart 5-63 1 Beautif ul Homework 5-63 Suppose t h a t whe t h e ph of a c e r t a i c h e m i c a l compoud i s 5.00, t h e ph measured by a radomly s e l e c t e d begiig chemistry studet
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationTables and Formulas for Sullivan, Fundamentals of Statistics, 2e Pearson Education, Inc.
Table ad Formula for Sulliva, Fudametal of Statitic, e. 008 Pearo Educatio, Ic. CHAPTER Orgaizig ad Summarizig Data Relative frequecy frequecy um of all frequecie Cla midpoit: The um of coecutive lower
More informationStatistics Problem Set - modified July 25, _. d Q w. i n
Statitic Problem Set - modified July 5, 04 x i x i i x i _ x x _ t d Q w F x x t pooled calculated pooled. f d x x t calculated / /.. f d Kow cocept of Gauia Curve Sytematic Error Idetermiate Error t-tet
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationLecture 30: Frequency Response of Second-Order Systems
Lecture 3: Frequecy Repoe of Secod-Order Sytem UHTXHQF\ 5HVSRQVH RI 6HFRQGUGHU 6\VWHPV A geeral ecod-order ytem ha a trafer fuctio of the form b + b + b H (. (9.4 a + a + a It ca be table, utable, caual
More informationLecture 9: Shor s Algorithm
Quantum Computation (CMU 8-859BB, Fall 05) Lecture 9: Shor Algorithm October 7, 05 Lecturer: Ryan O Donnell Scribe: Sidhanth Mohanty Overview Let u recall the period finding problem that wa et up a a function
More informationInverse Matrix. A meaning that matrix B is an inverse of matrix A.
Iverse Matrix Two square matrices A ad B of dimesios are called iverses to oe aother if the followig holds, AB BA I (11) The otio is dual but we ofte write 1 B A meaig that matrix B is a iverse of matrix
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationPhysics 741 Graduate Quantum Mechanics 1 Solutions to Final Exam, Fall 2014
Phyic 7 Graduate Quantum Mechanic Solution to inal Eam all 0 Each quetion i worth 5 point with point for each part marked eparately Some poibly ueful formula appear at the end of the tet In four dimenion
More informationSummary: CORRELATION & LINEAR REGRESSION. GC. Students are advised to refer to lecture notes for the GC operations to obtain scatter diagram.
Key Cocepts: 1) Sketchig of scatter diagram The scatter diagram of bivariate (i.e. cotaiig two variables) data ca be easily obtaied usig GC. Studets are advised to refer to lecture otes for the GC operatios
More informationQueueing Theory (Part 3)
Queueig Theory art 3 M/M/ Queueig Sytem with Variatio M/M/, M/M///K, M/M//// Queueig Theory- M/M/ Queueig Sytem We defie λ mea arrival rate mea ervice rate umber of erver > ρ λ / utilizatio ratio We require
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More information5. Fast NLMS-OCF Algorithm
5. Fast LMS-OCF Algorithm The LMS-OCF algorithm preseted i Chapter, which relies o Gram-Schmidt orthogoalizatio, has a compleity O ( M ). The square-law depedece o computatioal requiremets o the umber
More information