Fast Simulation of Digital Phase Detectors Using Importance Sampling

Size: px
Start display at page:

Download "Fast Simulation of Digital Phase Detectors Using Importance Sampling"

Transcription

1 Fat Simulatio of Digital Phae Detector Uig Importace Samplig Fracico A. S. Silva Joé M. N. Leitão Itituto de Telecomuicaçõe - Itituto Superior Técico Liboa, PORTUGAL fea, jleitaog@lx.it.pt Abtract Thi paper addree the developmet of importace amplig techique for the evaluatio of a cla of ope-loop digital phae modulatio receiver. We aume additive white Gauia oie chael, ymbol-by-ymbol detectio ad carrier phae trackig withi the ymbol iterval. For the irreducible error oor aalyi Importace Samplig baed o large deviatio theory wa ued. I the geeral oiy operatig coditio, a adaptive importace amplig approach i adopted. The reultig imulatio algorithm yield practically the ame reult of covetioal Mote Carlo, while exhibitig remarkable imulatio time gai. I. INTRODUCTION Referece [] coidered the developmet of a cla of opeloop receiver uitable for operatio with frequecy at-fadig chael diturbed by fat-fadig coditio ad large carrier phae variatio. The propoed olutio, coitig of a bak of matched tochatic oliear filter (NLF) ad a deciio proceor drive by the filter iovatio procee, perform ymbol-by-ymbol detectio while keepig track of carrier amplitude ad phae withi the ymbol iterval. Performace evaluatio wa carried out by covetioal, time coumig, Mote Carlo (MC) imulatio. To further tet ad refie the approach ad the algorithm developed i [] a adequate ad fat imulatio tool ha to be devied. Thi i the mai purpoe of the work herei reported. Specifically we addre the applicatio of importace amplig (IS) techique to thi cla of problem by focuig o the additive white Gauia oie (AWGN) chael with radom carrier phae drift, which i a particular ceario of []. We how how to derive the receiver error et due to the irreducible error oor iduced by the radom phae drift; from thi iformatio we deig a IS procedure baed o large deviatio theory (LDT). Our referece, for thi purpoe are [], [3] ad [4]. Whe departig from the aymptotic error oor a adaptive importace amplig (AIS) approach, adapted from [5], i adopted. The paper i orgaized a follow: Sectio preet the adopted commuicatio model ad ome IS apect relevat to the imulatio deig. I Sectio 3 we derive the error et for deity biaig uig LDT, ad preet the mai apect behid the AIS techique applied. Implemetatio apect are icluded i thi ectio. I ectio 4 we how the reult of our IS aalyi. Some cocludig remark are preeted i ectio 5. Thi work wa upported by Portuguee program Praxi XXI, uder project /./TIT/583/95. A. Model II. PROBLEM FORMULATION Coider the dicrete bae-bad model of a digitally phaemodulated carrier with a radom phae drift due to ocillator itability or Doppler effect, ad tramitted through a AWGN chael. Thi igal, i for the ymbol iterval [kt ; (k +)T ], repreeted by it N ample give by = exp h j () + ffi i + v; =;:::;N () where () i the digital phae modulatio equece aociated with tramitted ymbol ff, ffi i a dicrete Browia motio 0;ff ffi decribed by ffi = ffi + ffi, with ffi οn, ad v i a complex zero mea white Gauia equece with variace ffv. B. Receiver e -j The receiver tak i to detect the k th tramitted ymbol while keepig track of the radom phae ffi ; = ;:::;N. Thi detector/etimator tructure coit of a bak of matched NLF drive by the ame iput. Matchig to ymbol ff coit of elimiatig the modulatig equece from the obervatio vector (rotatig block i Fig. ). The NLF propa z NLF ( ^ P P, ) ( ^ P() P(), ) Deciio algorithm mi{ } m ^ Figure : Diagram of receiver brach matched to ymbol ff gate recurively probability deitie of phae ffi coditioed o the obervatio z (). Followig [], deitie are repreeted, for thi calar phae proce, a Tikhoov fuctio with mea ^ffi ad cocetratio parameter. Propagatio i accomplihed i two tep. A filterig tep ^ffi F = arcta z() ; + P ff v i ^ffi P z () ; + P ff v co ^ffi P ()

2 F =» z () + P ff v followed by a predictio tep =ffv 4 + z ; co ^ffi P + z ; i ^ffi P = + P (3) ^ffi P + = ^ffi F (4) P + = P F ;ff ffi Deciio i favorable to the brach m that yield the miimum value of ß - the Euclidea metric for the iovatio proce of the repective NLF. All the M NLF are the iitialized with the parameter iterval. See [] for detail. ^ffi P N+ ;P N+ (5) for ext ymbol C. Performace Aemet ad Importace Samplig Fig. i a chematic repreetatio of the commuicatio model coidered i the previou ubectio. I thi figure N k V Nk A k Y Nk S Nk Symbol k MOD Chael detector Figure : Model for the commuicatio ytem A k = ff i the tramitted ymbol with ff fff ; ;ff M g, ad Y Nk ad S Nk are the tramitted ad received igal vector repectively cotaiig N ample each withi ymbol iterval [kt ; (k +)T ]. V Nk i the AWGN vector V Nk = [v ;:::;v N ] k, ad Nk = [ffi ;:::;ffi N ] the phae icremet vector. Sice the ymbol detector propagate deity parameter from the (k ) th ymbol iterval to the k th oe, a obervatio record of ize L S L = [S k ;S k ;:::;S k L+ ] ; L> (6) S = S k ; L = (7) iuece etimate ^A k. Accordigly, we defie the aociated tramitted igal ad diturbace record Y L ad U L = L;V LΛ repectively. The ubiaed MC error probability etimator i where g A k ; ^A k X ^P e = N MC N MC k= g A k ; ^A k i oe if ^A k 6= A k ad zero otherwie, N MC beig the umber of imulatio ru. For i.i.d. error ^P e o var = ffmc = P e ( P e ) =N MC. No-idepedet error icreae variace (ee [6]), with a higher N MC beig required to obtai the oppoite effect. IS imulatio i iteded to reduce high value of ff MC =P e aociated with low P e. For thi, a biaed imulatio deity p Λ ( ) i ued to geerate the record [Y;U] Λ (* mea that [Y;U] Λ i geerated accordig to p Λ ( )) i order to obtai more frequet error - the importat ad otherwie rare evet. Although biaed imulatio deitie lead aturally to biaed error rate etimate, IS provide appropriate correctio for each error evet by mea of the likelihood ratio W ([Y;U] Λ i ) = p ([Y;U] Λ i ) =pλ ([Y;U] Λ i ). Thi yield the ubiaed error rate IS etimator X ^P e Λ = N IS N IS i= E ([Y;U] Λ i ) W ([Y;U]Λ i ) (8) where E ( ) i the idicator fuctio for the error et E. Note that i (8) each imulatio ample i a record. Thi i ot the cae with ^P e uder covetioal MC, ad the differece betwee the approache relie o the type of imulatio - tream imulatio for MC, ad error evet imulatio for IS. Error evet imulatio itroduced i [7] i coidered a the method epecially appropriate for IS i the preece of memory effect. It coit of geeratig idepedet realizatio of U L for a give iformatio patter A L while tetig A k for error occurrece. Bia doe i the imulatio deity will be coditioed o each patter A L belogig to a fiite deumerable et of cofiguratio. Whe miimizig the IS etimator variace for a give N IS, we mut act o W ( ) through p Λ ( ). I our aalyi, we ued two ditict tool for thi purpoe: Large deviatio theory reult - for the error oor aalyi, ff ffi 6=0;ff v =0 ad adaptive importace amplig for the oiy chael - ffv 6=0;ff ffi 6=0. LDT tudie the rate of covergece to zero of certai probabilitie ad it relatiohip with the propertie of the error et E. See for example [], [4] ad [3]. We derive the error et tructure i the pace of radom phae icremet, deoted by D. Outide the error oor limit aalyi, ffffi 6=0;ff v 6= 0, for which the error et i ukow, we proceed with a tochatic miimizatio techique for ffis - AIS - uig iformatio from the deity biaig i D. III. IMPORTANCE SAMPLING DESIGN From model aalyi, we foud that evet imulatio with L = i a adequate procedure. Thi require appropriate imulatio of the receiver iitializatio i order to model the impact of the (k ) th deciio o etimate ^A k. A. Error et aalyi No-liear recurio i equatio () to (5) alog with the deciio algorithm, preclude i geeral the error et aalyi. If we retrict our aalyi to D, (ffffi 6=0, ff v =0), we obtai a impler model that i aalytically tractable. For implicity we derive here the error et for the biary cae (M =). The filter equatio i the error oor are: ^ffi F =arg z () = ffi F = ^ffi P + = ^ffi F P + = P ff ffi : I the receiver, brach t deciio metric coditioed o tramitted ff become (idex t refer to target - the ymbol

3 ff t which i to be detected itead of ff ). ß tj = e j( () (t) +ffi) P P (t) j ^ffi P(t) e (9) = 8 6 Q Q where P P (t) = exp ff ffi = 4 C ^ffi P (t) = () (t) + ffi ; > (0) ^ffi P (t) = I ijj + ffi 0 : () ^ffi P (t) Recall that i the receiver iitializatio for all brache. P (t) I the error oor, ^ffi i the um of the radom phae ffi 0 (previou to ffi ) with a error term I ijj = (j) N (i) N reultig from the (k ) th deciio feedback - electio of brach i give the tramitted ymbol ff j. From (9) we get the probability of error coditioed o tramiio of ymbol ff ad iitializatio error I ijj P Φ ß j >ß tj Ψ = P (co ffi I ijj + where < co f tj + ffi I ijj + f tj = () (t) = = co ffi () co f tj ) + ffi (3) () (t) ;=;:::;N f tj = () (t) : (4) We ow defie Etj;I D ijj = Φ N Ψ R N : ß j >ß tj a the error et i D coditioed o tramiio of ymbol ff ad iitializatio error I ijj. Equatio ß j = ß tj defiig the D ijj ca ot be olved i geeral. However we may a the ifiite et of deumerable olutio atifyig co ffi I ijj =co f tj + ffi I ijj (5) co ffi =co f tj + ffi ; =;:::;N: (6) There i a fiite collectio of ß cotaiig oly N elemet obtaied by the ß f N [ ß; ß] [ ß; ß]g. Ay igle elemet ß allow the derivatio of the remaiig N elemet ad alo of the ymmetry ceter of the error et, which we deigate by C N. We are able to idetify a poit ß for each oe of the N quadrat Q i wrt to C N. I geeral C N doe ot coicide with the origi of D. A a example of uch a error et, we how i Fig. 3 a diagram for N =obtaied by radom geeratio of ample i R. The olutio ß = f ; ; 3 ; 4 g i alo repreeted. The error regio preet a periodic tructure geerally o-coected ad extedig all over D Q Figure 3: Error et for N=. I =0, f ==3ß ad f = ß=3 B. Large Deviatio ad Biaig Strategy Havig idetified Etj;I D ijj D, with N D ditributed accordig to the imulatio deity ψ! N ψ! p ( N )= p exp ffi =(ff ffi ) ; ßffffi = we mut ow check the coditio for the optimal biaig of p ( N ). Refer to [] - Defiitio, of miimum rate poit ad domiatig poit. LDT aure the aymptotic efficiecy of the expoetial twited imulatio ditributio uig the uique domiatig poit ν of E. Sice p ( N ) i Gauia, thi would reult i the tralatio of it mea to the domiatig poit ν, iteded to eure a appropriate coverage of E tj;i D ijj. I thi cae it i ot poible to obtai a poit D ijj ad a half plae H(ν) (taget to the level of p(ν) i ν) uch that Etj;I D ijj ρ H(ν), due to the periodicity of the olutio ß j = ß tj. Whe there i o domiatig poit, Theorem i [] tate the coditio for the ue of a et of poit fν ;:::ν m g for the mea tralatio of a fiite umber of term that will cotitute the biaed deity. Thi reult i p Λ ( ) beig a mixture of Gauia term for appropriate coverage of Etj;I D ijj. The et fν ;:::ν m g mut cotai at leat all the miimum rate poit of E (ee alo Def i []) ad other poit, which, whe ued a bia vector, will improve the coverage of E with the biaed deity p Λ ( ). The miimum rate poit defiitio relie i the LD rate fuctio of p ( N ) Q 4 N = I ( N )=P ffi ffffi : (7) It i the poit ν for which I(ν) =I(E) = if N E I( N ), where I(E) i the Cramér traform (ee []) of E. The miimum rate poit jut miimize the Euclidea orm of I our cae, uig the miimum rate poit, would ot be ufficiet to cover E by the ame reao that determied the oexitece of the domiatig poit. However, ice E

4 how a ymmetric patter wrt C N,weueE = [ i= N E Q i, with E Qi = Etj;I D ijj Q i, ad the we earch for the importat poit o each Qi. Thi approximate the eparate etimatio of the probability mae of iteret for each error ubet E Qi ρ Q i followed by additio to fid the ma o E. The miimum rate poit wrt each et E Qi may eve be domiatig poit of the elemetary et E Qi. Poit i the olutio ß are ued to tart a quadratwie miimizatio of the Euclidea orm of N ubject to the cotrait N E Qi. At the ed of the earch, our et of biaig poit i Etj;I D ijj Φ ν Ψ ν = ;:::; νn. Due to the big umber of olutio, we elected for imulatio biaig oly the N m olutio with the maller Euclidea orm. We mut alo exclude from the error et the quadrat correpodig to the elimiated olutio. Thi prevet very rare ample fallig i thoe remote egmet of Etj;I D ijj, from icreaig the variace of Pe Λ. We ever oticed i our tet the egligible expected uderetimatio for P e. We defer the preetatio of the biaed deity to ubectio III.D. C. Deity Biaig uig AIS Coider ow the product pace D V I, with V beig the N dimeioal oie ample pace ad I the -dimeioal pace of the iitializatio phae error. We adopt the imulatio of the iitializatio error, ice keepig it characteritic i the error oor, would lead here to a uderetimatio of the error probability. We cocluded that ^ffi P i approximately Gauia it parameter beig eaily etimated i a hort imulatio preamble. A for the iitializatio parameter P, we foud it much table, but with a deity imilar to a expoetial. We decided to keep it cotat with it value i the error oor that i P = P exp( ffffi. =) Optimizatio of IS coit ow of biaig i the product pace D V I. For miimizatio of ffis we ue a tochatic earch, becaue we have o iformatio about the error et. The error et i ow E DV I D V I. We ue a parametric AIS techique adapted from that propoed i [5]. We etimate the coditioal mea E f( N;V N ;I) j ( N;V N ;I) E DV IΨ. The error et i coditioed o the tramitted ymbol. Optimizatio mut yield a multiple bia olutio that will cotitute the bia for deity p Λ ( N;V N ;I). We avoid repeatig here the detail i [5]. The propoed etimatio cycle i icreaigly repeated i our cae, a ffv icreae while ffffi i kept cotat. The biaed deity i preeted i the ext ubectio for M>. The major modificatio we have doe to the techique propoed i [5], are the tartig poit for the tochatic optimizatio procedure, ad a bia iolatio trategy i order to prevet the optimizatio to ed o a igle global extremum becaue thi would lead to a poor coverage of E DV I. We ued a tartig poit the optimized biae ν ad o bia at all for V N ad I. Thi horte the time required for tartig the algorithm. Quadrat eparatio i D i eetial to keep the differet bia term eparated durig optimizatio. D. Implemetatio Apect I the error oor, I ijj deped o the reult of etimate ^A k. Our tet howed o differece betwee IS imulatio that ued oly the correct iitializatio I ijj = I jjj =0 ad MC. The correct iitializatio I jjj happe aturally almot all the time, ad it ecod order impact i egligible for all our etimate rage. I fact we coducted tet with all the poible value for I ijj, their a priori probability P I ijj beig etimated recurively, ad the differece were egligible. I coequece we ued alway I jjj i the error oor. For the oiy chael, we ued the ame approach but with I jjj replaced by I N (0; I ) a explaied before with I etimated i a hort preamble due to it depedece from ff ffi ad ff v. We coidered util ow biary igalig (M =). With a M-ary igalig cheme, the error et coditioed o ff i the uio E = M[ i= i6= E ij Thi reder IS biaig uboptimal becaue a bia term iteded ij may reult i a overbiaed term for E jj, with E ij E jj 6= ;. To mitigate thi ource of o-optimality, we itroduce aother level of multiple biaig i our IS imulatio. Thi overcome the poibility of gettig big jump of W ( ) due to o-error ample (wrt E ij ) fallig i E jj whe E ij i targeted. Our biaed deity i the a Gauia mixture of (M ) N m term for appropriate target addreig ad error et coverage. The referred deity i p Λ ( N;V N ;Ijff )= N m X m= MX t= t6= P (B(t; m) ff ) p ( N;V N ;IjB(t; m) ff ) (8) where p ( N;V N ;IjB(t; m) ff ) i the 3N +dimeioal Gauia term with mea B(t; m) ff - the bia vector i D V Iif ff wa tramitted. The P (B(t; m) ff ) are the amplig probabilitie for the bia term. They were made iverely proportioal to the Euclidea orm of the repective bia hift term, but we do ot kow i what extet thi optio approache optimality. Simulatio deity at the error oor, i a mutati mutadi implificatio of (8) ice we are oly geeratig N D. The imulatio coit of a umber of batche with a ytematic geeratio of all the M tramitted ymbol i each batch. For each ymbol we perform a umber of ru, each oe coitig of amplig the bia term, vector N, ad vector [V N ;I] whe applicable. IV. RESULTS The reult preeted i thi ectio were obtaied with a 4- FSK modulatio with f =:6=(ßT ) rad betwee adjacet ymbol; thi correpod to particular value of the modulatio parameter i the igalig cheme coidered i []. The umber of ample per ymbol wa et to N = 0. Simulatio gai, deoted by i defied by the ratio betwee the MC imulatio time, T MC, ad the correpodig IS time,

5 T IS, ( = T MC =T IS ). Simulatio were topped whe empirical preciio reached a value lower tha 0% (ee for example [8]). Fig. 4 repreet imulatio data correpod- ^ P / (rad - ) P ^ o - IS x - MC - Simulatio gai Figure 4: IS ad MC i the error oor. ^P ad veru ff ffi 0 -P ^ o - IS x - MC =0.055 rad =0.050 rad =0.045 rad E b /N 0 (db) Figure 5: ^P veru E b =N 0 for differet value of ff ffi ig to the error oor for value of ffffi ragig from 0: rad =ffffi =0 to 0:03 rad =ffffi. =33:3 Deity biaig wa doe i D accordig to LDT priciple. The left vertical cale repreet the etimate of ymbol error probability, ^P, wherea the right vertical cale repreet imulatio gai. Notice the practical coicidece of ^P value of IS (mark o) with thoe of MC (mark ) i the rage =ffffi =0 to =ffffi =:. Simulatio gai icreae, i thi rage, from =55to = The value of T MC for =ff ffi =: i 3:7 hour uig a PIII@450MHz computer. Extedig compario of imulator for maller phae drift would be ubearable. The IS reult preeted i Fig. 5 were obtaied after adaptive optimizatio a they cocer the receiver performace i a wide rage of operatig coditio (icludig the error oor). Alo repreeted are the value of ^P obtaied with MC for ff ffi =0:05rad ad value of E b =N 0 equal to 9,, 5 ad 3 db; the correpodig gai were 8:, 54:3, 58: ad 45 repectively; for E b =N 0 = 7 db, there i o practical imulatio gai. Oce agai we tre the practical coicidece of etimated value of ^P provided by both imulator. Poit o the curve correpodig to ff ffi =0:045 rad took 0 miute (with the above metioed computer) i the rage of [0; 70] db, while the MC poit i the rage of [7; 50] db would take about 7:5 hour. V. CONCLUDING REMARKS I thi work we combied two IS approache i the aemet of a particular type of ymbol-by-ymbol phae detector. Compario with the MC imulatio how the effectivee of the developed IS algorithm both i term of accuracy ad the time imulatio gai. The receiver we have aalyzed, baed o tochatic oliear filterig implemetatio, were compared i [] with alterative tructure where the etimatio uit are exteded Kalma-Bucy filter (EKBF) applied to the ame problem. With the ame purpoe we are curretly extedig the techique herei deiged to the EKBF baed receiver. VI. REFERENCES [] F. D. Nue ad J. M. N. Leitão, A oliear filterig approach to etimatio ad detectio i mobile commuicatio, IEEE Joural o Selected Area i Commuicatio, vol. 6, o. 9, pp , December 998. [] J. S. Sadowky ad J. A. Bucklew, O Large Deviatio Theory ad aymptotically efficiet Mote Carlo etimatio, IEEE Traactio o Iformatio Theory, vol. 36, o. 3, pp , May 990. [3] J. S. Sadowky, O the optimality ad tability of expoetial twitig i Mote Carlo etimatio, IEEE Traactio o Iformatio Theory, vol. 39, o., pp. 9 8, Jauary 993. [4] J. A. Bucklew, Large Deviatio Techique i Deciio, Simulatio ad Etimatio, New York: Wiley, 990. [5] J. S. Stadler ad S. Roy, Adaptive importace amplig, IEEE Joural o Selected Area i Commuicatio, vol., o. 3, pp , April 993. [6] P. Balaba M. C. Jeruchim ad K. S. Shamuga, Simulatio of Commuicatio Sytem, Pleum, Jauary 994. [7] D. Lu ad K. Yao, Improved Importace Samplig techique for efficiet imulatio of digital commuicatio ytem, IEEE Joural o Selected Area i Commuicatio, vol. 6, o., pp , Jauary 988. [8] Jyu-Cheg Che, D. Lu, J. S. Sadowky ad K. Yao, O Importace Samplig i digital commuicatio - part I: Fudametal, IEEE Joural o Selected Area i Commuicatio, vol., o. 3, pp , April 993.

Comments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing

Comments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing Commet o Dicuio Sheet 18 ad Workheet 18 ( 9.5-9.7) A Itroductio to Hypothei Tetig Dicuio Sheet 18 A Itroductio to Hypothei Tetig We have tudied cofidece iterval for a while ow. Thee are method that allow

More information

Capacity-Approaching Signal Constellations for the Additive Exponential Noise Channel

Capacity-Approaching Signal Constellations for the Additive Exponential Noise Channel Capacity-Approachig Sigal Cotellatio for the Additive Expoetial Noie Chael Stéphae Y. Le Goff School of Electrical, Electroic ad Computer Egieerig Newcatle Uiverity, Uited Kigdom Abtract We preet a ew

More information

Another Look at Estimation for MA(1) Processes With a Unit Root

Another Look at Estimation for MA(1) Processes With a Unit Root Aother Look at Etimatio for MA Procee With a Uit Root F. Jay Breidt Richard A. Davi Na-Jug Hu Murray Roeblatt Colorado State Uiverity Natioal Tig-Hua Uiverity U. of Califoria, Sa Diego http://www.tat.colotate.edu/~rdavi/lecture

More information

Chapter 9. Key Ideas Hypothesis Test (Two Populations)

Chapter 9. Key Ideas Hypothesis Test (Two Populations) Chapter 9 Key Idea Hypothei Tet (Two Populatio) Sectio 9-: Overview I Chapter 8, dicuio cetered aroud hypothei tet for the proportio, mea, ad tadard deviatio/variace of a igle populatio. However, ofte

More information

Generalized Likelihood Functions and Random Measures

Generalized Likelihood Functions and Random Measures Pure Mathematical Sciece, Vol. 3, 2014, o. 2, 87-95 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/pm.2014.437 Geeralized Likelihood Fuctio ad Radom Meaure Chrito E. Koutzaki Departmet of Mathematic

More information

x z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed.

x z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed. ] z-tet for the mea, μ If the P-value i a mall or maller tha a pecified value, the data are tatitically igificat at igificace level. Sigificace tet for the hypothei H 0: = 0 cocerig the ukow mea of a populatio

More information

REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION

REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION I liear regreio, we coider the frequecy ditributio of oe variable (Y) at each of everal level of a ecod variable (X). Y i kow a the depedet variable.

More information

u t u 0 ( 7) Intuitively, the maximum principles can be explained by the following observation. Recall

u t u 0 ( 7) Intuitively, the maximum principles can be explained by the following observation. Recall Oct. Heat Equatio M aximum priciple I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace

More information

STA 4032 Final Exam Formula Sheet

STA 4032 Final Exam Formula Sheet Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace

More information

State space systems analysis

State space systems analysis State pace ytem aalyi Repreetatio of a ytem i tate-pace (tate-pace model of a ytem To itroduce the tate pace formalim let u tart with a eample i which the ytem i dicuio i a imple electrical circuit with

More information

Statistical Inference Procedures

Statistical Inference Procedures Statitical Iferece Procedure Cofidece Iterval Hypothei Tet Statitical iferece produce awer to pecific quetio about the populatio of iteret baed o the iformatio i a ample. Iferece procedure mut iclude a

More information

COMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2

COMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2 Tetig Hypothee COMPARISONS INVOLVING TWO SAMPLE MEANS Two type of hypothee:. H o : Null Hypothei - hypothei of o differece. or 0. H A : Alterate Hypothei hypothei of differece. or 0 Two-tail v. Oe-tail

More information

10-716: Advanced Machine Learning Spring Lecture 13: March 5

10-716: Advanced Machine Learning Spring Lecture 13: March 5 10-716: Advaced Machie Learig Sprig 019 Lecture 13: March 5 Lecturer: Pradeep Ravikumar Scribe: Charvi Ratogi, Hele Zhou, Nicholay opi Note: Lae template courtey of UC Berkeley EECS dept. Diclaimer: hee

More information

Isolated Word Recogniser

Isolated Word Recogniser Lecture 5 Iolated Word Recogitio Hidde Markov Model of peech State traitio ad aligmet probabilitie Searchig all poible aligmet Dyamic Programmig Viterbi Aligmet Iolated Word Recogitio 8. Iolated Word Recogier

More information

Last time: Completed solution to the optimum linear filter in real-time operation

Last time: Completed solution to the optimum linear filter in real-time operation 6.3 tochatic Etimatio ad Cotrol, Fall 4 ecture at time: Completed olutio to the oimum liear filter i real-time operatio emi-free cofiguratio: t D( p) F( p) i( p) dte dp e π F( ) F( ) ( ) F( p) ( p) 4444443

More information

STRONG DEVIATION THEOREMS FOR THE SEQUENCE OF CONTINUOUS RANDOM VARIABLES AND THE APPROACH OF LAPLACE TRANSFORM

STRONG DEVIATION THEOREMS FOR THE SEQUENCE OF CONTINUOUS RANDOM VARIABLES AND THE APPROACH OF LAPLACE TRANSFORM Joural of Statitic: Advace i Theory ad Applicatio Volume, Number, 9, Page 35-47 STRONG DEVIATION THEORES FOR THE SEQUENCE OF CONTINUOUS RANDO VARIABLES AND THE APPROACH OF LAPLACE TRANSFOR School of athematic

More information

SOLUTION: The 95% confidence interval for the population mean µ is x ± t 0.025; 49

SOLUTION: The 95% confidence interval for the population mean µ is x ± t 0.025; 49 C22.0103 Sprig 2011 Homework 7 olutio 1. Baed o a ample of 50 x-value havig mea 35.36 ad tadard deviatio 4.26, fid a 95% cofidece iterval for the populatio mea. SOLUTION: The 95% cofidece iterval for the

More information

Erick L. Oberstar Fall 2001 Project: Sidelobe Canceller & GSC 1. Advanced Digital Signal Processing Sidelobe Canceller (Beam Former)

Erick L. Oberstar Fall 2001 Project: Sidelobe Canceller & GSC 1. Advanced Digital Signal Processing Sidelobe Canceller (Beam Former) Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC 1 Advaced Digital Sigal Proceig Sidelobe Caceller (Beam Former) Erick L. Obertar 001 Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC

More information

Fig. 1: Streamline coordinates

Fig. 1: Streamline coordinates 1 Equatio of Motio i Streamlie Coordiate Ai A. Soi, MIT 2.25 Advaced Fluid Mechaic Euler equatio expree the relatiohip betwee the velocity ad the preure field i ivicid flow. Writte i term of treamlie coordiate,

More information

VIII. Interval Estimation A. A Few Important Definitions (Including Some Reminders)

VIII. Interval Estimation A. A Few Important Definitions (Including Some Reminders) VIII. Iterval Etimatio A. A Few Importat Defiitio (Icludig Some Remider) 1. Poit Etimate - a igle umerical value ued a a etimate of a parameter.. Poit Etimator - the ample tatitic that provide the poit

More information

TESTS OF SIGNIFICANCE

TESTS OF SIGNIFICANCE TESTS OF SIGNIFICANCE Seema Jaggi I.A.S.R.I., Library Aveue, New Delhi eema@iari.re.i I applied ivetigatio, oe i ofte itereted i comparig ome characteritic (uch a the mea, the variace or a meaure of aociatio

More information

LECTURE 13 SIMULTANEOUS EQUATIONS

LECTURE 13 SIMULTANEOUS EQUATIONS NOVEMBER 5, 26 Demad-upply ytem LETURE 3 SIMULTNEOUS EQUTIONS I thi lecture, we dicu edogeeity problem that arie due to imultaeity, i.e. the left-had ide variable ad ome of the right-had ide variable are

More information

ELEC 372 LECTURE NOTES, WEEK 4 Dr. Amir G. Aghdam Concordia University

ELEC 372 LECTURE NOTES, WEEK 4 Dr. Amir G. Aghdam Concordia University ELEC 37 LECTURE NOTES, WEE 4 Dr Amir G Aghdam Cocordia Uiverity Part of thee ote are adapted from the material i the followig referece: Moder Cotrol Sytem by Richard C Dorf ad Robert H Bihop, Pretice Hall

More information

M227 Chapter 9 Section 1 Testing Two Parameters: Means, Variances, Proportions

M227 Chapter 9 Section 1 Testing Two Parameters: Means, Variances, Proportions M7 Chapter 9 Sectio 1 OBJECTIVES Tet two mea with idepedet ample whe populatio variace are kow. Tet two variace with idepedet ample. Tet two mea with idepedet ample whe populatio variace are equal Tet

More information

ECEN620: Network Theory Broadband Circuit Design Fall 2014

ECEN620: Network Theory Broadband Circuit Design Fall 2014 ECE60: etwork Theory Broadbad Circuit Deig Fall 04 Lecture 3: PLL Aalyi Sam Palermo Aalog & Mixed-Sigal Ceter Texa A&M Uiverity Ageda & Readig PLL Overview & Applicatio PLL Liear Model Phae & Frequecy

More information

Société de Calcul Mathématique, S. A. Algorithmes et Optimisation

Société de Calcul Mathématique, S. A. Algorithmes et Optimisation Société de Calcul Mathématique S A Algorithme et Optimiatio Radom amplig of proportio Berard Beauzamy Jue 2008 From time to time we fid a problem i which we do ot deal with value but with proportio For

More information

ON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION

ON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION Review of the Air Force Academy No. (34)/7 ON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION Aca Ileaa LUPAŞ Military Techical Academy, Bucharet, Romaia (lua_a@yahoo.com) DOI:.96/84-938.7.5..6 Abtract:

More information

8.6 Order-Recursive LS s[n]

8.6 Order-Recursive LS s[n] 8.6 Order-Recurive LS [] Motivate ti idea wit Curve Fittig Give data: 0,,,..., - [0], [],..., [-] Wat to fit a polyomial to data.., but wic oe i te rigt model?! Cotat! Quadratic! Liear! Cubic, Etc. ry

More information

Applied Mathematical Sciences, Vol. 9, 2015, no. 3, HIKARI Ltd,

Applied Mathematical Sciences, Vol. 9, 2015, no. 3, HIKARI Ltd, Applied Mathematical Sciece Vol 9 5 o 3 7 - HIKARI Ltd wwwm-hiaricom http://dxdoiorg/988/am54884 O Poitive Defiite Solutio of the Noliear Matrix Equatio * A A I Saa'a A Zarea* Mathematical Sciece Departmet

More information

Heat Equation: Maximum Principles

Heat Equation: Maximum Principles Heat Equatio: Maximum Priciple Nov. 9, 0 I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace

More information

ME 410 MECHANICAL ENGINEERING SYSTEMS LABORATORY REGRESSION ANALYSIS

ME 410 MECHANICAL ENGINEERING SYSTEMS LABORATORY REGRESSION ANALYSIS ME 40 MECHANICAL ENGINEERING REGRESSION ANALYSIS Regreio problem deal with the relatiohip betwee the frequec ditributio of oe (depedet) variable ad aother (idepedet) variable() which i (are) held fied

More information

Statistics and Chemical Measurements: Quantifying Uncertainty. Normal or Gaussian Distribution The Bell Curve

Statistics and Chemical Measurements: Quantifying Uncertainty. Normal or Gaussian Distribution The Bell Curve Statitic ad Chemical Meauremet: Quatifyig Ucertaity The bottom lie: Do we trut our reult? Should we (or ayoe ele)? Why? What i Quality Aurace? What i Quality Cotrol? Normal or Gauia Ditributio The Bell

More information

IntroEcono. Discrete RV. Continuous RV s

IntroEcono. Discrete RV. Continuous RV s ItroEcoo Aoc. Prof. Poga Porchaiwiekul, Ph.D... ก ก e-mail: Poga.P@chula.ac.th Homepage: http://pioeer.chula.ac.th/~ppoga (c) Poga Porchaiwiekul, Chulalogkor Uiverity Quatitative, e.g., icome, raifall

More information

20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE

20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE 20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE If the populatio tadard deviatio σ i ukow, a it uually will be i practice, we will have to etimate it by the ample tadard deviatio. Sice σ i ukow,

More information

Lecture 30: Frequency Response of Second-Order Systems

Lecture 30: Frequency Response of Second-Order Systems Lecture 3: Frequecy Repoe of Secod-Order Sytem UHTXHQF\ 5HVSRQVH RI 6HFRQGUGHU 6\VWHPV A geeral ecod-order ytem ha a trafer fuctio of the form b + b + b H (. (9.4 a + a + a It ca be table, utable, caual

More information

Adaptive control design for a Mimo chemical reactor

Adaptive control design for a Mimo chemical reactor Automatio, Cotrol ad Itelliget Sytem 013; 1(3): 64-70 Publihed olie July 10, 013 (http://www.ciecepublihiggroup.com/j/aci) doi: 10.11648/j.aci.0130103.15 Adaptive cotrol deig for a Mimo chemical reactor

More information

Formula Sheet. December 8, 2011

Formula Sheet. December 8, 2011 Formula Sheet December 8, 2011 Abtract I type thi for your coveice. There may be error. Ue at your ow rik. It i your repoible to check it i correct or ot before uig it. 1 Decriptive Statitic 1.1 Cetral

More information

Brief Review of Linear System Theory

Brief Review of Linear System Theory Brief Review of Liear Sytem heory he followig iformatio i typically covered i a coure o liear ytem theory. At ISU, EE 577 i oe uch coure ad i highly recommeded for power ytem egieerig tudet. We have developed

More information

STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN ( )

STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN ( ) STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN Suppoe that we have a ample of meaured value x1, x, x3,, x of a igle uow quatity. Aumig that the meauremet are draw from a ormal ditributio

More information

Assignment 1 - Solutions. ECSE 420 Parallel Computing Fall November 2, 2014

Assignment 1 - Solutions. ECSE 420 Parallel Computing Fall November 2, 2014 Aigmet - Solutio ECSE 420 Parallel Computig Fall 204 ovember 2, 204. (%) Decribe briefly the followig term, expoe their caue, ad work-aroud the idutry ha udertake to overcome their coequece: (i) Memory

More information

A Tail Bound For Sums Of Independent Random Variables And Application To The Pareto Distribution

A Tail Bound For Sums Of Independent Random Variables And Application To The Pareto Distribution Applied Mathematic E-Note, 9009, 300-306 c ISSN 1607-510 Available free at mirror ite of http://wwwmaththuedutw/ ame/ A Tail Boud For Sum Of Idepedet Radom Variable Ad Applicatio To The Pareto Ditributio

More information

Performance-Based Plastic Design (PBPD) Procedure

Performance-Based Plastic Design (PBPD) Procedure Performace-Baed Platic Deig (PBPD) Procedure 3. Geeral A outlie of the tep-by-tep, Performace-Baed Platic Deig (PBPD) procedure follow, with detail to be dicued i ubequet ectio i thi chapter ad theoretical

More information

CHAPTER 6. Confidence Intervals. 6.1 (a) y = 1269; s = 145; n = 8. The standard error of the mean is = s n = = 51.3 ng/gm.

CHAPTER 6. Confidence Intervals. 6.1 (a) y = 1269; s = 145; n = 8. The standard error of the mean is = s n = = 51.3 ng/gm. } CHAPTER 6 Cofidece Iterval 6.1 (a) y = 1269; = 145; = 8. The tadard error of the mea i SE ȳ = = 145 8 = 51.3 g/gm. (b) y = 1269; = 145; = 30. The tadard error of the mea i ȳ = 145 = 26.5 g/gm. 30 6.2

More information

JOURNAL OF THE INDIAN SOCIETY OF AGRICULTURAL STATISTICS

JOURNAL OF THE INDIAN SOCIETY OF AGRICULTURAL STATISTICS Available olie at www.ia.org.i/jia JOURA OF THE IDIA OIETY OF AGRIUTURA TATITI 64() 00 55-60 Variace Etimatio for te Regreio Etimator of te Mea i tratified amplig UMMARY at Gupta * ad Javid abbir Departmet

More information

13.4 Scalar Kalman Filter

13.4 Scalar Kalman Filter 13.4 Scalar Kalma Filter Data Model o derive the Kalma filter we eed the data model: a 1 + u < State quatio > + w < Obervatio quatio > Aumptio 1. u i zero mea Gauia, White, u } σ. w i zero mea Gauia, White,

More information

Tables and Formulas for Sullivan, Fundamentals of Statistics, 2e Pearson Education, Inc.

Tables and Formulas for Sullivan, Fundamentals of Statistics, 2e Pearson Education, Inc. Table ad Formula for Sulliva, Fudametal of Statitic, e. 008 Pearo Educatio, Ic. CHAPTER Orgaizig ad Summarizig Data Relative frequecy frequecy um of all frequecie Cla midpoit: The um of coecutive lower

More information

Chapter 9: Hypothesis Testing

Chapter 9: Hypothesis Testing Chapter 9: Hypothei Tetig Chapter 5 dicued the cocept of amplig ditributio ad Chapter 8 dicued how populatio parameter ca be etimated from a ample. 9. Baic cocept Hypothei Tetig We begi by makig a tatemet,

More information

On the Signed Domination Number of the Cartesian Product of Two Directed Cycles

On the Signed Domination Number of the Cartesian Product of Two Directed Cycles Ope Joural of Dicrete Mathematic, 205, 5, 54-64 Publihed Olie July 205 i SciRe http://wwwcirporg/oural/odm http://dxdoiorg/0426/odm2055005 O the Siged Domiatio Number of the Carteia Product of Two Directed

More information

Professor: Mihnea UDREA DIGITAL SIGNAL PROCESSING. Grading: Web: MOODLE. 1. Introduction. General information

Professor: Mihnea UDREA DIGITAL SIGNAL PROCESSING. Grading: Web:   MOODLE. 1. Introduction. General information Geeral iformatio DIGITL SIGL PROCESSIG Profeor: ihea UDRE B29 mihea@comm.pub.ro Gradig: Laboratory: 5% Proect: 5% Tet: 2% ial exam : 5% Coure quiz: ±% Web: www.electroica.pub.ro OODLE 2 alog igal proceig

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Confidence Intervals: Three Views Class 23, Jeremy Orloff and Jonathan Bloom

Confidence Intervals: Three Views Class 23, Jeremy Orloff and Jonathan Bloom Cofidece Iterval: Three View Cla 23, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goal 1. Be able to produce z, t ad χ 2 cofidece iterval baed o the correpodig tadardized tatitic. 2. Be able to ue a hypothei

More information

EECE 301 Signals & Systems Prof. Mark Fowler

EECE 301 Signals & Systems Prof. Mark Fowler EECE 30 Sigal & Sytem Prof. Mark Fowler Note Set #8 C-T Sytem: Laplace Traform Solvig Differetial Equatio Readig Aigmet: Sectio 6.4 of Kame ad Heck / Coure Flow Diagram The arrow here how coceptual flow

More information

EULER-MACLAURIN SUM FORMULA AND ITS GENERALIZATIONS AND APPLICATIONS

EULER-MACLAURIN SUM FORMULA AND ITS GENERALIZATIONS AND APPLICATIONS EULER-MACLAURI SUM FORMULA AD ITS GEERALIZATIOS AD APPLICATIOS Joe Javier Garcia Moreta Graduate tudet of Phyic at the UPV/EHU (Uiverity of Baque coutry) I Solid State Phyic Addre: Practicate Ada y Grijalba

More information

We will look for series solutions to (1) around (at most) regular singular points, which without

We will look for series solutions to (1) around (at most) regular singular points, which without ENM 511 J. L. Baai April, 1 Frobeiu Solutio to a d order ODE ear a regular igular poit Coider the ODE y 16 + P16 y 16 + Q1616 y (1) We will look for erie olutio to (1) aroud (at mot) regular igular poit,

More information

ECE 422 Power System Operations & Planning 6 Small Signal Stability. Spring 2015 Instructor: Kai Sun

ECE 422 Power System Operations & Planning 6 Small Signal Stability. Spring 2015 Instructor: Kai Sun ECE 4 Power Sytem Operatio & Plaig 6 Small Sigal Stability Sprig 15 Itructor: Kai Su 1 Referece Saadat Chapter 11.4 EPRI Tutorial Chapter 8 Power Ocillatio Kudur Chapter 1 Power Ocillatio The power ytem

More information

Explicit scheme. Fully implicit scheme Notes. Fully implicit scheme Notes. Fully implicit scheme Notes. Notes

Explicit scheme. Fully implicit scheme Notes. Fully implicit scheme Notes. Fully implicit scheme Notes. Notes Explicit cheme So far coidered a fully explicit cheme to umerically olve the diffuio equatio: T + = ( )T + (T+ + T ) () with = κ ( x) Oly table for < / Thi cheme i ometime referred to a FTCS (forward time

More information

Tools Hypothesis Tests

Tools Hypothesis Tests Tool Hypothei Tet The Tool meu provide acce to a Hypothei Tet procedure that calculate cofidece iterval ad perform hypothei tet for mea, variace, rate ad proportio. It i cotrolled by the dialog box how

More information

Confidence Intervals. Confidence Intervals

Confidence Intervals. Confidence Intervals A overview Mot probability ditributio are idexed by oe me parameter. F example, N(µ,σ 2 ) B(, p). I igificace tet, we have ued poit etimat f parameter. F example, f iid Y 1,Y 2,...,Y N(µ,σ 2 ), Ȳ i a poit

More information

On the 2-Domination Number of Complete Grid Graphs

On the 2-Domination Number of Complete Grid Graphs Ope Joural of Dicrete Mathematic, 0,, -0 http://wwwcirporg/oural/odm ISSN Olie: - ISSN Prit: - O the -Domiatio Number of Complete Grid Graph Ramy Shahee, Suhail Mahfud, Khame Almaea Departmet of Mathematic,

More information

Estimation and Control under Communication Network Constraints

Estimation and Control under Communication Network Constraints Etimatio ad Cotrol uder Commuicatio Network Cotrait A Thei Preeted by Bei Ya to The Departmet of Electrical ad Computer Egieerig i partial fulfillmet of the requiremet for the degree of Mater of Sciece

More information

On The Computation Of Weighted Shapley Values For Cooperative TU Games

On The Computation Of Weighted Shapley Values For Cooperative TU Games O he Computatio Of Weighted hapley Value For Cooperative U Game Iriel Draga echical Report 009-0 http://www.uta.edu/math/preprit/ Computatio of Weighted hapley Value O HE COMPUAIO OF WEIGHED HAPLEY VALUE

More information

100(1 α)% confidence interval: ( x z ( sample size needed to construct a 100(1 α)% confidence interval with a margin of error of w:

100(1 α)% confidence interval: ( x z ( sample size needed to construct a 100(1 α)% confidence interval with a margin of error of w: Stat 400, ectio 7. Large Sample Cofidece Iterval ote by Tim Pilachowki a Large-Sample Two-ided Cofidece Iterval for a Populatio Mea ectio 7.1 redux The poit etimate for a populatio mea µ will be a ample

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 16 11/04/2013. Ito integral. Properties

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 16 11/04/2013. Ito integral. Properties MASSACHUSES INSIUE OF ECHNOLOGY 6.65/15.7J Fall 13 Lecture 16 11/4/13 Ito itegral. Propertie Cotet. 1. Defiitio of Ito itegral. Propertie of Ito itegral 1 Ito itegral. Exitece We cotiue with the cotructio

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

Gain-scheduling of Acceleration Estimator for Low-velocity Measurement with Encoders

Gain-scheduling of Acceleration Estimator for Low-velocity Measurement with Encoders Jue -5, INTEX, Gyeoggi-Do, orea Gai-chedulig of Acceleratio Etimator for Low-velocity Meauremet with Ecoder Seug-Woo So, Sag-Hu Lee ad Jog-Sug Hur Electro-Mechaical Reearch Ititute, Hyudai Heavy Idutrie

More information

CONTROL SYSTEMS. Chapter 7 : Bode Plot. 40dB/dec 1.0. db/dec so resultant slope will be 20 db/dec and this is due to the factor s

CONTROL SYSTEMS. Chapter 7 : Bode Plot. 40dB/dec 1.0. db/dec so resultant slope will be 20 db/dec and this is due to the factor s CONTROL SYSTEMS Chapter 7 : Bode Plot GATE Objective & Numerical Type Solutio Quetio 6 [Practice Book] [GATE EE 999 IIT-Bombay : 5 Mark] The aymptotic Bode plot of the miimum phae ope-loop trafer fuctio

More information

Last time: Ground rules for filtering and control system design

Last time: Ground rules for filtering and control system design 6.3 Stochatic Etimatio ad Cotrol, Fall 004 Lecture 7 Lat time: Groud rule for filterig ad cotrol ytem deig Gral ytem Sytem parameter are cotaied i w( t ad w ( t. Deired output i grated by takig the igal

More information

Pile-up Probabilities for the Laplace Likelihood Estimator of a Non-invertible First Order Moving Average

Pile-up Probabilities for the Laplace Likelihood Estimator of a Non-invertible First Order Moving Average IMS Lecture Note Moograph Serie c Ititute of Mathematical Statitic, Pile-up Probabilitie for the Laplace Likelihood Etimator of a No-ivertible Firt Order Movig Average F. Jay Breidt 1,, Richard A. Davi,3,

More information

Further Investigation of alternative Formulation of RP Model with Response Error. Ed Stanek

Further Investigation of alternative Formulation of RP Model with Response Error. Ed Stanek Further vetigatio of alterative Formulatio of RP odel with Repoe Error Ed Staek TRODCTO We explore the predictor that will reult i a imple radom ample with repoe error whe a differet model i potulated

More information

Noise Enhancement for Weighted Sum of Type I and II Error Probabilities with Constraints

Noise Enhancement for Weighted Sum of Type I and II Error Probabilities with Constraints etropy Article Noie Ehacemet for Weighted Sum of Type I ad II Error Probabilitie with Cotrait Shuju iu, Tig Yag ad Kui Zhag * College of Commuicatio Egieerig, Chogqig Uiverity, Chogqig 444, Chia; liuj@cqu.edu.c

More information

Reasons for Sampling. Forest Sampling. Scales of Measurement. Scales of Measurement. Sampling Error. Sampling - General Approach

Reasons for Sampling. Forest Sampling. Scales of Measurement. Scales of Measurement. Sampling Error. Sampling - General Approach Foret amplig Aver & Burkhart, Chpt. & Reao for amplig Do NOT have the time or moe to do a complete eumeratio Remember that the etimate of the populatio parameter baed o a ample are ot accurate, therefore

More information

Weak formulation and Lagrange equations of motion

Weak formulation and Lagrange equations of motion Chapter 4 Weak formulatio ad Lagrage equatio of motio A mot commo approach to tudy tructural dyamic i the ue of the Lagrage equatio of motio. Thee are obtaied i thi chapter tartig from the Cauchy equatio

More information

Chapter 1 ASPECTS OF MUTIVARIATE ANALYSIS

Chapter 1 ASPECTS OF MUTIVARIATE ANALYSIS Chapter ASPECTS OF MUTIVARIATE ANALYSIS. Itroductio Defiitio Wiipedia: Multivariate aalyi MVA i baed o the tatitical priciple of multivariate tatitic which ivolve obervatio ad aalyi of more tha oe tatitical

More information

Statistical treatment of test results

Statistical treatment of test results SCAN-G :07 Revied 007 Pulp, paper ad board Statitical treatmet of tet reult 0 Itroductio The value of tatitical method lie i the fact that they make it poible to iterpret tet reult accordig to trictly

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

In Lecture 25, the noisy edge data was modeled as a series of connected straight lines plus iid N(0,

In Lecture 25, the noisy edge data was modeled as a series of connected straight lines plus iid N(0, Lecture 26 A More Real-Life Edge oiy Meauremet Model (ad So Much More ) Oe ca ue all maer of tool to aalyze data But the way to bet aalyze data i to try to replicate it with a model I Lecture 25 we preeted

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

1it is said to be overdamped. When 1, the roots of

1it is said to be overdamped. When 1, the roots of Homework 3 AERE573 Fall 8 Due /8(M) SOLUTIO PROBLEM (4pt) Coider a D order uderdamped tem trafer fuctio H( ) ratio The deomiator i the tem characteritic polomial P( ) (a)(5pt) Ue the quadratic formula,

More information

A tail bound for sums of independent random variables : application to the symmetric Pareto distribution

A tail bound for sums of independent random variables : application to the symmetric Pareto distribution A tail boud for um of idepedet radom variable : applicatio to the ymmetric Pareto ditributio Chritophe Cheeau To cite thi verio: Chritophe Cheeau. A tail boud for um of idepedet radom variable : applicatio

More information

UNIVERSITY OF CALICUT

UNIVERSITY OF CALICUT Samplig Ditributio 1 UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION BSc. MATHEMATICS COMPLEMENTARY COURSE CUCBCSS 2014 Admiio oward III Semeter STATISTICAL INFERENCE Quetio Bak 1. The umber of poible

More information

Fractional parts and their relations to the values of the Riemann zeta function

Fractional parts and their relations to the values of the Riemann zeta function Arab. J. Math. (08) 7: 8 http://doi.org/0.007/40065-07-084- Arabia Joural of Mathematic Ibrahim M. Alabdulmohi Fractioal part ad their relatio to the value of the Riema zeta fuctio Received: 4 Jauary 07

More information

Difference tests (1): parametric

Difference tests (1): parametric NST B Eperimetal Pychology Statitic practical Differece tet (): parametric Rudolf Cardial & Mike Aitke / 3 December 003; Departmet of Eperimetal Pychology Uiverity of Cambridge Hadout: Awer to Eample (from

More information

A criterion for easiness of certain SAT-problems

A criterion for easiness of certain SAT-problems A criterio for eaie of certai SAT-problem Berd R. Schuh Dr. Berd Schuh, D-50968 Köl, Germay; berd.chuh@etcologe.de keyword: compleity, atifiability, propoitioal logic, P, NP, -i-3sat, eay/hard itace Abtract.

More information

THE CONCEPT OF THE ROOT LOCUS. H(s) THE CONCEPT OF THE ROOT LOCUS

THE CONCEPT OF THE ROOT LOCUS. H(s) THE CONCEPT OF THE ROOT LOCUS So far i the tudie of cotrol yte the role of the characteritic equatio polyoial i deteriig the behavior of the yte ha bee highlighted. The root of that polyoial are the pole of the cotrol yte, ad their

More information

CONTROL ENGINEERING LABORATORY

CONTROL ENGINEERING LABORATORY Uiverity of Techology Departmet of Electrical Egieerig Cotrol Egieerig Lab. CONTROL ENGINEERING LABORATORY By Dr. Abdul. Rh. Humed M.Sc. Quay Salim Tawfeeq M.Sc. Nihad Mohammed Amee M.Sc. Waleed H. Habeeb

More information

Hidden Markov Model Parameters

Hidden Markov Model Parameters .PPT 5/04/00 Lecture 6 HMM Traiig Traiig Hidde Markov Model Iitial model etimate Viterbi traiig Baum-Welch traiig 8.7.PPT 5/04/00 8.8 Hidde Markov Model Parameter c c c 3 a a a 3 t t t 3 c a t A Hidde

More information

Queueing Theory (Part 3)

Queueing Theory (Part 3) Queueig Theory art 3 M/M/ Queueig Sytem with Variatio M/M/, M/M///K, M/M//// Queueig Theory- M/M/ Queueig Sytem We defie λ mea arrival rate mea ervice rate umber of erver > ρ λ / utilizatio ratio We require

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Statistics Problem Set - modified July 25, _. d Q w. i n

Statistics Problem Set - modified July 25, _. d Q w. i n Statitic Problem Set - modified July 5, 04 x i x i i x i _ x x _ t d Q w F x x t pooled calculated pooled. f d x x t calculated / /.. f d Kow cocept of Gauia Curve Sytematic Error Idetermiate Error t-tet

More information

a 1 = 1 a a a a n n s f() s = Σ log a 1 + a a n log n sup log a n+1 + a n+2 + a n+3 log n sup () s = an /n s s = + t i

a 1 = 1 a a a a n n s f() s = Σ log a 1 + a a n log n sup log a n+1 + a n+2 + a n+3 log n sup () s = an /n s s = + t i 0 Dirichlet Serie & Logarithmic Power Serie. Defiitio & Theorem Defiitio.. (Ordiary Dirichlet Serie) Whe,a,,3, are complex umber, we call the followig Ordiary Dirichlet Serie. f() a a a a 3 3 a 4 4 Note

More information

Chapter 8.2. Interval Estimation

Chapter 8.2. Interval Estimation Chapter 8.2. Iterval Etimatio Baic of Cofidece Iterval ad Large Sample Cofidece Iterval 1 Baic Propertie of Cofidece Iterval Aumptio: X 1, X 2,, X are from Normal ditributio with a mea of µ ad tadard deviatio.

More information

Parameter Estimation for Discretely Observed Vasicek Model Driven by Small Lévy Noises

Parameter Estimation for Discretely Observed Vasicek Model Driven by Small Lévy Noises arameter Etimatio for Dicretely Oberved Vaicek Model Drive by Small Lévy Noie Chao Wei Abtract Thi paper i cocered with the parameter etimatio problem for Vaicek model drive by mall Lévy oie from dicrete

More information

Collective Support Recovery for Multi-Design Multi-Response Linear Regression

Collective Support Recovery for Multi-Design Multi-Response Linear Regression IEEE TRANACTION ON INFORMATION THEORY, VOL XX, NO XX, XX 4 Collective upport Recovery for Multi-Deig Multi-Repoe Liear Regreio eiguag ag, Yigbi Liag, Eric P Xig Abtract The multi-deig multi-repoe MDMR

More information

Statistical Equations

Statistical Equations Statitical Equatio You are permitted to ue the iformatio o thee page durig your eam. Thee page are ot guarateed to cotai all the iformatio you will eed. If you fid iformatio which you believe hould be

More information

Estimation Theory. goavendaño. Estimation Theory

Estimation Theory. goavendaño. Estimation Theory Etimatio Theory Statitical Iferece method by which geeralizatio are made about a populatio Two Major Area of Statitical Iferece. Etimatio a parameter i etablihed baed o the amplig ditributio of a proportio,

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

4. Partial Sums and the Central Limit Theorem

4. Partial Sums and the Central Limit Theorem 1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems

More information