Closed-form two-step weighted-leastsquares-based. localisation using invariance property of maximum likelihood estimator in multiplesample

Size: px
Start display at page:

Download "Closed-form two-step weighted-leastsquares-based. localisation using invariance property of maximum likelihood estimator in multiplesample"

Transcription

1 IET Commuiatios Researh Artile Closed-form two-step weighted-leastsquares-based time-of-arrival soure loalisatio usig ivariae property of maximum likelihood estimator i multiplesample eviromet Chee-Hyu Park, Joo-Hyuk Chag Shool of Eletroi Egieerig, Hayag Uiversity, Seoul , Korea jhag@hayag.a.kr ISSN Reeived o d Otober 015 Revised o d Jauary 016 Aepted o d February 016 doi: /iet-om Abstrat: I this study, the authors propose a losed-form time-of-arrival soure loalisatio method ad justify the employmet of the ivariae property of the maximum likelihood (ML) estimator i the soure loalisatio otext with multiple samples. The magitude of the bias of the proposed sample vetor futio (the statisti that osists of the multiple observatios set) usig the ivariae property of the ML estimator is smaller tha that based o the sample mea. Therefore, the mea squared error (MSE) of the weighted least squares estimate usig the proposed sample vetor futio is smaller tha that based o the sample mea whe the variaes of both sample vetor futios are the same. Furthermore, the authors ivestigate a situatio i whih sesors have erroeous positio iformatio. The simulatio results show that the averaged MSE performae of the proposed method is superior to that of the existig methods irrespetive of the umber of samples. 1 Itrodutio Soure loalisatio is a tehique that fids a geometrial poit of itersetio usig measuremets from eah reeiver suh as the time differee of arrival, the time of arrival (TOA), the reeived sigal stregth or the agle of arrival. Loalisig poit soures usig passive ad statioary sesors is of osiderable iterest ad has bee a repeated theme of researh i teleommuiatio areas, video ofereig ad global positioig systems (GPSs). Several loalisatio methods have existed. Oe of them uses the Gauss Newto algorithm based o the Taylor-series expasio [1]. The bias i the loatio estimate from the Gaussia measuremet oise ad sesor positio errors has bee aalysed []. The total least squares method was adopted to elimiate the bias i the ovetioal loatio estimator [3]. The problem of optimum sesor plaemet for soure loalisatio usig TOA measuremets was ivestigated [4]. A target loalisatio method for a multi-stati passive radar system was proposed usig TOA measuremets through ovex optimisatio ad adoptig semi-defiite relaxatio ad bisetio methods [5]. Loalisatio methods usig robust statistis have bee proposed for o-lie-of-sight eviromets [6, 7]. Also, a losed-form two-step weighted least squares (WLS) positioig algorithm that attais the the Cramer-Rao lower boud (CRLB) uder suffiietly small oise oditios was already developed [8 10]. However, a weakess of the two-step WLS method is that its performae is severely degraded whe the variae of oise is large. Reetly, a losed-form shrikage-based loalisatio method usig the miimum mea squared error (MSE) riterio was ivestigated [11]. This algorithm improved the loalisatio performae of the two-step WLS method i large oise variae oditios by modifyig the blid shrikage estimator [1] suh that it a be effiietly utilised i the TOA-based soure loalisatio otext. This shrikage method is appropriate for moderate ad large samples situatios, but its averaged MSE performae beomes iferior to that of the two-step WLS method with a small umber of samples beause the shrikage fator loses auray below a ertai sample size. To overome this disadvatage of the shrikage estimatio, we propose a loalisatio algorithm that adopts the maximum likelihood (ML) estimator based o the ivariae property. The motivatio for this paper is give i the followig. This paper justifies the utilisatio of the ML estimator based o the ivariae property i the multiple-sample-based soure loalisatio. To the best of our kowledge, ay proof for the optimality of the ML estimator i the multiple-sample-based soure loalisatio otext has ot bee performed. As the MSE of a sample vetor futio (statisti that osists of the futio of the measuremets) beomes larger, the MSE of a WLS estimate usig the orrespodig sample vetor futio also beomes larger. Therefore, determiig a sample vetor futio with the smallest possible MSE is importat. We use the ML estimator to determie a more optimal sample vetor futio beause the ML estimator is a asymptotially effiiet estimator [13, 14]. Whe the variaes of two differet sample vetor futios are the same, as the magitude of the bias is larger, the MSE of the WLS estimate usig that sample vetor futio is also larger. The proposed WLS estimate is show to have less bias tha that attaied usig the existig WLS estimate. As a result, the MSE of the WLS estimate based o the proposed sample vetor futio is smaller tha that attaied from the existig sample vetor futio whe the variaes of the sample vetor futios are the same. Also, the estimated value outside the parameter spae is restrited. This ostraied estimate a be iterpreted as the ML estimate. Simulatio results show that the proposed method is superior to the ovetioal two-step WLS estimate based o the sample mea eve with a small umber of samples, whereas the shrikage estimator is iferior to the two-step WLS estimator i that oditio. Furthermore, the proposed method also outperforms the shrikage estimator whe the umber of measuremets is moderate or large. The orgaisatio of this paper is as follows. Setio explais the soure loalisatio problem to be solved i this paper. The proposed positioig method based o the two-step WLS algorithm usig the ivariae property of the ML estimator is addressed i Setio 3. The estimatio performaes 106 & The Istitutio of Egieerig ad Tehology 016

2 of the proposed method are evaluated ad ompared with the existig algorithms via simulatio results i Setio 4. Setio 5 presets our olusios ad suggestios for future works. Problem formulatio The TOA soure loalisatio method fids the positio of a soure by usig multiple irles whose etres represet the positios of sesors. I the otext of the lie-of-sight soure loalisatio, the measuremet equatio is represeted as follows: r i,j = d i + i,j = (x x o i ) + (y y o i ) + i,j, (1) i whih i, j follows N(0, s i ). Also, i =1,,, M, j =1,,, P with M ad P deotig the total umber of sesors ad the umber of samples i the ith sesor, r i, j is the measured distae betwee the soure ad the ith sesor at the jth samplig ad d i is the true distae betwee the soure ad the ith sesor. Also, [x y] T is the true soure positio ad [x o i y o i ]T is the aurate positio of the ith sesor without loatio error. Note that, throughout this paper, a lowerase boldfae letter deotes a vetor, a upperase boldfae letter idiates a matrix ad the supersript T sigifies the vetor/matrix traspose. Squarig (1) ad rearragig yields the followig equatio x o i x + y o i y 0.5R + m i,j = 0.5(x o i + y o i ri,j), i = 1,,..., M, j = 1,,..., P () where R = x + y, m i,j = d i i,j (1/) i,j, i = 1,..., M, j = 1,..., P. For oveiee, () a be simply represeted i matrix form as Note that Ax + q j = b j. (3) x o 1 y o A =..., x o M yo M 0.5 x = [x yr] T, q j = [m 1,j,..., m M,j ] T, x o 1 + y o 1 r b j = 1 1,j.. (4) x o M + y o M rm,j The aim of this paper is to fid the soure positio suh that the MSE of the positio estimate is miimised. 3 Proposed losed-form two-step WLS-based TOA soure loalisatio method usig the ML estimator based o the ivariae property with multiple samples I this setio, we adopt the ML estimator based o the ivariae property to derive the estimate of the loatio i the multiple-sample eviromet, where the first ase is for the preisely kow sesor positios ad the seod ase is for the self-loalisatio seario. 3.1 Case 1: preisely kow sesor positios The existig TOA loalisatio algorithm for multiple samples is based o the followig likelihood futio [11] 1 p(b 1:P ; x) = (p) MP/ C q P/ { } (5) exp 1 P (b j Ax) T C 1 q (b j Ax) where C q deotes the ovariae matrix of q ad is represeted i the followig by egletig the seod-order oise term uder suffiietly small oise oditios { {C q } i,k = d i s i, if i = k; 0, if i = k, { (6) r i s i, if i = k; 0, if i = k, {C q } i,k represets the (i, k)th ompoet of C q ad d i is the true value of r i. Also, we adopt the sample vetor futio to extrat the loatio iformatio i the multiple-sample eviromet ad it is defied as the statisti whih osists of the ombiatio of the measuremet vetors. I this paper, two sample vetor futios are dealt with, that is, oe is (1/P) P b j usig the sample mea ad the other is b iv based o the ivariae property of the ML estimator. The first-step WLS estimator from (5) is determied as (A T C 1 q A) 1 A T C 1 q {(1/P) P b j}. The expeted value of the ith ompoet of the sample vetor futio based o the sample mea ({(1/P) P b j } i ) is {bo j } i (1/)s i,j ad b o j is the true value of b j. Here, {m} i is the ith ompoet of the vetor m. Whe the statioary state is assumed withi the estimatio iterval, the time idex j a be omitted ad the expeted value of the ith ompoet of the sample vetor futio based o the sample mea a be rewritte as {b o j } i (1/)s i = {Ax} i (1/)s i. The, the magitude of the bias for {(1/P) P b j } i is (1/)s i. We use the ML estimate based o the ivariae property to redue the bias of the sample vetor futio beause the ML estimator is a asymptotially ubiased estimator [14]. The ivariae property meas that if û is the ML estimator of θ ad g(θ) is ay trasformatio of θ, the the ML estimator for g(θ) is by defiitio g(û). I a TOA loalisatio otext, the ith elemet (1 i M) of the sample vetor futio that uses the ivariae property of the ML estimate, i.e. {b iv } i, is determied as (x o i + y o i ( r i ML ) )/ ad r i ML is P r i,j/p. The approximate Gaussiaity of the oise ompoet of b iv,defied as q iv, a be proved as follows. The ith ompoet of b iv is represeted as ( ) {b iv } i = 1 xo i + y o i 1 P r P i,j ( ) = 1 xo i + y o i d i + 1 P P i,j ( ) = 1 xo i + y o i di d P i P i,j 1 P P i,j { } 1 xo i + y o i di d P i P i,j. (7) I the derivatio of the last term of (7), the seod-order oise term was igored by assumig a suffiietly small oise oditio. The, & The Istitutio of Egieerig ad Tehology

3 the oise ompoet of {b iv } i is foud as {q iv } i d P i P i,j. (8) As a be see from (8), {q iv } i follows the Gaussia distributio uder a suffiietly small oise oditio, thus q iv follows the multivariate ormal distributio. Cosequetly, the improved likelihood futio is attaied as follows p(b iv 1 ; x) = (p) M/ exp 1/ C q iv { 1 } (9) (biv Ax) T C 1 q iv(biv Ax) where q iv = b iv Ax. Also, the oise ovariae matrix of q iv is determied i the followig {C q iv} i,k = E[{q iv } i {q iv } k ] 0, if i = k; = di s i, if i = k. P 0, if i = k; ( r i ML ) s i, if i = k. P (10) Differetiatig the logarithm of (9) with respet to x ad settig it to zero yields x iv = (A T C 1 q iva) 1 A T C 1 q ivbiv. (11) As E{b iv } i = {b o } i 1 P s i, the magitude of the bias for the sample vetor futio {b iv } i is (1/P)s i ad it is smaller tha that of {(1/P) P b j } i by P times. Usig the above property, the MSE of the first-step WLS estimate that uses the sample vetor futio based o the ivariae property is obtaied as follows (see Appedix for more details) MSE( x iv ) = 1 P tr{(at C 1 q A) 1 } + 1 tr[qs] (1) 4P where Q = C 1 q A(AT C 1 q A) A T C 1 q ad [S] i,k = s i s k. Meawhile, the MSE of the first-step WLS estimate that exploits the sample mea is represeted (after some algebra) as follows MSE( x e ) = 1 P tr{(at C 1 q A) 1 } + 1 tr[qs]. (13) 4 Sie MSE( x iv ) (1/P)tr{(A T C 1 q A) 1 } 0, tr[qs] is o-egative. Thus, the MSE of the first-step WLS estimate that uses the sample vetor futio based o the ivariae property is smaller tha that obtaied from the sample mea. Note that all pairs of estimators are futios of the omplete suffiiet statisti with regard to their respetive likelihood futio. The ompleteess of the suffiiet statisti of (5) ad (9) a be show as follows. The suffiiet statisti of (9) is A T C 1 q ivbiv. The probability desity futio of this suffiiet statisti is give by p(a T C 1 1 q ivbiv ; x) = (p) 3/ exp 1/ R [ 1 ] {AT C 1 q iv(biv Ax)} T R 1 {A T C 1 q iv(biv Ax)} where R = (1/P)(A T C 1 q A). By lettig AT C 1 q ivbiv = t, (14) the suffiiet statisti t is omplete whe E[f (t)] = 0 implies f (t) = 0, where f :R 3 R 1. I this regard, E[f (t)] = 0 a be rewritte as V f (t)p(t; x)dt = 0 (15) where Ω is the support for the suffiiet statisti t. Note that the expetatio of f (t) aot be zero uless f (t) = 0 everywhere from (15) so that t is the omplete suffiiet statisti. Furthermore, (11) beomes loser to the miimum variae ubiased estimator tha the WLS estimator derived from (5) beause the bias of the WLS estimator usig the ivariae property is smaller tha that of the outerpart equatio [13, 14]. The, the followig seod-step estimator is obtaied usig the relatioship betwee the first-step estimates where ẑ iv = (G T C 1 h ivg) 1 G T C 1 h ivhiv (16) h iv = [{ x iv } 1 { xiv } { xiv } 3 ] T, C h iv = 1 P diag(x, y, 1)(AT C 1 q A) 1 diag(x, y, 1), with x, y substituted as { x iv } 1,{ x iv } i the alulatio of C h iv. Also, it a be show that the MSE of the seod-step WLS estimate of the proposed method is smaller tha that based o the sample mea i the same maer. The fial loatio estimate is [ ] T x iv = sg({ x iv } 1 ) {ẑ iv } 1 sg({ x iv } ) {ẑ iv }. (17) 3. Case : self-loalisatio seario; sesors with erroeous oordiates exist with sesors that have preise positio iformatio I pratial appliatios, the sesor positios used for the positioig task might have errors [10]. For example, i the absolute self-loalisatio problem, the sesors are ategorised ito ahor odes ad pseudo-ahors. The positios of the ahor odes are kow with omparatively higher auray tha the other odes from the GPS ad the oordiates of the pseudo-ahors are estimated with the aid of the ahor odes. There are errors i the oordiates of the pseudo-ahors beause they are estimated values. Therefore, the effets of the erroeous positios of the pseudo-ahor odes should be take ito aout to loalise the eighbourig ukow sesors more preisely. I this setio, we develop a loalisatio algorithm that alleviates these adverse effets aused by sesor positio errors i a multiple-sample seario. We assume that the first L sesors are the ahor odes ad the remaiig M L sesors are pseudo-ahors. The measuremet equatios for the first L ahor odes are the same with (1) (4). The measuremet equatio for the sesors with erroeous positio iformatio is represeted by assumig a suffiietly high sigal-to-oise ratio oditio as follows 1 (x i + y i ri,j ) (x i x + y i y 0.5R) = (x o i x)w xi + (y o i y)w yi d i i,j, i = L + 1, L +,..., M, j = 1,,..., P. (18) where w xi ad w yi are the sesor positio errors with N(0, s s,i) ad s s,i is the variae of the ith sesor positio error [15 19]. 108 & The Istitutio of Egieerig ad Tehology 016

4 where b,j = [b v j b T p,j ]T, A = [A T A T p ]T ad q,j = [q T j q T p,j ]T. b j, A ad q j are the same with those defied i Setio. The, the sample vetor futio (b iv ) foud usig the ML estimator based o the ivariae property is represeted as x o i + y o i ( r i ML ), i = 1,..., L, } i = x i + y i ( r i ML ), i = L + 1,..., M. {b iv () As a be see from (4) ad (0), the error vetor b iv A x, represeted as q iv, is the multivariate Gaussia distributio uder a suffiietly small oise oditios. The likelihood futio of the ombied model is represeted as Fig. 1 Deploymet of sesors Represetig (18) i a matrix form yields p(b iv 1 ; x) = (p) M/ exp 1/ C q iv { 1 } (biv A x) T C 1 (b iv A x) q iv (3) Note that A p x + q p,j = b p,j. (19) x L+1 y L A p =..., x M y M 0.5 q p,j = [v L+1,j,..., v M,j ] T, x b p,j = 1 L+1 + y L+1 rl+1,j., (0) x M + y M r M,j where i = L +1,, M, j =1,, P ad v i,j = (x o i x)w xi + (y o i y)w yi d i i,j. Combiig the measuremet equatios from (4) ad (0) leads to the followig: b,j = A x + q,j (1) where q iv = b iv A x. The first-step WLS estimator is the obtaied from (3) x iv = (A T C 1 A ) 1 A T C 1 q iv q iv b iv. (4) The ovariae matrix C q iv a be derived i the same maer with (8) (10) as follows: {C q iv} i,k = 0, if i = k; ( r i ML ) s i, if i = k ad i L; P ( r ML i ) s i + ( r ML i ) s s,i, if i = k ad i. L. P (5) The seod-step WLS solutio is obtaied usig the relatioship betwee the first-step WLS estimates ẑ iv = (G T C 1 G) 1 G T C 1 h iv h iv h iv (6) Fig. Compariso of averaged MSE of the proposed method with that of the existig methods (sample umber = 3) & The Istitutio of Egieerig ad Tehology

5 Fig. 3 Compariso of averaged MSE of the proposed method with that of the existig methods (sample umber = 10) where C h iv = diag(x, y, 1)(A T C 1 A ) 1 diag(x, y, 1), ad x, y are substituted as { x iv The fial loatio estimate is x iv,f = q iv } 1,{ x iv } i the alulatio of C h iv. [ ] T sg({ x iv } 1 ) {ẑ iv } 1 sg({ x iv } ) {ẑ iv }. (7) 4 Simulatio results I this setio, we ompare the performae of the proposed soure loalisatio algorithm with that of the ovetioal method. The first sesor at the oordiates (0, 0) was set as the referee sesor ad the soure was assumed to be withi a 0 m square ell to determie the performae over the etire regio. The umber of sesors was six. Next, 30 differet soure loatios were geerated with a uiform Fig. 4 Compariso of the averaged orm of the bias of the proposed method with that of the existig methods (sample umber = 10) distributio, sesors were fixed, as show i Fig. 1 ad 00 Mote-Carlo simulatios were ru for eah give variae of oise. The variae of the measuremet oise of all of the sesors was assumed to be idetial. Also the sigle- ad omi-diretioal soure was assumed to be i the statioary state. The averaged MSE was alulated as follows Averaged MSE i=1 k=1 = [( xk (i) x(i)) + (ŷ k (i) y(i)) ] (8) where x k (i), ŷ k (i) is the estimated positio of the soure i the ith positio set ad kth iteratio, x(i) ad y(i) idiate the ith true positio of the soure. The CRLBs whih are used i this simulatio as the behmark are give i [10, 0]. Fig. 1 ideed illustrates a arragemet of sesors, i whih the radius of the sesor etwork was set to 10 m. As desribed i the itrodutio, ay estimated positio outside the parameter spae is ostraied to the maximum or miimum value of the parameter spae. The auray ompariso of the loalisatio is show i Fig. betwee the two-step WLS method based o the ivariae property of the ML estimator ad the existig methods as a futio of the variae of the oise whe the umber of samples is three. The dbm i Fig. deotes the square meter (m ) represeted with the deibel (db) uits. The proposed algorithm is learly superior to the existig estimators with large variaes of oise, whereas the averaged MSE performae of the existig shrikage estimator is iferior to that of the two-step WLS estimator beause the shrikage fator aot be estimated with suffiiet preisio with a small umber of samples. I additio, Fig. 3 shows the averaged MSE ompariso of the proposed ad existig methods whe the umber of measuremets is te. Agai, the averaged MSE performae of the proposed algorithm is lower tha that of the existig methods, but the shrikage method outperforms the two-step WLS method beause it has a suffiietly large umber of samples. That is, the averaged MSE of the proposed two-step WLS algorithm based o the ivariae property is smaller tha that of two-step WLS estimator regardless of the umber of samples, whereas the shrikage estimator is iferior to the two-step WLS method whe the umber of measuremets is small. Furthermore, the averaged MSE of the proposed method is superior to that of the shrikage estimator eve whe the umber of samples is suffiiet, as a be see i 110 & The Istitutio of Egieerig ad Tehology 016

6 Fig. 5 Compariso of averaged MSE of the proposed method with that of the existig methods (sample umber = 3, umber of ahor odes = 3) Fig. 3. Also, Fig. 4 shows that the orm of bias of the proposed method was muh smaller tha that of the other methods whe the sample umber was te. The orm of bias is obtaied i the followig Norm of Bias ( 1 ) ( ) 00 = x k x ŷ k y. 00 k=1 k=1 (9) irrespetive of the umber of measuremets, whereas that of the shrikage estimator is worse tha the two-step WLS estimator whe the umber of samples is small. Also, the averaged MSE of the proposed method was still smaller tha that of the shrikage estimator whe the umber of measuremets is te. Figs. 7 ad 8 show the averaged MSE whe the variae of oise is 10 dbm as a futio of the umber of sesors ad the radius of the sesor etwork, respetively. The averaged MSE beomes smaller as the umber of sesors ad the radius of the sesor etwork are larger. The bias dereases as the umber of samples ireases beause the bias of the proposed method is iversely proportioal to the umber of measuremets. The averaged MSE show i Figs. 5 ad 6 aouts for three sesors with erroeous positio iformatio. The variae of the sesor loatio oise was set to 0.01 m. Agai, the averaged MSE performae of the proposed method is superior to that of the two-step WLS method 5 Colusios We proposed a losed-form TOA soure loalisatio method ad justified the adoptio of the ivariae property of the ML estimator i the multiple-sample-based soure loalisatio otext. We have show that the MSE of the WLS estimator that uses a sample vetor futio based o the ivariae property of the ML estimator was smaller tha that usig the sample mea. The Fig. 6 Compariso of averaged MSE of the proposed method with that of the existig methods (sample umber = 10, umber of ahor odes = 3) & The Istitutio of Egieerig ad Tehology

7 Fig. 7 Compariso of averaged MSE of the proposed method with that of the existig methods as a futio of the umber of sesors (variae of oise = 10 dbm ) Fig. 8 Compariso of averaged MSE of the proposed method with that of the existig methods as a futio of the radius of the sesor etwork (variae of oise = 10 dbm ) averaged MSE of the proposed estimator was superior to that of the two-step WLS estimator i the large oise variaes regimes regardless of the umber of samples, ulike the shrikage estimator. Also, the proposed estimator outperformed the shrikage estimator i large oise variaes oditio whe the umber of measuremets was moderate. I future works, we will ivestigate a loalisatio method i the distae-depedet oise model. 6 Akowledgmet This work was supported by the Natioal Researh Foudatio of Korea (NRF) grat fuded by the Korea govermet (MSIP) (No. 014R1AA1A ). 7 Referees 1 Torrieri, D.J.: Statistial theory of passive loatio systems, IEEE Tras. Aerosp. Eletro. Syst., 1983, 0, (), pp Rui, L., Ho, K.C.: Bias aalysis of maximum likelihood target loatio estimator, IEEE Tras. Aerosp. Eletro. Syst., 013, 50, (4), pp Barto, R.J., Rao, D.: Performae apabilities of log-rage UWB-IR TDOA loalizatio systems, EURASIP J. Adv. Sigal Proess., 008, Artile ID: Su, M., Ho, K.C.: Optimum sesor plaemet for fully ad partially otrollable sesor etworks: a uified approah, Sigal Proess., 014, 10, pp Chalise, B.K., Zhag, Y., Ami, M.G., et al.: Target loalizatio i a multi-stati passive radar system through ovex optimizatio, Sigal Proess., 014, 10, pp Qiao, T., Liu, H.: Improved least media of squares loalizatio for o-lie-of-sight mitigatio, IEEE Commu. Lett., 014, 18, (8), pp & The Istitutio of Egieerig ad Tehology 016

8 7 Yi, F., Fritshe, C., Gustafsso, F., et al.: EM- ad JMAP-ML based joit estimatio algorithms for robust wireless geoloatio i mixed LOS/NLOS eviromets, IEEE Tras. Sigal Proess., 014, 6, (1), pp Cha, Y.T., Ho, K.C.: A simple ad effiiet estimator for hyperboli loatio, IEEE Tras. Sigal Proess., 1994, 4, (8), pp So, H.C., Li, L.: Liear least squares approah for aurate reeived sigal stregth based soure loalizatio, IEEE Tras. Sigal Proess., 011, 59, (8), pp Su, M., Yag, L., Ho, K.C.: Aurate sequetial self-loalizatio of sesor odes i losed-form, Sigal Proess., 01, 9, (1), pp Park, C.-H., Chag, J.-H.: Shrikage estimatio-based soure loalizatio with miimum mea squared error riterio ad miimum bias riterio, Digit. Sigal Proess., 014, 9, pp Be-Haim, Z., Eldar, Y.C.: Blid miimax estimatio, IEEE Tras. Sigal Proess., 007, 53, (9), pp Casella, G., Berger, R.L.: Statistial iferee. Cegage Learig, Kay, S.M.: Fudametals of statistial sigal proessig vol. I: estimatio theory (Pretie-Hall, 1993) 15 Ho, K.C., Lu, X., Kovavisaruh, L.: Soure loalizatio usig TDOA ad FDOA measuremets i the presee of reeiver loatio errors: aalysis ad solutio, IEEE Tras. Sigal Proess., 007, 55, (), pp Yag, L., Ho, K.C.: A approximately effiiet TDOA loalizatio algorithm i losed-form for loatig multiple disjoit soures with erroeous sesor positios, IEEE Tras. Sigal Proess., 009, 57, (1), pp Ma, Z., Ho, K.C.: A study o the effets of sesor positio error ad the plaemet of alibratio emitter for soure loalizatio, IEEE Tras. Wirel. Commu., 014, 13, (6), pp Wag, Y., Ho, K.C.: A asymptotially effiiet estimator i losed-form for 3D AOA loalizatio usig a sesor etwork, IEEE Tras. Wirel. Commu., 015, 14, (1), pp Rokah, Y., Shultheiss, P.: Array shape alibratio usig soures i ukow loatios. Part II: ear-field soures ad estimator implemetatio, IEEE Tras. Aoust. Speeh Sigal Proess., 1987, 35, (6), pp Cheug, K.W., So, H.C., Cha, Y.T.: Least squares algorithms for time-of-arrival-based mobile loatio, IEEE Tras. Sigal Proess., 004, 5, (4), pp Appedix 8 1 Derivatio of (1) The MSE of the first-step WLS estimate based o the ivariae property is derived as follows: MSE( x iv ) = tr{var[ x iv ]} + Bias( x iv ) T Bias( x iv ) where Q = C 1 q 1 P tr{(at C 1 q A) 1 } + (E[b iv ] b o ) T C 1 q A T C 1 q (E[b iv ] b o ) A(AT C 1 q A) = 1 P tr{(at C 1 q A) 1 } + tr[q{e[b iv ] b o } {E[b iv ] b o } T ] { = 1 [ P tr{(at C 1 q A) 1 } + tr Q 1 P s 1 1 ] T P s M [ 1 P s 1 1 ]} P s M = 1 P tr{(at C 1 q A) 1 } + 1 4P tr[qs] (30) A(AT C 1 q A) A T C 1 q ad [S] i,k = s i s k. & The Istitutio of Egieerig ad Tehology

Fluids Lecture 2 Notes

Fluids Lecture 2 Notes Fluids Leture Notes. Airfoil orte Sheet Models. Thi-Airfoil Aalysis Problem Readig: Aderso.,.7 Airfoil orte Sheet Models Surfae orte Sheet Model A aurate meas of represetig the flow about a airfoil i a

More information

Chapter 8 Hypothesis Testing

Chapter 8 Hypothesis Testing Chapter 8 for BST 695: Speial Topis i Statistial Theory Kui Zhag, Chapter 8 Hypothesis Testig Setio 8 Itrodutio Defiitio 8 A hypothesis is a statemet about a populatio parameter Defiitio 8 The two omplemetary

More information

Sx [ ] = x must yield a

Sx [ ] = x must yield a Math -b Leture #5 Notes This wee we start with a remider about oordiates of a vetor relative to a basis for a subspae ad the importat speial ase where the subspae is all of R. This freedom to desribe vetors

More information

Basic Probability/Statistical Theory I

Basic Probability/Statistical Theory I Basi Probability/Statistial Theory I Epetatio The epetatio or epeted values of a disrete radom variable X is the arithmeti mea of the radom variable s distributio. E[ X ] p( X ) all Epetatio by oditioig

More information

ANOTHER PROOF FOR FERMAT S LAST THEOREM 1. INTRODUCTION

ANOTHER PROOF FOR FERMAT S LAST THEOREM 1. INTRODUCTION ANOTHER PROOF FOR FERMAT S LAST THEOREM Mugur B. RĂUŢ Correspodig author: Mugur B. RĂUŢ, E-mail: m_b_raut@yahoo.om Abstrat I this paper we propose aother proof for Fermat s Last Theorem (FLT). We foud

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

THE MEASUREMENT OF THE SPEED OF THE LIGHT

THE MEASUREMENT OF THE SPEED OF THE LIGHT THE MEASUREMENT OF THE SPEED OF THE LIGHT Nyamjav, Dorjderem Abstrat The oe of the physis fudametal issues is a ature of the light. I this experimet we measured the speed of the light usig MihelsoÕs lassial

More information

COMP26120: Introducing Complexity Analysis (2018/19) Lucas Cordeiro

COMP26120: Introducing Complexity Analysis (2018/19) Lucas Cordeiro COMP60: Itroduig Complexity Aalysis (08/9) Luas Cordeiro luas.ordeiro@mahester.a.uk Itroduig Complexity Aalysis Textbook: Algorithm Desig ad Appliatios, Goodrih, Mihael T. ad Roberto Tamassia (hapter )

More information

SYNTHESIS OF SIGNAL USING THE EXPONENTIAL FOURIER SERIES

SYNTHESIS OF SIGNAL USING THE EXPONENTIAL FOURIER SERIES SYNTHESIS OF SIGNAL USING THE EXPONENTIAL FOURIER SERIES Sadro Adriao Fasolo ad Luiao Leoel Medes Abstrat I 748, i Itrodutio i Aalysi Ifiitorum, Leohard Euler (707-783) stated the formula exp( jω = os(

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 ypothesis testig Covers (most of) the followig material from hapter 8: Setio 8. Setios 8.. ad 8..3 Setio 8.3. Setio 8.3. (util defiitio 8.3.6) Ørulf Borga Departmet of Mathematis Uiversity

More information

ME260W Mid-Term Exam Instructor: Xinyu Huang Date: Mar

ME260W Mid-Term Exam Instructor: Xinyu Huang Date: Mar ME60W Mid-Term Exam Istrutor: Xiyu Huag Date: Mar-03-005 Name: Grade: /00 Problem. A atilever beam is to be used as a sale. The bedig momet M at the gage loatio is P*L ad the strais o the top ad the bottom

More information

Supplementary Material for: Classical Testing in Functional Linear Models

Supplementary Material for: Classical Testing in Functional Linear Models To appear i the Joural of Noparametri Statistis Vol. 00, No. 00, Moth 20XX, 1 16 Supplemetary Material for: Classial Testig i utioal Liear Models Deha Kog a Aa-Maria Staiu b ad Arab Maity b a Departmet

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Chapter 4: Angle Modulation

Chapter 4: Angle Modulation 57 Chapter 4: Agle Modulatio 4.1 Itrodutio to Agle Modulatio This hapter desribes frequey odulatio (FM) ad phase odulatio (PM), whih are both fors of agle odulatio. Agle odulatio has several advatages

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation ECE 645: Estimatio Theory Sprig 2015 Istructor: Prof. Staley H. Cha Maximum Likelihood Estimatio (LaTeX prepared by Shaobo Fag) April 14, 2015 This lecture ote is based o ECE 645(Sprig 2015) by Prof. Staley

More information

Nonparametric Goodness-of-Fit Tests for Discrete, Grouped or Censored Data 1

Nonparametric Goodness-of-Fit Tests for Discrete, Grouped or Censored Data 1 Noparametri Goodess-of-Fit Tests for Disrete, Grouped or Cesored Data Boris Yu. Lemeshko, Ekateria V. Chimitova ad Stepa S. Kolesikov Novosibirsk State Tehial Uiversity Departmet of Applied Mathematis

More information

Certain inclusion properties of subclass of starlike and convex functions of positive order involving Hohlov operator

Certain inclusion properties of subclass of starlike and convex functions of positive order involving Hohlov operator Iteratioal Joural of Pure ad Applied Mathematial Siees. ISSN 0972-9828 Volume 0, Number (207), pp. 85-97 Researh Idia Publiatios http://www.ripubliatio.om Certai ilusio properties of sublass of starlike

More information

After the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution

After the completion of this section the student. V.4.2. Power Series Solution. V.4.3. The Method of Frobenius. V.4.4. Taylor Series Solution Chapter V ODE V.4 Power Series Solutio Otober, 8 385 V.4 Power Series Solutio Objetives: After the ompletio of this setio the studet - should reall the power series solutio of a liear ODE with variable

More information

Nonstandard Lorentz-Einstein transformations

Nonstandard Lorentz-Einstein transformations Nostadard Loretz-istei trasformatios Berhard Rothestei 1 ad Stefa Popesu 1) Politehia Uiversity of Timisoara, Physis Departmet, Timisoara, Romaia brothestei@gmail.om ) Siemes AG, rlage, Germay stefa.popesu@siemes.om

More information

Robust Parameter Estimation For Mixture Model

Robust Parameter Estimation For Mixture Model Robust Parameter Estimatio For Mixture Model Saldju Tadjudi Netom Systems, I. 20550 Nordhoff Street Chatsworth, CA 91311 Phoe (818) 885-2179 Fax (818) 709-0117 Saldju_Tadjudi@etomsystems.om David A. Ladgrebe

More information

Observer Design with Reduced Measurement Information

Observer Design with Reduced Measurement Information Observer Desig with Redued Measuremet Iformatio I pratie all the states aot be measured so that SVF aot be used Istead oly a redued set of measuremets give by y = x + Du p is available where y( R We assume

More information

Digital Signal Processing. Homework 2 Solution. Due Monday 4 October Following the method on page 38, the difference equation

Digital Signal Processing. Homework 2 Solution. Due Monday 4 October Following the method on page 38, the difference equation Digital Sigal Proessig Homework Solutio Due Moda 4 Otober 00. Problem.4 Followig the method o page, the differee equatio [] (/4[-] + (/[-] x[-] has oeffiiets a0, a -/4, a /, ad b. For these oeffiiets A(z

More information

Principles of Communications Lecture 12: Noise in Modulation Systems. Chih-Wei Liu 劉志尉 National Chiao Tung University

Principles of Communications Lecture 12: Noise in Modulation Systems. Chih-Wei Liu 劉志尉 National Chiao Tung University Priiples of Commuiatios Leture 1: Noise i Modulatio Systems Chih-Wei Liu 劉志尉 Natioal Chiao ug Uiversity wliu@twis.ee.tu.edu.tw Outlies Sigal-to-Noise Ratio Noise ad Phase Errors i Coheret Systems Noise

More information

Summation Method for Some Special Series Exactly

Summation Method for Some Special Series Exactly The Iteratioal Joural of Mathematis, Siee, Tehology ad Maagemet (ISSN : 39-85) Vol. Issue Summatio Method for Some Speial Series Eatly D.A.Gismalla Deptt. Of Mathematis & omputer Studies Faulty of Siee

More information

Analog Filter Synthesis

Analog Filter Synthesis 6 Aalog Filter Sythesis Nam Pham Aubur Uiversity Bogda M. Wilamowsi Aubur Uiversity 6. Itrodutio...6-6. Methods to Sythesize Low-Pass Filter...6- Butterworth Low-Pass Filter Chebyshev Low-Pass Filter Iverse

More information

The Use of L-Moments in the Peak Over Threshold Approach for Estimating Extreme Quantiles of Wind Velocity

The Use of L-Moments in the Peak Over Threshold Approach for Estimating Extreme Quantiles of Wind Velocity The Use of L-Momets i the Pea Over Threshold Approah for Estimatig Extreme Quatiles of Wid Veloity M.D. Padey Uiversity of Waterloo, Otario, Caada P.H.A.J.M. va Gelder & J.K. Vrijlig Delft Uiversity of

More information

Bernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2

Bernoulli Numbers. n(n+1) = n(n+1)(2n+1) = n(n 1) 2 Beroulli Numbers Beroulli umbers are amed after the great Swiss mathematiia Jaob Beroulli5-705 who used these umbers i the power-sum problem. The power-sum problem is to fid a formula for the sum of the

More information

Construction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness

Construction of Control Chart for Random Queue Length for (M / M / c): ( / FCFS) Queueing Model Using Skewness Iteratioal Joural of Sietifi ad Researh Publiatios, Volume, Issue, Deember ISSN 5-5 Costrutio of Cotrol Chart for Radom Queue Legth for (M / M / ): ( / FCFS) Queueig Model Usig Skewess Dr.(Mrs.) A.R. Sudamai

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

Doppler frequency offset estimation and diversity reception scheme of high-speed railway with multiple antennas on separated carriage

Doppler frequency offset estimation and diversity reception scheme of high-speed railway with multiple antennas on separated carriage Joural of Moder Trasportatio Volume, umber 4, Deember, Page 7-33 Joural homepage: jmtswjtuedu DO: 7/BF33583 Doppler frequey offset estimatio ad diversity reeptio sheme of high-speed railway with multiple

More information

What is a Hypothesis? Hypothesis is a statement about a population parameter developed for the purpose of testing.

What is a Hypothesis? Hypothesis is a statement about a population parameter developed for the purpose of testing. What is a ypothesis? ypothesis is a statemet about a populatio parameter developed for the purpose of testig. What is ypothesis Testig? ypothesis testig is a proedure, based o sample evidee ad probability

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

11 Correlation and Regression

11 Correlation and Regression 11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record

More information

Statistical Fundamentals and Control Charts

Statistical Fundamentals and Control Charts Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,

More information

Sequential source localisation and range estimation based on shrinkage algorithm

Sequential source localisation and range estimation based on shrinkage algorithm IET Signal Processing Research Article Sequential source localisation and range estimation based on shrinkage algorithm ISSN 1751-9675 Received on 13th December 016 Revised 15th June 017 Accepted on 1th

More information

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm , pp.10-106 http://dx.doi.org/10.1457/astl.016.137.19 The DOA Estimatio of ultiple Sigals based o Weightig USIC Algorithm Chagga Shu a, Yumi Liu State Key Laboratory of IPOC, Beijig Uiversity of Posts

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

Mass Transfer Chapter 3. Diffusion in Concentrated Solutions

Mass Transfer Chapter 3. Diffusion in Concentrated Solutions Mass Trasfer Chapter 3 Diffusio i Coetrated Solutios. Otober 07 3. DIFFUSION IN CONCENTRATED SOLUTIONS 3. Theor Diffusio auses ovetio i fluids Covetive flow ours beause of pressure gradiets (most ommo)

More information

= 47.5 ;! R. = 34.0 ; n air =

= 47.5 ;! R. = 34.0 ; n air = Setio 9: Refratio ad Total Iteral Refletio Tutorial Pratie, page 449 The agle of iidee is 65 The fat that the experimet takes plae i water does ot hage the agle of iidee Give:! i = 475 ;! R = 340 ; air

More information

Principal Component Analysis. Nuno Vasconcelos ECE Department, UCSD

Principal Component Analysis. Nuno Vasconcelos ECE Department, UCSD Priipal Compoet Aalysis Nuo Vasoelos ECE Departmet, UCSD Curse of dimesioality typial observatio i Bayes deisio theory: error ireases whe umber of features is large problem: eve for simple models (e.g.

More information

(8) 1f = f. can be viewed as a real vector space where addition is defined by ( a1+ bi

(8) 1f = f. can be viewed as a real vector space where addition is defined by ( a1+ bi Geeral Liear Spaes (Vetor Spaes) ad Solutios o ODEs Deiitio: A vetor spae V is a set, with additio ad salig o elemet deied or all elemets o the set, that is losed uder additio ad salig, otais a zero elemet

More information

Solutions 3.2-Page 215

Solutions 3.2-Page 215 Solutios.-Page Problem Fid the geeral solutios i powers of of the differetial equatios. State the reurree relatios ad the guarateed radius of overgee i eah ase. ) Substitutig,, ad ito the differetial equatio

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

CREDIBILITY EVALUATION FOR BLIND PROCESSING RESULTS OF BPSK SIGNALS BY USING PHASE SPECTRAL ENTROPY

CREDIBILITY EVALUATION FOR BLIND PROCESSING RESULTS OF BPSK SIGNALS BY USING PHASE SPECTRAL ENTROPY INTERNATIONAL JOURNAL ON SMART SENSING AND INTELLIGENT SYSTEMS VOL.9, NO.4, DECEMBER 26 CREDIBILITY EVALUATION FOR BLIND PROCESSING RESULTS OF BPSK SIGNALS BY USING PHASE SPECTRAL ENTROPY Wag Shuwag, Hu

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Local Estimates for the Koornwinder Jacobi-Type Polynomials

Local Estimates for the Koornwinder Jacobi-Type Polynomials Available at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 93-9466 Vol. 6 Issue (Jue 0) pp. 6 70 (reviously Vol. 6 Issue pp. 90 90) Appliatios ad Applied Mathematis: A Iteratioal Joural (AAM) Loal Estimates

More information

One way Analysis of Variance (ANOVA)

One way Analysis of Variance (ANOVA) Oe way Aalysis of Variae (ANOVA) ANOVA Geeral ANOVA Settig"Slide 43-45) Ivestigator otrols oe or more fators of iterest Eah fator otais two or more levels Levels a be umerial or ategorial ifferet levels

More information

MCT242: Electronic Instrumentation Lecture 2: Instrumentation Definitions

MCT242: Electronic Instrumentation Lecture 2: Instrumentation Definitions Faculty of Egieerig MCT242: Electroic Istrumetatio Lecture 2: Istrumetatio Defiitios Overview Measuremet Error Accuracy Precisio ad Mea Resolutio Mea Variace ad Stadard deviatio Fiesse Sesitivity Rage

More information

Chemistry 2. Assumed knowledge. Learning outcomes. The particle on a ring j = 3. Lecture 4. Cyclic π Systems

Chemistry 2. Assumed knowledge. Learning outcomes. The particle on a ring j = 3. Lecture 4. Cyclic π Systems Chemistry Leture QuatitativeMO Theoryfor Begiers: Cyli Systems Assumed kowledge Be able to predit the umber of eletros ad the presee of ougatio i a rig otaiig arbo ad/or heteroatoms suh as itroge ad oxyge.

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

ESTIMATION OF MACHINING ERRORS ON GLEASON BEVEL

ESTIMATION OF MACHINING ERRORS ON GLEASON BEVEL 5 th INTERNATIONAL MEETING OF THE CARPATHIAN REGION SPECIALISTS IN THE FIELD OF GEARS ESTIMATION OF MACHINING ERRORS ON GLEASON BEVEL GEAR CUTTING BOB, Daila UNIO SA Satu Mare - 35, Luia Blaga Blvd, 39

More information

Lesson 8 Refraction of Light

Lesson 8 Refraction of Light Physis 30 Lesso 8 Refratio of Light Refer to Pearso pages 666 to 674. I. Refletio ad Refratio of Light At ay iterfae betwee two differet mediums, some light will be refleted ad some will be refrated, exept

More information

Extracting More Capacity from Multi-Channel Multi- Radio Wireless Networks by Exploiting Power

Extracting More Capacity from Multi-Channel Multi- Radio Wireless Networks by Exploiting Power Extratig More Capaity from Multi-Chael Multi- Radio Wireless Networks by Exploitig Power Devu Maikata Shila, Yu Cheg, Triha Ajali Dept. Eletrial & Computer Egieerig Illiois Istitute of Tehology {dmaika,heg,

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Optimal Management of the Spare Parts Stock at Their Regular Distribution

Optimal Management of the Spare Parts Stock at Their Regular Distribution Joural of Evirometal Siee ad Egieerig 7 (018) 55-60 doi:10.1765/16-598/018.06.005 D DVID PUBLISHING Optimal Maagemet of the Spare Parts Stok at Their Regular Distributio Svetozar Madzhov Forest Researh

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

(Dependent or paired samples) Step (1): State the null and alternate hypotheses: Case1: One-tailed test (Right)

(Dependent or paired samples) Step (1): State the null and alternate hypotheses: Case1: One-tailed test (Right) (epedet or paired samples) Step (1): State the ull ad alterate hypotheses: Case1: Oe-tailed test (Right) Upper tail ritial (where u1> u or u1 -u> 0) H0: 0 H1: > 0 Case: Oe-tailed test (Left) Lower tail

More information

STAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6)

STAT 350 Handout 19 Sampling Distribution, Central Limit Theorem (6.6) STAT 350 Hadout 9 Samplig Distributio, Cetral Limit Theorem (6.6) A radom sample is a sequece of radom variables X, X 2,, X that are idepedet ad idetically distributed. o This property is ofte abbreviated

More information

Lecture 7: Properties of Random Samples

Lecture 7: Properties of Random Samples Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ

More information

The beta density, Bayes, Laplace, and Pólya

The beta density, Bayes, Laplace, and Pólya The beta desity, Bayes, Laplae, ad Pólya Saad Meimeh The beta desity as a ojugate form Suppose that is a biomial radom variable with idex ad parameter p, i.e. ( ) P ( p) p ( p) Applyig Bayes s rule, we

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

CSE 527, Additional notes on MLE & EM

CSE 527, Additional notes on MLE & EM CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be

More information

Abstract. Fermat's Last Theorem Proved on a Single Page. "The simplest solution is usually the best solution"---albert Einstein

Abstract. Fermat's Last Theorem Proved on a Single Page. The simplest solution is usually the best solution---albert Einstein Copyright A. A. Frempog Fermat's Last Theorem Proved o a Sigle Page "5% of the people thik; 0% of the people thik that they thik; ad the other 85% would rather die tha thik."----thomas Ediso "The simplest

More information

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test.

Because it tests for differences between multiple pairs of means in one test, it is called an omnibus test. Math 308 Sprig 018 Classes 19 ad 0: Aalysis of Variace (ANOVA) Page 1 of 6 Itroductio ANOVA is a statistical procedure for determiig whether three or more sample meas were draw from populatios with equal

More information

Estimation of the Mean and the ACVF

Estimation of the Mean and the ACVF Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators

More information

Physics 30 Lesson 8 Refraction of Light

Physics 30 Lesson 8 Refraction of Light Physis 30 Lesso 8 Refratio of Light Refer to Pearso pages 666 to 674. I. Refletio ad refratio of light At ay iterfae betwee two differet mediums, some light will be refleted ad some will be refrated, exept

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

6.003 Homework #3 Solutions

6.003 Homework #3 Solutions 6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach

Lecture 7: Density Estimation: k-nearest Neighbor and Basis Approach STAT 425: Itroductio to Noparametric Statistics Witer 28 Lecture 7: Desity Estimatio: k-nearest Neighbor ad Basis Approach Istructor: Ye-Chi Che Referece: Sectio 8.4 of All of Noparametric Statistics.

More information

Algorithms. Elementary Sorting. Dong Kyue Kim Hanyang University

Algorithms. Elementary Sorting. Dong Kyue Kim Hanyang University Algorithms Elemetary Sortig Dog Kyue Kim Hayag Uiversity dqkim@hayag.a.kr Cotets Sortig problem Elemetary sortig algorithms Isertio sort Merge sort Seletio sort Bubble sort Sortig problem Iput A sequee

More information

Dr R Tiwari, Associate Professor, Dept. of Mechanical Engg., IIT Guwahati,

Dr R Tiwari, Associate Professor, Dept. of Mechanical Engg., IIT Guwahati, Dr R Tiwari, Assoiate Professor, Dept. of Mehaial Egg., IIT Guwahati, (rtiwari@iitg.eret.i).3 Measuremet ad Sigal Proessig Whe we ivestigate the auses of vibratio, we first ivestigate the relatioship betwee

More information

On Capacity and Delay of Multi-channel Wireless Networks with Infrastructure Support

On Capacity and Delay of Multi-channel Wireless Networks with Infrastructure Support O Capaity ad Delay of Multi-hael ireless Networks with Ifrastruture Support Hog-Nig Dai, Member, IEEE, Raymod Chi-ig og, Seior Member, IEEE, Hao ag, Member, IEEE Abstrat I this paper, we propose a ovel

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Physics 3 (PHYF144) Chap 8: The Nature of Light and the Laws of Geometric Optics - 1

Physics 3 (PHYF144) Chap 8: The Nature of Light and the Laws of Geometric Optics - 1 Physis 3 (PHYF44) Chap 8: The Nature of Light ad the Laws of Geometri Optis - 8. The ature of light Before 0 th etury, there were two theories light was osidered to be a stream of partiles emitted by a

More information

Certain Aspects of Univalent Function with Negative Coefficients Defined by Bessel Function

Certain Aspects of Univalent Function with Negative Coefficients Defined by Bessel Function Egieerig, Tehology ad Tehiques Vol59: e66044, Jauary-Deember 06 http://dxdoiorg/0590/678-434-066044 ISSN 678-434 Olie Editio BRAZILIAN ARCHIVES OF BIOLOGY AND TECHNOLOGY A N I N T E R N A T I O N A L J

More information

Introduction to Machine Learning DIS10

Introduction to Machine Learning DIS10 CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig

More information

Principal Component Analysis

Principal Component Analysis Priipal Compoet Aalysis Nuo Vasoelos (Ke Kreutz-Delgado) UCSD Curse of dimesioality Typial observatio i Bayes deisio theory: Error ireases whe umber of features is large Eve for simple models (e.g. Gaussia)

More information

Optimal Design of Accelerated Life Tests with Multiple Stresses

Optimal Design of Accelerated Life Tests with Multiple Stresses Optimal Desig of Accelerated Life Tests with Multiple Stresses Y. Zhu ad E. A. Elsayed Departmet of Idustrial ad Systems Egieerig Rutgers Uiversity 2009 Quality & Productivity Research Coferece IBM T.

More information

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University.

Signal Processing. Lecture 02: Discrete Time Signals and Systems. Ahmet Taha Koru, Ph. D. Yildiz Technical University. Sigal Processig Lecture 02: Discrete Time Sigals ad Systems Ahmet Taha Koru, Ph. D. Yildiz Techical Uiversity 2017-2018 Fall ATK (YTU) Sigal Processig 2017-2018 Fall 1 / 51 Discrete Time Sigals Discrete

More information

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes

Comparison of Minimum Initial Capital with Investment and Non-investment Discrete Time Surplus Processes The 22 d Aual Meetig i Mathematics (AMM 207) Departmet of Mathematics, Faculty of Sciece Chiag Mai Uiversity, Chiag Mai, Thailad Compariso of Miimum Iitial Capital with Ivestmet ad -ivestmet Discrete Time

More information

Converge-Cast: On the Capacity and Delay Tradeoffs

Converge-Cast: On the Capacity and Delay Tradeoffs Coverge-Cast: O the Capaity ad Delay Tradeoffs Xibig Wag,2, Luoyi Fu, Xiaohua Tia, Yuazhe Bei, Qiuyu Peg, Xiaoyig Ga, Hui Yu, Jig Liu. Departmet of Eletroi Egieerig, Shaghai Jiao Tog Uiversity, Chia {xwag8,

More information

Faster DTMF Decoding

Faster DTMF Decoding Faster DTMF Deodig J. B. Lima, R. M. Campello de Souza, H. M. de Olieira, M. M. Campello de Souza Departameto de Eletrôia e Sistemas - UFPE, Digital Sigal Proessig Group C.P. 78, 57-97, Reife-PE, Brasil

More information

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE

MOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:

More information

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.

MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

An improved attribute reduction algorithm based on mutual information with rough sets theory

An improved attribute reduction algorithm based on mutual information with rough sets theory Available olie www.jopr.om Joural of Chemial ad Pharmaeutial Researh, 04, 6(7:30-35 Researh Artile ISSN : 0975-7384 CODEN(USA : JCPRC5 A improved attribute redutio algorithm based o mutual iformatio with

More information

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function

Bayesian and E- Bayesian Method of Estimation of Parameter of Rayleigh Distribution- A Bayesian Approach under Linex Loss Function Iteratioal Joural of Statistics ad Systems ISSN 973-2675 Volume 12, Number 4 (217), pp. 791-796 Research Idia Publicatios http://www.ripublicatio.com Bayesia ad E- Bayesia Method of Estimatio of Parameter

More information

The standard deviation of the mean

The standard deviation of the mean Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information