School of Computer Engineering, Nanyang Technological University, Singapore

Size: px
Start display at page:

Download "School of Computer Engineering, Nanyang Technological University, Singapore"

Transcription

1 NARROWBAND DETECTION IN OCEAN WIT IMPULSIVE NOISE USING AN ACOUSTIC VECTOR SENSOR ARRAY V. N. ari 1, Aad G. V. 2, P. V. Nagesha 2 ad A. B. Premkumar 1 1 School of Computer Egieerig, Nayag Techological Uiversity, Sigapore Departmet of Electrical Commuicatio Egieerig, Idia Istitute of Sciece, Bagalore , Idia ABSTRACT This paper presets the formulatio ad aalysis of some methods for arrowbad detectio of uderwater acoustic sources i impulsive oise usig a array of acoustic vector sesors. Sice the array sigal vector is ukow due to the ukow locatio of the source, detectio is based o the geeralized likelihood ratio test which ivolves estimatio of the sigal vector. Differet detectors use differet sigal models which yield differet sigal estimators. It is show that the trucated subspace detector (T), which uses a trucated ormal mode model, yields the best performace. Idex Terms- subspace detectio, geeralized likelihood ratio test, shallow ocea, acoustic vector sesor 1. INTRODUCTION This paper addresses the problem of arrowbad detectio of a acoustic source i a shallow ocea usig a array of acoustic vector sesors (AVS). Detectio of sources usig a sesor array may be achieved usig a optimal Neyma- Pearso (NP) detectio strategy if the sigal field at the array is kow [1]. owever, the sigal is ukow i a geeral detectio sceario because the source locatio is ukow, ad the evirometal parameters may ot be kow fully. ece detectio of the sigal is doe by a geeralized likelihood ratio test (GLRT), which ivolves estimatio of the sigal vector ad oise parameters at the array. Oe form of this test leads to the formulatio of a subspace detectio algorithm [2]. Two detectors based o the GLRT approach, have bee preseted recetly for AVS arrays [, 4], viz. the subspace detector () ad the approximate sigal form detector (ASFD). These were formulated uder the assumptio that the ambiet oise is Gaussia. owever, ambiet oise i the ocea ofte has a heavy-tailed distributio [5]. Therefore it is of iterest to develop effective methods of detectio i such a eviromet. GLRT detectio has earlier bee employed i the case of spherically ivariat radom vector oise [6] ad geeralized Gaussia oise with iterferece [7]. It is well-kow that AVS arrays have a better directiofidig capability tha the covetioal APS arrays [8, 9]. This performace advatage arises because a AVS measures ot oly the acoustic pressure but also all compoets of particle velocity at a poit i space. Recet work has show that this advatage of a AVS array ca also be exploited to obtai better detectio performace tha that achieved by a APS array [, 4]. I this paper we exted the ad ASFD techiques to uderwater sigal detectio i heavy-tailed oise usig a AVS array. The oise distributio is modeled as geeralized Gaussia (GG). We also preset a ew techique called trucated subspace detector (T). Each of these detectors is based o a differet model of the array sigal vector. Differet models lead to differet estimates of the sigal vector. It is show that the ormalized mea square sigal estimatio error (MSE) of T is sigificatly lower ad hece the T provides a sigificatly better performace tha both ad ASFD. The paper is orgaized as follows. The data model is preseted i Sectio 2. The alterative sigal models ad correspodig detectors are formulated i Sectio ad expressios for the associated MSEs are derived. A comparative performace aalysis of the detectors is preseted i Sectio 4. Coclusios are preseted i Sectio DATA MODEL Cosider the detectio of a arrowbad source with ceter frequecy f located i a shallow ocea, usig a N elemet uiform horizotal liear AVS array. We shall cosider three outputs produced by each AVS, viz. the acoustic pressure ad two orthogoal horizotal compoets of particle velocity. The vertical compoet of particle velocity is ot cosidered sice it is foud to icrease complexity without yieldig ay sigificat additioal improvemet i performace. The sesor array is assumed to be at depth z a i the far-field regio with respect to the source, which is located at rage r, depth z s, ad azimuth agle ϕ measured with respect to the axis of the array. Let x, s ad w deote, respectively, the N x 1 data vector, sigal vector ad oise vector at the AVS array; ad let x, s ad w deote, respectively, the x1 data vector, sigal vector ad oise vector at the th AVS. Assumig the ocea to be rage-idepedet with water desity ρ ad soud speed profile c(z), we ca express s as s = [p 2 ρc(z a )v x 2 ρc(z a )v y ] T, (1) where p ad (v x, v y ) deote, respectively, the complex

2 amplitudes of acoustic pressure ad horizotal (x, y) compoets of particle velocity of the sigal at the th AVS. The vectors w ad x are defied similarly. The particle velocity compoets are scaled by the factor 2 ρc(z a ) to esure that all the elemets have the same dimesio. The sigal vector s ca be writte i terms of the ormal modes of the oceaic waveguide as [9]. s = A(ϕ)b, (2) A(ϕ) = [a 1 (ϕ) a M (ϕ)], () a m (ϕ) = c m (ϕ) d m (ϕ), (4) c m (ϕ) = [1 exp(ik m dcos(ϕ)) exp(i(n-1)k m dcos(ϕ))] T (5) d m (ϕ) = [1 2 ξ m cos(ϕ) 2 ξ m si(ϕ)] T, (6) ξ m = k m /k(z a ) = k m c(z a )/2πf; m = 1, M, (7) b = [b 1 b M ] T, (8) b B z exp r jk r k r ; m 1,... M, (9) m m s m m m where k m, δ m ad ψ m (z) are respectively the waveumber, atteuatio coefficiet ad eigefuctio of the m th mode, M is the umber of modes, d is the iter-sesor spacig, B is a costat, ad deotes the Kroecker product. The colums of A(ϕ) are the modal steerig vectors, ad the elemets of b are the amplitudes of the modes. The ambiet oise i the ocea is assumed to be spatially white ad heavy-tailed, modeled by the followig circular complex geeralized Gaussia (GG) PDF with variace σ 2 f GG N N J( ) K( ) w exp, 0< 2, 2 w (10) 1 /2 (4 / ) (4 / ) J( ), K( ). 2 2 [ (2 / )] 2 (2 / ). GLRT DETECTION IN SALLOW OCEAN.1 Formulatio of the detectio problem The detectio problem ca be cast i the form of the followig hypothesis testig problem: 0 : x = w 1 : x = s+ w. (11) The joit likelihood fuctios of the array data vectors uder hypotheses 0 ad 1 are give by f (x, 0 ) = f GG (x), (12) f (x, 1 ) = f GG (x - s), (1) where f GG (.) is defied i (10). The likelihood ratio L(x) = f(x; 1 )/f(x; 0 ) (14) yields the followig test statistic ad decisio rule N 1 x ( ) ( ) ( ), (15) TUD x x s Decide 1 if T UD (x) > γ(p FA ) (16) where x() ad s() deote the th elemet of x ad s respectively, ad γ(p FA ) is the threshold correspodig to probability of false alarm P FA [1]. But (16) is a urealizable detector (UD) sice it requires the kowledge of the sigal vector s that depeds o the ukow source locatio. owever, the performace of UD may be cosidered as a upper boud o the performace of ay realizable detector. Whe some parameters of the sigal s or the oise w are ukow, they ca be estimated by maximizig the likelihood fuctios with respect to these ukow parameters. Let Θ j deote the ukow parameter vector uder hypothesis j, j=0,1. The ratio of the maximized likelihoods called the geeralized likelihood ratio, is give by G ; ˆ 1; 1 ; ˆ 0; 0 L x f x Θ f x Θ, (17) where Θˆ j is the maximum likelihood estimate (MLE) of Θ j. Simplificatio of the geeralized likelihood ratio yields the GLRT test statistic. I sectios.2 ad., two ovel detectors based o the GLRT approach are preseted..2. Trucated Subspace detector If N > M, where N is the umber of sesors i the array ad M is the umber of ormal modes, the colums of the modal steerig matrix A(ϕ) are liearly idepedet ad the N-dimesioal array sigal vector s belogs to the M- dimesioal modal subspace V M (ϕ) spaed by the colums of A(ϕ). A subspace detector () based o this property of s was proposed i [] for arrowbad detectio i Gaussia oise. A simpler formulatio of the is preseted here for the geeral case of o-gaussia oise. We ca represet s i the alterative form s = A(ϕ)b = Q(ϕ) β =[q 1 (ϕ).. q M (ϕ)] β, (18) where Q(ϕ) is a uitary matrix which may be obtaied by QR decompositio of A(ϕ) as A(ϕ) = Q(ϕ) R. (19) I (18), β = Rb is a trasformed versio of the ukow mode amplitude vector b. The sigal vector s belogs to the modal subspace V M (ϕ) defied as V M (ϕ) = spa{q 1 (ϕ) q M (ϕ)}, (20) so that {q 1 (ϕ) q M (ϕ)} costitutes a orthoormal basis of V M (ϕ). For a give ϕ, the subspace V M (ϕ) is kow if the modal waveumbers {k m ; m = 1,, M} are kow. Thus the problem of estimatig the N-dimesioal sigal vector s is reduced to the simpler problem of estimatig the M- dimesioal mode amplitude vector β. Maximizatio of the likelihood fuctio f (x; 1 ) = f(x;β,ϕ, 1 ) with respect to the ukow M-dimesioal vector β yields the equatio N 1 ˆ 2 ˆ x (21) x r ( ) ( ) [ ( ) r ( ) ( )] 0, where r (ϕ) is a row vector deotig the th row of Q(ϕ), ad β ˆ deotes the coditioal MLE of β for a give ϕ. The

3 followig closed form solutio of (21) is readily obtaied if α = 2: β ˆ = Q (ϕ)x. (22) As o closed form solutio of (21) is available whe α 2, we use (22) as a approximatio to the coditioal MLE of β. The approximate MLEs of ϕ ad s ca ow be writte as ˆ argmax{ x Q( ) Q ( ) x}, (2) ˆ sˆ Q( ) Q ( ˆ ) x, (24) ad the test statistic of the is thus give by N 1 T x x( ) x( ) r ( ) ( ) x. ˆ ˆ Q (25) The ormalized mea square error (MSE) of the sigal estimate s ca be foud from (18) ad (24) as ˆ E[( s sˆ) ( s sˆ)] M, N (26) [ ] where is the sigal-to-oise ratio (SNR) ad E is the expectatio operator. The ca be employed oly if the colums of A(ϕ) are liearly idepedet, i.e. if M N. Sice the umber of modes M icreases as the frequecy f is icreased [9], the applicability of the is limited by a upper cut-off frequecy f c which depeds o the legth of the array; a shorter array limits the applicability of the to a lower cut-off frequecy. Moreover, the suffers degradatio i performace as f is icreased eve if f < f c, because a icrease i M leads to a icrease i the MSE ε, as show by (26). I order to exted the applicability of the to shorter arrays/higher frequecies, as well as arrest the degradatio associated with a icrease i the umber of modes, we propose a detector which uses a trucated model of the sigal vector obtaied by projectig s o a modal subspace V M of smaller dimesio M ', where M ' < M: V M (ϕ) = spa{q 1 (ϕ) q M (ϕ)}. (27) The set of spaig vectors of the trucated subspace V M (ϕ) is a subset of the set of spaig vectors of the full modal subspace V M (ϕ). The trucated sigal vector is give by s Q' ( ) ' [ q ( )... q ( )] '. (28) 1 M ' O replacig s by s' i (1) ad the adoptig the same procedure as for the subspace detector, we get the followig expressios for the coditioal MLE of β '(ϕ), the MLEs of ϕ ad s', ad the test statistic of the trucated subspace detector ˆ '( ) ' β Q ( ) x, (29) ˆ T argmax{ x Q'( ) Q ' ( ) x }, (0) sˆ' Q'( ˆ ) Q ' ( ˆ ) x, (1) T T ' ˆ ˆ N T T T 1 T ( x) [ x( ) x( ) r ( ) Q ' ( ) x ]. (2) where r ( ˆ ) is the th row of Q '( ˆ ). It ca be show ' T T that the ormalized MSE of the estimate s ˆ ' is E[( s sˆ') ( s sˆ')] T T,1 T,2 E[ s' s'] M' 1,. N T,1 T,2, () (4) The ormalized MSE ε T has two compoets. The first compoet ε T,1 is due to trucatio of the ormal mode expasio of the sigal vector. The secod compoet ε T,2 is due to oise, ad it is aalogous to ε defied i (26). Plots of ε T versus are show i Figs. 1 (a), (b) ad (c) for SNR = 0, 10 ad 20 db respectively, whe a sigal of frequecy 50 z is received by a 10-elemet AVS LA. The evirometal parameters are as specified at the begiig of Sectio 4. For this chose set of parameters, M = 15. We ca draw the followig coclusios from (), (4) ad Fig. 1. The oise-iduced error compoet ε T,2 decreases liearly i proportio to as is reduced. The trucatio-iduced error compoet icreases very slowly as the trucatio is icreased (i.e. as is reduced) ad becomes sigificat oly whe is close to 1. This behavior ca be attributed to the fact that (i) the modal vectors {a 1 (ϕ) a M (ϕ)} i the expasio of s are highly correlated, ad (ii) amplitudes { } of the discarded higher order modes are quite small due to faster atteuatio of the higher order modes. The total MSE ε T is miimum at a optimal value of which is very close to 1. The optimal value of icreases very slowly with icreasig SNR. It follows that the performace of T may be expected to be sigificatly better tha that of ad that the choice =1 is optimal or ear-optimal. This predictio is cofirmed by the result preseted i Sectio 4. The use of a trucated sigal model i T also has the additioal advatages of (i) reducig the eed for chael iformatio to modal waveumbers of the first few modes oly, ad (ii) reducig the computatioal complexity... Approximate sigal form detector A simple detector called the approximate sigal form detector (ASFD) may be formulated [4] by exploitig the fact that the modal waveumbers {k m ; m = 1,, M} are very close to oe aother. Usig the approximatio ξ m = k m /k(z a ) 1 i (7), we get the followig approximate expressio for the array sigal vector s"= G(ϕ)p, G(ϕ) = I N [1 2 cos(ϕ) 2 si(ϕ)] T, (5) where p = [p 1 p N ] T, ad I N deotes the NxN idetity matrix. O replacig s by s" i (1) ad maximizig the resultat likelihood fuctio f(x; 1 ) = f(x; p, ϕ, 1 ) with respect to p leads to the equatio

4 Fig. 1: ε T versus M' for ϕ = o f = 50 z, M = 15 ad (a) SNR = 0 db, (b) SNR = 10 db, ad (c) SNR = 20 db. 2 N ˆ x ˆ 1 g ( ) p [ g ( ) g ( ) p g ( ) x( )] 0, (6) where g (ϕ) is a row vector deotig the th row of G(ϕ), ad ˆp is the ML estimate of p. If α = 2, the solutio of (6) is give by 1 pˆ ( G ( ) G( )) G ( ) x G ( ) x / (7) No closed form solutio of (6) is available whe α 2, but (7) may still be used as a approximatio to the coditioal MLE. The correspodig MLEs of bearig ϕ ad sigal vector s '', ad the test statistic of the ASFD are give by ˆ ASFD { x G( ) G ( ) x}, (8) ˆ sˆ G( ) G ( ˆ ) x /. (9) ASFD N 1 ASFD TAS D ( x) [ x( ) x( ) s ˆ( ) ]. (40) F The ormalized MSE of the sigal estimate ˆ s is give by E[( s sˆ'') ( s sˆ'')] ASFD ASFD,1 ASFD,2 E[ s'' s''] 1 1,. ASFD,1 ASFD,2, (41) (42) We ote that ε ASFD also has two compoets. The first compoet ε ASFD,1, which is due to icorrect modelig of the sigal vector, is very small sice the error i the approximatio ξ m 1 is very small. The secod compoet ε ASFD,2, which is due to oise, is aalogous to ε ad ε T,2 defied i (26) ad (4) respectively. The oise-iduced error compoet ε ASFD,2 is lower tha ε whe M > N. ece, for a give N, the ASFD is expected to perform better tha the at higher frequecies. The T is expected to perform better tha ASFD at all frequecies sice ε T< ε ASFD. These predictios are cofirmed by the simulatio results show i Sectio 4. owever, the ASFD has the advatage of ot requirig ay prior iformatio o the modal waveumbers of the chael. 4. PERFORMANCE ANALYSIS We have evaluated the performace of the detectors through Fig. 2: P D vs. P FA at SNR = -10 db. GG (α = 0.5) oise. (a) f = 50 z, (b) f = 50 z. Fig. : (a) Normalized sigal estimatio MSE vs. frequecy, ad (b) P D (at P FA = 0.01) vs. frequecy for GG (α = 0.5) oise with -5 db SNR. simulatios usig a 10-sesor horizotal AVS array with half-wavelegth spacig i a Pekeris chael [9] with the followig parameters: ocea depth h = 70 m, soud speed i water c = 1500 m/s, bottom soud speed c b = 1700 m/s, bottom atteuatio δ = 0.5 db/wavelegth, desity ratio ρ b /ρ = 1.5. The array depth is z a = 40 m, the source is at a rage r = 5 km, depth z s = 40 m, azimuth ϕ = o. The SNR = -10 db i Fig. 2, ad -5 db i Figs. ad 4. I Figs. 2 ad, the evirometal oise is GG (α = 0.5) distributed. The probability of false alarm is fixed at P FA = 0.01 i Figs. ad 4. T results are show for M ' = 1, which is the value that maximizes the probability of detectio P D of the T for the curret simulatio parameters. The plots i Fig. 2 show the receiver operatig characteristics (variatio of P D with P FA ) at a array SNR = - 10 db, for the UD (solid lie), (dotted lie), T (dashed lie) ad ASFD (dot-dashed lie) whe the sigal frequecy is (a) 50 z (correspodig to M = 2 modes) ad (b) 50 z (M = 15). It ca be see from Fig. 2 that amog the realizable detectors cosidered, the T provides the best performace. The ASFD provides a better performace tha the at the higher frequecy, eve though the former uses o iformatio about the chael. I Fig. we study, i greater detail, the variatio of performace of the detectors with frequecy ad the relatio betwee detector performace ad sigal estimatio error.

5 Fig. 4: P D vs. parameter α of GG oise at P FA = 0.01 for f = 50 z at SNR = -5 db. Fig. (a) shows the variatio of the sigal estimatio MSE of the ASFD, ad T methods with frequecy, ad Fig (b) shows the correspodig variatio of the P D of these detectors. It is see that there is a very good egative correlatio betwee MSE ad P D across all detectors ad at all frequecies. The errors ε T ad ε ASFD are almost idepedet of frequecy, ad ε T < ε ASFD. Accordigly, the detectio performace of T is uiformly better tha that of ASFD. The error ε keeps icreasig with frequecy due to the icrease i the umber of modes M, ad cosequetly the performace of keeps degradig as frequecy is icreased. At very low frequecies the performace of is oly margially iferior to that of T ad better tha that of ASFD. At higher frequecies, ASFD performs better tha. I Fig. 4 we study the variatio of P D of the detectors with the parameter α of the evirometal oise. We cosider two cases whe the parameters σ 2 ad α are kow (solid lies) ad ukow (dashed lies). Whe the oise parameters are ukow, detectio is doe by obtaiig ML estimates of the ukow oise parameters. Figure 4 idicates that the performace of all detectors keeps improvig as α is reduced (i.e. as impulsiveess of evirometal oise icreases). This is so because, for a give SNR, most of the eergy of a impulsive oise resides i the outlier values of oise. The detectors are able to effectively reject these impulsive compoets ad thus achieve better performace i more impulsive oise. The differece betwee the dashed ad solid lies represets the degradatio i detector performace due to lack of kowledge of the oise parameters. This degradatio is lower i the case of the T as compared to the ASFD ad the, showig the greater robustess of T. If the oise PDF is estimated i advace usig secodary data [4], this degradatio ca be reduced. Overall, the T is show to be the most effective detectio scheme over the whole rage of heavy-tailed GG oise PDFs. 5. CONCLUSION This paper proposes two ew AVS array-based detectio schemes for sources i shallow ocea eviromets cotamiated by impulsive oise, viz. the trucated subspace detector (T) ad the approximate sigal form detector (ASFD). The detectors ivolve estimatio of the array sigal vector which is ukow due to the ukow locatio of the source. The detectio performace is show to be related to the ormalized mea square sigal estimatio error (MSE) of the associated GLRT. Thus the MSE provides a simple idicator to gauge the effectiveess of a detector without usig Mote Carlo simulatios. The subspace detector () degrades i performace with icreasig frequecy, due to a associated icrease i the MSE. The T ad ASFD methods are formulated to obtai improved detectio performace by reducig the sigal estimatio MSE. The T is show to be the most effective ad robust detectio scheme for a wide rage of oise PDFs, if the modal waveumbers of the ocea chael are kow. If this iformatio is ukow, however, detectio may be doe usig the ASFD. As the oise becomes more impulsive, the performace of the detectors improves because they are able to discard more effectively the outlier values arisig from oise. 6. ACKNOWLEDGMENT: This work was partly supported by a grat from Natioal Istitute of Ocea Techology, Cheai, Idia, uder the Ocea Acoustics Programme. REFERENCES [1] S. M. Kay, Fudametals of Statistical Sigal Processig, Vol.II: Detectio Theory, Pretice-all, Upper Saddle River, New Jersey, [2] S. Kraut, L. L. Scharf, L. T. McWhorter, Adaptive subspace detectors, IEEE Trasactios o Sigal Processig, vol. 49, o. 1, pp. 1-16, [] K. M. Krisha, G. V. Aad, "Narrowbad detectio of acoustic source i shallow ocea usig vector sesor array," Proc. OCEANS 2009, MTS/IEEE Biloxi, pp.1-8, Oct [4] V. N. ari, G. V. Aad, A. B. Premkumar, A. S. Madhukumar, "Uderwater Sigal Detectio i Partially kow Ocea usig Short Acoustic Vector Sesor Array," Proc. OCEANS 2011, Satader, pp. 1-9, Jue [5] F.W.Machell, C.S.Perod, G.E.Ellis, "Statistical characteristics of ocea acoustic oise process", i: E. J. Wegma, S. C. Schwartz, J. B. Thomas (Eds.), Topics i No-Gaussia Sigal Processig, Spriger, Berli pp , [6] N. B. Pulsoe, R. S. Raghava, Aalysis of a Adaptive CFAR Detector i No-Gaussia Iterferece, IEEE Trasactios o Aerospace ad Electroic Systems, vol. 5, o., pp , [7] M. N. Desai ad R. S. Magoubi, Robust Gaussia ad o- Gaussia matched subspace detectio, IEEE Trasactios o Sigal Processig, vol. 51, o. 12, pp , 200 [8] M. awkes ad A. Nehorai, Acoustic vector-sesor beamformig ad Capo directio estimatio, IEEE Trasactios o Sigal Processig, vol. 46, o. 9, pp , [9] K. G. Nagaada, G. V. Aad, Subspace itersectio method of high resolutio bearig estimatio i shallow ocea usig acoustic vector sesors, Sigal Processig, vol. 90, o. 1, pp , 2010.

Direction of Arrival Estimation Method in Underdetermined Condition Zhang Youzhi a, Li Weibo b, Wang Hanli c

Direction of Arrival Estimation Method in Underdetermined Condition Zhang Youzhi a, Li Weibo b, Wang Hanli c 4th Iteratioal Coferece o Advaced Materials ad Iformatio Techology Processig (AMITP 06) Directio of Arrival Estimatio Method i Uderdetermied Coditio Zhag Youzhi a, Li eibo b, ag Hali c Naval Aeroautical

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm

The DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm , pp.10-106 http://dx.doi.org/10.1457/astl.016.137.19 The DOA Estimatio of ultiple Sigals based o Weightig USIC Algorithm Chagga Shu a, Yumi Liu State Key Laboratory of IPOC, Beijig Uiversity of Posts

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

Session 5. (1) Principal component analysis and Karhunen-Loève transformation

Session 5. (1) Principal component analysis and Karhunen-Loève transformation 200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

Complex Algorithms for Lattice Adaptive IIR Notch Filter

Complex Algorithms for Lattice Adaptive IIR Notch Filter 4th Iteratioal Coferece o Sigal Processig Systems (ICSPS ) IPCSIT vol. 58 () () IACSIT Press, Sigapore DOI:.7763/IPCSIT..V58. Complex Algorithms for Lattice Adaptive IIR Notch Filter Hog Liag +, Nig Jia

More information

A proposed discrete distribution for the statistical modeling of

A proposed discrete distribution for the statistical modeling of It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Information-based Feature Selection

Information-based Feature Selection Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with

More information

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE

OPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE Joural of ELECTRICAL EGIEERIG, VOL. 56, O. 7-8, 2005, 200 204 OPTIMAL PIECEWISE UIFORM VECTOR QUATIZATIO OF THE MEMORYLESS LAPLACIA SOURCE Zora H. Perić Veljo Lj. Staović Alesadra Z. Jovaović Srdja M.

More information

DIRECTION OF ARRIVAL ESTIMATION

DIRECTION OF ARRIVAL ESTIMATION Research Article DIRECTION OF ARRIVAL ESTIMATION Lalita Gupta, R P Sigh Address for correspodece Dept. of Electroics & Commuicatio Egieerig, Maulaa Azad Natioal Istitute of Techology, Bhopal MP Email:gupta.lalita@gmail.com

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator

Economics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

MODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING. University of Illinois at Urbana-Champaign

MODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING. University of Illinois at Urbana-Champaign MODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING Yuheg Bu Jiaxu Lu Veugopal V. Veeravalli Uiversity of Illiois at Urbaa-Champaig Tsighua Uiversity Email: bu3@illiois.edu, lujx4@mails.tsighua.edu.c,

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

5. Likelihood Ratio Tests

5. Likelihood Ratio Tests 1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,

More information

An Improved Proportionate Normalized Least Mean Square Algorithm with Orthogonal Correction Factors for Echo Cancellation

An Improved Proportionate Normalized Least Mean Square Algorithm with Orthogonal Correction Factors for Echo Cancellation 202 Iteratioal Coferece o Electroics Egieerig ad Iformatics (ICEEI 202) IPCSI vol. 49 (202) (202) IACSI Press, Sigapore DOI: 0.7763/IPCSI.202.V49.33 A Improved Proportioate Normalized Least Mea Square

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Orthogonal Gaussian Filters for Signal Processing

Orthogonal Gaussian Filters for Signal Processing Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios

More information

Free Space Optical Wireless Communications under Turbulence Channel Effect

Free Space Optical Wireless Communications under Turbulence Channel Effect IOSR Joural of Electroics ad Commuicatio Egieerig (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue 3, Ver. III (May - Ju. 014), PP 01-08 Free Space Optical Wireless Commuicatios uder Turbulece

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

Formation of A Supergain Array and Its Application in Radar

Formation of A Supergain Array and Its Application in Radar Formatio of A Supergai Array ad ts Applicatio i Radar Tra Cao Quye, Do Trug Kie ad Bach Gia Duog. Research Ceter for Electroic ad Telecommuicatios, College of Techology (Coltech, Vietam atioal Uiversity,

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2

( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2 82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,

More information

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract

Goodness-Of-Fit For The Generalized Exponential Distribution. Abstract Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

OFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI

OFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI MIMO-OFDM OFDM Precoder for Miimizig BER Upper Boud of MLD uder Imperfect CSI MCRG Joit Semiar Jue the th 008 Previously preseted at ICC 008 Beijig o May the st 008 Boosar Pitakdumrogkija Kazuhiko Fukawa

More information

Statistical Pattern Recognition

Statistical Pattern Recognition Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals

BER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that

More information

Deterministic Model of Multipath Fading for Circular and Parabolic Reflector Patterns

Deterministic Model of Multipath Fading for Circular and Parabolic Reflector Patterns To appear i the Proceedigs of the 5 IEEE outheastco, (Ft. Lauderdale, FL), April 5 Determiistic Model of Multipath Fadig for Circular ad Parabolic Reflector Patters Dwight K. Hutcheso dhutche@clemso.edu

More information

Algebra of Least Squares

Algebra of Least Squares October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal

More information

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT

Geometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca

More information

THE KALMAN FILTER RAUL ROJAS

THE KALMAN FILTER RAUL ROJAS THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

5.1 Review of Singular Value Decomposition (SVD)

5.1 Review of Singular Value Decomposition (SVD) MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of

More information

Unbiased Estimation. February 7-12, 2008

Unbiased Estimation. February 7-12, 2008 Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom

More information

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution

Maximum likelihood estimation from record-breaking data for the generalized Pareto distribution METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio

More information

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS

A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a

More information

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation

Approximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

Efficient GMM LECTURE 12 GMM II

Efficient GMM LECTURE 12 GMM II DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm

More information

x = Pr ( X (n) βx ) =

x = Pr ( X (n) βx ) = Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as

More information

Exponential Families and Bayesian Inference

Exponential Families and Bayesian Inference Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where

More information

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector

Dimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara

Econ 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio

More information

Statistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions

Statistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions Statistical ad Mathematical Methods DS-GA 00 December 8, 05. Short questios Sample Fial Problems Solutios a. Ax b has a solutio if b is i the rage of A. The dimesio of the rage of A is because A has liearly-idepedet

More information

The Method of Least Squares. To understand least squares fitting of data.

The Method of Least Squares. To understand least squares fitting of data. The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

Standard Bayesian Approach to Quantized Measurements and Imprecise Likelihoods

Standard Bayesian Approach to Quantized Measurements and Imprecise Likelihoods Stadard Bayesia Approach to Quatized Measuremets ad Imprecise Likelihoods Lawrece D. Stoe Metro Ic. Resto, VA USA Stoe@metsci.com Abstract I this paper we show that the stadard defiitio of likelihood fuctio

More information

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION

CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods

More information

Assignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.

Assignment 2 Solutions SOLUTION. ϕ 1  = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ. PHYSICS 34 QUANTUM PHYSICS II (25) Assigmet 2 Solutios 1. With respect to a pair of orthoormal vectors ϕ 1 ad ϕ 2 that spa the Hilbert space H of a certai system, the operator  is defied by its actio

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

DIGITAL FILTER ORDER REDUCTION

DIGITAL FILTER ORDER REDUCTION DIGITAL FILTER RDER REDUTI VAHID RAISSI DEHKRDI, McGILL UIVERSITY, AADA, vahid@cim.mcgill.ca AMIR G. AGHDAM, RDIA UIVERSITY, AADA, aghdam@ece.cocordia.ca ABSTRAT I this paper, a method is proposed to reduce

More information

On an Application of Bayesian Estimation

On an Application of Bayesian Estimation O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma

More information

Warped, Chirp Z-Transform: Radar Signal Processing

Warped, Chirp Z-Transform: Radar Signal Processing arped, Chirp Z-Trasform: Radar Sigal Processig by Garimella Ramamurthy Report o: IIIT/TR// Cetre for Commuicatios Iteratioal Istitute of Iformatio Techology Hyderabad - 5 3, IDIA Jauary ARPED, CHIRP Z

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Chapter Vectors

Chapter Vectors Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it

More information

Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab

Table 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Mixtures of Gaussians and the EM Algorithm

Mixtures of Gaussians and the EM Algorithm Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT

TR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the

More information

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation

Confidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame

Information Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for

More information

TAMS24: Notations and Formulas

TAMS24: Notations and Formulas TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =

More information

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.

Definitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients. Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,

More information

Topic 18: Composite Hypotheses

Topic 18: Composite Hypotheses Toc 18: November, 211 Simple hypotheses limit us to a decisio betwee oe of two possible states of ature. This limitatio does ot allow us, uder the procedures of hypothesis testig to address the basic questio:

More information

FFTs in Graphics and Vision. The Fast Fourier Transform

FFTs in Graphics and Vision. The Fast Fourier Transform FFTs i Graphics ad Visio The Fast Fourier Trasform 1 Outlie The FFT Algorithm Applicatios i 1D Multi-Dimesioal FFTs More Applicatios Real FFTs 2 Computatioal Complexity To compute the movig dot-product

More information

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d

Linear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y

More information

MATH/STAT 352: Lecture 15

MATH/STAT 352: Lecture 15 MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet

More information

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency

Math 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the

More information

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State

R. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com

More information

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors

ECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY

EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber

More information

Mathematical Statistics - MS

Mathematical Statistics - MS Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios

More information

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes

The Maximum-Likelihood Decoding Performance of Error-Correcting Codes The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,

More information

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss

ECE 901 Lecture 12: Complexity Regularization and the Squared Loss ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality

More information

Machine Learning for Data Science (CS 4786)

Machine Learning for Data Science (CS 4786) Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Statistical Noise Models and Diagnostics

Statistical Noise Models and Diagnostics L. Yaroslavsky: Advaced Image Processig Lab: A Tutorial, EUSIPCO2 LECTURE 2 Statistical oise Models ad Diagostics 2. Statistical models of radom iterfereces: (i) Additive sigal idepedet oise model: r =

More information