School of Computer Engineering, Nanyang Technological University, Singapore
|
|
- Tobias Solomon Barnett
- 5 years ago
- Views:
Transcription
1 NARROWBAND DETECTION IN OCEAN WIT IMPULSIVE NOISE USING AN ACOUSTIC VECTOR SENSOR ARRAY V. N. ari 1, Aad G. V. 2, P. V. Nagesha 2 ad A. B. Premkumar 1 1 School of Computer Egieerig, Nayag Techological Uiversity, Sigapore Departmet of Electrical Commuicatio Egieerig, Idia Istitute of Sciece, Bagalore , Idia ABSTRACT This paper presets the formulatio ad aalysis of some methods for arrowbad detectio of uderwater acoustic sources i impulsive oise usig a array of acoustic vector sesors. Sice the array sigal vector is ukow due to the ukow locatio of the source, detectio is based o the geeralized likelihood ratio test which ivolves estimatio of the sigal vector. Differet detectors use differet sigal models which yield differet sigal estimators. It is show that the trucated subspace detector (T), which uses a trucated ormal mode model, yields the best performace. Idex Terms- subspace detectio, geeralized likelihood ratio test, shallow ocea, acoustic vector sesor 1. INTRODUCTION This paper addresses the problem of arrowbad detectio of a acoustic source i a shallow ocea usig a array of acoustic vector sesors (AVS). Detectio of sources usig a sesor array may be achieved usig a optimal Neyma- Pearso (NP) detectio strategy if the sigal field at the array is kow [1]. owever, the sigal is ukow i a geeral detectio sceario because the source locatio is ukow, ad the evirometal parameters may ot be kow fully. ece detectio of the sigal is doe by a geeralized likelihood ratio test (GLRT), which ivolves estimatio of the sigal vector ad oise parameters at the array. Oe form of this test leads to the formulatio of a subspace detectio algorithm [2]. Two detectors based o the GLRT approach, have bee preseted recetly for AVS arrays [, 4], viz. the subspace detector () ad the approximate sigal form detector (ASFD). These were formulated uder the assumptio that the ambiet oise is Gaussia. owever, ambiet oise i the ocea ofte has a heavy-tailed distributio [5]. Therefore it is of iterest to develop effective methods of detectio i such a eviromet. GLRT detectio has earlier bee employed i the case of spherically ivariat radom vector oise [6] ad geeralized Gaussia oise with iterferece [7]. It is well-kow that AVS arrays have a better directiofidig capability tha the covetioal APS arrays [8, 9]. This performace advatage arises because a AVS measures ot oly the acoustic pressure but also all compoets of particle velocity at a poit i space. Recet work has show that this advatage of a AVS array ca also be exploited to obtai better detectio performace tha that achieved by a APS array [, 4]. I this paper we exted the ad ASFD techiques to uderwater sigal detectio i heavy-tailed oise usig a AVS array. The oise distributio is modeled as geeralized Gaussia (GG). We also preset a ew techique called trucated subspace detector (T). Each of these detectors is based o a differet model of the array sigal vector. Differet models lead to differet estimates of the sigal vector. It is show that the ormalized mea square sigal estimatio error (MSE) of T is sigificatly lower ad hece the T provides a sigificatly better performace tha both ad ASFD. The paper is orgaized as follows. The data model is preseted i Sectio 2. The alterative sigal models ad correspodig detectors are formulated i Sectio ad expressios for the associated MSEs are derived. A comparative performace aalysis of the detectors is preseted i Sectio 4. Coclusios are preseted i Sectio DATA MODEL Cosider the detectio of a arrowbad source with ceter frequecy f located i a shallow ocea, usig a N elemet uiform horizotal liear AVS array. We shall cosider three outputs produced by each AVS, viz. the acoustic pressure ad two orthogoal horizotal compoets of particle velocity. The vertical compoet of particle velocity is ot cosidered sice it is foud to icrease complexity without yieldig ay sigificat additioal improvemet i performace. The sesor array is assumed to be at depth z a i the far-field regio with respect to the source, which is located at rage r, depth z s, ad azimuth agle ϕ measured with respect to the axis of the array. Let x, s ad w deote, respectively, the N x 1 data vector, sigal vector ad oise vector at the AVS array; ad let x, s ad w deote, respectively, the x1 data vector, sigal vector ad oise vector at the th AVS. Assumig the ocea to be rage-idepedet with water desity ρ ad soud speed profile c(z), we ca express s as s = [p 2 ρc(z a )v x 2 ρc(z a )v y ] T, (1) where p ad (v x, v y ) deote, respectively, the complex
2 amplitudes of acoustic pressure ad horizotal (x, y) compoets of particle velocity of the sigal at the th AVS. The vectors w ad x are defied similarly. The particle velocity compoets are scaled by the factor 2 ρc(z a ) to esure that all the elemets have the same dimesio. The sigal vector s ca be writte i terms of the ormal modes of the oceaic waveguide as [9]. s = A(ϕ)b, (2) A(ϕ) = [a 1 (ϕ) a M (ϕ)], () a m (ϕ) = c m (ϕ) d m (ϕ), (4) c m (ϕ) = [1 exp(ik m dcos(ϕ)) exp(i(n-1)k m dcos(ϕ))] T (5) d m (ϕ) = [1 2 ξ m cos(ϕ) 2 ξ m si(ϕ)] T, (6) ξ m = k m /k(z a ) = k m c(z a )/2πf; m = 1, M, (7) b = [b 1 b M ] T, (8) b B z exp r jk r k r ; m 1,... M, (9) m m s m m m where k m, δ m ad ψ m (z) are respectively the waveumber, atteuatio coefficiet ad eigefuctio of the m th mode, M is the umber of modes, d is the iter-sesor spacig, B is a costat, ad deotes the Kroecker product. The colums of A(ϕ) are the modal steerig vectors, ad the elemets of b are the amplitudes of the modes. The ambiet oise i the ocea is assumed to be spatially white ad heavy-tailed, modeled by the followig circular complex geeralized Gaussia (GG) PDF with variace σ 2 f GG N N J( ) K( ) w exp, 0< 2, 2 w (10) 1 /2 (4 / ) (4 / ) J( ), K( ). 2 2 [ (2 / )] 2 (2 / ). GLRT DETECTION IN SALLOW OCEAN.1 Formulatio of the detectio problem The detectio problem ca be cast i the form of the followig hypothesis testig problem: 0 : x = w 1 : x = s+ w. (11) The joit likelihood fuctios of the array data vectors uder hypotheses 0 ad 1 are give by f (x, 0 ) = f GG (x), (12) f (x, 1 ) = f GG (x - s), (1) where f GG (.) is defied i (10). The likelihood ratio L(x) = f(x; 1 )/f(x; 0 ) (14) yields the followig test statistic ad decisio rule N 1 x ( ) ( ) ( ), (15) TUD x x s Decide 1 if T UD (x) > γ(p FA ) (16) where x() ad s() deote the th elemet of x ad s respectively, ad γ(p FA ) is the threshold correspodig to probability of false alarm P FA [1]. But (16) is a urealizable detector (UD) sice it requires the kowledge of the sigal vector s that depeds o the ukow source locatio. owever, the performace of UD may be cosidered as a upper boud o the performace of ay realizable detector. Whe some parameters of the sigal s or the oise w are ukow, they ca be estimated by maximizig the likelihood fuctios with respect to these ukow parameters. Let Θ j deote the ukow parameter vector uder hypothesis j, j=0,1. The ratio of the maximized likelihoods called the geeralized likelihood ratio, is give by G ; ˆ 1; 1 ; ˆ 0; 0 L x f x Θ f x Θ, (17) where Θˆ j is the maximum likelihood estimate (MLE) of Θ j. Simplificatio of the geeralized likelihood ratio yields the GLRT test statistic. I sectios.2 ad., two ovel detectors based o the GLRT approach are preseted..2. Trucated Subspace detector If N > M, where N is the umber of sesors i the array ad M is the umber of ormal modes, the colums of the modal steerig matrix A(ϕ) are liearly idepedet ad the N-dimesioal array sigal vector s belogs to the M- dimesioal modal subspace V M (ϕ) spaed by the colums of A(ϕ). A subspace detector () based o this property of s was proposed i [] for arrowbad detectio i Gaussia oise. A simpler formulatio of the is preseted here for the geeral case of o-gaussia oise. We ca represet s i the alterative form s = A(ϕ)b = Q(ϕ) β =[q 1 (ϕ).. q M (ϕ)] β, (18) where Q(ϕ) is a uitary matrix which may be obtaied by QR decompositio of A(ϕ) as A(ϕ) = Q(ϕ) R. (19) I (18), β = Rb is a trasformed versio of the ukow mode amplitude vector b. The sigal vector s belogs to the modal subspace V M (ϕ) defied as V M (ϕ) = spa{q 1 (ϕ) q M (ϕ)}, (20) so that {q 1 (ϕ) q M (ϕ)} costitutes a orthoormal basis of V M (ϕ). For a give ϕ, the subspace V M (ϕ) is kow if the modal waveumbers {k m ; m = 1,, M} are kow. Thus the problem of estimatig the N-dimesioal sigal vector s is reduced to the simpler problem of estimatig the M- dimesioal mode amplitude vector β. Maximizatio of the likelihood fuctio f (x; 1 ) = f(x;β,ϕ, 1 ) with respect to the ukow M-dimesioal vector β yields the equatio N 1 ˆ 2 ˆ x (21) x r ( ) ( ) [ ( ) r ( ) ( )] 0, where r (ϕ) is a row vector deotig the th row of Q(ϕ), ad β ˆ deotes the coditioal MLE of β for a give ϕ. The
3 followig closed form solutio of (21) is readily obtaied if α = 2: β ˆ = Q (ϕ)x. (22) As o closed form solutio of (21) is available whe α 2, we use (22) as a approximatio to the coditioal MLE of β. The approximate MLEs of ϕ ad s ca ow be writte as ˆ argmax{ x Q( ) Q ( ) x}, (2) ˆ sˆ Q( ) Q ( ˆ ) x, (24) ad the test statistic of the is thus give by N 1 T x x( ) x( ) r ( ) ( ) x. ˆ ˆ Q (25) The ormalized mea square error (MSE) of the sigal estimate s ca be foud from (18) ad (24) as ˆ E[( s sˆ) ( s sˆ)] M, N (26) [ ] where is the sigal-to-oise ratio (SNR) ad E is the expectatio operator. The ca be employed oly if the colums of A(ϕ) are liearly idepedet, i.e. if M N. Sice the umber of modes M icreases as the frequecy f is icreased [9], the applicability of the is limited by a upper cut-off frequecy f c which depeds o the legth of the array; a shorter array limits the applicability of the to a lower cut-off frequecy. Moreover, the suffers degradatio i performace as f is icreased eve if f < f c, because a icrease i M leads to a icrease i the MSE ε, as show by (26). I order to exted the applicability of the to shorter arrays/higher frequecies, as well as arrest the degradatio associated with a icrease i the umber of modes, we propose a detector which uses a trucated model of the sigal vector obtaied by projectig s o a modal subspace V M of smaller dimesio M ', where M ' < M: V M (ϕ) = spa{q 1 (ϕ) q M (ϕ)}. (27) The set of spaig vectors of the trucated subspace V M (ϕ) is a subset of the set of spaig vectors of the full modal subspace V M (ϕ). The trucated sigal vector is give by s Q' ( ) ' [ q ( )... q ( )] '. (28) 1 M ' O replacig s by s' i (1) ad the adoptig the same procedure as for the subspace detector, we get the followig expressios for the coditioal MLE of β '(ϕ), the MLEs of ϕ ad s', ad the test statistic of the trucated subspace detector ˆ '( ) ' β Q ( ) x, (29) ˆ T argmax{ x Q'( ) Q ' ( ) x }, (0) sˆ' Q'( ˆ ) Q ' ( ˆ ) x, (1) T T ' ˆ ˆ N T T T 1 T ( x) [ x( ) x( ) r ( ) Q ' ( ) x ]. (2) where r ( ˆ ) is the th row of Q '( ˆ ). It ca be show ' T T that the ormalized MSE of the estimate s ˆ ' is E[( s sˆ') ( s sˆ')] T T,1 T,2 E[ s' s'] M' 1,. N T,1 T,2, () (4) The ormalized MSE ε T has two compoets. The first compoet ε T,1 is due to trucatio of the ormal mode expasio of the sigal vector. The secod compoet ε T,2 is due to oise, ad it is aalogous to ε defied i (26). Plots of ε T versus are show i Figs. 1 (a), (b) ad (c) for SNR = 0, 10 ad 20 db respectively, whe a sigal of frequecy 50 z is received by a 10-elemet AVS LA. The evirometal parameters are as specified at the begiig of Sectio 4. For this chose set of parameters, M = 15. We ca draw the followig coclusios from (), (4) ad Fig. 1. The oise-iduced error compoet ε T,2 decreases liearly i proportio to as is reduced. The trucatio-iduced error compoet icreases very slowly as the trucatio is icreased (i.e. as is reduced) ad becomes sigificat oly whe is close to 1. This behavior ca be attributed to the fact that (i) the modal vectors {a 1 (ϕ) a M (ϕ)} i the expasio of s are highly correlated, ad (ii) amplitudes { } of the discarded higher order modes are quite small due to faster atteuatio of the higher order modes. The total MSE ε T is miimum at a optimal value of which is very close to 1. The optimal value of icreases very slowly with icreasig SNR. It follows that the performace of T may be expected to be sigificatly better tha that of ad that the choice =1 is optimal or ear-optimal. This predictio is cofirmed by the result preseted i Sectio 4. The use of a trucated sigal model i T also has the additioal advatages of (i) reducig the eed for chael iformatio to modal waveumbers of the first few modes oly, ad (ii) reducig the computatioal complexity... Approximate sigal form detector A simple detector called the approximate sigal form detector (ASFD) may be formulated [4] by exploitig the fact that the modal waveumbers {k m ; m = 1,, M} are very close to oe aother. Usig the approximatio ξ m = k m /k(z a ) 1 i (7), we get the followig approximate expressio for the array sigal vector s"= G(ϕ)p, G(ϕ) = I N [1 2 cos(ϕ) 2 si(ϕ)] T, (5) where p = [p 1 p N ] T, ad I N deotes the NxN idetity matrix. O replacig s by s" i (1) ad maximizig the resultat likelihood fuctio f(x; 1 ) = f(x; p, ϕ, 1 ) with respect to p leads to the equatio
4 Fig. 1: ε T versus M' for ϕ = o f = 50 z, M = 15 ad (a) SNR = 0 db, (b) SNR = 10 db, ad (c) SNR = 20 db. 2 N ˆ x ˆ 1 g ( ) p [ g ( ) g ( ) p g ( ) x( )] 0, (6) where g (ϕ) is a row vector deotig the th row of G(ϕ), ad ˆp is the ML estimate of p. If α = 2, the solutio of (6) is give by 1 pˆ ( G ( ) G( )) G ( ) x G ( ) x / (7) No closed form solutio of (6) is available whe α 2, but (7) may still be used as a approximatio to the coditioal MLE. The correspodig MLEs of bearig ϕ ad sigal vector s '', ad the test statistic of the ASFD are give by ˆ ASFD { x G( ) G ( ) x}, (8) ˆ sˆ G( ) G ( ˆ ) x /. (9) ASFD N 1 ASFD TAS D ( x) [ x( ) x( ) s ˆ( ) ]. (40) F The ormalized MSE of the sigal estimate ˆ s is give by E[( s sˆ'') ( s sˆ'')] ASFD ASFD,1 ASFD,2 E[ s'' s''] 1 1,. ASFD,1 ASFD,2, (41) (42) We ote that ε ASFD also has two compoets. The first compoet ε ASFD,1, which is due to icorrect modelig of the sigal vector, is very small sice the error i the approximatio ξ m 1 is very small. The secod compoet ε ASFD,2, which is due to oise, is aalogous to ε ad ε T,2 defied i (26) ad (4) respectively. The oise-iduced error compoet ε ASFD,2 is lower tha ε whe M > N. ece, for a give N, the ASFD is expected to perform better tha the at higher frequecies. The T is expected to perform better tha ASFD at all frequecies sice ε T< ε ASFD. These predictios are cofirmed by the simulatio results show i Sectio 4. owever, the ASFD has the advatage of ot requirig ay prior iformatio o the modal waveumbers of the chael. 4. PERFORMANCE ANALYSIS We have evaluated the performace of the detectors through Fig. 2: P D vs. P FA at SNR = -10 db. GG (α = 0.5) oise. (a) f = 50 z, (b) f = 50 z. Fig. : (a) Normalized sigal estimatio MSE vs. frequecy, ad (b) P D (at P FA = 0.01) vs. frequecy for GG (α = 0.5) oise with -5 db SNR. simulatios usig a 10-sesor horizotal AVS array with half-wavelegth spacig i a Pekeris chael [9] with the followig parameters: ocea depth h = 70 m, soud speed i water c = 1500 m/s, bottom soud speed c b = 1700 m/s, bottom atteuatio δ = 0.5 db/wavelegth, desity ratio ρ b /ρ = 1.5. The array depth is z a = 40 m, the source is at a rage r = 5 km, depth z s = 40 m, azimuth ϕ = o. The SNR = -10 db i Fig. 2, ad -5 db i Figs. ad 4. I Figs. 2 ad, the evirometal oise is GG (α = 0.5) distributed. The probability of false alarm is fixed at P FA = 0.01 i Figs. ad 4. T results are show for M ' = 1, which is the value that maximizes the probability of detectio P D of the T for the curret simulatio parameters. The plots i Fig. 2 show the receiver operatig characteristics (variatio of P D with P FA ) at a array SNR = - 10 db, for the UD (solid lie), (dotted lie), T (dashed lie) ad ASFD (dot-dashed lie) whe the sigal frequecy is (a) 50 z (correspodig to M = 2 modes) ad (b) 50 z (M = 15). It ca be see from Fig. 2 that amog the realizable detectors cosidered, the T provides the best performace. The ASFD provides a better performace tha the at the higher frequecy, eve though the former uses o iformatio about the chael. I Fig. we study, i greater detail, the variatio of performace of the detectors with frequecy ad the relatio betwee detector performace ad sigal estimatio error.
5 Fig. 4: P D vs. parameter α of GG oise at P FA = 0.01 for f = 50 z at SNR = -5 db. Fig. (a) shows the variatio of the sigal estimatio MSE of the ASFD, ad T methods with frequecy, ad Fig (b) shows the correspodig variatio of the P D of these detectors. It is see that there is a very good egative correlatio betwee MSE ad P D across all detectors ad at all frequecies. The errors ε T ad ε ASFD are almost idepedet of frequecy, ad ε T < ε ASFD. Accordigly, the detectio performace of T is uiformly better tha that of ASFD. The error ε keeps icreasig with frequecy due to the icrease i the umber of modes M, ad cosequetly the performace of keeps degradig as frequecy is icreased. At very low frequecies the performace of is oly margially iferior to that of T ad better tha that of ASFD. At higher frequecies, ASFD performs better tha. I Fig. 4 we study the variatio of P D of the detectors with the parameter α of the evirometal oise. We cosider two cases whe the parameters σ 2 ad α are kow (solid lies) ad ukow (dashed lies). Whe the oise parameters are ukow, detectio is doe by obtaiig ML estimates of the ukow oise parameters. Figure 4 idicates that the performace of all detectors keeps improvig as α is reduced (i.e. as impulsiveess of evirometal oise icreases). This is so because, for a give SNR, most of the eergy of a impulsive oise resides i the outlier values of oise. The detectors are able to effectively reject these impulsive compoets ad thus achieve better performace i more impulsive oise. The differece betwee the dashed ad solid lies represets the degradatio i detector performace due to lack of kowledge of the oise parameters. This degradatio is lower i the case of the T as compared to the ASFD ad the, showig the greater robustess of T. If the oise PDF is estimated i advace usig secodary data [4], this degradatio ca be reduced. Overall, the T is show to be the most effective detectio scheme over the whole rage of heavy-tailed GG oise PDFs. 5. CONCLUSION This paper proposes two ew AVS array-based detectio schemes for sources i shallow ocea eviromets cotamiated by impulsive oise, viz. the trucated subspace detector (T) ad the approximate sigal form detector (ASFD). The detectors ivolve estimatio of the array sigal vector which is ukow due to the ukow locatio of the source. The detectio performace is show to be related to the ormalized mea square sigal estimatio error (MSE) of the associated GLRT. Thus the MSE provides a simple idicator to gauge the effectiveess of a detector without usig Mote Carlo simulatios. The subspace detector () degrades i performace with icreasig frequecy, due to a associated icrease i the MSE. The T ad ASFD methods are formulated to obtai improved detectio performace by reducig the sigal estimatio MSE. The T is show to be the most effective ad robust detectio scheme for a wide rage of oise PDFs, if the modal waveumbers of the ocea chael are kow. If this iformatio is ukow, however, detectio may be doe usig the ASFD. As the oise becomes more impulsive, the performace of the detectors improves because they are able to discard more effectively the outlier values arisig from oise. 6. ACKNOWLEDGMENT: This work was partly supported by a grat from Natioal Istitute of Ocea Techology, Cheai, Idia, uder the Ocea Acoustics Programme. REFERENCES [1] S. M. Kay, Fudametals of Statistical Sigal Processig, Vol.II: Detectio Theory, Pretice-all, Upper Saddle River, New Jersey, [2] S. Kraut, L. L. Scharf, L. T. McWhorter, Adaptive subspace detectors, IEEE Trasactios o Sigal Processig, vol. 49, o. 1, pp. 1-16, [] K. M. Krisha, G. V. Aad, "Narrowbad detectio of acoustic source i shallow ocea usig vector sesor array," Proc. OCEANS 2009, MTS/IEEE Biloxi, pp.1-8, Oct [4] V. N. ari, G. V. Aad, A. B. Premkumar, A. S. Madhukumar, "Uderwater Sigal Detectio i Partially kow Ocea usig Short Acoustic Vector Sesor Array," Proc. OCEANS 2011, Satader, pp. 1-9, Jue [5] F.W.Machell, C.S.Perod, G.E.Ellis, "Statistical characteristics of ocea acoustic oise process", i: E. J. Wegma, S. C. Schwartz, J. B. Thomas (Eds.), Topics i No-Gaussia Sigal Processig, Spriger, Berli pp , [6] N. B. Pulsoe, R. S. Raghava, Aalysis of a Adaptive CFAR Detector i No-Gaussia Iterferece, IEEE Trasactios o Aerospace ad Electroic Systems, vol. 5, o., pp , [7] M. N. Desai ad R. S. Magoubi, Robust Gaussia ad o- Gaussia matched subspace detectio, IEEE Trasactios o Sigal Processig, vol. 51, o. 12, pp , 200 [8] M. awkes ad A. Nehorai, Acoustic vector-sesor beamformig ad Capo directio estimatio, IEEE Trasactios o Sigal Processig, vol. 46, o. 9, pp , [9] K. G. Nagaada, G. V. Aad, Subspace itersectio method of high resolutio bearig estimatio i shallow ocea usig acoustic vector sesors, Sigal Processig, vol. 90, o. 1, pp , 2010.
Direction of Arrival Estimation Method in Underdetermined Condition Zhang Youzhi a, Li Weibo b, Wang Hanli c
4th Iteratioal Coferece o Advaced Materials ad Iformatio Techology Processig (AMITP 06) Directio of Arrival Estimatio Method i Uderdetermied Coditio Zhag Youzhi a, Li eibo b, ag Hali c Naval Aeroautical
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationThe DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm
, pp.10-106 http://dx.doi.org/10.1457/astl.016.137.19 The DOA Estimatio of ultiple Sigals based o Weightig USIC Algorithm Chagga Shu a, Yumi Liu State Key Laboratory of IPOC, Beijig Uiversity of Posts
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationSession 5. (1) Principal component analysis and Karhunen-Loève transformation
200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationComplex Algorithms for Lattice Adaptive IIR Notch Filter
4th Iteratioal Coferece o Sigal Processig Systems (ICSPS ) IPCSIT vol. 58 () () IACSIT Press, Sigapore DOI:.7763/IPCSIT..V58. Complex Algorithms for Lattice Adaptive IIR Notch Filter Hog Liag +, Nig Jia
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationDiscrete Orthogonal Moment Features Using Chebyshev Polynomials
Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationOPTIMAL PIECEWISE UNIFORM VECTOR QUANTIZATION OF THE MEMORYLESS LAPLACIAN SOURCE
Joural of ELECTRICAL EGIEERIG, VOL. 56, O. 7-8, 2005, 200 204 OPTIMAL PIECEWISE UIFORM VECTOR QUATIZATIO OF THE MEMORYLESS LAPLACIA SOURCE Zora H. Perić Veljo Lj. Staović Alesadra Z. Jovaović Srdja M.
More informationDIRECTION OF ARRIVAL ESTIMATION
Research Article DIRECTION OF ARRIVAL ESTIMATION Lalita Gupta, R P Sigh Address for correspodece Dept. of Electroics & Commuicatio Egieerig, Maulaa Azad Natioal Istitute of Techology, Bhopal MP Email:gupta.lalita@gmail.com
More informationMathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution
America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationMODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING. University of Illinois at Urbana-Champaign
MODEL CHANGE DETECTION WITH APPLICATION TO MACHINE LEARNING Yuheg Bu Jiaxu Lu Veugopal V. Veeravalli Uiversity of Illiois at Urbaa-Champaig Tsighua Uiversity Email: bu3@illiois.edu, lujx4@mails.tsighua.edu.c,
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More information5. Likelihood Ratio Tests
1 of 5 7/29/2009 3:16 PM Virtual Laboratories > 9. Hy pothesis Testig > 1 2 3 4 5 6 7 5. Likelihood Ratio Tests Prelimiaries As usual, our startig poit is a radom experimet with a uderlyig sample space,
More informationAn Improved Proportionate Normalized Least Mean Square Algorithm with Orthogonal Correction Factors for Echo Cancellation
202 Iteratioal Coferece o Electroics Egieerig ad Iformatics (ICEEI 202) IPCSI vol. 49 (202) (202) IACSI Press, Sigapore DOI: 0.7763/IPCSI.202.V49.33 A Improved Proportioate Normalized Least Mea Square
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationOrthogonal Gaussian Filters for Signal Processing
Orthogoal Gaussia Filters for Sigal Processig Mark Mackezie ad Kiet Tieu Mechaical Egieerig Uiversity of Wollogog.S.W. Australia Abstract A Gaussia filter usig the Hermite orthoormal series of fuctios
More informationFree Space Optical Wireless Communications under Turbulence Channel Effect
IOSR Joural of Electroics ad Commuicatio Egieerig (IOSR-JECE) e-issn: 78-834,p- ISSN: 78-8735.Volume 9, Issue 3, Ver. III (May - Ju. 014), PP 01-08 Free Space Optical Wireless Commuicatios uder Turbulece
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 6 Simple alternatives and the Neyman-Pearson lemma
STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull
More informationFormation of A Supergain Array and Its Application in Radar
Formatio of A Supergai Array ad ts Applicatio i Radar Tra Cao Quye, Do Trug Kie ad Bach Gia Duog. Research Ceter for Electroic ad Telecommuicatios, College of Techology (Coltech, Vietam atioal Uiversity,
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information( θ. sup θ Θ f X (x θ) = L. sup Pr (Λ (X) < c) = α. x : Λ (x) = sup θ H 0. sup θ Θ f X (x θ) = ) < c. NH : θ 1 = θ 2 against AH : θ 1 θ 2
82 CHAPTER 4. MAXIMUM IKEIHOOD ESTIMATION Defiitio: et X be a radom sample with joit p.m/d.f. f X x θ. The geeralised likelihood ratio test g.l.r.t. of the NH : θ H 0 agaist the alterative AH : θ H 1,
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationOFDM Precoder for Minimizing BER Upper Bound of MLD under Imperfect CSI
MIMO-OFDM OFDM Precoder for Miimizig BER Upper Boud of MLD uder Imperfect CSI MCRG Joit Semiar Jue the th 008 Previously preseted at ICC 008 Beijig o May the st 008 Boosar Pitakdumrogkija Kazuhiko Fukawa
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationBER results for a narrowband multiuser receiver based on successive subtraction for M-PSK modulated signals
results for a arrowbad multiuser receiver based o successive subtractio for M-PSK modulated sigals Gerard J.M. Jasse Telecomm. ad Traffic-Cotrol Systems Group Dept. of Iformatio Techology ad Systems Delft
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that
More informationDeterministic Model of Multipath Fading for Circular and Parabolic Reflector Patterns
To appear i the Proceedigs of the 5 IEEE outheastco, (Ft. Lauderdale, FL), April 5 Determiistic Model of Multipath Fadig for Circular ad Parabolic Reflector Patters Dwight K. Hutcheso dhutche@clemso.edu
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationGeometry of LS. LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT
OCTOBER 7, 2016 LECTURE 3 GEOMETRY OF LS, PROPERTIES OF σ 2, PARTITIONED REGRESSION, GOODNESS OF FIT Geometry of LS We ca thik of y ad the colums of X as members of the -dimesioal Euclidea space R Oe ca
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information5.1 Review of Singular Value Decomposition (SVD)
MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of
More informationUnbiased Estimation. February 7-12, 2008
Ubiased Estimatio February 7-2, 2008 We begi with a sample X = (X,..., X ) of radom variables chose accordig to oe of a family of probabilities P θ where θ is elemet from the parameter space Θ. For radom
More informationMaximum likelihood estimation from record-breaking data for the generalized Pareto distribution
METRON - Iteratioal Joural of Statistics 004, vol. LXII,. 3, pp. 377-389 NAGI S. ABD-EL-HAKIM KHALAF S. SULTAN Maximum likelihood estimatio from record-breakig data for the geeralized Pareto distributio
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationApproximate Confidence Interval for the Reciprocal of a Normal Mean with a Known Coefficient of Variation
Metodološki zvezki, Vol. 13, No., 016, 117-130 Approximate Cofidece Iterval for the Reciprocal of a Normal Mea with a Kow Coefficiet of Variatio Wararit Paichkitkosolkul 1 Abstract A approximate cofidece
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationEfficient GMM LECTURE 12 GMM II
DECEMBER 1 010 LECTURE 1 II Efficiet The estimator depeds o the choice of the weight matrix A. The efficiet estimator is the oe that has the smallest asymptotic variace amog all estimators defied by differet
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture & 3: Pricipal Compoet Aalysis The text i black outlies high level ideas. The text i blue provides simple mathematical details to derive or get to the algorithm
More informationx = Pr ( X (n) βx ) =
Exercise 93 / page 45 The desity of a variable X i i 1 is fx α α a For α kow let say equal to α α > fx α α x α Pr X i x < x < Usig a Pivotal Quatity: x α 1 < x < α > x α 1 ad We solve i a similar way as
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationDimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector
Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationEcon 325 Notes on Point Estimator and Confidence Interval 1 By Hiro Kasahara
Poit Estimator Eco 325 Notes o Poit Estimator ad Cofidece Iterval 1 By Hiro Kasahara Parameter, Estimator, ad Estimate The ormal probability desity fuctio is fully characterized by two costats: populatio
More informationStatistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions
Statistical ad Mathematical Methods DS-GA 00 December 8, 05. Short questios Sample Fial Problems Solutios a. Ax b has a solutio if b is i the rage of A. The dimesio of the rage of A is because A has liearly-idepedet
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More informationStandard Bayesian Approach to Quantized Measurements and Imprecise Likelihoods
Stadard Bayesia Approach to Quatized Measuremets ad Imprecise Likelihoods Lawrece D. Stoe Metro Ic. Resto, VA USA Stoe@metsci.com Abstract I this paper we show that the stadard defiitio of likelihood fuctio
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationAssignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.
PHYSICS 34 QUANTUM PHYSICS II (25) Assigmet 2 Solutios 1. With respect to a pair of orthoormal vectors ϕ 1 ad ϕ 2 that spa the Hilbert space H of a certai system, the operator  is defied by its actio
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationDIGITAL FILTER ORDER REDUCTION
DIGITAL FILTER RDER REDUTI VAHID RAISSI DEHKRDI, McGILL UIVERSITY, AADA, vahid@cim.mcgill.ca AMIR G. AGHDAM, RDIA UIVERSITY, AADA, aghdam@ece.cocordia.ca ABSTRAT I this paper, a method is proposed to reduce
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationWarped, Chirp Z-Transform: Radar Signal Processing
arped, Chirp Z-Trasform: Radar Sigal Processig by Garimella Ramamurthy Report o: IIIT/TR// Cetre for Commuicatios Iteratioal Istitute of Iformatio Techology Hyderabad - 5 3, IDIA Jauary ARPED, CHIRP Z
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More informationTable 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab
Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationMixtures of Gaussians and the EM Algorithm
Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity
More informationStatistical Inference Based on Extremum Estimators
T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationTR/46 OCTOBER THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION A. TALBOT
TR/46 OCTOBER 974 THE ZEROS OF PARTIAL SUMS OF A MACLAURIN EXPANSION by A. TALBOT .. Itroductio. A problem i approximatio theory o which I have recetly worked [] required for its solutio a proof that the
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationInformation Theory Tutorial Communication over Channels with memory. Chi Zhang Department of Electrical Engineering University of Notre Dame
Iformatio Theory Tutorial Commuicatio over Chaels with memory Chi Zhag Departmet of Electrical Egieerig Uiversity of Notre Dame Abstract A geeral capacity formula C = sup I(; Y ), which is correct for
More informationTAMS24: Notations and Formulas
TAMS4: Notatios ad Formulas Basic otatios ad defiitios X: radom variable stokastiska variabel Mea Vätevärde: µ = X = by Xiagfeg Yag kpx k, if X is discrete, xf Xxdx, if X is cotiuous Variace Varias: =
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationTopic 18: Composite Hypotheses
Toc 18: November, 211 Simple hypotheses limit us to a decisio betwee oe of two possible states of ature. This limitatio does ot allow us, uder the procedures of hypothesis testig to address the basic questio:
More informationFFTs in Graphics and Vision. The Fast Fourier Transform
FFTs i Graphics ad Visio The Fast Fourier Trasform 1 Outlie The FFT Algorithm Applicatios i 1D Multi-Dimesioal FFTs More Applicatios Real FFTs 2 Computatioal Complexity To compute the movig dot-product
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationMATH/STAT 352: Lecture 15
MATH/STAT 352: Lecture 15 Sectios 5.2 ad 5.3. Large sample CI for a proportio ad small sample CI for a mea. 1 5.2: Cofidece Iterval for a Proportio Estimatig proportio of successes i a biomial experimet
More informationMath 152. Rumbos Fall Solutions to Review Problems for Exam #2. Number of Heads Frequency
Math 152. Rumbos Fall 2009 1 Solutios to Review Problems for Exam #2 1. I the book Experimetatio ad Measuremet, by W. J. Youde ad published by the by the Natioal Sciece Teachers Associatio i 1962, the
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationVector Quantization: a Limiting Case of EM
. Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationMathematical Statistics - MS
Paper Specific Istructios. The examiatio is of hours duratio. There are a total of 60 questios carryig 00 marks. The etire paper is divided ito three sectios, A, B ad C. All sectios are compulsory. Questios
More informationThe Maximum-Likelihood Decoding Performance of Error-Correcting Codes
The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationMachine Learning for Data Science (CS 4786)
Machie Learig for Data Sciece CS 4786) Lecture 9: Pricipal Compoet Aalysis The text i black outlies mai ideas to retai from the lecture. The text i blue give a deeper uderstadig of how we derive or get
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More informationStatistical Noise Models and Diagnostics
L. Yaroslavsky: Advaced Image Processig Lab: A Tutorial, EUSIPCO2 LECTURE 2 Statistical oise Models ad Diagostics 2. Statistical models of radom iterfereces: (i) Additive sigal idepedet oise model: r =
More information