NONPARAMETRIC ESTIMATION IN RANDOM SUM MODELS

Size: px
Start display at page:

Download "NONPARAMETRIC ESTIMATION IN RANDOM SUM MODELS"

Transcription

1 STATISTICA, ao LXIX,., 009 NONPARAMETRIC ESTIMATION IN RANDOM SUM MODELS. INTRODUCTION The motvato for ths paper arses from the fact that the radom sum models are wdely used rsk theory, queueg systems, relablty theory, ecoomcs, commucatos, ad medce. I surace cotexts, the compoud dstrbuto of radom sum varables (see, e.g., Ca ad Wllmot (005), Charalambdes (005) ad Paer (006)) arses aturally as follows. Let X be the umber of persos volved the th accdet o a partcular day a certa cty ad let N be aother radom varable that represets the umber of accdets occurrg o that N day. The, the radom varable gve by SN = X, = S0 = X 0 =0, deotes the total umber of persos volved accdets a day, ad s called compoud radom varable. I queueg model, at a bus stato, assume that the umber of passegers o the th bus s X ad the umber of arrvg buses s the radom varable N ; the the umber of passegers arrvg buses durg a perod of tme s the radom sum S = N N X =. I commucatos, let us cosder the radom varable N as the umber of data packets trasmtted over a commucato lk oe mute such that each packet s successfully decoded wth probablty p, depedet of the decodg of ay other packet. Hece, the umber of successfully decoded packets oe mute spa s the radom sum S = N N X =, where X s f the th packet s decoded correctly ad 0 otherwse. That s, the compoud radom varable S N follows a bomal dstrbuto wth radom ad fxed parameters N ad p, respectvely. The dstrbuto of the radom varable S N, s kow as a compoud dstrbuto of the radom varables X ad N, where =,,..., N ; see, e.g., Chatfeld ad Thoebald (973), Ludberg (964), Medh (97), Peköz ad Ross (004), ad Sahoglu (99). Thus, the dstrbuto of a radom sum s based o two dstrbutos: the dstrbuto of N, whch we wll call the evet dstrbuto ad the dstrbuto of the radom varables X, X,, XN, whch we wll call the compoudg dstrbuto.

2 74 May authors (e.g. Ptts (994), Buchma ad Grübel (003, 004), ad Ca ad Wllmot (005)) have bee vestgated the dstrbutoal propertes of the radom sum S N cludg ts dstrbuto fucto ad the asymptotc behavour of the tal. Ptts (994) dscussed the oparametrc estmato of the dstrbuto fucto of S N based o topologcal cocepts ad assumed that the evet dstrbuto s kow ad the compoudg dstrbuto s ukow. Buchma ad Grübel (003, 004) cosdered the estmato problem of a probablty set of the compoudg dstrbuto of X, =,,..., N, ad the compoud dstrbuto of X ad N assumg that the evet dstrbuto follows Posso dstrbuto. Weba (007) vestgated predcto of the compoud mxed Posso process assumg that the evet dstrbuto s a mxed Posso process ad the compoudg dstrbuto s ukow. Meawhle, we here deal wth ukow evet ad compoudg dstrbutos. Also, our work s more geeral tha Ptts (994),ad Buchma ad Grübel (003, 004), sce t ca be appled to ay evet ad compoudg dstrbutos as log as they obey the assumptos that are secto 4.. Recetly, Bakouch ad Rstć (009), ad Rstć et al. (009) employed ths radom sum, S N, to model teger-valued tme seres that are used forecastg ad regresso aalyss of cout data. Also, they dscussed some propertes of S N for a kow evet dstrbuto ad a ukow compoudg dstrbuto, ad the obtaed estmators of the parameters of such dstrbutos after gvg a kow compoudg dstrbuto. I secto 4. of ths paper, we cosder a oparametrc estmato of the compoudg dstrbuto the compoud Posso model. The approach ths case s smlar to the estmato method of Buchma ad Grübel (003, 004) but our approach s of terest to ay problem cocerg the compoud Posso model. O the other had, Buchma ad Grübel (003, 004) are terested oly the compoud Posso model that s commoly used queueg theory for modelg the arrval dstrbuto of the umber of customers. Let Y,, Y deote depedet radom varables, each wth the dstrbuto of S N. Based o the formato provded by the radom varables Y,, Y, we wsh to estmate features of the dstrbutos of X ad N. A commo used approach to ths problem s to use parametrc models for the evet ad compoudg dstrbutos. Ths leads to a parametrc model for the dstrbuto of Y,, Y. Estmatg the parameters of ths model leads to estmators for the parameters of the dstrbutos of X ad N. The drawback of ths approach s that t requres strog assumptos about the dstrbutos of X ad N. However, sce we do ot observe a radom sample from both dstrbutos, these assumptos are dffcult to verfy emprcally. The purpose of ths paper s to cosder two methods of oparametrc estmato radom sum models; that s, we cosder methods that do ot requre full parametrc models for the compoudg dstrbuto ad the evet dstrbu-

3 Noparametrc estmato radom sum models 75 to. The frst cosders estmato of the meas of the dstrbutos of X ad N based o the secod-momet assumptos regardg compoudg ad evet dstrbutos. The secod problem s the oparametrc estmato of the compoudg dstrbuto based o a parametrc model for the evet dstrbuto. The outle of the paper s as follows. I secto some basc results regardg radom sum dstrbutos are preseted; although these results are well-kow, they are cetral to the proposed estmato procedures ad, hece, they are preseted for completeess. The approach based o secod-momet assumptos s preseted secto 3. I secto 4, oparametrc estmato of the compoudg dstrbuto s developed.. SOME PROPERTIES OF RANDOM SUMS Let S = N N X =, where X s depedet, detcally dstrbuted, oegatve, teger-valued radom varables ad let N be a o-egatve, tegervalued radom varable depedet of X, X,, XN. I ths secto, we brefly revew some statstcal propertes of S N (see, e.g., Klugma et al., 004). Let P N deote the probablty geeratg fucto of N ad let P X deote the probablty geeratg fucto of X. Therefore, the probablty geeratg fucto of S N s gve by P ()= t P [ P ()]. t (.) S N N X The fucto PS ( t ) s well defed for t. Smlarly, let M N N ad M X deote the momet geeratg fuctos of N ad X, respectvely. Hece, the momet geeratg fucto of S N s M ()= t P [ M ()]= t M [l M ()]. t (.) S N N X N X The fucto MS () t s well defed for t a for some a > 0. Hece, t follows N that E[ S ]= EN [ ] EX [ ], (.3) N N ES [ ]= ENEX [ ] [ ] + EN [ ( N )] EX [ ] EX [ ], (.4) Var[ S ]= E[ N ] Var[ X ] + Var[ N ]( E[ X ]). (.5) N

4 76 3. ESTIMATION OF THE DISTRIBUTION MEANS UNDER SECOND-MOMENT ASSUMPTIONS Let θ = EX ( ; θ ) ad let λ = EN ( ; λ ). Suppose we observe Y,, Y, depedet, detcally dstrbuted radom varables such that Y has the dstrbuto of SN = X + + XN. Note that ether N or X,, XN are drectly observed; the data oly cossts of realzatos of the radom varable S N ad are deoted by Y,, Y. Our goal s to estmate θ ad λ, the meas of the dstrbutos of X ad N, respectvely, based o ( Y,, Y ). Clearly, ths wll be mpossble wthout further assumptos regardg the dstrbutos of X ad N. Defe the fuctos V : Λ [0, ) ad W : Θ [0, ) by V( λ)= Var( N; λ) ad W ( θ)= Var( X ; θ ) ad assume that V ad W are kow. Usg equatos (.3) ad (.5) we ca show that Y has mea θλ ad varace θ V( λ) + λw( θ). We propose to estmate ( θ, λ ) usg the frst two momets of the dstrbuto of Y. Expressg the parameters θ ad λ terms of the frst two momets of the dstrbuto of Y proceeds ths approach. The assumpto that V ad W are kow s meat to be a weaker verso of the assumpto of parametrc models for the dstrbutos. Ths method mght be used whe oe s wllg to assume that V ( λ )= λ, as the Posso dstrbuto, but s ot wllg to assume that the Posso dstrbuto actually holds. Thus, our approach ths secto s smlar to the quas-lkelhood method descrbed, e.g., McCullagh ad Nelder (989, chapter 9). Sce the frst momet of Y s θλ, t s ecessary that the secod momet of Y s ot a fucto of θλ ; hece, we requre the followg assumpto: Assumpto ad For ( θ, λ) Θ Λ, Let Y = Y = θ V( λ) + λw( θ) s ot a fucto of θλ.

5 Noparametrc estmato radom sum models 77 S = ( Y Y). = Defe the estmator ( θ, λ ) as the soluto to θλ= Y, θ V( λ) + λw( θ)= S, (3.) provded that such soluto exsts. Determato of the asymptotc dstrbuto of ( θ, λ ) requres the followg regularty codtos: Assumpto The parameter space Θ Λ s a ope subset of R. Uder assumpto, the true parameter value ( θ, λ ) s a teror pot of the parameter space. Assumpto 3 Defe a fucto H : Θ Λ A by H( θ, λ)=( θλ, θ V( λ) + λw( θ)). The A s a ope subset of R ad H( θ, λ ) s a oe-to-oe fucto wth a cotuously dfferetable verse. Uder assumpto 3, the estmators θ ad λ ca be wrtte as fuctos of Y ad S. Ths fact, together wth the asymptotc dstrbuto of ( YS, ) ca be used to determe the asymptotc dstrbuto of ( θ, λ ). Assumpto 4 4 For all ( θ, λ) Θ Λ, EY ( ; θ, λ)<. Assumpto 4 s used to apply the strog law of large umbers ad the cetral lmt theorem to sums of the form Y = ad Y =. For a o-egatve defte matrx L, let N( 0, L) deote a radom varable wth a bvarate ormal dstrbuto wth mea vector 0 ad covarace matrx L ; let µ 3 ( θλ, ) ad µ 4 ( θλ, ) deote the thrd ad fourth cetral momets, respectvely, of Y.

6 78 Theorem 3. Assume that assumptos -4 hold. The, wth probablty approachg as, the estmator ( θ, λ ) exsts ad where θ θ N( 0, Σ( θ, λ)) as λ λ Var( Y; θ, λ) µ 3( θ, λ) Σ( θ, λ)= M( θ, λ) M(, ) θ λ µ 3( θ, λ ) µ 4( θ, λ) Var( Y; θ, λ) ad (, )= λ θ M θ λ. ' ' θv( λ) + λw ( θ) V ( λ) θ + W( θ) Proof: Sce here we are cocered wth the lmtg behavour of the estmators θ, λ, we wrte Y ad S for Y ad S, respectvely, to emphasze ther depedece o. Frst cosder cosstecy of ( θ, λ ). Uder assumpto 4, Y E( Y ; θ, λ)= θλw. p. as, where w.p. meas wth probablty, ad S Var( Y ; θ, λ)= θv( λ) + λw( θ) w. p. as so that ( Y, S ) coverges to H( θ, λ ) wth probablty. It follows that, wth probablty, ( Y, S ) les A for suffcetly large. By assumpto 3 there exsts a cotuous fucto h= H (.,.), the verse of H (.,.), such that, whe ( Y, S ) A, the ( θ, λ )= hy (, S ). Thus, wth probablty, ( θ, λ )= hy (, S ) for suffcetly large ad ( Y, S ) coverges to H( θ, λ ). It follows that ( θ, λ ) s a cosstet estmator of ( θ, λ ). Now cosder the asymptotc dstrbuto of ( θ, λ ). Uder assumpto 4, Y (, ) H θλ N( 0, B( θλ, )) as S T

7 Noparametrc estmato radom sum models 79 where Var( Y ; θ, λ) µ 3( θ, λ) B( θ, λ)= ; µ 3( θ, λ ) µ 4( θ, λ) Var( Y; θ, λ) see, e.g., example 3.3 of Sever (005). Sce, for suffcetly large, ( θ, λ )= hy (, S ), t follows from the δ -method (see, e.g., Sever, 005, secto 3.), that where θ θ N ( 0, D( θ, λ λ λ )) D( θ, λ)= h ( H( θ, λ)) B( θ, λ) h ( H( θ, λ)) T ad h deotes the matrx of partal dervatves of h. Note that, sce h= H (.,.), hhθ ( (, λ))=( θ, λ ); t follows that h ( H( θ, λ))= H ( θ, λ), the matrx verse of H (.,.), where H deotes the matrx of dervatves of H( θ, λ ) wth respect to ( θ, λ ). It follows mmedately from the expresso for H( θ, λ ) that λ θ H ( θ, λ)=. θv( λ) + λw ( θ) V ( λ) θ + W( θ) The result follows. ad Let 3 µ 3 = ( Y Y), = µ 4 = ( Y Y) = = S µ 3 B 4. µ 3 µ 4 S 4

8 80 Defe T Σ = M( θ, λ) BM( θ, λ). Theorem 3. Assume that assumptos -4 hold. The Σ Σ( θ, λ) as. Proof: Uder assumpto 4, as, S Var( Y ; θ, λ ), µ µ ( θ, λ ), ad µ µ ( θ, λ) It follows that B B( θ, λ) as. Sce M( θ, λ ) s a cotuous fucto of ( θ, λ ), ad ( θ, λ ) s a cosstet estmator of ( θ, λ ), t follows that M( θ, λ) M( θ, λ) as. The result follows. 4. NONPARAMETRIC ESTIMATION OF THE COMPOUNDING DISTRIBUTION 4. Geeral approach Let P deote the probablty geeratg fucto of Y, let R deote the probablty geeratg fucto of the evet dstrbuto, ad let Q deote the probablty geeratg fucto of the compoudg dstrbuto. Assume that we have a parametrc model wth parameter λ for the evet dstrbuto; hece, we wrte R( ; λ) for R as Let R( Q( t); λ )= P( t), t. Pt ( )= t = Y deote the emprcal probablty geeratg fucto based o Y,, Y. The Pt ( ) s a cosstet estmator of Pt ( ) for t. Hece, a estmator of the compoudg dstrbuto ca be obtaed by settg R( Q( t); λ ) equal to Pt ( ), where λ s a approprate estmator of λ.

9 Noparametrc estmato radom sum models 8 I order to carry out ths approach, there are several ssues whch must be cosdered. Frst, we must esure that λ ad Q are detfed ths model. Secod, a estmator of λ must be costructed. Fally, we must be able to use the detty R( Q( t); λ )= P ( t) (4.) order to obta a estmator of the compoudg dstrbuto. Frst cosder detfcato. The followg assumpto s suffcet for Q ad λ to be detfed. Assumpto 5 Rt ( ; λ)= Rt ( ; λ ) f ad oly f t = t.. R(0; λ )= R(0; λ ) f ad oly f λ= λ.. Lemma 4. Assume that assumpto 5 s satsfed. The R( Q( t); λ)= R( Q( t); λ ) for t f ad oly f Q= Q ad λ= λ. Proof: Clearly, f Q= Q ad λ = λ, the RQ ( ( t); λ)= RQ ( ( t); λ ) for t. Hece, assume that R( Q( t); λ)= R( Q( t); λ ) for t. Note that Q(0)= Q (0)= 0. Hece, settg t = 0, t follows that R(0; λ)= R(0; λ ) ; by part () of assumpto 5, t follows that λ= λ. Fx t. By part () of assumpto 5, RQ ( ( t); λ)= RQ ( ( t); λ ) mples that Q()= t Q() t. Sce t s arbtrary, Q= Q, provg the result. Now cosder estmato of λ. It follows from the detfcato result that a estmator of λ ca be obtaed by solvg R(0; λ )= P (0) (4.) for λ. However, the estmator gve (4.) wll oly be useful for those dstrbutos for whch P (0) s ot close to 0. A alteratve approach s to base a estmator of a secod-momet assumpto, as dscussed secto 3. Fally, we must use the detty (4.) to obta a estmator of the compoudg dstrbuto. The detals of ths wll deped o the parametrc model used for the evet dstrbuto. I the remader of ths secto we cosder two choces for ths dstrbuto. I secto 4., the evet dstrbuto s take to be a

10 8 Posso dstrbuto; ths case was also cosdered by Buchma ad Grübel (003), who developed a smlar method of estmato. I secto 4.3, the evet dstrbuto s take to be a geometrc dstrbuto. 4. Estmato uder a compoud Posso model The compoud Posso dstrbuto has a maor mportace the class of compoud dstrbutos. Ths s because of usg t the probablty theory ad ts applcatos bology, rsk theory, meteorology, health scece, etc. Uder the assumpto that N has a Posso dstrbuto wth mea λ, t follows from the dscusso secto 4. that Pt ( )= exp{ λ[ Qt ( ) ]}, t. Suppose that the parameter λ s kow. Hece, we ca estmate Q by Q where exp{ λ[ Q ( t) ]}= P ( t) (4.3) ad let p = k I{ Y = k} = so that P ca also be wrtte as k Pt ()= t p. k=0 k Here I { = } = f Y = k ad 0 otherwse. Y k For =,,, let q = Pr( X = ). Our goal s to estmate q, q, based o p 0, p, or, equvaletly, based o Pt ( ). To do ths, we make the followg assumpto: Assumpto 6 There exsts a postve teger M such that Pr( X > M )= 0 ad, hece, q = q = =0. M+ M+ Uder assumpto 6, the umber of ukow parameters s fte, whch smplfes certa techcal argumets. Note that M ca be take to be very large so that assumpto 6 s early always satsfed practce.

11 Noparametrc estmato radom sum models 83 We ca estmate q, q, by fdg Q to solve (4.3) ad the dfferetatg order to obta the estmators q, q, : q = Q (0), q = Q (0)/!, q = Q (0)/3! 3 ad so o. Defe Q to be the soluto to exp{ Qt ( ) }= Pt ( ), t. (4.4) The Qt ()= [ Qt () ] + λ ad q, q,, the probabltes correspodg to Q, are related to q, q, through q k = qk, k=,,. λ I the usual case whch λ s ukow, t must be estmated. Let λ deote a estmator of λ. The q, q, ca be estmated by q k = q, =,,. k k λ Oe approach to estmate λ s to use a estmator based o equato (4.). Ths yelds the estmator λ = log p. (4.5) 0 A alteratve approach s to use the method descrbed secto 3. I ths case, we assume the exstece of a kow fucto W such that W( θ ) = Var( X ) where θ = EX ( ; θ ). The a estmator λ s gve by the soluto to equato (3.), whch may be wrtte as M M M M q q + W q = λ = = λ = =. λ (4.6) Other estmators of λ ca be used, provded that the followg codto s satsfed.

12 84 Assumpto 7 The estmator λ s a cotuously dfferetable fucto of ( p 0, p,, p M ) ad s a cosstet estmator of λ. Let q=( q, q,, q M ) deote the vector of probabltes correspodg to Q ; smlarly, defe q =( q, q,, q M ) ad p =( p, p,, p M ). A method of calculatg q, q, s gve the followg theorem. Theorem 4. Assume that assumptos 5-7 hold ad that N has a Posso dstrbuto wth mea λ. Defe a M M matrx H as follows: 0, f <, H = =,,..., M. p f =,..., M, Hece ad q = H p q = q. λ Proof: Let α ()= t P () t ad let β()= t Q() t. Therefore M β()= t q t, = ()= α t p t, =0 ad β( t)= log α ( t), usg equato (4.4). It ow follows from Sever (005, lemma 4.) that r + p = q p, r =0,,,. (4.7) r+ + r =0 r +

13 Noparametrc estmato radom sum models 85 Expressg terms of the matrx H ad the vectors q ad p, equato (4.7) ca be wrtte as Hq = p. The result for q ow follows from the relatoshp betwee q ad q. The followg result shows that ( q, q,, q M ) s asymptotcally ormally dstrbuted. Theorem 4. Assume that assumptos 5-7 hold ad that N has a Posso dstrbuto wth mea λ. Therefore, as, q q q q qm q M coverges dstrbuto to a M dmesoal multvarate ormal dstrbuto wth mea vector 0. Proof: It follows from equato (4.7) that ( q, q,, q M ) s a cotuously dfferetable fucto of ( p 0, p,, p M ). Uder assumpto 7, t follows that ( q, q,, q M ) s a cotuously dfferetable fucto of ( p 0, p,, p M ). The result ow follows from the δ -method (e.g., Sever, 005, secto 3.) together wth the fact that ( p 0, p,, p M ) s asymptotcally ormally dstrbuted (e.g., Sever, 005, example.7). The asymptotc covarace matrx of ( q, q,, q M ), whch s ot specfed theorem 4., ca be obtaed usg the δ -method (see, e.g., Sever, 005, theorem 3.). Sce ( q, q,, q M ) s a complcated fucto of ( p 0,, p M ), we do ot gve ts expresso here. The computato of such expresso ca be obtaed va the formula Sever (005, theorem 3.). Note that the estmators q, q,, qm are ot guarateed to be o-egatve or are they guarateed to sum to. Thus, practce, ay egatve estmate should be replaced by 0. It may also be helpful to ormalze the estmates by dvdg them by ther sum.

14 Estmato uder a compoud geometrc model I ths subsecto, we cosder the compoud geometrc dstrbuto whch plays a mportat role relablty, queueg, regeeratve processes, ad surace applcatos. We ow cosder the case whch N has a geometrc dstrbuto wth the parameter λ ad probablty fucto PN ( = )=( λλ ), =0,,, (4.8) where 0 < λ <. The aalyss ths case s very smlar to the aalyss gve secto 4. for the compoud Posso model ad, hece, we keep the treatmet here bref. For the compoud geometrc model, λ Pt ()=, t. λ Qt ( ) Let λ deote a estmator of λ satsfyg assumpto 7 ad defe Q by / λ Qt ()= +. λ Pt ( (4.9) ) A method of calculatg q, q, s gve the followg theorem. Theorem 4.3 Assume that assumptos 5-7 hold ad that the dstrbuto of N s gve by (4.8). Hece k p k k pk qk = q, =,,. k λ p 0 = p (4.0) 0 Proof: Rewrtg (4.9) as λqtpt ()()= Pt () + λ for t, ad dfferetatg ths expresso mples k Q ( ) t P ( k ) t P ( k) t k k λ () ()= (), =,,. =0

15 Noparametrc estmato radom sum models 87 Evaluatg ths expresso at t = 0, ad settg q 0 =0, lead to (4.0). The followg result shows that ( q, q,, q M ) s asymptotcally ormally dstrbuted. The proof s essetally the same as the proof of theorem 4. ad, hece, s omtted. Theorem 4.4 Assume that assumptos 5-7 hold ad that the dstrbuto of N s gve by (4.8). Therefore, as, q q q q qm q M coverges dstrbuto to a M dmesoal multvarate ormal dstrbuto wth mea vector 0. The commets followg theorem 4. ca be appled here as well. Remark 4.. Our approach secto 4. works well wth other evet dstrbutos (e.g. bomal ad egatve bomal) as log as they obey the assumptos ths secto. Also, the results that ca be obtaed to such dstrbutos are very smlar to those already gve subsectos 4. ad 4.3, so t s ot ecessary to clude such results here. Mathematcs Departmet, Faculty of Scece, Tata Uversty, Tata, Egypt Departmet of Statstcs, Northwester Uversty, USA HASSAN S. BAKOUCH THOMAS A. SEVERINI ACKNOWLEDGMENTS The authors thak the referees for ther suggestos ad commets whch have sgfcatly mproved the paper. The secod author gratefully ackowledges the support of the U.S. Natoal Scece Foudato. REFERENCES H. S. BAKOUCH, M. M. RISTIĆ (009), Zero trucated Posso teger-valued AR() model, Metrka, do 0.007/s G. BUCHMANN, R. GRÜBEL (003), Decompoudg: a estmato problem for Posso radom sums, Aals of Statstcs, 3, pp

16 88 G. BUCHMANN, R. GRÜBEL (004), Decompoudg Posso radom sums: Recursvely trucated estmates the dscrete case, Aals of the Isttute of Statstcal Mathematcs, 56, pp J. CAI, G. E. WILLMOT (005), Mootocty ad agg propertes of radom sums, Statstcs & Probablty Letters, 73, pp C. A. CHARALAMBIDES (005), Combatoral methods dscrete dstrbutos, New York: Wley. C. CHATFIELD, C. M. THEOBALD (973), Mxtures ad radom sums, The Statstca,, pp S. A. KLUGMAN, H. H. PANJER, G. E. WILLMOT (004), Loss models: from data to decsos, d ed., Wley-Iterscece. O. LUNDBERG (964), O radom processes ad ther applcato to sckess ad accdet statstcs, d ed., Almqvst ad Wksell (Uppsala). P. MCCULLAGH, J. A. NELDER (989), Geeralzed lear models, d ed., Chapma & Hall/CRC. J. N. MEDHI (97), Stochastc processes, 3rd ed., Joh Wley: New York. H. H. PANJER (006), Operatoal rsk: modelg aalytcs, New York: Wley. E. PEKÖZ, S. M. ROSS (004), Compoud radom varables, Probablty the Egeerg ad Iformatoal Sceces, 8, pp S. M. PITTS (994), Noparametrc estmato of compoud dstrbutos wth applcatos surace, Aals of the Isttute of Statstcal Mathematcs, 46, pp M. M. RISTIĆ, H. S. BAKOUCH, A. S. NASTIĆ (009), A ew geometrc frst-order teger-valued autoregressve (NGINAR()) process, Joural of Statstcal Plag ad Iferece, 39, pp M. SAHINOGLU (99), Compoud Posso software relablty model, IEEE Trasactos o Software Egeerg, 8, pp T. A. SEVERINI (005), Elemets of dstrbuto theory, Cambrdge Uversty Press: Cambrdge. M. WEBA (007), Optmal predcto of compoud mxed Posso processes, Joural of Statstcal Plag ad Iferece, 37, pp SUMMARY Noparametrc estmato radom sum models Let X, X,, XN be depedet, detcally dstrbuted, o-egatve, tegervalued radom varables ad let N be a o-egatve, teger-valued radom varable depedet of X, X,, XN. I ths paper, we cosder two oparametrc estmato problems for the radom sum varable S = X =0. The frst s the estmato of the meas of X ad N based o the secod-momet assumptos o dstrbutos of S N N X = 0 0 =, X ad N. The secod s the oparametrc estmato of the dstrbuto of X gve a parametrc model for the dstrbuto of N. Some asymptotc propertes of the proposed estmators are dscussed.

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad

More information

Lecture Notes to Rice Chapter 5

Lecture Notes to Rice Chapter 5 ECON 430 Revsed Sept. 06 Lecture Notes to Rce Chapter 5 By H. Goldste. Chapter 5 gves a troducto to probablstc approxmato methods, but s suffcet for the eeds of a adequate study of ecoometrcs. The commo

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

22 Nonparametric Methods.

22 Nonparametric Methods. 22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer

More information

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3

Bayesian Inferences for Two Parameter Weibull Distribution Kipkoech W. Cheruiyot 1, Abel Ouko 2, Emily Kirimi 3 IOSR Joural of Mathematcs IOSR-JM e-issn: 78-578, p-issn: 9-765X. Volume, Issue Ver. II Ja - Feb. 05, PP 4- www.osrjourals.org Bayesa Ifereces for Two Parameter Webull Dstrbuto Kpkoech W. Cheruyot, Abel

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

Analysis of Variance with Weibull Data

Analysis of Variance with Weibull Data Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA

GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Sc.It.(Lahore),26(3),985-990,2014 ISSN 1013-5316; CODEN: SINTE 8 GENERALIZED METHOD OF MOMENTS CHARACTERISTICS AND ITS APPLICATION ON PANELDATA Beradhta H. S. Utam 1, Warsoo 1, Da Kurasar 1, Mustofa Usma

More information

Qualifying Exam Statistical Theory Problem Solutions August 2005

Qualifying Exam Statistical Theory Problem Solutions August 2005 Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ  1 STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ

More information

Logistic regression (continued)

Logistic regression (continued) STAT562 page 138 Logstc regresso (cotued) Suppose we ow cosder more complex models to descrbe the relatoshp betwee a categorcal respose varable (Y) that takes o two (2) possble outcomes ad a set of p explaatory

More information

1 Solution to Problem 6.40

1 Solution to Problem 6.40 1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we

More information

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables Joural of Sceces, Islamc Republc of Ira 8(4): -6 (007) Uversty of Tehra, ISSN 06-04 http://sceces.ut.ac.r Complete Covergece ad Some Maxmal Iequaltes for Weghted Sums of Radom Varables M. Am,,* H.R. Nl

More information

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data

More information

Chapter 3 Sampling For Proportions and Percentages

Chapter 3 Sampling For Proportions and Percentages Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION

BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL DISTRIBUTION Iteratoal Joural of Mathematcs ad Statstcs Studes Vol.4, No.3, pp.5-39, Jue 06 Publshed by Europea Cetre for Research Trag ad Developmet UK (www.eajourals.org BAYESIAN INFERENCES FOR TWO PARAMETER WEIBULL

More information

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties 進佳數學團隊 Dr. Herbert Lam 林康榮博士 HKAL Pure Mathematcs F. Ieualtes. Basc propertes Theorem Let a, b, c be real umbers. () If a b ad b c, the a c. () If a b ad c 0, the ac bc, but f a b ad c 0, the ac bc. Theorem

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

Law of Large Numbers

Law of Large Numbers Toss a co tmes. Law of Large Numbers Suppose 0 f f th th toss came up H toss came up T s are Beroull radom varables wth p ½ ad E( ) ½. The proporto of heads s. Itutvely approaches ½ as. week 2 Markov s

More information

Estimation of the Loss and Risk Functions of Parameter of Maxwell Distribution

Estimation of the Loss and Risk Functions of Parameter of Maxwell Distribution Scece Joural of Appled Mathematcs ad Statstcs 06; 4(4): 9- http://www.scecepublshggroup.com/j/sjams do: 0.648/j.sjams.060404. ISSN: 76-949 (Prt); ISSN: 76-95 (Ole) Estmato of the Loss ad Rsk Fuctos of

More information

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem Joural of Amerca Scece ;6( Cubc Nopolyomal Sple Approach to the Soluto of a Secod Order Two-Pot Boudary Value Problem W.K. Zahra, F.A. Abd El-Salam, A.A. El-Sabbagh ad Z.A. ZAk * Departmet of Egeerg athematcs

More information

Iterated Logarithm Laws on GLM Randomly Censored with Random Regressors and Incomplete Information #

Iterated Logarithm Laws on GLM Randomly Censored with Random Regressors and Incomplete Information # Appled Mathematcs 363-368 do:.436/am..343 ublshed Ole March (http://www.scr.org/joural/am) Iterated Logarthm Laws o GLM Radomly Cored wth Radom Regrsors ad Icomplete Iformato # Abstract Qag Zhu Zhhog ao

More information

A NEW LOG-NORMAL DISTRIBUTION

A NEW LOG-NORMAL DISTRIBUTION Joural of Statstcs: Advaces Theory ad Applcatos Volume 6, Number, 06, Pages 93-04 Avalable at http://scetfcadvaces.co. DOI: http://dx.do.org/0.864/jsata_700705 A NEW LOG-NORMAL DISTRIBUTION Departmet of

More information

ESS Line Fitting

ESS Line Fitting ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

6.867 Machine Learning

6.867 Machine Learning 6.867 Mache Learg Problem set Due Frday, September 9, rectato Please address all questos ad commets about ths problem set to 6.867-staff@a.mt.edu. You do ot eed to use MATLAB for ths problem set though

More information

Extreme Value Theory: An Introduction

Extreme Value Theory: An Introduction (correcto d Extreme Value Theory: A Itroducto by Laures de Haa ad Aa Ferrera Wth ths webpage the authors ted to form the readers of errors or mstakes foud the book after publcato. We also gve extesos for

More information

ECON 5360 Class Notes GMM

ECON 5360 Class Notes GMM ECON 560 Class Notes GMM Geeralzed Method of Momets (GMM) I beg by outlg the classcal method of momets techque (Fsher, 95) ad the proceed to geeralzed method of momets (Hase, 98).. radtoal Method of Momets

More information

J P S S. A comprehensive journal of probability and statistics for theorists, methodologists, practitioners, teachers, and others

J P S S. A comprehensive journal of probability and statistics for theorists, methodologists, practitioners, teachers, and others ISSN 76-338 J P S S A comprehesve joural of probablty ad statstcs for theorsts methodologsts practtoers teachers ad others JOURNAL OF PROBABILITY AND STATISTICAL SCIENCE Volume 8 Number August 00 Joural

More information

9.1 Introduction to the probit and logit models

9.1 Introduction to the probit and logit models EC3000 Ecoometrcs Lecture 9 Probt & Logt Aalss 9. Itroducto to the probt ad logt models 9. The logt model 9.3 The probt model Appedx 9. Itroducto to the probt ad logt models These models are used regressos

More information

Lecture 2 - What are component and system reliability and how it can be improved?

Lecture 2 - What are component and system reliability and how it can be improved? Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

Dr. Shalabh. Indian Institute of Technology Kanpur

Dr. Shalabh. Indian Institute of Technology Kanpur Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology

More information

Module 7: Probability and Statistics

Module 7: Probability and Statistics Lecture 4: Goodess of ft tests. Itroducto Module 7: Probablty ad Statstcs I the prevous two lectures, the cocepts, steps ad applcatos of Hypotheses testg were dscussed. Hypotheses testg may be used to

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

Complete Convergence for Weighted Sums of Arrays of Rowwise Asymptotically Almost Negative Associated Random Variables

Complete Convergence for Weighted Sums of Arrays of Rowwise Asymptotically Almost Negative Associated Random Variables A^VÇÚO 1 32 ò 1 5 Ï 2016 c 10 Chese Joural of Appled Probablty ad Statstcs Oct., 2016, Vol. 32, No. 5, pp. 489-498 do: 10.3969/j.ss.1001-4268.2016.05.005 Complete Covergece for Weghted Sums of Arrays of

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

arxiv: v1 [math.st] 24 Oct 2016

arxiv: v1 [math.st] 24 Oct 2016 arxv:60.07554v [math.st] 24 Oct 206 Some Relatoshps ad Propertes of the Hypergeometrc Dstrbuto Peter H. Pesku, Departmet of Mathematcs ad Statstcs York Uversty, Toroto, Otaro M3J P3, Caada E-mal: pesku@pascal.math.yorku.ca

More information

STRONG CONSISTENCY FOR SIMPLE LINEAR EV MODEL WITH v/ -MIXING

STRONG CONSISTENCY FOR SIMPLE LINEAR EV MODEL WITH v/ -MIXING Joural of tatstcs: Advaces Theory ad Alcatos Volume 5, Number, 6, Pages 3- Avalable at htt://scetfcadvaces.co. DOI: htt://d.do.org/.864/jsata_7678 TRONG CONITENCY FOR IMPLE LINEAR EV MODEL WITH v/ -MIXING

More information

THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS

THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE PARAMETERS Joural of Mathematcs ad Statstcs (: 5-9, 4 ISSN: 549-3644 4 Scece Publcatos do:.3844/jmssp.4.5.9 Publshed Ole ( 4 (http://www.thescpub.com/jmss.toc THE EFFICIENCY OF EMPIRICAL LIKELIHOOD WITH NUISANCE

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

A New Measure of Probabilistic Entropy. and its Properties

A New Measure of Probabilistic Entropy. and its Properties Appled Mathematcal Sceces, Vol. 4, 200, o. 28, 387-394 A New Measure of Probablstc Etropy ad ts Propertes Rajeesh Kumar Departmet of Mathematcs Kurukshetra Uversty Kurukshetra, Ida rajeesh_kuk@redffmal.com

More information

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout

More information

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Non-uniform Turán-type problems

Non-uniform Turán-type problems Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at

More information

Multiple Linear Regression Analysis

Multiple Linear Regression Analysis LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple

More information

IJOART. Copyright 2014 SciResPub.

IJOART. Copyright 2014 SciResPub. Iteratoal Joural of Advacemets Research & Techology, Volume 3, Issue 10, October -014 58 Usg webull dstrbuto the forecastg by applyg o real data of the umber of traffc accdets sulama durg the perod (010-013)

More information

LINEAR REGRESSION ANALYSIS

LINEAR REGRESSION ANALYSIS LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d 9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,

More information

Mu Sequences/Series Solutions National Convention 2014

Mu Sequences/Series Solutions National Convention 2014 Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed

More information

STA302/1001-Fall 2008 Midterm Test October 21, 2008

STA302/1001-Fall 2008 Midterm Test October 21, 2008 STA3/-Fall 8 Mdterm Test October, 8 Last Name: Frst Name: Studet Number: Erolled (Crcle oe) STA3 STA INSTRUCTIONS Tme allowed: hour 45 mutes Ads allowed: A o-programmable calculator A table of values from

More information

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings

Research Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte

More information

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018 Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of

More information

Random Variables and Probability Distributions

Random Variables and Probability Distributions Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x

More information

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several

More information

Bivariate Zero-Inflated Power Series Distribution

Bivariate Zero-Inflated Power Series Distribution Appled athematcs 84-89 do:.436/am..7 ublshed Ole July (http://www.scr.org/joural/am) Bvarate Zero-Iflated ower Seres Dstrbuto Abstract atl arut Krsha Shrke Dgambar Tukaram Departmet of Statstcs. V.. ahavdyalaya

More information

Continuous Distributions

Continuous Distributions 7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f

More information

Study of Correlation using Bayes Approach under bivariate Distributions

Study of Correlation using Bayes Approach under bivariate Distributions Iteratoal Joural of Scece Egeerg ad Techolog Research IJSETR Volume Issue Februar 4 Stud of Correlato usg Baes Approach uder bvarate Dstrbutos N.S.Padharkar* ad. M.N.Deshpade** *Govt.Vdarbha Isttute of

More information

STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE

STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE Statstca Sca 9(1999), 289-296 STRONG CONSISTENCY OF LEAST SQUARES ESTIMATE IN MULTIPLE REGRESSION WHEN THE ERROR VARIANCE IS INFINITE J Mgzhog ad Che Xru GuZhou Natoal College ad Graduate School, Chese

More information