On the Conflict of Truncated Random Variable vs. Heavy-Tail and Long Range Dependence in Computer and Network Simulation

Size: px
Start display at page:

Download "On the Conflict of Truncated Random Variable vs. Heavy-Tail and Long Range Dependence in Computer and Network Simulation"

Transcription

1 Journal of Computatonal Informaton Systems 7:5 (0) Avalable at On the Conflct of Truncated Random Varable vs. Heavy-Tal and Long Range Dependence n Computer and etwork Smulaton Wanyang DAI Department of Mathematcs and State Key Laboratory of ovel Software Technology, anjng Unversty, anjng 0093, Chna Abstract Heavy-taled dstrbuton (HTD) and long-range dependence (LRD) have appeared n the studes of telecommuncaton, fnance, and etc. However, the truncaton of a heavy-taled random varable s nevtable n a computer and network smulaton due to the hardware and software lmtatons such as numberng format of bnary dgts and pseudo random number generators. Thus a natural ssue arses: how well the approxmaton of a concerned objectve n a smulaton wll be f a truncated random varable s used to replace the orgnal heavy-taled one? As ponted out n ths paper, the dfference of the means (or varances) between the truncated verson and the orgnal one wll stll be nfnte f the orgnal random varable s heavly taled wth nfnte mean and/or varance, whch ndcates that the truncated approxmaton may be not consstent wth what should be f the HTD/LRD assumptons are mposed. So, based on ths observaton and our prevously establshed approxmaton theory va reflectng Gaussan process (RGP) wth or wthout LRD, we can provde more reasonable nterpretatons to some well-known large-scale computer and statstcal experments n characterzng the superposton of nternet traffc sources, whch clarfy that the fndngs n these smulatons should be more close to the realty but not to the mathematcal assumptons about HTD/LRD, whch are mposed n ther models and analyss. Hence our fndngs smooth, to some extent, the gaps between HTD/LRD theory and real-world smulatons. More mportantly, our fndngs also ndcate that t s more sutable to use the truncated verson of a heavy-taled random varable n a smulaton and related analyss n order to be more consstent wth realty and to avod more complcated dscussons va HTD/LRD theory. Keywords: Hgh-speed etwork; Source Traffc; Characterzaton; Queueng System; Computer and etwork Smulaton; Pseudo Random umber Generator; umberng Format of Bnary Dgts; Truncated Random Varable; Heavy-taled Dstrbuton; Long-range Dependence; Reflectng Gaussan Process. Introducton HTD/LRD have been used n many areas to characterze source traffcs n telecommuncaton (see, e.g., Refs. [5~6], [], [3], [9], and etc.), prce jumps and correlatons n fnance (see, e.g., Refs. [], []), and etc. Partcularly, n the early 990s, the authors such as Refs. [] and [9] dsclosed one of the most nterestng fndngs n hgh-speed networks,.e., source traffc data were shown to possess LRD. Snce then, stochastc modelng assocated wth LRD data has become an actve area of research. For examples, n the early 000s, a number of scentsts n Bell Labs focused on traffc data and related queueng modelng based on statstcal multplexng. Ther achevements (see, e.g., Refs. [5~6], and etc.) through large-scale computer and statstcal experments ndcate that the packet nterarrval tmes and packet szes tend to..d. Correspondng author. Emal addresses: nan5lu8@netra.nju.edu.cn (Wanyang DAI) / Copyrght 0 Bnary Informaton Press May, 0

2 489 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) (ndependent and dentcally dstrbuted) when the number of the nput connectons ncreases. Ther fndngs are of great mportance n desgnng and mplementng telecommuncaton software systems and hardware devces snce HTD/LRD sources wll sgnfcantly ncrease system desgn complexty and the cost of hgh-speed memory. Moreover, for some partcular cases and under certan tme scalng, Refs. [6] developed some theory to make ther smulaton fndngs justfed. However, snce the above well-known smulatons are computer based ones, the truncaton of a heavy-taled random varable used n the smulatons s nevtable due to the hardware and software lmtatons of a computer, such as, the numberng format of bnary dgts and the pseudo unform random number generators (see, e.g., Ref. [4]). Then a natural ssue arses concernng the truncaton: how well the approxmaton of a concerned objectve desgned n a smulaton wll be f a truncated random varable s used to replace the orgnal heavy-taled one? As ponted out n ths paper, the dfference of the means (or varances) between the truncated verson and the orgnal one wll stll be nfnte f the orgnal random varable s heavly taled wth nfnte mean and/or varance, whch ndcates that the truncated approxmaton may be not consstent wth the HTD/LRD based theory. In fact, some of the smulatons conducted by authors n Refs. [5~6], and etc. have revealed some gaps between the smulaton fndngs and the related HTD/LRD theory. For example, the theory developed n Ref. [6] to justfy ther smulaton fndngs s under the so-called crtcal tme scale ntroduced n Ref. [5],.e., the characterstcs of an ndvdual source becomes less mportant when the number of superposed sources ncreases. evertheless, n general, the characterstcs of the superposed lmtng process heavly depends on the ways of the tme/space scales (see, e.g., Refs. [6], [0], []). If the tme scale of nterest does not change wth superposton, thngs wll be dfferent snce ndvdual source behavor stll plays an mportant role. So, by the above observaton and our prevously establshed approxmaton theory n Ref. [0] concernng RGP wth or wthout LRD, we can provde more reasonable nterpretatons to the smulaton fndngs n Refs. [5~6], and etc., whch are based on the same queueng model and the same tme/space scalng wth both heavy-taled random varable and ts truncated counterpart as the drvng random envronmental factors. From these nterpretatons, we can see that the smulaton fndngs n Refs. [5~6], and etc. should be more close to the realty but not to the mathematcal assumptons about HTD/LRD, whch are mposed n ther models and stemmed from Ref. [9] where only bounded range of tme scales are concerned. Hence our fndngs smooth, to some extent, the gaps between HTD/LRD theory and real-world smulatons. More mportantly, our fndngs also ndcate that t s more sutable to use the truncated verson to replace a heavy-taled random varable n a smulaton and related analyss n order to be more consstent wth realty and to avod more complcated dscussons va HTD/LRD theory. The rest of ths paper s organzed as follows. In Secton, we make a comparson between a heavy-taled random varable and ts assocated truncated verson, and state the reason why the hardware and software systems n a computer can cause truncaton to a heavy-taled random varable. Moreover, n the secton, we also descrbe the possble mpact of the truncaton of a random varable on some well-known smulaton fndngs n hgh-speed networks. In Secton 3, we use our prevously establshed approxmaton theory va RGP to justfy that some well-known smulaton fndngs should be more close to the realty but not to the mposed mathematcal assumptons about HTD/LRD. Fnally, n Secton 4, we

3 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) present the concluson of the paper and make some remarks about the mpact of a truncated heavy-taled random varable on fnancal engneerng, nsurance and tme seres analyss.. Truncated Random Varable vs. HTD/LRD n a Computer Smulaton.. Truncaton Aganst HTD/LRD Related Smulaton Consder a random varable X wth dstrbuton F(x)=P { X x } over x [p, q], where p,q (-, + ) wth p<q, and moreover, suppose [p, q]=[p, + ) f q=+ and [p, q]=(-, q] f p=-. Then we can defne the truncated random varable Y over [p, q] as follows, X f X takesvalues n[ p, q], Y = () gnored f X does not takevalues n[ p, q]. In other words, the dstrbuton of Y can be represented n a condtonal probablty form,.e., for any y [ pq, ], PX { yx, [ pq, ]} PY { y} = P{ X y X [ pq, ]} =. PX { [ pq, ]} () Thus we know that the truncated mean correspondng to X s gven as follows, E XI{ X [ p, q]} E E XI{ X [ p, q]} X [ p, q] E[ Y]. = = = E[ Y]. Smlarly, we know that the truncated varance correspondng to X s gven by ( X p q ) Var XI{ [, ]} = Var( Y ). (4) Therefore, when the random varable X s lghtly taled, we know that the followng clams are true as p and q +, PX { (, p) ( q, + )} 0, EX [ ] EY [ ] 0, Var( X ) Var( Y ) 0, whch mply that Y can be used as an approxmatng random varable for X n a smulaton. However, when the random varable X s heavly taled, the mean and/or varance of X may be nfnte. For example, f X s a Pareto dstrbuted random varable, then the dstrbuton of X has the followng expresson wth parameters β 0 and x 0, m (3) xm β for x xm, F( x) = x 0 for x < xm, (5)

4 49 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) whch mples that both the mean and varance of X wll be nfnte f β and that the mean s fnte and the varance s nfnte f < β. Moreover, the dstrbuton for the correspondng random varable Y that s truncated by a gven constant b x m can be expressed as follows, for x> q; β xm t x F ( x) = for xm x q, β xm q 0 for x< xm. Therefore t follows from (.5)-(.6) that we may have the followng clams for any gven m (6) q> x when X s Pareto dstrbuted, E[ X ] E[ Y ] = and/or Var( X ) Var( Y ) =, (7).e., the dfferences of the mean and/or varance between the heavy-taled random varable and ts truncated counterpart may be nfnte. Therefore, f E[X]= and/or Var(X)=, t s not sutable to use the truncated random varable Y as an approxmatng one for X n a smulaton no matter how large E[Y] and/or Var(Y) are. In addton, we have the observaton that the truncated random varable may take a large (maybe huge but bounded) value wth relatvely large probablty but tself s essentally not a heavy-taled random varable. So, to be concse n applcatons and to avod more complcated dscussons through applyng HTD/LRD theory when a random varable appeared n a real-world applcaton (e.g., n fnance) s obvously bounded by some large (maybe huge) constant (e.g., the total wealth n the world or n a local envronment), a good choce s to use the truncated verson of a heavy-taled random varable n a smulaton... The Reason Causng Truncaton n a Computer Smulaton In a today s computer, numberng format s based on a fxed number of bnary dgts, whch s denoted by L, e.g., L=3. So the nteger M= L - s the largest nteger accepted by the computer. Due to ths fact, some random numbers generated from pseudo random number generators employed n a smulaton wll be truncated f the assocated random varable s heavly taled. For example, consder the Pareto dstrbuted random varable X and a unformly dstrbuted random varable U over [0, ], t follows from the dscusson n page 3 of Ref. [8] or page 36 of Ref. [4] that X = F ( U) (8) where F denotes the left-contnuous nverse of F and has the followng expresson,

5 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) x m / β F ( u) =, u (0,). ( u) (9) Therefore, once we generate the unformly dstrbuted random numbers from U over (0, ), we get the Pareto dstrbuted random numbers from X over [0, ). Currently, there exst some pseudo unform random number generators such as the Kss generator whose perod s of order 95 (see, e.g., pages n Ref. [4]). evertheless, all the generated random numbers F ( u) Correspondng to u near the unty wll be truncated n a smulaton f F ( u) > M. To be clear, we also remark that there exsts a class of unformly dstrbuted random number generators wth the form of X = f( X ) such as lnear congruence generator, whose perod s bounded by M(see, n+ n e.g., pages n Ref. [4]), then the largest pseudo unform random number except the unty, whch L L generated from these generators, are bounded by a constant c = ( )/. Therefore, f < β n (9), we can see that the F ( u) correspondng to the generated random number u s always less than M for relatvely small x m, whch ndcates that these generators themselves also have the truncaton ablty to a heavy-taled random varable snce all the values of ( F ( c), ) to the Pareto dstrbuted random varable are truncated..3. Impacts on Some Well-known Smulatons Related to HTD/LRD The above observatons ndcate that many exstng smulatons and related analyss based on HTD/LRD appeared n communcaton systems, fnancal engneerng, and etc. (see, e.g., Refs. [5~6], [9]) may need some new nterpretatons. In fact, some of these smulatons are well-known and have shown some gaps between the smulaton fndngs and the related HTD/LRD theory. Concretely, n the early 990s, one of the most nterestng fndngs n hgh-speed networks s the one that traffc data were shown to possess LRD (see, e.g., Refs. [], [3], [9]). In partcular, The authors n Refs. [9] showed that O/OFF processes wth heavy-taled O-perod dstrbutons exhbt LRD, whch s based on detaled statstcal analyss of real-tme traffc measurements on large tme scales but bounded by M= L - n seconds from Ethernet LA's at the level of ndvdual sources. Snce then, stochastc modelng assocated wth LRD data has become an actve area of research. For examples, n the early 000s, a number of scentsts n Bell Labs focused on traffc data and related queueng modelng based on statstcal multplexng. Ther achevements (see, Refs. [5~6], and etc.) through large-scale computer and statstcal experments ndcate that the packet nterarrval tmes and packet szes tend to..d. when the number of the nput connectons ncreases. Ther fndngs are of great mportance n desgnng and mplementng telecommuncaton software systems and hardware devces snce HTD/LRD sources wll sgnfcantly

6 493 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) ncrease system desgn complexty and the cost of hgh-speed memory. Moreover, for some partcular cases and under certan tme scalng, the authors of Ref. [6] developed some theory to make ther smulaton fndngs justfed. For example, a partcular queueng model used n ther theory s based on the followng assumptons: the dstrbutons of O- and OFF-perods are Pareto and exponental respectvely and packet szes are constant. They showed that the sequence of probabltes that steady state unfnshed works exceed a threshold tend to the correspondng probablty assumng Posson nput process when the number of nput sources tends to nfnty, whch concdes wth ther smulaton studes. evertheless, as ponted out n Ref. [6], ther theory heavly depends on the so-called crtcal tme scale ntroduced n Ref. [5], under whch the characterstcs of an ndvdual source become less mportant. If the tme scale of nterest does not change wth superposton, then thngs wll be dfferent snce ndvdual source behavor stll plays an mportant role. Interested readers are also drected to Ref. [] for more detals about the nfluence on LRD caused by dfferent tme scales. ow, snce the smulatons conducted n Refs. [5~6] and etc. are computer based ones, the truncaton of a heavy-taled random varable as dscussed n Secton s nevtable, we can provde some dfferent nterpretatons about the fndngs n ther smulatons. Further, our nterpretatons seem to be more consstent between ther smulaton fndngs and our approxmaton theory developed n Ref. [0]. For example, under the same queueng model and the same tme/space scalng, f the O-perod random varables wth Pareto dstrbutons are truncated, then the queueng length process correspondng to large superposton number of nput sources s roughly equal to the one wth nput traffc whose nterarrval tmes are..d., whch concdes wth ther smulaton fndngs n Refs. [5~6], and etc. evertheless, f the O-perod random varables are not truncated, then the queueng length process correspondng to large superposton number of nput sources s roughly equal to the one whose nput traffc s of LRD. From ths example, we can see that whether or not a heavy-taled random varable s truncated wll have a sgnfcant mpact on a smulaton. In the followng secton, we wll use a generalzed queueng model to concretely justfy our fndngs based on the theory developed n Refs. [0] and the observaton found n the current paper concernng the truncaton of a heavy-taled random varable n a smulaton. 3. Demonstraton Through a Generalzed Queueng System In the study of Ref. [0], the author establshed some approxmaton theory to justfy several heavy traffc lmt theorems under dfferent tme/space scalng for a queue wth superposed LRD O/OFF nput sources and general servce tme dstrbuton. In ths secton, we employ one of the lmt theorems, whch s under a tme/space scalng smlar to the dffusve scalng as used n the conventonal central lmt theorem, to demonstrate our fndngs as stated at the end of Secton.3. The rest of ths secton s organzed as follows. In Subsectons 3.-3., we summarze the queueng model and refne the lmt theorem requred for the current purpose, and moreover, and n Subsecton 3.3, we present our nterpretatons and ther mplcaton. 3.. The Queueng Model In the queueng system under consderaton, the servce tmes are assumed to be generally dstrbuted and there are..d. O/OFF nput sources. Each O/OFF source n {,..,} conssts of ndependent strctly

7 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) alternatng O- and OFF-perods, moreover, t transmts packets to a server accordng to a Posson process wth nterarrval tme sequence { un( ), } and rate λ f t s O and remans slent f t s OFF. The lengths of the O-perods are dentcally dstrbuted and so are the lengths of OFF-perods, and furthermore, both of ther dstrbutons can be heavy-taled wth nfnte varance. Specfcally, for any dstrbuton F, we denote by F = F the complementary (or rght tal) dstrbuton, and by F and F the dstrbutons for O-and OFF-perods wth probablty densty functons f and f respectvely. Ther means and varances are denoted by μ and σ for =,. In what follows, we assume that as x, α ether F ( x)~ x L( x) wth < α < or σ <, (0) where ~ denotes nearly equals and L > 0 s a slowly varyng functon at nfnty, that s, L ( tx) lm = for any t > 0. x L( x) ote that the mean μ s always fnte but the varance σ s nfnte when α <, and furthermore, one dstrbuton may have fnte varance and the other has an nfnte varance snce F and F are allowed to be dfferent. The szes of transmtted packets (servce tmes) form an..d. random sequence { v ( ) = v( )/ μ, }, where μ s the rate of transmsson correspondng to each and {(): v } s an..d. random sequence wth mean and varance σ v, moreover, { v (): } s ndependent of the arrval processes. To derve our queueng dynamcal equaton, we ntroduce more notatons. For a sngle source n {,, }, t follows from the explanaton n Ref. [] that the alternatng O/OFF perods can be descrbed by a statonary bnary process W = { W ( t), t 0}, where n n f nput traffc s n an O - perod at tme t, Wn () t = 0 f nput traffc s n an OFF - perod at tme t. () Moreover, the mean of W n s gven by { } γ = EW [ ( t)] = P W( t) = = n n μ μ + μ ()

8 495 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) In addton, we let A () t be the total number of packets transmtted to the server by tme t summed over all sources, S () t be the total number of packets that fnshed servce at the server f t keeps busy by tme t. Then the queue length process Q () t (the number of packets ncludng the one beng served at the server at tme t) can be represented by Q () t = A () t = S ( B ()) t (3) where we assume that the ntal queue length s zero for convenence, B () t s the cumulatve amount of tme that the server s busy by tme t. In the followng analyss, we wll employ the frst-n-frst-out (FIFO) and non-dlng servce dscplne under whch the server s never dle when there are packets watng to be served. 3.. The Requred Lmt Theorem For the above system, we are nterested n the behavor of the scaled queueng process Q () under the condton that the load of the server closely approaches the servce capacty when the source number gets large enough, where () Q (). (4) Q Moreover, for convenence, we adapt some notatons from Ref. [7]. When < α <, set a = ( Γ( α ))/( α ). Whenσ <, set α =, L and a =. In addton, defne σ / b L ( x) α α = lm t. (5) x L ( x) If 0 < b < (mplyng α = α and b= lm x L( x) / L( x) ), set αmn = α, f, on the other hand, b = 0 or b =, ( μ ab+ μ a ) π = and L = L ( ) (4 ) 3 μ+ μ Γ αmn ; (6) μ a π = and L = L ( ) (4 ) max mn 3 μ+ μ Γ αmn mn (7)

9 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) where mn s the ndex f b = (e.g. f α < α ) and s the ndex f b = 0, max denotng the other ndex. Moreover, for each, let the servce rate μ correspondng to some postve constant θ be gven by = +. (8) μ λγ θ In addton, suppose that the dstrbutons of F and F satsfy F ( x) ( =,) s absolutely contnuous n terms of x; (9) The densty f ( x) ( =,) of F satsfes lm f ( x) <. (0) + x 0 Theorem 3.. Under condtons (8)-(0) and as, Q () converges n dstrbuton under Skorohod topology to a reflectng Gaussan process Q () gven by Q () = A ( γ + ) λt () S ( λγ ) θ + I () 0 () where the three processes A ( γ ), S ( λγ ) and T () are ndependent each other, and furthermore, A ( γ ) s a Brownan moton wth mean zero and varance functon λγ, S( λγ ) s also a Brownan moton wth mean zero and varance functon λγσ, T () v s a Gaussan process wth a.s. contnuous sample paths, mean zero and statonary ncrements, whose covarance functon Var( T ( t)) can be expressed as t L t as t for H H ~ π ( ), = π t for all t 0 and H = () where H s the Hurst parameter defned by H= process wth I (0) = 0 and satsfes 0 (3 α ) /. Moreover, I () mn s a non-decreasng QsdI () () s = 0. (3)

10 497 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) The Interpretatons and Ther Implcaton In ths subsecton, we suppose that the O-perods n the queueng system are of Pareto dstrbuton wth < β and thus we know that the O-perod s heavly taled wth mean μ <, varance σ =, α = β, L ( ) x m dstrbuton wth mean = x β. Moreover, we suppose that the OFF perods are of exponental μ <, varance σ = μ <, α = / μ, L( x) = and suppose that α > α. Then t follows from (5) that b = and then we know that αmn = α = β, whch mples that H defned n Theorem 3. takes value over (/, ). Hence t follows from Theorem 3. that the correspondng lmtng queue length process Q s a reflectng Gaussan process wth LRD. Therefore, f we consder Q as an approxmatng physcal queue length process, then the correspondng nput process superposed from large number of O/OFF sources should be of LRD. However, f we consder the O-perods are of the correspondng truncated Pareto dstrbuton, the assocated mean and varance are both fnte. Thus, smlar to the above dscusson, we know that H=/, whch means by Theorem 3. that the derved lmtng queue length process Q s a reflectng Brownan moton (RBM), whch does not have the LRD (nterested readers are also drected to Refs. [8~9] for more detals about Brownan approxmatons). evertheless, the constant π n () may be very large. Therefore, f we consder Q as an approxmatng queue length process, then the correspondng nput process superposed from large number of O/OFF sources should not be of LRD and the packet nterarrval tmes more look lke beng generated from an..d sequence of random varables, whch concdes wth what were observed n the smulatons conducted by Refs. [4~6], and etc. Fnally, from the practcal vewpont, t should be reasonable that the O-perods and OFF-perods from lower speed end users are bounded by some large (maybe huge) constant (e.g., even the range of tme scales used n the mplementatons of Ref. [9] are bounded by M L = ). Therefore, the fndngs based on ther smulatons n Refs. [5~6] and etc. should be more close to the realty but not to ther mathematcal assumptons mposed about HTD/LRD due to the truncaton effect n ther smulatons. More mportantly, ther assumptons on HTD/LRD are stemmed from Ref. [9] where only bounded tme scales are concerned. So t s more sutable to use the truncated verson of a heavy-taled random varable n a smulaton to be consstent wth practce and to avod more complcated HTD/LRD related analyss.

11 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) Conclusons and Future Work In ths paper, we have answered the queston arsng n a smulaton or a real-word applcaton, whch ndcates that the approxmaton of a concerned objectve through a truncated random varable to replace the orgnal heavy-taled one may be not consstent wth what should be f the HTD/LRD assumptons are mposed. So, based on ths observaton and our prevously establshed approxmatng theory about RGP wth or wthout LRD, we provde more reasonable nterpretatons to some well-known large-scale computer and statstcal experments n characterzng the superposton of nternet traffc sources. More mportantly, our fndngs also ndcate that, n a smulaton and related analyss, t s more sutable to use a truncated random varable to replace a heavy-taled one n order to be more consstent wth realty and to avod more complcated dscussons va HTD/LRD theory. In addton to telecommuncaton, the studes concernng HTD/LRD have appeared n many felds such as fnancal engneerng, nsurance, and tme seres analyss (see, e.g., Refs. [~3]). For the purpose of computer orented smulatons and real-world applcatons, t s also nevtable to handle the truncaton problem when a heavy-taled random varable s concerned. Acknowledgement Ths project s supported by atural Scence Foundaton of Chna wth Grant o References [] F. Avram, Z. Palmowsk, and M. Pstorus. On the optmal dvdend problem for a spectrally negatve Levy process. Annals of Appled Probablty, 007, 7(): 56~80. [] O. E. Barndorff-elsen and. Shephard. on-gaussan Ornsten-Uhlenbeck-based models and some of ther uses n fnancal mathematcs. J. R. Stat. Soc. Ser. B, 00, 63: 67~4. [3] P. J. Brockwell and R. A. Davs. Tme Seres: Theory and Methods, Sprnger-Verlag, ew York, 99. [4] J. Cao, W. S. Cleverland, D. Ln, and D. X. Sun. Internet traffc tends to Posson and ndependent as the load ncreases. onlnear Estmaton and Classfcaton, eds. C. Holmes, D. Denson, M. Hansen, B. Yu, and B. Mallck, Sprnger, ew York, 00. [5] J. Cao, W. S. Cleverland, D. Ln, and D. X. Sun. The effect of statstcal multplexng on the long-range dependence of Internet packet traffc. Tech Report, Bell Labs, Murray Hll, J, U.S.A., 00. [6] J. Cao and K. Ramanan. A Posson lmt for the unfnshed work superposed pont processes. Tech Report. Bell Labs, Murray Hll, J, U.S.A., 00.. [7] J. D. Cavanaugh and T.J. Salo. Internetwotkng wth ATM WAS. In Wllam Stallngs, edtor, Advances n Local and Metropoltan Area etworks, IEEE Computer Socety Press, 994. [8] J. G. Da and W. Da. A heavy traffc lmt theorem for a class of open queueng networks wth fnte buffers. Queueng Systems, 999, 3: 5~40. [9] W. Da. Brownan Approxmatons for Queueng etworks wth Fnte Buffers: Modelng, Heavy Traffc Analyss and umercal Implementatons. Ph.D Thess, The Georga Insttute of Technology, 996. Also publshed n UMI Dssertaton Servces, A Bell & Howell Company, Mchgan, U.S.A., 997. [0] W. Da. Heavy traffc lmt theorems for a queue wth Posson O/OFF long-range depedent sources and general servce tme dstrbuton. Preprnt, 004, nvted talk at 004 Annual Conference of Jangsu Probablty and Statstcal Socety, also presented at 005 Internatonal Conference of Management and Applcatons, Chengdu, Chna and 006 IFORMS Hong Kong Internatonal Conference, Hong Kong, Chna. [] W. E. Leland, M. S. Taqqu, W. Wllnger, and D. V. Wlson. On the self-smlar nature of Ethernet traffc. IEEE/ACM Trans. etw., 994, : ~5.

12 499 W. Da. /Journal of Computatonal Informaton Systems 7:5 (0) [] T. Mkosch, S. Resnck, H. Rootzen, and A. Stegeman. Is network traffc approxmated by stable Levy moton or fractonal Brownan moton? Annals of Appled Probablty, 00, (): 3~68. [3] V. Paxson and S. Floyd. Wde-area traffc: the falure of Posson modelng. IEEE/ACM Transactons on etworkng, 995, 3: 6~44. [4] C. P. Robert and G. Casella, Monte Carlo Statstcal Methods. Sprnger, ew York, 999. [5] B. K. Ryu and A. Elwald. The mportance of long-range dependence of VBR traffc n ATM traffc engneerng: myths and realtes. In Proc. ACM SIGCOMM' 96, 996, 3~4. [6] B.K. Ryu and S.B. Lowen. Pont process approaches to the modelng and analyss of self-smlar traffc: Part I-Model constructon. In Proc. IEEE Infocom 996, 996, 468~475. [7] M. S. Taqqu, W. Wllnger, and R. Sherman. Proof of a fundamental result n self-smlar traffc modelng. ACM/Sgcomm Computer Communcaton Revew, 997, 7: 5~3. [8] W. Whtt. Stochastc Process Lmts. ew York, Sprnger-Verlag, 00. [9] W. Wllnger, M. S. Taqqu, R. Sherman, and D. V. Wlson. Self-smlarty through hgh-varablty: statstcal analyss of Ethernet LA traffc at the source level. IEEE/ACM Transactons on etworkng, 997, 5(): 7~86.

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Queueing Networks II Network Performance

Queueing Networks II Network Performance Queueng Networks II Network Performance Davd Tpper Assocate Professor Graduate Telecommuncatons and Networkng Program Unversty of Pttsburgh Sldes 6 Networks of Queues Many communcaton systems must be modeled

More information

Lecture 17 : Stochastic Processes II

Lecture 17 : Stochastic Processes II : Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss

More information

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests Smulated of the Cramér-von Mses Goodness-of-Ft Tests Steele, M., Chaselng, J. and 3 Hurst, C. School of Mathematcal and Physcal Scences, James Cook Unversty, Australan School of Envronmental Studes, Grffth

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS Avalable onlne at http://sck.org J. Math. Comput. Sc. 3 (3), No., 6-3 ISSN: 97-537 COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

More information

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity

Week3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle

More information

Distributions /06. G.Serazzi 05/06 Dimensionamento degli Impianti Informatici distrib - 1

Distributions /06. G.Serazzi 05/06 Dimensionamento degli Impianti Informatici distrib - 1 Dstrbutons 8/03/06 /06 G.Serazz 05/06 Dmensonamento degl Impant Informatc dstrb - outlne densty, dstrbuton, moments unform dstrbuton Posson process, eponental dstrbuton Pareto functon densty and dstrbuton

More information

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS HCMC Unversty of Pedagogy Thong Nguyen Huu et al. A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS Thong Nguyen Huu and Hao Tran Van Department of mathematcs-nformaton,

More information

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights ACTA ET COMMENTATIONES UNIVERSITATIS TARTUENSIS DE MATHEMATICA Volume 7, Number 2, December 203 Avalable onlne at http://acutm.math.ut.ee A note on almost sure behavor of randomly weghted sums of φ-mxng

More information

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore

Predictive Analytics : QM901.1x Prof U Dinesh Kumar, IIMB. All Rights Reserved, Indian Institute of Management Bangalore Sesson Outlne Introducton to classfcaton problems and dscrete choce models. Introducton to Logstcs Regresson. Logstc functon and Logt functon. Maxmum Lkelhood Estmator (MLE) for estmaton of LR parameters.

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Bayesian predictive Configural Frequency Analysis

Bayesian predictive Configural Frequency Analysis Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse

More information

Convergence of random processes

Convergence of random processes DS-GA 12 Lecture notes 6 Fall 216 Convergence of random processes 1 Introducton In these notes we study convergence of dscrete random processes. Ths allows to characterze phenomena such as the law of large

More information

Lecture 3: Probability Distributions

Lecture 3: Probability Distributions Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the

More information

Uncertainty and auto-correlation in. Measurement

Uncertainty and auto-correlation in. Measurement Uncertanty and auto-correlaton n arxv:1707.03276v2 [physcs.data-an] 30 Dec 2017 Measurement Markus Schebl Federal Offce of Metrology and Surveyng (BEV), 1160 Venna, Austra E-mal: markus.schebl@bev.gv.at

More information

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers

Psychology 282 Lecture #24 Outline Regression Diagnostics: Outliers Psychology 282 Lecture #24 Outlne Regresson Dagnostcs: Outlers In an earler lecture we studed the statstcal assumptons underlyng the regresson model, ncludng the followng ponts: Formal statement of assumptons.

More information

TCOM 501: Networking Theory & Fundamentals. Lecture 7 February 25, 2003 Prof. Yannis A. Korilis

TCOM 501: Networking Theory & Fundamentals. Lecture 7 February 25, 2003 Prof. Yannis A. Korilis TCOM 501: Networkng Theory & Fundamentals Lecture 7 February 25, 2003 Prof. Yanns A. Korls 1 7-2 Topcs Open Jackson Networks Network Flows State-Dependent Servce Rates Networks of Transmsson Lnes Klenrock

More information

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek

Discussion of Extensions of the Gauss-Markov Theorem to the Case of Stochastic Regression Coefficients Ed Stanek Dscusson of Extensons of the Gauss-arkov Theorem to the Case of Stochastc Regresson Coeffcents Ed Stanek Introducton Pfeffermann (984 dscusses extensons to the Gauss-arkov Theorem n settngs where regresson

More information

An (almost) unbiased estimator for the S-Gini index

An (almost) unbiased estimator for the S-Gini index An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Notes on Frequency Estimation in Data Streams

Notes on Frequency Estimation in Data Streams Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U) Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of

More information

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud

Resource Allocation with a Budget Constraint for Computing Independent Tasks in the Cloud Resource Allocaton wth a Budget Constrant for Computng Independent Tasks n the Cloud Wemng Sh and Bo Hong School of Electrcal and Computer Engneerng Georga Insttute of Technology, USA 2nd IEEE Internatonal

More information

A Hybrid Variational Iteration Method for Blasius Equation

A Hybrid Variational Iteration Method for Blasius Equation Avalable at http://pvamu.edu/aam Appl. Appl. Math. ISSN: 1932-9466 Vol. 10, Issue 1 (June 2015), pp. 223-229 Applcatons and Appled Mathematcs: An Internatonal Journal (AAM) A Hybrd Varatonal Iteraton Method

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1 Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Lecture 4 Hypothesis Testing

Lecture 4 Hypothesis Testing Lecture 4 Hypothess Testng We may wsh to test pror hypotheses about the coeffcents we estmate. We can use the estmates to test whether the data rejects our hypothess. An example mght be that we wsh to

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

x i1 =1 for all i (the constant ).

x i1 =1 for all i (the constant ). Chapter 5 The Multple Regresson Model Consder an economc model where the dependent varable s a functon of K explanatory varables. The economc model has the form: y = f ( x,x,..., ) xk Approxmate ths by

More information

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family IOSR Journal of Mathematcs IOSR-JM) ISSN: 2278-5728. Volume 3, Issue 3 Sep-Oct. 202), PP 44-48 www.osrjournals.org Usng T.O.M to Estmate Parameter of dstrbutons that have not Sngle Exponental Famly Jubran

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands Content. Inference on Regresson Parameters a. Fndng Mean, s.d and covarance amongst estmates.. Confdence Intervals and Workng Hotellng Bands 3. Cochran s Theorem 4. General Lnear Testng 5. Measures of

More information

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models

Computation of Higher Order Moments from Two Multinomial Overdispersion Likelihood Models Computaton of Hgher Order Moments from Two Multnomal Overdsperson Lkelhood Models BY J. T. NEWCOMER, N. K. NEERCHAL Department of Mathematcs and Statstcs, Unversty of Maryland, Baltmore County, Baltmore,

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Chapter 8 Indicator Variables

Chapter 8 Indicator Variables Chapter 8 Indcator Varables In general, e explanatory varables n any regresson analyss are assumed to be quanttatve n nature. For example, e varables lke temperature, dstance, age etc. are quanttatve n

More information

A Robust Method for Calculating the Correlation Coefficient

A Robust Method for Calculating the Correlation Coefficient A Robust Method for Calculatng the Correlaton Coeffcent E.B. Nven and C. V. Deutsch Relatonshps between prmary and secondary data are frequently quantfed usng the correlaton coeffcent; however, the tradtonal

More information

Computing MLE Bias Empirically

Computing MLE Bias Empirically Computng MLE Bas Emprcally Kar Wa Lm Australan atonal Unversty January 3, 27 Abstract Ths note studes the bas arses from the MLE estmate of the rate parameter and the mean parameter of an exponental dstrbuton.

More information

Lecture 4. Instructor: Haipeng Luo

Lecture 4. Instructor: Haipeng Luo Lecture 4 Instructor: Hapeng Luo In the followng lectures, we focus on the expert problem and study more adaptve algorthms. Although Hedge s proven to be worst-case optmal, one may wonder how well t would

More information

Basically, if you have a dummy dependent variable you will be estimating a probability.

Basically, if you have a dummy dependent variable you will be estimating a probability. ECON 497: Lecture Notes 13 Page 1 of 1 Metropoltan State Unversty ECON 497: Research and Forecastng Lecture Notes 13 Dummy Dependent Varable Technques Studenmund Chapter 13 Bascally, f you have a dummy

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Statistics for Economics & Business

Statistics for Economics & Business Statstcs for Economcs & Busness Smple Lnear Regresson Learnng Objectves In ths chapter, you learn: How to use regresson analyss to predct the value of a dependent varable based on an ndependent varable

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan

Winter 2008 CS567 Stochastic Linear/Integer Programming Guest Lecturer: Xu, Huan Wnter 2008 CS567 Stochastc Lnear/Integer Programmng Guest Lecturer: Xu, Huan Class 2: More Modelng Examples 1 Capacty Expanson Capacty expanson models optmal choces of the tmng and levels of nvestments

More information

TAIL PROBABILITIES OF RANDOMLY WEIGHTED SUMS OF RANDOM VARIABLES WITH DOMINATED VARIATION

TAIL PROBABILITIES OF RANDOMLY WEIGHTED SUMS OF RANDOM VARIABLES WITH DOMINATED VARIATION Stochastc Models, :53 7, 006 Copyrght Taylor & Francs Group, LLC ISSN: 153-6349 prnt/153-414 onlne DOI: 10.1080/153634060064909 TAIL PROBABILITIES OF RANDOMLY WEIGHTED SUMS OF RANDOM VARIABLES WITH DOMINATED

More information

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1

On an Extension of Stochastic Approximation EM Algorithm for Incomplete Data Problems. Vahid Tadayon 1 On an Extenson of Stochastc Approxmaton EM Algorthm for Incomplete Data Problems Vahd Tadayon Abstract: The Stochastc Approxmaton EM (SAEM algorthm, a varant stochastc approxmaton of EM, s a versatle tool

More information

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010 Parametrc fractonal mputaton for mssng data analyss Jae Kwang Km Survey Workng Group Semnar March 29, 2010 1 Outlne Introducton Proposed method Fractonal mputaton Approxmaton Varance estmaton Multple mputaton

More information

A CHARACTERIZATION OF ADDITIVE DERIVATIONS ON VON NEUMANN ALGEBRAS

A CHARACTERIZATION OF ADDITIVE DERIVATIONS ON VON NEUMANN ALGEBRAS Journal of Mathematcal Scences: Advances and Applcatons Volume 25, 2014, Pages 1-12 A CHARACTERIZATION OF ADDITIVE DERIVATIONS ON VON NEUMANN ALGEBRAS JIA JI, WEN ZHANG and XIAOFEI QI Department of Mathematcs

More information

2016 Wiley. Study Session 2: Ethical and Professional Standards Application

2016 Wiley. Study Session 2: Ethical and Professional Standards Application 6 Wley Study Sesson : Ethcal and Professonal Standards Applcaton LESSON : CORRECTION ANALYSIS Readng 9: Correlaton and Regresson LOS 9a: Calculate and nterpret a sample covarance and a sample correlaton

More information

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA 4 Analyss of Varance (ANOVA) 5 ANOVA 51 Introducton ANOVA ANOVA s a way to estmate and test the means of multple populatons We wll start wth one-way ANOVA If the populatons ncluded n the study are selected

More information

High resolution entropy stable scheme for shallow water equations

High resolution entropy stable scheme for shallow water equations Internatonal Symposum on Computers & Informatcs (ISCI 05) Hgh resoluton entropy stable scheme for shallow water equatons Xaohan Cheng,a, Yufeng Ne,b, Department of Appled Mathematcs, Northwestern Polytechncal

More information

Estimation: Part 2. Chapter GREG estimation

Estimation: Part 2. Chapter GREG estimation Chapter 9 Estmaton: Part 2 9. GREG estmaton In Chapter 8, we have seen that the regresson estmator s an effcent estmator when there s a lnear relatonshp between y and x. In ths chapter, we generalzed the

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Exerments-I MODULE III LECTURE - 2 EXPERIMENTAL DESIGN MODELS Dr. Shalabh Deartment of Mathematcs and Statstcs Indan Insttute of Technology Kanur 2 We consder the models

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Exercises of Chapter 2

Exercises of Chapter 2 Exercses of Chapter Chuang-Cheh Ln Department of Computer Scence and Informaton Engneerng, Natonal Chung Cheng Unversty, Mng-Hsung, Chay 61, Tawan. Exercse.6. Suppose that we ndependently roll two standard

More information

On mutual information estimation for mixed-pair random variables

On mutual information estimation for mixed-pair random variables On mutual nformaton estmaton for mxed-par random varables November 3, 218 Aleksandr Beknazaryan, Xn Dang and Haln Sang 1 Department of Mathematcs, The Unversty of Msssspp, Unversty, MS 38677, USA. E-mal:

More information

Elsevier Editorial System(tm) for Journal of the Franklin Institute Manuscript Draft

Elsevier Editorial System(tm) for Journal of the Franklin Institute Manuscript Draft Elsever Edtoral System(tm) for Journal of the Frankln Insttute Manuscrpt Draft Manuscrpt umber: FI-D-09-00471 Ttle: On the Asymptotc Queueng Behavor of General AQM Routers Artcle Type: Modelng & Smulaton

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium?

Welfare Properties of General Equilibrium. What can be said about optimality properties of resource allocation implied by general equilibrium? APPLIED WELFARE ECONOMICS AND POLICY ANALYSIS Welfare Propertes of General Equlbrum What can be sad about optmalty propertes of resource allocaton mpled by general equlbrum? Any crteron used to compare

More information

Superposition of Multiplicative Multifractal Trac Streams. Los Angeles, CA fjbgao,

Superposition of Multiplicative Multifractal Trac Streams. Los Angeles, CA fjbgao, Proceedngs ICC'000, June, 000, New Orleans, Lousana. Superposton of Multplcatve Multfractal Trac Streams Janbo Gao and Izhak Rubn Department of Electrcal Engneerng Unversty of Calforna, Los Angeles Los

More information

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur Analyss of Varance and Desgn of Experment-I MODULE VII LECTURE - 3 ANALYSIS OF COVARIANCE Dr Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Any scentfc experment s performed

More information

Research Article Green s Theorem for Sign Data

Research Article Green s Theorem for Sign Data Internatonal Scholarly Research Network ISRN Appled Mathematcs Volume 2012, Artcle ID 539359, 10 pages do:10.5402/2012/539359 Research Artcle Green s Theorem for Sgn Data Lous M. Houston The Unversty of

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Mamum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models for

More information

Chapter 7 Channel Capacity and Coding

Chapter 7 Channel Capacity and Coding Wreless Informaton Transmsson System Lab. Chapter 7 Channel Capacty and Codng Insttute of Communcatons Engneerng atonal Sun Yat-sen Unversty Contents 7. Channel models and channel capacty 7.. Channel models

More information

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14 APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce

More information

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables

LINEAR REGRESSION ANALYSIS. MODULE VIII Lecture Indicator Variables LINEAR REGRESSION ANALYSIS MODULE VIII Lecture - 7 Indcator Varables Dr. Shalabh Department of Maematcs and Statstcs Indan Insttute of Technology Kanpur Indcator varables versus quanttatve explanatory

More information

Asymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation

Asymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation Nonl. Analyss and Dfferental Equatons, ol., 4, no., 5 - HIKARI Ltd, www.m-har.com http://dx.do.org/.988/nade.4.456 Asymptotcs of the Soluton of a Boundary alue Problem for One-Characterstc Dfferental Equaton

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Limited Dependent Variables

Limited Dependent Variables Lmted Dependent Varables. What f the left-hand sde varable s not a contnuous thng spread from mnus nfnty to plus nfnty? That s, gven a model = f (, β, ε, where a. s bounded below at zero, such as wages

More information

Finding Primitive Roots Pseudo-Deterministically

Finding Primitive Roots Pseudo-Deterministically Electronc Colloquum on Computatonal Complexty, Report No 207 (205) Fndng Prmtve Roots Pseudo-Determnstcally Ofer Grossman December 22, 205 Abstract Pseudo-determnstc algorthms are randomzed search algorthms

More information

Lecture 4: November 17, Part 1 Single Buffer Management

Lecture 4: November 17, Part 1 Single Buffer Management Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input

More information

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM

DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM Ganj, Z. Z., et al.: Determnaton of Temperature Dstrbuton for S111 DETERMINATION OF TEMPERATURE DISTRIBUTION FOR ANNULAR FINS WITH TEMPERATURE DEPENDENT THERMAL CONDUCTIVITY BY HPM by Davood Domr GANJI

More information

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

Power law and dimension of the maximum value for belief distribution with the max Deng entropy Power law and dmenson of the maxmum value for belef dstrbuton wth the max Deng entropy Bngy Kang a, a College of Informaton Engneerng, Northwest A&F Unversty, Yanglng, Shaanx, 712100, Chna. Abstract Deng

More information

A Note on Bound for Jensen-Shannon Divergence by Jeffreys

A Note on Bound for Jensen-Shannon Divergence by Jeffreys OPEN ACCESS Conference Proceedngs Paper Entropy www.scforum.net/conference/ecea- A Note on Bound for Jensen-Shannon Dvergence by Jeffreys Takuya Yamano, * Department of Mathematcs and Physcs, Faculty of

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION

DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION Internatonal Worshop ADVANCES IN STATISTICAL HYDROLOGY May 3-5, Taormna, Italy DERIVATION OF THE PROBABILITY PLOT CORRELATION COEFFICIENT TEST STATISTICS FOR THE GENERALIZED LOGISTIC DISTRIBUTION by Sooyoung

More information

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes

DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR. Introductory Econometrics 1 hour 30 minutes 25/6 Canddates Only January Examnatons 26 Student Number: Desk Number:...... DO NOT OPEN THE QUESTION PAPER UNTIL INSTRUCTED TO DO SO BY THE CHIEF INVIGILATOR Department Module Code Module Ttle Exam Duraton

More information

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal Markov chans M. Veeraraghavan; March 17, 2004 [Tp: Study the MC, QT, and Lttle s law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Lttle s law lecture (when dervng the mean response tme

More information

Supplementary Notes for Chapter 9 Mixture Thermodynamics

Supplementary Notes for Chapter 9 Mixture Thermodynamics Supplementary Notes for Chapter 9 Mxture Thermodynamcs Key ponts Nne major topcs of Chapter 9 are revewed below: 1. Notaton and operatonal equatons for mxtures 2. PVTN EOSs for mxtures 3. General effects

More information

Tail Dependence Comparison of Survival Marshall-Olkin Copulas

Tail Dependence Comparison of Survival Marshall-Olkin Copulas Tal Dependence Comparson of Survval Marshall-Olkn Copulas Hajun L Department of Mathematcs and Department of Statstcs Washngton State Unversty Pullman, WA 99164, U.S.A. lh@math.wsu.edu January 2006 Abstract

More information

Topic 23 - Randomized Complete Block Designs (RCBD)

Topic 23 - Randomized Complete Block Designs (RCBD) Topc 3 ANOVA (III) 3-1 Topc 3 - Randomzed Complete Block Desgns (RCBD) Defn: A Randomzed Complete Block Desgn s a varant of the completely randomzed desgn (CRD) that we recently learned. In ths desgn,

More information

Quantum and Classical Information Theory with Disentropy

Quantum and Classical Information Theory with Disentropy Quantum and Classcal Informaton Theory wth Dsentropy R V Ramos rubensramos@ufcbr Lab of Quantum Informaton Technology, Department of Telenformatc Engneerng Federal Unversty of Ceara - DETI/UFC, CP 6007

More information

Error Probability for M Signals

Error Probability for M Signals Chapter 3 rror Probablty for M Sgnals In ths chapter we dscuss the error probablty n decdng whch of M sgnals was transmtted over an arbtrary channel. We assume the sgnals are represented by a set of orthonormal

More information

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations

1 Derivation of Rate Equations from Single-Cell Conductance (Hodgkin-Huxley-like) Equations Physcs 171/271 -Davd Klenfeld - Fall 2005 (revsed Wnter 2011) 1 Dervaton of Rate Equatons from Sngle-Cell Conductance (Hodgkn-Huxley-lke) Equatons We consder a network of many neurons, each of whch obeys

More information

Applied Stochastic Processes

Applied Stochastic Processes STAT455/855 Fall 23 Appled Stochastc Processes Fnal Exam, Bref Solutons 1. (15 marks) (a) (7 marks) The dstrbuton of Y s gven by ( ) ( ) y 2 1 5 P (Y y) for y 2, 3,... The above follows because each of

More information

Inference from Data Partitions

Inference from Data Partitions Inference from Data Parttons Rcardo Bórquez and Melvn Hnch May 18, 2010 1 Introducton Consder a statonary process X = {X t, t = 1, 2,..., T } defned on (Ω, F, {F t }, P ) where F denotes the Borel sets,

More information

6. Stochastic processes (2)

6. Stochastic processes (2) 6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process

More information

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA

Statistical Energy Analysis for High Frequency Acoustic Analysis with LS-DYNA 14 th Internatonal Users Conference Sesson: ALE-FSI Statstcal Energy Analyss for Hgh Frequency Acoustc Analyss wth Zhe Cu 1, Yun Huang 1, Mhamed Soul 2, Tayeb Zeguar 3 1 Lvermore Software Technology Corporaton

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information