A Competitive Test for Uniformity of Monotone Distributions

Size: px
Start display at page:

Download "A Competitive Test for Uniformity of Monotone Distributions"

Transcription

1 A Compeve Tes for Unformy of Monoone Dsrbuons Jayadev Acharya Ashkan Jafarpour Alon Orlsky Ananda Theerha Suresh Unversy of Calforna San Dego Absrac We propose a es ha akes random samples drawn from a monoone dsrbuon and decdes wheher or no he dsrbuon s unform The es s nearly opmal n ha uses a mos On log n samples, where n s he number of samples ha a gene who knew all bu one b abou he underlyng dsrbuon would need for he same ask Conversely, we show ha any such es would requre Ωn log n samples for some dsrbuons INTRODUCTION Many a lvely debae rages over wheher some quany grows wh a possbly relaed parameer, or s ndependen of : cancer prevalence vs radaon exposure; dabees onse rae vs age; flu frequency vs negave emperaure; hear aacks vs sress; recovery speed vs drug dosage; produc falures vs me from manufacure; axes or educaon level or negave ncarceraon rae vs ncome; gender vs salary; pary afflaon vs ncome or age; grades vs preparaon me; qualy vs cos; and fnally, age before beauy We propose a es ha akes random samples generaed by a monoone dsrbuon and decdes wheher or no he dsrbuon s unform The es s near opmal n he followng sense A gene who knew he underlyng dsrbuon, could clearly decde f s unform or no whou any samples We show ha f a gene who knew all bu one specfc b abou he underlyng dsrbuon would requre n samples o decde on unformy, hen our es wll requre a mos On log n samples o make he same decson We also show ha Ωn log n samples are necessary In general, he parameer of neres can be dscree Appearng n Proceedngs of he 6 h Inernaonal Conference on Arfcal Inellgence and Sascs AISTATS 03, Scosdale, AZ, USA Volume 3 of JMLR: W&CP 3 Copyrgh 03 by he auhors ncome or connuous emperaure and can assume dfferen ranges However, every monoone dsrbuon over a fne connuous nerval, and every monoone dscree dsrbuon over a fne doman, can be convered o an equvalen monoone dsrbuon over [0, For example, he monoone dsrbuon p 06, p 03, p7 0, can be convered o 06 [0,/3 x+03 [/3,/3 x+0 [/3, x Hence we consder probably densy funcons, or dsrbuons for shor, over [0, Monoone dsrbuons over nfne ranges can be smlarly analyzed and wll be addressed n he full verson of hs paper Over [0,, he dsrbuon ux s unform A dsrbuon f s monoone f for all x < y < z, fy fx fz fy 0 Noe ha monoone dsrbuons can be eher ncreasng or decreasng Le M be he collecon of monoone dsrbuons, and M M {u}, he collecon of monoone non-unform dsrbuons We would lke o decde wheher a dsrbuon f M s unform or no based on ndependen samples generaes A es s a mappng : [0, ] {un, non} declarng wheher he observed samples are beleved o be generaed by a unform or a non-unform dsrbuon The error probably of for f M based on n samples generaes s P ef, n { P X n non, f f u, P X n un, f f M, where X n X,, X n are samples dsrbued ndependenly f As n several recen works, we are mosly neresed n he sample complexy, he number of samples requred o acheve a ceran error For a dsrbuon f M, es, and error ɛ > 0, le N ɛ f mn {n : P ef, n < ɛ and P eu, n < ɛ} be he smalles number of samples for whch has error < ɛ for boh f and he unform dsrbuon We requre s error o be small for boh f and u as a rval es acheves 0 error for jus one of hem

2 A Compeve Tes for Unformy of Monoone Dsrbuons The smalles number of samples requred by any es o acheve error probably < ɛ for f M and u s herefore, Nɛ f mn {Nɛ f} The es achevng he mnmum s denoed Example For > 0, le { + f x [0, fx, f x [, Snce boh f and u are consan over [0, and [,, all he nformaon X n conveys abou f and u s conaned n M { : X < }, he number of samples n [0, If he underlyng dsrbuon s u, hen M Bn, n, wh expeced value n and sandard devaon n If he underlyng dsrbuon s f, hen M Bn +, n, wh expeced value + n and sandard devaon n Consder he es ha decdes un f M < + n and non oherwse The es errs only f M srays from s mean by > n, namely by roughly n sandard devaons If n > C, hen he error probably wll be small, showng ha for any fxed ɛ, Nɛ f Nɛ f O For he lower bound, observe ha f n, hen he dfference beween he means of M when sampled under f and u wll be sgnfcanly smaller han a sandard devaon, and no es wll dsngush he wo alernaves Hence Nɛ f Ω, and herefore Nɛ f Θ Ths argumen s of course jus nuve A rgorous proof s based on Equaon and compues he l dsance beween he wo bnomal dsrbuons Clearly, he closer f ges o u, he larger N f becomes Prevous approaches o hs problem have herefore consdered he sub-collecon M M of all monoone dsrbuons whose l dsance from u s a leas Daskalaks e al, 0 showed ha a es smlar o n he las example sasfes Nɛ f O for all f M, and ha for some f M, Nɛ f Ω Therefore he hghes sample complexy of any dsrbuon n M s Θ However, he nex example shows ha some M dsrbuons have a far lower complexy Example Le fx x + where x s Drac Dela funcon Clearly l f, u Consder he es ha declares non f a sample a x 0 s observed, and un oherwse For he unform dsrbuon u, he es errs wh probably 0, and o ensure ha for f errs wh probably /3, we need 3 n Namely n log 3/ log log 3 samples suffce I can be easly shown ha roughly hs number s also necessary, hence N ɛ f Θ The wo examples show ha he l dsance of f from u s no an accurae measure for he number of samples needed o es s unformy, and n parcular ha some dsrbuons n M can be esed for unformy usng much less han Θ samples They also show ha achevng N ɛ f may requre advance knowledge of f as he es may depend on he underlyng dsrbuon In hs paper we derve a es ha performs almos as well as possble, no jus for he wors dsrbuon n a subclass of M, bu for every dsrbuon n M Is performance for every underlyng dsrbuon approaches ha of he bes es desgned wh knowledge of all bu one albe carefully chosen b abou he underlyng dsrbuon Specfcally, f a gene knew he underlyng monoone dsrbuon, could deermne wheher he dsrbuon s unform or no whou any samples a all We show ha f he underlyng dsrbuon s f, and a very knowledgeable gene, who knew ha he underlyng dsrbuon was eher f or u bu dd no know whch, n a sense mssng jus a sngle b abou he dsrbuon, hen f ha gene needed n samples o deermne wheher he dsrbuon was unform or no, our es, desgned of course whou knowledge of f, would requre a mos On log n samples Before formally sang he resuls, noe ha for many daa-based decson problems, ncludng hs one, once an error probably ɛ < / s acheved, one can repea he es several mes and ake he majory of all decsons, resulng n an error dmnshng exponenally fas n he number of repeons Specfcally, f we repea he es on T ndependen daa ses, can be easly shown ha he error probably of he combned es s a mos ɛ ɛt/ For smplcy herefore we consder he number of samples needed o ge error probably < /3 Any oher desred error can be acheved by repeang he expermen a consan number of mes For f M and es, le and N f N /3 f, N f N /3 f, be he number of samples ha, and he bes es, need o have error probably < /3 We desgn a sngle es c ha s nearly opmal regardless of he underlyng dsrbuon Namely, for

3 Jayadev Acharya, Ashkan Jafarpour, Alon Orlsky, Ananda Theerha Suresh every f M N c f O N f log N f We also show ha hs exra facor s necessary More precsely, for every es, here s a f M such ha N f Ω N f log N f Two observaons are n order Frs, all unformy ess make some nheren assumpon abou he underlyng dsrbuon For example, he es Daskalaks e al, 0 for dsrbuons n M assumes ha he esed dsrbuon s eher unform or n M If he dsrbuon s no n hese wo classes, namely 0 < l f, u <, hen he es s performance s no guaraneed Smlarly, for our problem, f n on f log N f, hen here s no guaranee on he performance of c In fac, we show ha n ha case, for suffcenly large n, c oupus unwh probably a leas 3 Second, wh he saed number of samples, c has error /3 If a smaller error ɛ s desred, hen as above, he number of samples can be mulpled by 7 ln ɛ Noe however ha n ha case, we would be comparng /3 error for he gene wh ɛ error for c If we requred he gene o acheve ɛ error oo, he dependence on ɛ n he consan wll decrease and perhaps vansh RELATED WORKS The sascs leraure offers varous unformy ess, see Woodroofe and Sun, 999 and references heren The compuer scence communy has consdered he problem more recenly, ypcally addressng dscree dsrbuons Whou loss of generaly, assume he underlyng dsrbuon s over [k] {,, k} Pannsk, 008 showed ha esng f he dsrbuon s unform or ɛ far away from unform n l dsance, requres Θ k ɛ samples Bau e al, 00 showed ha esng f he dsrbuon s monoone or far from all monoone dsrbuons n l dsance requres Õ k samples, where he mpled consan s an nverse polynomal n he l dsance They also showed ha esng f wo monoone dsrbuons are close n l dsance requres Opolylogk samples Daskalaks e al, 0 exended hese resuls o m-modal dsrbuons In parcular, hey showed ha esng f a monoone dsrbuon equals a prespecfed dsrbuon requres O log k log log kɛ 5 samples and he dependence on k s opmal up o a Olog log k facor Alhough no drecly relaed o hs paper, muldmensonal dsrbuons were consdered as well Rubnfeld and Servedo, 009 showed ha esng wheher a monoone dsrbuon over he n dmensonal boolean hypercube {, } n s unform or far from unform n l dsance, requres Θn samples, where Θ represens Θ wh possble poly-logarhmc facors Smlarly, Adamaszek e al, 00 showed ha esng unformy of monoone dsrbuons over he connuous [0, ] n hypercube requres Θn/ɛ samples All he above resuls consder he sample complexy of he wors dsrbuon n a class A dfferen, compeve, approach ha compares he performance for each dsrbuon o he bes possble, was consdered as well Acharya e al, 0 and Acharya e al, 0 consdered closeness esng, where we would lke o deermne wheher wo sequences are drawn from he same or from dfferen dsrbuons, and classfcaon where we are gven wo ranng sequences generaed by unknown dsrbuons and would lke o deermne whch of he wo dsrbuons generaed a new es sequence For boh problems, hey proposed ess ha requre Õn3/ samples, where n s he number of samples requred by he opmal es, desgned wh knowledge of he underlyng dsrbuon mulse 3 PRELIMINARIES 3 Posson samplng Consder any paron of he range [0, no dsjon nervals When a dsrbuon on [0, s sampled exacly n mes, he number of mes elemens appearng n he nervals are dependen for example, hey sum o exacly n, complcang he analyss of many properes A sandard approach o overcome he dependence, eg, Mzenmacher and Upfal, 005 s o sample he dsrbuon a random pon mes, he Posson dsrbuon wh parameer n, resulng n sequences of random lengh close o n Posson al bounds show ha for any α > 0, wh hgh probably a random varable pon + α s larger han n Thus, any es wh error probably 3 ɛ for n samples, can be modfed o work wh error probably < 3 for pon + α samples Snce α can be any posve consan, he es works wh a fraconally larger Posson parameer For a dsrbuon f, he probably ha pon samples generaed accordng o f wll resul n samples x

4 A Compeve Tes for Unformy of Monoone Dsrbuons s fx e n n x x! In parcular, for he unform dsrbuon u, ux e n n x x! We wll also use an equvalen formulaon of Posson samplng Le h be a non-negave funcon over [0,, and le H hx denoe s negral Then a dsrbuon over [0, s ponh accordng o h 0 ff The number of samples n any wo dsjon subses are ndependen For any A [0,, he number of samples n A s pon x A hxdx 3 Smulaon Anoher useful propery of Posson samplng s ha n some cases one can use samples generaed by one dsrbuon o smulae samples generaed by anoher, whou necessarly knowng he underlyng dsrbuon Le h and f be any non-negave funcons over [0, such ha h s furher from han f s, namely for all x, hx /fx Le Y be pon samples ha are generaed accordng o eher h or u We show ha whou he knowledge of he underlyng dsrbuon, one can conver Y o X such ha f he underlyng dsrbuon s h hen X f and f Y u hen X u Lemma 3 There exss an algorhm wh npu Y, n and oupu X such ha If Y h, hen X f, If Y u, hen X u Proof Generae Z u of lengh pon Consruc he se of X as follows Add any sample Y o he nally empy se X wp fx /hx and add any sample Z o he se wp hx fx /hx One can show ha for any bn A, and he lemma wll follow from f Y h, hen E[ X A ] n x A fx, f Y u, hen E[ X A ] n A 33 Error bounds One can consder wo ype of error probables for any es The average error, whch s he error of he es when he samples are eher from f or u wh equal probably, P ef, n P ef, n + P eu, n The wors-case error of whch s he larger of he errors for f and u, ˆP ef, n maxp ef, n, P eu, n As wh all hypohess esng problems, Clearly, and P ef, n mn Pef, n + Peu, n mn f u,n ˆP ef, n P ef, n f u,n, ˆP e f, n mn P e f, n x mnfx, ux f u,n Where he l dsance beween f and u s f u,n x UPPER BOUND Tes fx ux We propose a es ha dsngushes every f from u wh Posson n ON f log N f samples wh error probably 3, whou he knowledge of f For brevy, le n N f Le k log n + 5 Paron he nerval [0, no k bns I,, I k as follows, I [0, k, [ k, k,, k, [ k, k k+,, k, [ k, k

5 Jayadev Acharya, Ashkan Jafarpour, Alon Orlsky, Ananda Theerha Suresh 0 Fgure : Paron of [0, no I,, I k Noe ha he bn szes ncrease exponenally from I o I k and decrease exponenally from I k+ o I k Ths paron s shown n Fgure The es c, descrbed below, performs a varaon of he χ -es on he number of samples appearng n each bn, f eher one of hem, or her sum, s large, he es declares f o be non Noe ha snce he varaon of he χ -es we use can be negave, we need o check boh he ndvdual values and her sum Tes c Inpu: Sequence x of lengh pon 000n k Oupu: un or non for k, le ν {x : x I } and n I f s reurn non else reurn un ν ν 5 k or ν ν 5 k In he remander of hs secon, we prove he compeveness of c Bounds on sample complexy Suppose a monoone dsrbuon f s dsngushable from u usng n samples In hs subsecon we show ha wh a consan facor more samples we can dsngush f from u by only usng he number of samples whn each bn Also, we show ha f f can be dsngushed from u, hen a varaon of χ dsance on he number of samples n he bns s large Conversely, we show ha f f canno be dsngushed from u wh n samples, hen χ dsance s small Defne a sarcase dsrbuon g, shown n Fgure, ha assgns he same probably as f o each bn Namely, for x I gx I y I fy The followng heorem uses Lemma 3 o relae he error probably of f o ha of g Theorem N g N f Proof Whou loss of generaly, suppose ha f s non-ncreasng We show ha from samples of g or u, we can generae samples ha are dsrbued accordng 0 0 Fgure : g and f o f or u Then we run he same opmal es for f on he nduced samples of g Le Y be pon samples from g Paron Y no wo sequences Y and Y, where each sample n Y appears n eher Y or wh equal probably The se of elemens n Y and Y are wo ndependen copes of Posson n samples from g and her unon s Y Snce g s no furher away from han f, Lemma 3 canno be appled drecly Insead, observe ha he average of f and hence g n I s hgher han all he values of f n I + and s less han all he values of f n I Also observe ha I, I + I and we are akng wce he number of samples from he dsrbuon g By scalng and ransformng and usng he followng seps we generae samples X whn each bn For any 3, f x I, fx hen samples of X belong o I are generaed from samples of Y whn I Smlarly f x I, fx, hen we use samples of Y from bn I o generae samples n I For any k, f x I, fx hen samples of X belong o I are generaed from samples of Y whn I + Smlarly f x I k, fx, hen we use samples of Y from bn I k o generae samples n I k 3 If fx changes sgn nsde I where {,, k } for he poron of he I where fx use em or and for he poron where fx use em 3 or o generae he samples of X whn I The above procedure s llusraed n Fgure 3 for k An arrow from I o I j ndcaes ha he samples of X n bn I j are generaed from samples of Y whn bn I The label of he arrow ndcaes he sep used Smlar o he proof echnque n Lemma 3 can be shown ha he samples X are dsrbued accordng o f or u n bns I,, I k and has no samples n I I k

6 A Compeve Tes for Unformy of Monoone Dsrbuons 3 3 I I I 3 I I 5 I 6 I 7 I 8 Fgure 3: Generaon scheme Le be a es such ha Pe f, n< 3 and Pe u, n< 3 The followng es, has error probably less han 0 If Y has samples n I or I k hen Y non Run he es on samples X When he underlyng dsrbuon s u, afer akng Posson n samples, wp e 6 no sample appears n I I k Snce he same es s used, he oal error n hs case s < 3 Addng he probably of havng sample n he I I k we have Peu, n < 3 + e 6 < 0 When he underlyng dsrbuon s nonunform, f a sample appears n I I k, hen he error s zero whle n he oher case runs he es and has error probably less han 3 So far we have shown ha N 0g n Hence, from Equaon, 0 g u,n 3 The followng observaon helps us evaluae he l dsance beween g and u Observaon 5 Snce g and u are consan whn each bn, her number of samples whn each bn s a suffcen sasc o dsngush hem Le ν denoe he number of samples n I Le E[ν ] when he samples are dsrbued accordng o u, and λ E[ν ] when he samples are dsrbued accordng o f Noe ha and λ are funcons of number of samples and for he ease of noaon, parameer n s omed When he underlyng dsrbuon s u, ν s Posson dsrbued wh mean a and when he underlyng dsrbuon s f or g, ν s Posson dsrbued wh mean a λ Le f be he average of f n I, and ν ν,, ν k Le uν be he dsrbuon of ν when X u and fν be he dsrbuon of ν when X f Then, uν e λ ν ν! and fν e λ λ ν ν! Le E h denoe he expecaon wh respec o h The followng lemma, s proof omed, bounds he l dsance beween wo dsrbuons Lemma 6 For any wo dsrbuons h and h, [ ] l h, h h E h h The nex lemma lower bounds a varan of he χ dsance beween f and u Lemma 7 For n N f, wh pon samples, λ > 0 Proof Usng Observaon 5 and Equaon 3, fν uν 0 Subsung fν and uν and usng Lemma 6, 6 k e λ λ ν e λ λ λ ν ν ν! λ exp, where he las nequaly follows from generang funcon of Posson random varables Hence, λ ln 6 > 0 Nex we upper bound he χ dsance beween wo dsrbuons Lemma 8 For n N f, wh pon samples, λ + λ ln 3 Proof Snce samples from f can be used o generae samples from g, he error of f s a mos ha of g, hence N g N f From Equaon, Hence, 3 ν ν exp exp mnuν, fν uνfν λ + λ λ λ + λ ln 3

7 Jayadev Acharya, Ashkan Jafarpour, Alon Orlsky, Ananda Theerha Suresh 3 Proof of compeveness Theorem 9 If n > 000n log n, hen Pe c u, n c and Pe f, n 3 3 Proof Le ν be dsrbued accordng o f, and One can show ha E[α] var[α] α ν ν, α α λ n n, λ + λ λ + 3λ + Unform case: If ν s dsrbued accordng o u, hen E[α] 0 and var[α] k Therefore, by Chebyshev s Inequaly, Pe c u, n 3 Non-unform case: Observe ha all of he s are larger han 000 k/6 Hence by Chebyshev s Inequaly, f s λ / 50 k, hen ν ν 5 k wp a leas /3 Oherwse can be shown ha, var[α] 3 0 E[α] +8k and by Chebyshev s Inequaly he error probably s < 3 Nex we show ha f he number of samples s small, hen c errs on samples of f wh probably > 3 Theorem 0 For suffcenly large n, f n on log n hen P c e f, n 3 Proof Skech By Lemma 8, he χ dsance beween f and u s o log n Suppose he underlyng dsrbuon s f The es c compares a varan of χ quany, α, o he hreshold Θ log n Smlar o he proof of Theorem 9, can be shown ha α concenraes around s mean, whch s smaller han he hreshold Hence, he es c declares un wh probably a leas 3 5 LOWER BOUND Smlar o he prevous secon, we ne bns whose szes ncrease exponenally and consruc a famly C n of monoone decreasng dsrbuons ha are fla whn each bn We show ha for any f C n, N f n, whle no sngle es can dsngush u from all f C n wh on log n samples Le m n log, for smplcy assume m s even, and k m Defne, I { [ 3n, [ k 3n 3n,, k, k + Then, I n for,, k Le Ix be he ndex of he bn conanng x Le S {,, m } {m +,, 3m } {k m +,, k m } Then, S m m For any j j,, j m S, { + m jr x / I k+ f j x m r r:j r Ix m jr jr 3n k x I k+ The dsrbuon f j s nduced from u, by removng some probably mass from I k+ and spreadng across I, I jr for each j r The amoun of probably mass shfed s proporonal o he sandard devaon of he number of samples appearng n I jr Ths ensures ha f j s monoone and has exacly m+ jumps Le {f j : j S} Thus, C n S m m Frs, we show ha N f j n C n Lemma f j C n, N f j n Proof For ν s and λ s ned n he prevous secon, le m β ν j λ j λj We show ha β concenraes around dfferen values for u and f j, and use ha o prove ha hey can be dsngushed wh n samples When u s sampled pon mes, E[β] 0 var[β] whereas f f j s sampled, E[β] m m λ j k λj k m n I j n I j m, m j k m m m m m var[β] + < 6m, m j k

8 A Compeve Tes for Unformy of Monoone Dsrbuons where he las nequaly holds for m Chebyshev s Inequaly, u : f j : hence, j S, N f j n P β 3m m 3m 3, P β 6m 3m 3 m 3, Usng The followng lemma helps o lower bound he number of samples necessary o dsngush u from all dsrbuons n C n Lemma For posve x,, x n, n e x n + exp n x The nex heorem lower bounds he number of samples needed o dsngush all dsrbuons n C n from u Theorem 3 For any es, f j C n such ha, N f j Ω N f j log N f j Proof We fnd a lower bound on n such ha pon samples are necessary o dsngush all f j C n from u wh error 3 Consder he average funcon and le f ave x m m f j x, λ rj λ r + λ r l:j l r j S m j l Nex we relae he maxmum error of all dsrbuons conaned n C n, o he error of her mxure 3 mn max maxp ef, n, Peu, n f C n mn maxp ef ave, n, P eu, n f ave u,n, where he las nequaly follows from Equaon By Lemma 6, 9 f ave u,n E fave [ ] fave x ux Afer movng he consans o lef hand sde we have, [ ] 3 9 E fave x f ave ux a k+ e λ ν k+ νr λrj S e λr λ rj ν ν! λ j S r r b k+ e λ ν k+ λrj λ νr rk S ν j S k S ν! λ r r c 6n m m S exp j k mn j S k S d 7n m S exp j k mn j S k S e m m/ m m/ m 7n S exp mn j k jm m+ km m+ f m m/ 7n S exp mn j m m j m/ 7n exp S mn j m m j g 8n m m/ + exp S mn exp exp 8n mn, where a follows snce all f j s and u are consan whn each I and he number of samples whn each bn s a suffcen sasc for f ave x and ux, b follows from k+ r eλr λ rj, c by subsung λrj and λ rk, d snce s he domnan erm and ohers are exponenally decreasng wh rao a mos /, e from rewrng he sum of producs as produc of sums, f from replacng each erm by he maxmum value, whch occurs for k m + m, and g from Lemma Smplfyng, we have for any es, he number of samples necessary s Ωnm where m [ log n ] References J Acharya, H Das, A Jafarpour, A Orlsky, and S Pan Compeve closeness esng JMLR - Proceedngs Track, 9:7 68, 0 J Acharya, H Das, A Jafarpour, A Orlsky, S Pan, and A T Suresh Compeve classfcaon and closeness esng JMLR - Proceedngs Track, 3: 8, 0 M Adamaszek, A Czumaj, and C Sohler Tesng monoone connuous dsrbuons on hgh-dmensonal real cubes In SODA, pages 56 65, 00

9 Jayadev Acharya, Ashkan Jafarpour, Alon Orlsky, Ananda Theerha Suresh T Bau, R Kumar, and R Rubnfeld Sublnear algorhms for esng monoone and unmodal dsrbuons In Proceedngs of he hry-sxh annual ACM symposum on Theory of compung, STOC 0, pages , New York, NY, USA, 00 ACM ISBN C Daskalaks, I Dakonkolas, R A Servedo, G Valan, and P Valan Tesng $k$-modal dsrbuons: Opmal algorhms va reducons CoRR, abs/5659, 0 M Mzenmacher and E Upfal Probably and compung - randomzed algorhms and probablsc analyss Cambrdge Unversy Press, 005 ISBN L Pannsk A concdence-based es for unformy gven very sparsely sampled dscree daa IEEE Transacons on Informaon Theory, 50, 008 R Rubnfeld and R A Servedo Tesng monoone hghdmensonal dsrbuons Random Sruc Algorhms, 3:, January 009 M Woodroofe and J Sun Tesng unformy versus a monoone densy The Annals of Sascs, 7:pp , 999

Solution in semi infinite diffusion couples (error function analysis)

Solution in semi infinite diffusion couples (error function analysis) Soluon n sem nfne dffuson couples (error funcon analyss) Le us consder now he sem nfne dffuson couple of wo blocks wh concenraon of and I means ha, n a A- bnary sysem, s bondng beween wo blocks made of

More information

V.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS

V.Abramov - FURTHER ANALYSIS OF CONFIDENCE INTERVALS FOR LARGE CLIENT/SERVER COMPUTER NETWORKS R&RATA # Vol.) 8, March FURTHER AALYSIS OF COFIDECE ITERVALS FOR LARGE CLIET/SERVER COMPUTER ETWORKS Vyacheslav Abramov School of Mahemacal Scences, Monash Unversy, Buldng 8, Level 4, Clayon Campus, Wellngon

More information

Department of Economics University of Toronto

Department of Economics University of Toronto Deparmen of Economcs Unversy of Torono ECO408F M.A. Economercs Lecure Noes on Heeroskedascy Heeroskedascy o Ths lecure nvolves lookng a modfcaons we need o make o deal wh he regresson model when some of

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 4 CS434a/54a: Paern Recognon Prof. Olga Veksler Lecure 4 Oulne Normal Random Varable Properes Dscrmnan funcons Why Normal Random Varables? Analycally racable Works well when observaon comes form a corruped

More information

CS286.2 Lecture 14: Quantum de Finetti Theorems II

CS286.2 Lecture 14: Quantum de Finetti Theorems II CS286.2 Lecure 14: Quanum de Fne Theorems II Scrbe: Mara Okounkova 1 Saemen of he heorem Recall he las saemen of he quanum de Fne heorem from he prevous lecure. Theorem 1 Quanum de Fne). Le ρ Dens C 2

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 0 Canoncal Transformaons (Chaper 9) Wha We Dd Las Tme Hamlon s Prncple n he Hamlonan formalsm Dervaon was smple δi δ Addonal end-pon consrans pq H( q, p, ) d 0 δ q ( ) δq ( ) δ

More information

TSS = SST + SSE An orthogonal partition of the total SS

TSS = SST + SSE An orthogonal partition of the total SS ANOVA: Topc 4. Orhogonal conrass [ST&D p. 183] H 0 : µ 1 = µ =... = µ H 1 : The mean of a leas one reamen group s dfferen To es hs hypohess, a basc ANOVA allocaes he varaon among reamen means (SST) equally

More information

Graduate Macroeconomics 2 Problem set 5. - Solutions

Graduate Macroeconomics 2 Problem set 5. - Solutions Graduae Macroeconomcs 2 Problem se. - Soluons Queson 1 To answer hs queson we need he frms frs order condons and he equaon ha deermnes he number of frms n equlbrum. The frms frs order condons are: F K

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Lnear Response Theory: The connecon beween QFT and expermens 3.1. Basc conceps and deas Q: ow do we measure he conducvy of a meal? A: we frs nroduce a weak elecrc feld E, and hen measure

More information

Comb Filters. Comb Filters

Comb Filters. Comb Filters The smple flers dscussed so far are characered eher by a sngle passband and/or a sngle sopband There are applcaons where flers wh mulple passbands and sopbands are requred Thecomb fler s an example of

More information

Tight results for Next Fit and Worst Fit with resource augmentation

Tight results for Next Fit and Worst Fit with resource augmentation Tgh resuls for Nex F and Wors F wh resource augmenaon Joan Boyar Leah Epsen Asaf Levn Asrac I s well known ha he wo smple algorhms for he classc n packng prolem, NF and WF oh have an approxmaon rao of

More information

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!") i+1,q - [(!

In the complete model, these slopes are ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL. (! i+1 -! i ) + [(!) i+1,q - [(! ANALYSIS OF VARIANCE FOR THE COMPLETE TWO-WAY MODEL The frs hng o es n wo-way ANOVA: Is here neracon? "No neracon" means: The man effecs model would f. Ths n urn means: In he neracon plo (wh A on he horzonal

More information

Outline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model

Outline. Probabilistic Model Learning. Probabilistic Model Learning. Probabilistic Model for Time-series Data: Hidden Markov Model Probablsc Model for Tme-seres Daa: Hdden Markov Model Hrosh Mamsuka Bonformacs Cener Kyoo Unversy Oulne Three Problems for probablsc models n machne learnng. Compung lkelhood 2. Learnng 3. Parsng (predcon

More information

CHAPTER 10: LINEAR DISCRIMINATION

CHAPTER 10: LINEAR DISCRIMINATION CHAPER : LINEAR DISCRIMINAION Dscrmnan-based Classfcaon 3 In classfcaon h K classes (C,C,, C k ) We defned dscrmnan funcon g j (), j=,,,k hen gven an es eample, e chose (predced) s class label as C f g

More information

( ) () we define the interaction representation by the unitary transformation () = ()

( ) () we define the interaction representation by the unitary transformation () = () Hgher Order Perurbaon Theory Mchael Fowler 3/7/6 The neracon Represenaon Recall ha n he frs par of hs course sequence, we dscussed he chrödnger and Hesenberg represenaons of quanum mechancs here n he chrödnger

More information

Comparison of Differences between Power Means 1

Comparison of Differences between Power Means 1 In. Journal of Mah. Analyss, Vol. 7, 203, no., 5-55 Comparson of Dfferences beween Power Means Chang-An Tan, Guanghua Sh and Fe Zuo College of Mahemacs and Informaon Scence Henan Normal Unversy, 453007,

More information

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany

John Geweke a and Gianni Amisano b a Departments of Economics and Statistics, University of Iowa, USA b European Central Bank, Frankfurt, Germany Herarchcal Markov Normal Mxure models wh Applcaons o Fnancal Asse Reurns Appendx: Proofs of Theorems and Condonal Poseror Dsrbuons John Geweke a and Gann Amsano b a Deparmens of Economcs and Sascs, Unversy

More information

Variants of Pegasos. December 11, 2009

Variants of Pegasos. December 11, 2009 Inroducon Varans of Pegasos SooWoong Ryu bshboy@sanford.edu December, 009 Youngsoo Cho yc344@sanford.edu Developng a new SVM algorhm s ongong research opc. Among many exng SVM algorhms, we wll focus on

More information

Robustness Experiments with Two Variance Components

Robustness Experiments with Two Variance Components Naonal Insue of Sandards and Technology (NIST) Informaon Technology Laboraory (ITL) Sascal Engneerng Dvson (SED) Robusness Expermens wh Two Varance Componens by Ana Ivelsse Avlés avles@ns.gov Conference

More information

Math 128b Project. Jude Yuen

Math 128b Project. Jude Yuen Mah 8b Proec Jude Yuen . Inroducon Le { Z } be a sequence of observed ndependen vecor varables. If he elemens of Z have a on normal dsrbuon hen { Z } has a mean vecor Z and a varancecovarance marx z. Geomercally

More information

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005

Dynamic Team Decision Theory. EECS 558 Project Shrutivandana Sharma and David Shuman December 10, 2005 Dynamc Team Decson Theory EECS 558 Proec Shruvandana Sharma and Davd Shuman December 0, 005 Oulne Inroducon o Team Decson Theory Decomposon of he Dynamc Team Decson Problem Equvalence of Sac and Dynamc

More information

Lecture 6: Learning for Control (Generalised Linear Regression)

Lecture 6: Learning for Control (Generalised Linear Regression) Lecure 6: Learnng for Conrol (Generalsed Lnear Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure 6: RLSC - Prof. Sehu Vjayakumar Lnear Regresson

More information

Volatility Interpolation

Volatility Interpolation Volaly Inerpolaon Prelmnary Verson March 00 Jesper Andreasen and Bran Huge Danse Mares, Copenhagen wan.daddy@danseban.com brno@danseban.com Elecronc copy avalable a: hp://ssrn.com/absrac=69497 Inro Local

More information

GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim

GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS. Youngwoo Ahn and Kitae Kim Korean J. Mah. 19 (2011), No. 3, pp. 263 272 GENERATING CERTAIN QUINTIC IRREDUCIBLE POLYNOMIALS OVER FINITE FIELDS Youngwoo Ahn and Kae Km Absrac. In he paper [1], an explc correspondence beween ceran

More information

Lecture VI Regression

Lecture VI Regression Lecure VI Regresson (Lnear Mehods for Regresson) Conens: Lnear Mehods for Regresson Leas Squares, Gauss Markov heorem Recursve Leas Squares Lecure VI: MLSC - Dr. Sehu Vjayakumar Lnear Regresson Model M

More information

Part II CONTINUOUS TIME STOCHASTIC PROCESSES

Part II CONTINUOUS TIME STOCHASTIC PROCESSES Par II CONTINUOUS TIME STOCHASTIC PROCESSES 4 Chaper 4 For an advanced analyss of he properes of he Wener process, see: Revus D and Yor M: Connuous marngales and Brownan Moon Karazas I and Shreve S E:

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm H ( q, p, ) = q p L( q, q, ) H p = q H q = p H = L Equvalen o Lagrangan formalsm Smpler, bu

More information

On One Analytic Method of. Constructing Program Controls

On One Analytic Method of. Constructing Program Controls Appled Mahemacal Scences, Vol. 9, 05, no. 8, 409-407 HIKARI Ld, www.m-hkar.com hp://dx.do.org/0.988/ams.05.54349 On One Analyc Mehod of Consrucng Program Conrols A. N. Kvko, S. V. Chsyakov and Yu. E. Balyna

More information

Testing a new idea to solve the P = NP problem with mathematical induction

Testing a new idea to solve the P = NP problem with mathematical induction Tesng a new dea o solve he P = NP problem wh mahemacal nducon Bacground P and NP are wo classes (ses) of languages n Compuer Scence An open problem s wheher P = NP Ths paper ess a new dea o compare he

More information

( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model

( t) Outline of program: BGC1: Survival and event history analysis Oslo, March-May Recapitulation. The additive regression model BGC1: Survval and even hsory analyss Oslo, March-May 212 Monday May 7h and Tuesday May 8h The addve regresson model Ørnulf Borgan Deparmen of Mahemacs Unversy of Oslo Oulne of program: Recapulaon Counng

More information

J i-1 i. J i i+1. Numerical integration of the diffusion equation (I) Finite difference method. Spatial Discretization. Internal nodes.

J i-1 i. J i i+1. Numerical integration of the diffusion equation (I) Finite difference method. Spatial Discretization. Internal nodes. umercal negraon of he dffuson equaon (I) Fne dfference mehod. Spaal screaon. Inernal nodes. R L V For hermal conducon le s dscree he spaal doman no small fne spans, =,,: Balance of parcles for an nernal

More information

Online Supplement for Dynamic Multi-Technology. Production-Inventory Problem with Emissions Trading

Online Supplement for Dynamic Multi-Technology. Production-Inventory Problem with Emissions Trading Onlne Supplemen for Dynamc Mul-Technology Producon-Invenory Problem wh Emssons Tradng by We Zhang Zhongsheng Hua Yu Xa and Baofeng Huo Proof of Lemma For any ( qr ) Θ s easy o verfy ha he lnear programmng

More information

Mechanics Physics 151

Mechanics Physics 151 Mechancs Physcs 5 Lecure 9 Hamlonan Equaons of Moon (Chaper 8) Wha We Dd Las Tme Consruced Hamlonan formalsm Hqp (,,) = qp Lqq (,,) H p = q H q = p H L = Equvalen o Lagrangan formalsm Smpler, bu wce as

More information

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System

Survival Analysis and Reliability. A Note on the Mean Residual Life Function of a Parallel System Communcaons n Sascs Theory and Mehods, 34: 475 484, 2005 Copyrgh Taylor & Francs, Inc. ISSN: 0361-0926 prn/1532-415x onlne DOI: 10.1081/STA-200047430 Survval Analyss and Relably A Noe on he Mean Resdual

More information

SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β

SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β SARAJEVO JOURNAL OF MATHEMATICS Vol.3 (15) (2007), 137 143 SOME NOISELESS CODING THEOREMS OF INACCURACY MEASURE OF ORDER α AND TYPE β M. A. K. BAIG AND RAYEES AHMAD DAR Absrac. In hs paper, we propose

More information

ON THE WEAK LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS

ON THE WEAK LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS ON THE WEA LIMITS OF SMOOTH MAPS FOR THE DIRICHLET ENERGY BETWEEN MANIFOLDS FENGBO HANG Absrac. We denfy all he weak sequenal lms of smooh maps n W (M N). In parcular, hs mples a necessary su cen opologcal

More information

F-Tests and Analysis of Variance (ANOVA) in the Simple Linear Regression Model. 1. Introduction

F-Tests and Analysis of Variance (ANOVA) in the Simple Linear Regression Model. 1. Introduction ECOOMICS 35* -- OTE 9 ECO 35* -- OTE 9 F-Tess and Analyss of Varance (AOVA n he Smple Lnear Regresson Model Inroducon The smple lnear regresson model s gven by he followng populaon regresson equaon, or

More information

Chapter 6: AC Circuits

Chapter 6: AC Circuits Chaper 6: AC Crcus Chaper 6: Oulne Phasors and he AC Seady Sae AC Crcus A sable, lnear crcu operang n he seady sae wh snusodal excaon (.e., snusodal seady sae. Complee response forced response naural response.

More information

Density Matrix Description of NMR BCMB/CHEM 8190

Density Matrix Description of NMR BCMB/CHEM 8190 Densy Marx Descrpon of NMR BCMBCHEM 89 Operaors n Marx Noaon Alernae approach o second order specra: ask abou x magnezaon nsead of energes and ranson probables. If we say wh one bass se, properes vary

More information

e-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov

e-journal Reliability: Theory& Applications No 2 (Vol.2) Vyacheslav Abramov June 7 e-ournal Relably: Theory& Applcaons No (Vol. CONFIDENCE INTERVALS ASSOCIATED WITH PERFORMANCE ANALYSIS OF SYMMETRIC LARGE CLOSED CLIENT/SERVER COMPUTER NETWORKS Absrac Vyacheslav Abramov School

More information

January Examinations 2012

January Examinations 2012 Page of 5 EC79 January Examnaons No. of Pages: 5 No. of Quesons: 8 Subjec ECONOMICS (POSTGRADUATE) Tle of Paper EC79 QUANTITATIVE METHODS FOR BUSINESS AND FINANCE Tme Allowed Two Hours ( hours) Insrucons

More information

Epistemic Game Theory: Online Appendix

Epistemic Game Theory: Online Appendix Epsemc Game Theory: Onlne Appendx Edde Dekel Lucano Pomao Marcano Snscalch July 18, 2014 Prelmnares Fx a fne ype srucure T I, S, T, β I and a probably µ S T. Le T µ I, S, T µ, βµ I be a ype srucure ha

More information

Normal Random Variable and its discriminant functions

Normal Random Variable and its discriminant functions Noral Rando Varable and s dscrnan funcons Oulne Noral Rando Varable Properes Dscrnan funcons Why Noral Rando Varables? Analycally racable Works well when observaon coes for a corruped snle prooype 3 The

More information

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas)

Lecture 18: The Laplace Transform (See Sections and 14.7 in Boas) Lecure 8: The Lalace Transform (See Secons 88- and 47 n Boas) Recall ha our bg-cure goal s he analyss of he dfferenal equaon, ax bx cx F, where we emloy varous exansons for he drvng funcon F deendng on

More information

Lecture 2 M/G/1 queues. M/G/1-queue

Lecture 2 M/G/1 queues. M/G/1-queue Lecure M/G/ queues M/G/-queue Posson arrval process Arbrary servce me dsrbuon Sngle server To deermne he sae of he sysem a me, we mus now The number of cusomers n he sysems N() Tme ha he cusomer currenly

More information

FTCS Solution to the Heat Equation

FTCS Solution to the Heat Equation FTCS Soluon o he Hea Equaon ME 448/548 Noes Gerald Reckenwald Porland Sae Unversy Deparmen of Mechancal Engneerng gerry@pdxedu ME 448/548: FTCS Soluon o he Hea Equaon Overvew Use he forward fne d erence

More information

Relative controllability of nonlinear systems with delays in control

Relative controllability of nonlinear systems with delays in control Relave conrollably o nonlnear sysems wh delays n conrol Jerzy Klamka Insue o Conrol Engneerng, Slesan Techncal Unversy, 44- Glwce, Poland. phone/ax : 48 32 37227, {jklamka}@a.polsl.glwce.pl Keywor: Conrollably.

More information

Advanced Machine Learning & Perception

Advanced Machine Learning & Perception Advanced Machne Learnng & Percepon Insrucor: Tony Jebara SVM Feaure & Kernel Selecon SVM Eensons Feaure Selecon (Flerng and Wrappng) SVM Feaure Selecon SVM Kernel Selecon SVM Eensons Classfcaon Feaure/Kernel

More information

UNIVERSITAT AUTÒNOMA DE BARCELONA MARCH 2017 EXAMINATION

UNIVERSITAT AUTÒNOMA DE BARCELONA MARCH 2017 EXAMINATION INTERNATIONAL TRADE T. J. KEHOE UNIVERSITAT AUTÒNOMA DE BARCELONA MARCH 27 EXAMINATION Please answer wo of he hree quesons. You can consul class noes, workng papers, and arcles whle you are workng on he

More information

Time-interval analysis of β decay. V. Horvat and J. C. Hardy

Time-interval analysis of β decay. V. Horvat and J. C. Hardy Tme-nerval analyss of β decay V. Horva and J. C. Hardy Work on he even analyss of β decay [1] connued and resuled n he developmen of a novel mehod of bea-decay me-nerval analyss ha produces hghly accurae

More information

THE PREDICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS

THE PREDICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS THE PREICTION OF COMPETITIVE ENVIRONMENT IN BUSINESS INTROUCTION The wo dmensonal paral dfferenal equaons of second order can be used for he smulaon of compeve envronmen n busness The arcle presens he

More information

Existence and Uniqueness Results for Random Impulsive Integro-Differential Equation

Existence and Uniqueness Results for Random Impulsive Integro-Differential Equation Global Journal of Pure and Appled Mahemacs. ISSN 973-768 Volume 4, Number 6 (8), pp. 89-87 Research Inda Publcaons hp://www.rpublcaon.com Exsence and Unqueness Resuls for Random Impulsve Inegro-Dfferenal

More information

Let s treat the problem of the response of a system to an applied external force. Again,

Let s treat the problem of the response of a system to an applied external force. Again, Page 33 QUANTUM LNEAR RESPONSE FUNCTON Le s rea he problem of he response of a sysem o an appled exernal force. Agan, H() H f () A H + V () Exernal agen acng on nernal varable Hamlonan for equlbrum sysem

More information

Density Matrix Description of NMR BCMB/CHEM 8190

Density Matrix Description of NMR BCMB/CHEM 8190 Densy Marx Descrpon of NMR BCMBCHEM 89 Operaors n Marx Noaon If we say wh one bass se, properes vary only because of changes n he coeffcens weghng each bass se funcon x = h< Ix > - hs s how we calculae

More information

Notes on the stability of dynamic systems and the use of Eigen Values.

Notes on the stability of dynamic systems and the use of Eigen Values. Noes on he sabl of dnamc ssems and he use of Egen Values. Source: Macro II course noes, Dr. Davd Bessler s Tme Seres course noes, zarads (999) Ineremporal Macroeconomcs chaper 4 & Techncal ppend, and Hamlon

More information

Cubic Bezier Homotopy Function for Solving Exponential Equations

Cubic Bezier Homotopy Function for Solving Exponential Equations Penerb Journal of Advanced Research n Compung and Applcaons ISSN (onlne: 46-97 Vol. 4, No.. Pages -8, 6 omoopy Funcon for Solvng Eponenal Equaons S. S. Raml *,,. Mohamad Nor,a, N. S. Saharzan,b and M.

More information

Should Exact Index Numbers have Standard Errors? Theory and Application to Asian Growth

Should Exact Index Numbers have Standard Errors? Theory and Application to Asian Growth Should Exac Index umbers have Sandard Errors? Theory and Applcaon o Asan Growh Rober C. Feensra Marshall B. Rensdorf ovember 003 Proof of Proposon APPEDIX () Frs, we wll derve he convenonal Sao-Vara prce

More information

HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD

HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD Journal of Appled Mahemacs and Compuaonal Mechancs 3, (), 45-5 HEAT CONDUCTION PROBLEM IN A TWO-LAYERED HOLLOW CYLINDER BY USING THE GREEN S FUNCTION METHOD Sansław Kukla, Urszula Sedlecka Insue of Mahemacs,

More information

Attribute Reduction Algorithm Based on Discernibility Matrix with Algebraic Method GAO Jing1,a, Ma Hui1, Han Zhidong2,b

Attribute Reduction Algorithm Based on Discernibility Matrix with Algebraic Method GAO Jing1,a, Ma Hui1, Han Zhidong2,b Inernaonal Indusral Informacs and Compuer Engneerng Conference (IIICEC 05) Arbue educon Algorhm Based on Dscernbly Marx wh Algebrac Mehod GAO Jng,a, Ma Hu, Han Zhdong,b Informaon School, Capal Unversy

More information

Clustering (Bishop ch 9)

Clustering (Bishop ch 9) Cluserng (Bshop ch 9) Reference: Daa Mnng by Margare Dunham (a slde source) 1 Cluserng Cluserng s unsupervsed learnng, here are no class labels Wan o fnd groups of smlar nsances Ofen use a dsance measure

More information

Appendix to Online Clustering with Experts

Appendix to Online Clustering with Experts A Appendx o Onlne Cluserng wh Expers Furher dscusson of expermens. Here we furher dscuss expermenal resuls repored n he paper. Ineresngly, we observe ha OCE (and n parcular Learn- ) racks he bes exper

More information

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5

[ ] 2. [ ]3 + (Δx i + Δx i 1 ) / 2. Δx i-1 Δx i Δx i+1. TPG4160 Reservoir Simulation 2018 Lecture note 3. page 1 of 5 TPG460 Reservor Smulaon 08 page of 5 DISCRETIZATIO OF THE FOW EQUATIOS As we already have seen, fne dfference appromaons of he paral dervaves appearng n he flow equaons may be obaned from Taylor seres

More information

Genetic Algorithm in Parameter Estimation of Nonlinear Dynamic Systems

Genetic Algorithm in Parameter Estimation of Nonlinear Dynamic Systems Genec Algorhm n Parameer Esmaon of Nonlnear Dynamc Sysems E. Paeraks manos@egnaa.ee.auh.gr V. Perds perds@vergna.eng.auh.gr Ah. ehagas kehagas@egnaa.ee.auh.gr hp://skron.conrol.ee.auh.gr/kehagas/ndex.hm

More information

( ) [ ] MAP Decision Rule

( ) [ ] MAP Decision Rule Announcemens Bayes Decson Theory wh Normal Dsrbuons HW0 due oday HW o be assgned soon Proec descrpon posed Bomercs CSE 90 Lecure 4 CSE90, Sprng 04 CSE90, Sprng 04 Key Probables 4 ω class label X feaure

More information

FI 3103 Quantum Physics

FI 3103 Quantum Physics /9/4 FI 33 Quanum Physcs Aleander A. Iskandar Physcs of Magnesm and Phooncs Research Grou Insu Teknolog Bandung Basc Conces n Quanum Physcs Probably and Eecaon Value Hesenberg Uncerany Prncle Wave Funcon

More information

Computing Relevance, Similarity: The Vector Space Model

Computing Relevance, Similarity: The Vector Space Model Compung Relevance, Smlary: The Vecor Space Model Based on Larson and Hears s sldes a UC-Bereley hp://.sms.bereley.edu/courses/s0/f00/ aabase Managemen Sysems, R. Ramarshnan ocumen Vecors v ocumens are

More information

Lecture 11 SVM cont

Lecture 11 SVM cont Lecure SVM con. 0 008 Wha we have done so far We have esalshed ha we wan o fnd a lnear decson oundary whose margn s he larges We know how o measure he margn of a lnear decson oundary Tha s: he mnmum geomerc

More information

How about the more general "linear" scalar functions of scalars (i.e., a 1st degree polynomial of the following form with a constant term )?

How about the more general linear scalar functions of scalars (i.e., a 1st degree polynomial of the following form with a constant term )? lmcd Lnear ransformaon of a vecor he deas presened here are que general hey go beyond he radonal mar-vecor ype seen n lnear algebra Furhermore, hey do no deal wh bass and are equally vald for any se of

More information

. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue.

. The geometric multiplicity is dim[ker( λi. number of linearly independent eigenvectors associated with this eigenvalue. Lnear Algebra Lecure # Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons

More information

Bayesian Inference of the GARCH model with Rational Errors

Bayesian Inference of the GARCH model with Rational Errors 0 Inernaonal Conference on Economcs, Busness and Markeng Managemen IPEDR vol.9 (0) (0) IACSIT Press, Sngapore Bayesan Inference of he GARCH model wh Raonal Errors Tesuya Takash + and Tng Tng Chen Hroshma

More information

Bundling with Customer Self-Selection: A Simple Approach to Bundling Low Marginal Cost Goods On-Line Appendix

Bundling with Customer Self-Selection: A Simple Approach to Bundling Low Marginal Cost Goods On-Line Appendix Bundlng wh Cusomer Self-Selecon: A Smple Approach o Bundlng Low Margnal Cos Goods On-Lne Appendx Lorn M. H Unversy of Pennsylvana, Wharon School 57 Jon M. Hunsman Hall Phladelpha, PA 94 lh@wharon.upenn.edu

More information

10. A.C CIRCUITS. Theoretically current grows to maximum value after infinite time. But practically it grows to maximum after 5τ. Decay of current :

10. A.C CIRCUITS. Theoretically current grows to maximum value after infinite time. But practically it grows to maximum after 5τ. Decay of current : . A. IUITS Synopss : GOWTH OF UNT IN IUIT : d. When swch S s closed a =; = d. A me, curren = e 3. The consan / has dmensons of me and s called he nducve me consan ( τ ) of he crcu. 4. = τ; =.63, n one

More information

Econ107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6)

Econ107 Applied Econometrics Topic 5: Specification: Choosing Independent Variables (Studenmund, Chapter 6) Econ7 Appled Economercs Topc 5: Specfcaon: Choosng Independen Varables (Sudenmund, Chaper 6 Specfcaon errors ha we wll deal wh: wrong ndependen varable; wrong funconal form. Ths lecure deals wh wrong ndependen

More information

Track Properities of Normal Chain

Track Properities of Normal Chain In. J. Conemp. Mah. Scences, Vol. 8, 213, no. 4, 163-171 HIKARI Ld, www.m-har.com rac Propes of Normal Chan L Chen School of Mahemacs and Sascs, Zhengzhou Normal Unversy Zhengzhou Cy, Hennan Provnce, 4544,

More information

Performance Analysis for a Network having Standby Redundant Unit with Waiting in Repair

Performance Analysis for a Network having Standby Redundant Unit with Waiting in Repair TECHNI Inernaonal Journal of Compung Scence Communcaon Technologes VOL.5 NO. July 22 (ISSN 974-3375 erformance nalyss for a Nework havng Sby edundan Un wh ang n epar Jendra Sngh 2 abns orwal 2 Deparmen

More information

Robust and Accurate Cancer Classification with Gene Expression Profiling

Robust and Accurate Cancer Classification with Gene Expression Profiling Robus and Accurae Cancer Classfcaon wh Gene Expresson Proflng (Compuaonal ysems Bology, 2005) Auhor: Hafeng L, Keshu Zhang, ao Jang Oulne Background LDA (lnear dscrmnan analyss) and small sample sze problem

More information

WiH Wei He

WiH Wei He Sysem Idenfcaon of onlnear Sae-Space Space Baery odels WH We He wehe@calce.umd.edu Advsor: Dr. Chaochao Chen Deparmen of echancal Engneerng Unversy of aryland, College Par 1 Unversy of aryland Bacground

More information

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC

CH.3. COMPATIBILITY EQUATIONS. Continuum Mechanics Course (MMC) - ETSECCPB - UPC CH.3. COMPATIBILITY EQUATIONS Connuum Mechancs Course (MMC) - ETSECCPB - UPC Overvew Compably Condons Compably Equaons of a Poenal Vecor Feld Compably Condons for Infnesmal Srans Inegraon of he Infnesmal

More information

Chapter 6 DETECTION AND ESTIMATION: Model of digital communication system. Fundamental issues in digital communications are

Chapter 6 DETECTION AND ESTIMATION: Model of digital communication system. Fundamental issues in digital communications are Chaper 6 DEECIO AD EIMAIO: Fundamenal ssues n dgal communcaons are. Deecon and. Esmaon Deecon heory: I deals wh he desgn and evaluaon of decson makng processor ha observes he receved sgnal and guesses

More information

An introduction to Support Vector Machine

An introduction to Support Vector Machine An nroducon o Suppor Vecor Machne 報告者 : 黃立德 References: Smon Haykn, "Neural Neworks: a comprehensve foundaon, second edon, 999, Chaper 2,6 Nello Chrsann, John Shawe-Tayer, An Inroducon o Suppor Vecor Machnes,

More information

New M-Estimator Objective Function. in Simultaneous Equations Model. (A Comparative Study)

New M-Estimator Objective Function. in Simultaneous Equations Model. (A Comparative Study) Inernaonal Mahemacal Forum, Vol. 8, 3, no., 7 - HIKARI Ld, www.m-hkar.com hp://dx.do.org/.988/mf.3.3488 New M-Esmaor Objecve Funcon n Smulaneous Equaons Model (A Comparave Sudy) Ahmed H. Youssef Professor

More information

. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue.

. The geometric multiplicity is dim[ker( λi. A )], i.e. the number of linearly independent eigenvectors associated with this eigenvalue. Mah E-b Lecure #0 Noes We connue wh he dscusson of egenvalues, egenvecors, and dagonalzably of marces We wan o know, n parcular wha condons wll assure ha a marx can be dagonalzed and wha he obsrucons are

More information

Bayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance

Bayes rule for a classification problem INF Discriminant functions for the normal density. Euclidean distance. Mahalanobis distance INF 43 3.. Repeon Anne Solberg (anne@f.uo.no Bayes rule for a classfcaon problem Suppose we have J, =,...J classes. s he class label for a pxel, and x s he observed feaure vecor. We can use Bayes rule

More information

Chapter Lagrangian Interpolation

Chapter Lagrangian Interpolation Chaper 5.4 agrangan Inerpolaon Afer readng hs chaper you should be able o:. dere agrangan mehod of nerpolaon. sole problems usng agrangan mehod of nerpolaon and. use agrangan nerpolans o fnd deraes and

More information

NATIONAL UNIVERSITY OF SINGAPORE PC5202 ADVANCED STATISTICAL MECHANICS. (Semester II: AY ) Time Allowed: 2 Hours

NATIONAL UNIVERSITY OF SINGAPORE PC5202 ADVANCED STATISTICAL MECHANICS. (Semester II: AY ) Time Allowed: 2 Hours NATONAL UNVERSTY OF SNGAPORE PC5 ADVANCED STATSTCAL MECHANCS (Semeser : AY 1-13) Tme Allowed: Hours NSTRUCTONS TO CANDDATES 1. Ths examnaon paper conans 5 quesons and comprses 4 prned pages.. Answer all

More information

A Deza Frankl type theorem for set partitions

A Deza Frankl type theorem for set partitions A Deza Frankl ype heorem for se parons Cheng Yeaw Ku Deparmen of Mahemacs Naonal Unversy of Sngapore Sngapore 117543 makcy@nus.edu.sg Kok Bn Wong Insue of Mahemacal Scences Unversy of Malaya 50603 Kuala

More information

[Link to MIT-Lab 6P.1 goes here.] After completing the lab, fill in the following blanks: Numerical. Simulation s Calculations

[Link to MIT-Lab 6P.1 goes here.] After completing the lab, fill in the following blanks: Numerical. Simulation s Calculations Chaper 6: Ordnary Leas Squares Esmaon Procedure he Properes Chaper 6 Oulne Cln s Assgnmen: Assess he Effec of Sudyng on Quz Scores Revew o Regresson Model o Ordnary Leas Squares () Esmaon Procedure o he

More information

A Novel Efficient Stopping Criterion for BICM-ID System

A Novel Efficient Stopping Criterion for BICM-ID System A Novel Effcen Soppng Creron for BICM-ID Sysem Xao Yng, L Janpng Communcaon Unversy of Chna Absrac Ths paper devses a novel effcen soppng creron for b-nerleaved coded modulaon wh erave decodng (BICM-ID)

More information

THEORETICAL AUTOCORRELATIONS. ) if often denoted by γ. Note that

THEORETICAL AUTOCORRELATIONS. ) if often denoted by γ. Note that THEORETICAL AUTOCORRELATIONS Cov( y, y ) E( y E( y))( y E( y)) ρ = = Var( y) E( y E( y)) =,, L ρ = and Cov( y, y ) s ofen denoed by whle Var( y ) f ofen denoed by γ. Noe ha γ = γ and ρ = ρ and because

More information

Midterm Exam. Thursday, April hour, 15 minutes

Midterm Exam. Thursday, April hour, 15 minutes Economcs of Grow, ECO560 San Francsco Sae Unvers Mcael Bar Sprng 04 Mderm Exam Tursda, prl 0 our, 5 mnues ame: Insrucons. Ts s closed boo, closed noes exam.. o calculaors of an nd are allowed. 3. Sow all

More information

Efficient Asynchronous Channel Hopping Design for Cognitive Radio Networks

Efficient Asynchronous Channel Hopping Design for Cognitive Radio Networks Effcen Asynchronous Channel Hoppng Desgn for Cognve Rado Neworks Chh-Mn Chao, Chen-Yu Hsu, and Yun-ng Lng Absrac In a cognve rado nework (CRN), a necessary condon for nodes o communcae wh each oher s ha

More information

Anomaly Detection. Lecture Notes for Chapter 9. Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar

Anomaly Detection. Lecture Notes for Chapter 9. Introduction to Data Mining, 2 nd Edition by Tan, Steinbach, Karpatne, Kumar Anomaly eecon Lecure Noes for Chaper 9 Inroducon o aa Mnng, 2 nd Edon by Tan, Senbach, Karpane, Kumar 2/14/18 Inroducon o aa Mnng, 2nd Edon 1 Anomaly/Ouler eecon Wha are anomales/oulers? The se of daa

More information

Ordinary Differential Equations in Neuroscience with Matlab examples. Aim 1- Gain understanding of how to set up and solve ODE s

Ordinary Differential Equations in Neuroscience with Matlab examples. Aim 1- Gain understanding of how to set up and solve ODE s Ordnary Dfferenal Equaons n Neuroscence wh Malab eamples. Am - Gan undersandng of how o se up and solve ODE s Am Undersand how o se up an solve a smple eample of he Hebb rule n D Our goal a end of class

More information

2. SPATIALLY LAGGED DEPENDENT VARIABLES

2. SPATIALLY LAGGED DEPENDENT VARIABLES 2. SPATIALLY LAGGED DEPENDENT VARIABLES In hs chaper, we descrbe a sascal model ha ncorporaes spaal dependence explcly by addng a spaally lagged dependen varable y on he rgh-hand sde of he regresson equaon.

More information

Scattering at an Interface: Oblique Incidence

Scattering at an Interface: Oblique Incidence Course Insrucor Dr. Raymond C. Rumpf Offce: A 337 Phone: (915) 747 6958 E Mal: rcrumpf@uep.edu EE 4347 Appled Elecromagnecs Topc 3g Scaerng a an Inerface: Oblque Incdence Scaerng These Oblque noes may

More information

Including the ordinary differential of distance with time as velocity makes a system of ordinary differential equations.

Including the ordinary differential of distance with time as velocity makes a system of ordinary differential equations. Soluons o Ordnary Derenal Equaons An ordnary derenal equaon has only one ndependen varable. A sysem o ordnary derenal equaons consss o several derenal equaons each wh he same ndependen varable. An eample

More information

CHAPTER 2: Supervised Learning

CHAPTER 2: Supervised Learning HATER 2: Supervsed Learnng Learnng a lass from Eamples lass of a famly car redcon: Is car a famly car? Knowledge eracon: Wha do people epec from a famly car? Oupu: osve (+) and negave ( ) eamples Inpu

More information

Introduction ( Week 1-2) Course introduction A brief introduction to molecular biology A brief introduction to sequence comparison Part I: Algorithms

Introduction ( Week 1-2) Course introduction A brief introduction to molecular biology A brief introduction to sequence comparison Part I: Algorithms Course organzaon Inroducon Wee -2) Course nroducon A bref nroducon o molecular bology A bref nroducon o sequence comparson Par I: Algorhms for Sequence Analyss Wee 3-8) Chaper -3, Models and heores» Probably

More information

2/20/2013. EE 101 Midterm 2 Review

2/20/2013. EE 101 Midterm 2 Review //3 EE Mderm eew //3 Volage-mplfer Model The npu ressance s he equalen ressance see when lookng no he npu ermnals of he amplfer. o s he oupu ressance. I causes he oupu olage o decrease as he load ressance

More information

Advanced Macroeconomics II: Exchange economy

Advanced Macroeconomics II: Exchange economy Advanced Macroeconomcs II: Exchange economy Krzyszof Makarsk 1 Smple deermnsc dynamc model. 1.1 Inroducon Inroducon Smple deermnsc dynamc model. Defnons of equlbrum: Arrow-Debreu Sequenal Recursve Equvalence

More information