Probability is common sense reduced to calculation. Laplace

Size: px
Start display at page:

Download "Probability is common sense reduced to calculation. Laplace"

Transcription

1 Probablty s commo sese reduced to calculato. Laplace Our ma objectve ths lesso s to develop the art of descrbg ucertaty terms of probablstc models, as well as the skll of probablstc reasog (ferece). The models we cosder assg probabltes to collectos (sets) of possble outcomes. For ths reaso, we beg wth a short revew of set theory.

2 SET THEORY A set s collecto of objects called elemets. C A x : x A Complemet A B x : x A or x B Uo A B AB x : x A ad x B Itersecto A B AB A C C A A B B A ad A B B A A B C A B C A B C A B C A B C A B A C A B C A B AC C C C C A B A B C C C A B A B S A A Mutually Exclusve or Dsjot Double Complemet Commutatve Propertes Assocatve Propertes Dstrbutve Propertes De Morga's Law

3 SET THEORY Cosder uversal set S ad ts subsets A1, A2,, A. f A A, k j for all k ad j ad k k1 A j k S the t s sad that A1, A2,, A are mutually exclusve ad collectvely exhaustve. S A B S A B S A B C C C Mutually Exclusve Collectvely Exhaustve A1, A2,, A also form a partto of the uversal set S. Mutually Exclusve ad Collectvely Exhaustve

4 Fudametals of Probablty: Probablstc Models Probablty Law Radom Expermet Evet A Evet B P A P B Sample Sapce or S (Set of Outcomes) Radom Expermet: Expermet whose result s ucerta before t s performed. Tral: Sgle performace of a radom expermet. Outcome: Result of a tral. Sample Space S: The set of all possble outcomes of a radom expermet. Evet: Subset of the sample space S (to whch a probablty ca be assged). A collecto of possble outcomes. Sure Evet: Sample space S (a evet for sure to occur) Impossble Evet: Empty set (a evet mpossble to occur). A B Evets

5 Fudametals of Probablty: Probablstc Models Example: Dscrete Sample Space Sgle roll of a de. Dscrete Sample Space: S 1,2,3,4,5,6 Some Evets: A a odd umber shows up 1,3,5 A A A A A A A a umber less tha 3 shows up 1,2 a eve umber shows up 2,4,6 2 shows up 2, (sgle outcome) 2 or 4 show up 2,4 2 ad 4 show up a umber greater tha 6 shows up, (o outcome) a umber from 1 to 6 shows up 1,2,3,4,5,6 S, (all outcomes)

6 Fudametals of Probablty: Probablstc Models Example: Cotuous Sample Space Rado Recever 5V 5V st Output of the rado recever s measured at tme t t. 1 S s : 5 s 5 Cotuous sample space has fte umber of outcomes A s: 2.5 s 2.5 A s: 1 s1 A s: s 2.3

7 Fudametals of Probablty: Probablstc Models Example: Cotuous to Dscrete Sample Space Rado Recever 5V 5V st 8-bt ADC s There wll be oly outcomes at the output of the 8-Bt ADC. S 5, 4, ,, 0, ,0,0, ,, 4, or S= 128, 127,, 1,0,1,,127 Dscrete sample space ca have ftely or ftely may elemets

8 Fudametals of Probablty: Probablstc Models Example: 2D Sample Space Rollg a de two tmes. S, j : 1,1, 1,2, 1,3,, 4,3,, 6,4, 6,5, 6,

9 Secod Roll Fudametals of Probablty: Probablstc Models Tree Based Sequetal Descrpto: Sample Space Par of Rolls Sequetal Tree Descrpto Root 1 2 1,1 1,2 1,3 1,4 1,5 1,6 Leaves Frst Roll

10 Fudametals of Probablty: Probablstc Models Probablty Laws: Itutvely, probablty law specfes the lkelhood of ay outcome, or of ay set of possble outcomes (a evet). The probablty law assgs to every evet A, a umber P A, called probablty of A, satsfyg the followg axoms. Axoms of Probablty: 1) Noegatvty: P A 0 for every evet A. 2) Addtvty: If A ad B are two dsjot evets, the the probablty of ther uo satsfes P A B P A PB Furthermore, f A1, A 2, s a sequece of dsjot evets, the the probablty of uo satsfes, P A A P A P A ) Normalzato: The probablty of the etre sample space S s equal to 1. PS 1

11 Fudametals of Probablty: Probablstc Models Example: Sgle Co Toss. H, T, possble evets: S H, T, H, T, If the co s far,.e. we beleve that heads ad tals are equally lkely, the we assg equal probabltes to the two possble outcomes. P H P T 0.5 Addtvty axom mples that P H, T P H P T 1 whch s cosstet wth the ormalzato axom. Noegatvty axom s also satsfes P "Ay Evet" 0

12 Fudametals of Probablty: Probablstc Models Dscrete Probablty Law: If the sample space cossts of a fte umber of possble outcomes, the the probablty law s specfed by the probabltes of evets that cossts of a sgle elemet. I partcular the probablty of ay evet s1,s 2,, s s the sum of the probabltes of ts elemets P s1,s 2,, s P s1 P s2 P s Uform Probablty Law: If the sample space cossts of possble outcomes whch are equally lkely (.e. all sgle-elemet evets have the same probablty), the the probablty of ay evet A s gve by Number of elemets of A P A

13 Secod Roll Fudametals of Probablty: Probablstc Models Example: Cosder the expermet of rollg a par of far dce. Far dce assumpto meas that each of the 36 possble outcomes has the same probablty 1/36. S, j : 1,1, 1,2, 1,3,, 4,3,, 6,4, 6,5, 6, Sample Space Par of Rolls Frst Roll P P P P the sum of the rolls s eve the sum of the rolls s odd the frst roll s larger tha the secod roll at least oe roll s equal to

14 Fudametals of Probablty: Probablstc Models Example: A wheel of fortue s cotuously calbrated from 0 to 1, so the possble outcomes of a expermet cosstg of a sgle sp are the umbers the terval 0,1. Assumg a far wheel, t s approprate to cosder all outcomes equally lkely, but what s the probablty of the evet cosstg of a sgle elemet? Aswer: It caot be postve, because the, usg the addtvty axom, t would follow that evets wth a suffcetly large umber of elemets would have probablty larger tha 1. Therefore, the probablty of ay evet that cossts of a sgle elemet must be 0. What s the probablty of ay subterval ab?, t makes sese to assg probablty b a to ay subterval abof, 0,1, ad to calculate the probablty of a more complcated set by evaluatg ts legth. Ths assgmet satsfes the three probablty axoms ad qualfes as a legtmate probablty law. P Legth of Iterested Iterval b a a, b Cotuous Uform Law Legth of Sample Space 1

15 Fudametals of Probablty: Probablstc Models Example: Romeo ad Julet have a date at a gve tme, ad each wll arrve at the meetg place wth a delay betwee 0 ad 1 hour, wth all pars of delays beg equally lkely. The frst to arrve wll wat for 15 mutes ad wll leave f the other has ot yet arrved. What s the probablty that they wll meet? 0,1 0,1 S whose elemets are possble pars of delays. y 1 14 M 14 1 x 7 M x, y x y 1 4,0 x 1,0 y 1, PM 16

16 Fudametals of Probablty: Probablstc Models Propertes of Probablty Laws: 1) If A B, the P A P B 2) P A B P A P B P A B 3) P A B P A P B C C C 4) P A B C P A P A B P A B C Proof of these propertes ca be obtaed aalytcally or by usg Ve dagrams. Proof s also gve the text book.

17 Codtoal Probablty Codtoal probablty provdes us wth a way to reaso about outcome of a expermet, based o partal formato. o I a expermet volvg two successve rolls of a de, you are told that the sum of the two roll s 9. How lkely s that the frst roll was 6? o I a word guessg game, the frst letter of the word s a t. What s the lkelhood that the secod letter s a h? o How lkely s t that a perso has a dsease gve that a medcal test was egatve? o A spot shows up o a radar scree. How lkely s t correspodg to a arcraft? Defto: The probablty of a evet A uder the codto that evet B has occurred s called codtoal probablty of A gve B. def P A B P A B, PB 0 P B

18 Codtoal Probablty Iterpretato of codtoal probablty: Assume that A s a evet defed uder the sample space S. We kow that A S A ad PS 1, the P A S P A P A S P A P S 1 Therefore, ths result dcates that codtoal probablty of A gve B s smply the probablty of A assumg the etre sample space s B, whch s reasoable sce the evet B has occurred (whch meas that occurrece of ay outcome outsde of B s mpossble). S A B A B

19 Codtoal Probablty Example: We toss a far co three successve tmes. The evets A ad B are defed as follow: A= {more heads tha tals come up}, B= {frst toss s a head} P A B. Fd the codtoal probablty S HHH,HHT,HTH,THH,TTH,THT,HTT,TTT A HHH, HHT, HTH, THH P A B HHH, HHT, HTH, HTT P B AB HHH, HHT, HTH P AB 3 8 P A B P A B P B 4 8 4

20 Codtoal Probablty Example: Cosder rollg a de. Let A= {umber 1 shows up}, B= {a odd umber shows up}, C= {umber 1 or 2 shows up} S 1,2,3,4,5,6 P A B P A B P A P B P B P C B A P C B P A P B P B P B C P B C PC 2 6 2

21 Codtoal Probablty Example: Let t be the age of a perso whe he/she des. The probablty that he/she des at a age ot older tha t0 0 0 P t t t dt t 0 s gve by where t s a fucto determed from mortalty records ad gve by t 2 0, otherwse t 100 t, 0 t 100 years

22 Codtoal Probablty Example: (Cotug) a) What s the probablty that a perso wll de betwee the ages 60 ad 70? P 60 t 70 # of people who de betwee 60 ad 70 total populato t dt t dt t dt b) What s the probablty that a perso wll de betwee the ages 60 ad 70 assumg that hs/her curret age s 60? # of people who de betwee 60 ad 70 P60 t 70 t 60 total populatoof age older tha t P60 t 70t 60 tdt Pt 60 t dt 60

23 Codtoal Probablty Example: (Cotug) c) What s the probablty that a perso wll de betwee the ages 20 ad 50 assumg that hs/her curret age s 60? P 20 t 50 t 60 # of people who de betwee 20 ad 50 total populatoof age older tha Pt P t t P 60 P t 60 0

24 Codtoal Probablty Example: Radar Detecto If a arcraft s preset a certa area, a radar detects t ad geerate ad alarm sgal wth probablty If a arcraft s ot preset, the radar geerates a (false) alarm, wth probablty We assume that a arcraft s preset wth probablty What s the probablty of o arcraft presece ad a false alarm? What s the probablty of arcraft presece ad o detecto? Let A ad B be two evets defed as A A C a arcraft s preset, Bthe radar geerates a alarm C a arcraft s ot preset, B the radar does ot geerate a alarm C C C C C P Not Preset, False Alarm P A B P A P B A P Preset, No Detecto P A B P A P B A

25 Codtoal Probablty Example: Radar Detecto Arcraft Preset P A 0.05 C 0.95 P A Arcraft ot Preset PB A0.99 C P B A 0.01 P B C A 0.10 C C P B A 0.90 Mssed Detecto False Alarm

26 Codtoal Probablty Multplcato Rule P A P A P A A P A A A P A A Verfcato of the multplcato rule: Multplcato rule ca be verfed by usg the defto of the codtoal probablty as follow: 1 P A P A P A2 A1 P A1 A2 A3 P P A P A A P A A 1 1 P A P A P A A 2 1 P A 1 P A A A P A A 2 1 P P A A

27 Codtoal Probablty Example: Three cards are draw from a ordary 52-card deck wthout replacemet (draw cards are ot placed back the deck). We wsh to fd the probablty that oe of the three cards s a heart. We assume that at each step, each oe of the remag cards s equally lkely to be pcked. By symmetry, ths mples that every trplet of cards s equally lkely to be draw. Not a Heart Not a Heart Not a Heart Heart Heart the th card s ot a heart, 1,2,3 P A1 A2 A3 A We wat to calculate P A A A P A P A A P A A A P A1, P A2 A1, P A3 A1 A P A1 A2 A3 P A1 P A2 A1 P A3 A1 A Heart 13 52

28 Total Probablty Theorem ad Bayes Rule Total Probablty Theorem: Let A1, A2,, A be dsjot evets that forms a partto of the sample space, ad assume P A for all 1,,. The for ay evet B, we have that P A PB A P A PB A P A PB A P B P A B P A B P A B A 1 A AB 1 AB 2 AB A 2 B

29 Total Probablty Theorem ad Bayes Rule Example: You eter a chess touramet where your probablty of wg a game s 0.3 agast half the players (call them type 1), 0.4 agast a quarter of the players (call them type 2), ad 0.5 agast the remag quarter of the players (call them type 3). You play a game agast a radomly chose oppoet. What s the probablty of wg? Let A be the evet of playg wth a oppoet of type. We have P A 0.5, P A 0.25, P A Let also B be the evet of wg. We have P B A 0.3, P B A 0.4, P B A P B P A P B A P A P B A P A P B A

30 Total Probablty Theorem ad Bayes Rule Bayes Rule: Let A1, A2,, A be dsjot evets that forms a partto of the sample space, ad assume P A for all 1,,. The for ay evet B such that PB 0, we have that 0 P A P A B PB P A PB A P A1 PB A1 P A2 PB A2 P A PB A P A PB A P A P B A 1 P A P B A : a pror probablty of evet Probablty of evet A wthout kowg evet B has occurred. P A B : a posteror probablty of A Probablty of evet A kowg evet B has occurred. A

31 Total Probablty Theorem ad Bayes Rule Example: Radar Detecto Let us retur to radar detecto problem. Let A a arcraft s preset, B the radar geerates a alarm C a arcraft s ot preset, B the radar does ot geerate a alarm C A We are gve that C P A 0.05, P B A 0.99, P B A 0.10 Applyg Bayes rule wth A1 A ad A2 A P arcraft preset alarm P A B C PB P A PB A P A P B A C C P A P B A P A P B A

32 Total Probablty Theorem ad Bayes Rule R from Example: A box s cotag 11 resstors. The probablty of selectg th resstor the box s gve the table below. A resstor s selected from the box ad measured ts value by usg a multmeter whch has a measuremet characterstcs gve Fg 1. R P R Fgure 1: Measuremet Characterstcs of the Multmeter What s the probablty of the selected resstor beg 1300 gve that the measured value of the resstor s 1600? P(B R) What s the probablty of the selected resstor beg 1300 gve that the measured value of the resstor s 1300? R-150 R-100 R-50 R R+50 R+100 R+150 R+200 R+250 R+300 R+350 B (Ohm) Fgure 1

33 Total Probablty Theorem ad Bayes Rule Example: (Cotug) R 8 :'Selected resstor s 1300 ', B :'Measured value of the resstor s 1600 ' By usg Bayes rule, PR8 PB R8 PR8 PB R8 PR8 B 11 PB P R P B R 8 11 P B P R P B R P R 1 8 PB R8 PB P R B

34 Total Probablty Theorem ad Bayes Rule Example: (Cotug) R :'Selected resstor s 1300 ', B :'Measured value of the resstor s 1300 ' P B P R P B R P R PB R8 PB P R B Moreover, assume that the measured value of the resstor s 1600, ad let us fd the P R B, 1,,11. probabltes

35 7 PB PB PB 7 PB R7 PB 8 PB R8 PB 9 PB R9 PB 10 PB R10 PB 11 PB R11 PB PB PB PB P R1 P B R P R2 P B R PR1 B 0, PR2 B P R3 P B R P R4 P B R PR3 B 0, PR4 B P R5 P B R P R6 P B R PR5 B 0, PR6 B P R P R B P R P R B P R PR9 B P R B P R P R P R B B P R

36 Idepedece of Evets If kowledge of occurrece of a evet B does ot alter the probablty of some other evet A, the t would be atural to say that evet A s depedet of evet B. I terms of probabltes ths stuato occurs whe P A B P A P A B, PB 0 PB We wll defe two evets A ad B to be depedet f P AB P APB Ths result mples that P A B P A ad PB A PB The evets A1, A2,, A are sad to be depedet f 1 1 P A P A

37 Idepedece of Evets Example: Cosder a expermet volvg two successve rolls of a 4-sded de whch all 16 possble outcomes are equally lkely ad have probablty 1/16. a) Are the evets A 1st roll s a 1, B sum of the two rolls s a 5 depedet? 1 P A B Pthe result of the two roll s 1, 4 16 # of elemets of A 4 P A total umber of possble outcomes 16 # of elemets of B 4 PB total umber of possble outcomes 16 P AB P APB ad the evet A ad B are depedet.

38 Idepedece of Evets Example: (Cotug) b) Are the evets maxmum of the two roll s 2, B mmum of the two rolls s a 2 A 1 P A B Pthe result of the two roll s 2,2 16 # of elemets of A 3 P A A 1,2, 2,1, 2,2 total umber of possble outcomes 16 # of elemets of B 5 P B B 2,2, 3,2, 2,3, 4,2, 2,4 total umber of possble outcomes 16 P AB P A P B ad the evet A ad B are ot depedet.

39 Idepedece of Evets Example: Two umbers x ad y are selected at radom betwee zero ad oe. Let the evets B, D ad F are defed as follows: B y 1 2, D x 1 2, F x 1 2 ad y 1 2 x 1 2 ad y 1 2 y y y 1 1 B 12 D 12 1 F F 1 x 12 1 x 12 1 x The fgure gve above shows that these three evets are parwse depedet. 1 1 PB D PB PD, PB F PB PF PD F PD PF 4

40 Idepedece of Evets Example: (Cotug) However, the three evets are ot depedet sce B D F, so 1 PB D F P 0 PBPDPF 8

41 Idepedece of Evets Codtoal Idepedece: Gve a evet C, the evets A ad B are called codtoally depedet f P A B C P A C P B C If A ad B are codtoally depedet, the the defto of the codtoal probablty ad the multplcato rule yeld P A B C P A B C PC Assumg that PC PB C P A B C PC PB C P A B C P B C s ozero, P A B C P A C. I words, ths relato states that f C s kow to have occurred, the addtoal kowledge that B has also occurred does ot chage the probablty of A.

42 Idepedece of Evets Example: Cosder two depedet far co tosses, whch all four possble outcomes are equally lkely. Let H D H the two tosses have dfferet results 1st toss s a head, 2d toss s a head, 1 2 The evets H 1 ad H 2 are ucodtoally depedet. But So that 1 1 PH1 D, PH2 D, PH1 H2 D P H H D P H D P H D ad H 1, H 2 are ot codtoally depedet.

43 Idepedet Trals ad Bomal Probabltes Idepedet Trals: If a expermet volves a sequece of depedet but detcal stages, the each stage s called depedet tral. Beroull Trals: I partcular, f each stage of a depedet trals has oly two possble results, the the sequece of these depedet trals s called depedet Beroull trals. Example: Cosder a expermet that cossts of depedet tosses of a based co, whch probablty of heads s p ad probablty of tals s 1 p. I ths expermet, depedece meas that the evets A1, A2,, A are depedet where A th toss s a head Ths expermet ca be vsualzed for 3 by usg tree-based sequetal descrpto as follows:

44 Idepedet Trals ad Bomal Probabltes Example: (Cotug) p H p 1 p HH HT p 1 p p 1 p 3 HHH P HHH p 2 1 HHT P HHT p p 2 1 HTH P HTH p p 1 2 HTT P HTT p p 1 p T p 1 p TH TT p 1 p p 1 p 2 1 THH P THH p p 1 2 THT P THT p p 1 2 TTH P TTH p p 1 3 TTT P TTT p

45 Idepedet Trals ad Bomal Probabltes Bomal Probabltes: I ths example, ay partcular outcome (3-log sequece of heads ad tals) that volves k heads ad 3 k tals has probablty: k " heads a partcular 3 log sequece" 1 3 P k p p Ths formula ca be exteded to the case of geeral tosses. I ths case, the probablty of ay partcular log sequece that cotas k heads ad k tals s Cosder the probablty k " heads a partcular log sequece" 1 P k p p " heads a toss sequece" p k P k k k

46 Idepedet Trals ad Bomal Probabltes Bomal Probabltes: " heads a toss sequece" p k P k The probablty gve above cosders the all possble log sequeces that cotas k heads. Therefore, the probablty pk ca be calculated by summg the probabltes of all dstct toss sequeces that cotas k heads, sce the dstct toss sequeces are mutually exclusve. k k pk p 1 p Bomal Probablty Law k : umber of dstct toss sequeces cota k heads. k k k k k a b a b, a b 1 a b 1 k0 k k0 k Bomal Theorem Normalzato

47 Idepedet Trals ad Bomal Probabltes Bomal Probabltes: The umbers k are called choose k. The umbers k are kow as the bomal coeffcets, ad the probabltes kow as the bomal probabltes. pk are!, k k! k! k 0,1,2,, where for ay postve tegers we have! 1 23, 0! 1

48 Idepedet Trals ad Bomal Probabltes Example: A teret servce provder has stalled c modems to serve the eeds of a populato of customers. It s estmated that at a gve tme, each customer wll eed a coecto wth probablty p, depedetly of the others. What s the probablty that there are more customers eedg a coecto tha the umber of modems? It s asked that that the probablty of more tha c customers smultaeously eed a coecto. It s equal to where kc1 p k p k p p k k 1 k

49 Idepedet Trals ad Bomal Probabltes Example: A commucato system trasmts bary formato over a chael that 3 troduces radom bt errors wth probablty 10. The trasmtter sed each formato bt three tmes ad a decoder takes a majorty vote of the receved bts to decde o what the trasmtted bt was. Fd the probablty that the recever wll make a correct decso. The recever ca correct the sgle error, but t wll make the wrog decso f the chael troduces two or more errors. If we vew each trasmsso as a Beroull tral whch a success correspods to the troducto of a error, the the probablty of two or more errors three Beroull trals s 3 3 Pk

50 Coutg Coutg Prcple: The coutg prcple s based o a dvde-ad-coquer approach, whereby the coutg s broke dow to stages through the use of a tree. Cosder a expermet that cossts of two cosecutve stages: The possble results of the frst stage are a1, a2, a m The possble results of the secod stage are b1, b2, b The, the possble results of ths expermet would be all possble ordered pars a, b, 1,, m, j 1,, j Ad the umber of such ordered pars s m. leaves 1 Choces 2 Choces 3 Choces 4 Choces Stage 1 Stage 2 Stage 3 Stage 4

51 Coutg Coutg Prcple: Cosder a process that cossts of r stages. Suppose that: 1 possble results for the frst stage. o There are o For every possble result of the frst stage, there are stage. o More geerally, for all possble results of the frst 1 stages, there are results at the th stage. o The, the total umber of possble results of the r stage process s 1 2 r 2 possble results at the secod possble Example: A telephoe umber s a 7-dgt sequece, but the frst dgt has to be dfferet from 0 or 1. How may dstct telephoe umbers are there?

52 Coutg Example: (Cotug) Ths problem ca be vsualzed as a sequetal process where oe dgt s selected at a tme. Thus, there wll be 7 stages, ad choce of oe out of 10 elemets at each stage. There s a excepto for the frst dgt where there are oly 8 elemet s avalable Example: Cosder a -elemet set s1, s2,, s. How may subsets does t have (cludg tself ad the empty set)? The problem ca be terpreted as examato of oe elemet at a tme ad decde whether to clude t the set or ot. There wll be total of stages, ad a bary choce at each stage tmes

53 Coutg Permutato: Selectg k objects out of the objects wth payg atteto to order of the selecto s called a permutato. k Permutato: Assume that there s dstct object ad we wat to select k of them. How may dfferet ways ca be foud where the order of the selecto matters? The aswer s smple: o Ay of the objects ca be chose to be the frst oe. o After choosg frst oe, there are oly 1 possble choce for the secod oe. o Gve the choce of frst two, there oly remas 2 avalable objects for the thrd selecto, etc. o At the kth selecto, k 1 objects have already bee selected ad there would be k 1 objects avalable for the last selecto. By the Coutg Prcple, the umber of possble sequeces s called k permutatos s 1 k 1 k 21! 1 k 1 k 21 k!

54 Coutg Example: Let us cout the umber of words that cosst of four dstct letters. Ths problem ca be terpreted as the coutg the umber of 4 permutatos of the 26 letters Eglsh alphabet.! 26! ,800 k! 22! 1 classcal musc CDs, 2 rock musc CDs, ad 3 coutry musc Example: You have CDs. I how may dfferet ways ca you arrage them so that the CDs of the same type are cotguous? The problem ca be broke dow two stages: 1) Selectg order of CD types 3! 2) There are! (or!, or 1 2! 3 ) permutatos of the classcal (or rock, or coutry, respectvely) CDs. The desred total umber s 3! 1! 2! 3!.

55 Coutg Combato: Selectg k objects out of the objects wthout payg atteto to order of the selecto s called a combato. 2 permutatos of the letters A, B, C, ad D are AB, AC, AD, BA, BC, BD, CA, CB, CD, DA, DB, DC However, combato of two out four of these letters are AB, AC, AD, BC, BD, CD The umber of possble combatos s gve by! k k! k!

56 Coutg Example: Fd the umber of subsets of a -elemet set by usg combato. Sce k s the umber of k-elemet subsets of the -elemet set, oe ca fd the total umber of subsets by summg k over k. k0 k 2 Parttos ad Multomal Coeffcets: We have dstct objects ad the equalty gve below s hold for sum tegers 1, 2,, r 1 2 r Whch meas that objects are dvded to r dsjot groups where umber of elemets of th group s. How may ways are there to dvde objects to r dsjot groups?

57 Coutg Parttos ad Multomal Coeffcets: Each group ca be form oe at a tme. o There are ways of formg frst group. 1 1 o There are ways of formg secod group, ad so o. 2 o Use the Coutg Prcple r r whch s equal to! 1! 1 r 1!! 1! 1! 2! 1 2! r! 1 r! 1! 2! r! 1, 2,, r Multomal Coeffcets

58 Coutg Example: A class cosstg of 4 graduate ad 12 udergraduate studets s radomly dvded to four groups of 4. What s the probablty that each group cludes a graduate studet? We frst determe the ature of the sample space. A typcal outcome s a partcular way of parttog the 16 studets to four groups of ! N S 4,4,4,4 4!4!4!4! o Number of ways of dstrbutg four graduate studets to the four group s 4! o Number of ways of dstrbutg remag 12 udergraduate studets to the four groups where each group wll have three udergrads ! 3,3,3,3 3!3!3!3! Total umber of elemets of the terested evet ca be obtaed by usg Coutg Prcple 12! N A 4! 3!3!3!3!

59 Coutg Example: (Cotug) The probablty of ths evet s P A N N A S 12! 4! 3!3!3!3! 16! 4!4!4!4!

(b) By independence, the probability that the string 1011 is received correctly is

(b) By independence, the probability that the string 1011 is received correctly is Soluto to Problem 1.31. (a) Let A be the evet that a 0 s trasmtted. Usg the total probablty theorem, the desred probablty s P(A)(1 ɛ ( 0)+ 1 P(A) ) (1 ɛ 1)=p(1 ɛ 0)+(1 p)(1 ɛ 1). (b) By depedece, the probablty

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

1. Overview of basic probability

1. Overview of basic probability 13.42 Desg Prcples for Ocea Vehcles Prof. A.H. Techet Sprg 2005 1. Overvew of basc probablty Emprcally, probablty ca be defed as the umber of favorable outcomes dvded by the total umber of outcomes, other

More information

2. Independence and Bernoulli Trials

2. Independence and Bernoulli Trials . Ideedece ad Beroull Trals Ideedece: Evets ad B are deedet f B B. - It s easy to show that, B deedet mles, B;, B are all deedet ars. For examle, ad so that B or B B B B B φ,.e., ad B are deedet evets.,

More information

Lecture 1. (Part II) The number of ways of partitioning n distinct objects into k distinct groups containing n 1,

Lecture 1. (Part II) The number of ways of partitioning n distinct objects into k distinct groups containing n 1, Lecture (Part II) Materals Covered Ths Lecture: Chapter 2 (2.6 --- 2.0) The umber of ways of parttog dstct obects to dstct groups cotag, 2,, obects, respectvely, where each obect appears exactly oe group

More information

Introduction to Probability

Introduction to Probability Itroducto to Probablty Nader H Bshouty Departmet of Computer Scece Techo 32000 Israel e-mal: bshouty@cstechoacl 1 Combatorcs 11 Smple Rules I Combatorcs The rule of sum says that the umber of ways to choose

More information

1 Onto functions and bijections Applications to Counting

1 Onto functions and bijections Applications to Counting 1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of

More information

Random Variables and Probability Distributions

Random Variables and Probability Distributions Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ  1 STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen.

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen. .5 x 54.5 a. x 7. 786 7 b. The raked observatos are: 7.4, 7.5, 7.7, 7.8, 7.9, 8.0, 8.. Sce the sample sze 7 s odd, the meda s the (+)/ 4 th raked observato, or meda 7.8 c. The cosumer would more lkely

More information

Chapter 9 Jordan Block Matrices

Chapter 9 Jordan Block Matrices Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.

More information

The Occupancy and Coupon Collector problems

The Occupancy and Coupon Collector problems Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where

More information

STA 105-M BASIC STATISTICS (This is a multiple choice paper.)

STA 105-M BASIC STATISTICS (This is a multiple choice paper.) DCDM BUSINESS SCHOOL September Mock Eamatos STA 0-M BASIC STATISTICS (Ths s a multple choce paper.) Tme: hours 0 mutes INSTRUCTIONS TO CANDIDATES Do ot ope ths questo paper utl you have bee told to do

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

Chapter 3 Sampling For Proportions and Percentages

Chapter 3 Sampling For Proportions and Percentages Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

To use adaptive cluster sampling we must first make some definitions of the sampling universe:

To use adaptive cluster sampling we must first make some definitions of the sampling universe: 8.3 ADAPTIVE SAMPLING Most of the methods dscussed samplg theory are lmted to samplg desgs hch the selecto of the samples ca be doe before the survey, so that oe of the decsos about samplg deped ay ay

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos

More information

Mu Sequences/Series Solutions National Convention 2014

Mu Sequences/Series Solutions National Convention 2014 Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed

More information

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015 Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

Chapter 1 Counting Methods

Chapter 1 Counting Methods AlbertLudwgs Uversty Freburg Isttute of Empral Researh ad Eoometrs Dr. Sevtap Kestel Mathematal Statsts - Wter 2008 Chapter Coutg Methods Am s to determe how may dfferet possbltes there are a gve stuato.

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

CS 109 Lecture 12 April 22th, 2016

CS 109 Lecture 12 April 22th, 2016 CS 09 Lecture Aprl th 06 Four rototypcal Traectores Today:. Mult varable RVs. Expectato wth multple RVs 3. Idepedece wth multple RVs Four rototypcal Traectores Revew Dscrete Jot Mass Fucto For two dscrete

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

Pseudo-random Functions

Pseudo-random Functions Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties

F. Inequalities. HKAL Pure Mathematics. 進佳數學團隊 Dr. Herbert Lam 林康榮博士. [Solution] Example Basic properties 進佳數學團隊 Dr. Herbert Lam 林康榮博士 HKAL Pure Mathematcs F. Ieualtes. Basc propertes Theorem Let a, b, c be real umbers. () If a b ad b c, the a c. () If a b ad c 0, the ac bc, but f a b ad c 0, the ac bc. Theorem

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Median as a Weighted Arithmetic Mean of All Sample Observations

Median as a Weighted Arithmetic Mean of All Sample Observations Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of

More information

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018

å 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018 Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of

More information

Statistics: Unlocking the Power of Data Lock 5

Statistics: Unlocking the Power of Data Lock 5 STAT 0 Dr. Kar Lock Morga Exam 2 Grades: I- Class Multple Regresso SECTIONS 9.2, 0., 0.2 Multple explaatory varables (0.) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (0.2) Exam 2 Re- grades Re-

More information

Probability and Statistics. What is probability? What is statistics?

Probability and Statistics. What is probability? What is statistics? robablt ad Statstcs What s robablt? What s statstcs? robablt ad Statstcs robablt Formall defed usg a set of aoms Seeks to determe the lkelhood that a gve evet or observato or measuremet wll or has haeed

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY 3 EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER I STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad

More information

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design Authors: Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud Applcato of Calbrato Approach for Regresso Coeffcet Estmato uder Two-stage Samplg Desg Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

BIOREPS Problem Set #11 The Evolution of DNA Strands

BIOREPS Problem Set #11 The Evolution of DNA Strands BIOREPS Problem Set #11 The Evoluto of DNA Strads 1 Backgroud I the md 2000s, evolutoary bologsts studyg DNA mutato rates brds ad prmates dscovered somethg surprsg. There were a large umber of mutatos

More information

Statistics Descriptive and Inferential Statistics. Instructor: Daisuke Nagakura

Statistics Descriptive and Inferential Statistics. Instructor: Daisuke Nagakura Statstcs Descrptve ad Iferetal Statstcs Istructor: Dasuke Nagakura (agakura@z7.keo.jp) 1 Today s topc Today, I talk about two categores of statstcal aalyses, descrptve statstcs ad feretal statstcs, ad

More information

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a

More information

f f... f 1 n n (ii) Median : It is the value of the middle-most observation(s).

f f... f 1 n n (ii) Median : It is the value of the middle-most observation(s). CHAPTER STATISTICS Pots to Remember :. Facts or fgures, collected wth a defte pupose, are called Data.. Statstcs s the area of study dealg wth the collecto, presetato, aalyss ad terpretato of data.. The

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

Lecture 2 - What are component and system reliability and how it can be improved?

Lecture 2 - What are component and system reliability and how it can be improved? Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected

More information

For combinatorial problems we might need to generate all permutations, combinations, or subsets of a set.

For combinatorial problems we might need to generate all permutations, combinations, or subsets of a set. Addtoal Decrease ad Coquer Algorthms For combatoral problems we mght eed to geerate all permutatos, combatos, or subsets of a set. Geeratg Permutatos If we have a set f elemets: { a 1, a 2, a 3, a } the

More information

18.413: Error Correcting Codes Lab March 2, Lecture 8

18.413: Error Correcting Codes Lab March 2, Lecture 8 18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

CODING & MODULATION Prof. Ing. Anton Čižmár, PhD.

CODING & MODULATION Prof. Ing. Anton Čižmár, PhD. CODING & MODULATION Prof. Ig. Ato Čžmár, PhD. also from Dgtal Commucatos 4th Ed., J. G. Proaks, McGraw-Hll It. Ed. 00 CONTENT. PROBABILITY. STOCHASTIC PROCESSES Probablty ad Stochastc Processes The theory

More information

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data

More information

Exercises for Square-Congruence Modulo n ver 11

Exercises for Square-Congruence Modulo n ver 11 Exercses for Square-Cogruece Modulo ver Let ad ab,.. Mark True or False. a. 3S 30 b. 3S 90 c. 3S 3 d. 3S 4 e. 4S f. 5S g. 0S 55 h. 8S 57. 9S 58 j. S 76 k. 6S 304 l. 47S 5347. Fd the equvalece classes duced

More information

1. BLAST (Karlin Altschul) Statistics

1. BLAST (Karlin Altschul) Statistics Parwse seuece algmet global ad local Multple seuece algmet Substtuto matrces Database searchg global local BLAST Seuece statstcs Evolutoary tree recostructo Gee Fdg Prote structure predcto RNA structure

More information

Outline. Point Pattern Analysis Part I. Revisit IRP/CSR

Outline. Point Pattern Analysis Part I. Revisit IRP/CSR Pot Patter Aalyss Part I Outle Revst IRP/CSR, frst- ad secod order effects What s pot patter aalyss (PPA)? Desty-based pot patter measures Dstace-based pot patter measures Revst IRP/CSR Equal probablty:

More information

ENGI 4421 Propagation of Error Page 8-01

ENGI 4421 Propagation of Error Page 8-01 ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

Lecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have

Lecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have NM 7 Lecture 9 Some Useful Dscrete Dstrbutos Some Useful Dscrete Dstrbutos The observatos geerated by dfferet eermets have the same geeral tye of behavor. Cosequetly, radom varables assocated wth these

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for

More information

Ideal multigrades with trigonometric coefficients

Ideal multigrades with trigonometric coefficients Ideal multgrades wth trgoometrc coeffcets Zarathustra Brady December 13, 010 1 The problem A (, k) multgrade s defed as a par of dstct sets of tegers such that (a 1,..., a ; b 1,..., b ) a j = =1 for all

More information

STATISTICAL INFERENCE

STATISTICAL INFERENCE (STATISTICS) STATISTICAL INFERENCE COMPLEMENTARY COURSE B.Sc. MATHEMATICS III SEMESTER ( Admsso) UNIVERSITY OF CALICUT SCHOOL OF DISTANCE EDUCATION CALICUT UNIVERSITY P.O., MALAPPURAM, KERALA, INDIA -

More information

Investigating Cellular Automata

Investigating Cellular Automata Researcher: Taylor Dupuy Advsor: Aaro Wootto Semester: Fall 4 Ivestgatg Cellular Automata A Overvew of Cellular Automata: Cellular Automata are smple computer programs that geerate rows of black ad whte

More information

A be a probability space. A random vector

A be a probability space. A random vector Statstcs 1: Probablty Theory II 8 1 JOINT AND MARGINAL DISTRIBUTIONS I Probablty Theory I we formulate the cocept of a (real) radom varable ad descrbe the probablstc behavor of ths radom varable by the

More information

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s

More information

L5 Polynomial / Spline Curves

L5 Polynomial / Spline Curves L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a

More information

Algorithms Design & Analysis. Hash Tables

Algorithms Design & Analysis. Hash Tables Algorthms Desg & Aalyss Hash Tables Recap Lower boud Order statstcs 2 Today s topcs Drect-accessble table Hash tables Hash fuctos Uversal hashg Perfect Hashg Ope addressg 3 Symbol-table problem Symbol

More information

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class) Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form

More information

Random Variables. ECE 313 Probability with Engineering Applications Lecture 8 Professor Ravi K. Iyer University of Illinois

Random Variables. ECE 313 Probability with Engineering Applications Lecture 8 Professor Ravi K. Iyer University of Illinois Radom Varables ECE 313 Probablty wth Egeerg Alcatos Lecture 8 Professor Rav K. Iyer Uversty of Illos Iyer - Lecture 8 ECE 313 Fall 013 Today s Tocs Revew o Radom Varables Cumulatve Dstrbuto Fucto (CDF

More information

PTAS for Bin-Packing

PTAS for Bin-Packing CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,

More information

Some Notes on the Probability Space of Statistical Surveys

Some Notes on the Probability Space of Statistical Surveys Metodološk zvezk, Vol. 7, No., 200, 7-2 ome Notes o the Probablty pace of tatstcal urveys George Petrakos Abstract Ths paper troduces a formal presetato of samplg process usg prcples ad cocepts from Probablty

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Likewise, properties of the optimal policy for equipment replacement & maintenance problems can be used to reduce the computation.

Likewise, properties of the optimal policy for equipment replacement & maintenance problems can be used to reduce the computation. Whe solvg a vetory repleshmet problem usg a MDP model, kowg that the optmal polcy s of the form (s,s) ca reduce the computatoal burde. That s, f t s optmal to replesh the vetory whe the vetory level s,

More information

7. Joint Distributions

7. Joint Distributions 7. Jot Dstrbutos Chrs Pech ad Mehra Saham Ma 2017 Ofte ou wll work o problems where there are several radom varables (ofte teractg wth oe aother. We are gog to start to formall look at how those teractos

More information

UNIT 4 SOME OTHER SAMPLING SCHEMES

UNIT 4 SOME OTHER SAMPLING SCHEMES UIT 4 SOE OTHER SAPLIG SCHEES Some Other Samplg Schemes Structure 4. Itroducto Objectves 4. Itroducto to Systematc Samplg 4.3 ethods of Systematc Samplg Lear Systematc Samplg Crcular Systematc Samplg Advatages

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

CHAPTER 3 POSTERIOR DISTRIBUTIONS

CHAPTER 3 POSTERIOR DISTRIBUTIONS CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results

More information

NP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer

NP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer NP!= P By Lu Ra Table of Cotets. Itroduce 2. Prelmary theorem 3. Proof 4. Expla 5. Cocluso. Itroduce The P versus NP problem s a major usolved problem computer scece. Iformally, t asks whether a computer

More information

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67.

1. The weight of six Golden Retrievers is 66, 61, 70, 67, 92 and 66 pounds. The weight of six Labrador Retrievers is 54, 60, 72, 78, 84 and 67. Ecoomcs 3 Itroducto to Ecoometrcs Sprg 004 Professor Dobk Name Studet ID Frst Mdterm Exam You must aswer all the questos. The exam s closed book ad closed otes. You may use your calculators but please

More information

MATH 247/Winter Notes on the adjoint and on normal operators.

MATH 247/Winter Notes on the adjoint and on normal operators. MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say

More information

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems Char for Network Archtectures ad Servces Prof. Carle Departmet of Computer Scece U Müche Aalyss of System Performace IN2072 Chapter 5 Aalyss of No Markov Systems Dr. Alexader Kle Prof. Dr.-Ig. Georg Carle

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those

More information