Chapter 6: BINOMIAL PROBABILITIES
|
|
- Brice Gardner
- 5 years ago
- Views:
Transcription
1 Charles Bocelet, Probability, Statistics, ad Radom Sigals," Oxford Uiversity Press, 016. ISBN: Chater 6: BINOMIAL PROBABILITIES Sectios 6.1 Basics of the Biomial Distributio 6. Comutig Biomial Probabilities 6.3 Momets of the Biomial Distributio 6.4 Sums of Ideedet Biomial Radom Variables 6.5 Distributios Related to the Biomial Coectios Betwee Biomial ad Hyergeometric Probabilities 6.5. Multiomial Probabilities The Negative Biomial Distributio The Poisso Distributio 6.6 Parameter Estimatio for Biomial ad Multiomial Distributios 6.7 Alohaet 6.8 Error Cotrol Codes Reetitio-by-Three Code 6.8. Geeral Liear Block Codes Coclusios Summary Problems Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
2 Basics of the Biomial Distributio The biomial distributio arises from the summatio of Ideedet ad Idetically Distributed (IID) Beroulli R.V. 1, 0,0, 1, 1 The, 1 0. "" As described reviously, the umber of sequeces with exactly k oes i N trials is based o the combiatorial comutatio of the biomial coefficiet. The total summatio (which must equal oe) ca be erformed as From revious examles it was demostrated that 1 1 Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig 018 of 0 ECE 3800
3 Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800 Determie the exected value x P X x X E 0 x x x x x X E 0 1 X E Determie the d momet 0 x P X x X E X E 1 Determie the variace X E X E X E 1 X E X E q X E 1 The iitial roofs for these comutatios were rovided i the otes for Chater 4. Textbook examle. 138: Let = 5 ad = Usig the Biomial_hist.m with some ugradig
4 0.4 Biomial Theory (bar) vs. Simulatio (stem) bmea = bvar = bdmomet = Ad the theoretical ad simulatio robability values are as = Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
5 Additive relatioshi of biomial From the combiatorial aalysis oeratios show i Chater 3. with The icororatio of aother elemet or coi ca be derived from the revious umber of elemets ad the ext beig oe or the other of the ossible trial outcomes. This derivatio ca use coditioal robability for the ext coi Defiig., which ca also be cosidered from the revious trial as but the revious result is ot based o the th result, so that or usig the b otatio 1., 1. 1, 1., This is related to the Matlab homework roblem for formig Pascal s triagle! HW 3.5 % The fast way to a ritout of the biomial coefficiets M = 10; =0.3, q=0.7; row = 1 for k=1:m-1 row = [0 row]* + [row 0]*q ed This ca also be observed i the followig figure. Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
6 6. Comutig Biomial Probabilities Comutig the idividual robabilities., But what about the robability of a articular iterval?., It should be oted that b(,k,) ca be comuted recursively. Therefore, oce the first value of the sum is kow the remaiig ca be quickly comuted. The recursive relatioshi ca be see as.,. 1, 1., 1. 1, 1! 1!!! Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
7 With this ratio., 1. 1, First, this may be easier to comute tha the combiatorial coefficiet comutatios. Secod, otice that the relative magitude (icreasig or decreasig) is also established by this relatioshi. The successive robabilities are icreasig if or ad decreasig if The sequece maximum occurs for Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
8 6.3 Comutig the Momets (a alterative) Determie the exected value Usig a idetity A chage i variable for l=k Determie the variace is erformed usig a alterate aalysis, agai laig to use a idetity. Solvig for Usig a idetity Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE
9 A chage i variable for l=k Fiishig Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
10 6.4 Sums of Ideedet Biomial R.V. The sum of biomial R.V. give equivalet values of is biomial. Basis for N trials which is a sum of the two R.V. trials As the sum of ideedet radom variables, the MGF ca be used but the MGF is For the sum this is equivalet to Which is the desired result for a sigle biomial R.V. with The coditioal robability relatig the two R.V. Give N 1 ad N are Biomial R.V ad the sum is formed N=N 1 +N We ca defie a coditioal robability relatioshi: For But the iitial R.V. are ideededt Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
11 Exadig to show the comlete mf s The coditioal robability is hyer-geometric! Iterretatio: The coditioal is based o there beig k heads i the first N 1 trial set ad m-k heads i the secod N trial set. The rocess is comarig this robability to m heads i N trials overall. Therefore, the equatio is describig ways i which the first two trial coditios could occur as comared to a sigle comosite trial. Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
12 6.5.3 The Negative Biomial Distributio The biomial distributio is based o I ideedet flis, how may heads ca oe exect? The egative biomial distributio is based o to get k heads, how may ideedet flis,, are eeded? To build u to the kth head o the th fli, the k-1 head must have occurred i -1 flis. Therefore, the rior umber is a biomial robability i -1 ad k-1 ad the fial fli is based o, 1 1, 1 1, As a ote, the egative biomial ca be thought of as the sum of k geometric radom variables (where the geometric RV is thought of as a sequece of tails followed by a head ad oe egative biomial is the summatio of k geometric R.V. ) If this relatio holds, the mea ad variace ca be comuted from the mea ad variace of the geometric sequece! Geometric R.V. 1 Sum of IID Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
13 Baseball Examle Examle: I baseball, each iig there are 3 outs, what is the robability there are 3, 4, 5, etc. batters i the iig if they all hit with robability of 0.3? We really wat to talk about outs istead of hits therefore use =1.0.3=0.7. There are three outs, so k=3. Now figure out for =3, 4, 5, etc , What would be the umber of exected batters er iig? For =3:10 Pr = Probability Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
14 6.6 Biomial Estimatio I exerimetal cases whe success ad failure or ositive ad egative results ca occur based o assumed to be ideedet trials, the statistic ca rovide arameters to model (ad simulate) the uderlyig robabilistic exerimets. Biomial equatio estimatio: The mea ad the variace of the biomial, if estimated rovide! 1 For a exerimet with trials, we observe that k successes occurred. Let Uder our assumtio This is a ubiased estimate. The variace of the estimate ca be comuted as As the variace i the estimate goes to zero as icreases, it is also a cosist estimator. Ubiased: the exected value of the estimator equals the value beig estimated. Cosistet: the variace i the estimator goes to zero as goes to ifiity. For may discrete robability models, the estimatio of the mea or mea ad variace rovide all the iformatio required to defie the mf to be used i the model. Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
15 The Poisso Distributio htts://e.wikiedia.org/wiki/poisso_distributio The Poisso distributio ca be used as a aroximatio for the biomial distributio for large ad small. Examles: umber of telehoes i a area code, with the robability they are i use trasmittig large files with the robability of bit errors Makig the aroximatios: For large ad small k, let Cosiderig (1-) For How close is it?!!!!!!!! 1!! Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
16 0.5 Figure 6.5a Biomial Poisso 0.5 Figure 6.5b Biomial Poisso k k See: BFigure6_5.m Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
17 ALOHANET Probabilistic cocets origially develoed i Hawaii htts://e.wikiedia.org/wiki/alohaet The cocet is based o wireless commuicatio usig a star etwork toology. Assume that the cetral ode of a start trasmits ackets that are received by all the etwork members. This commuicatios occurs at oe frequecy while ay resoses from the etwork members occurs at a searate frequecy. I resoses, the etwork member commuicatio could collide with other members. Whe a acket was correctly received a ackowledgemet was set. If o ackowledgemet was received, the members would have to rebroadcast their message. I slotted ALOHA, the trasmissio time eriods are eriodically defied as time slots. Trasmissios ca oly begi i a time slot ad ot at ay radom time. The robability of a collisio could be comuted ad messages were cosidered either successes or failures At low umber of users ad caacity, this is t a great roblem but First: robability of a message beig trasmitted by 0, 1, or more Usig egative rob Usig the Poisso aroximatio for the Biomial! 0 1 For maximum throughut at a sigle user, study the Pr(N=1) curve. Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
18 Selectig the maximum for Assume that we use some value to rereset the successful robability of acket trasmissio ad the egative, failed acket trasmissio If we defie the robable umber of trials util successful acket trasmissio (a geometric R.V.) as with 1 1 This ow defies a average umber of trasmissio attemts before a success. Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
19 6.8 Error Cotrol Codes We ca assume that there is a defied umber of bit error i ay data trasmissio. If we look at a biary stream, we ca assess usig a biomial, the exected umber of bit errors i a bit trasmissio. The bit errors i a bit symbol or eve the bit errors i a b bit ecoded symbol. If the symbol trasmitted has sufficiet redudacy, the origial symbol ca be recovered eve if oe or more bits are i error. The ecodig rocess ca be called Forward Error Correctio. The simlest system is trasmittig 3 or more redudat bits for each bit desired a reetitio by three code. For a three bit ecodig scheme, the received robabilities ca be see as The bit error robabilities for three bit symbols would be Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
20 For a bit-error-rate of So the symbol would be correct rate would become 0 1 ad i error This is early a 333 times imrovemet! Geeral Liear Block Code (LBC) Trile trasmissio is a form of LBC. There are may others that have well defied structures ad erformace. Overall redudat bits are added to the data to allow a outut message with a defied umber of bit errors to be correctly decoded. See: B. Sklar ad F. J. Harris, "The ABCs of liear block codes," i IEEE Sigal Processig Magazie, vol. 1, o. 4, , July 004. htt://ieeexlore.ieee.org/stam/stam.js?t=&arumber= Notes ad figures are based o or take from materials i the course textbook: Charles Bocelet,, Probability, Statistics, ad Radom Sigals, Oxford Uiversity Press, February 016. B.J. Bazui, Srig of 0 ECE 3800
( ) = is larger than. the variance of X V
Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator
More informationCOMPUTING FOURIER SERIES
COMPUTING FOURIER SERIES Overview We have see i revious otes how we ca use the fact that si ad cos rereset comlete orthogoal fuctios over the iterval [-,] to allow us to determie the coefficiets of a Fourier
More informationClassification of DT signals
Comlex exoetial A discrete time sigal may be comlex valued I digital commuicatios comlex sigals arise aturally A comlex sigal may be rereseted i two forms: jarg { z( ) } { } z ( ) = Re { z ( )} + jim {
More informationInformation Theory and Coding
Sol. Iformatio Theory ad Codig. The capacity of a bad-limited additive white Gaussia (AWGN) chael is give by C = Wlog 2 ( + σ 2 W ) bits per secod(bps), where W is the chael badwidth, is the average power
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections
ENGI 441 Discrete Probability Distributios Page 9-01 Discrete Probability Distributios [Navidi sectios 4.1-4.4; Devore sectios 3.4-3.6] Chater 5 itroduced the cocet of robability mass fuctios for discrete
More informationPUTNAM TRAINING PROBABILITY
PUTNAM TRAINING PROBABILITY (Last udated: December, 207) Remark. This is a list of exercises o robability. Miguel A. Lerma Exercises. Prove that the umber of subsets of {, 2,..., } with odd cardiality
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationTHE INTEGRAL TEST AND ESTIMATES OF SUMS
THE INTEGRAL TEST AND ESTIMATES OF SUMS. Itroductio Determiig the exact sum of a series is i geeral ot a easy task. I the case of the geometric series ad the telescoig series it was ossible to fid a simle
More informationTo make comparisons for two populations, consider whether the samples are independent or dependent.
Sociology 54 Testig for differeces betwee two samle meas Cocetually, comarig meas from two differet samles is the same as what we ve doe i oe-samle tests, ecet that ow the hyotheses focus o the arameters
More informationHypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value
Hyothesis estig ME's are oit estimates of arameters/coefficiets really have a distributio Basic Cocet - develo regio i which we accet the hyothesis ad oe where we reject it H - reresets all ossible values
More informationEXPERIMENTING WITH MAPLE TO OBTAIN SUMS OF BESSEL SERIES
EXPERIMENTING WITH MAPLE TO OBTAIN SUMS OF BESSEL SERIES Walter R Bloom Murdoch Uiversity Perth, Wester Australia Email: bloom@murdoch.edu.au Abstract I the study of ulse-width modulatio withi electrical
More informationThe standard deviation of the mean
Physics 6C Fall 20 The stadard deviatio of the mea These otes provide some clarificatio o the distictio betwee the stadard deviatio ad the stadard deviatio of the mea.. The sample mea ad variace Cosider
More informationReliability and Queueing
Copyright 999 Uiversity of Califoria Reliability ad Queueig by David G. Messerschmitt Supplemetary sectio for Uderstadig Networked Applicatios: A First Course, Morga Kaufma, 999. Copyright otice: Permissio
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationLecture 11: A Fourier Transform Primer
PHYS 34 Fall 1 ecture 11: A Fourier Trasform Primer Ro Reifeberger Birck aotechology Ceter Purdue Uiversity ecture 11 1 f() I may edeavors, we ecouter sigals that eriodically reeat f(t) T t Such reeatig
More informationLecture Overview. 2 Permutations and Combinations. n(n 1) (n (k 1)) = n(n 1) (n k + 1) =
COMPSCI 230: Discrete Mathematics for Computer Sciece April 8, 2019 Lecturer: Debmalya Paigrahi Lecture 22 Scribe: Kevi Su 1 Overview I this lecture, we begi studyig the fudametals of coutig discrete objects.
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationBINOMIAL COEFFICIENT AND THE GAUSSIAN
BINOMIAL COEFFICIENT AND THE GAUSSIAN The biomial coefficiet is defied as-! k!(! ad ca be writte out i the form of a Pascal Triagle startig at the zeroth row with elemet 0,0) ad followed by the two umbers,
More information= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).
Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =
More informationConfidence intervals for proportions
Cofidece itervals for roortios Studet Activity 7 8 9 0 2 TI-Nsire Ivestigatio Studet 60 mi Itroductio From revious activity This activity assumes kowledge of the material covered i the activity Distributio
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationLecture Chapter 6: Convergence of Random Sequences
ECE5: Aalysis of Radom Sigals Fall 6 Lecture Chapter 6: Covergece of Radom Sequeces Dr Salim El Rouayheb Scribe: Abhay Ashutosh Doel, Qibo Zhag, Peiwe Tia, Pegzhe Wag, Lu Liu Radom sequece Defiitio A ifiite
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationECE534, Spring 2018: Final Exam
ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationSampling Distributions, Z-Tests, Power
Samplig Distributios, Z-Tests, Power We draw ifereces about populatio parameters from sample statistics Sample proportio approximates populatio proportio Sample mea approximates populatio mea Sample variace
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationChapter 10 Advanced Topics in Random Processes
ery Stark ad Joh W. Woods, Probability, Statistics, ad Radom Variables for Egieers, 4th ed., Pearso Educatio Ic.,. ISBN 978--3-33-6 Chapter Advaced opics i Radom Processes Sectios. Mea-Square (m.s.) Calculus
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More information2 Scalable algorithms, Scheduling, and a glance at All Prefix Sum
CME 323: Distributed Algorithms ad Otimizatio, Srig 2017 htt://staford.edu/~rezab/dao. Istructor: Reza Zadeh, Matroid ad Staford. Lecture 2, 4/5/2017. Scribed by Adreas Satucci. 2 Scalable algorithms,
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationProbability review (week 2) Solutions
Probability review (week 2) Solutios A. Biomial distributio. BERNOULLI, BINOMIAL, POISSON AND NORMAL DISTRIBUTIONS. X is a biomial RV with parameters,p. Let u i be a Beroulli RV with probability of success
More informationNuclear Physics Worksheet
Nuclear Physics Worksheet The ucleus [lural: uclei] is the core of the atom ad is comosed of articles called ucleos, of which there are two tyes: rotos (ositively charged); the umber of rotos i a ucleus
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More informationShannon s noiseless coding theorem
18.310 lecture otes May 4, 2015 Shao s oiseless codig theorem Lecturer: Michel Goemas I these otes we discuss Shao s oiseless codig theorem, which is oe of the foudig results of the field of iformatio
More informationYALE UNIVERSITY DEPARTMENT OF COMPUTER SCIENCE
YALE UNIVERSITY DEPARTMENT OF COMPUTER SCIENCE CPSC 467a: Crytograhy ad Comuter Security Notes 16 (rev. 1 Professor M. J. Fischer November 3, 2008 68 Legedre Symbol Lecture Notes 16 ( Let be a odd rime,
More informationOn the Beta Cumulative Distribution Function
Alied Mathematical Scieces, Vol. 12, 218, o. 1, 461-466 HIKARI Ltd, www.m-hikari.com htts://doi.org/1.12988/ams.218.8241 O the Beta Cumulative Distributio Fuctio Khaled M. Aludaat Deartmet of Statistics,
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationP1 Chapter 8 :: Binomial Expansion
P Chapter 8 :: Biomial Expasio jfrost@tiffi.kigsto.sch.uk www.drfrostmaths.com @DrFrostMaths Last modified: 6 th August 7 Use of DrFrostMaths for practice Register for free at: www.drfrostmaths.com/homework
More informationDiscrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19
CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationThe Maximum-Likelihood Decoding Performance of Error-Correcting Codes
The Maximum-Lielihood Decodig Performace of Error-Correctig Codes Hery D. Pfister ECE Departmet Texas A&M Uiversity August 27th, 2007 (rev. 0) November 2st, 203 (rev. ) Performace of Codes. Notatio X,
More informationA Note on Sums of Independent Random Variables
Cotemorary Mathematics Volume 00 XXXX A Note o Sums of Ideedet Radom Variables Pawe l Hitczeko ad Stehe Motgomery-Smith Abstract I this ote a two sided boud o the tail robability of sums of ideedet ad
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationChapter 18: Sampling Distribution Models
Chater 18: Samlig Distributio Models This is the last bit of theory before we get back to real-world methods. Samlig Distributios: The Big Idea Take a samle ad summarize it with a statistic. Now take aother
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationMA Advanced Econometrics: Properties of Least Squares Estimators
MA Advaced Ecoometrics: Properties of Least Squares Estimators Karl Whela School of Ecoomics, UCD February 5, 20 Karl Whela UCD Least Squares Estimators February 5, 20 / 5 Part I Least Squares: Some Fiite-Sample
More informationAs stated by Laplace, Probability is common sense reduced to calculation.
Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST
More informationJohn H. J. Einmahl Tilburg University, NL. Juan Juan Cai Tilburg University, NL
Estimatio of the margial exected shortfall Laures de Haa, Poitiers, 202 Estimatio of the margial exected shortfall Jua Jua Cai Tilburg iversity, NL Laures de Haa Erasmus iversity Rotterdam, NL iversity
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationThe Binomial Theorem
The Biomial Theorem Lecture 47 Sectio 9.7 Robb T. Koether Hampde-Sydey College Fri, Apr 8, 204 Robb T. Koether (Hampde-Sydey College The Biomial Theorem Fri, Apr 8, 204 / 25 Combiatios 2 Pascal s Triagle
More informationCALCULATION OF FIBONACCI VECTORS
CALCULATION OF FIBONACCI VECTORS Stuart D. Aderso Departmet of Physics, Ithaca College 953 Daby Road, Ithaca NY 14850, USA email: saderso@ithaca.edu ad Dai Novak Departmet of Mathematics, Ithaca College
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationtests 17.1 Simple versus compound
PAS204: Lecture 17. tests UMP ad asymtotic I this lecture, we will idetify UMP tests, wherever they exist, for comarig a simle ull hyothesis with a comoud alterative. We also look at costructig tests based
More informationCS / MCS 401 Homework 3 grader solutions
CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 9, Part B Hypothesis Tests
SlidesPreared by JOHN S.LOUCKS St.Edward suiversity Slide 1 Chater 9, Part B Hyothesis Tests Poulatio Proortio Hyothesis Testig ad Decisio Makig Calculatig the Probability of Tye II Errors Determiig the
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationBIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH
BIOSAISICAL MEHODS FOR RANSLAIONAL & CLINICAL RESEARCH Direct Bioassays: REGRESSION APPLICAIONS COMPONENS OF A BIOASSAY he subject is usually a aimal, a huma tissue, or a bacteria culture, he aget is usually
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSection 5.1 The Basics of Counting
1 Sectio 5.1 The Basics of Coutig Combiatorics, the study of arragemets of objects, is a importat part of discrete mathematics. I this chapter, we will lear basic techiques of coutig which has a lot of
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationECE534, Spring 2018: Solutions for Problem Set #2
ECE534, Srig 08: s for roblem Set #. Rademacher Radom Variables ad Symmetrizatio a) Let X be a Rademacher radom variable, i.e., X = ±) = /. Show that E e λx e λ /. E e λx = e λ + e λ = + k= k=0 λ k k k!
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More information4. Basic probability theory
Cotets Basic cocepts Discrete radom variables Discrete distributios (br distributios) Cotiuous radom variables Cotiuous distributios (time distributios) Other radom variables Lect04.ppt S-38.45 - Itroductio
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationBig Picture. 5. Data, Estimates, and Models: quantifying the accuracy of estimates.
5. Data, Estimates, ad Models: quatifyig the accuracy of estimates. 5. Estimatig a Normal Mea 5.2 The Distributio of the Normal Sample Mea 5.3 Normal data, cofidece iterval for, kow 5.4 Normal data, cofidece
More informationUnderstanding Samples
1 Will Moroe CS 109 Samplig ad Bootstrappig Lecture Notes #17 August 2, 2017 Based o a hadout by Chris Piech I this chapter we are goig to talk about statistics calculated o samples from a populatio. We
More information(a) (b) All real numbers. (c) All real numbers. (d) None. to show the. (a) 3. (b) [ 7, 1) (c) ( 7, 1) (d) At x = 7. (a) (b)
Chapter 0 Review 597. E; a ( + )( + ) + + S S + S + + + + + + S lim + l. D; a diverges by the Itegral l k Test sice d lim [(l ) ], so k l ( ) does ot coverge absolutely. But it coverges by the Alteratig
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationNotes on the prime number theorem
Notes o the rime umber theorem Keji Kozai May 2, 24 Statemet We begi with a defiitio. Defiitio.. We say that f(x) ad g(x) are asymtotic as x, writte f g, if lim x f(x) g(x) =. The rime umber theorem tells
More informationLecture 5. Random variable and distribution of probability
Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za
More informationOpen book and notes. 120 minutes. Cover page and six pages of exam. No calculators.
IE 330 Seat # Ope book ad otes 120 miutes Cover page ad six pages of exam No calculators Score Fial Exam (example) Schmeiser Ope book ad otes No calculator 120 miutes 1 True or false (for each, 2 poits
More informationNew Definition of Density on Knapsack Cryptosystems
Africacryt008@Casablaca 008.06.1 New Defiitio of Desity o Kasac Crytosystems Noboru Kuihiro The Uiversity of Toyo, Jaa 1/31 Kasac Scheme rough idea Public Key: asac: a={a 1, a,, a } Ecrytio: message m=m
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationOutput Analysis and Run-Length Control
IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%
More information