Introduction to Probability
|
|
- Meghan Davis
- 5 years ago
- Views:
Transcription
1 Itroducto to Probablty Nader H Bshouty Departmet of Computer Scece Techo Israel e-mal: bshouty@cstechoacl 1 Combatorcs 11 Smple Rules I Combatorcs The rule of sum says that the umber of ways to choose a elemet from oe of two dsjots sets s the sum of the cardaltes of the sets That s, f A ad B are two fte sets wth o members commo, the A B = A + B The rule of product says that the umber of ways to choose a ordered par s the umber of ways to choose the frst elemet from A ad the secod elemet from B That s, f A ad B are two fte sets, the A B = A B 12 Smple Coutg Strgs A strg over a set S s a sequece of elemets of S For example, there are 8 bary strgs of legth 3: 000,001,010,011,100,101,110,111 A -strg over a set S ca be vewed as a elemet of the Cartesa product S of -tuples; thus, there are S strgs of legth Permutatos A permutato of a fte set S s a ordered sequece of all the elemets of S, wth each elemet appearg exactly oce For example, f S = {a, b, c}, there are 6 permutatos of S: abc,acb,bac,bca,cab,cba There are! permutatos of a set of elemets A -permutato of S s a ordered sequece of of S, wth o elemet appearg more tha oce the sequece The umber of -permutatos of a -set s: Combatos ( 1)( 2) ( + 1) =! ( )!
2 A -combato of a -set S s smply a -subset of S There are sx 2-combatos of the 4-set {a, b, c, d}: ab, ac, ad, bc, bd, cd The umber of -combatos of a -set 13 Equaltes!!( )! Bomal coeffcets We use the otato ( ) (read choose ) to deote the umber of -combatos of a -set We have! =!( ) Ths formula s symmetrc ad : = These umbers are also ow as bomal coeffcets, due to ther appearace the bomal expaso: (x + y) = x y A specal case: We also have 2 = =0 =0 = 1 1 = = Iequaltes Bomal bouds For 1, we have the lower boud: 2
3 The upper boud: For all 0 (see 2), e ( ), where for coveece we assume that 0 0 = 1 For = λ, where 0 λ 1, ths boud ca be rewrtte as (see R3): 2 H(λ), λ where H(λ) = λlgλ (1 λ)lg(1 λ) s the etropy fucto ad where, for coveece, we assume that 0 lg 0 = 0, so that H(0) = H(1) = 0 For 0 λ 1 2 we have (see R4) λ For ay 0, j 0, 0, ad j +, The Strlg s approxmato s log! = 0 j + 2 H(λ) ( j ) j ( + 1 ) log 1 log(2π) + o(1), = 22 (1 + O(1/)) π 2 Probablty 21 Itroducto We defe probablty terms of a sample space S, whch s a set whose elemets are called elemetary evets For flppg two dstgushable cos, we ca vew the sample space S = HH, HT, T H, T T A evet s a subset of the sample space S The evet S s called the certa evet, ad the evet Ø s called the ull evet We say that two evets A ad B are mutually exclusve f A B = Ø Axoms of probablty A probablty dstrbuto Pr{} o a sample space S s a mappg from evets of S to real umbers such that the followg probablty axoms are satsfed: 3
4 1 Pr[A 0 for ay evet A 2 Pr[S = 1 3 Pr[A B = Pr[A + Pr[B for ay two mutually exclusve evets A ad B We call Pr[A the probablty of the evet A Results: Pr[Ø = 0, f A B, the Pr[A Pr[B For A (the complemet of A), Pr[A = 1 Pr[A For ay two evets A ad B, Pr[A B = Pr[A + Pr[B Pr[A B Pr[A + Pr[B Dscrete probablty dstrbutos A probablty dstrbuto s dscrete f t s defed over a fte or or coutably fte sample spacethe for ay evet A, Pr[A = s A Pr[s If S s fte ad every elemetary evet s S has probablty Pr[s = 1/ S the we have the uform probablty dstrbuto o S A far co s oe whch the probablty of obtag a head s the same as the probablty of obtag a tal, that s, 1/2 22 Codtoal probablty ad Idepedece Codtoal probablty formalzes the oto of havg pror partal owledge of the outcome of a expermet The codtoal probablty of a evet A gve that aother evet B occurs s defed to be: Pr[A B Pr[A B = Pr[B Wheever Pr[B 0, (we read Pr[A B as the probablty of A gve B ) Two evets are depedet f, Pr[A B = Pr[A Pr[B, whch s equvalet, f Pr[B 0, to the codto Pr[A B = Pr[A A collecto A 1, A 2,, A of evets s sad to be parwse depedet f Pr[A A j = Pr[A Pr[A j For all 1 < j We say that they are (mutually) depedet f every -subset A 1, A 2,, A of collecto, where 2 ad 1 1 < 2 < <, satsfes: Pr[A 1 A 2 A = Pr[A 1 Pr[A 2 Pr[A 4
5 Bayes s Theorem From Bayes s theorem: Pr[A B = Pr[A B = Pr[A Pr[B A Pr[B Pr[A Pr[B A Pr[A Pr[B A + Pr[A Pr[B A Boole s equalty: For ay fte or coutably fte sequece of evets A 1, A 2,, Pr[A 1 A 2 Pr[A 1 + Pr[A 2 + For collecto of evets A 1, A 2,, A, Pr[A 1 A 2 A = Pr[A 1 Pr[A 2 A 1 Pr[A 3 A 1 A 2 Pr[A A 1 A 2 A 1 23 Dscrete Radom Varables ad Expectato A (dscrete) radom varable s a fucto from a fte or coutably fte sample space S to the real umbers For radom varable X ad a real umber x, we defe the evet X = x to be [s S : X(s) = x; thus, Pr[X = x = [s S:X(s)=x Pr[s The fucto: f(x) = Pr[X = x, s the probablty desty fucto of the radom varable X It s commo for several radom varables to be defed o the same sample space If X ad Y are radom varables, the fucto: f(x, y) = Pr[X = x ad Y = y Is the jot probablty desty fucto of X ad Y For a fxed value y, Pr[Y = y = x Pr[X = x ad Y = y We defe two radom varables X ad Y to be depedet f for all x ad y, the evets X = x ad Y = y are depedet or, equvaletly, f for all x ad y, we have Pr[X = x ad Y = y = Pr[X = x Pr[Y = y Expected value of a radom varable The expected value (or, syoymously, expectato or mea) of a dscrete radom varable s E[X = x Pr[X = x x Sometmes the expectato of s deoted by µ x or, whe the radom s apparet from cotext, smply by µ The expectatos of the sum of two radom varables s the sum of ther expectatos, that s, E[X + Y = E[X + [Y If s ay radom varable, ay fucto g(x) defes a ew radom varable g(x) If the expectato of g(x) s defed, the E[g(X) = x g(x) Pr[X = x 5
6 Lettg g(x) = ax, we have for ay costat a, E[aX = ae[x E[aX + Y = ae[x + E[Y Whe two radom varables X ad Y are depedet ad each has a defed expectato, E[XY = E[XE[Y I geeral, whe radom varable X 1, X 2,, X are mutually depedet, E[X 1 X 2 X = E[X 1 E[X 2 E[X Whe a radom varable X taes o values from the atural umbers N = {0, 1, 2, }, there s a ce formula for ts expectato: Varace ad stadard devato E[X = Pr[X The varace of a radom varable X wth mea E[s: V ar[x = E[(X E[X) 2 = E[X 2 E 2 [X We have E[X 2 = V ar[x + E 2 [X V ar[ax = a 2 V ar[x Whe X ad Y are depedet radom varables, V ar[x +Y = V ar[x+v ar[y I geeral, f radom varables X 1, X 2,, X are parwse depedet, the V ar[ = V ar[ The stadard devato of a radom varable s the postve square root of the varace of X Marov s equalty: (see Rule 1) For a oegatve radom varable X Pr[X t E[X t for all t > 0 ad Pr[X λe[x 1 λ See more results [G Appedx A Chebychev s equalty: 6
7 Pr[ X E[X V ar[x 2 Beayme-Chebyschev Let X 1,, X m be parwse depedet radom varables such that E[ = µ ad V ar[ = σ 2 The See the proof [G Appedx A [ m Pr m µ λ σ2 λ 2 m 24 Geometrc ad Bomal dstrbutos A co flp s a stace of a Beroull tral, whch s defed as a expermet wth oly two possble outcomes: success, whch occurs wth probablty p, ad falure, whch occurs wth probablty q = 1 p The trals are mutually depedet o each has the same probablty p for success The geometrc dstrbuto Suppose we have a sequece of Beroull trals, each wth a probablty p of success ad a probablty q = 1 p of falure Let the radom varable X be the umber of trals eeded to obta a success Pr[X = = q 1 p A probablty dstrbuto satsfyg ths s sad to be a geometrc dstrbuto The bomal dstrbuto E[X = 1/p V ar[x = q/p 2 Defe the radom varable X to be the umber of success trals Pr[X = x = p q A probablty dstrbuto satsfyg ths s sad to be a bomal dstrbuto Defe: b(;, p) = p (1 p) We have: E[X = p ad V ar[x = pq The bomal dstrbuto b(;, p) creases as rus from 0 to utl t reaches the mea p, ad the t decreases Let 0, let 0 < p < 1, let q = 1 p, ad let 0 The, b(;, p) p q 7
8 For 0, b(;, 1/2) 2 H(/) The tals of the bomal dstrbuto Let X 1, X 2,, X be depedet radom varables such that {0, 1} ad E[ = p The ths s equvalet to a sequece of Beroull trals, where success occurs wth probablty p Let X be the radom varable deotg the total umber of successes The for 0, the probablty of at least success s: ad [ Pr = b(;, p) = p For p < <, the probablty of more tha successes s: [ ( )p Pr > = b(;, p) < b(;, p), p =+1 [ Pr p λ [ Pr = b(;, p) pe λ λ For 0 < < p, the probablty of fewer tha success s: [ 1 Pr < = b(;, p) < =0 (1 p) q b(;, p) p Cheroff Let X 1,, X be depedet radom varables such that {0, 1} ad E[ = p The Multplcatve Form Addtve Form [ Pr [ Pr p [ Pr [ Pr p p λp e λ2p/3 λp e λ2p/2 p λ e 2λ2 8 λ e 2λ2
9 ad [ Pr See aother boud [G Appedx A p λ 2e 2λ2 Hoeffdg Let X 1,, X m be depedet radom varables such that [a, b ad E[ = p The [ Pr p λ 2e 2λ2 /(b a) 2 Other Results Cosder depedet radom varables X 1,, X (a sequece of Beroull trals) where E[ = p (where the th tral, for = 1, 2,,, success occurs wth probablty p ad falure occurs wth probablty q = 1 p ) Let µ = E [ The for r > µ, [ µe r Pr µ r r Pr[X µ r e r2 /2 3 Examples Example 1 Radom Halvg: A game where you radomly uformly choose a teger 1 1 ad the utl you get 1 Show that the expected umber of steps s / Soluto: Let X be the expected umber of steps the X 1 = 1 ad E[X = 1 + E 1 [E[ Now + 1 E[X +1 E[X = E[X +1 ad therefore E[X +1 = E[X + (1/) Acowledgemet: To Vva Bshouty for helpg me wth ths survey Refereces [AS N Alo ad J H Specer The Probablstc Method [CLR T Corme, C E Leserso ad R L Rvest Itroducto to Algorthms [G O Goldrech Moder Cryptography, Probablstc Proofs ad Pseudo-radomess [MR R Motwa ad P Raghava Radomzed Algorthms 9
10 4 Proofs Rule 1 Marov s equalty: for all t > 0 Proof We have Pr[X t E[X t E[X = x Pr[X = x x x t Pr[X = xx Pr[X tt Rule 2 We have Proof We have = ( + ( )) ( ) ( ) Rule 3 For 0 λ 1 we have where H(λ) = λlgλ (1 λ)lg(1 λ) Proof Use Rule 2 2 H(λ), λ Rule 4 For 0 λ 1 2 we have λ 0 2 H(λ) Proof We have λ 1 = (λ + (1 λ)) λ (1 λ) = λ ( λ (1 λ) 1 λ λ ) λ λ = 2 H(λ) 0 (1 λ) ( λ 1 λ ) λ 10
The Occupancy and Coupon Collector problems
Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationSpecial Instructions / Useful Data
JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth
More informationLecture 4 Sep 9, 2015
CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationParameter, Statistic and Random Samples
Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationDiscrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b
CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package
More information,m = 1,...,n; 2 ; p m (1 p) n m,m = 0,...,n; E[X] = np; n! e λ,n 0; E[X] = λ.
CS70: Lecture 21. Revew: Dstrbutos Revew: Idepedece Varace; Iequaltes; WLLN 1. Revew: Dstrbutos 2. Revew: Idepedece 3. Varace 4. Iequaltes Markov Chebyshev 5. Weak Law of Large Numbers U[1,...,] : Pr[X
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationLecture 02: Bounding tail distributions of a random variable
CSCI-B609: A Theorst s Toolkt, Fall 206 Aug 25 Lecture 02: Boudg tal dstrbutos of a radom varable Lecturer: Yua Zhou Scrbe: Yua Xe & Yua Zhou Let us cosder the ubased co flps aga. I.e. let the outcome
More informationHomework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015
Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts
More information2. Independence and Bernoulli Trials
. Ideedece ad Beroull Trals Ideedece: Evets ad B are deedet f B B. - It s easy to show that, B deedet mles, B;, B are all deedet ars. For examle, ad so that B or B B B B B φ,.e., ad B are deedet evets.,
More information{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:
Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed
More informationRandom Variables. ECE 313 Probability with Engineering Applications Lecture 8 Professor Ravi K. Iyer University of Illinois
Radom Varables ECE 313 Probablty wth Egeerg Alcatos Lecture 8 Professor Rav K. Iyer Uversty of Illos Iyer - Lecture 8 ECE 313 Fall 013 Today s Tocs Revew o Radom Varables Cumulatve Dstrbuto Fucto (CDF
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections
ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty
More informationD KL (P Q) := p i ln p i q i
Cheroff-Bouds 1 The Geeral Boud Let P 1,, m ) ad Q q 1,, q m ) be two dstrbutos o m elemets, e,, q 0, for 1,, m, ad m 1 m 1 q 1 The Kullback-Lebler dvergece or relatve etroy of P ad Q s defed as m D KL
More informationChapter 4 Multiple Random Variables
Revew o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for Chapter 4-5 Notes: Although all deftos ad theorems troduced our lectures ad ths ote are mportat ad you should be famlar wth, but I put those
More informationX ε ) = 0, or equivalently, lim
Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece
More informationPseudo-random Functions
Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationLaw of Large Numbers
Toss a co tmes. Law of Large Numbers Suppose 0 f f th th toss came up H toss came up T s are Beroull radom varables wth p ½ ad E( ) ½. The proporto of heads s. Itutvely approaches ½ as. week 2 Markov s
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationComplete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables
Joural of Sceces, Islamc Republc of Ira 8(4): -6 (007) Uversty of Tehra, ISSN 06-04 http://sceces.ut.ac.r Complete Covergece ad Some Maxmal Iequaltes for Weghted Sums of Radom Varables M. Am,,* H.R. Nl
More informationA be a probability space. A random vector
Statstcs 1: Probablty Theory II 8 1 JOINT AND MARGINAL DISTRIBUTIONS I Probablty Theory I we formulate the cocept of a (real) radom varable ad descrbe the probablstc behavor of ths radom varable by the
More informationBounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy
Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled
More informationChain Rules for Entropy
Cha Rules for Etroy The etroy of a collecto of radom varables s the sum of codtoal etroes. Theorem: Let be radom varables havg the mass robablty x x.x. The...... The roof s obtaed by reeatg the alcato
More informationEconometric Methods. Review of Estimation
Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators
More informationRandom Variables and Probability Distributions
Radom Varables ad Probablty Dstrbutos * If X : S R s a dscrete radom varable wth rage {x, x, x 3,. } the r = P (X = xr ) = * Let X : S R be a dscrete radom varable wth rage {x, x, x 3,.}.If x r P(X = x
More informationLecture 1. (Part II) The number of ways of partitioning n distinct objects into k distinct groups containing n 1,
Lecture (Part II) Materals Covered Ths Lecture: Chapter 2 (2.6 --- 2.0) The umber of ways of parttog dstct obects to dstct groups cotag, 2,, obects, respectvely, where each obect appears exactly oe group
More informationDr. Shalabh. Indian Institute of Technology Kanpur
Aalyss of Varace ad Desg of Expermets-I MODULE -I LECTURE - SOME RESULTS ON LINEAR ALGEBRA, MATRIX THEORY AND DISTRIBUTIONS Dr. Shalabh Departmet t of Mathematcs t ad Statstcs t t Ida Isttute of Techology
More information1 Onto functions and bijections Applications to Counting
1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of
More informationmeans the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever.
9.4 Sequeces ad Seres Pre Calculus 9.4 SEQUENCES AND SERIES Learg Targets:. Wrte the terms of a explctly defed sequece.. Wrte the terms of a recursvely defed sequece. 3. Determe whether a sequece s arthmetc,
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationLecture 9. Some Useful Discrete Distributions. Some Useful Discrete Distributions. The observations generated by different experiments have
NM 7 Lecture 9 Some Useful Dscrete Dstrbutos Some Useful Dscrete Dstrbutos The observatos geerated by dfferet eermets have the same geeral tye of behavor. Cosequetly, radom varables assocated wth these
More informationContinuous Distributions
7//3 Cotuous Dstrbutos Radom Varables of the Cotuous Type Desty Curve Percet Desty fucto, f (x) A smooth curve that ft the dstrbuto 3 4 5 6 7 8 9 Test scores Desty Curve Percet Probablty Desty Fucto, f
More informationAlgorithms Theory, Solution for Assignment 2
Juor-Prof. Dr. Robert Elsässer, Marco Muñz, Phllp Hedegger WS 2009/200 Algorthms Theory, Soluto for Assgmet 2 http://lak.formatk.u-freburg.de/lak_teachg/ws09_0/algo090.php Exercse 2. - Fast Fourer Trasform
More informationLebesgue Measure of Generalized Cantor Set
Aals of Pure ad Appled Mathematcs Vol., No.,, -8 ISSN: -8X P), -888ole) Publshed o 8 May www.researchmathsc.org Aals of Lebesgue Measure of Geeralzed ator Set Md. Jahurul Islam ad Md. Shahdul Islam Departmet
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationDimensionality Reduction and Learning
CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1
STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ
More informationPoint Estimation: definition of estimators
Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.
More informationMu Sequences/Series Solutions National Convention 2014
Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed
More informationResearch Article A New Iterative Method for Common Fixed Points of a Finite Family of Nonexpansive Mappings
Hdaw Publshg Corporato Iteratoal Joural of Mathematcs ad Mathematcal Sceces Volume 009, Artcle ID 391839, 9 pages do:10.1155/009/391839 Research Artcle A New Iteratve Method for Commo Fxed Pots of a Fte
More informationPseudo-random Functions. PRG vs PRF
Pseudo-radom Fuctos Debdeep Muhopadhyay IIT Kharagpur PRG vs PRF We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom
More informationBIOREPS Problem Set #11 The Evolution of DNA Strands
BIOREPS Problem Set #11 The Evoluto of DNA Strads 1 Backgroud I the md 2000s, evolutoary bologsts studyg DNA mutato rates brds ad prmates dscovered somethg surprsg. There were a large umber of mutatos
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationAlgorithms Design & Analysis. Hash Tables
Algorthms Desg & Aalyss Hash Tables Recap Lower boud Order statstcs 2 Today s topcs Drect-accessble table Hash tables Hash fuctos Uversal hashg Perfect Hashg Ope addressg 3 Symbol-table problem Symbol
More informationChapter 1 Counting Methods
AlbertLudwgs Uversty Freburg Isttute of Empral Researh ad Eoometrs Dr. Sevtap Kestel Mathematal Statsts - Wter 2008 Chapter Coutg Methods Am s to determe how may dfferet possbltes there are a gve stuato.
More informationNP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Prelmary theorem 3. Proof 4. Expla 5. Cocluso. Itroduce The P versus NP problem s a major usolved problem computer scece. Iformally, t asks whether a computer
More informationEstimation of Stress- Strength Reliability model using finite mixture of exponential distributions
Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationA Remark on the Uniform Convergence of Some Sequences of Functions
Advaces Pure Mathematcs 05 5 57-533 Publshed Ole July 05 ScRes. http://www.scrp.org/joural/apm http://dx.do.org/0.436/apm.05.59048 A Remark o the Uform Covergece of Some Sequeces of Fuctos Guy Degla Isttut
More information9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d
9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,
More informationSTK4011 and STK9011 Autumn 2016
STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto
More information(b) By independence, the probability that the string 1011 is received correctly is
Soluto to Problem 1.31. (a) Let A be the evet that a 0 s trasmtted. Usg the total probablty theorem, the desred probablty s P(A)(1 ɛ ( 0)+ 1 P(A) ) (1 ɛ 1)=p(1 ɛ 0)+(1 p)(1 ɛ 1). (b) By depedece, the probablty
More information3. Basic Concepts: Consequences and Properties
: 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationNP!= P. By Liu Ran. Table of Contents. The P vs. NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Strategy 3. Prelmary theorem 4. Proof 5. Expla 6. Cocluso. Itroduce The P vs. NP problem s a major usolved problem computer scece. Iformally, t asks whether
More informationLecture 3. Sampling, sampling distributions, and parameter estimation
Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More information5 Short Proofs of Simplified Stirling s Approximation
5 Short Proofs of Smplfed Strlg s Approxmato Ofr Gorodetsky, drtymaths.wordpress.com Jue, 20 0 Itroducto Strlg s approxmato s the followg (somewhat surprsg) approxmato of the factoral,, usg elemetary fuctos:
More informationQualifying Exam Statistical Theory Problem Solutions August 2005
Qualfyg Exam Statstcal Theory Problem Solutos August 5. Let X, X,..., X be d uform U(,),
More informationFridayʼs lecture" Problem solutions" Joint densities" 1."E(X) xf (x) dx (x,y) dy X,Y Marginal distributions" The distribution of a ratio" Problems"
Frdayʼs lecture" Jot destes" Margal dstrbutos" The dstrbuto of a rato" Problems" Problem solutos" 1." E(X) = xf X (x)dx = x f X,Y (x,y)dy dx 2. E(X) " = kp X (k) = p X (1) + 2p X (2) +... = xf X,Y (x,y)dxdy
More informationClass 13,14 June 17, 19, 2015
Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral
More informationQ-analogue of a Linear Transformation Preserving Log-concavity
Iteratoal Joural of Algebra, Vol. 1, 2007, o. 2, 87-94 Q-aalogue of a Lear Trasformato Preservg Log-cocavty Daozhog Luo Departmet of Mathematcs, Huaqao Uversty Quazhou, Fua 362021, P. R. Cha ldzblue@163.com
More informationMaps on Triangular Matrix Algebras
Maps o ragular Matrx lgebras HMED RMZI SOUROUR Departmet of Mathematcs ad Statstcs Uversty of Vctora Vctora, BC V8W 3P4 CND sourour@mathuvcca bstract We surveys results about somorphsms, Jorda somorphsms,
More informationInvestigation of Partially Conditional RP Model with Response Error. Ed Stanek
Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a
More information22 Nonparametric Methods.
22 oparametrc Methods. I parametrc models oe assumes apror that the dstrbutos have a specfc form wth oe or more ukow parameters ad oe tres to fd the best or atleast reasoably effcet procedures that aswer
More informationExchangeable Sequences, Laws of Large Numbers, and the Mortgage Crisis.
Exchageable Sequeces, Laws of Large Numbers, ad the Mortgage Crss. Myug Joo Sog Advsor: Prof. Ja Madel May 2009 Itroducto The law of large umbers for..d. sequece gves covergece of sample meas to a costat,.e.,
More informationChapter 8: Statistical Analysis of Simulated Data
Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample
More informationå 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018
Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationMathematics HL and Further mathematics HL Formula booklet
Dploma Programme Mathematcs HL ad Further mathematcs HL Formula booklet For use durg the course ad the eamatos Frst eamatos 04 Mathematcal Iteratoal Baccalaureate studes SL: Formula Orgazato booklet 0
More information1. Overview of basic probability
13.42 Desg Prcples for Ocea Vehcles Prof. A.H. Techet Sprg 2005 1. Overvew of basc probablty Emprcally, probablty ca be defed as the umber of favorable outcomes dvded by the total umber of outcomes, other
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationRECAPITULATION & CONDITIONAL PROBABILITY. Number of favourable events n E Total number of elementary events n S
Fomulae Fo u Pobablty By OP Gupta [Ida Awad We, +91-9650 350 480] Impotat Tems, Deftos & Fomulae 01 Bascs Of Pobablty: Let S ad E be the sample space ad a evet a expemet espectvely Numbe of favouable evets
More informationhp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations
HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several
More informationModule 7. Lecture 7: Statistical parameter estimation
Lecture 7: Statstcal parameter estmato Parameter Estmato Methods of Parameter Estmato 1) Method of Matchg Pots ) Method of Momets 3) Mamum Lkelhood method Populato Parameter Sample Parameter Ubased estmato
More informationPTAS for Bin-Packing
CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,
More informationRandom Variate Generation ENM 307 SIMULATION. Anadolu Üniversitesi, Endüstri Mühendisliği Bölümü. Yrd. Doç. Dr. Gürkan ÖZTÜRK.
adom Varate Geerato ENM 307 SIMULATION Aadolu Üverstes, Edüstr Mühedslğ Bölümü Yrd. Doç. Dr. Gürka ÖZTÜK 0 adom Varate Geerato adom varate geerato s about procedures for samplg from a varety of wdely-used
More informationStrong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity
BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout
More informationCHAPTER 3 POSTERIOR DISTRIBUTIONS
CHAPTER 3 POSTERIOR DISTRIBUTIONS If scece caot measure the degree of probablt volved, so much the worse for scece. The practcal ma wll stck to hs apprecatve methods utl t does, or wll accept the results
More informationArithmetic Mean and Geometric Mean
Acta Mathematca Ntresa Vol, No, p 43 48 ISSN 453-6083 Arthmetc Mea ad Geometrc Mea Mare Varga a * Peter Mchalča b a Departmet of Mathematcs, Faculty of Natural Sceces, Costate the Phlosopher Uversty Ntra,
More informationCS 2750 Machine Learning Lecture 5. Density estimation. Density estimation
CS 750 Mache Learg Lecture 5 esty estmato Mlos Hausrecht mlos@tt.edu 539 Seott Square esty estmato esty estmato: s a usuervsed learg roblem Goal: Lear a model that rereset the relatos amog attrbutes the
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationNon-uniform Turán-type problems
Joural of Combatoral Theory, Seres A 111 2005 106 110 wwwelsevercomlocatecta No-uform Turá-type problems DhruvMubay 1, Y Zhao 2 Departmet of Mathematcs, Statstcs, ad Computer Scece, Uversty of Illos at
More informationBayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information
Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst
More informationPr[X (p + t)n] e D KL(p+t p)n.
Cheroff Bouds Wolfgag Mulzer 1 The Geeral Boud Let P 1,..., m ) ad Q q 1,..., q m ) be two dstrbutos o m elemets,.e.,, q 0, for 1,..., m, ad m 1 m 1 q 1. The Kullback-Lebler dvergece or relatve etroy of
More informationCIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights
CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:
More informationIFYMB002 Mathematics Business Appendix C Formula Booklet
Iteratoal Foudato Year (IFY IFYMB00 Mathematcs Busess Apped C Formula Booklet Related Documet: IFY Mathematcs Busess Syllabus 07/8 IFYMB00 Maths Busess Apped C Formula Booklet Cotets lease ote that the
More informationDesign maintenanceand reliability of engineering systems: a probability based approach
Desg mateaead relablty of egeerg systems: a probablty based approah CHPTER 2. BSIC SET THEORY 2.1 Bas deftos Sets are the bass o whh moder probablty theory s defed. set s a well-defed olleto of objets.
More informationChapter 3 Sampling For Proportions and Percentages
Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys
More information