Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts
|
|
- Cameron Bridges
- 5 years ago
- Views:
Transcription
1 Basics of Iferece Lecture 21: Sta230 / Mth230 Coli Rudel Aril 16, 2014 U util this oit i the class you have almost exclusively bee reseted with roblems where we are usig a robability model where the model arameters are give. I the real world this almost ever haes, a much more commo situatio is that you have collected some data ad have a idea about what tye of robability model might be aroriate but you do t kow (or have a guess / belief) about the values of the model arameters. Basic setu: x - a observed data oit θ - arameter (or vector of arameters) of the distributio roducig the data oits X - set of observed data oits Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Review - Examle - Defective Parts Suose that a certai machie roduces defective ad odefective arts, but we do ot kow what roortio of defectives we would fid amog all arts that could be roduced by the machie. The distributio of X, assumig that we kow P =, is the biomial distributio with arameters ad. Give o other iformatio we might believe that P has a cotiuous distributio with df such as f P () = 1 for (0, 1). What is the joit robability of f (x, )? What is the margial distributio of X? f (x ) = ( x ) x (1 ) x, for x = 0, 1,..., f (x, ) = ( x ) x (1 ) x, for x = 0, 1,..., ad 0 1 ( ) 1 1 f X (x) = f (x, ) d = x (1 ) x d 0 x 0 ( ) ( ) = Γ(x 1)Γ( x 1) B(x + 1, x + 1) = x x Γ( 2) Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Review - Examle - Defective Parts, cot. Based o the recedig results, what is the coditioal distributio of P give X = 5 ad N = 10? ( f (x, ) f ( x) = x) x f X (x) = (1 ) x ( Γ(x+1)Γ( x+1) x) Γ(+2) Γ( + 2) = Γ(x + 1)Γ( x + 1) x (1 ) x, for 0 1 Which is a Beta distributio with arameters α = x + 1 ad β = x + 1, therefore if X = 5 ad N = 10 the f ( x = 5, = 10) Beta(6, 6) E(P X = 5, N = 10) = = 1/2 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
2 Review - Examle - Defective Parts, cot. f ( x = 5, = 10) Beta(6, 6) f( x) f ( x = 1, = 10) Beta(2, 10) f ( x = 50, = 100) Beta(51, 51) f( x) f ( x = 9, = 10) Beta(10, 2) As you might exect this aroach to iferece is based o Bayes Theorem which states P(A B) = P(B A)P(A) P(B) We are iterested i estimatig the model arameters based o the observed data ad ay rior belief about the arameters, which we setu as follows f( x) f( x) P(θ X ) = P(X θ) P(X ) π(θ) P(X θ) π(θ) Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 - Termiology Elemets of the Bayesia Model: π(θ) - Prior distributio - This distributio reflects ay reexistig iformatio / belief about the distributio of the arameter(s). P(X θ) - Likelihood / Samlig distributio - Distributio of the data give the arameters, which is the robability model believed to have geerated the data. P(X ) - Margial distributio of the data - Distributio of the observed data margialized over all ossible values of the arameter(s). P(θ X ) - Posterior distributio - Distributio of the arameter(s) after takig the observed data ito accout. Examle - Defective Parts, i Bayesia Terms For the Defective Parts we foud the joit, margial ad coditioal distributios. I terms of Bayesia iferece: Data - X - Number of defective arts Parameters - - Proortio of arts that are defective Prior distributio - π() = 1, for x (0, 1) Likelihood / Samlig distributio - f (x ) = ( ) x x (1 ) x Margial distributio of the data - f X (x) = ( ) Γ(x 1)Γ( x 1) x Γ( 2) Posterior distributio - f ( x) = Γ(+2) Γ(x+1)Γ( x+1) x (1 ) x, for 0 1 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
3 Examle - Defective Parts, Redux Whe we last worked through this roblem I claimed that sice we did t kow what the roortio of defective arts we should use a uiform rior (all values betwee 0 ad 1 equally likely). What could we do if we believed that the roortio was close to 0? Examle - Defective Parts, Redux Lets fid the osterior distributio of for a rior, Beta(α, β) Remember that the Uif(0, 1) is a secial case of the beta distributio where α = 1, β = 1, we ca try tweakig α ad β to better rereset this belief. Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 f( x) Examle - Defective Parts, Redux Cosequetly, if we a riori believed that the roortio of defective arts was close to zero we might use a Beta(1, 3) rior which would give us the followig osteriors for 1, 5, or 9 defective arts i P X = 1, N = 10 Beta(2, 12) f( x) P X = 5, N = 10 Beta(6, 8) f( x) P X = 9, N = 10 Beta(10, 4) Cojugate Distributios / Priors I the case of a Biomial likelihood we have just see that ay Beta rior we ick will result i a osterior that is also a Beta distributio. For a articular likelihood whe a rior ad osterior belog to the same distributio family this distributio is referred to as a cojugate rior. I this case the Beta distributio is a cojugate rior for the Biomial likelihood. Cojugate riors are immesely useful as they rovide simle aalytic solutio to this tye of iferece roblem, but they are also somewhat limitig sice our rior belief may ot be reresetable usig the cojugate family s arameterizatio. Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
4 Biomial ad a No-cojugate Prior Lets cosider a situatio where we do ot use a Beta rior, ad istead ot for a trucated Normal distributio o (0,1). What do we do the? This kid of situatio haes all the time i Bayesia iferece, we set u a model which results i a (seemigly) itractable osterior distributio. Istead of a aalytic solutio we make use of umerical Mote Carlo methods to geerate samles from the distributio, which ca be used to estimate the distributio ad its roerties. These methods are effective but comutatioally itesive, this is the reaso why Bayesia methods have become oular i the last 30 years as sufficiet comutatioal ower has become available to make use of these methods. More o this if you take Sta 250 or 360 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sequetial Udates Examle - Defective Parts - Sequetial Udates We have already show that if we have a Beta(1, 1) rior o the roortio of defective arts ad if we observe 5 of 10 arts are defective the we would have a Beta(6, 6) osterior for the roortio. If we were to the isect 10 more arts ad foud that 5 were defective, how should we udate our osterior? If we cosider this as two iid data oits (x 1, x 2 ), there are two otios: Take both ito accout at the same time whe calculatig the osterior We have already show that if we have a Beta(1, 1) rior o the roortio of defective arts ad if we observe 5 of 10 arts are defective the we would have a Beta(6, 6) osterior for the roortio. If we were to the isect 10 more arts ad foud that 5 were defective, how should we udate our osterior? If we cosider this as two iid data oits (x 1, x 2 ), there are two otios: Take both ito accout at the same time whe calculatig the osterior f ( x) = f (x ) f X (x) π() = f (x 1 )f (x 2 ) π() f X (x) f ( x) = f (x 1 )f (x 2 ) f X (x) π() 5 (1 ) 5 5 (1 ) 5 Beta(11, 11) First udate the rior usig x 1 ad the use f ( x 1 ) as the rior whe udatig usig x 2. f ( x 2, x 1 ) = f (x 2 ) f X (x 2 ) f ( x 1) = f (x 2 ) f (x 1 ) f X (x 2 ) f X (x 1 ) π() First udate the rior usig x 1 ad the use f ( x 1 ) as the rior whe udatig usig x 2. f ( x 2, x 1 ) = f (x 2 ) f X (x 2 ) f ( x 1) 5 (1 ) 5 5 (1 ) 5 Beta(11, 11) Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
5 Examle - Defective Parts - k lots We ca geeralize our results to k lots with differet lot sizes. Let X 1,..., X k be the umber of defective arts i each lot (which are iid) ad 1,..., k the umber of arts examied i each lot the for a rior Beta(α, β) Examle - Exoetial Distributio Let X be the lifesa of a Fluorescet lam which is modeled by a exoetial distributio with arameter λ where our rior belief o λ is give by a Gamma distributio with arameters k ad θ. If the failures of the lams are ideedet ad we observe the lifesa of lams (x 1,..., x ) what should our osterior distributio for λ be? Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Likelihood of Multile Normal Data Poits If we are collectig data from a rocess that follows a ormal distributio with mea µ ad variace σ 2 ad where each observatio is iid, what is the likelihood of of these observatios (x 1, x 2,..., x )? Cojugate Prior for the Normal Distributio Lets cosider a Normal distributio with mea µ ad variace σ 2, if we assume that σ 2 is kow but µ is ot. What is the osterior distributio of µ if the rior µ N (λ, τ 2 )? Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
6 Cojugate Prior for the Normal Distributio, cot. Where to go from here? Hierarchical Models: Θ θ 11 θ 21 θ 31 y 11 y 12 y 13 y 21 y 22 y 23 y 31 y 32 y 33 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21 Sta230 / Mth230 (Coli Rudel) Lecture 21 Aril 16, / 21
tests 17.1 Simple versus compound
PAS204: Lecture 17. tests UMP ad asymtotic I this lecture, we will idetify UMP tests, wherever they exist, for comarig a simle ull hyothesis with a comoud alterative. We also look at costructig tests based
More information( ) = is larger than. the variance of X V
Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator
More informationOn the Beta Cumulative Distribution Function
Alied Mathematical Scieces, Vol. 12, 218, o. 1, 461-466 HIKARI Ltd, www.m-hikari.com htts://doi.org/1.12988/ams.218.8241 O the Beta Cumulative Distributio Fuctio Khaled M. Aludaat Deartmet of Statistics,
More informationChapter 18: Sampling Distribution Models
Chater 18: Samlig Distributio Models This is the last bit of theory before we get back to real-world methods. Samlig Distributios: The Big Idea Take a samle ad summarize it with a statistic. Now take aother
More informationDistribution of Sample Proportions
Distributio of Samle Proortios Probability ad statistics Aswers & Teacher Notes TI-Nsire Ivestigatio Studet 90 mi 7 8 9 10 11 12 Itroductio From revious activity: This activity assumes kowledge of the
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationENGI 4421 Discrete Probability Distributions Page Discrete Probability Distributions [Navidi sections ; Devore sections
ENGI 441 Discrete Probability Distributios Page 9-01 Discrete Probability Distributios [Navidi sectios 4.1-4.4; Devore sectios 3.4-3.6] Chater 5 itroduced the cocet of robability mass fuctios for discrete
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationTo make comparisons for two populations, consider whether the samples are independent or dependent.
Sociology 54 Testig for differeces betwee two samle meas Cocetually, comarig meas from two differet samles is the same as what we ve doe i oe-samle tests, ecet that ow the hyotheses focus o the arameters
More informationRecursive Updating Fixed Parameter
Recursive Udatig Fixed Parameter So far we ve cosidered the sceario where we collect a buch of data ad the use that (ad the rior PDF) to comute the coditioal PDF from which we ca the get the MAP, or ay
More information13.1 Shannon lower bound
ECE598: Iformatio-theoretic methods i high-dimesioal statistics Srig 016 Lecture 13: Shao lower boud, Fao s method Lecturer: Yihog Wu Scribe: Daewo Seo, Mar 8, 016 [Ed Mar 11] I the last class, we leared
More informationEstimating Proportions
3/1/018 Outlie for Today Remiders about Missig Values Iterretig Cofidece Itervals Cofidece About Proortios Proortios as Iterval Variables Cofidece Itervals Cofidece Coefficiets Examles Lab Exercise ( arts
More informationConfidence Intervals for the Difference Between Two Proportions
PASS Samle Size Software Chater 6 Cofidece Itervals for the Differece Betwee Two Proortios Itroductio This routie calculates the grou samle sizes ecessary to achieve a secified iterval width of the differece
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationChapter 9, Part B Hypothesis Tests
SlidesPreared by JOHN S.LOUCKS St.Edward suiversity Slide 1 Chater 9, Part B Hyothesis Tests Poulatio Proortio Hyothesis Testig ad Decisio Makig Calculatig the Probability of Tye II Errors Determiig the
More informationTopic 4. Representation and Reasoning with Uncertainty
Toic 4 Reresetatio ad Reasoig with Ucertaity Cotets 4.0 Reresetig Ucertaity 4. Probabilistic methods Bayesia PART III 4.2 Certaity Factors CFs 4.3 Demster-Shafer theory 4.4 Fuzzy Logic 4. Probabilistic
More informationHypothesis Testing. H 0 : θ 1 1. H a : θ 1 1 (but > 0... required in distribution) Simple Hypothesis - only checks 1 value
Hyothesis estig ME's are oit estimates of arameters/coefficiets really have a distributio Basic Cocet - develo regio i which we accet the hyothesis ad oe where we reject it H - reresets all ossible values
More informationp we will use that fact in constructing CI n for population proportion p. The approximation gets better with increasing n.
Estimatig oulatio roortio: We will cosider a dichotomous categorical variable(s) ( classes: A, ot A) i a large oulatio(s). Poulatio(s) should be at least 0 times larger tha the samle(s). We will discuss
More informationLast Lecture. Biostatistics Statistical Inference Lecture 16 Evaluation of Bayes Estimator. Recap - Example. Recap - Bayes Estimator
Last Lecture Biostatistics 60 - Statistical Iferece Lecture 16 Evaluatio of Bayes Estimator Hyu Mi Kag March 14th, 013 What is a Bayes Estimator? Is a Bayes Estimator the best ubiased estimator? Compared
More information= p x (1 p) 1 x. Var (X) =p(1 p) M X (t) =1+p(e t 1).
Prob. fuctio:, =1 () = 1, =0 = (1 ) 1 E(X) = Var (X) =(1 ) M X (t) =1+(e t 1). 1.1.2 Biomial distributio Parameter: 0 1; >0; MGF: M X (t) ={1+(e t 1)}. Cosider a sequece of ideedet Ber() trials. If X =
More informationSTAT-UB.0103 NOTES for Wednesday 2012.APR.25. Here s a rehash on the p-value notion:
STAT-UB.3 NOTES for Wedesday 22.APR.25 Here s a rehash o the -value otio: The -value is the smallest α at which H would have bee rejected, with these data. The -value is a measure of SHOCK i the data.
More informationLecture 23 Maximum Likelihood Estimation and Bayesian Inference
Lecture 23 Maximum Likelihood Estimation and Bayesian Inference Thais Paiva STA 111 - Summer 2013 Term II August 7, 2013 1 / 31 Thais Paiva STA 111 - Summer 2013 Term II Lecture 23, 08/07/2013 Lecture
More informationNuclear Physics Worksheet
Nuclear Physics Worksheet The ucleus [lural: uclei] is the core of the atom ad is comosed of articles called ucleos, of which there are two tyes: rotos (ositively charged); the umber of rotos i a ucleus
More informationLecture 9: September 19
36-700: Probability ad Mathematical Statistics I Fall 206 Lecturer: Siva Balakrisha Lecture 9: September 9 9. Review ad Outlie Last class we discussed: Statistical estimatio broadly Pot estimatio Bias-Variace
More informationChapter 6 Sampling Distributions
Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationElementary manipulations of probabilities
Elemetary maipulatios of probabilities Set probability of multi-valued r.v. {=Odd} = +3+5 = /6+/6+/6 = ½ X X,, X i j X i j Multi-variat distributio: Joit probability: X true true X X,, X X i j i j X X
More informationCOMPUTING FOURIER SERIES
COMPUTING FOURIER SERIES Overview We have see i revious otes how we ca use the fact that si ad cos rereset comlete orthogoal fuctios over the iterval [-,] to allow us to determie the coefficiets of a Fourier
More informationConfidence intervals for proportions
Cofidece itervals for roortios Studet Activity 7 8 9 0 2 TI-Nsire Ivestigatio Studet 60 mi Itroductio From revious activity This activity assumes kowledge of the material covered i the activity Distributio
More informationBayesian Approach for ARMA Process and Its Application
Iteratioal Busiess Research October 008 Bayesia Aroach for ARMA Process ad Its Alicatio Chogju Fa Busiess School, Uiversity of Shaghai for Sciece ad Techology Shaghai 00093, Chia E-mail: cjfa@sh63.et Sha
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More informationThe Bayesian Learning Framework. Back to Maximum Likelihood. Naïve Bayes. Simple Example: Coin Tosses. Given a generative model
Back to Maximum Likelihood Give a geerative model f (x, y = k) =π k f k (x) Usig a geerative modellig approach, we assume a parametric form for f k (x) =f (x; k ) ad compute the MLE θ of θ =(π k, k ) k=
More informationProbability and MLE.
10-701 Probability ad MLE http://www.cs.cmu.edu/~pradeepr/701 (brief) itro to probability Basic otatios Radom variable - referrig to a elemet / evet whose status is ukow: A = it will rai tomorrow Domai
More informationEXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY
EXAMINATIONS OF THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA, 016 MODULE : Statistical Iferece Time allowed: Three hours Cadidates should aswer FIVE questios. All questios carry equal marks. The umber
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationAgreement of CI and HT. Lecture 13 - Tests of Proportions. Example - Waiting Times
Sigificace level vs. cofidece level Agreemet of CI ad HT Lecture 13 - Tests of Proportios Sta102 / BME102 Coli Rudel October 15, 2014 Cofidece itervals ad hypothesis tests (almost) always agree, as log
More informationLecture 10 October Minimaxity and least favorable prior sequences
STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationBIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH
BIOSAISICAL MEHODS FOR RANSLAIONAL & CLINICAL RESEARCH Direct Bioassays: REGRESSION APPLICAIONS COMPONENS OF A BIOASSAY he subject is usually a aimal, a huma tissue, or a bacteria culture, he aget is usually
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationECE534, Spring 2018: Final Exam
ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationA quick activity - Central Limit Theorem and Proportions. Lecture 21: Testing Proportions. Results from the GSS. Statistics and the General Population
A quick activity - Cetral Limit Theorem ad Proportios Lecture 21: Testig Proportios Statistics 10 Coli Rudel Flip a coi 30 times this is goig to get loud! Record the umber of heads you obtaied ad calculate
More informationSTA 250: Statistics. Notes 7. Bayesian Approach to Statistics. Book chapters: 7.2
STA 25: Statistics Notes 7. Bayesian Aroach to Statistics Book chaters: 7.2 1 From calibrating a rocedure to quantifying uncertainty We saw that the central idea of classical testing is to rovide a rigorous
More information1.010 Uncertainty in Engineering Fall 2008
MIT OpeCourseWare http://ocw.mit.edu.00 Ucertaity i Egieerig Fall 2008 For iformatio about citig these materials or our Terms of Use, visit: http://ocw.mit.edu.terms. .00 - Brief Notes # 9 Poit ad Iterval
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationEstimation for a Class of Generalized State-Space Space Models:
Estimatio for a Class of Geeralized State-Sace Sace Models: Richard A. Davis ad Gabriel Rodriuez-Yam Colorado State Uiversit htt://www.stat.colostate.edu/~rdavis/lectures Joit work with: William Dusmuir
More informationPutnam Training Exercise Counting, Probability, Pigeonhole Principle (Answers)
Putam Traiig Exercise Coutig, Probability, Pigeohole Pricile (Aswers) November 24th, 2015 1. Fid the umber of iteger o-egative solutios to the followig Diohatie equatio: x 1 + x 2 + x 3 + x 4 + x 5 = 17.
More informationPharmacogenomics. Yossi Levy Yossi Levy. Central Dogma of Molecular Biology
harmacogeomics Yossi Levy Cetral ogma of Molecular Biology Yossi Levy 0 Geome ad NA Geome cotais all biological iformatio Biological iformatio is ecoded i NA NA is divided to discrete uits called Gees
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationSongklanakarin Journal of Science and Technology SJST R1 Teerapabolarn
Soglaaari Joural of Sciece ad Techology SJST--.R Teeraabolar A No-uiform Boud o Biomial Aroimatio to the Beta Biomial Cumulative Distributio Fuctio Joural: Soglaaari Joural of Sciece ad Techology For Review
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationStatistics 300: Elementary Statistics
Statistics 300: Elemetary Statistics Sectios 7-, 7-3, 7-4, 7-5 Parameter Estimatio Poit Estimate Best sigle value to use Questio What is the probability this estimate is the correct value? Parameter Estimatio
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationExpectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationThree classification models Discriminant Model: learn the decision boundary directly and apply it to determine the class of each data point
Review of Last Wee Three classificatio models Discrimiat Model: lear the decisio boudary directly ad aly it to determie the class of each data oit Discrimiative Model: lear PY directly Geerative Model:
More informationChapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE. Part 3: Summary of CI for µ Confidence Interval for a Population Proportion p
Chapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE Part 3: Summary of CI for µ Cofidece Iterval for a Populatio Proportio p Sectio 8-4 Summary for creatig a 100(1-α)% CI for µ: Whe σ 2 is kow ad paret
More informationExpectation-Maximization Algorithm.
Expectatio-Maximizatio Algorithm. Petr Pošík Czech Techical Uiversity i Prague Faculty of Electrical Egieerig Dept. of Cyberetics MLE 2 Likelihood.........................................................................................................
More informationL S => logf y i P x i ;S
Three Classical Tests; Wald, LM(core), ad LR tests uose that we hae the desity y; of a model with the ull hyothesis of the form H ; =. Let L be the log-likelihood fuctio of the model ad be the MLE of.
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More information6. Sufficient, Complete, and Ancillary Statistics
Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationInterval Estimation (Confidence Interval = C.I.): An interval estimate of some population parameter is an interval of the form (, ),
Cofidece Iterval Estimatio Problems Suppose we have a populatio with some ukow parameter(s). Example: Normal(,) ad are parameters. We eed to draw coclusios (make ifereces) about the ukow parameters. We
More informationJohn H. J. Einmahl Tilburg University, NL. Juan Juan Cai Tilburg University, NL
Estimatio of the margial exected shortfall Laures de Haa, Poitiers, 202 Estimatio of the margial exected shortfall Jua Jua Cai Tilburg iversity, NL Laures de Haa Erasmus iversity Rotterdam, NL iversity
More information1 Models for Matched Pairs
1 Models for Matched Pairs Matched pairs occur whe we aalyse samples such that for each measuremet i oe of the samples there is a measuremet i the other sample that directly relates to the measuremet i
More informationStatistics Definition: The science of assembling, classifying, tabulating, and analyzing data or facts:
8. Statistics Statistics Defiitio: The sciece of assemblig, classifyig, tabulatig, ad aalyzig data or facts: Descritive statistics The collectig, grouig ad resetig data i a way that ca be easily uderstood
More informationLECTURE NOTES 9. 1 Point Estimation. 1.1 The Method of Moments
LECTURE NOTES 9 Poit Estimatio Uder the hypothesis that the sample was geerated from some parametric statistical model, a atural way to uderstad the uderlyig populatio is by estimatig the parameters of
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationParameter, Statistic and Random Samples
Parameter, Statistic ad Radom Samples A parameter is a umber that describes the populatio. It is a fixed umber, but i practice we do ot kow its value. A statistic is a fuctio of the sample data, i.e.,
More informationSTA Learning Objectives. Population Proportions. Module 10 Comparing Two Proportions. Upon completing this module, you should be able to:
STA 2023 Module 10 Comparig Two Proportios Learig Objectives Upo completig this module, you should be able to: 1. Perform large-sample ifereces (hypothesis test ad cofidece itervals) to compare two populatio
More informationRegression and generalization
Regressio ad geeralizatio CE-717: Machie Learig Sharif Uiversity of Techology M. Soleymai Fall 2016 Curve fittig: probabilistic perspective Describig ucertaity over value of target variable as a probability
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationYALE UNIVERSITY DEPARTMENT OF COMPUTER SCIENCE
YALE UNIVERSITY DEPARTMENT OF COMPUTER SCIENCE CPSC 467a: Crytograhy ad Comuter Security Notes 16 (rev. 1 Professor M. J. Fischer November 3, 2008 68 Legedre Symbol Lecture Notes 16 ( Let be a odd rime,
More informationMTH 212 Formulas page 1 out of 7. Sample variance: s = Sample standard deviation: s = s
MTH Formula age out of 7 DESCRIPTIVE TOOLS Poulatio ize = N Samle ize = x x+ x +... + x x Poulatio mea: µ = Samle mea: x = = N ( µ ) ( x x) Poulatio variace: = Samle variace: = N Poulatio tadard deviatio:
More informationElement sampling: Part 2
Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig
More informationA NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES. Dennis D. Boos
.- A NEW METHOD FOR CONSTRUCTING APPROXIMATE CONFIDENCE INTERVALS FOR M-ESTU1ATES by Deis D. Boos Departmet of Statistics North Carolia State Uiversity Istitute of Statistics Mimeo Series #1198 September,
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationPUTNAM TRAINING PROBABILITY
PUTNAM TRAINING PROBABILITY (Last udated: December, 207) Remark. This is a list of exercises o robability. Miguel A. Lerma Exercises. Prove that the umber of subsets of {, 2,..., } with odd cardiality
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More information(7 One- and Two-Sample Estimation Problem )
34 Stat Lecture Notes (7 Oe- ad Two-Sample Estimatio Problem ) ( Book*: Chapter 8,pg65) Probability& Statistics for Egieers & Scietists By Walpole, Myers, Myers, Ye Estimatio 1 ) ( ˆ S P i i Poit estimate:
More informationSummary. Recap ... Last Lecture. Summary. Theorem
Last Lecture Biostatistics 602 - Statistical Iferece Lecture 23 Hyu Mi Kag April 11th, 2013 What is p-value? What is the advatage of p-value compared to hypothesis testig procedure with size α? How ca
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More informationBIOSTATISTICS. Lecture 5 Interval Estimations for Mean and Proportion. dr. Petr Nazarov
Microarray Ceter BIOSTATISTICS Lecture 5 Iterval Estimatios for Mea ad Proportio dr. Petr Nazarov 15-03-013 petr.azarov@crp-sate.lu Lecture 5. Iterval estimatio for mea ad proportio OUTLINE Iterval estimatios
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationChapter 6: BINOMIAL PROBABILITIES
Charles Bocelet, Probability, Statistics, ad Radom Sigals," Oxford Uiversity Press, 016. ISBN: 978-0-19-00051-0 Chater 6: BINOMIAL PROBABILITIES Sectios 6.1 Basics of the Biomial Distributio 6. Comutig
More informationEstimation Theory Chapter 3
stimatio Theory Chater 3 Likelihood Fuctio Higher deedece of data PDF o ukow arameter results i higher estimatio accuracy amle : If ˆ If large, W, Choose  P  small,  W POOR GOOD i Oly data samle Data
More informationCoping with Insufficient Data: The Case of Household Automobile Holding Modeling by Ryuichi Kitamura and Toshiyuki Yamamoto
Coig with Isufficiet Data: he Case of ousehold utomobile oldig odelig by Ryuichi Kitamura ad oshiyuki Yamamoto It is ofte the case that tyically available data do ot cotai all the variables that are desired
More information15-780: Graduate Artificial Intelligence. Density estimation
5-780: Graduate Artificial Itelligece Desity estimatio Coditioal Probability Tables (CPT) But where do we get them? P(B)=.05 B P(E)=. E P(A B,E) )=.95 P(A B, E) =.85 P(A B,E) )=.5 P(A B, E) =.05 A P(J
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio
More informationThe Sampling Distribution of the Maximum. Likelihood Estimators for the Parameters of. Beta-Binomial Distribution
Iteratioal Mathematical Forum, Vol. 8, 2013, o. 26, 1263-1277 HIKARI Ltd, www.m-hikari.com http://d.doi.org/10.12988/imf.2013.3475 The Samplig Distributio of the Maimum Likelihood Estimators for the Parameters
More information