Probability in Medical Imaging

Size: px
Start display at page:

Download "Probability in Medical Imaging"

Transcription

1 Chapter P Probability i Meical Imagig Cotets Itrouctio P1 Probability a isotropic emissios P2 Raioactive ecay statistics P4 Biomial coutig process P4 Half-life P5 Poisso process P6 Determiig activity of a source P6 Noise i meical imagig systems P6 Itrouctio These otes summarize a few probability topics that are relevat to meical imagig A fuametal limitatio of ay meical imagig system is the presece of oise i the measuremets There are o easy solutios to reucig oise I X-ray imagig oe coul reuce oise by icreasig the source itesity, but that woul icrease the raiatio ose to the patiet I ay moality oe coul collect multiple scas a average them to reuce oise, but this by icreases the sca time thereby icreasig the likelihoo of patiet motio artifacts (It also reuces scaer throughput, compromisig the cost effectiveess of the sca) I some moalities oe ca reuce oise by usig a etector that is more sesitive, but this comes either with a traeoff i spatial resolutio, or a icrease i the system price I ay case, oise cosieratios are very importat i meical imagig, a the basic tool use for oise aalysis is probability a raom processes Although probability is ot a official prerequisite for EECS 516, ABET requires that all accreite uergrauate egieerig programs cover probability a statistics A goo referece for the cocepts eee i this class is the book by Leo-Garcia [1] P1

2 P2 c J Fessler, September 12, 2007, 10:0 (stuet versio) Probability a isotropic emissios (Serves to illustrate basic raom variables cocepts) A poit source at a istace from a plaar etector emits photos isotropically (withi a plae for simplicity) The agle of emissio is a raom variable Θ Uiform[ π,π] y Poit Source θ max Θ r Y y 0 0 We wish to etermie the itesity of photos iciet o the etector, efie here as the average umber of photos per uit area (Actually, per uit legth here sice we are cosierig a 1D etector) Some etectors oly capture photos that are iciet withi a certai critical agle θ max, where 0 < θ max π/2 (For a hypothetical ieal etector we ca simply let θ max = π/2 i our fial expressios) Provie Θ θ max, the photo strikes the etector at positio Y = y 0 + ta Θ If a average of N photos are emitte from the source, the we efie the itesity o the etector to be I(y) = N p Y C (y C) P(C) where p Y C (y C) is the coitioal probability esity fuctio (pf) of Y a where C is the evet that a give photo is capture: C = [ Θ θ max ] Sice Θ has a uiform istributio over [ π,π], the capture probability is: P{C} = ( )/(2π) = θ max /π Iterpretatio of itesity: the expecte umber of photos that are recore by the etector betwee y 1 a y 2 is: y2 y 1 I(y)y From elemetary probability: p Θ (θ) = { 1 2π, θ π 0, otherwise a p Θ C (θ C) = p { 1 Θ(θ) P{C} 1 { θ θ max} =, θ θ max 0, otherwise For Θ θ max there is a mootoe ifferetiable relatioship betwee Y a Θ Thus this is a simple trasformatio of raom variables problem From elemetary trasformatio of raom variables: p Y C (y C) = p Θ C (θ C) θ y θ=ta 1 [(y y 0)/]

3 c J Fessler, September 12, 2007, 10:0 (stuet versio) P3 Sice /x ta 1 x = 1/(1 + x 2 ), θ y = 2 + (y y 0 ) 2 = cos2 θ = cos θ, r which ca be iterprete as a 1/r falloff of itesity (sice circumferece of circle is 2πr r) times a obliquity factor cos θ ue to agle of iciece betwee photos a etector (More o that later) Thus Alterative erivatio: p Y C (y C) = { 1 2 +(y y 0), 2 y y 0 ta θ max 0, otherwise, F Y C (y C) = P{Y y C} = P{y 0 + ta Θ y C} = P { Θ ta 1 ((y y 0 )/) C } = F Θ C (ta 1 ((y y 0 )/) C) the take erivative of both sies wrt y Mea: E[Y C] = y p Y C (y C) y = y0+ ta θ max 1 y y 0 ta θ max 2 + (y y 0 ) 2 y = y 0 where the itegral is y 0 ue to the symmetry of the pf p Y C (y C) However, for θ max = π/2 the mea is uefie (For θ max = π/2 the pf is a Cauchy istributio, for which the mea is ot efie) Variace (a measure of the sprea of the PSF): Var{Y C} = E [ (Y E[Y C]) 2 C ] = (y y 0 ) 2 p Y C (y C) y = + ta θmax = 2 1 x x = (x ta 1 x) ta θ max 1 + x2 y0+ ta θ max y 0 ta θ max [(y y 0 )/] [(y y 0 )/] 2 y + ta θ max ta θ max = 2 where x = (y y 0 )/ a y = x The variace approaches ifiity as θ max π/2 θ max (ta θ max θ max ) Example Suppose = N = 1000 photos are emitte, let X eote the umber that strike etector betwee y 1 a y 2 Fi statistics of X The probability that a give photo strikes betwee y 1 a y 2 is p = y 2 y 1 I(y)y / = y 2 y 1 p Y C (y C) P{C} y Assumig photos are iepeet, X is a Biomial raom variable: P{X = k} = ( k where q = 1 p Mea of X is E[X] = p, variace is σ 2 X = pq ) p k q k

4 P4 c J Fessler, September 12, 2007, 10:0 (stuet versio) Raioactive ecay statistics (This sectio also serves to review probability: Biomial, Poisso, mea, ) For emissio tomography or uclear imagig, we will ee to kow the statistics of ecay of raioactive samples Cosier a raioactive sample cotaiig a large umber N = of (ustable) uclei at time t = 0 Let T i eote the raom variable that is the time at which the ith ucleus ecays to a stable state, eg, emits a γ photo Assume the followig The T i values are iepeet raom variables, i = 1,2,, Each T i has a expoetial istributio with mea µ T As show below, µ T is relate to the half-life of the isotope Why assume a expoetial istributio? Uique to expoetial is the memoryless property: P{T i t T i t 0 } = P{T i t t 0 } for t t 0 Also see p 349 of Leo-Garcia, 2 e for at raom property Also agrees with empirical observatios Biomial coutig process Let K(t) be raom process that couts the umber of uclei that have ecaye by time t K(0) = 0 K(t) = i=1 step(t T i), where step(t) eotes the uit step fuctio, ie, { 1, t 0 step(t) = 0, otherwise Oe expects that all uclei will ecay evetually, ie, For t 0 efie The lim P{K(t) = N = } = 1 t p t = P{T i t} = 1 e t/µt P{K(t) = k N = } = P{k out of of the T i values are less tha t} = ( k ) p k t (1 p t ) Thus K(t) is a Biomial process that couts from 0 to a icremets at raom times Note ( ) P{K(t) = N = } = p t (1 p t ) = p t = (1 e t/µt ) 1 as t The mea fuctio (versus time) is particularly importat: E[K(t) N = ] = p t = By Taylor series, 1 e x x for small x Thus for small t: E[K(t) N = ] µ T t (1 e t/µt )

5 c J Fessler, September 12, 2007, 10:0 (stuet versio) P5 Half-life The half-life of a isotope is the time t 1/2 for which E [ K(t 1/2 ) N = ] = 1 2 Solvig yiels: t 1/2 = µ T l 2 Alteratively, you coul efie it as the time at which the rate of ecays r t is half of iitial rate r 0 r t = t E[K(t) N = ] = t (1 e t/µt ) = /µ T e t/µt Solvig the equality r t1/2 = 1 2 r 0 yies the same expressio for t 1/2, so either iterpretatio works If is large but p t is small, the Biomial istributio is approximately same as Poisso istributio, ie, P{K(t) = k N = } e λt λk t k! where λ t = p t = (1 e t/µt ) /µ T t for t small So for t small, K(t) approximately has the first-orer istributio of a Poisso process (Derivig the kth-orer istributio is a exercise)

6 P6 c J Fessler, September 12, 2007, 10:0 (stuet versio) Poisso process Whe raioactive samples are purchase (eg, from a uclear reactor), the umber N of ustable uclei is ot kow exactly, but rather is a raom variable A reasoable assumptio (though this may seem circular) is that N is a Poisso raom variable with some mea µ N The by total probability the istributio of the coutig process K(t) is: ( P{K(t) = k} = P{K(t) = k N = } P{N = } = k =0 =k ) p k t (1 p t ) so uer the above assumptios, K(t) is a type of Poisso process Note that it is a ihomogeeous Poisso process sice its mea varies oliearly with time: ( ) E[K(t)] = µ N p t = µ N 1 e t/µt, ie, the rate of the process, efie as /t E[K(t)] varies with time However, for small t E[K(t)] µ N µ T t, so K(t) behaves very much like a homogeeous Poisso process for t µ T, with rate λ = µ N /µ T ( ) e µn µ N = e µn pt (µ N p t ) k /k!,! I this course we will assume, uless otherwise state, that the umber of emissios from a raioactive source i a give time iterval t is a Poisso raom variable with mea λ t, where λ is calle the activity of the source The SI uit of activity is the Becquerel (Bq), where 1 Bq is equivalet to a rate of 1 ecay (or cout ) per seco I aily practice i the US, the historical uit of Curies (Ci) is still use frequetly, where 1 Ci = Bq Determiig activity of a source Suppose you have a source (such as mouse liver extracte from a mouse previously ijecte with a raiotracer) where λ is ukow If we cout the source i well couter for time t 0 ; we observe K(t 0 ) (total umber of couts i t 0 secos) The maximumlikelihoo estimator for λ is: ˆλ = K(t 0) t 0 This estimator is ubiase because: ] [ ] K(t0 ) E[ˆλ = E = E[K(t 0)] = λt 0 = λ t 0 t 0 } Var{ˆλ = Var t 0 { } K(t0 ) t 0 = Var{K(t 0)} t 2 0 = λt 0 t 2 0 As t 0 icreases, variace of ˆλ ecreases, ie, the precisio of the estimate improves = λ t 0 Noise i meical imagig systems From above, imagig with raioisotopes yiels Poisso measuremets X-ray imagig also is omiate by Poisso oise The emissio of photos from the X-ray source is very realistically moele by a Poisso process sice the curret to the aoe esures a cotiual supply of photos, i cotrast to uclear imagig where there is oly a fiite (but large) umber of uclei i a give source The omiat oise source i both NMR a ultrasou systems is electroic oise This ca be simply moele as a zero-mea, Gaussia process Aother oise source i ultrasou (a optical a RADAR systems) is speckle oise This oise is irectly relate to the coherece of ultrasou imagig Bibliography [1] A Leo-Garcia Probability a raom processes for electrical egieerig Aiso-Wesley, New York, 2 eitio, 1994

Chapter 2 Transformations and Expectations

Chapter 2 Transformations and Expectations Chapter Trasformatios a Epectatios Chapter Distributios of Fuctios of a Raom Variable Problem: Let be a raom variable with cf F ( ) If we efie ay fuctio of, say g( ) g( ) is also a raom variable whose

More information

(average number of points per unit length). Note that Equation (9B1) does not depend on the

(average number of points per unit length). Note that Equation (9B1) does not depend on the EE603 Class Notes 9/25/203 Joh Stesby Appeix 9-B: Raom Poisso Poits As iscusse i Chapter, let (t,t 2 ) eote the umber of Poisso raom poits i the iterval (t, t 2 ]. The quatity (t, t 2 ) is a o-egative-iteger-value

More information

Inhomogeneous Poisson process

Inhomogeneous Poisson process Chapter 22 Ihomogeeous Poisso process We coclue our stuy of Poisso processes with the case of o-statioary rates. Let us cosier a arrival rate, λ(t), that with time, but oe that is still Markovia. That

More information

The Poisson Process *

The Poisson Process * OpeStax-CNX module: m11255 1 The Poisso Process * Do Johso This work is produced by OpeStax-CNX ad licesed uder the Creative Commos Attributio Licese 1.0 Some sigals have o waveform. Cosider the measuremet

More information

3. Calculus with distributions

3. Calculus with distributions 6 RODICA D. COSTIN 3.1. Limits of istributios. 3. Calculus with istributios Defiitio 4. A sequece of istributios {u } coverges to the istributio u (all efie o the same space of test fuctios) if (φ, u )

More information

Commonly Used Distributions and Parameter Estimation

Commonly Used Distributions and Parameter Estimation Commoly Use Distributios a Parameter stimatio Berli Che Departmet of Computer Sciece & Iformatio gieerig Natioal Taiwa Normal Uiversity Referece:. W. Navii. Statistics for gieerig a Scietists. Chapter

More information

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4

MATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4 MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.

More information

Approximations and more PMFs and PDFs

Approximations and more PMFs and PDFs Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.

More information

6.3.3 Parameter Estimation

6.3.3 Parameter Estimation 130 CHAPTER 6. ARMA MODELS 6.3.3 Parameter Estimatio I this sectio we will iscuss methos of parameter estimatio for ARMAp,q assumig that the orers p a q are kow. Metho of Momets I this metho we equate

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

The Chi Squared Distribution Page 1

The Chi Squared Distribution Page 1 The Chi Square Distributio Page Cosier the istributio of the square of a score take from N(, The probability that z woul have a value less tha is give by z / g ( ( e z if > F π, if < z where ( e g e z

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Expectation maximization

Expectation maximization Motivatio Expectatio maximizatio Subhrasu Maji CMSCI 689: Machie Learig 14 April 015 Suppose you are builig a aive Bayes spam classifier. After your are oe your boss tells you that there is o moey to label

More information

Lecture 2: Poisson Sta*s*cs Probability Density Func*ons Expecta*on and Variance Es*mators

Lecture 2: Poisson Sta*s*cs Probability Density Func*ons Expecta*on and Variance Es*mators Lecture 2: Poisso Sta*s*cs Probability Desity Fuc*os Expecta*o ad Variace Es*mators Biomial Distribu*o: P (k successes i attempts) =! k!( k)! p k s( p s ) k prob of each success Poisso Distributio Note

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Computing Confidence Intervals for Sample Data

Computing Confidence Intervals for Sample Data Computig Cofidece Itervals for Sample Data Topics Use of Statistics Sources of errors Accuracy, precisio, resolutio A mathematical model of errors Cofidece itervals For meas For variaces For proportios

More information

Analytic Number Theory Solutions

Analytic Number Theory Solutions Aalytic Number Theory Solutios Sea Li Corell Uiversity sl6@corell.eu Ja. 03 Itrouctio This ocumet is a work-i-progress solutio maual for Tom Apostol s Itrouctio to Aalytic Number Theory. The solutios were

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

9.3 constructive interference occurs when waves build each other up, producing a resultant wave of greater amplitude than the given waves

9.3 constructive interference occurs when waves build each other up, producing a resultant wave of greater amplitude than the given waves Iterferece of Waves i Two Dimesios Costructive a estructive iterferece may occur i two imesios, sometimes proucig fixe patters of iterferece. To prouce a fixe patter, the iterferig waves must have the

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Monte Carlo Integration

Monte Carlo Integration Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce

More information

AP Calculus BC Summer Math Packet

AP Calculus BC Summer Math Packet AP Calculus BC Summer Math Packet This is the summer review a preparatio packet for stuets eterig AP Calculus BC. Dear Bear Creek Calculus Stuet, The first page is the aswer sheet for the attache problems.

More information

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object

Last time: Moments of the Poisson distribution from its generating function. Example: Using telescope to measure intensity of an object 6.3 Stochastic Estimatio ad Cotrol, Fall 004 Lecture 7 Last time: Momets of the Poisso distributio from its geeratig fuctio. Gs () e dg µ e ds dg µ ( s) µ ( s) µ ( s) µ e ds dg X µ ds X s dg dg + ds ds

More information

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS

January 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

Definition 2 (Eigenvalue Expansion). We say a d-regular graph is a λ eigenvalue expander if

Definition 2 (Eigenvalue Expansion). We say a d-regular graph is a λ eigenvalue expander if Expaer Graphs Graph Theory (Fall 011) Rutgers Uiversity Swastik Kopparty Throughout these otes G is a -regular graph 1 The Spectrum Let A G be the ajacecy matrix of G Let λ 1 λ λ be the eigevalues of A

More information

The structure of Fourier series

The structure of Fourier series The structure of Fourier series Valery P Dmitriyev Lomoosov Uiversity, Russia Date: February 3, 2011) Fourier series is costructe basig o the iea to moel the elemetary oscillatio 1, +1) by the expoetial

More information

MATH 472 / SPRING 2013 ASSIGNMENT 2: DUE FEBRUARY 4 FINALIZED

MATH 472 / SPRING 2013 ASSIGNMENT 2: DUE FEBRUARY 4 FINALIZED MATH 47 / SPRING 013 ASSIGNMENT : DUE FEBRUARY 4 FINALIZED Please iclude a cover sheet that provides a complete setece aswer to each the followig three questios: (a) I your opiio, what were the mai ideas

More information

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn

Review Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom

More information

IIT JAM Mathematical Statistics (MS) 2006 SECTION A

IIT JAM Mathematical Statistics (MS) 2006 SECTION A IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim

More information

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19

Discrete Mathematics and Probability Theory Spring 2016 Rao and Walrand Note 19 CS 70 Discrete Mathematics ad Probability Theory Sprig 2016 Rao ad Walrad Note 19 Some Importat Distributios Recall our basic probabilistic experimet of tossig a biased coi times. This is a very simple

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS

NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS NANYANG TECHNOLOGICAL UNIVERSITY SYLLABUS FOR ENTRANCE EXAMINATION FOR INTERNATIONAL STUDENTS AO-LEVEL MATHEMATICS STRUCTURE OF EXAMINATION PAPER. There will be oe 2-hour paper cosistig of 4 questios.

More information

Statistical Fundamentals and Control Charts

Statistical Fundamentals and Control Charts Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,

More information

Math 2784 (or 2794W) University of Connecticut

Math 2784 (or 2794W) University of Connecticut ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number

Integrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios

More information

Simulation. Two Rule For Inverting A Distribution Function

Simulation. Two Rule For Inverting A Distribution Function Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump

More information

k=1 s k (x) (3) and that the corresponding infinite series may also converge; moreover, if it converges, then it defines a function S through its sum

k=1 s k (x) (3) and that the corresponding infinite series may also converge; moreover, if it converges, then it defines a function S through its sum 0. L Hôpital s rule You alreay kow from Lecture 0 that ay sequece {s k } iuces a sequece of fiite sums {S } through S = s k, a that if s k 0 as k the {S } may coverge to the it k= S = s s s 3 s 4 = s k.

More information

1 = 2 d x. n x n (mod d) d n

1 = 2 d x. n x n (mod d) d n HW2, Problem 3*: Use Dirichlet hyperbola metho to show that τ 2 + = 3 log + O. This ote presets the ifferet ieas suggeste by the stuets Daiel Klocker, Jürge Steiiger, Stefaia Ebli a Valerie Roiter for

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 27. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Marquette Uiversity MATH 700 Class 7 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, a Computer Sciece Copyright 07 by D.B. Rowe Marquette Uiversity MATH 700 Agea: Recap Chapter 0.-0.3 Lecture

More information

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).

Limit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p). Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.

More information

6. Sufficient, Complete, and Ancillary Statistics

6. Sufficient, Complete, and Ancillary Statistics Sufficiet, Complete ad Acillary Statistics http://www.math.uah.edu/stat/poit/sufficiet.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 6. Sufficiet, Complete, ad Acillary

More information

Exponential function and its derivative revisited

Exponential function and its derivative revisited Expoetial fuctio a its erivative revisite Weg Ki Ho, Foo Him Ho Natioal Istitute of Eucatio, Sigapore {wegki,foohim}.ho@ie.eu.sg Tuo Yeog Lee NUS High School of Math & Sciece hsleety@us.eu.sg February

More information

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes.

IE 230 Seat # Name < KEY > Please read these directions. Closed book and notes. 60 minutes. IE 230 Seat # Name < KEY > Please read these directios. Closed book ad otes. 60 miutes. Covers through the ormal distributio, Sectio 4.7 of Motgomery ad Ruger, fourth editio. Cover page ad four pages of

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Test One (Answer Key)

Test One (Answer Key) CS395/Ma395 (Sprig 2005) Test Oe Name: Page 1 Test Oe (Aswer Key) CS395/Ma395: Aalysis of Algorithms This is a closed book, closed otes, 70 miute examiatio. It is worth 100 poits. There are twelve (12)

More information

Statistics 20: Final Exam Solutions Summer Session 2007

Statistics 20: Final Exam Solutions Summer Session 2007 1. 20 poits Testig for Diabetes. Statistics 20: Fial Exam Solutios Summer Sessio 2007 (a) 3 poits Give estimates for the sesitivity of Test I ad of Test II. Solutio: 156 patiets out of total 223 patiets

More information

Chapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE. Part 3: Summary of CI for µ Confidence Interval for a Population Proportion p

Chapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE. Part 3: Summary of CI for µ Confidence Interval for a Population Proportion p Chapter 8: STATISTICAL INTERVALS FOR A SINGLE SAMPLE Part 3: Summary of CI for µ Cofidece Iterval for a Populatio Proportio p Sectio 8-4 Summary for creatig a 100(1-α)% CI for µ: Whe σ 2 is kow ad paret

More information

Lecture 5. Random variable and distribution of probability

Lecture 5. Random variable and distribution of probability Itroductio to theory of probability ad statistics Lecture 5. Radom variable ad distributio of probability prof. dr hab.iż. Katarzya Zarzewsa Katedra Eletroii, AGH e-mail: za@agh.edu.pl http://home.agh.edu.pl/~za

More information

d dx where k is a spring constant

d dx where k is a spring constant Vorlesug IX Harmoic Oscillator 1 Basic efiitios a properties a classical mechaics Oscillator is efie as a particle subject to a liear force fiel The force F ca be epresse i terms of potetial fuctio V F

More information

CAMI Education linked to CAPS: Mathematics. Grade The main topics in the FET Mathematics Curriculum NUMBER

CAMI Education linked to CAPS: Mathematics. Grade The main topics in the FET Mathematics Curriculum NUMBER - 1 - CAMI Eucatio like to CAPS: Grae 1 The mai topics i the FET Curriculum NUMBER TOPIC 1 Fuctios Number patters, sequeces a series 3 Fiace, growth a ecay 4 Algebra 5 Differetial Calculus 6 Probability

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

The Poisson Distribution

The Poisson Distribution MATH 382 The Poisso Distributio Dr. Neal, WKU Oe of the importat distributios i probabilistic modelig is the Poisso Process X t that couts the umber of occurreces over a period of t uits of time. This

More information

PHYS-3301 Lecture 7. CHAPTER 4 Structure of the Atom. Rutherford Scattering. Sep. 18, 2018

PHYS-3301 Lecture 7. CHAPTER 4 Structure of the Atom. Rutherford Scattering. Sep. 18, 2018 CHAPTER 4 Structure of the Atom PHYS-3301 Lecture 7 4.1 The Atomic Models of Thomso ad Rutherford 4.2 Rutherford Scatterig 4.3 The Classic Atomic Model 4.4 The Bohr Model of the Hydroge Atom 4.5 Successes

More information

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:

Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Math 224 Fall 2017 Homework 4 Drew Armstrog Problems from 9th editio of Probability ad Statistical Iferece by Hogg, Tais ad Zimmerma: Sectio 2.3, Exercises 16(a,d),18. Sectio 2.4, Exercises 13, 14. Sectio

More information

Lecture #3. Math tools covered today

Lecture #3. Math tools covered today Toay s Program:. Review of previous lecture. QM free particle a particle i a bo. 3. Priciple of spectral ecompositio. 4. Fourth Postulate Math tools covere toay Lecture #3. Lear how to solve separable

More information

6 Infinite random sequences

6 Infinite random sequences Tel Aviv Uiversity, 2006 Probability theory 55 6 Ifiite radom sequeces 6a Itroductory remarks; almost certaity There are two mai reasos for eterig cotiuous probability: ifiitely high resolutio; edless

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

ME 375 FINAL EXAM Friday, May 6, 2005

ME 375 FINAL EXAM Friday, May 6, 2005 ME 375 FINAL EXAM Friay, May 6, 005 Divisio: Kig 11:30 / Cuigham :30 (circle oe) Name: Istructios (1) This is a close book examiatio, but you are allowe three 8.5 11 crib sheets. () You have two hours

More information

Classical Electrodynamics

Classical Electrodynamics A First Look at Quatum Physics Classical Electroyamics Chapter Itrouctio a Survey Classical Electroyamics Prof. Y. F. Che Cotets A First Look at Quatum Physics. Coulomb s law a electric fiel. Electric

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

INF-GEO Solutions, Geometrical Optics, Part 1

INF-GEO Solutions, Geometrical Optics, Part 1 INF-GEO430 20 Solutios, Geometrical Optics, Part Reflectio by a symmetric triagular prism Let be the agle betwee the two faces of a symmetric triagular prism. Let the edge A where the two faces meet be

More information

Sequences. A Sequence is a list of numbers written in order.

Sequences. A Sequence is a list of numbers written in order. Sequeces A Sequece is a list of umbers writte i order. {a, a 2, a 3,... } The sequece may be ifiite. The th term of the sequece is the th umber o the list. O the list above a = st term, a 2 = 2 d term,

More information

INFINITE SEQUENCES AND SERIES

INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES INFINITE SEQUENCES AND SERIES I geeral, it is difficult to fid the exact sum of a series. We were able to accomplish this for geometric series ad the series /[(+)]. This is

More information

C. Complex Numbers. x 6x + 2 = 0. This equation was known to have three real roots, given by simple combinations of the expressions

C. Complex Numbers. x 6x + 2 = 0. This equation was known to have three real roots, given by simple combinations of the expressions C. Complex Numbers. Complex arithmetic. Most people thik that complex umbers arose from attempts to solve quadratic equatios, but actually it was i coectio with cubic equatios they first appeared. Everyoe

More information

Confidence Level We want to estimate the true mean of a random variable X economically and with confidence.

Confidence Level We want to estimate the true mean of a random variable X economically and with confidence. Cofidece Iterval 700 Samples Sample Mea 03 Cofidece Level 095 Margi of Error 0037 We wat to estimate the true mea of a radom variable X ecoomically ad with cofidece True Mea μ from the Etire Populatio

More information

1 Review and Overview

1 Review and Overview CS229T/STATS231: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #12 Scribe: Garrett Thomas, Pega Liu October 31, 2018 1 Review a Overview Recall the GAN setup: we have iepeet samples x 1,..., x raw

More information

How to Maximize a Function without Really Trying

How to Maximize a Function without Really Trying How to Maximize a Fuctio without Really Tryig MARK FLANAGAN School of Electrical, Electroic ad Commuicatios Egieerig Uiversity College Dubli We will prove a famous elemetary iequality called The Rearragemet

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

1. Do the following sequences converge or diverge? If convergent, give the limit. Explicitly show your reasoning. 2n + 1 n ( 1) n+1.

1. Do the following sequences converge or diverge? If convergent, give the limit. Explicitly show your reasoning. 2n + 1 n ( 1) n+1. Solutio: APPM 36 Review #3 Summer 4. Do the followig sequeces coverge or iverge? If coverget, give the limit. Eplicitly show your reasoig. a a = si b a = { } + + + 6 c a = e Solutio: a Note si a so, si

More information

Department of Civil Engineering-I.I.T. Delhi CEL 899: Environmental Risk Assessment HW5 Solution

Department of Civil Engineering-I.I.T. Delhi CEL 899: Environmental Risk Assessment HW5 Solution Departmet of Civil Egieerig-I.I.T. Delhi CEL 899: Evirometal Risk Assessmet HW5 Solutio Note: Assume missig data (if ay) ad metio the same. Q. Suppose X has a ormal distributio defied as N (mea=5, variace=

More information

Hauptman and Karle Joint and Conditional Probability Distributions. Robert H. Blessing, HWI/UB Structural Biology Department, January 2003 ( )

Hauptman and Karle Joint and Conditional Probability Distributions. Robert H. Blessing, HWI/UB Structural Biology Department, January 2003 ( ) Hauptma ad Karle Joit ad Coditioal Probability Distributios Robert H Blessig HWI/UB Structural Biology Departmet Jauary 00 ormalized crystal structure factors are defied by E h = F h F h = f a hexp ihi

More information

Modeling and Performance Analysis with Discrete-Event Simulation

Modeling and Performance Analysis with Discrete-Event Simulation Simulatio Modelig ad Performace Aalysis with Discrete-Evet Simulatio Chapter 5 Statistical Models i Simulatio Cotets Basic Probability Theory Cocepts Useful Statistical Models Discrete Distributios Cotiuous

More information

Course Outline. Problem Identification. Engineering as Design. Amme 3500 : System Dynamics and Control. System Response. Dr. Stefan B.

Course Outline. Problem Identification. Engineering as Design. Amme 3500 : System Dynamics and Control. System Response. Dr. Stefan B. Course Outlie Amme 35 : System Dyamics a Cotrol System Respose Week Date Cotet Assigmet Notes Mar Itrouctio 8 Mar Frequecy Domai Moellig 3 5 Mar Trasiet Performace a the s-plae 4 Mar Block Diagrams Assig

More information

Sparsification using Regular and Weighted. Graphs

Sparsification using Regular and Weighted. Graphs Sparsificatio usig Regular a Weighte 1 Graphs Aly El Gamal ECE Departmet a Cooriate Sciece Laboratory Uiversity of Illiois at Urbaa-Champaig Abstract We review the state of the art results o spectral approximatio

More information

ADVANCED SOFTWARE ENGINEERING

ADVANCED SOFTWARE ENGINEERING ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Introduction to Probability I: Expectations, Bayes Theorem, Gaussians, and the Poisson Distribution. 1

Introduction to Probability I: Expectations, Bayes Theorem, Gaussians, and the Poisson Distribution. 1 Itroductio to Probability I: Expectatios, Bayes Theorem, Gaussias, ad the Poisso Distributio. 1 Pakaj Mehta February 25, 2019 1 Read: This will itroduce some elemetary ideas i probability theory that we

More information

Lecture 6 Testing Nonlinear Restrictions 1. The previous lectures prepare us for the tests of nonlinear restrictions of the form:

Lecture 6 Testing Nonlinear Restrictions 1. The previous lectures prepare us for the tests of nonlinear restrictions of the form: Eco 75 Lecture 6 Testig Noliear Restrictios The previous lectures prepare us for the tests of oliear restrictios of the form: H 0 : h( 0 ) = 0 versus H : h( 0 ) 6= 0: () I this lecture, we cosier Wal,

More information

Math 6070 A Primer on Probability Theory

Math 6070 A Primer on Probability Theory Math 67 A Primer o Probability Theory Davar Khoshevisa Uiversity of Utah Sprig 214 Cotets 1 Probabilities 1 2 Distributio Fuctios 2 2.1 Discrete Raom Variables..................... 2 2.2 Cotiuous Raom

More information

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m? MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle

More information

( ) = p and P( i = b) = q.

( ) = p and P( i = b) = q. MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of

More information

Final Review for MATH 3510

Final Review for MATH 3510 Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable

More information

Mathematics 170B Selected HW Solutions.

Mathematics 170B Selected HW Solutions. Mathematics 17B Selected HW Solutios. F 4. Suppose X is B(,p). (a)fidthemometgeeratigfuctiom (s)of(x p)/ p(1 p). Write q = 1 p. The MGF of X is (pe s + q), sice X ca be writte as the sum of idepedet Beroulli

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

CS / MCS 401 Homework 3 grader solutions

CS / MCS 401 Homework 3 grader solutions CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of

More information

Department of Mathematics

Department of Mathematics Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets

More information

Summary. Recap. Last Lecture. Let W n = W n (X 1,, X n ) = W n (X) be a sequence of estimators for

Summary. Recap. Last Lecture. Let W n = W n (X 1,, X n ) = W n (X) be a sequence of estimators for Last Lecture Biostatistics 602 - Statistical Iferece Lecture 17 Asymptotic Evaluatio of oit Estimators Hyu Mi Kag March 19th, 2013 What is a Bayes Risk? What is the Bayes rule Estimator miimizig square

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.

Econ 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1. Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio

More information

Kinetics of Complex Reactions

Kinetics of Complex Reactions Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet

More information

THE INTEGRAL TEST AND ESTIMATES OF SUMS

THE INTEGRAL TEST AND ESTIMATES OF SUMS THE INTEGRAL TEST AND ESTIMATES OF SUMS. Itroductio Determiig the exact sum of a series is i geeral ot a easy task. I the case of the geometric series ad the telescoig series it was ossible to fid a simle

More information