QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, MAY 9, Examiners: Drs. K. M. Ramachandran and G. S. Ladde
|
|
- Ella Townsend
- 5 years ago
- Views:
Transcription
1 QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, MAY 9, 2015 Examiners: Drs. K. M. Ramachandran and G. S. Ladde INSTRUCTIONS: a. The quality is more important than the quantity. b. Attempt at least 2 problems from each part totaling at most 5 problems. c. In the absence of any Tables, students are expected to provide the solution of the data oriented problems in the form of the problem solving process. d. Students are also expected to exhibit the reading, writing and problem solving abilities. e. Just the mechanical work with an answer (if any) is not enough to receive the full credit. PART-1 1Þ Prove or disprove the following statements: a. The distribution of statistics is population distribution. b. If the marginal densities of random variables are identical,then they are independent. # # c. Z+<Ð+ \ + \ Ñœ+ Z+<Ð\ Ñ + Z+<Ð\ Ñ #+ + G9@Ð\ ß\ ÑÞ " " # # " " # # " # " # 2. Let \ß\ß\ be random sample drawn from exponentialð Ñpopulation. Find: " # $ " (i) \ Ð"Ñ (ii) \ Ð$Ñ (iii) the sample range. 3. Let \ ß \ ß ÞÞß \ be a sample ß \ œ Ð\ ß \ ß ÞÞß \ Ñ, X Ð\Ñ be a statisticsß 8 \œb ; V be observed sample set, and VÐXÑbe the range of statistics X. Let 0ÐBl )) be the joint pdf of the given the sample, \ " # 8 " # 8 X (a) If \ß\ßÞÞß\ " # 8 are Bernoulli random variables with parameter! ) " and 8 XÐ\Ñ œ \, then show that XÐ\Ñis sufficient statistics. 3œ" 3 (b) If \ß\ßÞÞß\ " # 8 are iid observations from discrete uniform distribution on Ö"ß #ß $ß ÞÞÞß ), ) R and X Ð\Ñ œ max 3 Ö\ " ß \# ß ÞÞß \ 8, then show that XÐ\Ñis sufficient statistics.
2 4. Let \ß\ßÞÞß\ " # 8be a random sample from Binomial Ð8ß:Ñdistribution, where both 8 and : are unknown. (a) By employing the Method of Moment, find estimators for both 8 and :. (b) Discuss a situation in which both 8 and : are unknown. (c) Five realizations of a binomial Ð8ß :Ñ experiment are observed. (i) The First data set is: 16, 18, 22, 25, 27, and (ii) the second data set is: 16, 18, 22, 25, 28. For these data sets, using the method of moment,calculate the estimates for 8 and :. (d) Compare the estimates in Problem 4(c). (e) What kind of conclusions can you draw from Problem 4(d)? 5. Let \ ß \ ß ÞÞß \ be a random sampleß \ œ Ð\ ß \ ß ÞÞß \ Ñ ß \ œ B ; V be observed sample set. Let 0ÐBl )) be the joint pdf of the given the sample, \, and let sup@ 9 PÐ) be an entire parameter set in V. 9 Á 9, let us define -ÐBÑ œ sup PÐ ) (a) Show that: (i)!ÿ- ÐBÑŸ"ßfor all B ;, (ii) As PÐ) lbñincreases, -ÐBÑdecreases, PÐs) 9lBÑ sup@ 91ÐXÐBÑl) Ñ (iii) -ÐBÑ œ PÐs) lbñ, (iv) -ÐBÑ œ sup 1ÐX ÐBÑl) Ñ œ - ÐX ÐBÑÑ, where X Ð\Ñ sufficient statistics and 0ÐBl) ) œ 1ÐX ÐBÑl) Ñ2ÐBÑà (iv) As lbñ decreases, -ÐBÑ increases. (b) Under what condition(s) 9, -Ð\Ñ is called as the Likelihood Ratio Test Statistics? (c) Assuming that -Ð\Ñ is Likelihood Ratio Test statistics, what can you say about : ÖB À -ÐBÑ Ÿ - for any number - satisfying! Ÿ - Ÿ "? " # 8 " # 8 X 8 PART-2 1. Let \ be normal random variable with mean. and variance 5 # ÞLet us further # # assume that. µrð. : ß 5: Ñand its prior distribution is 1 (.)..: and 5: are assumed to be either known or estimated. a) Find the marginal distribution of the given random. b) Define the likelihood function, PÐ) lbñ, where B is a realization of random variable \. c) Find a posterior distribution of ), 1 ()lb). d) Find the predictive distribution of an unknown observation B. #. Assume that all the given statements in Problem #"-Part-2 remain unchanged. Further assume that. œ "!ß 5 œ &ß 5 œ "! and B œ " 00Þ : : a) Find IÒ. lbó and IÒÐ. IÒ. ÓÑ # lbó Þ b) Find the precision of the normal distribution. c) Show that the IÒ. Ó œ IÒIÒ. lbóó and interpret it. d) Show that IÒvar Ð. lbñó œ var(.) var( IÒ. lbó) and interpret it.
3 3. Let :ÐBl) Ñ be a conditional density of a random variable \. The Jeffrey's prior is defined by: 1) ( ) º lmð) Ñl " #. Compute the Jeffrey's prior for ) for the following given a random sample \" ß \# ß ÞÞÞß \ 8 with iid: a) Exponential ("). b) Poisson (-). c) RÐ. ß 5 Ñ : : # %. Under the Bayesian approach, for given \ œ B, the 1 ÐÐ) lb) is posterior distribution of ). For ßthe credible probability of Eis defined by: T Ð) ElBÑ œ 1 ÐÐ) lb ).). E (a) Is there any relationship between the credible set and confidence set? Justify. (b) For a given \ß\ßÞÞß\ " # 8 random sample with Poisson (-) distribution, and - has " " a gamma Ð+ß,Ñprior. The posterior pdf of - is gamma Ð+ XÐBÑßÒ8 Ó Ñ, 8 where XÐ\Ñ œ \. Find the credible set for. 3œ" 3 - (c) In addition to the conditions in (b), assume that: 8œ"! and XÐBÑœ'. Find 90% credible set for -. &. Let \ be a random variable with Cauchy Ð!ß "Ñ distribution 0 ÐBÑ œ. \, " Ð" B Ñ 1 # a. Find: (i) J\ ÐBÑ, " (ii) J\ ÐBÑ(if it exists). b. Is it possible simulate the Cauchy Ð!ß "Ñ? Justify. c. If the answer to question in (b) is "YES", then is it possible to simulate Cauchy ( α" ß Ñ? GOOD LUCK
4 DEPARTMENT OF MATHEMATICS AND STATISTICS QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, SEPTEMBER 24, 2016 Examiners: Drs. K. M. Ramachandran and G. S. Ladde INSTRUCTIONS: a. The quality is more important than the quantity. b. Attempt at least 2 problems from each part totaling at most 5 problems. c. In the absence of any Tables, students are expected to provide the solution of the data oriented problems in the form of the problem solving process. d. Students are also expected to exhibit the reading, writing and problem solving abilities. e. Just the mechanical work with an answer (if any) is not enough to receive the full credit. PART-1 1. Let \ be a real-valued random variable defined on a complete probability space ÐH ß ¹ ß TÑ with singleton set range (R( \) œ ÖB any B R; where R is a set of real numbers). a. Find: a distribution function J \ of \. Justify bþ Find a probability density function 0 \ of \ (if exists). c. Draw the sketches of J\ and 0\ with justifications. d. What conclusion can be drawn from Parts (a), (b) and (c)? Justify. 2. Let \ß\ßÞÞß\ " # 8be a Bernoulli-type random sample drawn from a population # # mean. Ò!ß "Ó and variance 5 Ò!ß "ÓÞ \ and W sample mean and variance of the random sample. a. Find the joint distribution of the random sample ; b. Find: IÒ\ Ó; c. Find: Var Ò\Ó. # # d. Show that IÒW Ó œ 5 ß e. Based on your response in (a)-(d), what conclusions can you draw. Þ
5 3. Let \" ß \# ß ÞÞÞß \ 8ß ÞÞÞ be a sequence of iid random variables with mean ( IÒ\ 8 Ó œ., Z+<Ð\ Ñœ5 # ÑÞShow that: 8. # # # (a) W8 converges in probability to 5 as 8Ä, whenever Z+<ÐW8ÑÄ!Þ (b) Prove or disprove convergence or divergence of W 8. # (c) On the basis of (a) and (b),what types of conclusion can you draw about W and W? 8 4. Let \ß\ßÞÞß\ be a random sample defined in Problem 2 ÞLet XÐ\Ñbe defined " # œ" by: XÐ\Ñ œ \ Þ Prove or disprove the following statements: a. The distribution of XÐ\Ñis an exponential family. b. XÐ\Ñis sufficient statistics. 8 B 3 3œ" c. The Bernoulli MLE of. is.sœ Þ 8 5. Let \ ß \ ß ÞÞß \ be a random sampleß \ œ Ð\ ß \ ß ÞÞß \ Ñ ß \ œ B ; V be observed sample set. Let 0ÐBl )) be the joint pdf of the given the sample \, and let 1) ÐÑbe a prior distribution of ). be an entire parameter set in Á9. - Moreover, let T lbñ œ T Ð H! is true lbñ and T lbñ œ T Ð H " is truelbñþ (a) Define the "action set" with respect to the "Bayesian hypothesis testing problem". (b) Is the "hypothesis test" identical with a "decision rule"? Justify. (c) Define the loss function in the "hypothesis testing problem". (d) Define the rejection region for the "Bayesian hypothesis testing problem". (e) Determine the costs for Type I and II Error " # 8 " # 8 X 8 PART-2 1. Let \ be a binomial random variable with mean. Ò!ß "Ó and variance 5 # Ò!ß "Ó, and let \ß\ßÞÞß\ " # 8be a corresponding random sample drawn from this populatiom. In the Bayesian analysis, it is assumed that the parameter. is random variable. Let :ÐCß. Ñ be the joint distribution of Ð\ß. ÑÞ The binomial sampling model is denoted by :ÐCl. ÑÞ a. Justify the exchangeability property of :ÐCß. Ñ. b. Find the expression for the joint probability of \ and. c. Find the marginal distribution of the given random. d. Define the likelihood function, PÐ. lcñ, where B is a realization of random variable \.
6 2. Let ] µ Beta Ðα" ß Ñ and Z µ 0. Further assume Beta Ðα" ß Ñ and 0 have common Z Ò!ß "Ó with α œ #Þ(ß " œ 'Þ$ and - œ 2.67 œ sup 0 ] ÐCÑ Þ Let ÐY ß Z Ñ be independent and uniformly distributed random variables to generate a random variable. Show that: BetaÐα" ß ÑÐZ Ð= ÑÑ BetaÐα" ß ÑÐZ Ð= ÑÑ C (a) T Ö= ÀZÐ= ÑŸCand YÐ= ÑŸ œ -.?.@Þ BetaÐα" ß ÑÐZ Ð= ÑÑ " - - (b) T Ö= À YÐ= Ñ Ÿ = Þ -!! (c) T Ö= À ]Ð= ÑŸC œ T Ö= ÀZÐ= ÑŸC Ö = ÀYÐ= ÑŸ Þ (d) What conclusions can you draw from the results (a)-(c)? Z BetaÐα" ß ÑÐZ Ð= ÑÑ - 3. Let \ be a binomial random variable corresponding to the random sample in Problem 1 (Part 2). In the Bayesian analysis, it is assumed that the parameter. is random variable. Let :ÐCß. Ñ be the joint distribution of Ð\ß. ÑÞ The binomial sampling model is denoted by :ÐCl. ÑÞ In addition assume that :Ð. Ñ is prior distribution.. a. Find a posterior distribution of., :(. lc). b. If. µ Beta ( α, "), the find :(. lc). c. What conclusions can you draw from the conclusion of (b)? d. Using (b) find IÒ. lcó and Var Ð. lcñ. " C C e. Show that IÒ. lcó VarÐ. lcñ Ð" Ñthe α -level credible interval for Prove or disprove the following statement. a. The normal distribution has conjugate prior distribution. b. The Binomial distribution Ð8ß. Ñ has no conjugate prior distribution. c. The Poisson distribution has conjugate prior distribution. 5. Assume that all the conditions in Problem 1 (Part 2) are valid. a. Is it possible to determine the Fisher information MÐ. Ñ,. V? Justify. b. If the answer to the question in (a) is "YES", then find the Jeffrey's prior density. c. Based on your work in (b), is the prior in (b) proper or improper? Justify. GOOD LUCK
7 DEPARTMENT OF MATHEMATICS AND STATISTICS QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, SEPTEMBER 26, 2015 Examiners: Drs. K. M. Ramachandran and G. S. Ladde INSTRUCTIONS: a. The quality is more important than the quantity. b. Attempt at least 2 problems from each part totaling at most 5 problems. c. In the absence of any Tables, students are expected to provide the solution of the data oriented problems in the form of the problem solving process. d. Students are also expected to exhibit the reading, writing and problem solving abilities. e. Just the mechanical work with an answer (if any) is not enough to receive the full credit. PART-1 1. Let \ be a real-valued random variable defined on a complete probability space ÐH ß ¹ ß TÑ with singleton set range (R( \) œ ÖB for some B R). (a) Find: a distribution function J \ of \. Justify (b) Find a probability density function 0 \ of \ (if exists). (c) Draw the sketches of J\ and 0\ with justifications. (d) What conclusion can be drawn from Parts (a), (b), and (c)? Justify. 2. Let \" and \# be two random variables. (a) Does the independence of \" and \# imply J\ œ J\? Justify. " # (b) Does J\ œ J \ imply independence of \" and \#? Justify. " # (c) Under what conditions \ß\ is a random sample of size #? Justify. " # 3. Let \ß\ß\ß\ " # $ % and \& be iid observed from a distribution with mean. and # \ \ " # \ \ \ $ % & variance 5 Þ Let." œ # ß.# œ $ and. 3 œ \ be three estimators of.. (a) Calculate the variance of each estimator. Justify. (b) Compare the estimators in Problem 4 (a). Justify. (c) What conclusions can you draw from Problem 4 (b)? Justify.
8 4. Let H!, H 9 are defined in a hypothesis testing problem. Let \ß\ßÞÞß " # # # \ 8 be a random sample from R(.5 ß ), 5 known, and let \œð\ß\ßþþß " # X 8 \Ñß\œB 8 ; V, and we consider testing : H!:. œ.! versus H 1 :. Á. ). For fixed α level, a reasonable level test has rejection region: ÖlB.! l DαÎ# 5Î 8 Þ Determine: (a) The accepted set of sample elements of ;. (b) The probability of acceptance region. (c) The Confidence interval. 5. Which of the following statements are TRUE or FALSE? Justify your responses. (a) The true value is guaranteed by the point estimator rather than interval estimator. (b) For level α test, TÐReject H! Ÿ α and TÐAccept H! " α provide a basis to determine the α level region parameter estimationþ (c) For +,, the coverage probability of Ò+]ß,]Ó dependents on parameter ). (d) For +,, the coverage probability of Ò+ ]ß, ]Ó is independent of ). PART-2 1. Let \ be normal random variable with mean. and variance 5 # ÞLet us further # # assume that. µrð. : ß 5: Ñand its prior distribution is 1 (.)..: and 5: are assumed to be either known or estimated. a) Find the marginal distribution of the given random. b) Define the likelihood function, PÐ) lbñ, where B is a realization of random variable \. c) Find a posterior distribution of ), 1 ()lb). d) Find the α -level credible interval.. 2. Assume that all the given statements in Problem #4 remain unchanged. Further assume that. œ 3 ß 5 œ 5ß 5 œ 2 and B œ " 20Þ : : a) Find IÒ. lbó and IÒÐ. IÒ. ÓÑ # lbó Þ b) Find the precision of the normal distribution. c) Show that the IÒ. Ó œ IÒIÒ. lbóó and interpret it. d) Show that IÒvar Ð. lbñó œ var(.) var( IÒ. lbó) and interpret it.
9 3. Let :ÐBl) Ñ be a conditional density of a random variable \. The Fisher information # ` " and Jeffrey's prior are defined by: MÐ) Ñ œ IÒ ` # 68Ð:ÐBl) ÑÑ and 1 ()) º lmð) Ñl # ), respectively. Compute the Fisher and Jeffrey's prior for ) for the following given a random sample \" ß \# ß ÞÞÞß \ 8 with iid: a) Binomial(1, )). b) Exponential ()). c) Poisson ()) 4. Let \" ß \# ß ÞÞÞß \ 8be a random sample of size 8 from a population RÐ. ß 5 # Ñ with 5 # œ %Þ Further assume that. µ RÐ!ß "ÑÞ # (a) Find IÒ. lbó and IÒÐ. IÒ. lbóñ Þ (b) Find the precision of the normal distribution. (c) Find *&% credible interval for. 5. A change in stock price of AE follows binomial distribution with parameter! ) "ÞA random sample of 6 price changes were recorder. 3 out of 6 price changes were upward direction. Knowing the past knowledge, the values of prior distribution 1) ( ) at )œ!þ%ß!þ&ß!þ'ß and!þ) are 0.1, 0.2, 0.4, and 0.3, respectively. a) For the given values of ), generate a table with columns: ) and values of: (i) prior distribution, (ii) the likelihood function, (iii) the product of prior distribution and likelihood function, and (iv) posterior probability. b) Find the marginal distribution of the given random sample. c) Find the expected value of ). GOOD LUCK
10
11
12
13
14
15
16
DEPARTMENT OF MATHEMATICS AND STATISTICS QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, SEPTEMBER 24, 2016
DEPARTMENT OF MATHEMATICS AND STATISTICS QUALIFYING EXAMINATION II IN MATHEMATICAL STATISTICS SATURDAY, SEPTEMBER 24, 2016 Examiners: Drs. K. M. Ramachandran and G. S. Ladde INSTRUCTIONS: a. The quality
More informationStat 643 Problems. a) Show that V is a sub 5-algebra of T. b) Let \ be an integrable random variable. Find EÐ\lVÑÞ
Stat 643 Problems 1. Let ( HT, ) be a measurable space. Suppose that., T and Uare 5-finite positive measures on this space with T Uand U...T.T.U a) Show that T. and œ a.s......u.....u.u Š.. b) Show that
More informationÆ Å not every column in E is a pivot column (so EB œ! has at least one free variable) Æ Å E has linearly dependent columns
ßÞÞÞß @ is linearly independent if B" @" B# @# ÞÞÞ B: @: œ! has only the trivial solution EB œ! has only the trivial solution Ðwhere E œ Ò@ @ ÞÞÞ@ ÓÑ every column in E is a pivot column E has linearly
More informationMAY 2005 SOA EXAM C/CAS 4 SOLUTIONS
MAY 2005 SOA EXAM C/CAS 4 SOLUTIONS Prepared by Sam Broverman, to appear in ACTEX Exam C/4 Study Guide http://wwwsambrovermancom 2brove@rogerscom sam@utstattorontoedu 1 The distribution function is JÐBÑ
More informationSIMULATION - PROBLEM SET 1
SIMULATION - PROBLEM SET 1 " if! Ÿ B Ÿ 1. The random variable X has probability density function 0ÐBÑ œ " $ if Ÿ B Ÿ.! otherwise Using the inverse transform method of simulation, find the random observation
More informationStat 643 Problems, Fall 2000
Stat 643 Problems, Fall 2000 Assignment 1 1. Let ( HT, ) be a measurable space. Suppose that., T and Uare 5-finite positive measures on this space ith T Uand U...T.T.U a) Sho that T. and œ a.s......u.....u.u
More informationNOVEMBER 2005 EXAM NOVEMBER 2005 CAS COURSE 3 EXAM SOLUTIONS 1. Maximum likelihood estimation: The log of the density is 68 0ÐBÑ œ 68 ) Ð) "Ñ 68 B. The loglikelihood function is & j œ 68 0ÐB Ñ œ & 68 )
More information: œ Ö: =? À =ß> real numbers. œ the previous plane with each point translated by : Ðfor example,! is translated to :)
â SpanÖ?ß@ œ Ö =? > @ À =ß> real numbers : SpanÖ?ß@ œ Ö: =? > @ À =ß> real numbers œ the previous plane with each point translated by : Ðfor example, is translated to :) á In general: Adding a vector :
More informationPART I. Multiple choice. 1. Find the slope of the line shown here. 2. Find the slope of the line with equation $ÐB CÑœ(B &.
Math 1301 - College Algebra Final Exam Review Sheet Version X This review, while fairly comprehensive, should not be the only material used to study for the final exam. It should not be considered a preview
More informationSIMULTANEOUS CONFIDENCE BANDS FOR THE PTH PERCENTILE AND THE MEAN LIFETIME IN EXPONENTIAL AND WEIBULL REGRESSION MODELS. Ping Sa and S.J.
SIMULTANEOUS CONFIDENCE BANDS FOR THE PTH PERCENTILE AND THE MEAN LIFETIME IN EXPONENTIAL AND WEIBULL REGRESSION MODELS " # Ping Sa and S.J. Lee " Dept. of Mathematics and Statistics, U. of North Florida,
More informationDr. H. Joseph Straight SUNY Fredonia Smokin' Joe's Catalog of Groups: Direct Products and Semi-direct Products
Dr. H. Joseph Straight SUNY Fredonia Smokin' Joe's Catalog of Groups: Direct Products and Semi-direct Products One of the fundamental problems in group theory is to catalog all the groups of some given
More informationPart 2: One-parameter models
Part 2: One-parameter models 1 Bernoulli/binomial models Return to iid Y 1,...,Y n Bin(1, ). The sampling model/likelihood is p(y 1,...,y n ) = P y i (1 ) n P y i When combined with a prior p( ), Bayes
More informationReview. DS GA 1002 Statistical and Mathematical Models. Carlos Fernandez-Granda
Review DS GA 1002 Statistical and Mathematical Models http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall16 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing with
More information8œ! This theorem is justified by repeating the process developed for a Taylor polynomial an infinite number of times.
Taylor and Maclaurin Series We can use the same process we used to find a Taylor or Maclaurin polynomial to find a power series for a particular function as long as the function has infinitely many derivatives.
More informationStat 5102 Final Exam May 14, 2015
Stat 5102 Final Exam May 14, 2015 Name Student ID The exam is closed book and closed notes. You may use three 8 1 11 2 sheets of paper with formulas, etc. You may also use the handouts on brand name distributions
More informationStat 5101 Lecture Notes
Stat 5101 Lecture Notes Charles J. Geyer Copyright 1998, 1999, 2000, 2001 by Charles J. Geyer May 7, 2001 ii Stat 5101 (Geyer) Course Notes Contents 1 Random Variables and Change of Variables 1 1.1 Random
More informationGene expression experiments. Infinite Dimensional Vector Spaces. 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces
MA 751 Part 3 Gene expression experiments Infinite Dimensional Vector Spaces 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces Gene expression experiments Question: Gene
More informationStatistics Ph.D. Qualifying Exam: Part I October 18, 2003
Statistics Ph.D. Qualifying Exam: Part I October 18, 2003 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your answer
More informationPropagation of Uncertainty in a Maritime Risk Assessment Model utilizing Bayesian Simulation and Expert Judgment Aggregation Techniques
Presentation September 24 Rutgers University 1 Propagation of Uncertainty in a Maritime Risk Assessment Model utilizing Bayesian Simulation and Expert Judgment Aggregation Techniques V. Dinesh (VCU),T.A.
More informationThe Hahn-Banach and Radon-Nikodym Theorems
The Hahn-Banach and Radon-Nikodym Theorems 1. Signed measures Definition 1. Given a set Hand a 5-field of sets Y, we define a set function. À Y Ä to be a signed measure if it has all the properties of
More informationStatistical machine learning and kernel methods. Primary references: John Shawe-Taylor and Nello Cristianini, Kernel Methods for Pattern Analysis
Part 5 (MA 751) Statistical machine learning and kernel methods Primary references: John Shawe-Taylor and Nello Cristianini, Kernel Methods for Pattern Analysis Christopher Burges, A tutorial on support
More information7. Random variables as observables. Definition 7. A random variable (function) X on a probability measure space is called an observable
7. Random variables as observables Definition 7. A random variable (function) X on a probability measure space is called an observable Note all functions are assumed to be measurable henceforth. Note that
More informationIt's Only Fitting. Fitting model to data parameterizing model estimating unknown parameters in the model
It's Only Fitting Fitting model to data parameterizing model estimating unknown parameters in the model Likelihood: an example Cohort of 8! individuals observe survivors at times >œ 1, 2, 3,..., : 8",
More informationHere are proofs for some of the results about diagonalization that were presented without proof in class.
Suppose E is an 8 8 matrix. In what follows, terms like eigenvectors, eigenvalues, and eigenspaces all refer to the matrix E. Here are proofs for some of the results about diagonalization that were presented
More informationBinomial Randomization 3/13/02
Binomial Randomization 3/13/02 Define to be the product space 0,1, á, m â 0,1, á, m and let be the set of all vectors Ðs, á,s Ñ in such that s á s t. Suppose that \, á,\ is a multivariate hypergeometric
More informationChapter 4 HOMEWORK ASSIGNMENTS. 4.1 Homework #1
Chapter 4 HOMEWORK ASSIGNMENTS These homeworks may be modified as the semester progresses. It is your responsibility to keep up to date with the correctly assigned homeworks. There may be some errors in
More informationMidterm Examination. STA 215: Statistical Inference. Due Wednesday, 2006 Mar 8, 1:15 pm
Midterm Examination STA 215: Statistical Inference Due Wednesday, 2006 Mar 8, 1:15 pm This is an open-book take-home examination. You may work on it during any consecutive 24-hour period you like; please
More informationSTATISTICS SYLLABUS UNIT I
STATISTICS SYLLABUS UNIT I (Probability Theory) Definition Classical and axiomatic approaches.laws of total and compound probability, conditional probability, Bayes Theorem. Random variable and its distribution
More informationInner Product Spaces. Another notation sometimes used is X.?
Inner Product Spaces X In 8 we have an inner product? @? @?@ ÞÞÞ? 8@ 8Þ Another notation sometimes used is X? ß@? @? @? @ ÞÞÞ? @ 8 8 The inner product in?@ ß in 8 has several essential properties ( see
More informationSuggestions - Problem Set (a) Show the discriminant condition (1) takes the form. ln ln, # # R R
Suggetion - Problem Set 3 4.2 (a) Show the dicriminant condition (1) take the form x D Ð.. Ñ. D.. D. ln ln, a deired. We then replace the quantitie. 3ß D3 by their etimate to get the proper form for thi
More informationExample Let VœÖÐBßCÑ À b-, CœB - ( see the example above). Explain why
Definition If V is a relation from E to F, then a) the domain of V œ dom ÐVÑ œ Ö+ E À b, F such that Ð+ß,Ñ V b) the range of V œ ran( VÑ œ Ö, F À b+ E such that Ð+ß,Ñ V " c) the inverse relation of V œ
More informationSPRING 2007 EXAM C SOLUTIONS
SPRING 007 EXAM C SOLUTIONS Question #1 The data are already shifted (have had the policy limit and the deductible of 50 applied). The two 350 payments are censored. Thus the likelihood function is L =
More information1 Introduction. P (n = 1 red ball drawn) =
Introduction Exercises and outline solutions. Y has a pack of 4 cards (Ace and Queen of clubs, Ace and Queen of Hearts) from which he deals a random of selection 2 to player X. What is the probability
More informationQuiz 1. Name: Instructions: Closed book, notes, and no electronic devices.
Quiz 1. Name: Instructions: Closed book, notes, and no electronic devices. 1. What is the difference between a deterministic model and a probabilistic model? (Two or three sentences only). 2. What is the
More informationLA PRISE DE CALAIS. çoys, çoys, har - dis. çoys, dis. tons, mantz, tons, Gas. c est. à ce. C est à ce. coup, c est à ce
> ƒ? @ Z [ \ _ ' µ `. l 1 2 3 z Æ Ñ 6 = Ð l sl (~131 1606) rn % & +, l r s s, r 7 nr ss r r s s s, r s, r! " # $ s s ( ) r * s, / 0 s, r 4 r r 9;: < 10 r mnz, rz, r ns, 1 s ; j;k ns, q r s { } ~ l r mnz,
More informationFinal Examination. STA 215: Statistical Inference. Saturday, 2001 May 5, 9:00am 12:00 noon
Final Examination Saturday, 2001 May 5, 9:00am 12:00 noon This is an open-book examination, but you may not share materials. A normal distribution table, a PMF/PDF handout, and a blank worksheet are attached
More informationYou may have a simple scientific calculator to assist with arithmetic, but no graphing calculators are allowed on this exam.
Math 131 Exam 3 Solutions You may have a simple scientific calculator to assist ith arithmetic, but no graphing calculators are alloed on this exam. Part I consists of 14 multiple choice questions (orth
More informationStatistics & Data Sciences: First Year Prelim Exam May 2018
Statistics & Data Sciences: First Year Prelim Exam May 2018 Instructions: 1. Do not turn this page until instructed to do so. 2. Start each new question on a new sheet of paper. 3. This is a closed book
More informationInfinite Dimensional Vector Spaces. 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces
MA 751 Part 3 Infinite Dimensional Vector Spaces 1. Motivation: Statistical machine learning and reproducing kernel Hilbert Spaces Microarray experiment: Question: Gene expression - when is the DNA in
More informationStatistical Theory MT 2006 Problems 4: Solution sketches
Statistical Theory MT 006 Problems 4: Solution sketches 1. Suppose that X has a Poisson distribution with unknown mean θ. Determine the conjugate prior, and associate posterior distribution, for θ. Determine
More informationBernoulli and Poisson models
Bernoulli and Poisson models Bernoulli/binomial models Return to iid Y 1,...,Y n Bin(1, ). The sampling model/likelihood is p(y 1,...,y n ) = P y i (1 ) n P y i When combined with a prior p( ), Bayes rule
More informationMath 131 Exam 4 (Final Exam) F04M
Math 3 Exam 4 (Final Exam) F04M3.4. Name ID Number The exam consists of 8 multiple choice questions (5 points each) and 0 true/false questions ( point each), for a total of 00 points. Mark the correct
More informationStatistical Theory MT 2007 Problems 4: Solution sketches
Statistical Theory MT 007 Problems 4: Solution sketches 1. Consider a 1-parameter exponential family model with density f(x θ) = f(x)g(θ)exp{cφ(θ)h(x)}, x X. Suppose that the prior distribution has the
More informationFall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.
1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n
More informationSTAT J535: Chapter 5: Classes of Bayesian Priors
STAT J535: Chapter 5: Classes of Bayesian Priors David B. Hitchcock E-Mail: hitchcock@stat.sc.edu Spring 2012 The Bayesian Prior A prior distribution must be specified in a Bayesian analysis. The choice
More informationNotes on the Unique Extension Theorem. Recall that we were interested in defining a general measure of a size of a set on Ò!ß "Ó.
1. More on measures: Notes on the Unique Extension Theorem Recall that we were interested in defining a general measure of a size of a set on Ò!ß "Ó. Defined this measure T. Defined TÐ ( +ß, ) Ñ œ, +Þ
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric Distributions Basic building blocks: Need to determine given Representation: or? Recall Curve Fitting Binary Variables
More informationPredictive Distributions
Predictive Distributions October 6, 2010 Hoff Chapter 4 5 October 5, 2010 Prior Predictive Distribution Before we observe the data, what do we expect the distribution of observations to be? p(y i ) = p(y
More informationProblem 1 (20) Log-normal. f(x) Cauchy
ORF 245. Rigollet Date: 11/21/2008 Problem 1 (20) f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.0 0.2 0.4 0.6 0.8 4 2 0 2 4 Normal (with mean -1) 4 2 0 2 4 Negative-exponential x x f(x) f(x) 0.0 0.1 0.2 0.3 0.4 0.5
More informationIntroduction to Bayesian Methods
Introduction to Bayesian Methods Jessi Cisewski Department of Statistics Yale University Sagan Summer Workshop 2016 Our goal: introduction to Bayesian methods Likelihoods Priors: conjugate priors, non-informative
More informationExample: A Markov Process
Example: A Markov Process Divide the greater metro region into three parts: city such as St. Louis), suburbs to include such areas as Clayton, University City, Richmond Heights, Maplewood, Kirkwood,...)
More informationPractice Problems Section Problems
Practice Problems Section 4-4-3 4-4 4-5 4-6 4-7 4-8 4-10 Supplemental Problems 4-1 to 4-9 4-13, 14, 15, 17, 19, 0 4-3, 34, 36, 38 4-47, 49, 5, 54, 55 4-59, 60, 63 4-66, 68, 69, 70, 74 4-79, 81, 84 4-85,
More informationE.G., data mining, prediction. Function approximation problem: How >9 best estimate the function 0 from partial information (examples)
Can Neural Network and Statistical Learning Theory be Formulated in terms of Continuous Complexity Theory? 1. Neural Networks and Statistical Learning Theory Many areas of mathematics, statistics, and
More informationInner Product Spaces
Inner Product Spaces In 8 X, we defined an inner product? @? @?@ ÞÞÞ? 8@ 8. Another notation sometimes used is? @? ß@. The inner product in 8 has several important properties ( see Theorem, p. 33) that
More informationIntroduction to Bayesian Statistics with WinBUGS Part 4 Priors and Hierarchical Models
Introduction to Bayesian Statistics with WinBUGS Part 4 Priors and Hierarchical Models Matthew S. Johnson New York ASA Chapter Workshop CUNY Graduate Center New York, NY hspace1in December 17, 2009 December
More informationFinal Examination a. STA 532: Statistical Inference. Wednesday, 2015 Apr 29, 7:00 10:00pm. Thisisaclosed bookexam books&phonesonthefloor.
Final Examination a STA 532: Statistical Inference Wednesday, 2015 Apr 29, 7:00 10:00pm Thisisaclosed bookexam books&phonesonthefloor Youmayuseacalculatorandtwo pagesofyourownnotes Do not share calculators
More informationMath 1M03 (Version 1) Sample Exam
Math 1M03 (Version 1) Sample Exam Name: (Last Name) (First Name) Student Number: Day Class Duration: 3 Hours Maximum Mark: 40 McMaster University Sample Final Examination This examination paper consists
More informationProblem Selected Scores
Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected
More informationModule 22: Bayesian Methods Lecture 9 A: Default prior selection
Module 22: Bayesian Methods Lecture 9 A: Default prior selection Peter Hoff Departments of Statistics and Biostatistics University of Washington Outline Jeffreys prior Unit information priors Empirical
More informationUnobservable Parameter. Observed Random Sample. Calculate Posterior. Choosing Prior. Conjugate prior. population proportion, p prior:
Pi Priors Unobservable Parameter population proportion, p prior: π ( p) Conjugate prior π ( p) ~ Beta( a, b) same PDF family exponential family only Posterior π ( p y) ~ Beta( a + y, b + n y) Observed
More informationOutline. 1. The Screening Philosophy 2. Robust Products/Processes 3. A Statistical Screening Procedure 4. Some Caveats 5.
Screening to Identify Robust Products Based on Fractional Factorial Experiments Thomas J. Santner Ohio State University Guohua Pan Novartis Pharmaceuticals Corp Outline 1. The Screening Philosophy 2. Robust
More informationBayesian inference. Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark. April 10, 2017
Bayesian inference Rasmus Waagepetersen Department of Mathematics Aalborg University Denmark April 10, 2017 1 / 22 Outline for today A genetic example Bayes theorem Examples Priors Posterior summaries
More informationStatistics GIDP Ph.D. Qualifying Exam Theory Jan 11, 2016, 9:00am-1:00pm
Statistics GIDP Ph.D. Qualifying Exam Theory Jan, 06, 9:00am-:00pm Instructions: Provide answers on the supplied pads of paper; write on only one side of each sheet. Complete exactly 5 of the 6 problems.
More informationReview: General Approach to Hypothesis Testing. 1. Define the research question and formulate the appropriate null and alternative hypotheses.
1 Review: Let X 1, X,..., X n denote n independent random variables sampled from some distribution might not be normal!) with mean µ) and standard deviation σ). Then X µ σ n In other words, X is approximately
More informationClassical and Bayesian inference
Classical and Bayesian inference AMS 132 January 18, 2018 Claudia Wehrhahn (UCSC) Classical and Bayesian inference January 18, 2018 1 / 9 Sampling from a Bernoulli Distribution Theorem (Beta-Bernoulli
More informationBayesian Inference for Normal Mean
Al Nosedal. University of Toronto. November 18, 2015 Likelihood of Single Observation The conditional observation distribution of y µ is Normal with mean µ and variance σ 2, which is known. Its density
More informationParametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory
Statistical Inference Parametric Inference Maximum Likelihood Inference Exponential Families Expectation Maximization (EM) Bayesian Inference Statistical Decison Theory IP, José Bioucas Dias, IST, 2007
More informationebay/google short course: Problem set 2
18 Jan 013 ebay/google short course: Problem set 1. (the Echange Parado) You are playing the following game against an opponent, with a referee also taking part. The referee has two envelopes (numbered
More informationMATH 1301 (College Algebra) - Final Exam Review
MATH 1301 (College Algebra) - Final Exam Review This review is comprehensive but should not be the only material used to study for the final exam. It should not be considered a preview of the final exam.
More informationA Very Brief Summary of Statistical Inference, and Examples
A Very Brief Summary of Statistical Inference, and Examples Trinity Term 2008 Prof. Gesine Reinert 1 Data x = x 1, x 2,..., x n, realisations of random variables X 1, X 2,..., X n with distribution (model)
More information1. Classify each number. Choose all correct answers. b. È # : (i) natural number (ii) integer (iii) rational number (iv) real number
Review for Placement Test To ypass Math 1301 College Algebra Department of Computer and Mathematical Sciences University of Houston-Downtown Revised: Fall 2009 PLEASE READ THE FOLLOWING CAREFULLY: 1. The
More informationMathematical Statistics
Mathematical Statistics MAS 713 Chapter 8 Previous lecture: 1 Bayesian Inference 2 Decision theory 3 Bayesian Vs. Frequentist 4 Loss functions 5 Conjugate priors Any questions? Mathematical Statistics
More informationMath 132, Spring 2003 Exam 2: Solutions
Math 132, Spring 2003 Exam 2: Solutions No calculators with a CAS are allowed. e sure your calculator is set for radians, not degrees if you do any calculus computations with trig functions. Part I, Multiple
More informationSTAT 2122 Homework # 3 Solutions Fall 2018 Instr. Sonin
STAT 2122 Homeork Solutions Fall 2018 Instr. Sonin Due Friday, October 5 NAME (25 + 5 points) Sho all ork on problems! (4) 1. In the... Lotto, you may pick six different numbers from the set Ö"ß ß $ß ÞÞÞß
More informationINTRODUCTION TO BAYESIAN INFERENCE PART 2 CHRIS BISHOP
INTRODUCTION TO BAYESIAN INFERENCE PART 2 CHRIS BISHOP Personal Healthcare Revolution Electronic health records (CFH) Personal genomics (DeCode, Navigenics, 23andMe) X-prize: first $10k human genome technology
More informationThe binomial model. Assume a uniform prior distribution on p(θ). Write the pdf for this distribution.
The binomial model Example. After suspicious performance in the weekly soccer match, 37 mathematical sciences students, staff, and faculty were tested for the use of performance enhancing analytics. Let
More informationAccouncements. You should turn in a PDF and a python file(s) Figure for problem 9 should be in the PDF
Accouncements You should turn in a PDF and a python file(s) Figure for problem 9 should be in the PDF Please do not zip these files and submit (unless there are >5 files) 1 Bayesian Methods Machine Learning
More informationReview Quiz. 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the
Review Quiz 1. Prove that in a one-dimensional canonical exponential family, the complete and sufficient statistic achieves the Cramér Rao lower bound (CRLB). That is, if where { } and are scalars, then
More informationThe Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition.
Christian P. Robert The Bayesian Choice From Decision-Theoretic Foundations to Computational Implementation Second Edition With 23 Illustrations ^Springer" Contents Preface to the Second Edition Preface
More information2. Let 0 be as in problem 1. Find the Fourier coefficient,&. (In other words, find the constant,& the Fourier series for 0.)
Engineering Mathematics (ESE 317) Exam 4 April 23, 200 This exam contains seven multiple-choice problems worth two points each, 11 true-false problems worth one point each, and some free-response problems
More informationSpring 2012 Math 541B Exam 1
Spring 2012 Math 541B Exam 1 1. A sample of size n is drawn without replacement from an urn containing N balls, m of which are red and N m are black; the balls are otherwise indistinguishable. Let X denote
More informationThree hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER.
Three hours To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER EXTREME VALUES AND FINANCIAL RISK Examiner: Answer QUESTION 1, QUESTION
More informationSpecial Topic: Bayesian Finite Population Survey Sampling
Special Topic: Bayesian Finite Population Survey Sampling Sudipto Banerjee Division of Biostatistics School of Public Health University of Minnesota April 2, 2008 1 Special Topic Overview Scientific survey
More informationMath 562 Homework 1 August 29, 2006 Dr. Ron Sahoo
Math 56 Homework August 9, 006 Dr. Ron Sahoo He who labors diligently need never despair; for all things are accomplished by diligence and labor. Menander of Athens Direction: This homework worths 60 points
More informationEngineering Mathematics (E35 317) Final Exam December 18, 2007
Engineering Mathematics (E35 317) Final Exam December 18, 2007 This exam contains 18 multile-choice roblems orth to oints each, five short-anser roblems orth one oint each, and nine true-false roblems
More informationDigital Communications: An Overview of Fundamentals
IMPERIAL COLLEGE of SCIENCE, TECHNOLOGY and MEDICINE, DEPARTMENT of ELECTRICAL and ELECTRONIC ENGINEERING. COMPACT LECTURE NOTES on COMMUNICATION THEORY. Prof Athanassios Manikas, Spring 2001 Digital Communications:
More informationData Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University
Data Mining Chapter 4: Data Analysis and Uncertainty Fall 2011 Ming Li Department of Computer Science and Technology Nanjing University Why uncertainty? Why should data mining care about uncertainty? We
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables THE UNIVERSITY OF MANCHESTER. 21 June :45 11:45
Two hours MATH20802 To be supplied by the Examinations Office: Mathematical Formula Tables THE UNIVERSITY OF MANCHESTER STATISTICAL METHODS 21 June 2010 9:45 11:45 Answer any FOUR of the questions. University-approved
More informationTABLE OF CONTENTS CHAPTER 1 COMBINATORIAL PROBABILITY 1
TABLE OF CONTENTS CHAPTER 1 COMBINATORIAL PROBABILITY 1 1.1 The Probability Model...1 1.2 Finite Discrete Models with Equally Likely Outcomes...5 1.2.1 Tree Diagrams...6 1.2.2 The Multiplication Principle...8
More informationCOPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition
Preface Preface to the First Edition xi xiii 1 Basic Probability Theory 1 1.1 Introduction 1 1.2 Sample Spaces and Events 3 1.3 The Axioms of Probability 7 1.4 Finite Sample Spaces and Combinatorics 15
More informationMath 494: Mathematical Statistics
Math 494: Mathematical Statistics Instructor: Jimin Ding jmding@wustl.edu Department of Mathematics Washington University in St. Louis Class materials are available on course website (www.math.wustl.edu/
More informationHypothesis Testing. Part I. James J. Heckman University of Chicago. Econ 312 This draft, April 20, 2006
Hypothesis Testing Part I James J. Heckman University of Chicago Econ 312 This draft, April 20, 2006 1 1 A Brief Review of Hypothesis Testing and Its Uses values and pure significance tests (R.A. Fisher)
More informationMarkov Chain Monte Carlo (MCMC)
Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can
More informationMATH c UNIVERSITY OF LEEDS Examination for the Module MATH2715 (January 2015) STATISTICAL METHODS. Time allowed: 2 hours
MATH2750 This question paper consists of 8 printed pages, each of which is identified by the reference MATH275. All calculators must carry an approval sticker issued by the School of Mathematics. c UNIVERSITY
More informationSummary: the confidence interval for the mean (σ 2 known) with gaussian assumption
Summary: the confidence interval for the mean (σ known) with gaussian assumption on X Let X be a Gaussian r.v. with mean µ and variance σ. If X 1, X,..., X n is a random sample drawn from X then the confidence
More informationSubject CS1 Actuarial Statistics 1 Core Principles
Institute of Actuaries of India Subject CS1 Actuarial Statistics 1 Core Principles For 2019 Examinations Aim The aim of the Actuarial Statistics 1 subject is to provide a grounding in mathematical and
More informationHypothesis Test. The opposite of the null hypothesis, called an alternative hypothesis, becomes
Neyman-Pearson paradigm. Suppose that a researcher is interested in whether the new drug works. The process of determining whether the outcome of the experiment points to yes or no is called hypothesis
More informationSVM example: cancer classification Support Vector Machines
SVM example: cancer classification Support Vector Machines 1. Cancer genomics: TCGA The cancer genome atlas (TCGA) will provide high-quality cancer data for large scale analysis by many groups: SVM example:
More informationLund Institute of Technology Centre for Mathematical Sciences Mathematical Statistics
Lund Institute of Technology Centre for Mathematical Sciences Mathematical Statistics STATISTICAL METHODS FOR SAFETY ANALYSIS FMS065 ÓÑÔÙØ Ö Ü Ö Ì ÓÓØ ØÖ Ô Ð ÓÖ Ø Ñ Ò Ý Ò Ò ÐÝ In this exercise we will
More informationFrom Handout #1, the randomization model for a design with a simple block structure can be written as
Hout 4 Strata Null ANOVA From Hout 1 the romization model for a design with a simple block structure can be written as C œ.1 \ X α % (4.1) w where α œðα á α > Ñ E ÐÑœ % 0 Z œcov ÐÑ % with cov( % 3 % 4
More information