+, where 0 x N - n. k k

Similar documents
Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Limited Dependent Variables

Why Monte Carlo Integration? Introduction to Monte Carlo Method. Continuous Probability. Continuous Probability

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

As is less than , there is insufficient evidence to reject H 0 at the 5% level. The data may be modelled by Po(2).

PhysicsAndMathsTutor.com

Lecture 4 Hypothesis Testing

Homework Assignment 3 Due in class, Thursday October 15

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

F8: Heteroscedasticity

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

STAT 3008 Applied Regression Analysis

xp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ

First Year Examination Department of Statistics, University of Florida

Expectation Maximization Mixture Models HMMs

Goodness of fit and Wilks theorem

Professor Chris Murray. Midterm Exam

Linear Approximation with Regularization and Moving Least Squares

UNIVERSITY OF TORONTO Faculty of Arts and Science. December 2005 Examinations STA437H1F/STA1005HF. Duration - 3 hours

18.1 Introduction and Recap

Chapter 14 Simple Linear Regression

Multiple Regression Analysis

Complex Numbers. x = B B 2 4AC 2A. or x = x = 2 ± 4 4 (1) (5) 2 (1)

Interval Estimation in the Classical Normal Linear Regression Model. 1. Introduction

Composite Hypotheses testing

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

Expected Value and Variance

Economics 130. Lecture 4 Simple Linear Regression Continued

Module 2. Random Processes. Version 2 ECE IIT, Kharagpur

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Population element: 1 2 N. 1.1 Sampling with Replacement: Hansen-Hurwitz Estimator(HH)

THE ROYAL STATISTICAL SOCIETY 2006 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Section 3.6 Complex Zeros

MAE140 - Linear Circuits - Fall 13 Midterm, October 31

Math1110 (Spring 2009) Prelim 3 - Solutions

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

Randomness and Computation

Solutions Homework 4 March 5, 2018

A REVIEW OF ERROR ANALYSIS

MATH 281A: Homework #6

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

ECONOMICS 351*-A Mid-Term Exam -- Fall Term 2000 Page 1 of 13 pages. QUEEN'S UNIVERSITY AT KINGSTON Department of Economics

The written Master s Examination

A General Class of Selection Procedures and Modified Murthy Estimator

ANSWERS CHAPTER 9. TIO 9.2: If the values are the same, the difference is 0, therefore the null hypothesis cannot be rejected.

Differentiating Gaussian Processes

1. Inference on Regression Parameters a. Finding Mean, s.d and covariance amongst estimates. 2. Confidence Intervals and Working Hotelling Bands

Mixture of Gaussians Expectation Maximization (EM) Part 2

STAT 3340 Assignment 1 solutions. 1. Find the equation of the line which passes through the points (1,1) and (4,5).

MACHINE APPLIED MACHINE LEARNING LEARNING. Gaussian Mixture Regression

On New Selection Procedures for Unequal Probability Sampling

Chapter 3 Describing Data Using Numerical Measures

The Fundamental Theorem of Algebra. Objective To use the Fundamental Theorem of Algebra to solve polynomial equations with complex solutions

Hydrological statistics. Hydrological statistics and extremes

4 Analysis of Variance (ANOVA) 5 ANOVA. 5.1 Introduction. 5.2 Fixed Effects ANOVA

Modeling and Simulation NETW 707

,, MRTS is the marginal rate of technical substitution

Chapter 1. Probability

Solution of Linear System of Equations and Matrix Inversion Gauss Seidel Iteration Method

Here is the rationale: If X and y have a strong positive relationship to one another, then ( x x) will tend to be positive when ( y y)

AS-Level Maths: Statistics 1 for Edexcel

since [1-( 0+ 1x1i+ 2x2 i)] [ 0+ 1x1i+ assumed to be a reasonable approximation

ENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition

Stat 543 Exam 2 Spring 2016

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

1 Matrix representations of canonical matrices

Lecture 3: Probability Distributions

[The following data appear in Wooldridge Q2.3.] The table below contains the ACT score and college GPA for eight college students.

Statistical analysis using matlab. HY 439 Presented by: George Fortetsanakis

F statistic = s2 1 s 2 ( F for Fisher )

Lecture 6 More on Complete Randomized Block Design (RBD)

Stat 543 Exam 2 Spring 2016

find (x): given element x, return the canonical element of the set containing x;

Simulated Power of the Discrete Cramér-von Mises Goodness-of-Fit Tests

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

CS-433: Simulation and Modeling Modeling and Probability Review

The Bellman Equation

Comparing two Quantiles: the Burr Type X and Weibull Cases

Chapter 12 Analysis of Covariance

Maximum Likelihood Estimation

Kernel Methods and SVMs Extension

Chapter 6. Supplemental Text Material

e i is a random error

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Chapter 5 Multilevel Models

Maximum Likelihood Estimation and Binary Dependent Variables

Unit 5: Quadratic Equations & Functions

MIMA Group. Chapter 2 Bayesian Decision Theory. School of Computer Science and Technology, Shandong University. Xin-Shun SDU

Propagation of error for multivariable function

PROBABILITY PRIMER. Exercise Solutions

Multiple Choice. Choose the one that best completes the statement or answers the question.

Algorithms for factoring

/ n ) are compared. The logic is: if the two

a. (All your answers should be in the letter!

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

Binomial Distribution: Tossing a coin m times. p = probability of having head from a trial. y = # of having heads from n trials (y = 0, 1,..., m).

Simulation and Probability Distribution

Transcription:

CO 745, Mdterm Len Cabrera. A multle choce eam has questons, each of whch has ossble answers. A student nows the correct answer to n of these questons. For the remanng - n questons, he checs the answers comletel at random. To tae nto consderaton the chance of students randoml selectng the correct resonse, the rofessor has decded that for each correct answer the student gets one ont, and for each wrong answer he gets -/ onts. a Derve an eresson for the denst functon for the students score. b What s the eected value of the total score for the test? Do ou have an recommendatons that ou could mae? a Probablt of gettng uncertan queston correct s / umber of uncertan questons student gets correct s bnomal dstrbuton wth arameters - n # of uncertan questons and / robablt of success Let X number of uncertan questons the student gets correct ~ Bn - n, / n n f, X n, Var X n umber of uncertan questons student gets ncorrect s - n - X Score equals number of certan questons n lus number of uncertan questons student gets correct X, mnus / tmes number of uncertan questons student gets ncorrect - n - X Therefore, score s a functon of X: SX n X - / - n - X n X - - n/ X/ S n n, where - n That s, the student gets n onts and we automatcall subtract / onts for all uncertan questons, then add / onts for the uncertan questons he gets rght. Double chec mn and ma scores: S n - / - n gets none of the uncertan questons rght S - n n - / - n - n / - n gets all uncertan questons rght SX s a strctl ncreasng functon of X, so there s a unque that gves a artcular score s. n n The denst of the score s g s s n n, where. Ths s vald for n - / - n s b The score s a lnear functon of X, therefore, the eected value of the functon s equal to the functon of the eected value,.e., SX SX Substtute the value for X gven above nto the formula for SX: S X n n n n n deall, the eected value of the score would be n n order to measure eactl what the student new. Unfortunatel, even b subtractng / onts, the eected value wll be greater than n although less than t would be wthout subtractng the onts. Also, - n/ wll never be zero. n order to get t closer to zero, the rofessor should mae as large as ossble.e., more choces for each queston. of 8

f enalt of / - for ncorrect answers, then S n.. umbers are selected at random from the nterval,. a f numbers are selected, what s the robablt that eactl 5 of them are less than /? b f numbers are selected, on average how man of them are less than /? c f numbers are selected, what s the robablt that the average of the numbers s less than /? a Unform, / / Pr[Un, < /] d ] / X # Un, samles < / ~ Bnomal wth n and / 5 f 5 5 5 6 / 56.46 5 b X / 5 Double checed wth smulaton n cel: Trals: Average: 5. StDev:.56 F5.6 F4.58 Pr[5 samles < /] F5 - F4.5 c Use Theorem: f random samle s from a oulaton wth mean µ and varance, then the samle mean s a random varable wth mean µ and varance /n. n ths case, oulaton mean and varance are from Un,: X /, VarX / average of samle of Un,; ~ /, / / / / Pr [ < / ] Pr < / / Double checed wth smulaton n cel: Trals: Average:.5 StDev:. Pr [ z < ].5 Count Prob. Percent Prob. 5 5 5.8.6.4. PDF of umbers 4 5 6 7 8 9 CDF of umbers 5 7 9..8.6.4...8.6.4..8.6.4 PDF of Avg of umbers.4.4.45.48.5.5.55.58 CDF of Avg of umbers..8.4.48.5.58 of 8

. Let,,..., m be a random samle from a normal dstrbuton wth mean µ and varance, and,,..., n be a samle from a normal dstrbuton wth mean µ and the same varance. Also and j are ndeendent for all, j. Let and be the samle means, and s and s be the samle varances. a Wrte down the dstrbuton of z b What s the dstrbuton of, t's mean and varance. m s n s u c Usng z and u, construct a random varable that has a t-dstrbuton. What are ts degrees of freedom? a Theorem: f random samle s from a oulaton wth mean µ and varance, then the samle mean s a random varable wth mean µ and varance /n. ~ µ, /m and ~ µ, /n z ~ µ µ, 87 of Statstcs for ngneerng and the Scences. rd ed. Mendenhall & Sncch f z e z µ µ π z µ µ Var z b m s n s ~ χ m and ~ χ n 5 of Statstcs for ngneerng and the Scences. rd ed. Mendenhall & Sncch From class notes: f X ~ χ and X ~ χ m and the're ndeendent, then X X ~ χ m n u m s n s m ~ χ m n f u u m n m n e u m n Γ u m n Var u m n of 8

z c From class notes: z ~, and X ~ χ n t ~ t n X / n z ~ z µ µ µ µ, z ' ~, z' ~ t m n u / m n 4. Suose that the random varable X has a Pareto denst f ;, / / for, > and a Derve the denst of the random varable Y lnx. b After etensve testng to be done n the second half of the course ou have determned that. Gven ths, fnd the Y and VarY. c Gven our answer to b, what s Y and VarY for the general case where s not equal to? a Y lnx X ds e d g Y e s ds f s / e d e e, ln b g e, ~ onental Y Var Y c Snce s a constant, Y and Var Y 4 of 8

5. Suose that X s random varables wth multnomal denst: f,, ;,,,, a Gven a random samle of observatons, wrte down the lelhood and log-lelhood functons. b What are the mamum lelhood estmators of and? c Show that the mamum lelhood estmators, ˆ and ˆ, are unbased estmators of and. d Derve the nformaton matr for and. e What are the Cramer-Rao lower bounds for Var and Var? a L ; f,, where,, and, L ; ln L ; ln ln ln For smlct let,, b To fnd ML, tae artals of ln L ; wrt, set them equal to zero and solve for ln L ; ln L ; Solve qn for b frst gettng common denomnators Get rd of the denomnator b multlng both sdes b the denomnator Combne terms for Solve for b tang t to the other sde and dvdng b ow wor on qn to solve for ; frst get common denomnators As before, get rd of the denomnator b multlng both sdes b the denomnator 5 of 8

Combne terms for ow substtute qn for Brea u fracton so 's cancel Combne terms wth on one sde and everthng else on the other. Get common denomnators on the left term for and multl out the term on the rght. Multl both sdes b and notce the terms cancel ow solve for. We can cancel the and substtute ˆ ow substtute qn 4 nto qn to fnsh solvng for / ˆ Substtute ˆ We sweat off brow... 4 ˆ ˆ c ˆ ˆ unbased unbased 6 of 8

7 of 8 d, where j j L ; ln, To mae thngs qucer and easer to read: e CRLB s [ ] Usng d c b a a c b d cb ad

8 of 8 ad cb [ ] Var Var