Stats & Summary

Similar documents
PubH 7405: REGRESSION ANALYSIS REGRESSION IN MATRIX TERMS

ME 501A Seminar in Engineering Analysis Page 1

Introduction to mathematical Statistics

MATRIX AND VECTOR NORMS

Training Sample Model: Given n observations, [[( Yi, x i the sample model can be expressed as (1) where, zero and variance σ

Chapter Unary Matrix Operations

Density estimation II

DATA FITTING. Intensive Computation 2013/2014. Annalisa Massini

Soo King Lim Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11:

3. REVIEW OF PROPERTIES OF EIGENVALUES AND EIGENVECTORS

Chapter 3 Supplemental Text Material

The z-transform. LTI System description. Prof. Siripong Potisuk

POWERS OF COMPLEX PERSYMMETRIC ANTI-TRIDIAGONAL MATRICES WITH CONSTANT ANTI-DIAGONALS

European Journal of Mathematics and Computer Science Vol. 3 No. 1, 2016 ISSN ISSN

ITERATIVE METHODS FOR SOLVING SYSTEMS OF LINEAR ALGEBRAIC EQUATIONS

Advanced Algorithmic Problem Solving Le 3 Arithmetic. Fredrik Heintz Dept of Computer and Information Science Linköping University

Optimality of Strategies for Collapsing Expanded Random Variables In a Simple Random Sample Ed Stanek

An Extended Mixture Inverse Gaussian Distribution

1 4 6 is symmetric 3 SPECIAL MATRICES 3.1 SYMMETRIC MATRICES. Defn: A matrix A is symmetric if and only if A = A, i.e., a ij =a ji i, j. Example 3.1.

12 Iterative Methods. Linear Systems: Gauss-Seidel Nonlinear Systems Case Study: Chemical Reactions

Lecture 3-4 Solutions of System of Linear Equations

Chapter Gauss-Seidel Method

Chapter Linear Regression

Linear Algebra Concepts

Differential Entropy 吳家麟教授

Matrix. Definition 1... a1 ... (i) where a. are real numbers. for i 1, 2,, m and j = 1, 2,, n (iii) A is called a square matrix if m n.

MATH2999 Directed Studies in Mathematics Matrix Theory and Its Applications

Available online through

Level-2 BLAS. Matrix-Vector operations with O(n 2 ) operations (sequentially) BLAS-Notation: S --- single precision G E general matrix M V --- vector

Fibonacci and Lucas Numbers as Tridiagonal Matrix Determinants

Sequences and summations

Linear Algebra Concepts

Computer Programming

Numerical Analysis Topic 4: Least Squares Curve Fitting

Regression. By Jugal Kalita Based on Chapter 17 of Chapra and Canale, Numerical Methods for Engineers

CS321. Numerical Analysis

Review of Linear Algebra

Section 7.2 Two-way ANOVA with random effect(s)

CS473-Algorithms I. Lecture 3. Solving Recurrences. Cevdet Aykanat - Bilkent University Computer Engineering Department

Handout #2. Introduction to Matrix: Matrix operations & Geometric meaning

CS537. Numerical Analysis

BASIC PRINCIPLES OF STATISTICS

Mathematics HL and further mathematics HL formula booklet

Chapter 2 Intro to Math Techniques for Quantum Mechanics

The linear system. The problem: solve

Probability and Statistics. What is probability? What is statistics?

Area and the Definite Integral. Area under Curve. The Partition. y f (x) We want to find the area under f (x) on [ a, b ]

Least squares. Václav Hlaváč. Czech Technical University in Prague

Random variables and sampling theory

Some Unbiased Classes of Estimators of Finite Population Mean

Singular Value Decomposition. Linear Algebra (3) Singular Value Decomposition. SVD and Eigenvectors. Solving LEs with SVD

Chapter System of Equations

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

Mathematics HL and further mathematics HL formula booklet

Mathematics HL and further mathematics HL formula booklet

The Computation of Common Infinity-norm Lyapunov Functions for Linear Switched Systems

this is the indefinite integral Since integration is the reverse of differentiation we can check the previous by [ ]

The total number of permutations of S is n!. We denote the set of all permutations of S by

Department of Statistics, Dibrugarh University, Dibrugarh, Assam, India. Department of Statistics, G. C. College, Silchar, Assam, India.

( ) ( ) ( ( )) ( ) ( ) ( ) ( ) ( ) = ( ) ( ) + ( ) ( ) = ( ( )) ( ) + ( ( )) ( ) Review. Second Derivatives for f : y R. Let A be an m n matrix.

A Series Illustrating Innovative Forms of the Organization & Exposition of Mathematics by Walter Gottschalk

Methods to Invert a Matrix

Hypercyclic Functions for Backward and Bilateral Shift Operators. Faculty of Science, Ain Shams University, Cairo, Egypt 2 Department of Mathematics,

TESTS BASED ON MAXIMUM LIKELIHOOD

STA261H1.doc. i 1 X n be a random sample. The sample mean is defined by i= 1 X 1 + ( ) X has a N ( σ ) 1 n. N distribution. Then n. distribution.

Qualifying Exam Statistical Theory Problem Solutions August 2005

MATH 371 Homework assignment 1 August 29, 2013

INTRODUCTION ( ) 1. Errors

FORMULAE FOR FINITE DIFFERENCE APPROXIMATIONS, QUADRATURE AND LINEAR MULTISTEP METHODS

COMPLEX NUMBERS AND DE MOIVRE S THEOREM

6.6 Moments and Centers of Mass

Roberto s Notes on Integral Calculus Chapter 4: Definite integrals and the FTC Section 2. Riemann sums

Describes techniques to fit curves (curve fitting) to discrete data to obtain intermediate estimates.

Chapter 7. Bounds for weighted sums of Random Variables

CURVE FITTING LEAST SQUARES METHOD

Decompression diagram sampler_src (source files and makefiles) bin (binary files) --- sh (sample shells) --- input (sample input files)

Patterns of Continued Fractions with a Positive Integer as a Gap

Preliminary Examinations: Upper V Mathematics Paper 1

Inner Product Spaces (Chapter 5)

SOLVING SYSTEMS OF EQUATIONS, DIRECT METHODS

ON NILPOTENCY IN NONASSOCIATIVE ALGEBRAS

On the Pell p-circulant sequences

14.2 Line Integrals. determines a partition P of the curve by points Pi ( xi, y

Inner Product Spaces INNER PRODUCTS

On Solution of Min-Max Composition Fuzzy Relational Equation

TiCC TR November, Gauss Sums, Partitions and Constant-Value Codes. A.J. van Zanten. TiCC, Tilburg University Tilburg, The Netherlands

Lecture Notes 2. The ability to manipulate matrices is critical in economics.

β (cf Khan, 2006). In this model, p independent

PATTERNS IN CONTINUED FRACTION EXPANSIONS

Fast Fourier Transform 1) Legendre s Interpolation 2) Vandermonde Matrix 3) Roots of Unity 4) Polynomial Evaluation

Chapter 17. Least Square Regression

Chapter 2 Solving Linear Equation

A Technique for Constructing Odd-order Magic Squares Using Basic Latin Squares

Department of Mathematics UNIVERSITY OF OSLO. FORMULAS FOR STK4040 (version 1, September 12th, 2011) A - Vectors and matrices

Numerical Analysis Formulae Booklet

4. Standard Regression Model and Spatial Dependence Tests

STK3100 and STK4100 Autumn 2017

Chapter 5 Properties of a Random Sample

Channel Models with Memory. Channel Models with Memory. Channel Models with Memory. Channel Models with Memory

STK3100 and STK4100 Autumn 2018

Transcription:

Stts 443.3 & 85.3 Summr

The Woodbur Theorem BCD B C D B D where the verses C C D B, d est.

Block Mtrces Let the m mtr m q q m be rttoed to sub-mtrces,,,, Smlrl rtto the m k mtr B B B mk m B B l kl

Product of Blocked Mtrces The B B B B B B B B B B B B B

The Iverse of Blocked Mtrces Let the mtr be rttoed to sub-mtrces,,,, Smlrl rtto the mtr Suose tht B = - B B B B B

Summrzg Let Suose tht - = B the B B B B B B B B B B

Smmetrc Mtrces mtr,, s sd to be smmetrc f Note: B B B B

The trce d the determt of squre mtr Let deote the mtr The j tr

lso where det det the determt of j j j j cofctor of j the determt of the mtr th th fter deletg row d j col. j

Some roertes. I, tr I. B B, tr B tr B 3. 4. f 0 or 0

Secl Tes of Mtrces. Orthogol mtrces mtr s orthogol f PˊP = PPˊ = I I ths cses P - =Pˊ. lso the rows (colums) of P hve legth d re orthogol to ech other

Secl Tes of Mtrces (cotued). Postve defte mtrces smmetrc mtr,, s clled ostve defte f: for ll 0 smmetrc mtr,, s clled ostve sem defte f: 0 for ll 0 0

Theorem The mtr s ostve defte f 0, 0, 0,, 0 3 33 3 3 3 3 3 d,,, where

Secl Tes of Mtrces (cotued) 3. Idemotet mtrces smmetrc mtr, E, s clled demotet f: E E Idemotet mtrces roject vectors oto ler subsce E E E E E

Egevectors, Egevlues of mtr

Defto Let be mtr Let d be such tht wth 0 the s clled egevlue of d d s clled egevector of d

Note: I 0 If I 0 the I 0 0 thus I 0 s the codto for egevlue.

det = 0 I = oloml of degree. Hece there re ossble egevlues,,

Thereom If the mtr s smmetrc wth dstct egevlues,,,, wth corresodg egevectors,, ssume the 0,, 0 PDP

The Geerlzed Iverse of mtr

Defto B (deoted b - ) s clled the geerlzed verse (Moore Perose verse) of f. B =. BB = B 3. (B)' = B 4. (B)' = B Note: - s uque

Hece B = B B = B B B = B (B ) ' (B ) ' = B B ' ' B ' ' = B B ' ' = B B = B B B = (B )(B )B = (B ) ' (B ) ' B = ' B ' ' B ' B = ' B ' B = (B ) ' B = B B = B The geerl soluto of sstem of Equtos The geerl soluto b I where z b b I z s rbtrr

Let C be q mtr of rk k < m(,q), the C = B where s k mtr of rk k d B s k q mtr of rk k the C B BB

The Geerl Ler Model,, Let X β o dstrbut, hs where I 0 ε ε Xβ N

Geometrcl terretto of the Geerl Ler Model X β,, Let o dstrbut, hs where I 0 ε ε Xβ N X Xβ μ les the ler sce sed b the colums of E

Estmto The Geerl Ler Model

the Norml Equtos

X X Xβ The Norml Equtos, where X

Soluto to the orml equtos X ˆ Xβ X ˆ β XX X If the mtr X s of full rk.

Estmte of ˆ ˆ Xβ ˆ Xβ I X XX ˆ Xβ X

Proertes of The Mmum Lkelhood Estmtes Ubsedess, Mmum Vrce

Ubsedess ˆ β XX X E E XX XE c β c β ˆ ˆ E E cβ E XX XXβ β ˆ s ˆ Xβ ˆ Xβ ˆ s s ubsed estmtor of.

Dstrbutol Proertes Lest squre Estmtes (Mmum Lkeldood estmtes)

The Geerl Ler Model d X X X X I s. X X X X X X β where ˆ. B X X X X I Now s U X X X X I B where I Xβ, ~ N The Estmtes

Theorem. 0 wth, ~. s U, ~ ˆ. XX β β N re deedet d ˆ 3. s β

The Geerl Ler Model wth tercet

0,, Let X β o dstrbut, hs.e. I Xβ N o dstrbut, hs where I 0 ε ε Xβ N The mtr formulto (tercet cluded) The the model becomes Thus to clude tercet dd etr colum of s the desg mtr X d clude the tercet the rmeter vector

The Guss-Mrkov Theorem mortt result the theor of Ler models Proves otmlt of Lest squres estmtes more geerl settg

The Guss-Mrkov Theorem ssume E Xβ d vr I Cosder the lest squres estmte of d ˆ cβ β cx X ˆ XX X X c, ubsed ler estmtor of β Let b b b b β deote other ubsed ler estmtor of the vr ˆ b vrc β c β

Hothess testg for the GLM The Geerl Ler Hothess

Testg the Geerl Ler Hotheses The Geerl Ler Hothess H 0 : h + h + h 3 3 +... + h = h h + h + h 3 3 +... + h = h... h q + h q + h q3 3 +... + h q = h q where h h, h 3,..., h q d h h, h 3,..., h q re kow coeffcets. I mtr otto H q β h q

Testg h Hβ : H 0 Xβ Xβ h Hβ H H X X h Hβ ˆ ˆ ˆ ˆ test sttstc q F q F F H, f Reject 0

ltertve form of the F sttstc F RSS H 0 RSS RSS q RSS H Resdul Sum of Squres ssumg H 0 0 RSS Resdul Sum of Squres ot ssumg H 0

Cofdece tervls, Predcto tervls, Cofdece Regos Geerl Ler Model

c X X c c β ˆ s t Oe t tme ( )00 % cofdece tervl for β c ( )00 % cofdece tervl for d. / / to s s / / to s s

Multle Cofdece Itervls ssocted wth the test H 0 : Hβ h Theorem: Let H be q mtr of rk q. Cosder chβ for ll c the chβ c q, s ch XX ˆ qf H c for ll form set of ( )00 % smulteous cofdece tervl for chβ for ll c c