The multivariate Gaussian probability density function for random vector X (X 1,,X ) T. diagonal term of, denoted

Similar documents
Additional File 1 - Detailed explanation of the expression level CPD

Chapter 11. Supplemental Text Material. The method of steepest ascent can be derived as follows. Suppose that we have fit a firstorder

This appendix presents the derivations and proofs omitted from the main text.

Optimal inference of sameness Supporting information

Specification -- Assumptions of the Simple Classical Linear Regression Model (CLRM) 1. Introduction

Scattering of two identical particles in the center-of. of-mass frame. (b)

Harmonic oscillator approximation

8/25/17. Data Modeling. Data Modeling. Data Modeling. Patrice Koehl Department of Biological Sciences National University of Singapore

The Prncpal Component Transform The Prncpal Component Transform s also called Karhunen-Loeve Transform (KLT, Hotellng Transform, oregenvector Transfor

Information Acquisition in Global Games of Regime Change (Online Appendix)

Statistical pattern recognition

Chat eld, C. and A.J.Collins, Introduction to multivariate analysis. Chapman & Hall, 1980

APPENDIX A Some Linear Algebra

Bezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0

Predictors Using Partially Conditional 2 Stage Response Error Ed Stanek

Team. Outline. Statistics and Art: Sampling, Response Error, Mixed Models, Missing Data, and Inference

Gaussian process classification: a message-passing viewpoint

Bézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0

Linear Approximation with Regularization and Moving Least Squares

2.3 Nilpotent endomorphisms

Pythagorean triples. Leen Noordzij.

Multi-dimensional Central Limit Theorem

Improvements on Waring s Problem

Two Approaches to Proving. Goldbach s Conjecture

PROBABILITY PRIMER. Exercise Solutions

The Price of Anarchy in a Network Pricing Game

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

PHYS 705: Classical Mechanics. Calculus of Variations II

LECTURE 9 CANONICAL CORRELATION ANALYSIS

Chapter Newton s Method

The Geometry of Logit and Probit

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

HW #3. 1. Spin Matrices. HW3-soln-improved.nb 1. We use the spin operators represented in the bases where S z is diagonal:

ENG 8801/ Special Topics in Computer Engineering: Pattern Recognition. Memorial University of Newfoundland Pattern Recognition

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Maximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models

Confidence intervals for the difference and the ratio of Lognormal means with bounded parameters

MULTIPLE REGRESSION ANALYSIS For the Case of Two Regressors

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Effects of Ignoring Correlations When Computing Sample Chi-Square. John W. Fowler February 26, 2012

Differentiating Gaussian Processes

The Second Anti-Mathima on Game Theory

Introduction. Modeling Data. Approach. Quality of Fit. Likelihood. Probabilistic Approach

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

Formulas for the Determinant

e i is a random error

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

xp(x µ) = 0 p(x = 0 µ) + 1 p(x = 1 µ) = µ

Weak McCoy Ore Extensions

Homework Notes Week 7

8 Waves in Uniform Magnetized Media

Stat260: Bayesian Modeling and Inference Lecture Date: February 22, Reference Priors

13 Principal Components Analysis

p(z) = 1 a e z/a 1(z 0) yi a i x (1/a) exp y i a i x a i=1 n i=1 (y i a i x) inf 1 (y Ax) inf Ax y (1 ν) y if A (1 ν) = 0 otherwise

Joint Source Coding and Higher-Dimension Modulation

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

CS286r Assign One. Answer Key

Root Locus Techniques

Module 3: Element Properties Lecture 1: Natural Coordinates

Lecture 10 Support Vector Machines II

Lecture Notes on Linear Regression

P R. Lecture 4. Theory and Applications of Pattern Recognition. Dept. of Electrical and Computer Engineering /

Tensor Analysis. For orthogonal curvilinear coordinates, ˆ ˆ (98) Expanding the derivative, we have, ˆ. h q. . h q h q

Solutions to exam in SF1811 Optimization, Jan 14, 2015

MLE and Bayesian Estimation. Jie Tang Department of Computer Science & Technology Tsinghua University 2012

Logistic Regression. CAP 5610: Machine Learning Instructor: Guo-Jun QI

Lecture 3. Ax x i a i. i i

Variable Structure Control ~ Basics

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Lecture 12: Classification

Introduction to Interfacial Segregation. Xiaozhe Zhang 10/02/2015

Lecture 6/7 (February 10/12, 2014) DIRAC EQUATION. The non-relativistic Schrödinger equation was obtained by noting that the Hamiltonian 2

[ ] λ λ λ. Multicollinearity. multicollinearity Ragnar Frisch (1934) perfect exact. collinearity. multicollinearity. exact

EGR 544 Communication Theory

Chapter 7 Channel Capacity and Coding

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

The exam is closed book, closed notes except your one-page cheat sheet.

Conjugacy and the Exponential Family

FUZZY FINITE ELEMENT METHOD

Math 217 Fall 2013 Homework 2 Solutions

The Essential Dynamics Algorithm: Essential Results

Number of cases Number of factors Number of covariates Number of levels of factor i. Value of the dependent variable for case k

Week 5: Neural Networks

Classification as a Regression Problem

SELECTED PROOFS. DeMorgan s formulas: The first one is clear from Venn diagram, or the following truth table:

Radar Trackers. Study Guide. All chapters, problems, examples and page numbers refer to Applied Optimal Estimation, A. Gelb, Ed.

However, since P is a symmetric idempotent matrix, of P are either 0 or 1 [Eigen-values

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

Problem #1. Known: All required parameters. Schematic: Find: Depth of freezing as function of time. Strategy:

Quick Visit to Bernoulli Land

MULTIPLICATIVE FUNCTIONS: A REWRITE OF ANDREWS CHAPTER 6

Communication with AWGN Interference

Module 5. Cables and Arches. Version 2 CE IIT, Kharagpur

5 The Rational Canonical Form

1 Convex Optimization

Composite Hypotheses testing

Affine transformations and convexity

Discrete Simultaneous Perturbation Stochastic Approximation on Loss Function with Noisy Measurements

Transcription:

Appendx Proof of heorem he multvarate Gauan probablty denty functon for random vector X (X,,X ) px exp / / x x mean and varance equal to the th dagonal term of, denoted he margnal dtrbuton of X Gauan wth he decon maker rk-neutral and therefore /he maxmze the total expected proft A pror, the decon maker chooe the project wth potve expected value If we denote the et of a pror proftable project a, then the pror value PV max 0, Suppoe there an nformaton ource about the project; X E, ~, E 0 Let denote a ubet of the project If the decon maker able to oberve nformaton about the ubet (for free), then the value wth th nformaton y max E X,0 y py dy max E X y,0 py dy y From the properte of the multvarate Gauan dtrbuton, ee eg Anderon (003), E X y y Let u denote X E y a W W a lnear combnaton of Gauan random varable and therefore ha margnal dtrbuton, where p (w ) (, )

h lnear combnaton the un-varate varable of nteret n the mult-dmenonal ntegral requred for the value of nformaton computaton Margnalzng out the remanng dmenon of nformaton, the value wth nformaton can be mplfed to max w,0 p(w ) dw E max W, 0 w he followng reult from Schlaffer (959) and Bckel (008) For a Gauan varable W wth mean m and varance, Emax W,0 m ( m ) m Ung th reult and ubtractng the pror value from the value wth nformaton VOI( ) Snce, we get the requred reult Proof of Corollary For VOI, there nformaton regardng all project, therefore he reult follow by ubttutng and, and recognzng that e e Proof of heorem he proof of heorem how that the VOI( ) can be wrtten a VOI( ) Conder agan a Gauan varable W wth mean m and varance We wll fnd partal dervatve of the expreon m( m ) m wth repect to any parameter

d m m m m m dm d dm / d d dm / m m m d d dm / d d dm / d Snce d x dx x and d x d x x exp x exp x x, dx dx the dervatve mplfe to m m d m dm m / / m dm d m dm m m m d d d d d dm d m m d d Sentvty to the mean If m, Sentvty to the tandard devaton If, m m d m m dm m m d m m d () Sentvty to From the reult above (entvty to the mean), the dervatve wth repect to the mean of any project d,, 0 d d 0 VOI( ) maxmum at 0 and decreae a the mean get further from 0 () Sentvty to he meaurement noe affect the equvalent tandard devaton but doe not affect any mean parameter For a parameter that only affect the equvalent tandard devaton, 3

d d d d d For the lat tep n the computaton above, we have ued the followng reult, whch we proved before part () (entvty to the tandard devaton) d d For the remander of the proof, we wll compute the dervatve of the equvalent varance wth repect to q, e d d, and then replace t back n the expreon d d he dervatve of the nvere of an nvertble matrx M dm d dm d M M, where the matrx dervatve work for every entry of the matrx Here, parameter n,, therefore, for ome d d d d d d If q = t for, then d a matrx of 0 except the th dagonal element, whch equal d Matrce and are both ymmetrc alo ymmetrc nce matrx nveron b e, retan the ymmetrc property hu, by replacng d d d b b b 0 d In ummary, we get negatve effect and the dervatve dvoi( ) b d 4

() Sentvty to he pror tandard devaton affect the equvalent tandard devaton but doe not affect any mean parameter Smlar to (), for a parameter that only affect the equvalent tandard devaton, d d d d d Conder frt the pecal cae of VOI he dervatve of agan the crucal part he followng matrx dentte hold by the Sherman-Woodbury-Morron formula, ee eg Henderon and Searle (98) and herefore, S For the dervatve of d e e d d e e e e d d d If q =, d a matrx whch nonzero only for the element n row and column Defnng d d B d de d e, whch non-negatve defnte, the above expreon can be wrtten a e B e e Be Snce both and are potve defnte, th dervatve wll be potve, and VOI ncreae a a functon of the pror uncertanty he cae wth PVOI can be vewed a a pecal cae of total nformaton where ome t go to nfnty he ame proof therefore hold 5