Point process models for earthquakes with applications to Groningen and Kashmir data

Size: px
Start display at page:

Download "Point process models for earthquakes with applications to Groningen and Kashmir data"

Transcription

1 Point process models for earthquakes with applications to Groningen and Kashmir data Marie-Colette van Lieshout CWI & Twente The Netherlands Point process models for earthquakes with applications to Groningen and Kashmir data p. 1/21

2 Earthquake data Latitude (degrees north) Longitude (degrees east) Left: Groningen 2014, M 1.5. Right: Kashmir Oct 8 Nov 7, 2005, M 4.5. Point process models for earthquakes with applications to Groningen and Kashmir data p. 2/21

3 Data characteristics a region W : the gas field and a bounding box, respectively; a finite list of points in W ; additional marks (time stamps, magnitudes,...); Sometimes also information about the environment is available (covariates). Such data is called a point pattern. Point process models for earthquakes with applications to Groningen and Kashmir data p. 3/21

4 The Poisson process Write N X (A) for the number of points in A. A point process X on R d is a homogeneous Poisson process with intensity λ > 0 if N X (A) is Poisson distributed with mean λ A for every bounded Borel set A R d ; for any k disjoint bounded Borel sets A 1,...,A k, k N, the random variables N X (A 1 ),...,N X (A k ) are independent. Note: Replacing λ A by A λ(x)dx for some integrable function λ : R d R + yields an inhomogeneous Poisson process. Point process models for earthquakes with applications to Groningen and Kashmir data p. 4/21

5 First and second order moments Let X be a point process on R d. Define, for Borel sets A,B R d, α (1) (A) = EN X (A); µ (2) (A B) = E[N X (A)N X (B)]; [ ] α (2) (A B) = E 1{x A;y B}. x X y X Often, α (2) (A B) = for product density ρ (2). Normalise A B ρ (2) (x,y)dxdy to get the pair correlation function. g(x,y) = ρ(2) (x,y) ρ (1) (x)ρ (2) (y) Point process models for earthquakes with applications to Groningen and Kashmir data p. 5/21

6 Spatial regression Goal: given data pattern x = {x 1,...,x n } in W, investigate whether the intensity depends on covariate functions C j : W R, j = 1,...,p. Point process models for earthquakes with applications to Groningen and Kashmir data p. 6/21

7 Maximum likelihood for Poisson processes Model λ(u) = λ β (u) = exp [ β 0 + ] p β j C j (u). j=1 The log likelihood function L(β) reads p n L(β) = nβ 0 + β j C j (x i ) e β 0 j=1 i=1 W [ p ] exp β j C j (u) du j=1 so ˆβ solves the score equations C j (u)λ β (u)du = W n C j (x i ) i=1 for j = 0,...,p under the convention that C 0 1. Point process models for earthquakes with applications to Groningen and Kashmir data p. 7/21

8 Results Van Hove et al., 2015 Three students at Twente (Van Hove, Van Lingen and Riemens) estimated the parameters in this model and extrapolated them into the future. Remark: In 2014, the Dutch government decided to reduce gas extraction near Loppersum (NW) by some 80%. In this scenario, 18 rather than 24 quakes are predicted in 2018 Point process models for earthquakes with applications to Groningen and Kashmir data p. 8/21

9 Hypothesis tests To assess the significance of the covariates, use where f is the likelihood function. Λ(X) = sup{f(x;β) : β j = 0} f(x; ˆβ) Under β j = 0, 2logΛ(X) is approximately χ 2 1-distributed. For the composite hypothesis β j = 0 for all j = 1,...,p, use Λ(X) = sup{f(x;β) : β 1 = = β p = 0} f(x; ˆβ). Now, 2logΛ(X) is approximately χ 2 p-distributed. Van Hove et al.: the kernel smoothed fault lines, amount of gas extraction and subsidence all proved significant; the number of quakes in previous years was not. Point process models for earthquakes with applications to Groningen and Kashmir data p. 9/21

10 Kashmir data 176 spatial locations of shallow (depth less than 70 km) earthquakes of magnitude 4.5 or higher recorded October 8 November 7, 2005, in W = [72.65, 74.25] [33.70, 35.25] (Kashmir). Latitude (degrees north) Longitude (degrees east) Point process models for earthquakes with applications to Groningen and Kashmir data p. 10/21

11 Exploratory analysis Frequency Magnitude Time in hours from October 8, Time in hours from October 8, 2005 Notes: 76% of shocks happen within the first 48 hours from the main shock; two clear magnitude extremes of 7.6 (the main shock) and 6.4 ((Båth s law). Point process models for earthquakes with applications to Groningen and Kashmir data p. 11/21

12 Poisson cluster process X = x Φ(x+Z x ) where the Z x are i.i.d. clusters centred around the points x of a homogeneous Poisson process Φ. Depending on the structure of Z x, there are two main models: Trigger process: Z x consist of a Poisson number of i.i.d points; Hawkes process: Z x is a branching process. Point process models for earthquakes with applications to Groningen and Kashmir data p. 12/21

13 Trigger process Φ Poisson(κ); each parent generates Poisson(ν) offspring, i.i.d. bivariate normally distributed around the parent with covariance matrix σ 2 I. The trigger process X is stationary with intensity ρ = κν and has pair correlation function (Stoyan et al. 1995). g(r = x y ) = πκσ 2 exp[ r 2 /(4σ 2 ) ] Note: g(r) does not depend on ν, so fix ρ = κν = 176/ W. Point process models for earthquakes with applications to Groningen and Kashmir data p. 13/21

14 Hawkes process Φ Poisson(κ); its points form a subset of X, called generation zero; each point of generation j = 0,1,... acts as parent and produces Poisson(ν) offspring, i.i.d. bivariate normally distributed around the parent with covariance matrix σ 2 I with ν < 1; the combined offspring of generation j form generation j +1; the iteration terminates at the first empty generation. The Hawkes process X is stationary with intensity ρ = κ/(1 ν) and has pair correlation function g(r) = 1+ 1 ν κ (n+1)ν n 1 2πnσ exp[ r 2 /(2nσ 2 ) ] 2 n=1 (Møller and Torrisi 2007). Point process models for earthquakes with applications to Groningen and Kashmir data p. 14/21

15 Minimum contrast method Asume the pair correlation function g : R 2 R is rotation-invariant and minimise over the parameter θ. t1 t 0 ĝ(r) g(r;θ) 2 dr, Here and λ 2 g(r) = 1 2πr x X W ˆλ = N X(W) W y X W is an edge-corrected kernel estimator. 1{ ǫ r y x ǫ} 2ǫ W W y x Point process models for earthquakes with applications to Groningen and Kashmir data p. 15/21

16 Results g(r) g fit(r) g^ripley(r) g Pois(r) g(r) g fit(r) g^ripley(r) g Pois(r) Distance r (in degrees) Distance r (in degrees) Trigger process ˆκ = 0.88, ˆσ = 0.08 and ˆν = 81. Thus, 2.17 main shocks in Kashmir with 81 aftershocks each. Hawkes process ˆκ = 7.44, ˆσ = 0.03 and ˆν = 0.9. Thus, main shocks in Kashmir with 1/(1 ν) = 9.54 aftershocks each. Point process models for earthquakes with applications to Groningen and Kashmir data p. 16/21

17 Mixture model of two bivariate normal distributions with a cluster around the main shock at µ 1 = (73.59,34.54); a cluster around the location µ 2 = (73.10,34.73) of the second largest shock; all m = 69 earthquakes y i happening before the second shock belonging to the first cluster. For the other n = 105 earthquake locations x i, introduce latent variables (Z 1,...Z n ). If Z i = 1, x i is allocated to µ 1, if 2 to µ 2. Likelihood function m n [ f(y i µ 1,Σ 1 ) p1{zi =1}f(x i µ 1,Σ 1 )+(1 p)1 {zi =2}f(x i µ 2,Σ 2 ) ] i=1 i=1 where f( µ,σ) is the bivariate normal probability density function with mean vector µ and covariance matrix Σ. Point process models for earthquakes with applications to Groningen and Kashmir data p. 17/21

18 Mixture parameter estimation by EM-method Iterate p t+1 Σ 1,t+1 = = 1 n + Σ 2,t+1 = n P(Z i = 1 X i = x i ;θ t ) i=1 m i=1 (y i µ 1 )(y i µ 1 ) T m+ n i=1 P(Z i = 1 X i = x i ;θ t ) n i=1 P(Z i = 1 X i = x i ;θ t )(x i µ 1 )(x i µ 1 ) T m+ n i=1 P(Z i = 1 X i = x i ;θ t ) n i=1 P(Z i = 2 X i = x i ;θ t )(x i µ 2 )(x i µ 2 ) T n i=1 P(Z i = 2 X i = x i ;θ t ) ;, where P(Z i = 1 X i = x i ;θ t ) = p t f(x i µ 1,Σ 1,t ) p t f(x i µ 1,Σ 1,t )+(1 p t )f(x i µ 2,Σ 2,t ) and P(Z i = 2 X i = x i ;θ t ) = 1 P(Z i = 1 X i = x i ;θ t ). Point process models for earthquakes with applications to Groningen and Kashmir data p. 18/21

19 Results Latitude (degrees north) Longitude (degrees east) Allocate x i to µ 1 (triangles) if ˆpf(x i µ 1, ˆΣ 1 ) > (1 ˆp)f(x i µ 2, ˆΣ 2 ) with ˆp = 0.28, ˆΣ =, ˆΣ = and to µ 2 (crosses) otherwise. The circles indicate the y i. Point process models for earthquakes with applications to Groningen and Kashmir data p. 19/21

20 Conclusions Groningen (Van Hove et al., 2015) The number of induced earthquakes has increased over the years. An increase in magnitude is not statistically significant. Covariates on gas extraction and subsidence have a statistically significant effect on the earthquake intensity. Even if there would be no more gas extracted, there would still be earthquakes in the near future. E. van Hove, R. van Lingen en S. Riemens. Geïnduceerde aardbevingen in gasveld Groningen. Een statistische analyse. (In Dutch). B.Sc. thesis, University of Twente, Point process models for earthquakes with applications to Groningen and Kashmir data p. 20/21

21 Conclusions Kashmir A trigger process is a better fit than a Hawkes process. Gaussian mixture modelling allows for variable cluster characteristics. The cluster of aftershocks of the main shock is more widely scattered than that of the second most severe one. Longitude and latitude are negatively correlated; the variation in longitude is larger than that in latitude (reflecting the tilt of the convergence zone in northern Pakistan). K. Türkyilmaz, M.N.M. van Lieshout and A. Stein. Comparing the Hawkes and trigger process models for aftershock sequences following the 2005 Kashmir earthquake. Mathematical Geosciences, 45: , Point process models for earthquakes with applications to Groningen and Kashmir data p. 21/21

Summary statistics for inhomogeneous spatio-temporal marked point patterns

Summary statistics for inhomogeneous spatio-temporal marked point patterns Summary statistics for inhomogeneous spatio-temporal marked point patterns Marie-Colette van Lieshout CWI Amsterdam The Netherlands Joint work with Ottmar Cronie Summary statistics for inhomogeneous spatio-temporal

More information

A Spatio-Temporal Point Process Model for Firemen Demand in Twente

A Spatio-Temporal Point Process Model for Firemen Demand in Twente University of Twente A Spatio-Temporal Point Process Model for Firemen Demand in Twente Bachelor Thesis Author: Mike Wendels Supervisor: prof. dr. M.N.M. van Lieshout Stochastic Operations Research Applied

More information

Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017

Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Ph.D. Qualifying Exam Friday Saturday, January 6 7, 2017 Put your solution to each problem on a separate sheet of paper. Problem 1. (5106) Let X 1, X 2,, X n be a sequence of i.i.d. observations from a

More information

Problem Selected Scores

Problem Selected Scores Statistics Ph.D. Qualifying Exam: Part II November 20, 2010 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. Problem 1 2 3 4 5 6 7 8 9 10 11 12 Selected

More information

SOLUTION FOR HOMEWORK 6, STAT 6331

SOLUTION FOR HOMEWORK 6, STAT 6331 SOLUTION FOR HOMEWORK 6, STAT 633. Exerc.7.. It is given that X,...,X n is a sample from N(θ, σ ), and the Bayesian approach is used with Θ N(µ, τ ). The parameters σ, µ and τ are given. (a) Find the joinf

More information

Quasi-likelihood Scan Statistics for Detection of

Quasi-likelihood Scan Statistics for Detection of for Quasi-likelihood for Division of Biostatistics and Bioinformatics, National Health Research Institutes & Department of Mathematics, National Chung Cheng University 17 December 2011 1 / 25 Outline for

More information

Finite Singular Multivariate Gaussian Mixture

Finite Singular Multivariate Gaussian Mixture 21/06/2016 Plan 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Plan Singular Multivariate Normal Distribution 1 Basic definitions Singular Multivariate Normal Distribution 2 3 Multivariate

More information

Spatial analysis of tropical rain forest plot data

Spatial analysis of tropical rain forest plot data Spatial analysis of tropical rain forest plot data Rasmus Waagepetersen Department of Mathematical Sciences Aalborg University December 11, 2010 1/45 Tropical rain forest ecology Fundamental questions:

More information

Point Pattern Analysis

Point Pattern Analysis Point Pattern Analysis Nearest Neighbor Statistics Luc Anselin http://spatial.uchicago.edu principle G function F function J function Principle Terminology events and points event: observed location of

More information

GIST 4302/5302: Spatial Analysis and Modeling Point Pattern Analysis

GIST 4302/5302: Spatial Analysis and Modeling Point Pattern Analysis GIST 4302/5302: Spatial Analysis and Modeling Point Pattern Analysis Guofeng Cao www.spatial.ttu.edu Department of Geosciences Texas Tech University guofeng.cao@ttu.edu Fall 2018 Spatial Point Patterns

More information

Spatial Point Pattern Analysis

Spatial Point Pattern Analysis Spatial Point Pattern Analysis Jamie Monogan University of Georgia Spatial Data Analysis Jamie Monogan (UGA) Spatial Point Pattern Analysis Spatial Data Analysis 1 / 13 Objectives By the end of this meeting,

More information

The Use of Statistical Point Processes in Geoinformation Analysis

The Use of Statistical Point Processes in Geoinformation Analysis The Use of Statistical Point Processes in Geoinformation Analysis Alfred Stein, Valentyn Tolpekin, Salma Anwar Twente University Faculty of Geo Information Science and Earth Observation, The Netherlands

More information

ESTIMATING FUNCTIONS FOR INHOMOGENEOUS COX PROCESSES

ESTIMATING FUNCTIONS FOR INHOMOGENEOUS COX PROCESSES ESTIMATING FUNCTIONS FOR INHOMOGENEOUS COX PROCESSES Rasmus Waagepetersen Department of Mathematics, Aalborg University, Fredrik Bajersvej 7G, DK-9220 Aalborg, Denmark (rw@math.aau.dk) Abstract. Estimation

More information

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall Machine Learning Gaussian Mixture Models Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall 2012 1 The Generative Model POV We think of the data as being generated from some process. We assume

More information

Chapter 1. Linear Regression with One Predictor Variable

Chapter 1. Linear Regression with One Predictor Variable Chapter 1. Linear Regression with One Predictor Variable 1.1 Statistical Relation Between Two Variables To motivate statistical relationships, let us consider a mathematical relation between two mathematical

More information

Two step estimation for Neyman-Scott point process with inhomogeneous cluster centers. May 2012

Two step estimation for Neyman-Scott point process with inhomogeneous cluster centers. May 2012 Two step estimation for Neyman-Scott point process with inhomogeneous cluster centers Tomáš Mrkvička, Milan Muška, Jan Kubečka May 2012 Motivation Study of the influence of covariates on the occurrence

More information

Decomposition of variance for spatial Cox processes

Decomposition of variance for spatial Cox processes Decomposition of variance for spatial Cox processes Rasmus Waagepetersen Department of Mathematical Sciences Aalborg University Joint work with Abdollah Jalilian and Yongtao Guan November 8, 2010 1/34

More information

Master s Written Examination

Master s Written Examination Master s Written Examination Option: Statistics and Probability Spring 05 Full points may be obtained for correct answers to eight questions Each numbered question (which may have several parts) is worth

More information

Introduction to Normal Distribution

Introduction to Normal Distribution Introduction to Normal Distribution Nathaniel E. Helwig Assistant Professor of Psychology and Statistics University of Minnesota (Twin Cities) Updated 17-Jan-2017 Nathaniel E. Helwig (U of Minnesota) Introduction

More information

Linear Methods for Prediction

Linear Methods for Prediction Chapter 5 Linear Methods for Prediction 5.1 Introduction We now revisit the classification problem and focus on linear methods. Since our prediction Ĝ(x) will always take values in the discrete set G we

More information

Earthquake Modelling at the Country Level Using Aggregated Spatio-Temporal Point Processes

Earthquake Modelling at the Country Level Using Aggregated Spatio-Temporal Point Processes Math Geosci (2012) 44:309 326 DOI 10.1007/s11004-011-9380-3 Earthquake Modelling at the Country Level Using Aggregated Spatio-Temporal Point Processes M.N.M. van Lieshout A. Stein Received: 28 March 2011

More information

Statistics Ph.D. Qualifying Exam: Part II November 9, 2002

Statistics Ph.D. Qualifying Exam: Part II November 9, 2002 Statistics Ph.D. Qualifying Exam: Part II November 9, 2002 Student Name: 1. Answer 8 out of 12 problems. Mark the problems you selected in the following table. 1 2 3 4 5 6 7 8 9 10 11 12 2. Write your

More information

Temporal Point Processes the Conditional Intensity Function

Temporal Point Processes the Conditional Intensity Function Temporal Point Processes the Conditional Intensity Function Jakob G. Rasmussen Department of Mathematics Aalborg University Denmark February 8, 2010 1/10 Temporal point processes A temporal point process

More information

Decomposition of variance for spatial Cox processes

Decomposition of variance for spatial Cox processes Decomposition of variance for spatial Cox processes Rasmus Waagepetersen Department of Mathematical Sciences Aalborg University Joint work with Abdollah Jalilian and Yongtao Guan December 13, 2010 1/25

More information

STT 843 Key to Homework 1 Spring 2018

STT 843 Key to Homework 1 Spring 2018 STT 843 Key to Homework Spring 208 Due date: Feb 4, 208 42 (a Because σ = 2, σ 22 = and ρ 2 = 05, we have σ 2 = ρ 2 σ σ22 = 2/2 Then, the mean and covariance of the bivariate normal is µ = ( 0 2 and Σ

More information

Spatial point processes

Spatial point processes Mathematical sciences Chalmers University of Technology and University of Gothenburg Gothenburg, Sweden June 25, 2014 Definition A point process N is a stochastic mechanism or rule to produce point patterns

More information

Part III. Hypothesis Testing. III.1. Log-rank Test for Right-censored Failure Time Data

Part III. Hypothesis Testing. III.1. Log-rank Test for Right-censored Failure Time Data 1 Part III. Hypothesis Testing III.1. Log-rank Test for Right-censored Failure Time Data Consider a survival study consisting of n independent subjects from p different populations with survival functions

More information

Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D.

Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D. Web Appendix for Hierarchical Adaptive Regression Kernels for Regression with Functional Predictors by D. B. Woodard, C. Crainiceanu, and D. Ruppert A. EMPIRICAL ESTIMATE OF THE KERNEL MIXTURE Here we

More information

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A.

Fall 2017 STAT 532 Homework Peter Hoff. 1. Let P be a probability measure on a collection of sets A. 1. Let P be a probability measure on a collection of sets A. (a) For each n N, let H n be a set in A such that H n H n+1. Show that P (H n ) monotonically converges to P ( k=1 H k) as n. (b) For each n

More information

Linear Dynamical Systems (Kalman filter)

Linear Dynamical Systems (Kalman filter) Linear Dynamical Systems (Kalman filter) (a) Overview of HMMs (b) From HMMs to Linear Dynamical Systems (LDS) 1 Markov Chains with Discrete Random Variables x 1 x 2 x 3 x T Let s assume we have discrete

More information

Notes on the Multivariate Normal and Related Topics

Notes on the Multivariate Normal and Related Topics Version: July 10, 2013 Notes on the Multivariate Normal and Related Topics Let me refresh your memory about the distinctions between population and sample; parameters and statistics; population distributions

More information

DRAFT: A2.1 Activity rate Loppersum

DRAFT: A2.1 Activity rate Loppersum DRAFT: A.1 Activity rate Loppersum Rakesh Paleja, Matthew Jones, David Randell, Stijn Bierman April 3, 15 1 Summary On 1st Jan 14, the rate of production in the area of Loppersum was reduced. Here we seek

More information

Estimating functions for inhomogeneous spatial point processes with incomplete covariate data

Estimating functions for inhomogeneous spatial point processes with incomplete covariate data Estimating functions for inhomogeneous spatial point processes with incomplete covariate data Rasmus aagepetersen Department of Mathematics Aalborg University Denmark August 15, 2007 1 / 23 Data (Barro

More information

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed

Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 18.466 Notes, March 4, 2013, R. Dudley Maximum likelihood estimation: actual or supposed 1. MLEs in exponential families Let f(x,θ) for x X and θ Θ be a likelihood function, that is, for present purposes,

More information

1.1 Basis of Statistical Decision Theory

1.1 Basis of Statistical Decision Theory ECE598: Information-theoretic methods in high-dimensional statistics Spring 2016 Lecture 1: Introduction Lecturer: Yihong Wu Scribe: AmirEmad Ghassami, Jan 21, 2016 [Ed. Jan 31] Outline: Introduction of

More information

Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes

Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes Eric W. Fox, Ph.D. Department of Statistics UCLA June 15, 2015 Hawkes-type Point Process

More information

IEOR 165 Lecture 13 Maximum Likelihood Estimation

IEOR 165 Lecture 13 Maximum Likelihood Estimation IEOR 165 Lecture 13 Maximum Likelihood Estimation 1 Motivating Problem Suppose we are working for a grocery store, and we have decided to model service time of an individual using the express lane (for

More information

On Model Fitting Procedures for Inhomogeneous Neyman-Scott Processes

On Model Fitting Procedures for Inhomogeneous Neyman-Scott Processes On Model Fitting Procedures for Inhomogeneous Neyman-Scott Processes Yongtao Guan July 31, 2006 ABSTRACT In this paper we study computationally efficient procedures to estimate the second-order parameters

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 218 Outlines Overview Introduction Linear Algebra Probability Linear Regression 1

More information

Minimum Message Length Analysis of the Behrens Fisher Problem

Minimum Message Length Analysis of the Behrens Fisher Problem Analysis of the Behrens Fisher Problem Enes Makalic and Daniel F Schmidt Centre for MEGA Epidemiology The University of Melbourne Solomonoff 85th Memorial Conference, 2011 Outline Introduction 1 Introduction

More information

HT Introduction. P(X i = x i ) = e λ λ x i

HT Introduction. P(X i = x i ) = e λ λ x i MODS STATISTICS Introduction. HT 2012 Simon Myers, Department of Statistics (and The Wellcome Trust Centre for Human Genetics) myers@stats.ox.ac.uk We will be concerned with the mathematical framework

More information

ECE 275A Homework 7 Solutions

ECE 275A Homework 7 Solutions ECE 275A Homework 7 Solutions Solutions 1. For the same specification as in Homework Problem 6.11 we want to determine an estimator for θ using the Method of Moments (MOM). In general, the MOM estimator

More information

f(x θ)dx with respect to θ. Assuming certain smoothness conditions concern differentiating under the integral the integral sign, we first obtain

f(x θ)dx with respect to θ. Assuming certain smoothness conditions concern differentiating under the integral the integral sign, we first obtain 0.1. INTRODUCTION 1 0.1 Introduction R. A. Fisher, a pioneer in the development of mathematical statistics, introduced a measure of the amount of information contained in an observaton from f(x θ). Fisher

More information

Point Processes. Tonglin Zhang. Spatial Statistics for Point and Lattice Data (Part II)

Point Processes. Tonglin Zhang. Spatial Statistics for Point and Lattice Data (Part II) Title: patial tatistics for Point Processes and Lattice Data (Part II) Point Processes Tonglin Zhang Outline Outline imulated Examples Interesting Problems Analysis under tationarity Analysis under Nonstationarity

More information

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012

Gaussian Processes. Le Song. Machine Learning II: Advanced Topics CSE 8803ML, Spring 2012 Gaussian Processes Le Song Machine Learning II: Advanced Topics CSE 8803ML, Spring 01 Pictorial view of embedding distribution Transform the entire distribution to expected features Feature space Feature

More information

Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III)

Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Chapter 4: Constrained estimators and tests in the multiple linear regression model (Part III) Florian Pelgrin HEC September-December 2010 Florian Pelgrin (HEC) Constrained estimators September-December

More information

Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama

Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Qualifying Exam CS 661: System Simulation Summer 2013 Prof. Marvin K. Nakayama Instructions This exam has 7 pages in total, numbered 1 to 7. Make sure your exam has all the pages. This exam will be 2 hours

More information

Are Declustered Earthquake Catalogs Poisson?

Are Declustered Earthquake Catalogs Poisson? Are Declustered Earthquake Catalogs Poisson? Philip B. Stark Department of Statistics, UC Berkeley Brad Luen Department of Mathematics, Reed College 14 October 2010 Department of Statistics, Penn State

More information

Simulation of Max Stable Processes

Simulation of Max Stable Processes Simulation of Max Stable Processes Whitney Huang Department of Statistics Purdue University November 6, 2013 1 / 30 Outline 1 Max-Stable Processes 2 Unconditional Simulations 3 Conditional Simulations

More information

Information geometry for bivariate distribution control

Information geometry for bivariate distribution control Information geometry for bivariate distribution control C.T.J.Dodson + Hong Wang Mathematics + Control Systems Centre, University of Manchester Institute of Science and Technology Optimal control of stochastic

More information

Jesper Møller ) and Kateřina Helisová )

Jesper Møller ) and Kateřina Helisová ) Jesper Møller ) and ) ) Aalborg University (Denmark) ) Czech Technical University/Charles University in Prague 5 th May 2008 Outline 1. Describing model 2. Simulation 3. Power tessellation of a union of

More information

Geophysical Journal International

Geophysical Journal International Geophysical Journal International Geophys. J. Int. (2011) 184, 759 776 doi: 10.1111/j.1365-246X.2010.04857.x Global earthquake forecasts Yan Y. Kagan and David D. Jackson Department of Earth and Space

More information

Lecture 9 Point Processes

Lecture 9 Point Processes Lecture 9 Point Processes Dennis Sun Stats 253 July 21, 2014 Outline of Lecture 1 Last Words about the Frequency Domain 2 Point Processes in Time and Space 3 Inhomogeneous Poisson Processes 4 Second-Order

More information

Practice Examination # 3

Practice Examination # 3 Practice Examination # 3 Sta 23: Probability December 13, 212 This is a closed-book exam so do not refer to your notes, the text, or any other books (please put them on the floor). You may use a single

More information

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications

Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Empirical likelihood and self-weighting approach for hypothesis testing of infinite variance processes and its applications Fumiya Akashi Research Associate Department of Applied Mathematics Waseda University

More information

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università

More information

Earthquake Clustering and Declustering

Earthquake Clustering and Declustering Earthquake Clustering and Declustering Philip B. Stark Department of Statistics, UC Berkeley joint with (separately) Peter Shearer, SIO/IGPP, UCSD Brad Luen 4 October 2011 Institut de Physique du Globe

More information

Models for spatial data (cont d) Types of spatial data. Types of spatial data (cont d) Hierarchical models for spatial data

Models for spatial data (cont d) Types of spatial data. Types of spatial data (cont d) Hierarchical models for spatial data Hierarchical models for spatial data Based on the book by Banerjee, Carlin and Gelfand Hierarchical Modeling and Analysis for Spatial Data, 2004. We focus on Chapters 1, 2 and 5. Geo-referenced data arise

More information

[y i α βx i ] 2 (2) Q = i=1

[y i α βx i ] 2 (2) Q = i=1 Least squares fits This section has no probability in it. There are no random variables. We are given n points (x i, y i ) and want to find the equation of the line that best fits them. We take the equation

More information

Linear Methods for Prediction

Linear Methods for Prediction This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this

More information

Second-Order Analysis of Spatial Point Processes

Second-Order Analysis of Spatial Point Processes Title Second-Order Analysis of Spatial Point Process Tonglin Zhang Outline Outline Spatial Point Processes Intensity Functions Mean and Variance Pair Correlation Functions Stationarity K-functions Some

More information

Testing for Poisson Behavior

Testing for Poisson Behavior Testing for Poisson Behavior Philip B. Stark Department of Statistics, UC Berkeley joint with Brad Luen 17 April 2012 Seismological Society of America Annual Meeting San Diego, CA Quake Physics versus

More information

PCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities

PCMI Introduction to Random Matrix Theory Handout # REVIEW OF PROBABILITY THEORY. Chapter 1 - Events and Their Probabilities PCMI 207 - Introduction to Random Matrix Theory Handout #2 06.27.207 REVIEW OF PROBABILITY THEORY Chapter - Events and Their Probabilities.. Events as Sets Definition (σ-field). A collection F of subsets

More information

Wrapped Gaussian processes: a short review and some new results

Wrapped Gaussian processes: a short review and some new results Wrapped Gaussian processes: a short review and some new results Giovanna Jona Lasinio 1, Gianluca Mastrantonio 2 and Alan Gelfand 3 1-Università Sapienza di Roma 2- Università RomaTRE 3- Duke University

More information

Section 4.6 Simple Linear Regression

Section 4.6 Simple Linear Regression Section 4.6 Simple Linear Regression Objectives ˆ Basic philosophy of SLR and the regression assumptions ˆ Point & interval estimation of the model parameters, and how to make predictions ˆ Point and interval

More information

Master s Written Examination - Solution

Master s Written Examination - Solution Master s Written Examination - Solution Spring 204 Problem Stat 40 Suppose X and X 2 have the joint pdf f X,X 2 (x, x 2 ) = 2e (x +x 2 ), 0 < x < x 2

More information

Advanced Introduction to Machine Learning

Advanced Introduction to Machine Learning 10-715 Advanced Introduction to Machine Learning Homework 3 Due Nov 12, 10.30 am Rules 1. Homework is due on the due date at 10.30 am. Please hand over your homework at the beginning of class. Please see

More information

Statistical Analysis of Spatio-temporal Point Process Data. Peter J Diggle

Statistical Analysis of Spatio-temporal Point Process Data. Peter J Diggle Statistical Analysis of Spatio-temporal Point Process Data Peter J Diggle Department of Medicine, Lancaster University and Department of Biostatistics, Johns Hopkins University School of Public Health

More information

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014

Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Ph.D. Qualifying Exam Friday Saturday, January 3 4, 2014 Put your solution to each problem on a separate sheet of paper. Problem 1. (5166) Assume that two random samples {x i } and {y i } are independently

More information

Topics in Stochastic Geometry. Lecture 4 The Boolean model

Topics in Stochastic Geometry. Lecture 4 The Boolean model Institut für Stochastik Karlsruher Institut für Technologie Topics in Stochastic Geometry Lecture 4 The Boolean model Lectures presented at the Department of Mathematical Sciences University of Bath May

More information

Lecture 13: Data Modelling and Distributions. Intelligent Data Analysis and Probabilistic Inference Lecture 13 Slide No 1

Lecture 13: Data Modelling and Distributions. Intelligent Data Analysis and Probabilistic Inference Lecture 13 Slide No 1 Lecture 13: Data Modelling and Distributions Intelligent Data Analysis and Probabilistic Inference Lecture 13 Slide No 1 Why data distributions? It is a well established fact that many naturally occurring

More information

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator

Estimation Theory. as Θ = (Θ 1,Θ 2,...,Θ m ) T. An estimator Estimation Theory Estimation theory deals with finding numerical values of interesting parameters from given set of data. We start with formulating a family of models that could describe how the data were

More information

Ornstein-Uhlenbeck processes for geophysical data analysis

Ornstein-Uhlenbeck processes for geophysical data analysis Ornstein-Uhlenbeck processes for geophysical data analysis Semere Habtemicael Department of Mathematics North Dakota State University May 19, 2014 Outline 1 Introduction 2 Model 3 Characteristic function

More information

Introduction to Machine Learning

Introduction to Machine Learning Introduction to Machine Learning Brown University CSCI 1950-F, Spring 2012 Prof. Erik Sudderth Lecture 20: Expectation Maximization Algorithm EM for Mixture Models Many figures courtesy Kevin Murphy s

More information

Expectation Maximization and Mixtures of Gaussians

Expectation Maximization and Mixtures of Gaussians Statistical Machine Learning Notes 10 Expectation Maximiation and Mixtures of Gaussians Instructor: Justin Domke Contents 1 Introduction 1 2 Preliminary: Jensen s Inequality 2 3 Expectation Maximiation

More information

Mean square continuity

Mean square continuity Mean square continuity Suppose Z is a random field on R d We say Z is mean square continuous at s if lim E{Z(x) x s Z(s)}2 = 0 If Z is stationary, Z is mean square continuous at s if and only if K is continuous

More information

Week 3: The EM algorithm

Week 3: The EM algorithm Week 3: The EM algorithm Maneesh Sahani maneesh@gatsby.ucl.ac.uk Gatsby Computational Neuroscience Unit University College London Term 1, Autumn 2005 Mixtures of Gaussians Data: Y = {y 1... y N } Latent

More information

Spatial point process. Odd Kolbjørnsen 13.March 2017

Spatial point process. Odd Kolbjørnsen 13.March 2017 Spatial point process Odd Kolbjørnsen 13.March 2017 Today Point process Poisson process Intensity Homogeneous Inhomogeneous Other processes Random intensity (Cox process) Log Gaussian cox process (LGCP)

More information

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall

Machine Learning. Gaussian Mixture Models. Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall Machine Learning Gaussian Mixture Models Zhiyao Duan & Bryan Pardo, Machine Learning: EECS 349 Fall 2012 1 Discriminative vs Generative Models Discriminative: Just learn a decision boundary between your

More information

Gaussian Process Regression Model in Spatial Logistic Regression

Gaussian Process Regression Model in Spatial Logistic Regression Journal of Physics: Conference Series PAPER OPEN ACCESS Gaussian Process Regression Model in Spatial Logistic Regression To cite this article: A Sofro and A Oktaviarina 018 J. Phys.: Conf. Ser. 947 01005

More information

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari

MS&E 226: Small Data. Lecture 11: Maximum likelihood (v2) Ramesh Johari MS&E 226: Small Data Lecture 11: Maximum likelihood (v2) Ramesh Johari ramesh.johari@stanford.edu 1 / 18 The likelihood function 2 / 18 Estimating the parameter This lecture develops the methodology behind

More information

1: PROBABILITY REVIEW

1: PROBABILITY REVIEW 1: PROBABILITY REVIEW Marek Rutkowski School of Mathematics and Statistics University of Sydney Semester 2, 2016 M. Rutkowski (USydney) Slides 1: Probability Review 1 / 56 Outline We will review the following

More information

Student-t Process as Alternative to Gaussian Processes Discussion

Student-t Process as Alternative to Gaussian Processes Discussion Student-t Process as Alternative to Gaussian Processes Discussion A. Shah, A. G. Wilson and Z. Gharamani Discussion by: R. Henao Duke University June 20, 2014 Contributions The paper is concerned about

More information

Variance Estimation for Statistics Computed from. Inhomogeneous Spatial Point Processes

Variance Estimation for Statistics Computed from. Inhomogeneous Spatial Point Processes Variance Estimation for Statistics Computed from Inhomogeneous Spatial Point Processes Yongtao Guan April 14, 2007 Abstract This paper introduces a new approach to estimate the variance of statistics that

More information

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric

More information

Gaussian processes for inference in stochastic differential equations

Gaussian processes for inference in stochastic differential equations Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm 1/29 EM & Latent Variable Models Gaussian Mixture Models EM Theory The Expectation-Maximization Algorithm Mihaela van der Schaar Department of Engineering Science University of Oxford MLE for Latent Variable

More information

Linear Models and Estimation by Least Squares

Linear Models and Estimation by Least Squares Linear Models and Estimation by Least Squares Jin-Lung Lin 1 Introduction Causal relation investigation lies in the heart of economics. Effect (Dependent variable) cause (Independent variable) Example:

More information

Clustering K-means. Clustering images. Machine Learning CSE546 Carlos Guestrin University of Washington. November 4, 2014.

Clustering K-means. Clustering images. Machine Learning CSE546 Carlos Guestrin University of Washington. November 4, 2014. Clustering K-means Machine Learning CSE546 Carlos Guestrin University of Washington November 4, 2014 1 Clustering images Set of Images [Goldberger et al.] 2 1 K-means Randomly initialize k centers µ (0)

More information

Random vectors X 1 X 2. Recall that a random vector X = is made up of, say, k. X k. random variables.

Random vectors X 1 X 2. Recall that a random vector X = is made up of, say, k. X k. random variables. Random vectors Recall that a random vector X = X X 2 is made up of, say, k random variables X k A random vector has a joint distribution, eg a density f(x), that gives probabilities P(X A) = f(x)dx Just

More information

Normalized kernel-weighted random measures

Normalized kernel-weighted random measures Normalized kernel-weighted random measures Jim Griffin University of Kent 1 August 27 Outline 1 Introduction 2 Ornstein-Uhlenbeck DP 3 Generalisations Bayesian Density Regression We observe data (x 1,

More information

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1

A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Int. J. Contemp. Math. Sci., Vol. 2, 2007, no. 13, 639-648 A Bayesian Mixture Model with Application to Typhoon Rainfall Predictions in Taipei, Taiwan 1 Tsai-Hung Fan Graduate Institute of Statistics National

More information

Parameter Estimation and Fitting to Data

Parameter Estimation and Fitting to Data Parameter Estimation and Fitting to Data Parameter estimation Maximum likelihood Least squares Goodness-of-fit Examples Elton S. Smith, Jefferson Lab 1 Parameter estimation Properties of estimators 3 An

More information

Chapter 2. Poisson point processes

Chapter 2. Poisson point processes Chapter 2. Poisson point processes Jean-François Coeurjolly http://www-ljk.imag.fr/membres/jean-francois.coeurjolly/ Laboratoire Jean Kuntzmann (LJK), Grenoble University Setting for this chapter To ease

More information

Introduction to Machine Learning. Maximum Likelihood and Bayesian Inference. Lecturers: Eran Halperin, Yishay Mansour, Lior Wolf

Introduction to Machine Learning. Maximum Likelihood and Bayesian Inference. Lecturers: Eran Halperin, Yishay Mansour, Lior Wolf 1 Introduction to Machine Learning Maximum Likelihood and Bayesian Inference Lecturers: Eran Halperin, Yishay Mansour, Lior Wolf 2013-14 We know that X ~ B(n,p), but we do not know p. We get a random sample

More information

Link lecture - Lagrange Multipliers

Link lecture - Lagrange Multipliers Link lecture - Lagrange Multipliers Lagrange multipliers provide a method for finding a stationary point of a function, say f(x, y) when the variables are subject to constraints, say of the form g(x, y)

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Clustering K-means. Machine Learning CSE546. Sham Kakade University of Washington. November 15, Review: PCA Start: unsupervised learning

Clustering K-means. Machine Learning CSE546. Sham Kakade University of Washington. November 15, Review: PCA Start: unsupervised learning Clustering K-means Machine Learning CSE546 Sham Kakade University of Washington November 15, 2016 1 Announcements: Project Milestones due date passed. HW3 due on Monday It ll be collaborative HW2 grades

More information

EXAM IN STATISTICAL MACHINE LEARNING STATISTISK MASKININLÄRNING

EXAM IN STATISTICAL MACHINE LEARNING STATISTISK MASKININLÄRNING EXAM IN STATISTICAL MACHINE LEARNING STATISTISK MASKININLÄRNING DATE AND TIME: August 30, 2018, 14.00 19.00 RESPONSIBLE TEACHER: Niklas Wahlström NUMBER OF PROBLEMS: 5 AIDING MATERIAL: Calculator, mathematical

More information