Context. Sardine Anchovy Sprat

Size: px
Start display at page:

Download "Context. Sardine Anchovy Sprat"

Transcription

1

2 Context Sardine Anchovy Sprat

3 Reflexion strength % change in biomass Impact of a 1cm change ~ 11-12% size size 3

4 Criteria (no hierarchy): Distance Bathymetry Similarities in the echograms 4

5 25 0.5cm size classes discrete sampling High nb of 0, some correlation between bars Dimension reduction by PCA 5

6 A histogram should not be reduced to a set of bars. It is rather an organised sequence of bars. Probability distributions The georeferenced target is a function, i.e. no longer a variable Functional kriging Nerini, D., Monestiez, P. and C., Mante Cokriging for functional data, J. Mult. Anal. 101, Petitgas, P., Doray, M., Massé, J.,, and Grellier P., 2011.Spatially explicit estimation of fish length histograms, with application to anchovy habitats in the Bay of Biscay. ICES Journal of Marine Science, 68(10), Caballero, W., Giraldo, R., and Mateu, J A universal kriging approach for spatial functional data. Stochastic Environmental Research and Risk Assessment, 27(7), A Menafoglio, P Secchi, M Dalla Rosa, A Universal Kriging predictor for spatially dependent functional data of a Hilbert Space. Electronic Journal of Statistics. 6

7 Principles and existence of a solution (Nérini et al., 2010) Each observation is a realization of a functional random variable Y i at position x i (2D), that take its values in an Hilbert space equipped with standard inner product and the associated norm. Under stationary hypothesis, the mean function is E Y( x) μ The estimation of the function at an unknown location is: Y n * 0 B i ( Y i ) i 1 where B i refers to linear operators. These operators can be defined by their kernels so that: Bi ( Yi )( t) βi( s, t) Yi ( t) ds 7

8 Principles and existence of a solution * Unbiasedness E[ Y Y ] implies that n Bi ( μ) μ i 1 μ being unknown, one must choose operators that verify that constraint whatever μ One must choose the kriging operators so that n Bi K i 1 K( f) f, f Such an operator K exists if we restrict ourselves to Reproducing Kernel Hilbert Space RKHS. Regularity constraints are added to the more general HS case. Optimality is also tractable in this framework. 8

9 What about real case? Computers do not like infinite dimensional spaces. use of a finite number of basis functions Yi p k 1 α k ( x ) S i k ( t) where the S k s form an orthogonal basis. In that case, the problem reduces to the co-kriging of the α k 9

10 Using Legendre polynomials Legendre polynomials are orthogonal. S k ( t) Legendre ( t) k Linear model of Coregionalisation of the α k Empirical Distributions (N) Decomposition on N Legendre polynomials cokriging of the α cok k 10

11 Using B-Splines B-Spline functions are not-orthogonal. Functional PCA: Dimension reduction + Orthogonal basis of eigen functions S k ( t) PCk Bspline1,..., B( t) Linear model of coregionalisation Empirical distributions Decomposition on numerous non-orthogonal B-Splines Princ. Comp. cokriging of the princ. comp. 11

12 3 methods N proportions by size classes Series of functions B>>N B-Splines N Legendre polynomials Dimension reduction PCA ~few Princ. components Dimension reduction Functionnal PCA ~ few Princ. components Dimension reduction ~ few polynomials Principal curve One curvilinear variable 12

13 Cross validation to compare between methods Use yearly data from 1993 to 2013 (n = 448 samples) Loop on the number of principal components or Legendre polynomials Conditional on this number, define a linear model of CoRegionalization (mean annual strucures, modeld with nugget + 2 sphericals) Leave One sample Out and re-estimate it using the data of the running year Compute GOF, Kolmogorov distance, negative probabilities (quantity and frequence) to evaluate the quality of the estimation ( pi * pi )² * GOF K P p 1 dist max Fi Fi i p i p ² i 0 13

14 GOF between known and re-estimated histograms Legendre polynomials PCA PCA B-Splines Optimality for ~10 Legendre polynomials and 3-4 p.components 14

15 GOF between known and re-estimated histograms PCA_BSplines - PCA Optimality for ~10 Legendre polynomials and 4 p.components Legendre < B-Splines = ACP 15

16 Negative probabilities of known and re-estimated histograms Legendre polynomials PCA PCA_BSplines - PCA Up to 20% of probabilities < 0 with Legendre polynomials significantly less for PCA and functional PCA Legendre << B-Splines = ACP 16

17 Conclusions For all criteria (GOF, K dist et P - ): Legendre < B-Splines = PCA The winner is thus. PCA No functional kriging required 17

18 PC2 PC1 PC1 PC2 PC3 73% of the variability between distributions is made of : Translation (PC1) Some bimodality (PC2) Some dissymmetry (PC3) 18

19 . Cokriging of the 5 first PCA PC1 PC1 PC2 Mean annual variogram Linear model of coregionalisation PC1 PC2 PC3 PC3 PC2 RGeostats PC3

20 Section of interpolated size distributions (for latitude = 43 ) 20

21 PC2 Points sorted along a principal curve PC1 Curvilinear distance variogram Geographical distance 21

22 GOF Space dimension in which the principal curve is built 22

23 Honouring the constraints is not straightforward in cokriging Kriging of the curvilinear index (monovariate kriging) Space dimensions from 2 to 5. GOF for ACP GOF for principal curve Nota: Rebuilding true histo from 3 PCs produces negative proportions 23

24 ACP generate less negative probabilities than princ. curve Space dimensions from 2 to 5. ACP generate more negative probabilities than princ. curve Proba negative ACP proba negative Principal curve 24

25 Take home message Functional kriging works better with Bsplines than Legendre polynomials. However, in the particular case presented here, PCA remains the best method. Particularities rely on the discrete nature of the input data. The problem can be reduced down to a monovariate kriging of the curvilinear index of the PCA coordinates with an optimum for a space dimension equals to 4. Positiveness or monotony constraints (e.g. pdf or cdf) are not insured by the cokriging step. Principal curve approach reduces the problem as the space dimension increases. 25

26 Some perspectives Sensitivity to the size window used for determining the principal curve MAF and their potential principal curves Aitchison metric to solve positivity External variable(s) 26

27

28 PCA of the size classes 73% of explained variance by first 3 PC >97% with 10 PC Very good reconstruction with 10 PCs 28

29 Spatial model for the first 10 functional PCs Mean annual variogram Linear model of coregionalisation RGeostats

30 Estimation of the ponctual full size distributions From the cok of the first 10 functional PCs Frequency Section of interpolated size distributions (for latitude = 43 ) Longitude ( ) Size (cm) 30

Model-based geostatistics for wildlife population monitoring :

Model-based geostatistics for wildlife population monitoring : Context Model Mapping Abundance Conclusion Ref. Model-based geostatistics for wildlife population monitoring : Northwestern Mediterranean fin whale population and other case studies Pascal Monestiez Biostatistique

More information

Multivariate Geostatistics

Multivariate Geostatistics Hans Wackernagel Multivariate Geostatistics An Introduction with Applications Third, completely revised edition with 117 Figures and 7 Tables Springer Contents 1 Introduction A From Statistics to Geostatistics

More information

SUT WA Research Night

SUT WA Research Night SUT WA Research Night An introduction to acoustic seafloor observation and geostatistical data interpolation Elizabeth Mair BSc (GIS) Honours Curtin University Contents Project Introduction Methodology

More information

GeoEnv -July Simulations. D. Renard N. Desassis. Geostatistics & RGeostats

GeoEnv -July Simulations. D. Renard N. Desassis. Geostatistics & RGeostats GeoEnv -July 2014 Simulations D. Renard N. Desassis Geostatistics & RGeostats 1 o Why are simulations necessary? Simulations Estimation (Kriging) produces smooth results We need a different method which

More information

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt.

Kernel-based Approximation. Methods using MATLAB. Gregory Fasshauer. Interdisciplinary Mathematical Sciences. Michael McCourt. SINGAPORE SHANGHAI Vol TAIPEI - Interdisciplinary Mathematical Sciences 19 Kernel-based Approximation Methods using MATLAB Gregory Fasshauer Illinois Institute of Technology, USA Michael McCourt University

More information

Geostatistics for Gaussian processes

Geostatistics for Gaussian processes Introduction Geostatistical Model Covariance structure Cokriging Conclusion Geostatistics for Gaussian processes Hans Wackernagel Geostatistics group MINES ParisTech http://hans.wackernagel.free.fr Kernels

More information

Time-lapse filtering and improved repeatability with automatic factorial co-kriging. Thierry Coléou CGG Reservoir Services Massy

Time-lapse filtering and improved repeatability with automatic factorial co-kriging. Thierry Coléou CGG Reservoir Services Massy Time-lapse filtering and improved repeatability with automatic factorial co-kriging. Thierry Coléou CGG Reservoir Services Massy 1 Outline Introduction Variogram and Autocorrelation Factorial Kriging Factorial

More information

Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines

Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines Maximilian Kasy Department of Economics, Harvard University 1 / 37 Agenda 6 equivalent representations of the

More information

Index. Geostatistics for Environmental Scientists, 2nd Edition R. Webster and M. A. Oliver 2007 John Wiley & Sons, Ltd. ISBN:

Index. Geostatistics for Environmental Scientists, 2nd Edition R. Webster and M. A. Oliver 2007 John Wiley & Sons, Ltd. ISBN: Index Akaike information criterion (AIC) 105, 290 analysis of variance 35, 44, 127 132 angular transformation 22 anisotropy 59, 99 affine or geometric 59, 100 101 anisotropy ratio 101 exploring and displaying

More information

Principal Component Analysis

Principal Component Analysis I.T. Jolliffe Principal Component Analysis Second Edition With 28 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition Acknowledgments List of Figures List of Tables

More information

A MultiGaussian Approach to Assess Block Grade Uncertainty

A MultiGaussian Approach to Assess Block Grade Uncertainty A MultiGaussian Approach to Assess Block Grade Uncertainty Julián M. Ortiz 1, Oy Leuangthong 2, and Clayton V. Deutsch 2 1 Department of Mining Engineering, University of Chile 2 Department of Civil &

More information

COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION

COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION G. MARIETHOZ, PH. RENARD, R. FROIDEVAUX 2. CHYN, University of Neuchâtel, rue Emile Argand, CH - 2009 Neuchâtel, Switzerland 2 FSS Consultants, 9,

More information

COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION

COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION COLLOCATED CO-SIMULATION USING PROBABILITY AGGREGATION G. MARIETHOZ, PH. RENARD, R. FROIDEVAUX 2. CHYN, University of Neuchâtel, rue Emile Argand, CH - 2009 Neuchâtel, Switzerland 2 FSS Consultants, 9,

More information

Geostatistics for Seismic Data Integration in Earth Models

Geostatistics for Seismic Data Integration in Earth Models 2003 Distinguished Instructor Short Course Distinguished Instructor Series, No. 6 sponsored by the Society of Exploration Geophysicists European Association of Geoscientists & Engineers SUB Gottingen 7

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix GT APSSE - April 2017, the 13th joint work with Xavier Bay. 1 / 29 Sommaire 1 Preliminaries on Gaussian processes 2

More information

Handbook of Geostatistics in R for Fisheries and Marine Ecology

Handbook of Geostatistics in R for Fisheries and Marine Ecology #338 DECEMBER 2017 Handbook of Geostatistics in R for Fisheries and Marine Ecology ICES COOPERATIVE RESEARCH REPORT RAPPORT DES RECHERCHES COLLECTIVES ICES CIEM INTERNATIONAL COUNCIL FOR THE EXPLORATION

More information

MIT 9.520/6.860, Fall 2017 Statistical Learning Theory and Applications. Class 19: Data Representation by Design

MIT 9.520/6.860, Fall 2017 Statistical Learning Theory and Applications. Class 19: Data Representation by Design MIT 9.520/6.860, Fall 2017 Statistical Learning Theory and Applications Class 19: Data Representation by Design What is data representation? Let X be a data-space X M (M) F (M) X A data representation

More information

Learning Eigenfunctions: Links with Spectral Clustering and Kernel PCA

Learning Eigenfunctions: Links with Spectral Clustering and Kernel PCA Learning Eigenfunctions: Links with Spectral Clustering and Kernel PCA Yoshua Bengio Pascal Vincent Jean-François Paiement University of Montreal April 2, Snowbird Learning 2003 Learning Modal Structures

More information

Introduction to Spatial Data and Models

Introduction to Spatial Data and Models Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry

More information

Kernel Methods. Barnabás Póczos

Kernel Methods. Barnabás Póczos Kernel Methods Barnabás Póczos Outline Quick Introduction Feature space Perceptron in the feature space Kernels Mercer s theorem Finite domain Arbitrary domain Kernel families Constructing new kernels

More information

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of

covariance function, 174 probability structure of; Yule-Walker equations, 174 Moving average process, fluctuations, 5-6, 175 probability structure of Index* The Statistical Analysis of Time Series by T. W. Anderson Copyright 1971 John Wiley & Sons, Inc. Aliasing, 387-388 Autoregressive {continued) Amplitude, 4, 94 case of first-order, 174 Associated

More information

Kernel Principal Component Analysis

Kernel Principal Component Analysis Kernel Principal Component Analysis Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr

More information

Regularization in Reproducing Kernel Banach Spaces

Regularization in Reproducing Kernel Banach Spaces .... Regularization in Reproducing Kernel Banach Spaces Guohui Song School of Mathematical and Statistical Sciences Arizona State University Comp Math Seminar, September 16, 2010 Joint work with Dr. Fred

More information

Direct Learning: Linear Classification. Donglin Zeng, Department of Biostatistics, University of North Carolina

Direct Learning: Linear Classification. Donglin Zeng, Department of Biostatistics, University of North Carolina Direct Learning: Linear Classification Logistic regression models for classification problem We consider two class problem: Y {0, 1}. The Bayes rule for the classification is I(P(Y = 1 X = x) > 1/2) so

More information

Introduction to Spatial Data and Models

Introduction to Spatial Data and Models Introduction to Spatial Data and Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics,

More information

Recall that any inner product space V has an associated norm defined by

Recall that any inner product space V has an associated norm defined by Hilbert Spaces Recall that any inner product space V has an associated norm defined by v = v v. Thus an inner product space can be viewed as a special kind of normed vector space. In particular every inner

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 9, 2011 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 2 Part 3: Native Space for Positive Definite Kernels Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2014 fasshauer@iit.edu MATH

More information

Lecture 9: Introduction to Kriging

Lecture 9: Introduction to Kriging Lecture 9: Introduction to Kriging Math 586 Beginning remarks Kriging is a commonly used method of interpolation (prediction) for spatial data. The data are a set of observations of some variable(s) of

More information

Acceptable Ergodic Fluctuations and Simulation of Skewed Distributions

Acceptable Ergodic Fluctuations and Simulation of Skewed Distributions Acceptable Ergodic Fluctuations and Simulation of Skewed Distributions Oy Leuangthong, Jason McLennan and Clayton V. Deutsch Centre for Computational Geostatistics Department of Civil & Environmental Engineering

More information

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17 Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into

More information

Estimation of direction of increase of gold mineralisation using pair-copulas

Estimation of direction of increase of gold mineralisation using pair-copulas 22nd International Congress on Modelling and Simulation, Hobart, Tasmania, Australia, 3 to 8 December 2017 mssanz.org.au/modsim2017 Estimation of direction of increase of gold mineralisation using pair-copulas

More information

Space-time data. Simple space-time analyses. PM10 in space. PM10 in time

Space-time data. Simple space-time analyses. PM10 in space. PM10 in time Space-time data Observations taken over space and over time Z(s, t): indexed by space, s, and time, t Here, consider geostatistical/time data Z(s, t) exists for all locations and all times May consider

More information

Recent Developments in Numerical Methods for 4d-Var

Recent Developments in Numerical Methods for 4d-Var Recent Developments in Numerical Methods for 4d-Var Mike Fisher Slide 1 Recent Developments Numerical Methods 4d-Var Slide 2 Outline Non-orthogonal wavelets on the sphere: - Motivation: Covariance Modelling

More information

Local and Global Sensitivity Analysis

Local and Global Sensitivity Analysis Omar 1,2 1 Duke University Department of Mechanical Engineering & Materials Science omar.knio@duke.edu 2 KAUST Division of Computer, Electrical, Mathematical Science & Engineering omar.knio@kaust.edu.sa

More information

Using min/max autocorrelation factors of survey-based indicators to follow the evolution of fish stocks in time

Using min/max autocorrelation factors of survey-based indicators to follow the evolution of fish stocks in time Aquat. Living Resour., 9 (9) c EDP Sciences, IFREMER, IRD 9 DOI:.5/alr/9 www.alr-journal.org Aquatic Living Resources Using min/max autocorrelation factors of survey-based indicators to follow the evolution

More information

Descriptive Statistics

Descriptive Statistics Descriptive Statistics DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Descriptive statistics Techniques to visualize

More information

3. Some tools for the analysis of sequential strategies based on a Gaussian process prior

3. Some tools for the analysis of sequential strategies based on a Gaussian process prior 3. Some tools for the analysis of sequential strategies based on a Gaussian process prior E. Vazquez Computer experiments June 21-22, 2010, Paris 21 / 34 Function approximation with a Gaussian prior Aim:

More information

Geostatistical characterisation of contaminated metals: methodology and illustrations

Geostatistical characterisation of contaminated metals: methodology and illustrations 1 Geostatistical characterisation of contaminated metals: methodology and illustrations Per Lidar and Arne Larsson, Studsvik Nuclear AB Yvon Desnoyers, Geovariances Symp. on Recycling of Metals arising

More information

Is there still room for new developments in geostatistics?

Is there still room for new developments in geostatistics? Is there still room for new developments in geostatistics? Jean-Paul Chilès MINES ParisTech, Fontainebleau, France, IAMG 34th IGC, Brisbane, 8 August 2012 Matheron: books and monographs 1962-1963: Treatise

More information

Applied Linear Algebra

Applied Linear Algebra Applied Linear Algebra Peter J. Olver School of Mathematics University of Minnesota Minneapolis, MN 55455 olver@math.umn.edu http://www.math.umn.edu/ olver Chehrzad Shakiban Department of Mathematics University

More information

Influence of parameter estimation uncertainty in Kriging: Part 2 Test and case study applications

Influence of parameter estimation uncertainty in Kriging: Part 2 Test and case study applications Hydrology and Earth System Influence Sciences, of 5(), parameter 5 3 estimation (1) uncertainty EGS in Kriging: Part Test and case study applications Influence of parameter estimation uncertainty in Kriging:

More information

10-701/ Recitation : Kernels

10-701/ Recitation : Kernels 10-701/15-781 Recitation : Kernels Manojit Nandi February 27, 2014 Outline Mathematical Theory Banach Space and Hilbert Spaces Kernels Commonly Used Kernels Kernel Theory One Weird Kernel Trick Representer

More information

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

Karhunen-Loève decomposition of Gaussian measures on Banach spaces Karhunen-Loève decomposition of Gaussian measures on Banach spaces Jean-Charles Croix jean-charles.croix@emse.fr Génie Mathématique et Industriel (GMI) First workshop on Gaussian processes at Saint-Etienne

More information

Principal Component Analysis (PCA) CSC411/2515 Tutorial

Principal Component Analysis (PCA) CSC411/2515 Tutorial Principal Component Analysis (PCA) CSC411/2515 Tutorial Harris Chan Based on previous tutorial slides by Wenjie Luo, Ladislav Rampasek University of Toronto hchan@cs.toronto.edu October 19th, 2017 (UofT)

More information

Hypothesis testing:power, test statistic CMS:

Hypothesis testing:power, test statistic CMS: Hypothesis testing:power, test statistic The more sensitive the test, the better it can discriminate between the null and the alternative hypothesis, quantitatively, maximal power In order to achieve this

More information

Sampling variance of species identification in fisheries-acoustic surveys based on automated procedures associating acoustic images and trawl hauls

Sampling variance of species identification in fisheries-acoustic surveys based on automated procedures associating acoustic images and trawl hauls ICES Journal of Marine Science, 60: 437 445. 2003 doi:10.1016/s1054 3139(03)00026-2 Sampling variance of species identification in fisheries-acoustic surveys based on automated procedures associating acoustic

More information

CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method

CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method CS168: The Modern Algorithmic Toolbox Lecture #8: PCA and the Power Iteration Method Tim Roughgarden & Gregory Valiant April 15, 015 This lecture began with an extended recap of Lecture 7. Recall that

More information

Interpolation of Spatial Data - A Stochastic or a Deterministic Problem?

Interpolation of Spatial Data - A Stochastic or a Deterministic Problem? Interpolation of Spatial Data - A Stochastic or a Deterministic Problem? M. Scheuerer, R. Schaback and M. Schlather 18 November 2011 Abstract Interpolation of spatial data is a very general mathematical

More information

Copyright The McGraw-Hill Companies, Inc. Permission required for reproduction or display.

Copyright The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 15. SPATIAL INTERPOLATION 15.1 Elements of Spatial Interpolation 15.1.1 Control Points 15.1.2 Type of Spatial Interpolation 15.2 Global Methods 15.2.1 Trend Surface Models Box 15.1 A Worked Example

More information

PRODUCING PROBABILITY MAPS TO ASSESS RISK OF EXCEEDING CRITICAL THRESHOLD VALUE OF SOIL EC USING GEOSTATISTICAL APPROACH

PRODUCING PROBABILITY MAPS TO ASSESS RISK OF EXCEEDING CRITICAL THRESHOLD VALUE OF SOIL EC USING GEOSTATISTICAL APPROACH PRODUCING PROBABILITY MAPS TO ASSESS RISK OF EXCEEDING CRITICAL THRESHOLD VALUE OF SOIL EC USING GEOSTATISTICAL APPROACH SURESH TRIPATHI Geostatistical Society of India Assumptions and Geostatistical Variogram

More information

A robust statistically based approach to estimating the probability of contamination occurring between sampling locations

A robust statistically based approach to estimating the probability of contamination occurring between sampling locations A robust statistically based approach to estimating the probability of contamination occurring between sampling locations Peter Beck Principal Environmental Scientist Image placeholder Image placeholder

More information

Statistics for Spatial Functional Data

Statistics for Spatial Functional Data Statistics for Spatial Functional Data Marcela Alfaro Córdoba North Carolina State University February 11, 2016 INTRODUCTION Based on Statistics for spatial functional data: some recent contributions from

More information

RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee

RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets 9.520 Class 22, 2004 Tomaso Poggio and Sayan Mukherjee About this class Goal To introduce an alternate perspective of RKHS via integral operators

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 11, 2009 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert

More information

Math 307 Learning Goals. March 23, 2010

Math 307 Learning Goals. March 23, 2010 Math 307 Learning Goals March 23, 2010 Course Description The course presents core concepts of linear algebra by focusing on applications in Science and Engineering. Examples of applications from recent

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces 9.520: Statistical Learning Theory and Applications February 10th, 2010 Reproducing Kernel Hilbert Spaces Lecturer: Lorenzo Rosasco Scribe: Greg Durrett 1 Introduction In the previous two lectures, we

More information

Basics of Point-Referenced Data Models

Basics of Point-Referenced Data Models Basics of Point-Referenced Data Models Basic tool is a spatial process, {Y (s), s D}, where D R r Chapter 2: Basics of Point-Referenced Data Models p. 1/45 Basics of Point-Referenced Data Models Basic

More information

Handbook of Spatial Statistics Chapter 2: Continuous Parameter Stochastic Process Theory by Gneiting and Guttorp

Handbook of Spatial Statistics Chapter 2: Continuous Parameter Stochastic Process Theory by Gneiting and Guttorp Handbook of Spatial Statistics Chapter 2: Continuous Parameter Stochastic Process Theory by Gneiting and Guttorp Marcela Alfaro Córdoba August 25, 2016 NCSU Department of Statistics Continuous Parameter

More information

PART II : Least-Squares Approximation

PART II : Least-Squares Approximation PART II : Least-Squares Approximation Basic theory Let U be an inner product space. Let V be a subspace of U. For any g U, we look for a least-squares approximation of g in the subspace V min f V f g 2,

More information

METHODOLOGY WHICH APPLIES GEOSTATISTICS TECHNIQUES TO THE TOPOGRAPHICAL SURVEY

METHODOLOGY WHICH APPLIES GEOSTATISTICS TECHNIQUES TO THE TOPOGRAPHICAL SURVEY International Journal of Computer Science and Applications, 2008, Vol. 5, No. 3a, pp 67-79 Technomathematics Research Foundation METHODOLOGY WHICH APPLIES GEOSTATISTICS TECHNIQUES TO THE TOPOGRAPHICAL

More information

Chapter 9. Support Vector Machine. Yongdai Kim Seoul National University

Chapter 9. Support Vector Machine. Yongdai Kim Seoul National University Chapter 9. Support Vector Machine Yongdai Kim Seoul National University 1. Introduction Support Vector Machine (SVM) is a classification method developed by Vapnik (1996). It is thought that SVM improved

More information

Machine Learning for Software Engineering

Machine Learning for Software Engineering Machine Learning for Software Engineering Dimensionality Reduction Prof. Dr.-Ing. Norbert Siegmund Intelligent Software Systems 1 2 Exam Info Scheduled for Tuesday 25 th of July 11-13h (same time as the

More information

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation

A Framework for Daily Spatio-Temporal Stochastic Weather Simulation A Framework for Daily Spatio-Temporal Stochastic Weather Simulation, Rick Katz, Balaji Rajagopalan Geophysical Statistics Project Institute for Mathematics Applied to Geosciences National Center for Atmospheric

More information

Downscaling & Record-Statistics

Downscaling & Record-Statistics Empirical-Statistical Downscaling & Record-Statistics R.E. Benestad Rasmus.benestad@met.no Outline! " # $%&''(&#)&* $ & +, -.!, - % $! /, 0 /0 Principles of Downscaling Why downscaling? Interpolated Temperatures

More information

Spatial smoothing using Gaussian processes

Spatial smoothing using Gaussian processes Spatial smoothing using Gaussian processes Chris Paciorek paciorek@hsph.harvard.edu August 5, 2004 1 OUTLINE Spatial smoothing and Gaussian processes Covariance modelling Nonstationary covariance modelling

More information

Computational Challenges in Reservoir Modeling. Sanjay Srinivasan The Pennsylvania State University

Computational Challenges in Reservoir Modeling. Sanjay Srinivasan The Pennsylvania State University Computational Challenges in Reservoir Modeling Sanjay Srinivasan The Pennsylvania State University Well Data 3D view of well paths Inspired by an offshore development 4 platforms 2 vertical wells 2 deviated

More information

Building Blocks for Direct Sequential Simulation on Unstructured Grids

Building Blocks for Direct Sequential Simulation on Unstructured Grids Building Blocks for Direct Sequential Simulation on Unstructured Grids Abstract M. J. Pyrcz (mpyrcz@ualberta.ca) and C. V. Deutsch (cdeutsch@ualberta.ca) University of Alberta, Edmonton, Alberta, CANADA

More information

COMPARISON OF DIGITAL ELEVATION MODELLING METHODS FOR URBAN ENVIRONMENT

COMPARISON OF DIGITAL ELEVATION MODELLING METHODS FOR URBAN ENVIRONMENT COMPARISON OF DIGITAL ELEVATION MODELLING METHODS FOR URBAN ENVIRONMENT Cahyono Susetyo Department of Urban and Regional Planning, Institut Teknologi Sepuluh Nopember, Indonesia Gedung PWK, Kampus ITS,

More information

Kernel Method: Data Analysis with Positive Definite Kernels

Kernel Method: Data Analysis with Positive Definite Kernels Kernel Method: Data Analysis with Positive Definite Kernels 2. Positive Definite Kernel and Reproducing Kernel Hilbert Space Kenji Fukumizu The Institute of Statistical Mathematics. Graduate University

More information

RegML 2018 Class 2 Tikhonov regularization and kernels

RegML 2018 Class 2 Tikhonov regularization and kernels RegML 2018 Class 2 Tikhonov regularization and kernels Lorenzo Rosasco UNIGE-MIT-IIT June 17, 2018 Learning problem Problem For H {f f : X Y }, solve min E(f), f H dρ(x, y)l(f(x), y) given S n = (x i,

More information

Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes

Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes Statistical Properties of Marsan-Lengliné Estimates of Triggering Functions for Space-time Marked Point Processes Eric W. Fox, Ph.D. Department of Statistics UCLA June 15, 2015 Hawkes-type Point Process

More information

Second-Order Inference for Gaussian Random Curves

Second-Order Inference for Gaussian Random Curves Second-Order Inference for Gaussian Random Curves With Application to DNA Minicircles Victor Panaretos David Kraus John Maddocks Ecole Polytechnique Fédérale de Lausanne Panaretos, Kraus, Maddocks (EPFL)

More information

We LHR3 04 Realistic Uncertainty Quantification in Geostatistical Seismic Reservoir Characterization

We LHR3 04 Realistic Uncertainty Quantification in Geostatistical Seismic Reservoir Characterization We LHR3 04 Realistic Uncertainty Quantification in Geostatistical Seismic Reservoir Characterization A. Moradi Tehrani* (CGG), A. Stallone (Roma Tre University), R. Bornard (CGG) & S. Boudon (CGG) SUMMARY

More information

Kernel Learning via Random Fourier Representations

Kernel Learning via Random Fourier Representations Kernel Learning via Random Fourier Representations L. Law, M. Mider, X. Miscouridou, S. Ip, A. Wang Module 5: Machine Learning L. Law, M. Mider, X. Miscouridou, S. Ip, A. Wang Kernel Learning via Random

More information

Reduction of Model Complexity and the Treatment of Discrete Inputs in Computer Model Emulation

Reduction of Model Complexity and the Treatment of Discrete Inputs in Computer Model Emulation Reduction of Model Complexity and the Treatment of Discrete Inputs in Computer Model Emulation Curtis B. Storlie a a Los Alamos National Laboratory E-mail:storlie@lanl.gov Outline Reduction of Emulator

More information

Modeling with Itô Stochastic Differential Equations

Modeling with Itô Stochastic Differential Equations Modeling with Itô Stochastic Differential Equations 2.4-2.6 E. Allen presentation by T. Perälä 27.0.2009 Postgraduate seminar on applied mathematics 2009 Outline Hilbert Space of Stochastic Processes (

More information

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Y.C. Hon and R. Schaback April 9, Abstract This paper solves the Laplace equation u = on domains Ω R 3 by meshless collocation

More information

CIS 520: Machine Learning Oct 09, Kernel Methods

CIS 520: Machine Learning Oct 09, Kernel Methods CIS 520: Machine Learning Oct 09, 207 Kernel Methods Lecturer: Shivani Agarwal Disclaimer: These notes are designed to be a supplement to the lecture They may or may not cover all the material discussed

More information

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl.

Uncertainty Quantification and Validation Using RAVEN. A. Alfonsi, C. Rabiti. Risk-Informed Safety Margin Characterization. https://lwrs.inl. Risk-Informed Safety Margin Characterization Uncertainty Quantification and Validation Using RAVEN https://lwrs.inl.gov A. Alfonsi, C. Rabiti North Carolina State University, Raleigh 06/28/2017 Assumptions

More information

Statistical Signal Processing Detection, Estimation, and Time Series Analysis

Statistical Signal Processing Detection, Estimation, and Time Series Analysis Statistical Signal Processing Detection, Estimation, and Time Series Analysis Louis L. Scharf University of Colorado at Boulder with Cedric Demeure collaborating on Chapters 10 and 11 A TT ADDISON-WESLEY

More information

Convergence of Eigenspaces in Kernel Principal Component Analysis

Convergence of Eigenspaces in Kernel Principal Component Analysis Convergence of Eigenspaces in Kernel Principal Component Analysis Shixin Wang Advanced machine learning April 19, 2016 Shixin Wang Convergence of Eigenspaces April 19, 2016 1 / 18 Outline 1 Motivation

More information

Index. Geostatistics Modeling Spatial Uncertainty. Edited by JEAN-PAUL CHILkS and PIERRE DELFINER Copyright by John Wiley & Sons, Inc

Index. Geostatistics Modeling Spatial Uncertainty. Edited by JEAN-PAUL CHILkS and PIERRE DELFINER Copyright by John Wiley & Sons, Inc Geostatistics Modeling Spatial Uncertainty Edited by JEAN-PAUL CHILkS and PIERRE DELFINER Copyright 0 1999 by John Wiley & Sons, Inc Index Accumulation, 149, 200 Additive renormalization, 252 Additivity

More information

Kernel Methods. Jean-Philippe Vert Last update: Jan Jean-Philippe Vert (Mines ParisTech) 1 / 444

Kernel Methods. Jean-Philippe Vert Last update: Jan Jean-Philippe Vert (Mines ParisTech) 1 / 444 Kernel Methods Jean-Philippe Vert Jean-Philippe.Vert@mines.org Last update: Jan 2015 Jean-Philippe Vert (Mines ParisTech) 1 / 444 What we know how to solve Jean-Philippe Vert (Mines ParisTech) 2 / 444

More information

Improving Spatial Data Interoperability

Improving Spatial Data Interoperability Improving Spatial Data Interoperability A Framework for Geostatistical Support-To To-Support Interpolation Michael F. Goodchild, Phaedon C. Kyriakidis, Philipp Schneider, Matt Rice, Qingfeng Guan, Jordan

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 9, 2011 About this class Goal In this class we continue our journey in the world of RKHS. We discuss the Mercer theorem which gives

More information

Polynomial chaos expansions for sensitivity analysis

Polynomial chaos expansions for sensitivity analysis c DEPARTMENT OF CIVIL, ENVIRONMENTAL AND GEOMATIC ENGINEERING CHAIR OF RISK, SAFETY & UNCERTAINTY QUANTIFICATION Polynomial chaos expansions for sensitivity analysis B. Sudret Chair of Risk, Safety & Uncertainty

More information

Applying MapCalc Map Analysis Software

Applying MapCalc Map Analysis Software Applying MapCalc Map Analysis Software Generating Surface Maps from Point Data: A farmer wants to generate a set of maps from soil samples he has been collecting for several years. Previously, he would

More information

Bayes spaces: use of improper priors and distances between densities

Bayes spaces: use of improper priors and distances between densities Bayes spaces: use of improper priors and distances between densities J. J. Egozcue 1, V. Pawlowsky-Glahn 2, R. Tolosana-Delgado 1, M. I. Ortego 1 and G. van den Boogaart 3 1 Universidad Politécnica de

More information

Classification. The goal: map from input X to a label Y. Y has a discrete set of possible values. We focused on binary Y (values 0 or 1).

Classification. The goal: map from input X to a label Y. Y has a discrete set of possible values. We focused on binary Y (values 0 or 1). Regression and PCA Classification The goal: map from input X to a label Y. Y has a discrete set of possible values We focused on binary Y (values 0 or 1). But we also discussed larger number of classes

More information

Generalization theory

Generalization theory Generalization theory Daniel Hsu Columbia TRIPODS Bootcamp 1 Motivation 2 Support vector machines X = R d, Y = { 1, +1}. Return solution ŵ R d to following optimization problem: λ min w R d 2 w 2 2 + 1

More information

Scientific registration no: 2504 Symposium no: 25 Présentation: poster ALLEN O. IMP,UNIL, Switzerland

Scientific registration no: 2504 Symposium no: 25 Présentation: poster ALLEN O. IMP,UNIL, Switzerland Scientific registration no: 2504 Symposium no: 25 Présentation: poster Geostatistical mapping and GIS of radionuclides in the Swiss soils Artificial and Natural Radionuclides Content Teneurs en radionucléides

More information

PDF Estimation via Characteristic Function and an Orthonormal Basis Set

PDF Estimation via Characteristic Function and an Orthonormal Basis Set PDF Estimation via Characteristic Function and an Orthonormal Basis Set ROY M. HOWARD School of Electrical Engineering and Computing Curtin University of Technology GPO Bo U987, Perth 6845. AUSTRALIA r.howard@echange.curtin.edu.au

More information

On Riesz-Fischer sequences and lower frame bounds

On Riesz-Fischer sequences and lower frame bounds On Riesz-Fischer sequences and lower frame bounds P. Casazza, O. Christensen, S. Li, A. Lindner Abstract We investigate the consequences of the lower frame condition and the lower Riesz basis condition

More information

Quadrature using sparse grids on products of spheres

Quadrature using sparse grids on products of spheres Quadrature using sparse grids on products of spheres Paul Leopardi Mathematical Sciences Institute, Australian National University. For presentation at ANZIAM NSW/ACT Annual Meeting, Batemans Bay. Joint

More information

SVMs: Non-Separable Data, Convex Surrogate Loss, Multi-Class Classification, Kernels

SVMs: Non-Separable Data, Convex Surrogate Loss, Multi-Class Classification, Kernels SVMs: Non-Separable Data, Convex Surrogate Loss, Multi-Class Classification, Kernels Karl Stratos June 21, 2018 1 / 33 Tangent: Some Loose Ends in Logistic Regression Polynomial feature expansion in logistic

More information

Traps for the Unwary Subsurface Geoscientist

Traps for the Unwary Subsurface Geoscientist Traps for the Unwary Subsurface Geoscientist ashley.francis@sorviodvnvm.co.uk http://www.sorviodvnvm.co.uk Presented at SEG Development & Production Forum, 24-29 th June 2001, Taos, New Mexico, USA 24-29

More information

MLCC 2015 Dimensionality Reduction and PCA

MLCC 2015 Dimensionality Reduction and PCA MLCC 2015 Dimensionality Reduction and PCA Lorenzo Rosasco UNIGE-MIT-IIT June 25, 2015 Outline PCA & Reconstruction PCA and Maximum Variance PCA and Associated Eigenproblem Beyond the First Principal Component

More information

Robustness of Principal Components

Robustness of Principal Components PCA for Clustering An objective of principal components analysis is to identify linear combinations of the original variables that are useful in accounting for the variation in those original variables.

More information

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis.

401 Review. 6. Power analysis for one/two-sample hypothesis tests and for correlation analysis. 401 Review Major topics of the course 1. Univariate analysis 2. Bivariate analysis 3. Simple linear regression 4. Linear algebra 5. Multiple regression analysis Major analysis methods 1. Graphical analysis

More information