The Sobol decomposition

Size: px
Start display at page:

Download "The Sobol decomposition"

Transcription

1 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution The Sobol decomposition Suppose x =(x1,,x p ) [0, 1] p η : [0, 1] p R adeterministicfunction ANOVA decomposition gives p η(x) =η 0 + η i (x i )+ + η 1,,p (x) (1) i=1 (1) exists and is unique iff [0,1] p η u (x u )η v (x v )dx =0 u, v {1,,p}, u v with x u =(x u1,,x ut ) if u =(u 1,,u t ) {1,,p} /44 Gaelle Chastaing Sensitivity analysis and dependent variables

2 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Let Assume that The Sobol index Y = η(x 1,,X p )=η(x) X independent, X U([0, 1] p ) η L 2 R ([0, 1]p ) i.e. h 1,h 2 = [0,1] p h 1 (x)h 2 (x)dx = E(h 1 (X)h 2 (X)) h 1,h 2 L 2 R ([0, 1]p ) By ANOVA decomposition V (Y )= i V (η i )+ i<j V (η ij )+ + V (η 1,,p ) /44 Gaelle Chastaing Sensitivity analysis and dependent variables

3 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution The Sobol index The Sobol index of a group of variables X u is Moreover S u = V (η u) V (Y ) η 0 = E(Y ) η i = E(Y X i ) η 0 η ij = E(Y X i,x j ) η i η j η 0 and S u = V [E(Y X u)] v u ( 1) u v V [E(Y X u )] V (Y ) S u =1 u 6/44 Gaelle Chastaing Sensitivity analysis and dependent variables

4 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Context X =(X 1,,X p ) can be non independent Y = η(x) Idea :Decompose η(x) into a sum of increasing dimension functions to mimic the construction of Sobol indices Define ν reference measure PX distribution of X =(X 1,,X p ) px = dp X dν the density function of X w.r.t. ν η L 2 R (R p, B(R p ),P X ) c.a.d. h 1,h 2 = E(h 1 (X)h 2 (X)) = h 1 (x)h 2 (x)dp X /44 Gaelle Chastaing Sensitivity analysis and dependent variables

5 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Conditions where P X << ν ν(dx) =ν 1 (dx 1 ) ν p (dx p ) (C.1) Main assumption 0 <M 1, u {1,..,p}, p X M p Xu p Xu c (C.2) with p Xu et p X c u marginal densities of X u and X c u = X \ X u /44 Gaelle Chastaing Sensitivity analysis and dependent variables

6 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Generalized functional ANOVA Define Hu 0 = { h u (X u ), h u 2 <, h u,h v =0, v u, h v Hv 0 } H 0 = {h 0 constant} Theorem Let η L 2 R (Rp, B(R p ),P X ).Under(C.1)and(C.2),thereexists η 0, η 1,, η 1,,p H H1 0 H0 1,,p such that : η(x) =η 0 + i η i(x i )+ i<j η ij(x i,x j )+ + η 1,,p (X) Moreover, this decomposition is unique. 0/44 Gaelle Chastaing Sensitivity analysis and dependent variables

7 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Generalized sensitivity indices We have η(x) = u η u(x u ), η u Hu 0 Hu 0 Hv 0, v u if u > v As a consequence, V (Y )= u [V (η u )+ Sensitivity index for the group X u is u v u,v Cov(η u, η v )] S u = V (η u(x u )) + u v u,v Cov(η u(x u ), η v (X v )) V (Y ) and S u =1 u 12/44 Gaelle Chastaing Sensitivity analysis and dependent variables

8 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Illustration with p =2inputs η(x) =η 0 + η 1 (X 1 )+η 2 (X 2 )+η 12 (X 1,X 2 ) Orthogonality relation η 12 η 1 η 2 S 1 = V (η 1)+Cov(η 1,η 2 ) V (η), S 2 = V (η 2)+Cov(η 1,η 2 ) V (η) η 0 3/44 Gaelle Chastaing Sensitivity analysis and dependent variables

9 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Application with p =2inputs Assume ( X αn(0,i ) 2 )+(1 α)n(0, Ω), withα =0.2, Ω =. L =50simulations, n =1000observations Model Result Y = X 1 + X 2 + X 1 X 2 S 1 S 2 S 12 u S u New indices Analytical DVP of Sobol indices with LPE 31/44 Gaelle Chastaing Sensitivity analysis and dependent variables

10 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Under good conditions, Constrained minimization η(x) = u η u (X u ), η u, η v =0 v u Idea : Define the effects (η u ) u as solution of the minimization problem min (η(x) η u (x u )) 2 p X (x)dx {η u L 2 (R u )} u u under the orthogonality constraints η u, η v = η u (x u )η v (x v )p X (x)dx, v u, u {1,,p} 5/44 Gaelle Chastaing Sensitivity analysis and dependent variables

11 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution Conclusions Conclusions and perspectives Existence and uniqueness of a generalized decomposition of the output Construction of generalized sensitivity indices Summed to 1 Include the case of independent inputs Copula representation allows for describing the required conditions Both projection method and minimization under constraints give satisfying results for simple models Perpectives Improve numerical methods Study convergence properties of estimators 43/44 Gaelle Chastaing Sensitivity analysis and dependent variables

12 Introduction Generalized decomposition Generalized sensitivity indices Examples of distribution G. Chastaing, F. Gamboa, and C. Prieur. Generalized hoeffding-sobol decomposition for dependent variables -application to sensitivity analysis G. Hooker. Generalized functional anova diagnostics for high-dimensional functions of dependent variables. Journal of Computational and Graphical Statistics, 16(3),2007. R.B. Nelsen. An introduction to copulas. Springer, New York. I.M. Sobol. Sensitivity estimates for nonlinear mathematical models. Wiley Ed., 1(4),1993. C.J. Stone. The use of polynomial splines and their tensor products in multivariate function estimation. The Annals of Statistics, 22(1), /44 Gaelle Chastaing Sensitivity analysis and dependent variables

13 !! F( x, t) d x Ω R ( 0, T ]! Yij = F( x i, t j ), i = 1,.., N; j = 1,.. J! i F( x, t ), j = 1,! J i j, t IFP Energies nouvelles, Rueil-Malmaison, France!!!! f Yij = α j f ( ti θ j ) + vj + εij, j = 1,.., J, i = 1,.., N 12

14 IFP Energies nouvelles, Rueil-Malmaison, France 13!!! * # = (",!, v )!! Gamboa, F., Loubes, J.-M., Maza, E., Semi-parametric estimation of shifts. 2007, Electronic Journal of Statistics. Lawton, W., Sylvestre, E., Maggio, M., Self modelling nonlinear regression. Technometrics

15 IFP Energies nouvelles, Rueil-Malmaison, France!! " F( X, t) t X N " # =!! vˆ ( ) αˆ ( ) x 0 N ( 0, T] (",!, v) ( X, # N (X N ))! Fˆ ( x, t ) = ˆ( α x ) f ( t ˆ( θ x )) ˆ( x ) t i 0, T 0 i 0 i 0 + v! θˆ ( )! 0 ] ] 14

16 !!!! IFP Energies nouvelles, Rueil-Malmaison, France!!! 15

17 !! IFP Energies nouvelles, Rueil-Malmaison, France!! 16

18 Framework Modeling Road traffic (Mediamobile) : Activity: Real-time prediction of traveling time Aim: Understand the speed process on the road traffic network Observations : Fixed sensors: corrupted values Cars fleet: unobserved areas The graph is known Probem: Use the spatial dependency for: Spatial completion Spatio-temporal prediction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 2 / 31

19 Framework Modeling Road traffic (Mediamobile) : Activity: Real-time prediction of traveling time Aim: Understand the speed process on the road traffic network Observations : Fixed sensors: corrupted values Cars fleet: unobserved areas The graph is known Probem: Use the spatial dependency for: Spatial completion Spatio-temporal prediction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 2 / 31

20 Framework Modeling Road traffic (Mediamobile) : Activity: Real-time prediction of traveling time Aim: Understand the speed process on the road traffic network Observations : Fixed sensors: corrupted values Cars fleet: unobserved areas The graph is known Probem: Use the spatial dependency for: Spatial completion Spatio-temporal prediction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 2 / 31

21 Framework Modeling Road traffic (Mediamobile) : Activity: Real-time prediction of traveling time Aim: Understand the speed process on the road traffic network Observations : Fixed sensors: corrupted values Cars fleet: unobserved areas The graph is known Probem: Use the spatial dependency for: Spatial completion Spatio-temporal prediction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 2 / 31

22 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

23 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

24 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

25 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

26 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

27 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

28 Steps Modeling Modeling : Random process (X (n) i ) n Z,i G Indexed by (discrete) time Z and the graph G of the road traffic network Gaussian Centered Stationary Extension of classical tools from time series to graphs Objective: Yield a parametric model (K θ ) θ Θ for covariance operators of X F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 3 / 31

29 Problem Modeling Speed of vehicles on the road network at a fixed time: zero-mean Gaussian field (X i ) i G indexed by the vertices of a graph. Aim: Chose a model for covariance operators Modeling constraints Adaptability to physical modeling Compatibility with classical cases (time series, Z d, homogeneous tree...) Extension of classical tools from time series (spectral representation, Whittle s estimation...) Define covariance operators from a spectral construction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 6 / 31

30 Problem Modeling Speed of vehicles on the road network at a fixed time: zero-mean Gaussian field (X i ) i G indexed by the vertices of a graph. Aim: Chose a model for covariance operators Modeling constraints Adaptability to physical modeling Compatibility with classical cases (time series, Z d, homogeneous tree...) Extension of classical tools from time series (spectral representation, Whittle s estimation...) Define covariance operators from a spectral construction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 6 / 31

31 Problem Modeling Speed of vehicles on the road network at a fixed time: zero-mean Gaussian field (X i ) i G indexed by the vertices of a graph. Aim: Chose a model for covariance operators Modeling constraints Adaptability to physical modeling Compatibility with classical cases (time series, Z d, homogeneous tree...) Extension of classical tools from time series (spectral representation, Whittle s estimation...) Define covariance operators from a spectral construction F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 6 / 31

32 A few bibliography Modeling Spectral representation of stationary process Z d : X. Guyon Homogeneous tree: J-P. Arnaud Distance transitive graphs: H. Heyer Maximum likelihood Z: R. Azencott and D. Dacunha-Castelle Z d : X. Guyon, R. Dahlhaus F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 7 / 31

33 A few bibliography Modeling Spectral representation of stationary process Z d : X. Guyon Homogeneous tree: J-P. Arnaud Distance transitive graphs: H. Heyer Maximum likelihood Z: R. Azencott and D. Dacunha-Castelle Z d : X. Guyon, R. Dahlhaus F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 7 / 31

34 Graph Modeling Model: Zero-mean Gaussian field (X i ) i G indexed by the vertices G of a graph G. Definition (Unoriented weigthed graph) G =(G, W ) : G set of vertices (countable) W [ 1, 1] G G Weighted adjacency operator (symmetric) Neighbors: i j if W ij = 0 Degree of a vertex: D i = {j, i j}. Assumption (H 0 ) D := sup i G D i < +, G has bouded degree i G, j G W ij 1 even renormalizing F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 8 / 31

35 Graph Modeling Model: Zero-mean Gaussian field (X i ) i G indexed by the vertices G of a graph G. Definition (Unoriented weigthed graph) G =(G, W ) : G set of vertices (countable) W [ 1, 1] G G Weighted adjacency operator (symmetric) Neighbors: i j if W ij = 0 Degree of a vertex: D i = {j, i j}. Assumption (H 0 ) D := sup i G D i < +, G has bouded degree i G, j G W ij 1 even renormalizing F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 8 / 31

36 Graph Modeling Model: Zero-mean Gaussian field (X i ) i G indexed by the vertices G of a graph G. Definition (Unoriented weigthed graph) G =(G, W ) : G set of vertices (countable) W [ 1, 1] G G Weighted adjacency operator (symmetric) Neighbors: i j if W ij = 0 Degree of a vertex: D i = {j, i j}. Assumption (H 0 ) D := sup i G D i < +, G has bouded degree i G, j G W ij 1 even renormalizing F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 8 / 31

37 Graph Modeling Model: Zero-mean Gaussian field (X i ) i G indexed by the vertices G of a graph G. Definition (Unoriented weigthed graph) G =(G, W ) : G set of vertices (countable) W [ 1, 1] G G Weighted adjacency operator (symmetric) Neighbors: i j if W ij = 0 Degree of a vertex: D i = {j, i j}. Assumption (H 0 ) D := sup i G D i < +, G has bouded degree i G, j G W ij 1 even renormalizing F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 8 / 31

38 Modeling Modeling for covariance operators Models for covariance operators (of the speed field) K(f )=f (W ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 10 / 31

39 Modeling Modeling for covariance operators Models for covariance operators (of the speed field) K(f )=f(w) W acts on l 2 (G) : u l 2 (G), i G, (Wu) i := W ij u j. j G F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 10 / 31

40 Modeling Modeling for covariance operators Models for covariance operators (of the speed field) K(f )=f (W ) Under H 0 W is a bounded Hilbertian self-adjoint operator in B G := l 2 (G) l 2 (G): W 2,op 1. F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 10 / 31

41 Modeling Modeling for covariance operators Models for covariance operators (of the speed field) K(f )=f (W ) Definition (Identity resolution) M σ-algebra E : M B G such that ω, ω M, 1 E(ω)self-adjoints projectors. 2 E(ø) = 0, E(Ω) =I 3 E(ω ω )=E(ω)E(ω ) 4 Si ω ω =ø, alors E(ω ω )=E(ω)+E(ω ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 10 / 31

42 Modeling Modeling for covariance operators Models for covariance operators (of the speed field) K(f )=f(w) Spectral decomposition E, M, W = M λde(λ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 10 / 31

43 Modeling Models for covariance operators, spectral density Definition (Construction of the covariance operators) Let g be an positive function, analytic over Sp(W ), K(g) = g(λ)de(λ), g polynomial: MA (W ) q 1 g polynomial: AR(W ) p Sp(W ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 11 / 31

44 Modeling Models for covariance operators, spectral density Definition (Construction of the covariance operators) Let g be an positive function, analytic over Sp(W ), K(g) = g(λ)de(λ), g polynomial: MA (W ) q 1 g polynomial: AR(W ) p Sp(W ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 11 / 31

45 Modeling Models for covariance operators, spectral density Definition (Construction of the covariance operators) Let g be an positive function, analytic over Sp(W ), K(g) = g(λ)de(λ), g polynomial: MA (W ) q 1 g polynomial: AR(W ) p Sp(W ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 11 / 31

46 Modeling Models for covariance operators, spectral density Definition (Construction of the covariance operators) Let g be an positive function, analytic over Sp(W ), K(g) = g(λ)de(λ), g polynomial: MA (W ) q 1 g polynomial: AR(W ) p K(g) ij := Sp(W ) Sp(W ) g(λ)dµ ij (λ). F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 11 / 31

47 Modeling Models for covariance operators, spectral density Definition (Construction of the covariance operators) Let g be an positive function, analytic over Sp(W ), K(g) = g(λ)de(λ), g polynomial: MA (W ) q 1 g Remarks: polynomial: AR(W ) p K(g) =g(w ) Dependency in W Analogy with Z Sp(W ) F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 11 / 31

48 Modeling G = Z: compatibility with time series Adjacency operator W ij = i j =1. F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 12 / 31

49 Modeling G = Z: compatibility with time series Adjacency operator Local measure W ij = i j =1. i, j G, k Z, W k = 1 ij π T k : k ième Chebychev polynomials [ 1,1] λ k T j i (λ) 1 λ 2 dλ. F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 12 / 31

50 Modeling G = Z: compatibility with time series Adjacency operator Local measure W ij = i j =1. i, j G, k Z, W k = 1 ij π [ 1,1] λ k T j i (λ) 1 λ 2 dλ. Model (K(g)) ij = 1 π [ 1,1] g(λ) T j i (λ) 1 λ 2 dλ. F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 12 / 31

51 Modeling G = Z: compatibility with time series Adjacency operator Local measure W ij = i j =1. i, j G, k Z, W k = 1 ij π [ 1,1] λ k T j i (λ) 1 λ 2 dλ. Spectral density f (t) =g(cos(t)) K(g) ij = 1 f (t) cos ((j i)t) dt := (T (f )) ij 2π [ π,π] F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 12 / 31

52 Modeling The concrete problem F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 14 / 31

53 Modeling The concrete problem F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 15 / 31

54 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

55 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

56 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

57 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

58 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

59 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

60 Ideas Modeling Framework: Parametric model of covariances operators K(f θ )=f θ (W ). Aim: Parametric estimation Remark: Spectral density Asymptotic eigendistribution of the covariance operators Computational issues log det Term of the log-likelihood Γ 1 term of the log-likelihood Other important ideas Trace measure Tappered periodogram F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 16 / 31

61 Modeling Spectrum of the road network F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 26 / 31

62 Real datas Modeling Aim: Predict missing values on FRC 0 in Toulouse F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 27 / 31

63 Modeling Merci! F. Gamboa et al Modeling and estimation for Gaussian fields indexed by graphs, application to road traffic prediction 31 / 31

Generalized Sobol indices for dependent variables

Generalized Sobol indices for dependent variables Generalized Sobol indices for dependent variables Gaelle Chastaing Fabrice Gamboa Clémentine Prieur July 1st, 2013 1/28 Gaelle Chastaing Sensitivity analysis and dependent variables Contents 1 Context

More information

arxiv: v3 [math.st] 11 Mar 2012

arxiv: v3 [math.st] 11 Mar 2012 Electronic Journal of Statistics Vol. 0 (0000) ISSN: 1935-754 DOI: 10.114/154957804100000000 arxiv:111.1788v3 [math.st] 11 Mar 01 Generalized Hoeffding-Sobol Decomposition for Dependent Variables - Application

More information

Information geometry for bivariate distribution control

Information geometry for bivariate distribution control Information geometry for bivariate distribution control C.T.J.Dodson + Hong Wang Mathematics + Control Systems Centre, University of Manchester Institute of Science and Technology Optimal control of stochastic

More information

Time Series: Theory and Methods

Time Series: Theory and Methods Peter J. Brockwell Richard A. Davis Time Series: Theory and Methods Second Edition With 124 Illustrations Springer Contents Preface to the Second Edition Preface to the First Edition vn ix CHAPTER 1 Stationary

More information

Introduction to Probabilistic Graphical Models: Exercises

Introduction to Probabilistic Graphical Models: Exercises Introduction to Probabilistic Graphical Models: Exercises Cédric Archambeau Xerox Research Centre Europe cedric.archambeau@xrce.xerox.com Pascal Bootcamp Marseille, France, July 2010 Exercise 1: basics

More information

Probabilistic Graphical Models

Probabilistic Graphical Models Probabilistic Graphical Models Lecture 12 Dynamical Models CS/CNS/EE 155 Andreas Krause Homework 3 out tonight Start early!! Announcements Project milestones due today Please email to TAs 2 Parameter learning

More information

Introduction to Smoothing spline ANOVA models (metamodelling)

Introduction to Smoothing spline ANOVA models (metamodelling) Introduction to Smoothing spline ANOVA models (metamodelling) M. Ratto DYNARE Summer School, Paris, June 215. Joint Research Centre www.jrc.ec.europa.eu Serving society Stimulating innovation Supporting

More information

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016

Spatial Statistics with Image Analysis. Outline. A Statistical Approach. Johan Lindström 1. Lund October 6, 2016 Spatial Statistics Spatial Examples More Spatial Statistics with Image Analysis Johan Lindström 1 1 Mathematical Statistics Centre for Mathematical Sciences Lund University Lund October 6, 2016 Johan Lindström

More information

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis

Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Sobol-Hoeffding decomposition Application to Global SA Computation of the SI Sobol-Hoeffding Decomposition with Application to Global Sensitivity Analysis Olivier Le Maître with Colleague & Friend Omar

More information

Analysis of covariance (ANCOVA) using polynomial chaos expansions

Analysis of covariance (ANCOVA) using polynomial chaos expansions Research Collection Conference Paper Analysis of covariance (ANCOVA) using polynomial chaos expansions Author(s): Sudret, Bruno; Caniou, Yves Publication Date: 013 Permanent Link: https://doi.org/10.399/ethz-a-0100633

More information

Approximate Optimal Designs for Multivariate Polynomial Regression

Approximate Optimal Designs for Multivariate Polynomial Regression Approximate Optimal Designs for Multivariate Polynomial Regression Fabrice Gamboa Collaboration with: Yohan de Castro, Didier Henrion, Roxana Hess, Jean-Bernard Lasserre Universität Potsdam 16th of February

More information

Local and Global Sensitivity Analysis

Local and Global Sensitivity Analysis Omar 1,2 1 Duke University Department of Mechanical Engineering & Materials Science omar.knio@duke.edu 2 KAUST Division of Computer, Electrical, Mathematical Science & Engineering omar.knio@kaust.edu.sa

More information

Contraction Principles some applications

Contraction Principles some applications Contraction Principles some applications Fabrice Gamboa (Institut de Mathématiques de Toulouse) 7th of June 2017 Christian and Patrick 59th Birthday Overview Appetizer : Christian and Patrick secret lives

More information

Multivariate Random Variable

Multivariate Random Variable Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate

More information

Probability Models for Bayesian Recognition

Probability Models for Bayesian Recognition Intelligent Systems: Reasoning and Recognition James L. Crowley ENSIAG / osig Second Semester 06/07 Lesson 9 0 arch 07 Probability odels for Bayesian Recognition Notation... Supervised Learning for Bayesian

More information

Linear Models in Statistics

Linear Models in Statistics Linear Models in Statistics ALVIN C. RENCHER Department of Statistics Brigham Young University Provo, Utah A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York Chichester Weinheim Brisbane

More information

Decomposable Graphical Gaussian Models

Decomposable Graphical Gaussian Models CIMPA Summerschool, Hammamet 2011, Tunisia September 12, 2011 Basic algorithm This simple algorithm has complexity O( V + E ): 1. Choose v 0 V arbitrary and let v 0 = 1; 2. When vertices {1, 2,..., j}

More information

A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking

A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking A new covariance function for spatio-temporal data analysis with application to atmospheric pollution and sensor networking György Terdik and Subba Rao Tata UofD, HU & UofM, UK January 30, 2015 Laboratoire

More information

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2.

APPENDIX A. Background Mathematics. A.1 Linear Algebra. Vector algebra. Let x denote the n-dimensional column vector with components x 1 x 2. APPENDIX A Background Mathematics A. Linear Algebra A.. Vector algebra Let x denote the n-dimensional column vector with components 0 x x 2 B C @. A x n Definition 6 (scalar product). The scalar product

More information

Research Article Least Squares Estimators for Unit Root Processes with Locally Stationary Disturbance

Research Article Least Squares Estimators for Unit Root Processes with Locally Stationary Disturbance Advances in Decision Sciences Volume, Article ID 893497, 6 pages doi:.55//893497 Research Article Least Squares Estimators for Unit Root Processes with Locally Stationary Disturbance Junichi Hirukawa and

More information

Mutual Information and Optimal Data Coding

Mutual Information and Optimal Data Coding Mutual Information and Optimal Data Coding May 9 th 2012 Jules de Tibeiro Université de Moncton à Shippagan Bernard Colin François Dubeau Hussein Khreibani Université de Sherbooe Abstract Introduction

More information

Stability Analysis of Stationary Solutions for the Cahn Hilliard Equation

Stability Analysis of Stationary Solutions for the Cahn Hilliard Equation Stability Analysis of Stationary Solutions for the Cahn Hilliard Equation Peter Howard, Texas A&M University University of Louisville, Oct. 19, 2007 References d = 1: Commun. Math. Phys. 269 (2007) 765

More information

Stability of optimization problems with stochastic dominance constraints

Stability of optimization problems with stochastic dominance constraints Stability of optimization problems with stochastic dominance constraints D. Dentcheva and W. Römisch Stevens Institute of Technology, Hoboken Humboldt-University Berlin www.math.hu-berlin.de/~romisch SIAM

More information

On Shapley value for measuring importance. of dependent inputs

On Shapley value for measuring importance. of dependent inputs Shapley value & variable importance 1 On Shapley value for measuring importance of dependent inputs Art B. Owen, Stanford joint with Clémentine Prieur, Grenoble Based on forthcoming JUQ article (2017).

More information

Probabilistic Graphical Models

Probabilistic Graphical Models School of Computer Science Probabilistic Graphical Models Variational Inference II: Mean Field Method and Variational Principle Junming Yin Lecture 15, March 7, 2012 X 1 X 1 X 1 X 1 X 2 X 3 X 2 X 2 X 3

More information

Analysing geoadditive regression data: a mixed model approach

Analysing geoadditive regression data: a mixed model approach Analysing geoadditive regression data: a mixed model approach Institut für Statistik, Ludwig-Maximilians-Universität München Joint work with Ludwig Fahrmeir & Stefan Lang 25.11.2005 Spatio-temporal regression

More information

Multiple Random Variables

Multiple Random Variables Multiple Random Variables This Version: July 30, 2015 Multiple Random Variables 2 Now we consider models with more than one r.v. These are called multivariate models For instance: height and weight An

More information

Statistícal Methods for Spatial Data Analysis

Statistícal Methods for Spatial Data Analysis Texts in Statistícal Science Statistícal Methods for Spatial Data Analysis V- Oliver Schabenberger Carol A. Gotway PCT CHAPMAN & K Contents Preface xv 1 Introduction 1 1.1 The Need for Spatial Analysis

More information

Random Variables and Their Distributions

Random Variables and Their Distributions Chapter 3 Random Variables and Their Distributions A random variable (r.v.) is a function that assigns one and only one numerical value to each simple event in an experiment. We will denote r.vs by capital

More information

P -spline ANOVA-type interaction models for spatio-temporal smoothing

P -spline ANOVA-type interaction models for spatio-temporal smoothing P -spline ANOVA-type interaction models for spatio-temporal smoothing Dae-Jin Lee 1 and María Durbán 1 1 Department of Statistics, Universidad Carlos III de Madrid, SPAIN. e-mail: dae-jin.lee@uc3m.es and

More information

Modeling daily precipitation in Space and Time

Modeling daily precipitation in Space and Time Space and Time SWGen - Hydro Berlin 20 September 2017 temporal - dependence Outline temporal - dependence temporal - dependence Stochastic Weather Generator Stochastic Weather Generator (SWG) is a stochastic

More information

Lecture 13 The Fundamental Forms of a Surface

Lecture 13 The Fundamental Forms of a Surface Lecture 13 The Fundamental Forms of a Surface In the following we denote by F : O R 3 a parametric surface in R 3, F(u, v) = (x(u, v), y(u, v), z(u, v)). We denote partial derivatives with respect to the

More information

Decomposable and Directed Graphical Gaussian Models

Decomposable and Directed Graphical Gaussian Models Decomposable Decomposable and Directed Graphical Gaussian Models Graphical Models and Inference, Lecture 13, Michaelmas Term 2009 November 26, 2009 Decomposable Definition Basic properties Wishart density

More information

Gaussian process regression for Sensitivity analysis

Gaussian process regression for Sensitivity analysis Gaussian process regression for Sensitivity analysis GPSS Workshop on UQ, Sheffield, September 2016 Nicolas Durrande, Mines St-Étienne, durrande@emse.fr GPSS workshop on UQ GPs for sensitivity analysis

More information

Ma/CS 6b Class 23: Eigenvalues in Regular Graphs

Ma/CS 6b Class 23: Eigenvalues in Regular Graphs Ma/CS 6b Class 3: Eigenvalues in Regular Graphs By Adam Sheffer Recall: The Spectrum of a Graph Consider a graph G = V, E and let A be the adjacency matrix of G. The eigenvalues of G are the eigenvalues

More information

3 Applications of partial differentiation

3 Applications of partial differentiation Advanced Calculus Chapter 3 Applications of partial differentiation 37 3 Applications of partial differentiation 3.1 Stationary points Higher derivatives Let U R 2 and f : U R. The partial derivatives

More information

A note on Gaussian distributions in R n

A note on Gaussian distributions in R n Proc. Indian Acad. Sci. (Math. Sci. Vol., No. 4, November 0, pp. 635 644. c Indian Academy of Sciences A note on Gaussian distributions in R n B G MANJUNATH and K R PARTHASARATHY Indian Statistical Institute,

More information

Exponential tail inequalities for eigenvalues of random matrices

Exponential tail inequalities for eigenvalues of random matrices Exponential tail inequalities for eigenvalues of random matrices M. Ledoux Institut de Mathématiques de Toulouse, France exponential tail inequalities classical theme in probability and statistics quantify

More information

Fundamentals of Matrices

Fundamentals of Matrices Maschinelles Lernen II Fundamentals of Matrices Christoph Sawade/Niels Landwehr/Blaine Nelson Tobias Scheffer Matrix Examples Recap: Data Linear Model: f i x = w i T x Let X = x x n be the data matrix

More information

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011

Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Copula Regression RAHUL A. PARSA DRAKE UNIVERSITY & STUART A. KLUGMAN SOCIETY OF ACTUARIES CASUALTY ACTUARIAL SOCIETY MAY 18,2011 Outline Ordinary Least Squares (OLS) Regression Generalized Linear Models

More information

Research Statement. Mamikon S. Ginovyan. Boston University

Research Statement. Mamikon S. Ginovyan. Boston University Research Statement Mamikon S. Ginovyan Boston University 1 Abstract My research interests and contributions mostly are in the areas of prediction, estimation and hypotheses testing problems for second

More information

LECTURE NOTES ELEMENTARY NUMERICAL METHODS. Eusebius Doedel

LECTURE NOTES ELEMENTARY NUMERICAL METHODS. Eusebius Doedel LECTURE NOTES on ELEMENTARY NUMERICAL METHODS Eusebius Doedel TABLE OF CONTENTS Vector and Matrix Norms 1 Banach Lemma 20 The Numerical Solution of Linear Systems 25 Gauss Elimination 25 Operation Count

More information

Concentration Inequalities for Random Matrices

Concentration Inequalities for Random Matrices Concentration Inequalities for Random Matrices M. Ledoux Institut de Mathématiques de Toulouse, France exponential tail inequalities classical theme in probability and statistics quantify the asymptotic

More information

BHASVIC MαTHS. Convert the below into the form ax m + bx n : (b) (c) (e) (f)

BHASVIC MαTHS. Convert the below into the form ax m + bx n : (b) (c) (e) (f) Convert the below into the form ax m + bx n : (a) 1+5x 4x 1 (b) 3x 4 x x 3 (c) 4 16x 3 3 27x 3 2x 2 (d) 4 5x 3x 2 (e) (f) 4x 3 1 2x 3 x 4x+ 81x2 9 x 2 Co-ordinate Geometry line The equation of straight

More information

SUBELLIPTIC CORDES ESTIMATES

SUBELLIPTIC CORDES ESTIMATES PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 000-9939XX0000-0 SUBELLIPTIC CORDES ESTIMATES Abstract. We prove Cordes type estimates for subelliptic linear partial

More information

Product measure and Fubini s theorem

Product measure and Fubini s theorem Chapter 7 Product measure and Fubini s theorem This is based on [Billingsley, Section 18]. 1. Product spaces Suppose (Ω 1, F 1 ) and (Ω 2, F 2 ) are two probability spaces. In a product space Ω = Ω 1 Ω

More information

Einstein-Hilbert action on Connes-Landi noncommutative manifolds

Einstein-Hilbert action on Connes-Landi noncommutative manifolds Einstein-Hilbert action on Connes-Landi noncommutative manifolds Yang Liu MPIM, Bonn Analysis, Noncommutative Geometry, Operator Algebras Workshop June 2017 Motivations and History Motivation: Explore

More information

Extreme Value Analysis and Spatial Extremes

Extreme Value Analysis and Spatial Extremes Extreme Value Analysis and Department of Statistics Purdue University 11/07/2013 Outline Motivation 1 Motivation 2 Extreme Value Theorem and 3 Bayesian Hierarchical Models Copula Models Max-stable Models

More information

Persistence as a spectral property

Persistence as a spectral property , Georgia Tech. Joint work with Naomi Feldheim and Ohad Feldheim. March 18, 2017 Advertisement. SEAM2018, March 23-25, 2018. Georgia Tech, Atlanta, GA. Organizing committee: Michael Lacey Wing Li Galyna

More information

Information Geometry: Background and Applications in Machine Learning

Information Geometry: Background and Applications in Machine Learning Geometry and Computer Science Information Geometry: Background and Applications in Machine Learning Giovanni Pistone www.giannidiorestino.it Pescara IT), February 8 10, 2017 Abstract Information Geometry

More information

RANDOM PROPERTIES BENOIT PAUSADER

RANDOM PROPERTIES BENOIT PAUSADER RANDOM PROPERTIES BENOIT PAUSADER. Quasilinear problems In general, one consider the following trichotomy for nonlinear PDEs: A semilinear problem is a problem where the highest-order terms appears linearly

More information

A time series is called strictly stationary if the joint distribution of every collection (Y t

A time series is called strictly stationary if the joint distribution of every collection (Y t 5 Time series A time series is a set of observations recorded over time. You can think for example at the GDP of a country over the years (or quarters) or the hourly measurements of temperature over a

More information

Frailty Models and Copulas: Similarities and Differences

Frailty Models and Copulas: Similarities and Differences Frailty Models and Copulas: Similarities and Differences KLARA GOETHALS, PAUL JANSSEN & LUC DUCHATEAU Department of Physiology and Biometrics, Ghent University, Belgium; Center for Statistics, Hasselt

More information

Short Questions (Do two out of three) 15 points each

Short Questions (Do two out of three) 15 points each Econometrics Short Questions Do two out of three) 5 points each ) Let y = Xβ + u and Z be a set of instruments for X When we estimate β with OLS we project y onto the space spanned by X along a path orthogonal

More information

Diffeomorphic Warping. Ben Recht August 17, 2006 Joint work with Ali Rahimi (Intel)

Diffeomorphic Warping. Ben Recht August 17, 2006 Joint work with Ali Rahimi (Intel) Diffeomorphic Warping Ben Recht August 17, 2006 Joint work with Ali Rahimi (Intel) What Manifold Learning Isn t Common features of Manifold Learning Algorithms: 1-1 charting Dense sampling Geometric Assumptions

More information

1 EM algorithm: updating the mixing proportions {π k } ik are the posterior probabilities at the qth iteration of EM.

1 EM algorithm: updating the mixing proportions {π k } ik are the posterior probabilities at the qth iteration of EM. Université du Sud Toulon - Var Master Informatique Probabilistic Learning and Data Analysis TD: Model-based clustering by Faicel CHAMROUKHI Solution The aim of this practical wor is to show how the Classification

More information

Numerical Solutions to Partial Differential Equations

Numerical Solutions to Partial Differential Equations Numerical Solutions to Partial Differential Equations Zhiping Li LMAM and School of Mathematical Sciences Peking University The Residual and Error of Finite Element Solutions Mixed BVP of Poisson Equation

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 218. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Stochastic representation of random positive-definite tensor-valued properties: application to 3D anisotropic permeability random fields

Stochastic representation of random positive-definite tensor-valued properties: application to 3D anisotropic permeability random fields Sous la co-tutelle de : LABORATOIRE DE MODÉLISATION ET SIMULATION MULTI ÉCHELLE CNRS UPEC UNIVERSITÉ PARIS-EST CRÉTEIL UPEM UNIVERSITÉ PARIS-EST MARNE-LA-VALLÉE Stochastic representation of random positive-definite

More information

A general mixed model approach for spatio-temporal regression data

A general mixed model approach for spatio-temporal regression data A general mixed model approach for spatio-temporal regression data Thomas Kneib, Ludwig Fahrmeir & Stefan Lang Department of Statistics, Ludwig-Maximilians-University Munich 1. Spatio-temporal regression

More information

Chapter 17: Undirected Graphical Models

Chapter 17: Undirected Graphical Models Chapter 17: Undirected Graphical Models The Elements of Statistical Learning Biaobin Jiang Department of Biological Sciences Purdue University bjiang@purdue.edu October 30, 2014 Biaobin Jiang (Purdue)

More information

Strain analysis.

Strain analysis. Strain analysis ecalais@purdue.edu Plates vs. continuum Gordon and Stein, 1991 Most plates are rigid at the until know we have studied a purely discontinuous approach where plates are

More information

Algorithms for Uncertainty Quantification

Algorithms for Uncertainty Quantification Algorithms for Uncertainty Quantification Lecture 9: Sensitivity Analysis ST 2018 Tobias Neckel Scientific Computing in Computer Science TUM Repetition of Previous Lecture Sparse grids in Uncertainty Quantification

More information

Chapter 1: Probability Theory Lecture 1: Measure space, measurable function, and integration

Chapter 1: Probability Theory Lecture 1: Measure space, measurable function, and integration Chapter 1: Probability Theory Lecture 1: Measure space, measurable function, and integration Random experiment: uncertainty in outcomes Ω: sample space: a set containing all possible outcomes Definition

More information

High Dimensional Inverse Covariate Matrix Estimation via Linear Programming

High Dimensional Inverse Covariate Matrix Estimation via Linear Programming High Dimensional Inverse Covariate Matrix Estimation via Linear Programming Ming Yuan October 24, 2011 Gaussian Graphical Model X = (X 1,..., X p ) indep. N(µ, Σ) Inverse covariance matrix Σ 1 = Ω = (ω

More information

Qualifying Examination HARVARD UNIVERSITY Department of Mathematics Tuesday, January 19, 2016 (Day 1)

Qualifying Examination HARVARD UNIVERSITY Department of Mathematics Tuesday, January 19, 2016 (Day 1) Qualifying Examination HARVARD UNIVERSITY Department of Mathematics Tuesday, January 19, 2016 (Day 1) PROBLEM 1 (DG) Let S denote the surface in R 3 where the coordinates (x, y, z) obey x 2 + y 2 = 1 +

More information

Derivative-based global sensitivity measures for interactions

Derivative-based global sensitivity measures for interactions Derivative-based global sensitivity measures for interactions Olivier Roustant École Nationale Supérieure des Mines de Saint-Étienne Joint work with J. Fruth, B. Iooss and S. Kuhnt SAMO 13 Olivier Roustant

More information

Learning discrete graphical models via generalized inverse covariance matrices

Learning discrete graphical models via generalized inverse covariance matrices Learning discrete graphical models via generalized inverse covariance matrices Duzhe Wang, Yiming Lv, Yongjoon Kim, Young Lee Department of Statistics University of Wisconsin-Madison {dwang282, lv23, ykim676,

More information

SPDES driven by Poisson Random Measures and their numerical September Approximation 7, / 42

SPDES driven by Poisson Random Measures and their numerical September Approximation 7, / 42 SPDES driven by Poisson Random Measures and their numerical Approximation Hausenblas Erika Montain University Leoben, Austria September 7, 2011 SPDES driven by Poisson Random Measures and their numerical

More information

Learning Theory. Ingo Steinwart University of Stuttgart. September 4, 2013

Learning Theory. Ingo Steinwart University of Stuttgart. September 4, 2013 Learning Theory Ingo Steinwart University of Stuttgart September 4, 2013 Ingo Steinwart University of Stuttgart () Learning Theory September 4, 2013 1 / 62 Basics Informal Introduction Informal Description

More information

Research Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood

Research Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood Advances in Decision Sciences Volume 2012, Article ID 973173, 8 pages doi:10.1155/2012/973173 Research Article Optimal Portfolio Estimation for Dependent Financial Returns with Generalized Empirical Likelihood

More information

Sampling bias in logistic models

Sampling bias in logistic models Sampling bias in logistic models Department of Statistics University of Chicago University of Wisconsin Oct 24, 2007 www.stat.uchicago.edu/~pmcc/reports/bias.pdf Outline Conventional regression models

More information

Support Vector Machines

Support Vector Machines Support Vector Machines Sridhar Mahadevan mahadeva@cs.umass.edu University of Massachusetts Sridhar Mahadevan: CMPSCI 689 p. 1/32 Margin Classifiers margin b = 0 Sridhar Mahadevan: CMPSCI 689 p.

More information

1 Appendix A: Matrix Algebra

1 Appendix A: Matrix Algebra Appendix A: Matrix Algebra. Definitions Matrix A =[ ]=[A] Symmetric matrix: = for all and Diagonal matrix: 6=0if = but =0if 6= Scalar matrix: the diagonal matrix of = Identity matrix: the scalar matrix

More information

Dependent ( ) Independent (1 or Ø) These lines coincide so they are a.k.a coincident.

Dependent ( ) Independent (1 or Ø) These lines coincide so they are a.k.a coincident. Notes #3- Date: 7.1 Solving Systems of Two Equations (568) The solution to a system of linear equations is the ordered pair (x, y) where the lines intersect! A solution can be substituted into both equations

More information

Eddy-diffusivity fields in turbulent transport: explicit expressions

Eddy-diffusivity fields in turbulent transport: explicit expressions DICCA University of Genova Italy Eddy-diffusivity fields in turbulent transport: explicit expressions Andrea Mazzino andrea.mazzino@unige.it Lagrangian transport: from complex flows to complex fluids Lecce

More information

Covariance function estimation in Gaussian process regression

Covariance function estimation in Gaussian process regression Covariance function estimation in Gaussian process regression François Bachoc Department of Statistics and Operations Research, University of Vienna WU Research Seminar - May 2015 François Bachoc Gaussian

More information

Divide and Conquer Kernel Ridge Regression. A Distributed Algorithm with Minimax Optimal Rates

Divide and Conquer Kernel Ridge Regression. A Distributed Algorithm with Minimax Optimal Rates : A Distributed Algorithm with Minimax Optimal Rates Yuchen Zhang, John C. Duchi, Martin Wainwright (UC Berkeley;http://arxiv.org/pdf/1305.509; Apr 9, 014) Gatsby Unit, Tea Talk June 10, 014 Outline Motivation.

More information

On the smallest eigenvalues of covariance matrices of multivariate spatial processes

On the smallest eigenvalues of covariance matrices of multivariate spatial processes On the smallest eigenvalues of covariance matrices of multivariate spatial processes François Bachoc, Reinhard Furrer Toulouse Mathematics Institute, University Paul Sabatier, France Institute of Mathematics

More information

Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines

Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines Econ 2148, fall 2017 Gaussian process priors, reproducing kernel Hilbert spaces, and Splines Maximilian Kasy Department of Economics, Harvard University 1 / 37 Agenda 6 equivalent representations of the

More information

Scientific Data Computing: Lecture 3

Scientific Data Computing: Lecture 3 Scientific Data Computing: Lecture 3 Benson Muite benson.muite@ut.ee 23 April 2018 Outline Monday 10-12, Liivi 2-207 Monday 12-14, Liivi 2-205 Topics Introduction, statistical methods and their applications

More information

Nonparametric Bayesian Methods - Lecture I

Nonparametric Bayesian Methods - Lecture I Nonparametric Bayesian Methods - Lecture I Harry van Zanten Korteweg-de Vries Institute for Mathematics CRiSM Masterclass, April 4-6, 2016 Overview of the lectures I Intro to nonparametric Bayesian statistics

More information

Total positivity in Markov structures

Total positivity in Markov structures 1 based on joint work with Shaun Fallat, Kayvan Sadeghi, Caroline Uhler, Nanny Wermuth, and Piotr Zwiernik (arxiv:1510.01290) Faculty of Science Total positivity in Markov structures Steffen Lauritzen

More information

01 Probability Theory and Statistics Review

01 Probability Theory and Statistics Review NAVARCH/EECS 568, ROB 530 - Winter 2018 01 Probability Theory and Statistics Review Maani Ghaffari January 08, 2018 Last Time: Bayes Filters Given: Stream of observations z 1:t and action data u 1:t Sensor/measurement

More information

Online Appendix. j=1. φ T (ω j ) vec (EI T (ω j ) f θ0 (ω j )). vec (EI T (ω) f θ0 (ω)) = O T β+1/2) = o(1), M 1. M T (s) exp ( isω)

Online Appendix. j=1. φ T (ω j ) vec (EI T (ω j ) f θ0 (ω j )). vec (EI T (ω) f θ0 (ω)) = O T β+1/2) = o(1), M 1. M T (s) exp ( isω) Online Appendix Proof of Lemma A.. he proof uses similar arguments as in Dunsmuir 979), but allowing for weak identification and selecting a subset of frequencies using W ω). It consists of two steps.

More information

Gaussian processes for inference in stochastic differential equations

Gaussian processes for inference in stochastic differential equations Gaussian processes for inference in stochastic differential equations Manfred Opper, AI group, TU Berlin November 6, 2017 Manfred Opper, AI group, TU Berlin (TU Berlin) inference in SDE November 6, 2017

More information

Introduction to Probabilistic Graphical Models

Introduction to Probabilistic Graphical Models Introduction to Probabilistic Graphical Models Sargur Srihari srihari@cedar.buffalo.edu 1 Topics 1. What are probabilistic graphical models (PGMs) 2. Use of PGMs Engineering and AI 3. Directionality in

More information

Multivariate Analysis and Likelihood Inference

Multivariate Analysis and Likelihood Inference Multivariate Analysis and Likelihood Inference Outline 1 Joint Distribution of Random Variables 2 Principal Component Analysis (PCA) 3 Multivariate Normal Distribution 4 Likelihood Inference Joint density

More information

3 Operations on One Random Variable - Expectation

3 Operations on One Random Variable - Expectation 3 Operations on One Random Variable - Expectation 3.0 INTRODUCTION operations on a random variable Most of these operations are based on a single concept expectation. Even a probability of an event can

More information

Message passing and approximate message passing

Message passing and approximate message passing Message passing and approximate message passing Arian Maleki Columbia University 1 / 47 What is the problem? Given pdf µ(x 1, x 2,..., x n ) we are interested in arg maxx1,x 2,...,x n µ(x 1, x 2,..., x

More information

Gaussian with mean ( µ ) and standard deviation ( σ)

Gaussian with mean ( µ ) and standard deviation ( σ) Slide from Pieter Abbeel Gaussian with mean ( µ ) and standard deviation ( σ) 10/6/16 CSE-571: Robotics X ~ N( µ, σ ) Y ~ N( aµ + b, a σ ) Y = ax + b + + + + 1 1 1 1 1 1 1 1 1 1, ~ ) ( ) ( ), ( ~ ), (

More information

Estimation of State Noise for the Ensemble Kalman filter algorithm for 2D shallow water equations.

Estimation of State Noise for the Ensemble Kalman filter algorithm for 2D shallow water equations. Estimation of State Noise for the Ensemble Kalman filter algorithm for 2D shallow water equations. May 6, 2009 Motivation Constitutive Equations EnKF algorithm Some results Method Navier Stokes equations

More information

Geostatistical Modeling for Large Data Sets: Low-rank methods

Geostatistical Modeling for Large Data Sets: Low-rank methods Geostatistical Modeling for Large Data Sets: Low-rank methods Whitney Huang, Kelly-Ann Dixon Hamil, and Zizhuang Wu Department of Statistics Purdue University February 22, 2016 Outline Motivation Low-rank

More information

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS PROBABILITY: LIMIT THEOREMS II, SPRING 15. HOMEWORK PROBLEMS PROF. YURI BAKHTIN Instructions. You are allowed to work on solutions in groups, but you are required to write up solutions on your own. Please

More information

Naive Bayes and Gaussian Bayes Classifier

Naive Bayes and Gaussian Bayes Classifier Naive Bayes and Gaussian Bayes Classifier Mengye Ren mren@cs.toronto.edu October 18, 2015 Mengye Ren Naive Bayes and Gaussian Bayes Classifier October 18, 2015 1 / 21 Naive Bayes Bayes Rules: Naive Bayes

More information

Density estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas

Density estimation Nonparametric conditional mean estimation Semiparametric conditional mean estimation. Nonparametrics. Gabriel Montes-Rojas 0 0 5 Motivation: Regression discontinuity (Angrist&Pischke) Outcome.5 1 1.5 A. Linear E[Y 0i X i] 0.2.4.6.8 1 X Outcome.5 1 1.5 B. Nonlinear E[Y 0i X i] i 0.2.4.6.8 1 X utcome.5 1 1.5 C. Nonlinearity

More information

6 Pattern Mixture Models

6 Pattern Mixture Models 6 Pattern Mixture Models A common theme underlying the methods we have discussed so far is that interest focuses on making inference on parameters in a parametric or semiparametric model for the full data

More information

Ma 3/103: Lecture 24 Linear Regression I: Estimation

Ma 3/103: Lecture 24 Linear Regression I: Estimation Ma 3/103: Lecture 24 Linear Regression I: Estimation March 3, 2017 KC Border Linear Regression I March 3, 2017 1 / 32 Regression analysis Regression analysis Estimate and test E(Y X) = f (X). f is the

More information

Some Topics in Stochastic Partial Differential Equations

Some Topics in Stochastic Partial Differential Equations Some Topics in Stochastic Partial Differential Equations November 26, 2015 L Héritage de Kiyosi Itô en perspective Franco-Japonaise, Ambassade de France au Japon Plan of talk 1 Itô s SPDE 2 TDGL equation

More information

Reproducing Kernel Hilbert Spaces

Reproducing Kernel Hilbert Spaces Reproducing Kernel Hilbert Spaces Lorenzo Rosasco 9.520 Class 03 February 11, 2009 About this class Goal To introduce a particularly useful family of hypothesis spaces called Reproducing Kernel Hilbert

More information