A Spatio-Temporal Point Process Model for Ambulance Demand

Size: px
Start display at page:

Download "A Spatio-Temporal Point Process Model for Ambulance Demand"

Transcription

1 A Spatio-Temporal Point Process Model for Ambulance Demand David S. Matteson Department of Statistical Science Department of Social Statistics Cornell University Joint work with: Zhengyi Zhou (Applied Math, Cornell); Dawn B. Woodard & Shane G. Henderson (ORIE, Cornell); Athanasios C. Micheas (Statistics, UM-Columbia) Sponsorship: National Science Foundation 2014 September 18 avid S. Matteson S-T Ambulance Demand 2014 September 18 1 / 56

2 Introduction AHA American Heart Association: avid S. Matteson S-T Ambulance Demand 2014 September 18 2 / 56

3 Introduction Toronto Spatio-Temporal Ambulance Demand in Toronto February 1-28, 2007; 15, 393 observations Mean number of call arrivals per hour Sunday Monday Tuesday Wednesday Thursday Friday Saturday Mean 04:00:00 08:00:00 12:00:00 16:00:00 20:00:00 24:00:00 Hour of day Spatial demand locations (bases); mean demand per hour, by day David S. Matteson S-T Ambulance Demand 2014 September 18 3 / 56

4 Introduction Outline A Spatio-Temporal Model for Ambulance Demand Notation and Assumptions A Mixture Model Time invariant component distributions Mixture weight constraints Estimation Data augmentation Autoregressive priors Birth-and-death MCMC Imposing a boundary Comparison Methods Predictive Accuracy avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September 18 4 / 56

5 Introduction Notation Notation A continuous spatial domain S S = R 2 S = S R 2 (incorporate given spatial boundary) A discretized temporal domain T = {1, 2,..., T } T consecutive, equally spaced, time periods (1 or 2-hour blocks) s t,i spatial location of ith point at time t, for i = 1,..., n t S t = {s t,i : i = 1,..., n t } avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September 18 5 / 56

6 Introduction Assumptions Assumptions S t independently follows a non-homogeneous Poisson point process over S Positive, integrable intensity function λ t Decompose intensity λ t (s) = δ t f t (s), for s S avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September 18 6 / 56

7 Introduction Assumptions Assumptions S t independently follows a non-homogeneous Poisson point process over S Positive, integrable intensity function λ t Decompose intensity λ t (s) = δ t f t (s), for s S δ t = S λ t(s) ds aggregate event intensity for period t f t (s) spatial density of events for period t f t (s) > 0, for s S & S f t(s) ds = 1 n t λ t Poisson(δ t ) s t,i λ t, n t iid ft (s) for i = 1,..., n t avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September 18 6 / 56

8 Aggregate Demand Hourly Toronto EMS Data Su 8am 4pm Mo 8am 4pm Tu 8am 4pm We 8am 4pm Th 8am 4pm Fr 8am 4pm Sa 8am 4pm Su 8am 4pm Mo 8am 4pm Tu 8am 4pm We 8am 4pm Th 8am 4pm Fr 8am 4pm Sa 8am 4pm Hourly call arrivals Day/hour index Hourly call arrivals Hourly call arrivals Sunday Friday 04:00:00 08:00:00 12:00:00 16:00:00 20:00:00 24:00:00 hour of day 04:00:00 08:00:00 12:00:00 16:00:00 20:00:00 24:00:00 hour of day avid S. Matteson S-T Ambulance Demand 2014 September 18 7 / 56

9 Aggregate Demand Constrained and Smooth Factor Model: k f kl k (a) Factor levels (log linear scale) f 1 f 2 f 3 f 4 04:00:00 08:00:00 12:00:00 16:00:00 20:00:00 24:00:00 Hour of day (b) (c) Daily factor loadings (log linear scale) L L 2 L 3 L 4 Daily factor loadings (log linear scale) L L 2 L 3 L 4 F F F F First 28 days of 2008 Day Index for 2008 (Tic marks at Fridays) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September 18 8 / 56

10 Aggregate Demand avid S. Matteson S-T Ambulance Demand 2014 September 18 9 / 56

11 Spatio-Temporal Demand Spatio-Temporal Ambulance Demand in Toronto One Month avid S. Matteson S-T Ambulance Demand 2014 September / 56

12 Spatio-Temporal Demand Spatio-Temporal Ambulance Demand in Toronto One Month One Hour David S. Matteson S-T Ambulance Demand 2014 September / 56

13 Spatio-Temporal Demand MEDIC Current Industry Practice: MEDIC avid S. Matteson S-T Ambulance Demand 2014 September / 56

14 Spatio-Temporal Demand MEDIC Current Industry Practice: MEDIC avid S. Matteson S-T Ambulance Demand 2014 September / 56

15 Spatio-Temporal Demand MEDIC Current Industry Practice: MEDIC avid S. Matteson S-T Ambulance Demand 2014 September / 56

16 Spatio-Temporal Demand MEDIC Current Industry Practice: MEDIC avid S. Matteson S-T Ambulance Demand 2014 September / 56

17 Spatio-Temporal Demand Dependence Spatio-Temporal Ambulance Demand in Toronto Figure: (a) training data, downtown subregion outlined by a rectangle; (b) time series (top) and autocorrelation function (ACF, bottom) of the proportions of observations arising from downtown. Each period is a two-hour interval. Weekly (84 time periods) and daily (12 time periods) seasonality, as well as low-order autocorrelation. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

18 Spatio-Temporal Demand Dependence Spatio-Temporal Ambulance Demand in Toronto (a) (b) Figure: (a) training data, York subregion outlined by a rectangle; (b) time series (top) and autocorrelation function (ACF, bottom) of the proportions of observations arising from downtown. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

19 Spatio-Temporal Demand Dependence Spatio-Temporal Ambulance Demand in Toronto Figure: (a) Northwest region; (b) time series (top) and ACF (bottom) of the proportions of observations arising from the region. Null ACF in this region. avid S. Matteson S-T Ambulance Demand 2014 September / 56

20 Spatio-Temporal Model Gaussian Mixture A Spatial Gaussian Mixture Model We assume that {δ t } is known or obtained from temporal aggregate demand analysis: Channouf et al. (2007) or Matteson et al. (2011). Consider modeling spatial densities {f t (s)} via Gaussian mixture K f t (s; {p t,j }, {µ t,j }, {Σ t,j }) = p t,j φ(s; µ t,j, Σ t,j ), s S j=1 avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

21 Spatio-Temporal Model Gaussian Mixture A Spatial Gaussian Mixture Model We assume that {δ t } is known or obtained from temporal aggregate demand analysis: Channouf et al. (2007) or Matteson et al. (2011). Consider modeling spatial densities {f t (s)} via Gaussian mixture K f t (s; {p t,j }, {µ t,j }, {Σ t,j }) = p t,j φ(s; µ t,j, Σ t,j ), s S j=1 φ is the bivariate Gaussian density, mean µ and covariance Σ Mixture weights {p t,j }: p t,j > 0 and K j=1 p t,j = 1 ( j, t) Number of mixture components K, fixed or variable avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

22 Spatio-Temporal Model Gaussian Mixture Means and Covariances (ellipses at 90% level) for K = 15 David S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

23 Spatio-Temporal Model Model 1 Time Invariant Component Distributions K f t (s; {p t,j }, {µ j }, {Σ j }) = p t,j φ(s; µ j, Σ j ), s S (1) j=1 Constant component mixture means µ t,j = µ j ( j, t) Constant component mixture covariances Σ t,j = Σ j ( j, t) Mixture weights {p t,j }: p t,j > 0 and K j=1 p t,j = 1 ( j, t) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

24 Spatio-Temporal Model Model 1 Mixture Weights avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

25 Model 1 Estimation Bayesian Estimation: Priors and Data Augmentation Following Richardson and Green (1997) and Stephens (2000) For j = 1,..., K and t = 1,..., T, with p t = (p t,1,..., p t,k ), let p t Dirichlet(γ,..., γ), µ j Normal(ξ, κ 1 ), Σ 1 j β Wishart(2α, (2β) 1 ), β Wishart(2g, (2h) 1 ), avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

26 Model 1 Estimation Bayesian Estimation: Priors and Data Augmentation Following Richardson and Green (1997) and Stephens (2000) For j = 1,..., K and t = 1,..., T, with p t = (p t,1,..., p t,k ), let p t Dirichlet(γ,..., γ), µ j Normal(ξ, κ 1 ), Σ 1 j β Wishart(2α, (2β) 1 ), β Wishart(2g, (2h) 1 ), Augment data: latent component labels z t,i denotes membership for s t,i Full conditionals: P(z t,i = j ) p t,j φ(s t,i ; µ j, Σ j ), [β ] Wishart [p t ] Dirichlet [µ j ] Normal [Σ 1 j ] Wishart avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

27 Mixture Weight Constraints Model 2 Modeling Seasonality: Mixture Weight Constraints Let W N (W << T ) denote length of a given cycle W = 84: 2-hour time periods within a week Each t T is matched to some b {1,..., W } such that b mod W = t mod W We assume s S f t (s; {p t,j }, {µ j }, {Σ j }) = f b (s; {p b,j }, {µ j }, {Σ j }) K = p b,j φ(s; µ j, Σ j ), (2) All time periods with same position within the cycle have the same density j=1 David S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

28 Mixture Weight Constraints Model 2 Mixture Weights avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

29 Model 2 CAR Prior (Conditional) Autoregressive Prior avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

30 Model 2 CAR Prior Summation Constraint avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

31 Model 2 CAR Prior A Reparameterization avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

32 Model 2 Reparameterization A Reparameterization Multinomial logit transformation of the mixture weights [ ] p b,r π b,r = log 1 K 1 j=1 p, r = 1,..., K 1, b,j avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

33 Model 2 Reparameterization A Reparameterization Multinomial logit transformation of the mixture weights [ ] p b,r π b,r = log 1 K 1 j=1 p, r = 1,..., K 1, b,j with inverse transformation p b,j = p b,k = exp(π b,j ) 1 + K 1 r=1 exp(π, for j = 1,..., K 1, b,r ) K 1 r=1 exp(π b,r ). avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

34 Model 2 Reparameterization A Reparameterization Multinomial logit transformation of the mixture weights [ ] p b,r π b,r = log 1 K 1 j=1 p, r = 1,..., K 1, b,j with inverse transformation p b,j = p b,k = exp(π b,j ) 1 + K 1 r=1 exp(π, for j = 1,..., K 1, b,r ) K 1 r=1 exp(π b,r ). Autoregressive priors to model dependence in transformed weights {π b,j } (i) first-order autocorrelation (ii) first-order autocorrelation with daily seasonality avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

35 Model 2 Reparameterization (Conditional) Autoregressive Prior avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

36 Model 2 Autoregressive Priors First-Order (Conditional) Autoregressive Prior Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r We impose the following priors π b,r π b,r N ( c r + ρ r [(π b 1,r c r ) + (π b+1,r c r )], νr 2 ) r = 1,..., K 1; b = 1,..., W ; π b,r = (π 1,r,..., π b 1,r, π b+1,r,..., π W,r ) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

37 Model 2 Autoregressive Priors First-Order (Conditional) Autoregressive Prior Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r We impose the following priors π b,r π b,r N ( c r + ρ r [(π b 1,r c r ) + (π b+1,r c r )], νr 2 ) r = 1,..., K 1; b = 1,..., W ; π b,r = (π 1,r,..., π b 1,r, π b+1,r,..., π W,r ) ρ r U(0, 0.5) c r N(0, 10 4 ) ν 2 r U(0, 10 4 ) Autoregressive coefficients ρ r control the persistence over time Intercepts c r control for average levels Variances ν 2 r control the variability avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

38 Model 2 Autoregressive Priors First-Order (Conditional) Autoregressive Prior Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r We impose the following priors π b,r π b,r N ( c r + ρ r [(π b 1,r c r ) + (π b+1,r c r )], νr 2 ) r = 1,..., K 1; b = 1,..., W ; π b,r = (π 1,r,..., π b 1,r, π b+1,r,..., π W,r ) ρ r U(0, 0.5) c r N(0, 10 4 ) ν 2 r U(0, 10 4 ) Autoregressive coefficients ρ r control the persistence over time Intercepts c r control for average levels Variances ν 2 r control the variability For any ρ r ( 0.5, 0.5), the prior distribution of π r = (π 1,r,..., π B,r ) exists and is a proper multivariate normal distribution (Besag, 1974) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

39 Model 2 Autoregressive Priors Posterior Weights Figure: Posterior p t across time for component 1 in Model 2 (top); posterior p t across time for component 1 in Model 2 with CAR(1) prior (bottom) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

40 Model 2 Autoregressive Priors Estimation Algorithm 1. Initialize β, {µ j }, {Σ j }, {π b,r }, {c r }, {ρ r } and {ν 2 r } 2. Sample {µ j }, β, {Σ j } via full conditionals, similar to Model (1) 3. Update {π b,r } via Metropolis-Hastings 4. Update hyperparameters {c r }, {ρ r } and {ν 2 r } via Metropolis-Hastings David S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

41 Model 2 Seasonal Autoregressive Priors Seasonal (Conditional) Autoregressive Model avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

42 Model 2 Seasonal Autoregressive Priors Seasonal (Conditional) Autoregressive Model avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

43 Model 2 Seasonal Autoregressive Priors Seasonal (Conditional) Autoregressive Model avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

44 Model 2 Seasonal Autoregressive Priors Seasonal First-Order (Conditional) Autoregressive Model Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r and same period on neighboring days π b d,r, π b+d,r d is number of time periods in a day (d = 12) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

45 Model 2 Seasonal Autoregressive Priors Seasonal First-Order (Conditional) Autoregressive Model Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r and same period on neighboring days π b d,r, π b+d,r d is number of time periods in a day (d = 12) Priors [ π b,r π b,r N (c r + ρ r (π b 1,r c r ) + (π b+1,r c r ) ] + (π b d,r c r ) + (π b+d,r c r ), νr 2 ρ r U(0, 0.25) ), avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

46 Model 2 Seasonal Autoregressive Priors Seasonal First-Order (Conditional) Autoregressive Model Transformed weight π b,r depends on neighboring periods π b 1,r, π b+1,r and same period on neighboring days π b d,r, π b+d,r d is number of time periods in a day (d = 12) Priors [ π b,r π b,r N (c r + ρ r (π b 1,r c r ) + (π b+1,r c r ) ] + (π b d,r c r ) + (π b+d,r c r ), νr 2 ρ r U(0, 0.25) ), For ρ r ( 0.25, 0.25), the joint prior distribution of π r is proper avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

47 Model 2 Seasonal Autoregressive Priors Posterior Means and Covariances Figure: Posterior means and covariances (ellipses at 90% level) of all components from fitting proposed mixture model using 15 components. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

48 Model 2 Seasonal Autoregressive Priors Posterior Means and Covariances Figure: Each ellipse (except the 15th) is shaded with the posterior mean of ρ r for that component. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

49 Model 2 Seasonal Autoregressive Priors Posterior log Spatial Densities, K = 15 Figure: Mixture model using 15 components: (a) posterior log spatial density for Wednesday 2-4pm (demand concentrated at downtown at midday); (b) posterior log spatial density for Wednesday 2-4am (demand more spread out at midnight). avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

50 Model 2 BDMCMC Estimating the Number of Components Varying number of components (usually) improves mixing & predictions Adapt the birth-and-death MCMC (BDMCMC) methods of Stephens (2000) Alternative to Reversible Jump MCMC (RJMCMC), Green (1995) and Richardson and Green (1997) BDMCMC widely used in pattern recognition applications (cf. Micheas et al., 2012; Elguebaly and Bouguila, 2012). Fix birth rate of new components at λ b Assume a truncated Poisson prior on the number of components, i.e., P(l) τ l /l!, l {1,..., l max }, for some l max David S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

51 Model 2 BDMCMC BDMCMC Algorithm Initialize l components, y = {({p b,1 } W b=1, µ 1, Σ 1 ),..., ({p b,l } W b=1, µ l, Σ l )} 1. For j {1,..., l}, calculate death rate for the j th component, d j (y) L ( y\({p b,j } W b=1 d j (y) = λ, µ j, Σ j ) ) P(l 1) P ( {p b,1,..., p b,j 1, p b,j+1,..., p b,l } ) W b=1 b L(y) l P(l) P ( ) {p b,1,..., p b,l } W b=1 L( ) is joint likelihood function, and P( ) represents the priors 2. Total death rate, d(y) = l j=1 d j(y) 3. Time to next jump: exponential with mean λ b + d(y) 4. Birth or Death? P(birth) = λ b /(λ b + d(y)) and P(death) = d(y)/(λ b + d(y)) 5. If birth, independently sample component s weight from Beta(1, l) 6. Normalize weights to sum 1, in all periods 7. Repeat 1 6 for a fixed time T 0 8. Fix the number of components, and update all other parameters via full-conditionals or Metropolis-Hastings avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

52 Model 2 BDMCMC Posterior log Spatial Densities, variable number of components Figure: Mixture model using variable number of components: (a) posterior log spatial density for Wednesday 2-4am using an average of 19 components; (b) that using an average of 24 components. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

53 Model 2 Boundary Estimation with a Boundary Point processes commonly occur on fixed bounded regions We restrict the spatial domain, S from R 2 to a bounded region S Toronto: Lake Ontario to the south and surrounding suburban areas Normalize the spatial densities f b with respect to the boundary f b (s; θ) = f b(s; θ)1 {s S} S f b(s; θ) ds, in which θ is a vectorization of all the parameters Numerically approximate the denominator avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

54 Model 2 Boundary Estimation with a Boundary Figure: Estimated first-order autoregressive-prior model using 15 components: (a) posterior means and covariances (ellipses at 90% level) of all 15 components at the 50,000th iteration; (b) posterior log spatial density on Wednesday 2:00pm-4:00pm, averaged across the last 50,000 Monte Carlo samples. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

55 Evaluation Comparison Methods Comparison Methods (MEDIC) Histogram Estimator Partition spatial domain into C equally-sized rectangular spatial cells, each with area A C For each time period t, define f t (s) = C c=1 1 A C n c,t + a n t + ac 1 {s c}, Modified proportion (nc,t + a)/(n t + ac) vs. true proportion (n c,t )/(n t ) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

56 Evaluation Comparison Methods Comparison Methods (MEDIC) Histogram Estimator Partition spatial domain into C equally-sized rectangular spatial cells, each with area A C For each time period t, define f t (s) = C c=1 1 A C n c,t + a n t + ac 1 {s c}, Modified proportion (nc,t + a)/(n t + ac) vs. true proportion (n c,t )/(n t ) Kernel Density Estimator Bivariate normal kernel function Bandwidths: plug-in selector (PI, see Wand and Jones, 1994), or smoothed cross-validation selector (SCV, see Duong and Hazelton, 2005) avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

57 Evaluation Comparison Methods MEDIC and MEDIC-KDE avid S. Matteson S-T Ambulance Demand 2014 September / 56

58 Evaluation Comparison Methods MEDIC and MEDIC-KDE avid S. Matteson S-T Ambulance Demand 2014 September / 56

59 Evaluation Comparison Methods Log Predictive Densities, MEDIC and MEDIC-KDE Figure: Log predictive densities using two current industry estimation methods for 2-4am (midnight) on February 6, 2008 (Wednesday). Compared to mixture models, estimates from the MEDIC method is overly noisy while those from MEDIC with KDE are not very refined. avid S. Matteson S-T Ambulance Demand 2014 September / 56

60 Evaluation Predictive Accuracy Predictive Accuracy Average logarithmic score (Good, 1952; Gneiting and Raftery, 2007) PA({s t,i }) = 1 T t=1 n t ˆf t ( ) density estimate from training data s t,i test data T n t log ˆf t (s t,i ) t=1 i=1 avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

61 Evaluation Predictive Accuracy Predictive Accuracy Average logarithmic score (Good, 1952; Gneiting and Raftery, 2007) PA({s t,i }) = 1 T t=1 n t ˆf t ( ) density estimate from training data s t,i test data Monte Carlo estimate PA mix ({s t,i }) = 1 M [ M 1 T t=1 n t m=1 T n t log ˆf t (s t,i ) t=1 i=1 ] T n t log ˆf t (s t,i θ (m) ) t=1 i=1 θ (m) : m th -iteration posterior parameter estimates from the training data avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

62 Evaluation Predictive Accuracy Predictive Accuracy Gaussian Mixture Competing Methods Estimation method PA for Mar 07 PA for Feb components ± ± Variable number of comp: average 19 comp ± ± average 24 comp ± ± MEDIC MEDIC with KDE Table: Predictive accuracies of proposed Gaussian mixture models and competing methods on test data of March 2007 and February The predictive accuracies for mixture models are presented with their 95% batch means confidence intervals. avid S. Matteson S-T Ambulance Demand 2014 September / 56

63 Evaluation Predictive Accuracy Operational Predictive Accuracy: 44 bases avid S. Matteson S-T Ambulance Demand 2014 September / 56

64 Evaluation Predictive Accuracy Operational Predictive Accuracy: 44 bases avid S. Matteson S-T Ambulance Demand 2014 September / 56

65 Evaluation Predictive Accuracy Operational Predictive Accuracy: 44 bases avid S. Matteson S-T Ambulance Demand 2014 September / 56

66 Evaluation Predictive Accuracy Operational Predictive Accuracy: Error(M, r) = 1 T T t=1 P M,t(r) P test,t (r) Figure: (a) all 44 ambulance bases in Toronto; (b) and (c) average absolute error in measuring operational performance made by our mixture model (15 components), MEDIC, and MEDIC with KDE, using test data from March 2007 and February 2008, respectively (with 95% confidence intervals in gray). avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

67 Conclusions Thank you! Conclusions Flexible, parsimonious framework to model spatio-temporal point processes A Constrained Factor Model A Finite Mixture Model Time invariant component distributions Mixture weight constraints Autoregressive priors Birth-and-death MCMC Spatial boundary Large Toronto EMS dataset, spatio-temporal ambulance demand Average logarithmic score Future work: forecasting and covariate models avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

68 Conclusions Bibliography Bibliography Besag, J. E. (1974), Spatial interaction and the statistical analysis of lattice systems, Journal of the Royal Statistical Society, Series B, 36, Channouf, N., L Ecuyer, P., Ingolfsson, A., and Avramidis, A. (2007), The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta, Health Care Management Science, 10, Duong, T., and Hazelton, M. L. (2005), Cross-validation bandwidth matrices for multivariate kernel density estimation, Scandinavian Journal of Statistics, 32, Elguebaly, T., and Bouguila, N. (2012), Medical image classification using birth-and-death MCMC,, in Circuits and Systems (ISCAS), 2012 IEEE International Symposium on, Seoul, South Korea, pp Gneiting, T., and Raftery, A. (2007), Strictly proper scoring rules, prediction, and estimation, Journal of the American Statistical Association, 102, Good, I. J. (1952), Rational decisions, Journal of the Royal Statistical Society: Series B, 14, Green, P. (1995), Reversible jump MCMC computation and Bayesian model determination, Biometrika, 82, Matteson, D. S., and James, N. A. (2014), A nonparametric approach for multiple change point analysis of multivariate data, Journal of the American Statistical Association, 109(505), Matteson, D. S., McLean, M. W., Woodard, D. B., and Henderson, S. G. (2011), Forecasting emergency medical service call arrival rates, Annals of Applied Statistics, 5, Micheas, A. C., Wikle, C. K., and Larsen, D. R. (2012), Random set modeling of three-dimensional objects in a hierarchical Bayesian context, Journal of Statistical Computation and Simulation, 0, Richardson, S., and Green, P. (1997), On Bayesian analysis of mixtures with an unknown number of components (with discussion), Journal of the Royal Statistical Society: Series B, 59, Stephens, M. (2000), Bayesian analysis of mixture models with an unknown number of components - an alternative to reversible jump methods, Annals of Statistics, 28, Wand, M. P., and Jones, M. C. (1994), Multivariate plug-in bandwidth selection, Computational Statistics, 9, Zhou, Z., Matteson, D. S., Woodard, D. B., Henderson, S. G., and Micheas, A. C. (2014), A Spatio-Temporal Point Process Model for Ambulance Demand, in press, Journal of the American Statistical Association; arxiv preprint arxiv: ,. avid S. Matteson (matteson@cornell.edu) S-T Ambulance Demand 2014 September / 56

A Spatio-Temporal Point Process Model for Ambulance Demand

A Spatio-Temporal Point Process Model for Ambulance Demand A Spatio-Temporal Point Process Model for Ambulance Demand Zhengyi Zhou, David S. Matteson, Dawn B. Woodard, Shane G. Henderson and Athanasios C. Micheas arxiv:1401.5547v2 [stat.ap] 27 May 2014 May 29,

More information

A Spatio-Temporal Point Process Model for Ambulance Demand

A Spatio-Temporal Point Process Model for Ambulance Demand Journal of the American Statistical Association ISSN: 0162-1459 (Print) 1537-274X (Online) Journal homepage: http://www.tandfonline.com/loi/uasa20 A Spatio-Temporal Point Process Model for Ambulance Demand

More information

arxiv: v1 [stat.ml] 16 Jun 2016

arxiv: v1 [stat.ml] 16 Jun 2016 Predicting Ambulance Demand: Challenges and Methods Zhengyi Zhou ZZHOU@RESEARCH.ATT.COM Research done at Cornell University, now at AT&T Labs Research, 33 Thomas Street, New York, NY 10007 USA arxiv:1606.05363v1

More information

arxiv: v1 [stat.ap] 1 Jul 2015

arxiv: v1 [stat.ap] 1 Jul 2015 Predicting Ambulance Demand: a Spatio-Temporal Kernel Approach arxiv:1507.00364v1 [stat.ap] 1 Jul 2015 ABSTRACT Zhengyi Zhou Center for Applied Mathematics Cornell University Ithaca, NY 14853 zz254@cornell.edu

More information

Bayesian model selection in graphs by using BDgraph package

Bayesian model selection in graphs by using BDgraph package Bayesian model selection in graphs by using BDgraph package A. Mohammadi and E. Wit March 26, 2013 MOTIVATION Flow cytometry data with 11 proteins from Sachs et al. (2005) RESULT FOR CELL SIGNALING DATA

More information

Physician Performance Assessment / Spatial Inference of Pollutant Concentrations

Physician Performance Assessment / Spatial Inference of Pollutant Concentrations Physician Performance Assessment / Spatial Inference of Pollutant Concentrations Dawn Woodard Operations Research & Information Engineering Cornell University Johns Hopkins Dept. of Biostatistics, April

More information

Multilevel Statistical Models: 3 rd edition, 2003 Contents

Multilevel Statistical Models: 3 rd edition, 2003 Contents Multilevel Statistical Models: 3 rd edition, 2003 Contents Preface Acknowledgements Notation Two and three level models. A general classification notation and diagram Glossary Chapter 1 An introduction

More information

Bayesian Image Segmentation Using MRF s Combined with Hierarchical Prior Models

Bayesian Image Segmentation Using MRF s Combined with Hierarchical Prior Models Bayesian Image Segmentation Using MRF s Combined with Hierarchical Prior Models Kohta Aoki 1 and Hiroshi Nagahashi 2 1 Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology

More information

A Nonparametric Approach for Multiple Change Point Analysis of Multivariate Data

A Nonparametric Approach for Multiple Change Point Analysis of Multivariate Data A Nonparametric Approach for Multiple Change Point Analysis of Multivariate Data David S. Matteson Department of Statistical Science Cornell University matteson@cornell.edu www.stat.cornell.edu/~matteson

More information

Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach. Radford M. Neal, 28 February 2005

Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach. Radford M. Neal, 28 February 2005 Creating Non-Gaussian Processes from Gaussian Processes by the Log-Sum-Exp Approach Radford M. Neal, 28 February 2005 A Very Brief Review of Gaussian Processes A Gaussian process is a distribution over

More information

Bayesian Modeling of Conditional Distributions

Bayesian Modeling of Conditional Distributions Bayesian Modeling of Conditional Distributions John Geweke University of Iowa Indiana University Department of Economics February 27, 2007 Outline Motivation Model description Methods of inference Earnings

More information

Contents. Part I: Fundamentals of Bayesian Inference 1

Contents. Part I: Fundamentals of Bayesian Inference 1 Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian

More information

Bayesian non-parametric model to longitudinally predict churn

Bayesian non-parametric model to longitudinally predict churn Bayesian non-parametric model to longitudinally predict churn Bruno Scarpa Università di Padova Conference of European Statistics Stakeholders Methodologists, Producers and Users of European Statistics

More information

Stat 535 C - Statistical Computing & Monte Carlo Methods. Lecture 18-16th March Arnaud Doucet

Stat 535 C - Statistical Computing & Monte Carlo Methods. Lecture 18-16th March Arnaud Doucet Stat 535 C - Statistical Computing & Monte Carlo Methods Lecture 18-16th March 2006 Arnaud Doucet Email: arnaud@cs.ubc.ca 1 1.1 Outline Trans-dimensional Markov chain Monte Carlo. Bayesian model for autoregressions.

More information

Bayesian time series classification

Bayesian time series classification Bayesian time series classification Peter Sykacek Department of Engineering Science University of Oxford Oxford, OX 3PJ, UK psyk@robots.ox.ac.uk Stephen Roberts Department of Engineering Science University

More information

Index. Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables.

Index. Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables. Index Pagenumbersfollowedbyf indicate figures; pagenumbersfollowedbyt indicate tables. Adaptive rejection metropolis sampling (ARMS), 98 Adaptive shrinkage, 132 Advanced Photo System (APS), 255 Aggregation

More information

A Review of Pseudo-Marginal Markov Chain Monte Carlo

A Review of Pseudo-Marginal Markov Chain Monte Carlo A Review of Pseudo-Marginal Markov Chain Monte Carlo Discussed by: Yizhe Zhang October 21, 2016 Outline 1 Overview 2 Paper review 3 experiment 4 conclusion Motivation & overview Notation: θ denotes the

More information

Spatial Inference of Nitrate Concentrations in Groundwater

Spatial Inference of Nitrate Concentrations in Groundwater Spatial Inference of Nitrate Concentrations in Groundwater Dawn Woodard Operations Research & Information Engineering Cornell University joint work with Robert Wolpert, Duke Univ. Dept. of Statistical

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

STA 414/2104: Machine Learning

STA 414/2104: Machine Learning STA 414/2104: Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistics! rsalakhu@cs.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 9 Sequential Data So far

More information

Multivariate Normal & Wishart

Multivariate Normal & Wishart Multivariate Normal & Wishart Hoff Chapter 7 October 21, 2010 Reading Comprehesion Example Twenty-two children are given a reading comprehsion test before and after receiving a particular instruction method.

More information

Spatial Dynamic Factor Analysis

Spatial Dynamic Factor Analysis Spatial Dynamic Factor Analysis Esther Salazar Federal University of Rio de Janeiro Department of Statistical Methods Sixth Workshop on BAYESIAN INFERENCE IN STOCHASTIC PROCESSES Bressanone/Brixen, Italy

More information

Bayesian Nonparametric Learning of Complex Dynamical Phenomena

Bayesian Nonparametric Learning of Complex Dynamical Phenomena Duke University Department of Statistical Science Bayesian Nonparametric Learning of Complex Dynamical Phenomena Emily Fox Joint work with Erik Sudderth (Brown University), Michael Jordan (UC Berkeley),

More information

Large sample distribution for fully functional periodicity tests

Large sample distribution for fully functional periodicity tests Large sample distribution for fully functional periodicity tests Siegfried Hörmann Institute for Statistics Graz University of Technology Based on joint work with Piotr Kokoszka (Colorado State) and Gilles

More information

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making

Modeling conditional distributions with mixture models: Applications in finance and financial decision-making Modeling conditional distributions with mixture models: Applications in finance and financial decision-making John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 11 Project

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 7 Approximate

More information

Hmms with variable dimension structures and extensions

Hmms with variable dimension structures and extensions Hmm days/enst/january 21, 2002 1 Hmms with variable dimension structures and extensions Christian P. Robert Université Paris Dauphine www.ceremade.dauphine.fr/ xian Hmm days/enst/january 21, 2002 2 1 Estimating

More information

Log Gaussian Cox Processes. Chi Group Meeting February 23, 2016

Log Gaussian Cox Processes. Chi Group Meeting February 23, 2016 Log Gaussian Cox Processes Chi Group Meeting February 23, 2016 Outline Typical motivating application Introduction to LGCP model Brief overview of inference Applications in my work just getting started

More information

Non-homogeneous Markov Mixture of Periodic Autoregressions for the Analysis of Air Pollution in the Lagoon of Venice

Non-homogeneous Markov Mixture of Periodic Autoregressions for the Analysis of Air Pollution in the Lagoon of Venice Non-homogeneous Markov Mixture of Periodic Autoregressions for the Analysis of Air Pollution in the Lagoon of Venice Roberta Paroli 1, Silvia Pistollato, Maria Rosa, and Luigi Spezia 3 1 Istituto di Statistica

More information

Modeling conditional distributions with mixture models: Theory and Inference

Modeling conditional distributions with mixture models: Theory and Inference Modeling conditional distributions with mixture models: Theory and Inference John Geweke University of Iowa, USA Journal of Applied Econometrics Invited Lecture Università di Venezia Italia June 2, 2005

More information

Bayesian spatial hierarchical modeling for temperature extremes

Bayesian spatial hierarchical modeling for temperature extremes Bayesian spatial hierarchical modeling for temperature extremes Indriati Bisono Dr. Andrew Robinson Dr. Aloke Phatak Mathematics and Statistics Department The University of Melbourne Maths, Informatics

More information

Wrapped Gaussian processes: a short review and some new results

Wrapped Gaussian processes: a short review and some new results Wrapped Gaussian processes: a short review and some new results Giovanna Jona Lasinio 1, Gianluca Mastrantonio 2 and Alan Gelfand 3 1-Università Sapienza di Roma 2- Università RomaTRE 3- Duke University

More information

Pattern Recognition and Machine Learning. Bishop Chapter 2: Probability Distributions

Pattern Recognition and Machine Learning. Bishop Chapter 2: Probability Distributions Pattern Recognition and Machine Learning Chapter 2: Probability Distributions Cécile Amblard Alex Kläser Jakob Verbeek October 11, 27 Probability Distributions: General Density Estimation: given a finite

More information

EM Algorithm II. September 11, 2018

EM Algorithm II. September 11, 2018 EM Algorithm II September 11, 2018 Review EM 1/27 (Y obs, Y mis ) f (y obs, y mis θ), we observe Y obs but not Y mis Complete-data log likelihood: l C (θ Y obs, Y mis ) = log { f (Y obs, Y mis θ) Observed-data

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 2: PROBABILITY DISTRIBUTIONS Parametric Distributions Basic building blocks: Need to determine given Representation: or? Recall Curve Fitting Binary Variables

More information

Markov Chain Monte Carlo (MCMC)

Markov Chain Monte Carlo (MCMC) Markov Chain Monte Carlo (MCMC Dependent Sampling Suppose we wish to sample from a density π, and we can evaluate π as a function but have no means to directly generate a sample. Rejection sampling can

More information

Riemann Manifold Methods in Bayesian Statistics

Riemann Manifold Methods in Bayesian Statistics Ricardo Ehlers ehlers@icmc.usp.br Applied Maths and Stats University of São Paulo, Brazil Working Group in Statistical Learning University College Dublin September 2015 Bayesian inference is based on Bayes

More information

A Fully Nonparametric Modeling Approach to. BNP Binary Regression

A Fully Nonparametric Modeling Approach to. BNP Binary Regression A Fully Nonparametric Modeling Approach to Binary Regression Maria Department of Applied Mathematics and Statistics University of California, Santa Cruz SBIES, April 27-28, 2012 Outline 1 2 3 Simulation

More information

STAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics

STAT 520: Forecasting and Time Series. David B. Hitchcock University of South Carolina Department of Statistics David B. University of South Carolina Department of Statistics What are Time Series Data? Time series data are collected sequentially over time. Some common examples include: 1. Meteorological data (temperatures,

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is

More information

Sequential Monte Carlo Methods for Bayesian Model Selection in Positron Emission Tomography

Sequential Monte Carlo Methods for Bayesian Model Selection in Positron Emission Tomography Methods for Bayesian Model Selection in Positron Emission Tomography Yan Zhou John A.D. Aston and Adam M. Johansen 6th January 2014 Y. Zhou J. A. D. Aston and A. M. Johansen Outline Positron emission tomography

More information

Infinite-State Markov-switching for Dynamic. Volatility Models : Web Appendix

Infinite-State Markov-switching for Dynamic. Volatility Models : Web Appendix Infinite-State Markov-switching for Dynamic Volatility Models : Web Appendix Arnaud Dufays 1 Centre de Recherche en Economie et Statistique March 19, 2014 1 Comparison of the two MS-GARCH approximations

More information

Bayesian Dynamic Linear Modelling for. Complex Computer Models

Bayesian Dynamic Linear Modelling for. Complex Computer Models Bayesian Dynamic Linear Modelling for Complex Computer Models Fei Liu, Liang Zhang, Mike West Abstract Computer models may have functional outputs. With no loss of generality, we assume that a single computer

More information

Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Mela. P.

Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Mela. P. Frailty Modeling for Spatially Correlated Survival Data, with Application to Infant Mortality in Minnesota By: Sudipto Banerjee, Melanie M. Wall, Bradley P. Carlin November 24, 2014 Outlines of the talk

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

Practical Bayesian Optimization of Machine Learning. Learning Algorithms

Practical Bayesian Optimization of Machine Learning. Learning Algorithms Practical Bayesian Optimization of Machine Learning Algorithms CS 294 University of California, Berkeley Tuesday, April 20, 2016 Motivation Machine Learning Algorithms (MLA s) have hyperparameters that

More information

Quantifying Fingerprint Evidence using Bayesian Alignment

Quantifying Fingerprint Evidence using Bayesian Alignment Quantifying Fingerprint Evidence using Bayesian Alignment Peter Forbes Joint work with Steffen Lauritzen and Jesper Møller Department of Statistics University of Oxford UCL CSML Lunch Talk 14 February

More information

On Bayesian Computation

On Bayesian Computation On Bayesian Computation Michael I. Jordan with Elaine Angelino, Maxim Rabinovich, Martin Wainwright and Yun Yang Previous Work: Information Constraints on Inference Minimize the minimax risk under constraints

More information

A Nonparametric Model for Stationary Time Series

A Nonparametric Model for Stationary Time Series A Nonparametric Model for Stationary Time Series Isadora Antoniano-Villalobos Bocconi University, Milan, Italy. isadora.antoniano@unibocconi.it Stephen G. Walker University of Texas at Austin, USA. s.g.walker@math.utexas.edu

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods Tomas McKelvey and Lennart Svensson Signal Processing Group Department of Signals and Systems Chalmers University of Technology, Sweden November 26, 2012 Today s learning

More information

Supplementary Notes: Segment Parameter Labelling in MCMC Change Detection

Supplementary Notes: Segment Parameter Labelling in MCMC Change Detection Supplementary Notes: Segment Parameter Labelling in MCMC Change Detection Alireza Ahrabian 1 arxiv:1901.0545v1 [eess.sp] 16 Jan 019 Abstract This work addresses the problem of segmentation in time series

More information

Bayesian Computation in Color-Magnitude Diagrams

Bayesian Computation in Color-Magnitude Diagrams Bayesian Computation in Color-Magnitude Diagrams SA, AA, PT, EE, MCMC and ASIS in CMDs Paul Baines Department of Statistics Harvard University October 19, 2009 Overview Motivation and Introduction Modelling

More information

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency

Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Gaussian processes for spatial modelling in environmental health: parameterizing for flexibility vs. computational efficiency Chris Paciorek March 11, 2005 Department of Biostatistics Harvard School of

More information

MCMC Sampling for Bayesian Inference using L1-type Priors

MCMC Sampling for Bayesian Inference using L1-type Priors MÜNSTER MCMC Sampling for Bayesian Inference using L1-type Priors (what I do whenever the ill-posedness of EEG/MEG is just not frustrating enough!) AG Imaging Seminar Felix Lucka 26.06.2012 , MÜNSTER Sampling

More information

ABC methods for phase-type distributions with applications in insurance risk problems

ABC methods for phase-type distributions with applications in insurance risk problems ABC methods for phase-type with applications problems Concepcion Ausin, Department of Statistics, Universidad Carlos III de Madrid Joint work with: Pedro Galeano, Universidad Carlos III de Madrid Simon

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate

More information

Efficient Bayesian Multivariate Surface Regression

Efficient Bayesian Multivariate Surface Regression Efficient Bayesian Multivariate Surface Regression Feng Li (joint with Mattias Villani) Department of Statistics, Stockholm University October, 211 Outline of the talk 1 Flexible regression models 2 The

More information

Efficient adaptive covariate modelling for extremes

Efficient adaptive covariate modelling for extremes Efficient adaptive covariate modelling for extremes Slides at www.lancs.ac.uk/ jonathan Matthew Jones, David Randell, Emma Ross, Elena Zanini, Philip Jonathan Copyright of Shell December 218 1 / 23 Structural

More information

Non-gaussian spatiotemporal modeling

Non-gaussian spatiotemporal modeling Dec, 2008 1/ 37 Non-gaussian spatiotemporal modeling Thais C O da Fonseca Joint work with Prof Mark F J Steel Department of Statistics University of Warwick Dec, 2008 Dec, 2008 2/ 37 1 Introduction Motivation

More information

Model Based Clustering of Count Processes Data

Model Based Clustering of Count Processes Data Model Based Clustering of Count Processes Data Tin Lok James Ng, Brendan Murphy Insight Centre for Data Analytics School of Mathematics and Statistics May 15, 2017 Tin Lok James Ng, Brendan Murphy (Insight)

More information

Markov Chain Monte Carlo in Practice

Markov Chain Monte Carlo in Practice Markov Chain Monte Carlo in Practice Edited by W.R. Gilks Medical Research Council Biostatistics Unit Cambridge UK S. Richardson French National Institute for Health and Medical Research Vilejuif France

More information

Motivation Scale Mixutres of Normals Finite Gaussian Mixtures Skew-Normal Models. Mixture Models. Econ 690. Purdue University

Motivation Scale Mixutres of Normals Finite Gaussian Mixtures Skew-Normal Models. Mixture Models. Econ 690. Purdue University Econ 690 Purdue University In virtually all of the previous lectures, our models have made use of normality assumptions. From a computational point of view, the reason for this assumption is clear: combined

More information

Study Notes on the Latent Dirichlet Allocation

Study Notes on the Latent Dirichlet Allocation Study Notes on the Latent Dirichlet Allocation Xugang Ye 1. Model Framework A word is an element of dictionary {1,,}. A document is represented by a sequence of words: =(,, ), {1,,}. A corpus is a collection

More information

Chapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang

Chapter 4 Dynamic Bayesian Networks Fall Jin Gu, Michael Zhang Chapter 4 Dynamic Bayesian Networks 2016 Fall Jin Gu, Michael Zhang Reviews: BN Representation Basic steps for BN representations Define variables Define the preliminary relations between variables Check

More information

The Jackknife-Like Method for Assessing Uncertainty of Point Estimates for Bayesian Estimation in a Finite Gaussian Mixture Model

The Jackknife-Like Method for Assessing Uncertainty of Point Estimates for Bayesian Estimation in a Finite Gaussian Mixture Model Thai Journal of Mathematics : 45 58 Special Issue: Annual Meeting in Mathematics 207 http://thaijmath.in.cmu.ac.th ISSN 686-0209 The Jackknife-Like Method for Assessing Uncertainty of Point Estimates for

More information

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Song Li 1, Peng Wang 1 and Lalit Goel 1 1 School of Electrical and Electronic Engineering Nanyang Technological University

More information

Month Demand Give an integer linear programming formulation for the problem of finding a production plan of minimum cost.

Month Demand Give an integer linear programming formulation for the problem of finding a production plan of minimum cost. 1.9 Modem production A company A, producing a single model of modem, is planning the production for the next 4 months. The producing capacity is of 2500 units per month, at a cost of 7 Euro per unit. A

More information

Pattern Recognition and Machine Learning. Bishop Chapter 11: Sampling Methods

Pattern Recognition and Machine Learning. Bishop Chapter 11: Sampling Methods Pattern Recognition and Machine Learning Chapter 11: Sampling Methods Elise Arnaud Jakob Verbeek May 22, 2008 Outline of the chapter 11.1 Basic Sampling Algorithms 11.2 Markov Chain Monte Carlo 11.3 Gibbs

More information

Stat 542: Item Response Theory Modeling Using The Extended Rank Likelihood

Stat 542: Item Response Theory Modeling Using The Extended Rank Likelihood Stat 542: Item Response Theory Modeling Using The Extended Rank Likelihood Jonathan Gruhl March 18, 2010 1 Introduction Researchers commonly apply item response theory (IRT) models to binary and ordinal

More information

DAILY QUESTIONS 28 TH JUNE 18 REASONING - CALENDAR

DAILY QUESTIONS 28 TH JUNE 18 REASONING - CALENDAR DAILY QUESTIONS 28 TH JUNE 18 REASONING - CALENDAR LEAP AND NON-LEAP YEAR *A non-leap year has 365 days whereas a leap year has 366 days. (as February has 29 days). *Every year which is divisible by 4

More information

Bayesian Inference for Pair-copula Constructions of Multiple Dependence

Bayesian Inference for Pair-copula Constructions of Multiple Dependence Bayesian Inference for Pair-copula Constructions of Multiple Dependence Claudia Czado and Aleksey Min Technische Universität München cczado@ma.tum.de, aleksmin@ma.tum.de December 7, 2007 Overview 1 Introduction

More information

Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting

Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting Anne Philippe Laboratoire de Mathématiques Jean Leray Université de Nantes Workshop EDF-INRIA,

More information

Distributions of Persistence Diagrams and Approximations

Distributions of Persistence Diagrams and Approximations Distributions of Persistence Diagrams and Approximations Vasileios Maroulas Department of Mathematics Department of Business Analytics and Statistics University of Tennessee August 31, 2018 Thanks V. Maroulas

More information

Metropolis Hastings. Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601. Module 9

Metropolis Hastings. Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601. Module 9 Metropolis Hastings Rebecca C. Steorts Bayesian Methods and Modern Statistics: STA 360/601 Module 9 1 The Metropolis-Hastings algorithm is a general term for a family of Markov chain simulation methods

More information

A short introduction to INLA and R-INLA

A short introduction to INLA and R-INLA A short introduction to INLA and R-INLA Integrated Nested Laplace Approximation Thomas Opitz, BioSP, INRA Avignon Workshop: Theory and practice of INLA and SPDE November 7, 2018 2/21 Plan for this talk

More information

Downloaded from:

Downloaded from: Camacho, A; Kucharski, AJ; Funk, S; Breman, J; Piot, P; Edmunds, WJ (2014) Potential for large outbreaks of Ebola virus disease. Epidemics, 9. pp. 70-8. ISSN 1755-4365 DOI: https://doi.org/10.1016/j.epidem.2014.09.003

More information

INFINITE MIXTURES OF MULTIVARIATE GAUSSIAN PROCESSES

INFINITE MIXTURES OF MULTIVARIATE GAUSSIAN PROCESSES INFINITE MIXTURES OF MULTIVARIATE GAUSSIAN PROCESSES SHILIANG SUN Department of Computer Science and Technology, East China Normal University 500 Dongchuan Road, Shanghai 20024, China E-MAIL: slsun@cs.ecnu.edu.cn,

More information

Recent Advances in Bayesian Inference Techniques

Recent Advances in Bayesian Inference Techniques Recent Advances in Bayesian Inference Techniques Christopher M. Bishop Microsoft Research, Cambridge, U.K. research.microsoft.com/~cmbishop SIAM Conference on Data Mining, April 2004 Abstract Bayesian

More information

Order-q stochastic processes. Bayesian nonparametric applications

Order-q stochastic processes. Bayesian nonparametric applications Order-q dependent stochastic processes in Bayesian nonparametric applications Department of Statistics, ITAM, Mexico BNP 2015, Raleigh, NC, USA 25 June, 2015 Contents Order-1 process Application in survival

More information

Learning Bayesian Networks for Biomedical Data

Learning Bayesian Networks for Biomedical Data Learning Bayesian Networks for Biomedical Data Faming Liang (Texas A&M University ) Liang, F. and Zhang, J. (2009) Learning Bayesian Networks for Discrete Data. Computational Statistics and Data Analysis,

More information

Gaussian Multiscale Spatio-temporal Models for Areal Data

Gaussian Multiscale Spatio-temporal Models for Areal Data Gaussian Multiscale Spatio-temporal Models for Areal Data (University of Missouri) Scott H. Holan (University of Missouri) Adelmo I. Bertolde (UFES) Outline Motivation Multiscale factorization The multiscale

More information

Expectation Propagation for Approximate Bayesian Inference

Expectation Propagation for Approximate Bayesian Inference Expectation Propagation for Approximate Bayesian Inference José Miguel Hernández Lobato Universidad Autónoma de Madrid, Computer Science Department February 5, 2007 1/ 24 Bayesian Inference Inference Given

More information

STA414/2104 Statistical Methods for Machine Learning II

STA414/2104 Statistical Methods for Machine Learning II STA414/2104 Statistical Methods for Machine Learning II Murat A. Erdogdu & David Duvenaud Department of Computer Science Department of Statistical Sciences Lecture 3 Slide credits: Russ Salakhutdinov Announcements

More information

Tractable Nonparametric Bayesian Inference in Poisson Processes with Gaussian Process Intensities

Tractable Nonparametric Bayesian Inference in Poisson Processes with Gaussian Process Intensities Tractable Nonparametric Bayesian Inference in Poisson Processes with Gaussian Process Intensities Ryan Prescott Adams rpa23@cam.ac.uk Cavendish Laboratory, University of Cambridge, Cambridge CB3 HE, UK

More information

STAT Advanced Bayesian Inference

STAT Advanced Bayesian Inference 1 / 32 STAT 625 - Advanced Bayesian Inference Meng Li Department of Statistics Jan 23, 218 The Dirichlet distribution 2 / 32 θ Dirichlet(a 1,...,a k ) with density p(θ 1,θ 2,...,θ k ) = k j=1 Γ(a j) Γ(

More information

Statistical Analysis of Spatio-temporal Point Process Data. Peter J Diggle

Statistical Analysis of Spatio-temporal Point Process Data. Peter J Diggle Statistical Analysis of Spatio-temporal Point Process Data Peter J Diggle Department of Medicine, Lancaster University and Department of Biostatistics, Johns Hopkins University School of Public Health

More information

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes

Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Bayesian dynamic modeling for large space-time weather datasets using Gaussian predictive processes Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota,

More information

A Bayesian Perspective on Residential Demand Response Using Smart Meter Data

A Bayesian Perspective on Residential Demand Response Using Smart Meter Data A Bayesian Perspective on Residential Demand Response Using Smart Meter Data Datong-Paul Zhou, Maximilian Balandat, and Claire Tomlin University of California, Berkeley [datong.zhou, balandat, tomlin]@eecs.berkeley.edu

More information

The Expectation-Maximization Algorithm

The Expectation-Maximization Algorithm 1/29 EM & Latent Variable Models Gaussian Mixture Models EM Theory The Expectation-Maximization Algorithm Mihaela van der Schaar Department of Engineering Science University of Oxford MLE for Latent Variable

More information

Lecture 5: Spatial probit models. James P. LeSage University of Toledo Department of Economics Toledo, OH

Lecture 5: Spatial probit models. James P. LeSage University of Toledo Department of Economics Toledo, OH Lecture 5: Spatial probit models James P. LeSage University of Toledo Department of Economics Toledo, OH 43606 jlesage@spatial-econometrics.com March 2004 1 A Bayesian spatial probit model with individual

More information

Mean, Median, Mode, and Range

Mean, Median, Mode, and Range Mean, Median, Mode, and Range Mean, median, and mode are measures of central tendency; they measure the center of data. Range is a measure of dispersion; it measures the spread of data. The mean of a data

More information

How Accurate is My Forecast?

How Accurate is My Forecast? How Accurate is My Forecast? Tao Hong, PhD Utilities Business Unit, SAS 15 May 2012 PLEASE STAND BY Today s event will begin at 11:00am EDT The audio portion of the presentation will be heard through your

More information

Curve Fitting Re-visited, Bishop1.2.5

Curve Fitting Re-visited, Bishop1.2.5 Curve Fitting Re-visited, Bishop1.2.5 Maximum Likelihood Bishop 1.2.5 Model Likelihood differentiation p(t x, w, β) = Maximum Likelihood N N ( t n y(x n, w), β 1). (1.61) n=1 As we did in the case of the

More information

Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods

Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods Outline Modeling Ultra-High-Frequency Multivariate Financial Data by Monte Carlo Simulation Methods Ph.D. Student: Supervisor: Marco Minozzo Dipartimento di Scienze Economiche Università degli Studi di

More information

An Alternative Infinite Mixture Of Gaussian Process Experts

An Alternative Infinite Mixture Of Gaussian Process Experts An Alternative Infinite Mixture Of Gaussian Process Experts Edward Meeds and Simon Osindero Department of Computer Science University of Toronto Toronto, M5S 3G4 {ewm,osindero}@cs.toronto.edu Abstract

More information

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent

Latent Variable Models for Binary Data. Suppose that for a given vector of explanatory variables x, the latent Latent Variable Models for Binary Data Suppose that for a given vector of explanatory variables x, the latent variable, U, has a continuous cumulative distribution function F (u; x) and that the binary

More information

Pseudo-marginal MCMC methods for inference in latent variable models

Pseudo-marginal MCMC methods for inference in latent variable models Pseudo-marginal MCMC methods for inference in latent variable models Arnaud Doucet Department of Statistics, Oxford University Joint work with George Deligiannidis (Oxford) & Mike Pitt (Kings) MCQMC, 19/08/2016

More information

Analysing geoadditive regression data: a mixed model approach

Analysing geoadditive regression data: a mixed model approach Analysing geoadditive regression data: a mixed model approach Institut für Statistik, Ludwig-Maximilians-Universität München Joint work with Ludwig Fahrmeir & Stefan Lang 25.11.2005 Spatio-temporal regression

More information