Journal de la Société Française de Statistique Vol. 158 No. 2 (2017) Hierarchical Bayesian modeling for combining dates in archeological context

Size: px
Start display at page:

Download "Journal de la Société Française de Statistique Vol. 158 No. 2 (2017) Hierarchical Bayesian modeling for combining dates in archeological context"

Transcription

1 Journal de la Société Française de Statistique Vol. 158 No. 2 (2017) Hierarchical Bayesian modeling for combining dates in archeological context Titre: Modélisation hiérarchique bayésienne pour la combinaison de dates en archéologie Philippe Lanos 1 and Anne Philippe 2 Abstract: A Bayesian approach is proposed for combining dates from different dating methods used in archeology. This modeling provides an automatic way to penalize outlying data. Examples are provided from different archeological contexts and involving radiocarbon, luminescence and archaeomagnetic results. This new combination procedure is also applied to the wiggle-matching process in dendrochronological dating. Calculations are based on MCMC numerical techniques and can be performed using the cross-platform ChronoModel application which is free, open source software (FOSS). Résumé : Nous proposons un modèle Bayésien pour combiner des dates provenant de différentes méthodes de datation utilisées en archéologie. Cette modélisation fournit un moyen automatique de pénaliser les données aberrantes. Nous illustrons ses propriétés sur des données issues de différents sites archéologiques où des échantillons ont été datés par radiocarbone, archéomagnétisme ou luminescence. Nous montrons que ce modèle peut facilement s étendre au contexte de la dendrochronologie. Des algorithmes MCMC sont mis en oeuvre pour approcher les lois a posteriori. Ils sont disponibles dans le logiciel libre ChronoModel dont le code source est ouvert. Keywords: Bayesian statistics, ChronoModel software, individual errors, MCMC methods, outlier penalization. Mots-clés : Statistique Bayésienne, logiciel ChronoModel, erreurs individuelles, algorithmes MCMC, pénalisation de valeurs aberrantes. AMS 2000 subject classifications: 62F15, 62F35, 62P25 1. Introduction Many dating methods are available to learn about the age of archeological artifacts. The choice of the method generally depends on the nature of the object and its age (see Aitken, 2013 for a detailed review). Radiocarbon, luminescence, and archaeomagnetic dating are probably the most commonly used methods. Radiocarbon dating (or 14C dating) is used to evaluate the ages of biological specimens (e.g. charcoals, wood artifacts, bone remains, etc.). It is possible to date objects as old as around years. Many statistical papers are devoted to this method and software applications are available to analyze and model the radiocarbon data (see Buck et al., 1999; Ramsey and Lee, 2013; Ramsey, 2009a). Luminescence dating (TL/OSL) is based on the radiation absorbed and stored in the crystal lattice of minerals such as quartz. The calculated age is the elapsed time since the last exposure to sunlight or intense heat. Archaeomagnetic dating (AM) relies on the past variations of the Earth s magnetic field. The ferromagnetic minerals, heated to high temperatures, acquire a remnant magnetization with a direction parallel to, and an intensity proportional to, the local Earth s magnetic field at the time of cooling. The 1 CNRS IRAMAT-CRPAA, Université Bordeaux-Montaigne and Géosciences-Rennes, Université Rennes 1. philippe.lanos@univ-rennes1.fr 2 Laboratoire de Mathématiques Jean Leray and ANJA-Inria Rennes, 2 Rue de la Houssinière BP 92208, Nantes Cedex 3, France anne.philippe@univ-nantes.fr [corresponding author]

2 Hierarchical Bayesian modeling for combining dates in archeological context 73 method is implemented for some geographical area where variations of the Earth s magnetic field are known. It allows the last heating of baked clays to be dated. One important question in archeology is the estimation of the date of an archeological event that is associated with a set of contemporaneous artifacts. This problem comes up frequently when constructing chronologies in archeology. Each artifact of the event is dated, and so we collect a sample of observations provided by one or several dating methods. This leads to the issue of combining measurements in order to define the event date. The simplest statistical model is defined as n independent measurements M 1,...,M n assumed to have the same unknown mean µ. The parameter µ is in turn related to calendar time via so-called calibration curve. We denote as s 2 i the experimental variance on each measurement M i, that is supposed known and evaluated by the laboratory during the measurement process. To summarize, we write M i = µ + s i ε i, i = 1,...,n (1) where ε 1,...,ε n are n independent identically distributed Gaussian random variables with zero mean and variance 1. The maximum likelihood estimate of µ (Ward and Wilson, 1978) is given by ˆµ n = n i=1 n i=1 M i s 2 i 1 s 2 i. (2) The measurements M i with high variance s 2 i are penalized, and thus they contribute less to the estimation of the mean µ. In Galbraith et al. (1999), this model is named the "common age model" and is applied for combining paleodoses in the luminescence dating method. This method is also implemented for combining 14C ages (see Ramsey, 2009a). To take into account individual effects, we can add a random effect on the parameter µ as follows: M i = µ i + s i ε i (3) µ i = µ + σλ i, where λ 1,...,λ n,ε 1,...,ε n are 2n independent and identically distributed Gaussian random variables with zero mean and variance 1. Error σλ i represents the uncertainty between the measurements and the event µ due to sampling (representativeness) problems of unknown origin which are not related to the measurement process in the laboratory. This model is named the "central Age model" in Galbraith et al. (1999). An explicit form of the likelihood estimate is not available. Alternatively, a Bayesian approach can be adopted to estimate the parameters µ and σ 2 of this hierarchical model. It is thus necessary to choose a prior distribution on (µ,σ 2 ). This choice is discussed for instance in Congdon (2010) or Spiegelhalter et al. (2004) in the particular case of meta-analysis. In archeology, dating laboratories might provide measurements for a 14C age, a paleodose measurement (TL/OSL), an inclination, a declination or an intensity of the geomagnetic field (AM).

3 74 P. Lanos and A. Philippe The laboratory measurements are then converted into calendar dates using a calibration curve (see Section 2). This step must be added to the combination model. We thus propose to extend the model with the random effect defined in (3) by adding a calibration step, and including individual effects on the variance by replacing σ by σ i. The inclusion of individual effects is motivated by the fact that each measurement can be affected by irreducible errors (Christen, 1994) which can come from different sources such as: 1. The way of ensuring that the samples studied can realistically provide results for the events that we wish to characterize (measurement or date) 2. The care taken in sampling in the field, 3. The care taken in sample handling and preparation in the laboratory, 4. Other non-controllable random factors that can appear during the process. The rest of the paper is organized in three sections. Section 2 is devoted to the Bayesian calibration of measurements and the combination of dates. In Section 3, we describe our hierarchical Bayesian model for combining measurements in the context of dating problems and define an "event model to estimate a date for contemporary artifacts. Section 4 provides an application to wiggle-match dating of tree-ring sequences. Remark 1. We define each Bayesian model using a directed acyclic graph (DAG). This graph describes the dependencies in the joint distribution of the probabilistic model. Each random variable of the model (that is an observation or a parameter) appears as a node in the graph. Any node is conditionally independent of its non-descendents given its parents. Nodes represented by circles correspond to the random variables of the model. With the color of the circles, we distinguish between observations (red) and parameters (blue). The green squares indicate exogenous variables. 2. Calibration and linked models In this section we describe two standard Bayesian models: the individual calibration of a measurement provided by a dating laboratory, the combination of measurements performed on the same artifact using the same dating method Calibration The simplest problem is the calibration of an individual measurement M in calendar time t. The measure M has a Gaussian distribution with mean µ and known variance s 2. Following a hierarchical model, the variable µ has a Gaussian distribution with mean g(t) and variance σ 2 g (t), where g is a function called "calibration curve" linking the measurement to calendar time t. Every dating method has its own calibration curve. For instance, the curve IntCal13 (Reimer et al., 2013) converts a radiocarbon Age in calendar date for the Northern Hemisphere atmospheric samples. The calibration of 14C ages is detailed by Ramsey (2009a); Buck et al. (1996); Litton and Buck (1995). In archaeomagnetism the secular variation curves of the Earth s magnetic field are used to convert an inclination, declination or intensity measurement to a calendar date (see Lanos, 2004). In the case of an age M provided by luminescence (TL or OSL), the calibration function is merely a linear function g(t) = (t 0 t) where t 0 is the determination year of the age measurement M in the laboratory. The construction of the calibration curve depends on the dating method. In the context of OSL dating the calibration curve comes from a physical equation, and so σ g is assumed to be null. In radiocarbon or

4 Hierarchical Bayesian modeling for combining dates in archeological context 75 archaeomagnetic dating methods, the curve comes from an estimation step (e.g. a non linear regression on a set of dated reference measurements). In this case σ g corresponds to the errors due to the estimation method. Note that these curves are regularly updated according to the improvement of the reference data. The Bayesian model for calibration or conversion of a measurement M to calendar date t is the following. The model on the measurement M is given by M = µ + sε, where µ is the true value of the measurement and s 2 is the known variance. The distribution of ε is the standard Gaussian distribution. The calibration step converts µ to calendar date t, using the relation µ = g(t) + σ g (t)ρ, where both functions g and σ g are assumed known, and where ρ is a standard Gaussian random variable. Let T be the time range of interest. This interval is fixed from prior information on the historical period to which the event belongs. We choose the uniform distribution on T as prior distribution on the parameter t, p(t) 1 T (t). (4) If we integrate the posterior distribution of (t, µ) with respect to latent variable µ, we get the posterior distribution of t (up to a multiplicative constant): p(t M) 1 ( ) 1 S(t) exp 2S 2 (M g(t))2 1 T (t), (5) (t) where S(t) 2 = s 2 + σ 2 g (t). (6) Figures 1, 2 and 3 illustrate the calibration process for different calibration curves. In many cases, the individual calibration provides an estimation of the date with a high uncertainty. The posterior distribution is often multi-modal or unimodal with large variance. This motivates the archeologist to repeat measurements on different contemporaneous artifacts using one or several dating methods Calibration from multiple measurements We observe m independent measurements M k performed on the same object. We assume that all the measurements can be calibrated with the same curve (g,σ 2 g ). This appears, for example, in the case of radiocarbon dating when the same object is analyzed by different laboratories. In this case, the measurements have to be combined before calibration (see Ward and Wilson, 1978 and Ramsey, 2009a). The Bayesian model (Fig. 4) is defined by the following distributions: M i µ N (µ, s 2 i ) µ t N (g(t), σ 2 g (t)) t Unif(T ), i = 1,...,m

5 76 P. Lanos and A. Philippe FIGURE 1. Conversion of a 14C age (A = 1000 ± 30 BP) to a calendar date via the calibration curve IntCal13. FIGURE 2. Conversion of a TL age (A = 900 ± 50 ) to a calendar date through the linear transformation g(t) = (2000 t). FIGURE 3. Conversion of an inclination measurement (I = 59 ± 1) to a calendar date via the calibration curve of archaeomagnetic field in France (Paris) over the last two millennia.

6 Hierarchical Bayesian modeling for combining dates in archeological context 77 where T is the time range of interest. This model is called R-Combine in Ramsey (2009a). One can easily get the marginal posterior density of t, which is given by p(t M 1,...,M m ) 1 ( ) 1 S m (t) exp 2 S m (t) 2 (M m g(t)) 2 1 T (t), where S m (t) 2 = s 2 m + σ 2 g (t) with 1 s 2 m = m k=1 1, s 2 k and where M m = m k=1 M k s 2 k / m k=1 1. s 2 k The R-combine model is equivalent to the individual calibration of the observation (M m,s 2 m) using the process described in Section 2.1. t µ s 2 i M i i = 1 to m FIGURE 4. DAG of the R-Combine model. 3. Event model In the general case we observe n measurements M i such that each measurement provides a dating through a calibration step defined by a calibration function g i and its error σ gi. The R-combine model is no longer valid in this case because it requires a common calibration curve (i.e. g i = g for all i = 1,...,n). Our idea is to adapt the Bayesian combination of measurements to estimate the date of an archeological event from the individual dating of contemporaneous artifacts The model. We describe the so-called Event model to estimate a date θ from n measurements M i provided by different dating methods. We assume that each measurement M i is related to an individual date t i through a calibration curve g i. Here this curve is assumed known with some known uncertainty. The main assumption in our Event model is the contemporaneity of the dates t i, i = 1...,n with the event date θ. We assume that θ T where T is the bounded interval corresponding to the range of study.

7 78 P. Lanos and A. Philippe In this context the model with random effect given by (3) can be rewritten as follows M i = µ i + s i ε i, µ i = g i (t i ) + σ gi (t i )ρ i, t i = θ + σ i λ i, (7) where (ε 1,...ε n,ρ 1,...,ρ n,λ 1,...,λ n ) are independent and identically distributed Gaussian random variables with zero mean and variance 1. The random variables (λ i ) i and (ε i ) i are interpreted as follows : σ i λ i represents the irreducible error between t i and θ due to sampling problems external to the laboratory ( Section 1), s i ε i + σ gi (t i )ρ i represents the experimental error provided by the laboratory and the calibration step. θ σ 2 i t i s 2 i µ i M i i = 1 to n FIGURE 5. DAG for the hierarchical Event model applied to dating combination with calibration. According to the DAG defining the event model (Fig. 5), the joint distribution of the probabilistic model can be written in the form p(m 1,...,M n, µ 1,..., µ n,t 1,...,t n,σ 2 1,...,σ 2 n,θ) = p(θ) where the conditional distributions that appear in the decomposition are given by M i µ i N (µ i, s 2 i ) n i=1 µ i t i N (g i (t i ), σ 2 g i (t i )) p(m i µ i )p(µ i t i )p(t i σ 2 i,θ)p(σ 2 i ), (8) t i σi 2,θ N (θ, σi 2 ) (9) σi 2 Shrink(s 2 0) (10) θ Unif(T ). (11)

8 Hierarchical Bayesian modeling for combining dates in archeological context 79 The density of the uniform shrinkage distribution with parameter s 2 0 (denoted Shrink(s2 0 )), that appears in (10), is given by p(σ 2 i ) = s 2 0 (s σ 2 i )2. (12) Note that this form of density implies that the random variable s 2 0 /(σ 2 + s 2 0 ) is uniformly distributed on [0,1]. This distribution is rather diffuse in the sense that the variance and mean are infinite. So it can be considered weakly informative. The properties of the uniform shrinkage prior and the choice of s 2 0 are discussed in Daniels (1999). In the particular case of the central age model defined in (3), Spiegelhalter et al. (2004) suggests the following choice of parameter: 1 s 2 = 1 0 n n i=1 Parameter s 2 0 quantifies the magnitude of error on the measurements. As s2 0 is the median of the uniform shrinkage prior, this choice ensures that the parameter σi 2 has the same prior probability to be smaller or larger than s 2 0. Therefore we do not favor the measurement errors with respect to the error between t i and θ due to sampling problems. With calibrated measurements, the parameter s 2 0 cannot be calculated directly from the variances s2 i. Indeed the measurement errors s i are not necessarily homogeneous units (see for instance the case of archaeomagnetism combined with 14C). Moreover they do not contain the information on the variance of the combined variables. To adapt this strategy we have to estimate the variance of the dates t i. We propose to estimate these variances after the step of individual calibration. We proceed in the following way, for each i = 1,...,n: 1. An individual calibration step is performed for each measurement M i 1. (a) compute the posterior distribution of t i (using (5)) (b) approximate the posterior variance w 2 i = var(t i M i ) 2. Take as shrinkage parameter s 0 : 1 s 2 = 1 0 n Remark 2. For the hyperparameters σi 2 in the third stage of the hierarchical model, the choice of a diffuse noninformative prior may be problematic as improper priors may induce improper posteriors. This problem appears in our model, for instance by taking p(σ i ) 1/σi 2, that is the classical non informative prior (called the Jeffreys prior) for Gaussian observations. The choice of diffuse priors in such models raises particular issues, discussed for instance in Congdon (2010). It is always possible to choose a proper probability distribution which approximates the diffuse prior, for instance a density proportional to the Jeffreys prior truncated on an closed interval [a,b] ]0, [, an inverse Gamma distribution with small scale and shape parameters. However, such priors may cause identifiability problems as the posteriors are close to being empirically improper. Moreover the inference of the parameter of interest is sensitive to the choice of parameters in the proper prior distribution. This is a major drawback for small samples. s 2 i n i=1 1. w 2 i 3.2. MCMC algorithm. The posterior distribution of the parameter of interest θ can not be obtained explicitly. It is necessary to implement a computational method to approximate the posterior distribution, its quantiles, the Bayes

9 80 P. Lanos and A. Philippe estimates and the highest posterior density (HPD) regions. We adopt a MCMC (Markov Chain Monte Carlo) algorithm known as the Metropolis-within-Gibbs strategy because the full conditionals cannot be simulated by standard random generators. For each parameter, the full conditional distribution is proportional to (8). 1. For the parameter of interest θ we identify a truncated Gaussian distribution on the period of interest T. Such a distribution can be simulated using rejection sampling. Different choices of proposal distribution are possible, such as the Gaussian distribution or the truncated Laplace (double exponential) distribution on T. It is also possible to use an adaptive random walk Metropolis- Hastings (MH) with a Gaussian proposal distribution. 2. The density of the full conditional distribution of σi 2 is explicitly computable up to an unknown multiplicative constant, but it is not a standard distribution. Therefore it is simulated using an adaptive random walk MH with a Gaussian proposal distribution on the variable log(σi 2). 3. The full conditional distribution of t i, i = 1,...,n, is proportional to { } { } S i (t i ) exp 2Si 2(t i) (M i g i (t i ) 2 exp 2σi 2 (t i θ) 2 ), where S i (t i ) is defined in (6). We can choose an adaptive random walk MH with a Gaussian proposal. However, the random walk solution is not necessarily the most efficient choice because the target distribution can be multimodal. We are frequently confronted with this problem as shown by, for instance, the results yielded by archaeomagnetic dating in Example 2. In this context, an alternative is to choose an independent Hasting-Metropolis algorithm with a proposal distribution that mimics the individual calibration density defined in (5). This ensures that all the possible values of t i can be visited when the calibrated date distribution is multimodal. These algorithms are implemented in the cross-platform ChronoModel application (Lanos et al., 2016; Vibet et al., 2016), which is free and open source software. In the examples discussed below, the graphics summarizing the numerical results are performed using ChronoModel software. We represent the marginal densities of the parameter of interest θ (on gray background) the individual measurements t i (on white background) the individual standard deviations σ i For each density, the bar above the density represents the shorter 95% posterior probability interval. The vertical lines, delimiting the colored area under the density curve, indicate the endpoints of the 95% HPD region. For a unimodal posterior density, the 95% posterior probability regions coincide. Different graphical tools are implemented to assess the convergence of the MCMC in ChronoModel software (e.g. the autocorrelation functions, the acceptance rate of Metropolis-Hasting algorithms). The user can adjust the length of burn-in, the maximum number of iterations for adaptation and for acquisition, and the thinning rate. Moreover multiple chains can be simulated and exported for further analysis using, for instance, the R package coda. In term of computational performance, among the examples given in this paper, the longest computing time is achieved for Ex. 2, Indeed 10 6 iterations are required to well estimate the multimodal posterior distribution of the Event. The simulation is performed on a 2 GHz Intel Core i7 by using a single core. The computational time is less than 1 minute including the post-processing i.e. estimation of HPD regions, credibility regions, posterior densities, etc from simulated Markov chain, and displaying results.

10 Hierarchical Bayesian modeling for combining dates in archeological context Examples Example 1. Mont-Saint-Michel (Normandy, France) FIGURE 6. Mont-Saint-Michel, Ex. 1. Posterior density of the event date θ (gray background). Posterior densities of t i (blue line & white background) and individual posterior calibrated densities (gray line & white background) obtained for TL dates and for 14 C dates. An archeology building study has been conducted at the Mont-Saint-Michel site in Normandy, France (Blain et al., 2007; Sapin et al., 2008). The aim of this study was to estimate the dates of different building states of the Carolingian church Notre-Dame-sous-Terre (NDST) located inside the Mont-Saint-Michel abbey. Therefore it is reasonable to fix the time range T equal to [0, 2000], which widely includes the Carolingian period. In what follows, we model building state number 1 which is associated with 14C analysis on 3 charcoals, and luminescence analyses of 8 bricks. Figures 6 and 7 summarize the estimation results obtained by the event model. The 95% HPD interval for the date of building state 1 is [892 ; 993]. This result is more precise than the dating obtained in Blain et al. (2007), which is based solely on luminescence analysis. This result confirms the value of combining different dating methods. Figure 6 provides a comparison between the individual calibrations of each measurement and the posterior densities of the dates t i. Clearly the event model improves the precision of the dating of each artifact included in the event. The graphical comparison of the posterior densities of t i confirms our assumption that the bricks and charcoals are contemporary. Posterior densities for standard deviations σ i fall within the small range [0,200] at 95% (Fig. 7). These results confirm that the dates t i are contemporary.

11 82 P. Lanos and A. Philippe FIGURE 7. Mont-Saint-Michel, Ex. 1 (Cont.). Posterior densities obtained for standard deviations σ i. Example 2. Cuers (Provence, France), medieval or modern lime kiln FIGURE 8. Cuers, Ex. 2. Posterior density of the event date θ (gray background). Posterior densities of t i (red line & white background) and individual posterior calibrated densities (gray line & white background) obtained for archaeomagnetic and 14 C dates. Archeological excavation was carried out to estimate the last firing date of a lime kiln in Cuers (Provence, France Vaschalde et al., 2014). We choose the time range T equal to [0, 2000]. Indeed no historical or archeological information is available about this site between the Roman period and the 20th century. The studied artifacts are pieces of baked clay from the kiln wall submitted for AM analysis and two charcoals submitted for 14C analysis. The obtained measurements are three archaeomagnetic parameters (inclination, declination and intensity) and two radiocarbon ages. Figure 8 gives the results obtained by the event model. As in the previous example, posterior densities t i (in red) are much more precise than the individual calibrated densities, in the sense that the number of local modes is reduced. The Event model gives a 95% HPD region for the last firing date which is the union of two disjoint intervals [1388,1548] and [1556,1616]. In this case the dating is indeterminate in the sense that two periods remain possible

12 Hierarchical Bayesian modeling for combining dates in archeological context 83 FIGURE 9. Cuers, Ex 2 (Cont.) Posterior densities obtained for standard deviations σ i. for the last firing. Consequently, additional measurements or prior information are required to decide between these two solutions. Figure 9 gives the posterior densities of standard deviations σ i. It clearly shows that this parameter takes higher values in the case of archaeomagnetic dating. This indicates a lack of consistency between the dates within the event. The archaeomagnetic dates are penalized in the estimation of the event. This is explained by the fact that radiocarbon dating provides more accurate dates after the calibration step. Example 3. Tell Qasile, context X (Israel) FIGURE 10. Tell Qasile, Ex. 3. [left] Posterior density for Event date θ (gray background). Posterior densities t i for 14 C dates (blue line and white background) The individual posterior calibrated densities are superimposed in gray. [right] Posterior densities obtained for standard deviations σ i. We consider the example studied in Ramsey (2009b), in order to compare the robustness to outliers of the event model with the R-combine model with the outlier implemented in OxCal software.

13 84 P. Lanos and A. Philippe From eleven radiocarbon dates, the aim is to determine the date of the context X in Tell Qasile, an archeological site in Tel Aviv. Since the site belongs to the protohistoric period, we fix the time range T equal to [ 2000, 0]. In OxCal, it is necessary to fix the prior probability that each measurement is an outlier. The recommended value is 5% when no pertinent information is available. The 95% HPD region for the date of the context X yielded by OxCal is [ 1054; 970] [ 962; 934]. The event model gives a uni-modal posterior density and 95% HPD interval equal to [ 1050; 951] (Fig. 10). This is very similar to the two merged OxCal intervals. Posterior densities for standard deviations σ i are very similar (Fig. 10) except for samples QS2 and QS6 which show higher posterior values, and thus appear to be outliers. The same two outliers are also detected by OxCal. In conclusion, the event model is robust to outliers and has the advantage that it does not require prior information about the outliers. The ability of the individual variance σi 2 to take large values automatically penalizes an outlier. 4. Wiggle-matching The "wiggle-matching" model combines radiocarbon dating and dendrochronology. Radiocarbon dating is carried out on tree-ring samples separated by a known number of tree-rings. This gives prior information on the calibrated dates t i. The number of years between these dates is then known (Manning et al., 2010; Galimberti and Ramsey, 2004; Christen and Litton, 1995). In this case, the calibrated dates t i should be shifted according to their relationship to the event date θ. So we adapt our event model to wiggle-matching as follows. We consider that the event date θ corresponds to the date of a chosen reference tree-ring (for instance the oldest tree-ring, see Example 4). We denote by δ i the number of years between t i and θ, which is fixed by counting the number of rings between them and assuming that one ring is equal to one year. By convention, δ i is positive (resp. negative) when t i is older (resp. younger) than θ. Equation (7) can be rewritten as follows t i = θ δ i + σ i λ i. (13) Remark 3. It is also possible to assume δ i unknown in order to model a counting error in the number of tree-rings. This extension of the model is implemented in chronomodel software. Example 4. Gordion Juniper dendrochronology (Central Anatolia) An application of the Event wiggle-matching model is presented here in the case of the Gordion Juniper dendrochronology (Manning and Kromer, 2011, table 1). Thirty-five samples of this sequence, from relative tree-rings centered at have been dated by the Heidelberg radiocarbon laboratory. The time range T is fixed equal to [ 5000, 0], the lack of prior information leads to the choice of a very large interval. The samples are calibrated with IntCal04.14c curve (Reimer et al., 2004) and are separated with known gaps taking values between 1 and 19 years over a range of 249 years. δ i is the gap between the dated tree-ring and reference. Following Manning and Kromer (2011), we fix as reference, the oldest tree-ring i.e. δ 1 = 0. The model considered in Manning and Kromer (2011) is implemented in OxCal, by using the D-Sequence and Gap functions with the outlier model. It gives a 95% HPD interval equal to [-1734, -1724].

14 Hierarchical Bayesian modeling for combining dates in archeological context 85 θ σ 2 i δ i t i s 2 i µ i M i i = 1 to n FIGURE 11. DAG for the wiggle matching model. The Event model gives a 95% HPD interval for θ equal to [-1744, -1719], which is less precise than the estimate yielded by OxCal. The difference in the 95% HPD region is due to the event structure, which increases the variance of the posterior distribution. However our approach brings robustness. As an illustration, we artificially modify the dataset by adding outliers with the same experimental variances on the 14C ages (see Table 1). Figure 12 gives the estimation obtained by the event model for: the original Gordion dataset analyzed in Manning and Kromer (2011), the same dataset contaminated with 11 outliers. TABLE 1. Gordion Juniper dendrochronology (Central Anatolia). Contaminated samples in Gordion dataset sample number modified 14C age (BP) with Manning and Kromer (2011) notations 20144, , 25792, , 20141, 20147, 25793, 20153, Figure 12 shows that the posterior distribution of the event date is very weakly sensitive to the presence of these outliers. Indeed, on the contaminated sample, the event model gives an 95% HPD interval for θ equal to [-1749 ; -1717]. The two results are quite similar; the event date is not affected by the presence of the outliers. The event model considered in Manning and Kromer (2011) cannot be estimated using OxCal software because of poor agreement indices. This alert message indicates in particular that the convergence of the MCMC is not guaranteed.

15 86 P. Lanos and A. Philippe FIGURE 12. Gordion juniper dendrochronology (Central Anatolia). Posterior densities of the dates t i (solid line and white background), the shifted dates t i + δ i (dotted line and white background) and the Event date θ (gray background) obtained on original Gordion dataset (blue) and on a contaminated version with 11 outliers defined in Table 1 (in red).

16 Hierarchical Bayesian modeling for combining dates in archeological context 87 Perspective A combination procedure to estimate the date of an archeological event from a set of contemporaneous artifacts using a hierarchical Bayesian approach is proposed. The event model defines a fundamental chronological entity that can be related to other entities in various ways to produce complex chronological models. We can then construct chronologies of events which take into account new archeological information such as ordering constraints based on stratigraphy, phasing with succession or with a hiatus between phases, or with a duration constraint on the phase, etc. These features are implemented in the ChronoModel software. Acknowledgement The authors are extremely grateful to Thomas S. Dye for his careful reading and his insightful comments that helped to improve the exposition in the manuscript. This project is supported by the grant ANR-11-MONU-007 ChronoModel. Acknowledgement The authors are extremely grateful to Thomas S. Dye for his careful reading and his insightful comments that helped to improve the exposition in the manuscript. This project is supported by the grant ANR-11-MONU-007 ChronoModel. References Aitken, M. J. (2013). Science based dating in archeology. Routleedge. Blain, S., Guibert, P., Bouvier, A., E.Vieillevigne, Bechtel, F., Sapin, C., and Baylé., M. (2007). TL-dating applied to building archaeology: The case of the medieval church Notre-Dame-Sous-Terre (Mont-Saint-Michel, France). Radiation Measurements, 42(9): Buck, C., Christen, J., and James, G. (1999). BCal : an on-line Bayesian radiocarbon calibration tool. Internet Archaeology, 7. Buck, C., Litton, C., and Cavanagh, W. G. (1996). The Bayesian Approach to Interpreting Archaeological Data. Chichester. Christen, J. and Litton, C. (1995). A Bayesian approach to wiggle-matching. Journal of Archaeological Science, 22(6): Christen, J. A. (1994). Summarizing a set of radiocarbon determinations: a robust approach. Applied Statistics, 43(3): Congdon, P. D. (2010). Applied Bayesian hierarchical methods. CRC Press, Boca Raton, FL. Daniels, M. J. (1999). A prior for the variance in hierarchical models. Canad. J. Statist., 27(3): Galbraith, R. F., Roberts, R. G., Laslett, G. M., Yoshida, H., and Olley, J. M. (1999). Optical dating of single and multiple grains of quartz from Jinmium rock shelter, Northern Australia: Part i, experimental design and statistical models. Archaeometry, 41(2): Galimberti, M. and Ramsey, C. B. (2004). Wiggle-match dating of tree-ring sequences. Radiocarbon 46(2): Lanos, P. (2004). Bayesian inference of calibration curves: Application to archaeomagnetism. In C.E. Buck and A.R. Millard, editors, Tools for Constructing Chronologies, volume 177, pages Lecture Notes in Statistics, Springer-Verlag. Lanos, P., Philippe, A., Lanos, H., and Dufresne, P. (2016). Chronomodel : Chronological modelling of archaeological data using Bayesian statistics. (version 1.5). Litton, C. D. and Buck, C. E. (1995). The Bayesian approach to the interpretation of archaeological data. Archaeometry, 37(1). Manning, S., Kromer, B., Ramsey, C. B., Pearson, C., Talamo, S., Trano, N., and Watkins, J. (2010). 14C record and wiggle-match placement for the Anatolian (Gordion Area) Juniper tree-ring chronology 1729 to 751 cal BC, and typical Aegean/Anatolian (growing season related) regional 14C offset assessment. Radiocarbon, 52(4). Manning, S. W. and Kromer, B. (2011). Radiocarbon dating archaeological samples in the eastern mediterranean, 1730 to 1480 bc: further exploring the atmospheric radiocarbon calibration record and the archaeological implications. Archaeometry, 53(2):

17 88 P. Lanos and A. Philippe Ramsey, C. B. (2009a). Bayesian analysis of radiocarbon dates. Radiocarbon, 51(1): Ramsey, C. B. (2009b). Dealing with outliers and offsets in radiocarbon dating. Radiocarbon, 51(3): Ramsey, C. B. and Lee, S. (2013). Recent and planned developments of the program OxCal. Radiocarbon, 55: Reimer, P., Bard, E., Bayliss, A., Beck, J., Blackwell, P., Ramsey, C. B., Buck, C., Cheng, H., Edwards, R. L., Friedrich, M., Grootes, P., Guilderson, T., Haflidason, H., Hajdas, I., Hatté, C., Heaton, T., Hoffmann, D., Hogg, A., Hughen, K., Kaiser, K., Kromer, B., Manning, S., Niu, M., Reimer, R., Richards, D., Scott, E., Southon, J., Staff, R., Turney, C., and van der Plicht, J. (2013). Intcal13 and marine13 radiocarbon age calibration curves 0-50,000 years cal bp. Radiocarbon, 55(4). Reimer, P. J., Baillie, M. G. L., Bard, E., Bayliss, A., Beck, J. W., Bertrand, C. J. H., Blackwell, P. G., Buck, C. E., Burr, G. S., Cutler, K. B., Damon, P. E., Edwards, R. L., Fairbanks, R. G., Friedrich, M., Guilderson, T. P., Hogg, A. G., Hughen, K. A., Kromer, B., McCormac, G., Manning, S., Ramsey, C. B., Reimer, R. W., Remmele, S., Southon, J. R., Stuiver, M., Talamo, S., Taylor, F. W., van der Plicht, J., and Weyhenmeyer, C. E. (2004). Intcal04 terrestrial radiocarbon age calibration, 0-26 cal kyr bp. Radiocarbon, 46(3): Sapin, C., Bayle, M., Buttner, S., Guibert, P., Blain, S., Lanos, P., Chauvin, A., Dufresne, P., and Oberlin, C. (2008). Archeologie du bati et archeometrie au Mont-Saint-Michel, nouvelles approches de Notre-Dame-Sous-Terre. Archeologie Medievale, 38: Spiegelhalter, D. J., Abrams, K. R., and Myles, J. P. (2004). Bayesian approaches to clinical trials and health-care evaluation. Wiley, Chichester. Vaschalde, C., Hervé, G., Lanos, P., and Thiriot, J. (2014). La datation des structures de cuisson: intégration de l archéomagnétisme et du radiocarbone, apports de l anthracologie. Archéologie Médiévale, 44:1 16. Vibet, M.-A., Philippe, A., Lanos, P., and Dufresne, P. (2016). Chronomodel user s manual v Ward, G. K. and Wilson, S. R. (1978). Procedures for comparing and combining radiocarbon age determinations: a critique. Archaeometry, 20(1):19 31.

Statistique Bayesienne appliquée à la datation en Archéologie

Statistique Bayesienne appliquée à la datation en Archéologie Statistique Bayesienne appliquée à la datation en Archéologie Anne Philippe Travail en collaboration avec Marie-Anne Vibet ( Univ. Nantes) Philippe Lanos (CNRS, Bordeaux) A. Philippe Chronomodel 1 / 24

More information

Bayesian modelling applied to dating methods

Bayesian modelling applied to dating methods Bayesian modelling applied to dating methods Anne Philippe Laboratoire de mathématiques Jean Leray Université de Nantes, France Anne.Philippe@univ-nantes.fr Mars 2018, Muséum national d Histoire naturelle

More information

Plan. Bayesian modelling applied to archaeology for users of Chronomodel and ArcheoPhase. Bayesian approach to Interpreting Archaeological Data

Plan. Bayesian modelling applied to archaeology for users of Chronomodel and ArcheoPhase. Bayesian approach to Interpreting Archaeological Data Plan Curso de Métodos Cronométricos, bercrono, Barcelona, 20-22 de Octubre Bayesian modelling applied to archaeology for users of and ArcheoPhase Anne Philippe & Marie-Anne Vibet - Laboratoire de mathématiques

More information

Event date model: a robust Bayesian tool for chronology building

Event date model: a robust Bayesian tool for chronology building Communications for Statistical Applications and Methods 208, Vol. 25, No. 2, 3 57 https://doi.org/0.29220/csam.208.25.2.3 Print ISSN 2287-7843 / Online ISSN 2383-4757 Event date model: a robust Bayesian

More information

FORMAL STATISTICAL MODELS FOR ESTIMATING RADIOCARBON CALIBRATION CURVES

FORMAL STATISTICAL MODELS FOR ESTIMATING RADIOCARBON CALIBRATION CURVES RADIOCARBON, Vol 46, Nr 3, 004, p 1093 110 004 by the Arizona Board of Regents on behalf of the University of Arizona FORMAL STATISTICAL MODELS FOR ESTIMATING RADIOCARBON CALIBRATION CURVES C E Buck 1

More information

2014 by the Arizona Board of Regents on behalf of the University of Arizona

2014 by the Arizona Board of Regents on behalf of the University of Arizona Radiocarbon, Vol 56, Nr, 014, p 877 881 DOI: 10.458/56.16946 014 by the Arizona Board of Regents on behalf of the University of Arizona RADIOCARBON DISTANCE BETWEEN CALENDAR DATES Adam Walanus AGH University

More information

Centre for Archaeological Research, University of Auckland, Private Bag 92019, Auckland, New Zealand.

Centre for Archaeological Research, University of Auckland, Private Bag 92019, Auckland, New Zealand. RADIOCARBON, Vol 43, Nr 1, 2001, p 119 124 2001 by the Arizona Board of Regents on behalf of the University of Arizona RESERVOIR OFFSET MODELS FOR RADIOCARBON CALIBRATION Martin Jones Centre for Archaeological

More information

DEVELOPMENTS IN THE CALIBRATION AND MODELING OF RADIOCARBON DATES

DEVELOPMENTS IN THE CALIBRATION AND MODELING OF RADIOCARBON DATES DEVELOPMENTS IN THE CALIBRATION AND MODELING OF RADIOCARBON DATES Christopher Bronk Ramsey 1 Michael Dee 1 Sharen Lee 1 Takeshi Nakagawa 2 Richard A Staff 1 ABSTRACT. Calibration is a core element of radiocarbon

More information

Chronological Modelling : some examples with ChronoModel

Chronological Modelling : some examples with ChronoModel 1 / 28 Chronological Modelling : some examples with ChronoModel Marie-Anne Vibet Anne Philippe Philippe Lanos 2 / 28 ChronoModel software Tools for constructing chronologies Based on the Event model 1

More information

Radiocarbon dating. Physical age determinations using natural radionuclides

Radiocarbon dating. Physical age determinations using natural radionuclides Laboratory for Ion Beam Physics Prof. Dr. Hans-Arno Synal +41 44 633 20 27 synal@phys.ethz.ch Vorlesung Analytische Strategie STRATEGISCHE ÜBUNG: Radiocarbon Dating HCI-J2 HS 2016 Radiocarbon dating Physical

More information

First modelling with ChronoModel (Part I)

First modelling with ChronoModel (Part I) Constructing chronologies with ChronoModel Practical Part Anne Philippe Marie-Anne Vibet Collaboration with Philippe Lanos First modelling with ChronoModel (Part I) Creating a simple model Including measurements

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate

More information

Dealing with Outliers and Offsets in Radiocarbon Dating

Dealing with Outliers and Offsets in Radiocarbon Dating Dealing with Outliers and Offsets in Radiocarbon Dating Christopher Bronk Ramsey Research Laboratory for Archaeology, University of Oxford, Dyson Perrins Building, South Parks Road, Oxford, OX1 3QY February

More information

Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting

Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting Construction of an Informative Hierarchical Prior Distribution: Application to Electricity Load Forecasting Anne Philippe Laboratoire de Mathématiques Jean Leray Université de Nantes Workshop EDF-INRIA,

More information

New Dates on Scioto Hopewell Sites: A SCHoN Project Kevin C. Nolan, Mark Seeman, and Mark A. Hill

New Dates on Scioto Hopewell Sites: A SCHoN Project Kevin C. Nolan, Mark Seeman, and Mark A. Hill New Dates on Scioto Hopewell Sites: A SCHoN Project As part of a larger project, Scale and Community in Hopewell Networks (SCHoN), we submitted a series of 19 dates from seven Scioto Valley Hopewell sites.

More information

Computational statistics

Computational statistics Computational statistics Markov Chain Monte Carlo methods Thierry Denœux March 2017 Thierry Denœux Computational statistics March 2017 1 / 71 Contents of this chapter When a target density f can be evaluated

More information

DEVELOPMENT AND APPLICATION OF THE TRAPEZOIDAL MODEL FOR ARCHAEOLOGICAL CHRONOLOGIES

DEVELOPMENT AND APPLICATION OF THE TRAPEZOIDAL MODEL FOR ARCHAEOLOGICAL CHRONOLOGIES RADIOCARBON, Vol 54, Nr 1, 2012, p 107 122 2012 by the Arizona Board of Regents on behalf of the University of Arizona DEVELOPMENT AND APPLICATION OF THE TRAPEZOIDAL MODEL FOR ARCHAEOLOGICAL CHRONOLOGIES

More information

EARLY BRONZE AGE STRATA AT TELL GHANEM AL-ALI ALONG THE MIDDLE EUPHRATES IN SYRIA: A PRELIMINARY REPORT OF 14 C DATING RESULTS

EARLY BRONZE AGE STRATA AT TELL GHANEM AL-ALI ALONG THE MIDDLE EUPHRATES IN SYRIA: A PRELIMINARY REPORT OF 14 C DATING RESULTS EARLY BRONZE AGE STRATA AT TELL GHANEM AL-ALI ALONG THE MIDDLE EUPHRATES IN SYRIA: A PRELIMINARY REPORT OF 14 C DATING RESULTS Toshio Nakamura 1,2 Mitsuo Hoshino 3 Tsuyoshi Tanaka 3 Hidekazu Yoshida 4

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters

More information

Bayesian model selection for computer model validation via mixture model estimation

Bayesian model selection for computer model validation via mixture model estimation Bayesian model selection for computer model validation via mixture model estimation Kaniav Kamary ATER, CNAM Joint work with É. Parent, P. Barbillon, M. Keller and N. Bousquet Outline Computer model validation

More information

SCIENTIFIC DATING IN ARCHAEOLOGY

SCIENTIFIC DATING IN ARCHAEOLOGY SCIENTIFIC DATING IN ARCHAEOLOGY Tsuneto Nagatomo 1. AGE DETERMINATION IN ARCHAEOLOGY Relative Age: stratigraphy, typology Absolute Chronology: historical data Age Determination by (natural) Scientific

More information

MCMC algorithms for fitting Bayesian models

MCMC algorithms for fitting Bayesian models MCMC algorithms for fitting Bayesian models p. 1/1 MCMC algorithms for fitting Bayesian models Sudipto Banerjee sudiptob@biostat.umn.edu University of Minnesota MCMC algorithms for fitting Bayesian models

More information

17 : Markov Chain Monte Carlo

17 : Markov Chain Monte Carlo 10-708: Probabilistic Graphical Models, Spring 2015 17 : Markov Chain Monte Carlo Lecturer: Eric P. Xing Scribes: Heran Lin, Bin Deng, Yun Huang 1 Review of Monte Carlo Methods 1.1 Overview Monte Carlo

More information

27 : Distributed Monte Carlo Markov Chain. 1 Recap of MCMC and Naive Parallel Gibbs Sampling

27 : Distributed Monte Carlo Markov Chain. 1 Recap of MCMC and Naive Parallel Gibbs Sampling 10-708: Probabilistic Graphical Models 10-708, Spring 2014 27 : Distributed Monte Carlo Markov Chain Lecturer: Eric P. Xing Scribes: Pengtao Xie, Khoa Luu In this scribe, we are going to review the Parallel

More information

Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo

Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo Probabilistic Graphical Models Lecture 17: Markov chain Monte Carlo Andrew Gordon Wilson www.cs.cmu.edu/~andrewgw Carnegie Mellon University March 18, 2015 1 / 45 Resources and Attribution Image credits,

More information

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2016 Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2016 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several

More information

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis Summarizing a posterior Given the data and prior the posterior is determined Summarizing the posterior gives parameter estimates, intervals, and hypothesis tests Most of these computations are integrals

More information

Medieval warmth confirmed at the Norse Eastern Settlement in. Greenland. GSA Data Repository G. Everett Lasher 1 and Yarrow Axford 1

Medieval warmth confirmed at the Norse Eastern Settlement in. Greenland. GSA Data Repository G. Everett Lasher 1 and Yarrow Axford 1 GSA Data Repository 2019096 1 2 Medieval warmth confirmed at the Norse Eastern Settlement in Greenland 3 G. Everett Lasher 1 and Yarrow Axford 1 4 5 1 Department of Earth and Planetary Sciences, Northwestern

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 3 Linear

More information

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition.

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition. Christian P. Robert The Bayesian Choice From Decision-Theoretic Foundations to Computational Implementation Second Edition With 23 Illustrations ^Springer" Contents Preface to the Second Edition Preface

More information

7. Estimation and hypothesis testing. Objective. Recommended reading

7. Estimation and hypothesis testing. Objective. Recommended reading 7. Estimation and hypothesis testing Objective In this chapter, we show how the election of estimators can be represented as a decision problem. Secondly, we consider the problem of hypothesis testing

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As

More information

The Groningen Radiocarbon Series from Tel Reh ov

The Groningen Radiocarbon Series from Tel Reh ov 15 The Groningen Radiocarbon Series from Tel Reh ov OxCal Bayesian computations for the Iron IB IIA Boundary and Iron IIA destruction events Hendrik J. Bruins, Johannes van der Plicht, Amihai Mazar, Christopher

More information

Bayesian Regression Linear and Logistic Regression

Bayesian Regression Linear and Logistic Regression When we want more than point estimates Bayesian Regression Linear and Logistic Regression Nicole Beckage Ordinary Least Squares Regression and Lasso Regression return only point estimates But what if we

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.utstat.utoronto.ca/~rsalakhu/ Sidney Smith Hall, Room 6002 Lecture 7 Approximate

More information

Bayesian Phylogenetics:

Bayesian Phylogenetics: Bayesian Phylogenetics: an introduction Marc A. Suchard msuchard@ucla.edu UCLA Who is this man? How sure are you? The one true tree? Methods we ve learned so far try to find a single tree that best describes

More information

Probabilistic Graphical Networks: Definitions and Basic Results

Probabilistic Graphical Networks: Definitions and Basic Results This document gives a cursory overview of Probabilistic Graphical Networks. The material has been gleaned from different sources. I make no claim to original authorship of this material. Bayesian Graphical

More information

Bayesian Linear Regression

Bayesian Linear Regression Bayesian Linear Regression Sudipto Banerjee 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. September 15, 2010 1 Linear regression models: a Bayesian perspective

More information

Monte Carlo in Bayesian Statistics

Monte Carlo in Bayesian Statistics Monte Carlo in Bayesian Statistics Matthew Thomas SAMBa - University of Bath m.l.thomas@bath.ac.uk December 4, 2014 Matthew Thomas (SAMBa) Monte Carlo in Bayesian Statistics December 4, 2014 1 / 16 Overview

More information

Bayesian Methods for Machine Learning

Bayesian Methods for Machine Learning Bayesian Methods for Machine Learning CS 584: Big Data Analytics Material adapted from Radford Neal s tutorial (http://ftp.cs.utoronto.ca/pub/radford/bayes-tut.pdf), Zoubin Ghahramni (http://hunch.net/~coms-4771/zoubin_ghahramani_bayesian_learning.pdf),

More information

Centre for Archaeological Research, Auckland University, Private Bag 92019, Auckland, New Zealand.

Centre for Archaeological Research, Auckland University, Private Bag 92019, Auckland, New Zealand. RADIOCARBON, Vol 44, Nr 3, 2002, p 663 674 2002 by the Arizona Board of Regents on behalf of the University of Arizona NEW RADIOCARBON CALIBRATION SOFTWARE artin Jones Centre for Archaeological Research,

More information

Advanced Statistical Modelling

Advanced Statistical Modelling Markov chain Monte Carlo (MCMC) Methods and Their Applications in Bayesian Statistics School of Technology and Business Studies/Statistics Dalarna University Borlänge, Sweden. Feb. 05, 2014. Outlines 1

More information

Markov Chain Monte Carlo in Practice

Markov Chain Monte Carlo in Practice Markov Chain Monte Carlo in Practice Edited by W.R. Gilks Medical Research Council Biostatistics Unit Cambridge UK S. Richardson French National Institute for Health and Medical Research Vilejuif France

More information

Bayesian linear regression

Bayesian linear regression Bayesian linear regression Linear regression is the basis of most statistical modeling. The model is Y i = X T i β + ε i, where Y i is the continuous response X i = (X i1,..., X ip ) T is the corresponding

More information

CPSC 540: Machine Learning

CPSC 540: Machine Learning CPSC 540: Machine Learning MCMC and Non-Parametric Bayes Mark Schmidt University of British Columbia Winter 2016 Admin I went through project proposals: Some of you got a message on Piazza. No news is

More information

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA

BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA BAYESIAN METHODS FOR VARIABLE SELECTION WITH APPLICATIONS TO HIGH-DIMENSIONAL DATA Intro: Course Outline and Brief Intro to Marina Vannucci Rice University, USA PASI-CIMAT 04/28-30/2010 Marina Vannucci

More information

On a multivariate implementation of the Gibbs sampler

On a multivariate implementation of the Gibbs sampler Note On a multivariate implementation of the Gibbs sampler LA García-Cortés, D Sorensen* National Institute of Animal Science, Research Center Foulum, PB 39, DK-8830 Tjele, Denmark (Received 2 August 1995;

More information

Bayesian Inference: Concept and Practice

Bayesian Inference: Concept and Practice Inference: Concept and Practice fundamentals Johan A. Elkink School of Politics & International Relations University College Dublin 5 June 2017 1 2 3 Bayes theorem In order to estimate the parameters of

More information

Bayesian Inference and MCMC

Bayesian Inference and MCMC Bayesian Inference and MCMC Aryan Arbabi Partly based on MCMC slides from CSC412 Fall 2018 1 / 18 Bayesian Inference - Motivation Consider we have a data set D = {x 1,..., x n }. E.g each x i can be the

More information

ST 740: Markov Chain Monte Carlo

ST 740: Markov Chain Monte Carlo ST 740: Markov Chain Monte Carlo Alyson Wilson Department of Statistics North Carolina State University October 14, 2012 A. Wilson (NCSU Stsatistics) MCMC October 14, 2012 1 / 20 Convergence Diagnostics:

More information

7. Estimation and hypothesis testing. Objective. Recommended reading

7. Estimation and hypothesis testing. Objective. Recommended reading 7. Estimation and hypothesis testing Objective In this chapter, we show how the election of estimators can be represented as a decision problem. Secondly, we consider the problem of hypothesis testing

More information

A Bayesian Approach to Phylogenetics

A Bayesian Approach to Phylogenetics A Bayesian Approach to Phylogenetics Niklas Wahlberg Based largely on slides by Paul Lewis (www.eeb.uconn.edu) An Introduction to Bayesian Phylogenetics Bayesian inference in general Markov chain Monte

More information

Bagging During Markov Chain Monte Carlo for Smoother Predictions

Bagging During Markov Chain Monte Carlo for Smoother Predictions Bagging During Markov Chain Monte Carlo for Smoother Predictions Herbert K. H. Lee University of California, Santa Cruz Abstract: Making good predictions from noisy data is a challenging problem. Methods

More information

Monte Carlo methods for sampling-based Stochastic Optimization

Monte Carlo methods for sampling-based Stochastic Optimization Monte Carlo methods for sampling-based Stochastic Optimization Gersende FORT LTCI CNRS & Telecom ParisTech Paris, France Joint works with B. Jourdain, T. Lelièvre, G. Stoltz from ENPC and E. Kuhn from

More information

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo Group Prof. Daniel Cremers 10a. Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative is Markov Chain

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods Tomas McKelvey and Lennart Svensson Signal Processing Group Department of Signals and Systems Chalmers University of Technology, Sweden November 26, 2012 Today s learning

More information

Slice Sampling with Adaptive Multivariate Steps: The Shrinking-Rank Method

Slice Sampling with Adaptive Multivariate Steps: The Shrinking-Rank Method Slice Sampling with Adaptive Multivariate Steps: The Shrinking-Rank Method Madeleine B. Thompson Radford M. Neal Abstract The shrinking rank method is a variation of slice sampling that is efficient at

More information

Adaptive Monte Carlo methods

Adaptive Monte Carlo methods Adaptive Monte Carlo methods Jean-Michel Marin Projet Select, INRIA Futurs, Université Paris-Sud joint with Randal Douc (École Polytechnique), Arnaud Guillin (Université de Marseille) and Christian Robert

More information

Invariant HPD credible sets and MAP estimators

Invariant HPD credible sets and MAP estimators Bayesian Analysis (007), Number 4, pp. 681 69 Invariant HPD credible sets and MAP estimators Pierre Druilhet and Jean-Michel Marin Abstract. MAP estimators and HPD credible sets are often criticized in

More information

Sampling Methods (11/30/04)

Sampling Methods (11/30/04) CS281A/Stat241A: Statistical Learning Theory Sampling Methods (11/30/04) Lecturer: Michael I. Jordan Scribe: Jaspal S. Sandhu 1 Gibbs Sampling Figure 1: Undirected and directed graphs, respectively, with

More information

Penalized Loss functions for Bayesian Model Choice

Penalized Loss functions for Bayesian Model Choice Penalized Loss functions for Bayesian Model Choice Martyn International Agency for Research on Cancer Lyon, France 13 November 2009 The pure approach For a Bayesian purist, all uncertainty is represented

More information

Lecture 7 and 8: Markov Chain Monte Carlo

Lecture 7 and 8: Markov Chain Monte Carlo Lecture 7 and 8: Markov Chain Monte Carlo 4F13: Machine Learning Zoubin Ghahramani and Carl Edward Rasmussen Department of Engineering University of Cambridge http://mlg.eng.cam.ac.uk/teaching/4f13/ Ghahramani

More information

Statistical Methods in Particle Physics Lecture 1: Bayesian methods

Statistical Methods in Particle Physics Lecture 1: Bayesian methods Statistical Methods in Particle Physics Lecture 1: Bayesian methods SUSSP65 St Andrews 16 29 August 2009 Glen Cowan Physics Department Royal Holloway, University of London g.cowan@rhul.ac.uk www.pp.rhul.ac.uk/~cowan

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee 1 and Andrew O. Finley 2 1 Biostatistics, School of Public Health, University of Minnesota, Minneapolis, Minnesota, U.S.A. 2 Department of Forestry & Department

More information

Lecture 4: Probabilistic Learning

Lecture 4: Probabilistic Learning DD2431 Autumn, 2015 1 Maximum Likelihood Methods Maximum A Posteriori Methods Bayesian methods 2 Classification vs Clustering Heuristic Example: K-means Expectation Maximization 3 Maximum Likelihood Methods

More information

CEDAD, Centre for Dating and Diagnostics, Department of Engineering of Innovation, University of Salento, Lecce, Italy. 4 Freelance architect.

CEDAD, Centre for Dating and Diagnostics, Department of Engineering of Innovation, University of Salento, Lecce, Italy. 4 Freelance architect. RADIOCARBON, Vol 51, Nr 2, 2009, p 867 872 2009 by the Arizona Board of Regents on behalf of the University of Arizona RADIOCARBON DATING OF LUMPS FROM AERIAL LIME MORTARS AND PLASTERS: METHODOLOGICAL

More information

Bayesian inference: what it means and why we care

Bayesian inference: what it means and why we care Bayesian inference: what it means and why we care Robin J. Ryder Centre de Recherche en Mathématiques de la Décision Université Paris-Dauphine 6 November 2017 Mathematical Coffees Robin Ryder (Dauphine)

More information

Machine Learning for Data Science (CS4786) Lecture 24

Machine Learning for Data Science (CS4786) Lecture 24 Machine Learning for Data Science (CS4786) Lecture 24 Graphical Models: Approximate Inference Course Webpage : http://www.cs.cornell.edu/courses/cs4786/2016sp/ BELIEF PROPAGATION OR MESSAGE PASSING Each

More information

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2014

Bayesian Networks: Construction, Inference, Learning and Causal Interpretation. Volker Tresp Summer 2014 Bayesian Networks: Construction, Inference, Learning and Causal Interpretation Volker Tresp Summer 2014 1 Introduction So far we were mostly concerned with supervised learning: we predicted one or several

More information

Contents. Part I: Fundamentals of Bayesian Inference 1

Contents. Part I: Fundamentals of Bayesian Inference 1 Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian

More information

Basic background for the geo- and archaeo- magnetist. Time scales Stratigraphy Site types Material types Field methods

Basic background for the geo- and archaeo- magnetist. Time scales Stratigraphy Site types Material types Field methods Basic background for the geo- and archaeo- magnetist Time scales Stratigraphy Site types Material types Field methods Field Observations Geology Archaeology Materials Geology Rocks and minerals Archaeology

More information

Density Estimation. Seungjin Choi

Density Estimation. Seungjin Choi Density Estimation Seungjin Choi Department of Computer Science and Engineering Pohang University of Science and Technology 77 Cheongam-ro, Nam-gu, Pohang 37673, Korea seungjin@postech.ac.kr http://mlg.postech.ac.kr/

More information

STAT 425: Introduction to Bayesian Analysis

STAT 425: Introduction to Bayesian Analysis STAT 425: Introduction to Bayesian Analysis Marina Vannucci Rice University, USA Fall 2017 Marina Vannucci (Rice University, USA) Bayesian Analysis (Part 2) Fall 2017 1 / 19 Part 2: Markov chain Monte

More information

EXAMINING THE INHERENT VARIABILITY IN DR: NEW METHODS OF PRESENTING DR VALUES AND IMPLICATIONS FOR MRE STUDIES

EXAMINING THE INHERENT VARIABILITY IN DR: NEW METHODS OF PRESENTING DR VALUES AND IMPLICATIONS FOR MRE STUDIES RADIOCARBON, Vol 53, Nr 2, 2011, p 277 288 2011 by the Arizona Board of Regents on behalf of the University of Arizona EXAMINING THE INHERENT VARIABILITY IN DR: NEW METHODS OF PRESENTING DR VALUES AND

More information

Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters

Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters Journal of Modern Applied Statistical Methods Volume 13 Issue 1 Article 26 5-1-2014 Comparison of Three Calculation Methods for a Bayesian Inference of Two Poisson Parameters Yohei Kawasaki Tokyo University

More information

Probabilistic Graphical Models

Probabilistic Graphical Models 2016 Robert Nowak Probabilistic Graphical Models 1 Introduction We have focused mainly on linear models for signals, in particular the subspace model x = Uθ, where U is a n k matrix and θ R k is a vector

More information

16 : Approximate Inference: Markov Chain Monte Carlo

16 : Approximate Inference: Markov Chain Monte Carlo 10-708: Probabilistic Graphical Models 10-708, Spring 2017 16 : Approximate Inference: Markov Chain Monte Carlo Lecturer: Eric P. Xing Scribes: Yuan Yang, Chao-Ming Yen 1 Introduction As the target distribution

More information

RADIOCARBON CALIBRATION BY THE DATE DISTRIBUTION METHOD

RADIOCARBON CALIBRATION BY THE DATE DISTRIBUTION METHOD RADIOCARBON, Vol 41, Nr 2, 1999, p 215-220 1999 by the Arizona Board of Regents on behalf of the University of Arizona RADIOCARBON CALIBRATION BY THE DATE DISTRIBUTION METHOD Paul Muzikar Department of

More information

STA 4273H: Sta-s-cal Machine Learning

STA 4273H: Sta-s-cal Machine Learning STA 4273H: Sta-s-cal Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 2 In our

More information

Probabilistic Machine Learning

Probabilistic Machine Learning Probabilistic Machine Learning Bayesian Nets, MCMC, and more Marek Petrik 4/18/2017 Based on: P. Murphy, K. (2012). Machine Learning: A Probabilistic Perspective. Chapter 10. Conditional Independence Independent

More information

Advanced Statistical Methods. Lecture 6

Advanced Statistical Methods. Lecture 6 Advanced Statistical Methods Lecture 6 Convergence distribution of M.-H. MCMC We denote the PDF estimated by the MCMC as. It has the property Convergence distribution After some time, the distribution

More information

an introduction to bayesian inference

an introduction to bayesian inference with an application to network analysis http://jakehofman.com january 13, 2010 motivation would like models that: provide predictive and explanatory power are complex enough to describe observed phenomena

More information

Monte Carlo integration

Monte Carlo integration Monte Carlo integration Eample of a Monte Carlo sampler in D: imagine a circle radius L/ within a square of LL. If points are randoml generated over the square, what s the probabilit to hit within circle?

More information

4/4/17. Dating Methods. Dating in Archaeology. These things date to 2500 B.C. (but there are no completion dates written anywhere on or near them)

4/4/17. Dating Methods. Dating in Archaeology. These things date to 2500 B.C. (but there are no completion dates written anywhere on or near them) Dating in Archaeology These things date to 2500 B.C. (but there are no completion dates written anywhere on or near them) Dating Methods One of the biggest questions in archaeology is WHEN? Successfully

More information

eqr094: Hierarchical MCMC for Bayesian System Reliability

eqr094: Hierarchical MCMC for Bayesian System Reliability eqr094: Hierarchical MCMC for Bayesian System Reliability Alyson G. Wilson Statistical Sciences Group, Los Alamos National Laboratory P.O. Box 1663, MS F600 Los Alamos, NM 87545 USA Phone: 505-667-9167

More information

An introduction to Bayesian statistics and model calibration and a host of related topics

An introduction to Bayesian statistics and model calibration and a host of related topics An introduction to Bayesian statistics and model calibration and a host of related topics Derek Bingham Statistics and Actuarial Science Simon Fraser University Cast of thousands have participated in the

More information

Bayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment

Bayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment Bayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment Yong Huang a,b, James L. Beck b,* and Hui Li a a Key Lab

More information

Bayesian Learning. HT2015: SC4 Statistical Data Mining and Machine Learning. Maximum Likelihood Principle. The Bayesian Learning Framework

Bayesian Learning. HT2015: SC4 Statistical Data Mining and Machine Learning. Maximum Likelihood Principle. The Bayesian Learning Framework HT5: SC4 Statistical Data Mining and Machine Learning Dino Sejdinovic Department of Statistics Oxford http://www.stats.ox.ac.uk/~sejdinov/sdmml.html Maximum Likelihood Principle A generative model for

More information

Hierarchical Bayesian Modeling

Hierarchical Bayesian Modeling Hierarchical Bayesian Modeling Making scientific inferences about a population based on many individuals Angie Wolfgang NSF Postdoctoral Fellow, Penn State Astronomical Populations Once we discover an

More information

Approximate Bayesian Computation

Approximate Bayesian Computation Approximate Bayesian Computation Michael Gutmann https://sites.google.com/site/michaelgutmann University of Helsinki and Aalto University 1st December 2015 Content Two parts: 1. The basics of approximate

More information

Bayesian Linear Models

Bayesian Linear Models Bayesian Linear Models Sudipto Banerjee 1 and Andrew O. Finley 2 1 Department of Forestry & Department of Geography, Michigan State University, Lansing Michigan, U.S.A. 2 Biostatistics, School of Public

More information

Hierarchical models. Dr. Jarad Niemi. August 31, Iowa State University. Jarad Niemi (Iowa State) Hierarchical models August 31, / 31

Hierarchical models. Dr. Jarad Niemi. August 31, Iowa State University. Jarad Niemi (Iowa State) Hierarchical models August 31, / 31 Hierarchical models Dr. Jarad Niemi Iowa State University August 31, 2017 Jarad Niemi (Iowa State) Hierarchical models August 31, 2017 1 / 31 Normal hierarchical model Let Y ig N(θ g, σ 2 ) for i = 1,...,

More information

Lecture: Gaussian Process Regression. STAT 6474 Instructor: Hongxiao Zhu

Lecture: Gaussian Process Regression. STAT 6474 Instructor: Hongxiao Zhu Lecture: Gaussian Process Regression STAT 6474 Instructor: Hongxiao Zhu Motivation Reference: Marc Deisenroth s tutorial on Robot Learning. 2 Fast Learning for Autonomous Robots with Gaussian Processes

More information

COS513 LECTURE 8 STATISTICAL CONCEPTS

COS513 LECTURE 8 STATISTICAL CONCEPTS COS513 LECTURE 8 STATISTICAL CONCEPTS NIKOLAI SLAVOV AND ANKUR PARIKH 1. MAKING MEANINGFUL STATEMENTS FROM JOINT PROBABILITY DISTRIBUTIONS. A graphical model (GM) represents a family of probability distributions

More information

Inference for a Population Proportion

Inference for a Population Proportion Al Nosedal. University of Toronto. November 11, 2015 Statistical inference is drawing conclusions about an entire population based on data in a sample drawn from that population. From both frequentist

More information

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1 Parameter Estimation William H. Jefferys University of Texas at Austin bill@bayesrules.net Parameter Estimation 7/26/05 1 Elements of Inference Inference problems contain two indispensable elements: Data

More information

Integrated Non-Factorized Variational Inference

Integrated Non-Factorized Variational Inference Integrated Non-Factorized Variational Inference Shaobo Han, Xuejun Liao and Lawrence Carin Duke University February 27, 2014 S. Han et al. Integrated Non-Factorized Variational Inference February 27, 2014

More information

Advances and Applications in Perfect Sampling

Advances and Applications in Perfect Sampling and Applications in Perfect Sampling Ph.D. Dissertation Defense Ulrike Schneider advisor: Jem Corcoran May 8, 2003 Department of Applied Mathematics University of Colorado Outline Introduction (1) MCMC

More information

Bayesian Statistical Methods. Jeff Gill. Department of Political Science, University of Florida

Bayesian Statistical Methods. Jeff Gill. Department of Political Science, University of Florida Bayesian Statistical Methods Jeff Gill Department of Political Science, University of Florida 234 Anderson Hall, PO Box 117325, Gainesville, FL 32611-7325 Voice: 352-392-0262x272, Fax: 352-392-8127, Email:

More information

Bayesian room-acoustic modal analysis

Bayesian room-acoustic modal analysis Bayesian room-acoustic modal analysis Wesley Henderson a) Jonathan Botts b) Ning Xiang c) Graduate Program in Architectural Acoustics, School of Architecture, Rensselaer Polytechnic Institute, Troy, New

More information