A new R package for TAR modeling

Size: px
Start display at page:

Download "A new R package for TAR modeling"

Transcription

1 XXVI Simposio Internacional de Estadística 2016 Sincelejo, Sucre, Colombia, 8 al 12 de Agosto de 2016 A new R package for TAR modeling Un nuevo paquete para el modelamiento TAR en R Hanwen Zhang 1,a, Fabio Humberto Nieto 1,b 1 Facultad de Estadística, División de Ciencias Económicas y Administrativas, Universidad Santo Tomás, Bogotá, Colombia 2 Departamento de Estadística, Facultad de Ciencias, Universidad Nacional de Colombia, Bogotá, Colombia Abstract In this document we present the advance of a new R package TAR for threshold autoregressive models. The package would consider the following distribution for the white noise process: Gaussian, Student s t, log-normal, and generalized error distribution. As for the scope of the package, this will include identifying TAR model and the model estimation using a Bayesian approach. Key words: TAR model, software, computer package. 1. Theoretical background A TAR (threshold autoregressive) model describes the relationship between two time series: the threshold series {Z t } and the output series {X t }. The specification of the model is given by: X t = a (j) 0 + k j i=1 a (j) i X t i + h (j) e t if r j 1 < Z t r j for some j = 1,, l. l is the number of regimes, r 1 < < r l 1 are the thresholds, k 1,, k l are the AR orders. a j i with j = 1,, l and i = 0,, k j are the AR coefficients. {e t } is the white noise process with variance equal to 1, and h (1),, h (l) are the variance weights. Nieto (2005) developed a Bayesian methodology for the identification and estimation of TAR models with Gaussian noise process, Zhang (2014) considered other distribuciones for the noise process. 2. Existing packages en R After look over the R s package website: packages_by_name.html, we found the following packages containing modeling of threshold models in time series. BAYSTAR package (Chen et al. 2013). Deals with SETAR (self-exciting threshold autoregressive model which is a special case of TAR model with Z t = X t d for some integer d 0)models with Gaussian white noise process with two regimes. The principal features of this package are: a Docente. hanwenzhang@usantotomas.edu.co b Profesor titular. fhnietos@unal.edu.co 1

2 2 Hanwen Zhang & Fabio Humberto Nieto Estimate the threshold value and the lag d using the Metropolis-Hastings algorithm. The user must provide the autoregressive orders. Provide the simulation of series from a SETAR model. TSA package. Contains R functions and datasets detailed in the book of Cryer & Chan (2008): Time Series Analysis with Applications in R. As well as the BAYSTAR package, this package only considers the case of two regimes. The principal features of this package are: The user must provide the value of d. Estimate the threshold value and using the minimum AIC criterion. Select the AR orders by minimizing AIC. Provide the simulation of series from a SETAR model. Provide likelihood test for threshold nonlinearity. Provide the prediction based on a fitted SETAR model. Revising these packages, it is clear that both packages consider the SETAR model with Gaussian noise process. There is no computational routine available for cases there the number of regimes is different from two. Also, there is no package for identification and estimation of all parameters of the TAR model. Also, distribution different from the Gaussian is not considered. 3. Package TAR The new package named TAR is planned to consider not only Gaussian distributions for the white noise process but also distributions as Student s t, log-normal and generalized error distribution. With this package, the user can identify the number of regimes, the thresholds and the AR orders, as well as the estimation of AR coefficients and the variance weights. We illustrate the use of the principal functions for Gaussian white noise process Function for the simulation of series from a TAR model simu.tar.norm This function simulates a serie from a TAR model with Gaussian distributed error given the parameters of the model from a given threshold process {Z t }. The arguments of the function are: Z: the threshold series, X the output series, l the number of regimes, r the thresholds, K the AR orders, theta the matrix of l rows containing the autoregressive orders and h the vector of l variance weights. For example, we can simulate a series from the following model { X t 1 0.3X t 2 + e t if Z t 0 X t = X t e t if Z t > 0 where {Z t } AR(1). The computation details are as follow: Z<-arima.sim(n=500,list(ar=c(0.5))) l <- 2 r <- 0 K <- c(2,1) theta <- matrix(c(1,-0.5,0.5,-0.7,-0.3,na),nrow=l) X <- simu.tar.norm(z, l, r, K, theta, H) ts.plot(x) The graphics of the simulated data are:

3 A new R package for TAR modeling 3 Z Time X Time 3.2. Function for the estimation of coefficients of a TAR model param.norm. This function estimate a TAR model using Gibbs Sampler given the structural parameters, i.e. the number of regimes, thresholds and autoregressive orders. The arguments of the function are: Z: the threshold series, X the output series, l the number of regimes, r the thresholds and K the AR orders. For example, we simulate a series with 2 regimes with threshold equal to 0, the AR orders are 2 and 1; nextly, we estimate the AR coefficients and the variance weghts. The computation details are as follow: Z<-arima.sim(n=500,list(ar=c(0.5))) l <- 2; r <- 0; K <- c(2,1) theta <- matrix(c(1,-0.5,0.5,-0.7,-0.3,na), nrow=l) X <- simu.tar.norm(z,l,r,k,theta,h) res <- param.norm(z,x,l,r,k) ============================================================ 100\% The autoregressive coefficients of the 1st regime are: Estimate Std.Err Limit inferior Limit superior lag lag lag The autoregressive coefficients of the 2nd regime are: Estimate Std.Err Limit inferior Limit superior lag

4 4 Hanwen Zhang & Fabio Humberto Nieto lag The variance weights are: Estimate Std.Err Limit inferior Limit superior Regime Regime Function for the identification of AR orders of a TAR model ARorder.norm. This function identifies the autoregressive orders for a TAR model with Gaussian noise process given the number of regimes and thresholds. The arguments of the function are: Z: the threshold series, X the output series, l the number of regimes and r the thresholds. For example, we simulate a series with 2 regimes with threshold equal to 0, the AR orders are 2 and 1; nextly, we estimate the AR orders. The computation details are as follow: Z<-arima.sim(n=300,list(ar=c(0.5))) l <- 2; r <- 0; K <- c(2,1) theta <- matrix(c(1,-0.5,0.5,-0.7,-0.3,na), nrow=l) X <- simu.tar.norm(z,l,r,k,theta,h) res <- ARorder.norm(Z,X,l,r) ================================================================ 100\% The identified AR order in the 1st regime is: 2 The identified AR order in the 2nd regime is: 1 A posteriori probability of the autoregressive orders are: Regime e Regime e Function for the identification of number of regimes and thresholds of a TAR model reg.thr.norm. This function identify the number of regimes and the corresponding thresholds for a TAR model with Gaussian noise process. The arguments of the function are: Z: the threshold series and X the output series. Here we present 2 examples: 1. We simulate a series with 2 regimes with threshold equal to 0, the AR orders are 2 and 1; nextly, we estimate the number of regimes and the thresholds. The computation details are as follow: Z<-arima.sim(n=300,list(ar=c(0.5))) l <- 2 r <- 0 K <- c(2,1) theta <- matrix(c(1,-0.5,0.5,-0.7,-0.3,na), nrow=l) X <- simu.tar.norm(z,l,r,k,theta,h) res <- Reg.Thr.norm(Z,X)

5 A new R package for TAR modeling 5 [1] Creating all possible thresholds for 2 regimes... ================================================== 100\% [1] Creating all possible thresholds for 3 regimes... ================================================== 100\% [1] Running Gibbs Sampler... ================================================== 100\% The identified regime number is: 2. A posteriori probability of the number of regimes are: 2 regimes 3 regimes Posterior probability e-130 The estimated threshold(s) is(are): The 95\% credible interval of the 1st threshold is: ( , ) 2. We simulate a series with 3 regimes with thresholds equal to -0.6 and 0.6, the AR orders are 1, 2 and 1; nextly, we estimate the number of regimes and the thresholds. The computation details are as follow: Z<-arima.sim(n=300, list(ar=c(0.5))) l <- 3; r <- c(-0.6, 0.6); K <- c(1, 2, 1) theta <- matrix(c(1,0.5,-0.5,-0.5,0.2,-0.7,na, 0.5,NA), nrow=l) H <- c(1, 1.5, 2) X <- simu.tar.norm(z, l, r, K, theta, H) res <- reg.thr.norm(z, X) [1] Creating all possible thresholds for 2 regimes... ============================================== 100% [1] Creating all possible thresholds for 3 regimes... ============================================== 100% [1] Running Gibbs Sampler... ============================================== 100% The identified regime number is: 3. A posteriori probability of the number of regimes are: 2 regimes 3 regimes Posterior probability e The estimated threshold(s) is(are): The 95% credible interval of the 1st threshold is: ( , ). The 95% credible interval of the 2nd threshold is: ( , )

6 6 Hanwen Zhang & Fabio Humberto Nieto 4. Conclusion In this document, we present some basic function of a new R package for TAR modeling with Gaussian white noise process. The package also includes other distributions for the noise process. References Chen, C. W. S., Lin, E. M., Liu, F. & Gerlach, R. (2013), BAYSTAR: On Bayesian analysis of Threshold autoregressive model (BAYSTAR). R package version * Cryer, J. & Chan, K.-S. (2008), Time Series Analysis with Applications in R (second edition), Springer. Nieto, F. H. (2005), Modeling bivariate threshold autoregressive processes in the presence of missing data, Communications in Statistics. Theory and Methods. 34, Zhang, H. (2014), TAR modeling with missing data when the white noise process is not Gaussian, Tesis de doctorado, Universidad Nacional de Colombia, BogotÃą, Colombia.

TAR Modeling with Missing Data when the White Noise Process Follows a Student s t-distribution

TAR Modeling with Missing Data when the White Noise Process Follows a Student s t-distribution Revista Colombiana de Estadística January 2015, Volume 38, Issue 1, pp. 239 to 266 DOI: http://dx.doi.org/10.15446/rce.v38n1.48813 TAR Modeling with Missing Data when the White Noise Process Follows a

More information

A note on the specification of conditional heteroscedasticity using a TAR model

A note on the specification of conditional heteroscedasticity using a TAR model A note on the specification of conditional heteroscedasticity using a TAR model Fabio H. Nieto Universidad Nacional de Colombia Edna C. Moreno Universidad Santo Tomás, Bogotá, Colombia Reporte Interno

More information

USING THE RJMCMC PROCEDURE FOR IDENTIFYING AND ESTIMATING TAR MODELS. Fabio H. Nieto. Universidad Nacional de Colombia.

USING THE RJMCMC PROCEDURE FOR IDENTIFYING AND ESTIMATING TAR MODELS. Fabio H. Nieto. Universidad Nacional de Colombia. USING THE RJMCMC PROCEDURE FOR IDENTIFYING AND ESTIMATING TAR MODELS Fabio H. Nieto Universidad Nacional de Colombia Hanwen Zhang Universidad Santo Tomás Wen Li Singapore Clinical Research Institute Reporte

More information

Is The TAR Model Useful For Analyzing Financial Time Series? Edna Carolina Moreno. Universidad Santo Tomás. Fabio H. Nieto

Is The TAR Model Useful For Analyzing Financial Time Series? Edna Carolina Moreno. Universidad Santo Tomás. Fabio H. Nieto Is The TAR Model Useful For Analyzing Financial Time Series? Edna Carolina Moreno Universidad Santo Tomás Fabio H. Nieto Universidad Nacional de Colombia Reporte Interno de Investigación No. 19 Departamento

More information

Univariate Conditional Distributions of an Open-Loop TAR Stochastic Process

Univariate Conditional Distributions of an Open-Loop TAR Stochastic Process Revista Colombiana de Estadística July 2016, Volume 39, Issue 2, pp. 149 to 165 DOI: http://dx.doi.org/10.15446/rce.v39n2.58912 Univariate Conditional Distributions of an Open-Loop TAR Stochastic Process

More information

Monitoring aggregated Poisson data with probability control limits

Monitoring aggregated Poisson data with probability control limits XXV Simposio Internacional de Estadística 2015 Armenia, Colombia, 5, 6, 7 y 8 de Agosto de 2015 Monitoring aggregated Poisson data with probability control limits Victor Hugo Morales Ospina 1,a, José Alberto

More information

Package RcppSMC. March 18, 2018

Package RcppSMC. March 18, 2018 Type Package Title Rcpp Bindings for Sequential Monte Carlo Version 0.2.1 Date 2018-03-18 Package RcppSMC March 18, 2018 Author Dirk Eddelbuettel, Adam M. Johansen and Leah F. South Maintainer Dirk Eddelbuettel

More information

Departamento de Economía Universidad de Chile

Departamento de Economía Universidad de Chile Departamento de Economía Universidad de Chile GRADUATE COURSE SPATIAL ECONOMETRICS November 14, 16, 17, 20 and 21, 2017 Prof. Henk Folmer University of Groningen Objectives The main objective of the course

More information

Outlier detection in ARIMA and seasonal ARIMA models by. Bayesian Information Type Criteria

Outlier detection in ARIMA and seasonal ARIMA models by. Bayesian Information Type Criteria Outlier detection in ARIMA and seasonal ARIMA models by Bayesian Information Type Criteria Pedro Galeano and Daniel Peña Departamento de Estadística Universidad Carlos III de Madrid 1 Introduction The

More information

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition.

The Bayesian Choice. Christian P. Robert. From Decision-Theoretic Foundations to Computational Implementation. Second Edition. Christian P. Robert The Bayesian Choice From Decision-Theoretic Foundations to Computational Implementation Second Edition With 23 Illustrations ^Springer" Contents Preface to the Second Edition Preface

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Computer Science! Department of Statistical Sciences! rsalakhu@cs.toronto.edu! h0p://www.cs.utoronto.ca/~rsalakhu/ Lecture 7 Approximate

More information

MEMBERSHIP IN THE REGION OF THE OPEN CLUSTER NGC 2244

MEMBERSHIP IN THE REGION OF THE OPEN CLUSTER NGC 2244 Revista Mexicana de Astronomía y Astrofísica, 37, 105 114 (001) MEMBERSHIP IN THE REGION OF THE OPEN CLUSTER NGC 44 B. E. Sabogal-Martínez, J. A. García-Varela, M. A. Higuera G., A. Uribe, and E. Brieva

More information

Markov Chain Monte Carlo methods

Markov Chain Monte Carlo methods Markov Chain Monte Carlo methods By Oleg Makhnin 1 Introduction a b c M = d e f g h i 0 f(x)dx 1.1 Motivation 1.1.1 Just here Supresses numbering 1.1.2 After this 1.2 Literature 2 Method 2.1 New math As

More information

The lmm Package. May 9, Description Some improved procedures for linear mixed models

The lmm Package. May 9, Description Some improved procedures for linear mixed models The lmm Package May 9, 2005 Version 0.3-4 Date 2005-5-9 Title Linear mixed models Author Original by Joseph L. Schafer . Maintainer Jing hua Zhao Description Some improved

More information

SYDE 372 Introduction to Pattern Recognition. Probability Measures for Classification: Part I

SYDE 372 Introduction to Pattern Recognition. Probability Measures for Classification: Part I SYDE 372 Introduction to Pattern Recognition Probability Measures for Classification: Part I Alexander Wong Department of Systems Design Engineering University of Waterloo Outline 1 2 3 4 Why use probability

More information

Multilevel Statistical Models: 3 rd edition, 2003 Contents

Multilevel Statistical Models: 3 rd edition, 2003 Contents Multilevel Statistical Models: 3 rd edition, 2003 Contents Preface Acknowledgements Notation Two and three level models. A general classification notation and diagram Glossary Chapter 1 An introduction

More information

Non-Linear Time Series

Non-Linear Time Series Non-Linear Time Series Kamil Feridun Turkman Manuel González Scotto Patrícia de Zea Bermudez Non-Linear Time Series Extreme Events and Integer Value Problems 123 Kamil Feridun Turkman Departmento de Estatística

More information

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II

ADVANCED MACHINE LEARNING ADVANCED MACHINE LEARNING. Non-linear regression techniques Part - II 1 Non-linear regression techniques Part - II Regression Algorithms in this Course Support Vector Machine Relevance Vector Machine Support vector regression Boosting random projections Relevance vector

More information

ST 740: Markov Chain Monte Carlo

ST 740: Markov Chain Monte Carlo ST 740: Markov Chain Monte Carlo Alyson Wilson Department of Statistics North Carolina State University October 14, 2012 A. Wilson (NCSU Stsatistics) MCMC October 14, 2012 1 / 20 Convergence Diagnostics:

More information

INTRODUCTION TO TIME SERIES ANALYSIS. The Simple Moving Average Model

INTRODUCTION TO TIME SERIES ANALYSIS. The Simple Moving Average Model INTRODUCTION TO TIME SERIES ANALYSIS The Simple Moving Average Model The Simple Moving Average Model The simple moving average (MA) model: More formally: where t is mean zero white noise (WN). Three parameters:

More information

On Forecast Strength of Some Linear and Non Linear Time Series Models for Stationary Data Structure

On Forecast Strength of Some Linear and Non Linear Time Series Models for Stationary Data Structure American Journal of Mathematics and Statistics 2015, 5(4): 163-177 DOI: 10.5923/j.ajms.20150504.01 On Forecast Strength of Some Linear and Non Linear Imam Akeyede 1,*, Babatunde Lateef Adeleke 2, Waheed

More information

Package LBLGXE. R topics documented: July 20, Type Package

Package LBLGXE. R topics documented: July 20, Type Package Type Package Package LBLGXE July 20, 2015 Title Bayesian Lasso for detecting Rare (or Common) Haplotype Association and their interactions with Environmental Covariates Version 1.2 Date 2015-07-09 Author

More information

Seasonal Autoregressive Integrated Moving Average Model for Precipitation Time Series

Seasonal Autoregressive Integrated Moving Average Model for Precipitation Time Series Journal of Mathematics and Statistics 8 (4): 500-505, 2012 ISSN 1549-3644 2012 doi:10.3844/jmssp.2012.500.505 Published Online 8 (4) 2012 (http://www.thescipub.com/jmss.toc) Seasonal Autoregressive Integrated

More information

A Course in Time Series Analysis

A Course in Time Series Analysis A Course in Time Series Analysis Edited by DANIEL PENA Universidad Carlos III de Madrid GEORGE C. TIAO University of Chicago RUEY S. TSAY University of Chicago A Wiley-Interscience Publication JOHN WILEY

More information

FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL

FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL FORECASTING SUGARCANE PRODUCTION IN INDIA WITH ARIMA MODEL B. N. MANDAL Abstract: Yearly sugarcane production data for the period of - to - of India were analyzed by time-series methods. Autocorrelation

More information

Tutorial on Probabilistic Programming with PyMC3

Tutorial on Probabilistic Programming with PyMC3 185.A83 Machine Learning for Health Informatics 2017S, VU, 2.0 h, 3.0 ECTS Tutorial 02-04.04.2017 Tutorial on Probabilistic Programming with PyMC3 florian.endel@tuwien.ac.at http://hci-kdd.org/machine-learning-for-health-informatics-course

More information

Package ARCensReg. September 11, 2016

Package ARCensReg. September 11, 2016 Type Package Package ARCensReg September 11, 2016 Title Fitting Univariate Censored Linear Regression Model with Autoregressive Errors Version 2.1 Date 2016-09-10 Author Fernanda L. Schumacher, Victor

More information

Modelling and forecasting of offshore wind power fluctuations with Markov-Switching models

Modelling and forecasting of offshore wind power fluctuations with Markov-Switching models Modelling and forecasting of offshore wind power fluctuations with Markov-Switching models 02433 - Hidden Markov Models Pierre-Julien Trombe, Martin Wæver Pedersen, Henrik Madsen Course week 10 MWP, compiled

More information

Doing Bayesian Integrals

Doing Bayesian Integrals ASTR509-13 Doing Bayesian Integrals The Reverend Thomas Bayes (c.1702 1761) Philosopher, theologian, mathematician Presbyterian (non-conformist) minister Tunbridge Wells, UK Elected FRS, perhaps due to

More information

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo

Computer Vision Group Prof. Daniel Cremers. 10a. Markov Chain Monte Carlo Group Prof. Daniel Cremers 10a. Markov Chain Monte Carlo Markov Chain Monte Carlo In high-dimensional spaces, rejection sampling and importance sampling are very inefficient An alternative is Markov Chain

More information

Program. The. provide the. coefficientss. (b) References. y Watson. probability (1991), "A. Stock. Arouba, Diebold conditions" based on monthly

Program. The. provide the. coefficientss. (b) References. y Watson. probability (1991), A. Stock. Arouba, Diebold conditions based on monthly Macroeconomic Forecasting Topics October 6 th to 10 th, 2014 Banco Central de Venezuela Caracas, Venezuela Program Professor: Pablo Lavado The aim of this course is to provide the basis for short term

More information

Package lmm. R topics documented: March 19, Version 0.4. Date Title Linear mixed models. Author Joseph L. Schafer

Package lmm. R topics documented: March 19, Version 0.4. Date Title Linear mixed models. Author Joseph L. Schafer Package lmm March 19, 2012 Version 0.4 Date 2012-3-19 Title Linear mixed models Author Joseph L. Schafer Maintainer Jing hua Zhao Depends R (>= 2.0.0) Description Some

More information

Advanced Statistical Modelling

Advanced Statistical Modelling Markov chain Monte Carlo (MCMC) Methods and Their Applications in Bayesian Statistics School of Technology and Business Studies/Statistics Dalarna University Borlänge, Sweden. Feb. 05, 2014. Outlines 1

More information

Contents. Part I: Fundamentals of Bayesian Inference 1

Contents. Part I: Fundamentals of Bayesian Inference 1 Contents Preface xiii Part I: Fundamentals of Bayesian Inference 1 1 Probability and inference 3 1.1 The three steps of Bayesian data analysis 3 1.2 General notation for statistical inference 4 1.3 Bayesian

More information

Univariate ARIMA Models

Univariate ARIMA Models Univariate ARIMA Models ARIMA Model Building Steps: Identification: Using graphs, statistics, ACFs and PACFs, transformations, etc. to achieve stationary and tentatively identify patterns and model components.

More information

M. H. Gonçalves 1 M. S. Cabral 2 A. Azzalini 3

M. H. Gonçalves 1 M. S. Cabral 2 A. Azzalini 3 M. H. Gonçalves 1 M. S. Cabral 2 A. Azzalini 3 1 University of Algarve, Portugal 2 University of Lisbon, Portugal 3 Università di Padova, Italy user!2010, July 21-23 1 2 3 4 5 What is bild? an R. parametric

More information

The pan Package. April 2, Title Multiple imputation for multivariate panel or clustered data

The pan Package. April 2, Title Multiple imputation for multivariate panel or clustered data The pan Package April 2, 2005 Version 0.2-3 Date 2005-3-23 Title Multiple imputation for multivariate panel or clustered data Author Original by Joseph L. Schafer . Maintainer Jing hua

More information

TIME SERIES MODELLING OF SURFACE PRESSURE DATA

TIME SERIES MODELLING OF SURFACE PRESSURE DATA INTERNATIONAL JOURNAL OF CLIMATOLOGY Int. J. Climatol. 18: 443 455 (1998) TIME SERIES MODELLING OF SURFACE PRESSURE DATA SHAFEEQAH AL-AWADHI and IAN JOLLIFFE* Department of Mathematical Sciences, Uni ersity

More information

Advanced Introduction to Machine Learning

Advanced Introduction to Machine Learning 10-715 Advanced Introduction to Machine Learning Homework 3 Due Nov 12, 10.30 am Rules 1. Homework is due on the due date at 10.30 am. Please hand over your homework at the beginning of class. Please see

More information

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis

(5) Multi-parameter models - Gibbs sampling. ST440/540: Applied Bayesian Analysis Summarizing a posterior Given the data and prior the posterior is determined Summarizing the posterior gives parameter estimates, intervals, and hypothesis tests Most of these computations are integrals

More information

FORECASTING THE INVENTORY LEVEL OF MAGNETIC CARDS IN TOLLING SYSTEM

FORECASTING THE INVENTORY LEVEL OF MAGNETIC CARDS IN TOLLING SYSTEM FORECASTING THE INVENTORY LEVEL OF MAGNETIC CARDS IN TOLLING SYSTEM Bratislav Lazić a, Nebojša Bojović b, Gordana Radivojević b*, Gorana Šormaz a a University of Belgrade, Mihajlo Pupin Institute, Serbia

More information

Labor-Supply Shifts and Economic Fluctuations. Technical Appendix

Labor-Supply Shifts and Economic Fluctuations. Technical Appendix Labor-Supply Shifts and Economic Fluctuations Technical Appendix Yongsung Chang Department of Economics University of Pennsylvania Frank Schorfheide Department of Economics University of Pennsylvania January

More information

Package jmcm. November 25, 2017

Package jmcm. November 25, 2017 Type Package Package jmcm November 25, 2017 Title Joint Mean-Covariance Models using 'Armadillo' and S4 Version 0.1.8.0 Maintainer Jianxin Pan Fit joint mean-covariance models

More information

Making rating curves - the Bayesian approach

Making rating curves - the Bayesian approach Making rating curves - the Bayesian approach Rating curves what is wanted? A best estimate of the relationship between stage and discharge at a given place in a river. The relationship should be on the

More information

Sampling Methods (11/30/04)

Sampling Methods (11/30/04) CS281A/Stat241A: Statistical Learning Theory Sampling Methods (11/30/04) Lecturer: Michael I. Jordan Scribe: Jaspal S. Sandhu 1 Gibbs Sampling Figure 1: Undirected and directed graphs, respectively, with

More information

Box-Jenkins ARIMA Advanced Time Series

Box-Jenkins ARIMA Advanced Time Series Box-Jenkins ARIMA Advanced Time Series www.realoptionsvaluation.com ROV Technical Papers Series: Volume 25 Theory In This Issue 1. Learn about Risk Simulator s ARIMA and Auto ARIMA modules. 2. Find out

More information

Overview. DS GA 1002 Probability and Statistics for Data Science. Carlos Fernandez-Granda

Overview. DS GA 1002 Probability and Statistics for Data Science.   Carlos Fernandez-Granda Overview DS GA 1002 Probability and Statistics for Data Science http://www.cims.nyu.edu/~cfgranda/pages/dsga1002_fall17 Carlos Fernandez-Granda Probability and statistics Probability: Framework for dealing

More information

Lecture 13 Fundamentals of Bayesian Inference

Lecture 13 Fundamentals of Bayesian Inference Lecture 13 Fundamentals of Bayesian Inference Dennis Sun Stats 253 August 11, 2014 Outline of Lecture 1 Bayesian Models 2 Modeling Correlations Using Bayes 3 The Universal Algorithm 4 BUGS 5 Wrapping Up

More information

Package mar. R topics documented: February 20, Title Multivariate AutoRegressive analysis Version Author S. M. Barbosa

Package mar. R topics documented: February 20, Title Multivariate AutoRegressive analysis Version Author S. M. Barbosa Title Multivariate AutoRegressive analysis Version 1.1-2 Author S. M. Barbosa Package mar February 20, 2015 R functions for multivariate autoregressive analysis Depends MASS Maintainer S. M. Barbosa

More information

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1

Parameter Estimation. William H. Jefferys University of Texas at Austin Parameter Estimation 7/26/05 1 Parameter Estimation William H. Jefferys University of Texas at Austin bill@bayesrules.net Parameter Estimation 7/26/05 1 Elements of Inference Inference problems contain two indispensable elements: Data

More information

A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling

A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling G. B. Kingston, H. R. Maier and M. F. Lambert Centre for Applied Modelling in Water Engineering, School

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY PREFACE xiii 1 Difference Equations 1.1. First-Order Difference Equations 1 1.2. pth-order Difference Equations 7

More information

Santiago Velilla. Curriculum Vitae

Santiago Velilla. Curriculum Vitae Santiago Velilla Departamento de Estadística Universidad Carlos III de Madrid 28903 - Getafe, Madrid, Spain. Tel: +34-91 - 624-9855. Fax: +34-91 - 624-9849 e-mail: santiago.velilla@uc3m.es Curriculum Vitae

More information

Bayesian Graphical Models for Structural Vector AutoregressiveMarch Processes 21, / 1

Bayesian Graphical Models for Structural Vector AutoregressiveMarch Processes 21, / 1 Bayesian Graphical Models for Structural Vector Autoregressive Processes Daniel Ahelegbey, Monica Billio, and Roberto Cassin (2014) March 21, 2015 Bayesian Graphical Models for Structural Vector AutoregressiveMarch

More information

STAT Financial Time Series

STAT Financial Time Series STAT 6104 - Financial Time Series Chapter 4 - Estimation in the time Domain Chun Yip Yau (CUHK) STAT 6104:Financial Time Series 1 / 46 Agenda 1 Introduction 2 Moment Estimates 3 Autoregressive Models (AR

More information

Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation. EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016

Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation. EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016 Introduction to Bayesian Statistics and Markov Chain Monte Carlo Estimation EPSY 905: Multivariate Analysis Spring 2016 Lecture #10: April 6, 2016 EPSY 905: Intro to Bayesian and MCMC Today s Class An

More information

RANDOM and REPEATED statements - How to Use Them to Model the Covariance Structure in Proc Mixed. Charlie Liu, Dachuang Cao, Peiqi Chen, Tony Zagar

RANDOM and REPEATED statements - How to Use Them to Model the Covariance Structure in Proc Mixed. Charlie Liu, Dachuang Cao, Peiqi Chen, Tony Zagar Paper S02-2007 RANDOM and REPEATED statements - How to Use Them to Model the Covariance Structure in Proc Mixed Charlie Liu, Dachuang Cao, Peiqi Chen, Tony Zagar Eli Lilly & Company, Indianapolis, IN ABSTRACT

More information

Modelling Operational Risk Using Bayesian Inference

Modelling Operational Risk Using Bayesian Inference Pavel V. Shevchenko Modelling Operational Risk Using Bayesian Inference 4y Springer 1 Operational Risk and Basel II 1 1.1 Introduction to Operational Risk 1 1.2 Defining Operational Risk 4 1.3 Basel II

More information

Package IGG. R topics documented: April 9, 2018

Package IGG. R topics documented: April 9, 2018 Package IGG April 9, 2018 Type Package Title Inverse Gamma-Gamma Version 1.0 Date 2018-04-04 Author Ray Bai, Malay Ghosh Maintainer Ray Bai Description Implements Bayesian linear regression,

More information

Data-driven methods in application to flood defence systems monitoring and analysis Pyayt, A.

Data-driven methods in application to flood defence systems monitoring and analysis Pyayt, A. UvA-DARE (Digital Academic Repository) Data-driven methods in application to flood defence systems monitoring and analysis Pyayt, A. Link to publication Citation for published version (APA): Pyayt, A.

More information

spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models

spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models spbayes: An R Package for Univariate and Multivariate Hierarchical Point-referenced Spatial Models Andrew O. Finley 1, Sudipto Banerjee 2, and Bradley P. Carlin 2 1 Michigan State University, Departments

More information

Regime switching models

Regime switching models Regime switching models Structural change and nonlinearities Matthieu Stigler Matthieu.Stigler at gmail.com April 30, 2009 Version 1.1 This document is released under the Creative Commons Attribution-Noncommercial

More information

Bayesian data analysis in practice: Three simple examples

Bayesian data analysis in practice: Three simple examples Bayesian data analysis in practice: Three simple examples Martin P. Tingley Introduction These notes cover three examples I presented at Climatea on 5 October 0. Matlab code is available by request to

More information

Course content (will be adapted to the background knowledge of the class):

Course content (will be adapted to the background knowledge of the class): Biomedical Signal Processing and Signal Modeling Lucas C Parra, parra@ccny.cuny.edu Departamento the Fisica, UBA Synopsis This course introduces two fundamental concepts of signal processing: linear systems

More information

arxiv: v1 [stat.co] 18 Feb 2012

arxiv: v1 [stat.co] 18 Feb 2012 A LEVEL-SET HIT-AND-RUN SAMPLER FOR QUASI-CONCAVE DISTRIBUTIONS Dean Foster and Shane T. Jensen arxiv:1202.4094v1 [stat.co] 18 Feb 2012 Department of Statistics The Wharton School University of Pennsylvania

More information

DIC, AIC, BIC, PPL, MSPE Residuals Predictive residuals

DIC, AIC, BIC, PPL, MSPE Residuals Predictive residuals DIC, AIC, BIC, PPL, MSPE Residuals Predictive residuals Overall Measures of GOF Deviance: this measures the overall likelihood of the model given a parameter vector D( θ) = 2 log L( θ) This can be averaged

More information

0.1 factor.ord: Ordinal Data Factor Analysis

0.1 factor.ord: Ordinal Data Factor Analysis 0.1 factor.ord: Ordinal Data Factor Analysis Given some unobserved explanatory variables and observed ordinal dependent variables, this model estimates latent factors using a Gibbs sampler with data augmentation.

More information

Bayesian time-varying quantile forecasting for. Value-at-Risk in financial markets

Bayesian time-varying quantile forecasting for. Value-at-Risk in financial markets Bayesian time-varying quantile forecasting for Value-at-Risk in financial markets Richard H. Gerlach a, Cathy W. S. Chen b, and Nancy Y. C. Chan b a Econometrics and Business Statistics, University of

More information

Additive Outlier Detection in Seasonal ARIMA Models by a Modified Bayesian Information Criterion

Additive Outlier Detection in Seasonal ARIMA Models by a Modified Bayesian Information Criterion 13 Additive Outlier Detection in Seasonal ARIMA Models by a Modified Bayesian Information Criterion Pedro Galeano and Daniel Peña CONTENTS 13.1 Introduction... 317 13.2 Formulation of the Outlier Detection

More information

Markov Chain Monte Carlo (MCMC) and Model Evaluation. August 15, 2017

Markov Chain Monte Carlo (MCMC) and Model Evaluation. August 15, 2017 Markov Chain Monte Carlo (MCMC) and Model Evaluation August 15, 2017 Frequentist Linking Frequentist and Bayesian Statistics How can we estimate model parameters and what does it imply? Want to find the

More information

Bayesian model selection in graphs by using BDgraph package

Bayesian model selection in graphs by using BDgraph package Bayesian model selection in graphs by using BDgraph package A. Mohammadi and E. Wit March 26, 2013 MOTIVATION Flow cytometry data with 11 proteins from Sachs et al. (2005) RESULT FOR CELL SIGNALING DATA

More information

MCMC 2: Lecture 2 Coding and output. Phil O Neill Theo Kypraios School of Mathematical Sciences University of Nottingham

MCMC 2: Lecture 2 Coding and output. Phil O Neill Theo Kypraios School of Mathematical Sciences University of Nottingham MCMC 2: Lecture 2 Coding and output Phil O Neill Theo Kypraios School of Mathematical Sciences University of Nottingham Contents 1. General (Markov) epidemic model 2. Non-Markov epidemic model 3. Debugging

More information

Computer intensive statistical methods

Computer intensive statistical methods Lecture 13 MCMC, Hybrid chains October 13, 2015 Jonas Wallin jonwal@chalmers.se Chalmers, Gothenburg university MH algorithm, Chap:6.3 The metropolis hastings requires three objects, the distribution of

More information

Bayesian Model Comparison:

Bayesian Model Comparison: Bayesian Model Comparison: Modeling Petrobrás log-returns Hedibert Freitas Lopes February 2014 Log price: y t = log p t Time span: 12/29/2000-12/31/2013 (n = 3268 days) LOG PRICE 1 2 3 4 0 500 1000 1500

More information

Modeling and Interpolation of Non-Gaussian Spatial Data: A Comparative Study

Modeling and Interpolation of Non-Gaussian Spatial Data: A Comparative Study Modeling and Interpolation of Non-Gaussian Spatial Data: A Comparative Study Gunter Spöck, Hannes Kazianka, Jürgen Pilz Department of Statistics, University of Klagenfurt, Austria hannes.kazianka@uni-klu.ac.at

More information

ECO 513 Fall 2009 C. Sims HIDDEN MARKOV CHAIN MODELS

ECO 513 Fall 2009 C. Sims HIDDEN MARKOV CHAIN MODELS ECO 513 Fall 2009 C. Sims HIDDEN MARKOV CHAIN MODELS 1. THE CLASS OF MODELS y t {y s, s < t} p(y t θ t, {y s, s < t}) θ t = θ(s t ) P[S t = i S t 1 = j] = h ij. 2. WHAT S HANDY ABOUT IT Evaluating the

More information

A NEW CLASS OF SKEW-NORMAL DISTRIBUTIONS

A NEW CLASS OF SKEW-NORMAL DISTRIBUTIONS A NEW CLASS OF SKEW-NORMAL DISTRIBUTIONS Reinaldo B. Arellano-Valle Héctor W. Gómez Fernando A. Quintana November, 2003 Abstract We introduce a new family of asymmetric normal distributions that contains

More information

The Influence of Additive Outliers on the Performance of Information Criteria to Detect Nonlinearity

The Influence of Additive Outliers on the Performance of Information Criteria to Detect Nonlinearity The Influence of Additive Outliers on the Performance of Information Criteria to Detect Nonlinearity Saskia Rinke 1 Leibniz University Hannover Abstract In this paper the performance of information criteria

More information

Introduction to Bayesian Learning. Machine Learning Fall 2018

Introduction to Bayesian Learning. Machine Learning Fall 2018 Introduction to Bayesian Learning Machine Learning Fall 2018 1 What we have seen so far What does it mean to learn? Mistake-driven learning Learning by counting (and bounding) number of mistakes PAC learnability

More information

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY

Time Series Analysis. James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY Time Series Analysis James D. Hamilton PRINCETON UNIVERSITY PRESS PRINCETON, NEW JERSEY & Contents PREFACE xiii 1 1.1. 1.2. Difference Equations First-Order Difference Equations 1 /?th-order Difference

More information

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA

TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA CHAPTER 6 TIME SERIES ANALYSIS AND FORECASTING USING THE STATISTICAL MODEL ARIMA 6.1. Introduction A time series is a sequence of observations ordered in time. A basic assumption in the time series analysis

More information

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 Contents Preface to Second Edition Preface to First Edition Abbreviations xv xvii xix PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1 1 The Role of Statistical Methods in Modern Industry and Services

More information

Principles of Bayesian Inference

Principles of Bayesian Inference Principles of Bayesian Inference Sudipto Banerjee University of Minnesota July 20th, 2008 1 Bayesian Principles Classical statistics: model parameters are fixed and unknown. A Bayesian thinks of parameters

More information

Part 7: Hierarchical Modeling

Part 7: Hierarchical Modeling Part 7: Hierarchical Modeling!1 Nested data It is common for data to be nested: i.e., observations on subjects are organized by a hierarchy Such data are often called hierarchical or multilevel For example,

More information

Reminder of some Markov Chain properties:

Reminder of some Markov Chain properties: Reminder of some Markov Chain properties: 1. a transition from one state to another occurs probabilistically 2. only state that matters is where you currently are (i.e. given present, future is independent

More information

On Moving Average Parameter Estimation

On Moving Average Parameter Estimation On Moving Average Parameter Estimation Niclas Sandgren and Petre Stoica Contact information: niclas.sandgren@it.uu.se, tel: +46 8 473392 Abstract Estimation of the autoregressive moving average (ARMA)

More information

Bayesian Additive Regression Tree (BART) with application to controlled trail data analysis

Bayesian Additive Regression Tree (BART) with application to controlled trail data analysis Bayesian Additive Regression Tree (BART) with application to controlled trail data analysis Weilan Yang wyang@stat.wisc.edu May. 2015 1 / 20 Background CATE i = E(Y i (Z 1 ) Y i (Z 0 ) X i ) 2 / 20 Background

More information

Improved model selection criteria for SETAR time series models

Improved model selection criteria for SETAR time series models Journal of Statistical Planning and Inference 37 2007 2802 284 www.elsevier.com/locate/jspi Improved model selection criteria for SEAR time series models Pedro Galeano a,, Daniel Peña b a Departamento

More information

User Guide for Hermir version 0.9: Toolbox for Synthesis of Multivariate Stationary Gaussian and non-gaussian Series

User Guide for Hermir version 0.9: Toolbox for Synthesis of Multivariate Stationary Gaussian and non-gaussian Series User Guide for Hermir version 0.9: Toolbox for Synthesis of Multivariate Stationary Gaussian and non-gaussian Series Hannes Helgason, Vladas Pipiras, and Patrice Abry June 2, 2011 Contents 1 Organization

More information

Chapter 12 PAWL-Forced Simulated Tempering

Chapter 12 PAWL-Forced Simulated Tempering Chapter 12 PAWL-Forced Simulated Tempering Luke Bornn Abstract In this short note, we show how the parallel adaptive Wang Landau (PAWL) algorithm of Bornn et al. (J Comput Graph Stat, to appear) can be

More information

Package spatial.gev.bma

Package spatial.gev.bma Type Package Package spatial.gev.bma February 20, 2015 Title Hierarchical spatial generalized extreme value (GEV) modeling with Bayesian Model Averaging (BMA) Version 1.0 Date 2014-03-11 Author Alex Lenkoski

More information

Time Series I Time Domain Methods

Time Series I Time Domain Methods Astrostatistics Summer School Penn State University University Park, PA 16802 May 21, 2007 Overview Filtering and the Likelihood Function Time series is the study of data consisting of a sequence of DEPENDENT

More information

Summary of Talk Background to Multilevel modelling project. What is complex level 1 variation? Tutorial dataset. Method 1 : Inverse Wishart proposals.

Summary of Talk Background to Multilevel modelling project. What is complex level 1 variation? Tutorial dataset. Method 1 : Inverse Wishart proposals. Modelling the Variance : MCMC methods for tting multilevel models with complex level 1 variation and extensions to constrained variance matrices By Dr William Browne Centre for Multilevel Modelling Institute

More information

{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn }

{ } Stochastic processes. Models for time series. Specification of a process. Specification of a process. , X t3. ,...X tn } Stochastic processes Time series are an example of a stochastic or random process Models for time series A stochastic process is 'a statistical phenomenon that evolves in time according to probabilistic

More information

Blind Equalization via Particle Filtering

Blind Equalization via Particle Filtering Blind Equalization via Particle Filtering Yuki Yoshida, Kazunori Hayashi, Hideaki Sakai Department of System Science, Graduate School of Informatics, Kyoto University Historical Remarks A sequential Monte

More information

Dimension-Independent likelihood-informed (DILI) MCMC

Dimension-Independent likelihood-informed (DILI) MCMC Dimension-Independent likelihood-informed (DILI) MCMC Tiangang Cui, Kody Law 2, Youssef Marzouk Massachusetts Institute of Technology 2 Oak Ridge National Laboratory 2 August 25 TC, KL, YM DILI MCMC USC

More information

Pattern Recognition and Machine Learning

Pattern Recognition and Machine Learning Christopher M. Bishop Pattern Recognition and Machine Learning ÖSpri inger Contents Preface Mathematical notation Contents vii xi xiii 1 Introduction 1 1.1 Example: Polynomial Curve Fitting 4 1.2 Probability

More information

6.867 Machine Learning

6.867 Machine Learning 6.867 Machine Learning Problem Set 2 Due date: Wednesday October 6 Please address all questions and comments about this problem set to 6867-staff@csail.mit.edu. You will need to use MATLAB for some of

More information

Marginal density. If the unknown is of the form x = (x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density

Marginal density. If the unknown is of the form x = (x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density Marginal density If the unknown is of the form x = x 1, x 2 ) in which the target of investigation is x 1, a marginal posterior density πx 1 y) = πx 1, x 2 y)dx 2 = πx 2 )πx 1 y, x 2 )dx 2 needs to be

More information

Frequentist-Bayesian Model Comparisons: A Simple Example

Frequentist-Bayesian Model Comparisons: A Simple Example Frequentist-Bayesian Model Comparisons: A Simple Example Consider data that consist of a signal y with additive noise: Data vector (N elements): D = y + n The additive noise n has zero mean and diagonal

More information