Collaborative Place Models Supplement 1
|
|
- Beatrix Jones
- 5 years ago
- Views:
Transcription
1 Collaborative Place Models Sulement Ber Kaicioglu Foursquare Labs Robert E. Schaire Princeton University David S. Rosenberg P Mobile Labs david.davidr@gmail.com Tony Jebara Columbia University jebara@cs.columbia.edu Inference CPM comrises a satial comonent, which reresents the inferred lace clusters, and a temoral comonent, which reresents the inferred lace distributions for each weehour. The model is deicted in Figure. Figure : Grahical model reresentation of CPM. The geograhic coordinates, denoted by `, are the only observed variables. The model assumes that all users share the same coefficients over the comonent lace distributions. We resent the derivation of our inference algorithm in multile stes. First, we use a strategy oularized by Griffiths and Steyvers [], and derive a collased Gibbs samler to samle from the osterior distribution of the categorical random variables conditioned on the observed geograhic coordinates. Second, we derive the conditional lielihood of the osterior samles, which we use to determine the samler s convergence. Finally, we derive formulas for aroximating the osterior exectations of the non-categorical random variables conditioned on the osterior samles.
2 . Collased Gibbs Samler In Lemmas and, we derive the collased Gibbs samler for variables z and y, resectively. Given a vector x and an index, let x indicate all the entries of the vector excluding the one at index. For Lemmas and, assume i (u, w, n) denotes the index of the variable that will be samled. Lemma. The unnormalized robability of z i conditioned on the observed location data and remaining categorical variables is z i y i f,z i, y i, ` / tṽu `i µ u, u ( u + ) u (ṽu ) + m,f. The arameters ṽ u, µu, u, and u are defined in the roof. t denotes the bivariate t-distribution and m,f denotes counts, both of which are defined in the aendix. Proof. We decomose the robability into two comonents using Bayes theorem: z i y i f,z i, y i, ` `i z i, y i f,z i, y i, ` i z i y i f,z i, y i, ` i `i y i f,z i, y i, ` i (`i z i, z i, ` i) z i y i f,z i, y i `i y i f,z i, y i, ` i / (`i z i, z i, ` i) () z i y i f,z i, y i. () In the first art of the derivation, we oerate on (). We augment it with and : (`i z i, z i, ` i) `i z i, z i, ` i, u, u u, u z i, z i, ` i d u d u `i z i, u, u u, u z i, z i, ` i d u d u N `i u, u (3) u, u z i, z i, ` i d u d u. (4), We convert (4) into a more tractable form. Let M be a set of indices, which we define in the aendix, and let ` M,, denote the subset of observations whose indices are in M. In the derivation
3 below, we treat all variables other than u and u as a constant: u, u z i, z i, ` i u, u z i, z i, ` M, u, u z i, ` M, ` M, / ` M, `j 0 0 j IW M, M, M, u, u, z i u, u z i ` M, z i u, u, z i u, u u, u, z i A u, u `j N `j u,v u, u,z j A u, u u, u A N. u µ u, u u Since the normal-inverse-wishart distribution is the conjugate rior of the multivariate normal distribution, the osterior is also a normal-inverse-wishart distribution, u, u z i, z i, ` i N u µ u, u u IW u u, ṽ u, (5) whose arameters are defined as u u + m,, ṽ u + m, `u m, j, X M, `j, µ u u µ u + m, S u j X M, u `j u + S u + `u, `u `j u m, `u u + m, `u T, µ u `u µ u T. 3
4 The osterior arameters deicted above are derived based on the conjugacy roerties of Gaussian distributions, as described in []. We rewrite () by combining (3), (4), and (5) to obtain (`i z i, z i, ` i) N `i u, u u, u z i, z i, ` i d u d u N `i u, u N u µ u, u u IW u u, ṽ u d u d u tṽu `i µ u, u ( u + ) u (ṽu ), (6) where t is the bivariate t-distribution. (6) is derived by alying Equation 58 from []. Now, we move onto the second art of the derivation. We oerate on () and augment it with : z i y i f,z i, y i z i y i f,z i, y i, f u f u y i f,z i, y i d f u z i y i f, f u (7) f u y i f,y i, z i d f u. (8),f We convert (8) into a more tractable form. As before, let M be a set of indices, which we define,f in the aendix, and let z M,f denote the subset of lace assignments whose indices are in M. In the derivation below, we treat all variables other than f u as a constant: f u y i f,y i, z i f u y i f,y i, z M,f z M y,f i f,y i, f u y i f,y i, f u y i f,y i, z M,f / z j y i f,y i, f u f u ) f u y i f,y i, z i j j j M,f M,f M,f z j y j, f u f u Categorical z j f u Dirichlet K f u Dirichlet Ku f u + m,f,..., + m Ku,f, (9) where the last ste follows because Dirichlet distribution is the conjugate rior of the categorical distribution. We rewrite () by combining (7), (8), and (9): z i y i f,z i, y i z i y i f, f u f u y i f,y i, z i d f u f u, Dirichlet K u f u + m,f,..., + m Ku,f d f u + m,f K u + m,f. (0) The last ste follows because it is the exected value of the Dirichlet distribution. 4
5 Finally, we combine (), (), (6), and (0) to obtain the unnormalized robability distribution: z i y i f,z i, y i, ` / (`i z i, z i, ` i) z i y i f,z i, y i tṽu `i µ u, u ( u + ) + m,f u (ṽu ) K u + m,f. Lemma. The unnormalized robability of y i conditioned on the observed location data and remaining categorical variables is y i f z i, y i, z i, ` / + m,f K u + m,f where the counts m,f, m,f, and m,f are defined in the aendix. w,f + m,f, Proof. We decomose the robability into two comonents using Bayes theorem: y i f z i, y i, z i, ` y i f z i, y i, z i Since () is equal to (), we rewrite it using (0) z i y i f,z i, y i y i f z i, y i z i z i, y i / z i y i f,z i, y i () y i f z i, y i. () z i y i f,z i, y i + m,f K u + m,f. (3) We oerate on () and augment it with : y i f z i, y i y i f y i y i f y i, w w y i d w (y i f w) w y i d w w,f (4) w y i d w. (5), We convert (5) into a more tractable form. As before, let M be a set of indices, which we define in the aendix, and let y M, denote the subset of comonent assignments whose indices are in M., In the derivation below, we treat all variables other than w as a constant, w y i w y M, ( y M, w ) w y M, / y M, w ( w ) (y j w) ( w ) j j M, M, Categorical (y j w) Dirichlet F ( w w) ) w y i Dirichlet F w w, + m,,..., w,f + m,f, (6) 5
6 where the last ste follows because Dirichlet distribution is the conjugate rior of the categorical distribution. We rewrite () by combining (4), (5), and (6): y i f z i, y i P f w,f w y i d w w,fdirichlet F w w, + m,,..., w,f + m,f w,f + m,f w,f + m,f d w. (7) Finally, we combine (), (), (3), and (7) to obtain the unnormalized robability distribution: y i f z i, y i, z i, ` / z i y i f,z i, y i y i f z i, y i + m,f K u + m,f P f w,f + m,f w,f + m,f.. Lielihoods In this subsection, we derive the conditional lielihoods of the osterior samles conditioned on the observed geograhical coordinates. We use these conditional lielihoods to determine the samler s convergence. We resent the derivations in multile lemmas and combine them in a theorem at the end of the subsection. Let denote the gamma function. Lemma 3. The marginal robability of the categorical random variable y is (y) W w FQ f FP f w,f ( w,f ) FQ f FP f, where the counts m,f are defined in the aendix. Proof. Let (,..., W ) denote the collection of random variables for all weehours. Below, we will augment the marginal robability with, and then factorize it based on the conditional 6
7 indeendence assumtions made by our model: (y) (y ) ( )d W (y j ) A ( w ) d jm,, 0 w jm, 0 ( w ) w W ( w ) w w (y j w) A jm, jm, W ( w ) d w (y j w) A d W F ( w w) w (y j w) A d w jm, Categorical (y j w) A d w. (8) Now, we substitute the robabilities in (8) with Dirichlet and categorical distributions, which are defined in more detail in the aendix: W 0 F ( w w) Categorical (y j w) A d w w W F B ( w w ) f W F B ( w ) w W B ( w ) B w W w FQ f FP f w,f ( w,f ) f w,f w,f w,f w,f jm, 0 F +m,f f m,f w,f A d w w, + m,,..., w,f + m,f FQ f FP f. A d w Lemma 4. The conditional robability of the categorical random variable z conditioned on y is U F ( K u ) Ku Q + m,f (z y), u ( ) Ku K u + m,f f where the counts m,f and m,f are defined in the aendix. n o Proof. Let f u u {,...,U},f {,...,F} denote the collection of random variables for all users and comonents. Below, we will augment the conditional robability with, and then 7
8 factorize it based on the conditional indeendence assumtions made by our model: (z y) (z y, ) ( y) d (z j y, ) A ( ) d jm,, 0 U F u f U u f u f U u f 0 F jm,f f u f u u 0 U z j y j, f jm,f jm,f F Ku f u F u f u z j y j, f A d u z j y j, f A d f u jm,f u f A d u Categorical z j f A d f u. (9) Now, we substitute the robabilities in (9) with Dirichlet and categorical distributions, which are defined in more detail in the aendix: U F 0 (z Ku u f u Categorical z j f A d f u u f U F u f U F u f U u f U u f B ( ) B ( ) K u K u f u, f u, jm,f +m,f K u F B ( ) B + m,f,..., + m Ku,f F ( K u ) Ku Q ( ) Ku + m,f. K u + m,f f u, d u f m,f d u f denote the bivariate gamma function, and let denote the determi- For our final derivation, let nant. Lemma 5. The conditional robability of the observed locations ` conditioned on z and y is U K u u (` z, y) u m, v u u v u u. The arameters v u, u, and u aendix. are defined in the roof, and the counts m, are defined in the 8
9 Proof. We will factorize the robability using the conditional indeendence assumtions made by the model, and then simlify the resulting robabilities by integrating out the means and covariances associated with the lace clusters: (` z, y) (` z) U K u u u U K u u U K u u U K u u jm, N `M, z, `M z, u, u u, u d u d u u, u N `j jm, u µ u, u u `j z j, IW u, u d u d u. u, u d u d u u,v We aly Equation 66 from [], which describes the conjugacy roerties of Gaussian distributions, to reformulate (0) into its final form: U K u (` z, y) N u µ u, u u IW u,v N `j U K u u m, v u u u The definitions for v u, u, and u are rovided in (5). v u u. jm, (0) u, u d u d u Finally, we combine Lemmas 3, 4, and 5 to rovide the log-lielihood of the samles z and y conditioned on the observations `. Lemma 6. The log-lielihood of the samles z and y conditioned on the observations ` is 0 WX log (z, y 0 UX + FX log w f FX u f UX XK u u where C denotes the constant terms. log v u log A K u + m,f K u + m, log X log + m,f A v u log u log u + C, Proof. The result follows by multilying the robabilities stated in Lemmas 3, 4, and 5, and alying the logarithm function..3 Parameter estimation In Subsection., we described a collased Gibbs samler for samling the osteriors of the categorical random variables. Below, Lemmas 7, 8, and 9 show how these samles, denoted as y and z, can be used to aroximate the osterior exectations of,,, and. 9
10 Lemma 7. The exectation of samles is given the observed geograhical coordinates and the osterior w,f E [ w,f y, z, `] P where the counts m,f are defined in the aendix. Proof. ( w y, z, `) ) w,f E [ w,f y, z, `] f w y M, y M, w Q ( w ) y M, jm, y M, ( w ) (y j w) / Dirichlet F ( w w) jm,, Categorical (y j w) Dirichlet F w w, + m,,..., w,f + m,f P f. Lemma 8. The exectation of given the observed geograhical coordinates and the osterior samles is h f u, E f u, y, z, `i where the counts m,f and m,f are defined in the aendix. + m,f K u + m,f, Proof. f u y, z, ` ) h f u, E f u, y, z, `i f u y, z f u z, y M,f z M,f f u, y z y M,f Q f u jm,f f u y z j f u, y z y M,f / Dirichlet Ku f u jm,f Categorical z j f u Dirichlet Ku f u + m,f,..., + m Ku,f + m,f K u + m,f. 0
11 Lemma 9. The exectations of osterior samles is and and given the observed geograhical coordinates and the h i u E u y, z, ` µ u h i u E u y, z, ` u v u 3. Parameters µ u, u, and v u are defined in the roof of Lemma. Proof. u, u y, z, ` ) u, u y, z, ` ) u y, z, ` ) h i u E u y, z, ` ) u y, z, ` ) h i u E u y, z, ` u, u z, ` u, u z,, `M `M, Q jm, N / N N tv u µ u IW `j u µ u, u u u v u 3. u, u, z u, u z, `M z u, u, z u, u, `M IW u µ u, u u u µ u, u u z IW IW u µ u u, u (vu ) u u, v u u,v, `M z u,v u u, v u Q jm, N jm, N `j `j u, u u, u Aendix. Miscellaneous notation Throughout the aer, we use various notations to reresent sets of indices and their cardinalities. Vectors y and z denote the comonent and lace assignments in CPM, resectively. Each vector entry is identified by a tule index (u, w, n), where u {,...,U} is a user, w {,...,W} is a weehour, and n {,...,N u,w } is an iteration index. For the subsequent notations, we assume that the random variables y and z are already samled. We refer to a subset of indices using
12 M 0,f0 u 0,w 0 {(u, w, n) z u,w,n 0,y u,w,n f 0,u u 0,w w 0 }, where u 0 denotes the user, w 0 denotes the weehour, 0 denotes the lace, and f 0 denotes the comonent. If we want the subset of indices to be unrestricted with resect to a category, we use the laceholder. For examle, has no constraints with resect to laces. M,f0 u 0,w 0 {(u, w, n) y u,w,n f 0,u u 0,w w 0 } Given a subset of indices denoted by M, the lowercase m M denotes its cardinality. For examle, given a set of indices its cardinality is M,f0 u 0, {(u, w, n) y u,w,n f 0,u u 0 }, m,f0 u 0, M,f0 u 0,. For the collased Gibbs samler, the sets of indices and cardinalities used in the derivations exclude the index that will be samled. We use to modify sets or cardinalities for this exclusion. Let (u, w, n) denote the index that will be samled, then given an index set M, let M M {(u, w, n)} reresent the excluding set and let m M reresent the corresonding cardinality. For examle, and M,f0 u 0, M,f0 u 0, m,f0 u 0, {(u, w, n)},f0 M u 0,. In the roof of Lemma, arameters ṽ u, µu, u, and u are defined using cardinalities that exclude the current index (u, w, n). Similarly, in the roof of Lemma 9, arameters µ u, u, and v u are defined lie their wiggly versions, but the counts used in their definitions do not exclude the current index. We define additional notation to reresent the sufficient statistics used by the learning algorithm. Let i (u, w, n) denote an observation index. Then, S u X im, denotes the sum of the observed coordinates that have been assigned to user u and lace. Similarly, P u X `i`ti im, denotes the sum of the outer roducts of the observed coordinates that have been assigned to user u and lace.. Probability distributions `i Let denote a bivariate gamma function, defined as (a) a + j. j Let >and let R be a ositive definite scale matrix. The inverse-wishart distribution, which is the conjugate rior to the multivariate normal distribution, is defined as IW (, ) 3 ex tr.
13 Let R be a ositive definite covariance matrix and let µ R denote a mean vector. The multivariate normal distribution is defined as N (` µ, ) ( ) ex (` µ)t (` µ). Let >and let R, then the -dimensional t-distribution is defined as t v (x µ, ) + (x µ)t (x µ) + Let K> be the number of categories and let (,..., K ) be the concentration arameters, where > 0 for all {,...,K}. Then, the K-dimensional Dirichlet distribution, which is the conjugate rior to the categorical distribution, is defined as Dirichlet K (x ) K B ( ) x, where KQ ( ) B ( ) KP. We abuse the Dirichlet notation slightly and use it to define the K-dimensional symmetric Dirichlet distribution as well. Let >0 be a scalar concentration arameter. Then, the symmetric Dirichlet distribution is defined as where References for all {,...,K}. Dirichlet K (x )Dirichlet K (x,..., K ), [] Thomas L. Griffiths and Mar Steyvers. Finding scientific toics. Proceedings of the National Academy of Sciences of the United States of America, 0(Sul ):58 535, Aril 004. [] Kevin Murhy. Conjugate bayesian analysis of the gaussian distribution. October
Collaborative Place Models Supplement 2
Collaborative Place Models Supplement Ber Kapicioglu Foursquare Labs berapicioglu@gmailcom Robert E Schapire Princeton University schapire@csprincetonedu David S Rosenberg YP Mobile Labs daviddavidr@gmailcom
More informationBayesian Spatially Varying Coefficient Models in the Presence of Collinearity
Bayesian Satially Varying Coefficient Models in the Presence of Collinearity David C. Wheeler 1, Catherine A. Calder 1 he Ohio State University 1 Abstract he belief that relationshis between exlanatory
More informationLearning Sequence Motif Models Using Gibbs Sampling
Learning Sequence Motif Models Using Gibbs Samling BMI/CS 776 www.biostat.wisc.edu/bmi776/ Sring 2018 Anthony Gitter gitter@biostat.wisc.edu These slides excluding third-arty material are licensed under
More informationIntroduction to Probability for Graphical Models
Introduction to Probability for Grahical Models CSC 4 Kaustav Kundu Thursday January 4, 06 *Most slides based on Kevin Swersky s slides, Inmar Givoni s slides, Danny Tarlow s slides, Jaser Snoek s slides,
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationBayesian Networks Practice
Bayesian Networks Practice Part 2 2016-03-17 Byoung-Hee Kim, Seong-Ho Son Biointelligence Lab, CSE, Seoul National University Agenda Probabilistic Inference in Bayesian networks Probability basics D-searation
More informationChapter 7: Special Distributions
This chater first resents some imortant distributions, and then develos the largesamle distribution theory which is crucial in estimation and statistical inference Discrete distributions The Bernoulli
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationCMSC 425: Lecture 4 Geometry and Geometric Programming
CMSC 425: Lecture 4 Geometry and Geometric Programming Geometry for Game Programming and Grahics: For the next few lectures, we will discuss some of the basic elements of geometry. There are many areas
More informationBayesian Networks Practice
ayesian Networks Practice Part 2 2016-03-17 young-hee Kim Seong-Ho Son iointelligence ab CSE Seoul National University Agenda Probabilistic Inference in ayesian networks Probability basics D-searation
More informationNumerical Methods for Particle Tracing in Vector Fields
On-Line Visualization Notes Numerical Methods for Particle Tracing in Vector Fields Kenneth I. Joy Visualization and Grahics Research Laboratory Deartment of Comuter Science University of California, Davis
More informationSTA 250: Statistics. Notes 7. Bayesian Approach to Statistics. Book chapters: 7.2
STA 25: Statistics Notes 7. Bayesian Aroach to Statistics Book chaters: 7.2 1 From calibrating a rocedure to quantifying uncertainty We saw that the central idea of classical testing is to rovide a rigorous
More informationApproximating min-max k-clustering
Aroximating min-max k-clustering Asaf Levin July 24, 2007 Abstract We consider the roblems of set artitioning into k clusters with minimum total cost and minimum of the maximum cost of a cluster. The cost
More informationUniform Law on the Unit Sphere of a Banach Space
Uniform Law on the Unit Shere of a Banach Sace by Bernard Beauzamy Société de Calcul Mathématique SA Faubourg Saint Honoré 75008 Paris France Setember 008 Abstract We investigate the construction of a
More informationSupplemental Information
Sulemental Information Anthony J. Greenberg, Sean R. Hacett, Lawrence G. Harshman and Andrew G. Clar Table of Contents Table S1 2 Table S2 3 Table S3 4 Figure S1 5 Figure S2 6 Figure S3 7 Figure S4 8 Text
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More informationThe Poisson Regression Model
The Poisson Regression Model The Poisson regression model aims at modeling a counting variable Y, counting the number of times that a certain event occurs during a given time eriod. We observe a samle
More informationp-adic Measures and Bernoulli Numbers
-Adic Measures and Bernoulli Numbers Adam Bowers Introduction The constants B k in the Taylor series exansion t e t = t k B k k! k=0 are known as the Bernoulli numbers. The first few are,, 6, 0, 30, 0,
More informationAnalysis of some entrance probabilities for killed birth-death processes
Analysis of some entrance robabilities for killed birth-death rocesses Master s Thesis O.J.G. van der Velde Suervisor: Dr. F.M. Sieksma July 5, 207 Mathematical Institute, Leiden University Contents Introduction
More informationDepartment of Mathematics
Deartment of Mathematics Ma 3/03 KC Border Introduction to Probability and Statistics Winter 209 Sulement : Series fun, or some sums Comuting the mean and variance of discrete distributions often involves
More informationResearch Note REGRESSION ANALYSIS IN MARKOV CHAIN * A. Y. ALAMUTI AND M. R. MESHKANI **
Iranian Journal of Science & Technology, Transaction A, Vol 3, No A3 Printed in The Islamic Reublic of Iran, 26 Shiraz University Research Note REGRESSION ANALYSIS IN MARKOV HAIN * A Y ALAMUTI AND M R
More informationScaling Multiple Point Statistics for Non-Stationary Geostatistical Modeling
Scaling Multile Point Statistics or Non-Stationary Geostatistical Modeling Julián M. Ortiz, Steven Lyster and Clayton V. Deutsch Centre or Comutational Geostatistics Deartment o Civil & Environmental Engineering
More informationStochastic integration II: the Itô integral
13 Stochastic integration II: the Itô integral We have seen in Lecture 6 how to integrate functions Φ : (, ) L (H, E) with resect to an H-cylindrical Brownian motion W H. In this lecture we address the
More informationMethods for Computing Marginal Data Densities from the Gibbs Output
Methods for Comuting Marginal Data Densities from the Gibbs Outut Cristina Fuentes-Albero Rutgers University Leonardo Melosi London Business School May 2012 Abstract We introduce two estimators for estimating
More informationOnline Appendix for The Timing and Method of Payment in Mergers when Acquirers Are Financially Constrained
Online Aendix for The Timing and Method of Payment in Mergers when Acquirers Are Financially Constrained Alexander S. Gorbenko USC Marshall School of Business Andrey Malenko MIT Sloan School of Management
More informationPrincipal Components Analysis and Unsupervised Hebbian Learning
Princial Comonents Analysis and Unsuervised Hebbian Learning Robert Jacobs Deartment of Brain & Cognitive Sciences University of Rochester Rochester, NY 1467, USA August 8, 008 Reference: Much of the material
More informationdn i where we have used the Gibbs equation for the Gibbs energy and the definition of chemical potential
Chem 467 Sulement to Lectures 33 Phase Equilibrium Chemical Potential Revisited We introduced the chemical otential as the conjugate variable to amount. Briefly reviewing, the total Gibbs energy of a system
More informationA Time-Varying Threshold STAR Model of Unemployment
A Time-Varying Threshold STAR Model of Unemloyment michael dueker a michael owyang b martin sola c,d a Russell Investments b Federal Reserve Bank of St. Louis c Deartamento de Economia, Universidad Torcuato
More informationHidden Predictors: A Factor Analysis Primer
Hidden Predictors: A Factor Analysis Primer Ryan C Sanchez Western Washington University Factor Analysis is a owerful statistical method in the modern research sychologist s toolbag When used roerly, factor
More informationUncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning
TNN-2009-P-1186.R2 1 Uncorrelated Multilinear Princial Comonent Analysis for Unsuervised Multilinear Subsace Learning Haiing Lu, K. N. Plataniotis and A. N. Venetsanooulos The Edward S. Rogers Sr. Deartment
More informationSampling. Inferential statistics draws probabilistic conclusions about populations on the basis of sample statistics
Samling Inferential statistics draws robabilistic conclusions about oulations on the basis of samle statistics Probability models assume that every observation in the oulation is equally likely to be observed
More informationPercolation Thresholds of Updated Posteriors for Tracking Causal Markov Processes in Complex Networks
Percolation Thresholds of Udated Posteriors for Tracing Causal Marov Processes in Comlex Networs We resent the adative measurement selection robarxiv:95.2236v1 stat.ml 14 May 29 Patric L. Harrington Jr.
More informationRANDOM WALKS AND PERCOLATION: AN ANALYSIS OF CURRENT RESEARCH ON MODELING NATURAL PROCESSES
RANDOM WALKS AND PERCOLATION: AN ANALYSIS OF CURRENT RESEARCH ON MODELING NATURAL PROCESSES AARON ZWIEBACH Abstract. In this aer we will analyze research that has been recently done in the field of discrete
More informationUniformly best wavenumber approximations by spatial central difference operators: An initial investigation
Uniformly best wavenumber aroximations by satial central difference oerators: An initial investigation Vitor Linders and Jan Nordström Abstract A characterisation theorem for best uniform wavenumber aroximations
More informationJohn Weatherwax. Analysis of Parallel Depth First Search Algorithms
Sulementary Discussions and Solutions to Selected Problems in: Introduction to Parallel Comuting by Viin Kumar, Ananth Grama, Anshul Guta, & George Karyis John Weatherwax Chater 8 Analysis of Parallel
More informationJoint Property Estimation for Multiple RFID Tag Sets Using Snapshots of Variable Lengths
Joint Proerty Estimation for Multile RFID Tag Sets Using Snashots of Variable Lengths ABSTRACT Qingjun Xiao Key Laboratory of Comuter Network and Information Integration Southeast University) Ministry
More informationCHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules
CHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules. Introduction: The is widely used in industry to monitor the number of fraction nonconforming units. A nonconforming unit is
More informationCombining Logistic Regression with Kriging for Mapping the Risk of Occurrence of Unexploded Ordnance (UXO)
Combining Logistic Regression with Kriging for Maing the Risk of Occurrence of Unexloded Ordnance (UXO) H. Saito (), P. Goovaerts (), S. A. McKenna (2) Environmental and Water Resources Engineering, Deartment
More informationOn parameter estimation in deformable models
Downloaded from orbitdtudk on: Dec 7, 07 On arameter estimation in deformable models Fisker, Rune; Carstensen, Jens Michael Published in: Proceedings of the 4th International Conference on Pattern Recognition
More informationSlash Distributions and Applications
CHAPTER 2 Slash Distributions and Alications 2.1 Introduction The concet of slash distributions was introduced by Kafadar (1988) as a heavy tailed alternative to the normal distribution. Further literature
More informationMATH 829: Introduction to Data Mining and Analysis Consistency of Linear Regression
1/9 MATH 829: Introduction to Data Mining and Analysis Consistency of Linear Regression Dominique Guillot Deartments of Mathematical Sciences University of Delaware February 15, 2016 Distribution of regression
More informationGeneral Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationSPARSE SIGNAL RECOVERY USING A BERNOULLI GENERALIZED GAUSSIAN PRIOR
3rd Euroean Signal Processing Conference EUSIPCO SPARSE SIGNAL RECOVERY USING A BERNOULLI GENERALIZED GAUSSIAN PRIOR Lotfi Chaari 1, Jean-Yves Tourneret 1 and Caroline Chaux 1 University of Toulouse, IRIT
More informationThe Hasse Minkowski Theorem Lee Dicker University of Minnesota, REU Summer 2001
The Hasse Minkowski Theorem Lee Dicker University of Minnesota, REU Summer 2001 The Hasse-Minkowski Theorem rovides a characterization of the rational quadratic forms. What follows is a roof of the Hasse-Minkowski
More informationA Slice Sampler for Restricted Hierarchical Beta Process with Applications to Shared Subspace Learning
A Slice Samler for Restricted Hierarchical Beta Process with Alications to Shared Subsace Learning Sunil Kumar Guta Dinh Phung Svetha Venkatesh Center for Pattern Recognition and Data Analytics PRaDA Deakin
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationA Note on Massless Quantum Free Scalar Fields. with Negative Energy Density
Adv. Studies Theor. Phys., Vol. 7, 13, no. 1, 549 554 HIKARI Ltd, www.m-hikari.com A Note on Massless Quantum Free Scalar Fields with Negative Energy Density M. A. Grado-Caffaro and M. Grado-Caffaro Scientific
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationSAS for Bayesian Mediation Analysis
Paer 1569-2014 SAS for Bayesian Mediation Analysis Miočević Milica, Arizona State University; David P. MacKinnon, Arizona State University ABSTRACT Recent statistical mediation analysis research focuses
More informationSPACE situational awareness (SSA) encompasses intelligence,
JOURNAL OF GUIDANCE,CONTROL, AND DYNAMICS Vol. 34, No. 6, November December 2011 Gaussian Sum Filters for Sace Surveillance: Theory and Simulations Joshua T. Horwood, Nathan D. Aragon, and Aubrey B. Poore
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More informationDeriving Indicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V.
Deriving ndicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V. Deutsch Centre for Comutational Geostatistics Deartment of Civil &
More informationDistributed Rule-Based Inference in the Presence of Redundant Information
istribution Statement : roved for ublic release; distribution is unlimited. istributed Rule-ased Inference in the Presence of Redundant Information June 8, 004 William J. Farrell III Lockheed Martin dvanced
More informationCorrespondence Between Fractal-Wavelet. Transforms and Iterated Function Systems. With Grey Level Maps. F. Mendivil and E.R.
1 Corresondence Between Fractal-Wavelet Transforms and Iterated Function Systems With Grey Level Mas F. Mendivil and E.R. Vrscay Deartment of Alied Mathematics Faculty of Mathematics University of Waterloo
More informationON PRIORS FOR IMPULSE RESPONSES IN BAYESIAN STRUCTURAL VAR MODELS
ON PRIORS FOR IMPULSE RESPONSES IN BAYESIAN STRUCTURAL VAR MODELS Andrzej Kocięcki National Bank of Poland e-mail: andrzej.kociecki@mail.nb.l (PRELIMINARY) June 3 I. INTRODUCTION In the mainstream of SVAR
More informationSupplement to the paper Accurate distributions of Mallows C p and its unbiased modifications with applications to shrinkage estimation
To aear in Economic Review (Otaru University of Commerce Vol. No..- 017. Sulement to the aer Accurate distributions of Mallows C its unbiased modifications with alications to shrinkage estimation Haruhiko
More informationOn the Chvatál-Complexity of Knapsack Problems
R u t c o r Research R e o r t On the Chvatál-Comlexity of Knasack Problems Gergely Kovács a Béla Vizvári b RRR 5-08, October 008 RUTCOR Rutgers Center for Oerations Research Rutgers University 640 Bartholomew
More informationNew Information Measures for the Generalized Normal Distribution
Information,, 3-7; doi:.339/info3 OPEN ACCESS information ISSN 75-7 www.mdi.com/journal/information Article New Information Measures for the Generalized Normal Distribution Christos P. Kitsos * and Thomas
More informationElements of Asymptotic Theory. James L. Powell Department of Economics University of California, Berkeley
Elements of Asymtotic Theory James L. Powell Deartment of Economics University of California, Berkeley Objectives of Asymtotic Theory While exact results are available for, say, the distribution of the
More informationEstimation of Separable Representations in Psychophysical Experiments
Estimation of Searable Reresentations in Psychohysical Exeriments Michele Bernasconi (mbernasconi@eco.uninsubria.it) Christine Choirat (cchoirat@eco.uninsubria.it) Raffaello Seri (rseri@eco.uninsubria.it)
More informationOn information plus noise kernel random matrices
On information lus noise kernel random matrices Noureddine El Karoui Deartment of Statistics, UC Berkeley First version: July 009 This version: February 5, 00 Abstract Kernel random matrices have attracted
More informationŽ. Ž. Ž. 2 QUADRATIC AND INVERSE REGRESSIONS FOR WISHART DISTRIBUTIONS 1
The Annals of Statistics 1998, Vol. 6, No., 573595 QUADRATIC AND INVERSE REGRESSIONS FOR WISHART DISTRIBUTIONS 1 BY GERARD LETAC AND HELENE ` MASSAM Universite Paul Sabatier and York University If U and
More informationExtensions of the Penalized Spline Propensity Prediction Method of Imputation
Extensions of the Penalized Sline Proensity Prediction Method of Imutation by Guangyu Zhang A dissertation submitted in artial fulfillment of the requirements for the degree of Doctor of Philosohy (Biostatistics)
More informationarxiv: v1 [cs.lg] 31 Jul 2014
Learning Nash Equilibria in Congestion Games Walid Krichene Benjamin Drighès Alexandre M. Bayen arxiv:408.007v [cs.lg] 3 Jul 204 Abstract We study the reeated congestion game, in which multile oulations
More informationFrequency-Domain Design of Overcomplete. Rational-Dilation Wavelet Transforms
Frequency-Domain Design of Overcomlete 1 Rational-Dilation Wavelet Transforms İlker Bayram and Ivan W. Selesnick Polytechnic Institute of New York University Brooklyn, NY 1121 ibayra1@students.oly.edu,
More informationElements of Asymptotic Theory. James L. Powell Department of Economics University of California, Berkeley
Elements of Asymtotic Theory James L. Powell Deartment of Economics University of California, Berkeley Objectives of Asymtotic Theory While exact results are available for, say, the distribution of the
More informationGeneralized optimal sub-pattern assignment metric
Generalized otimal sub-attern assignment metric Abu Sajana Rahmathullah, Ángel F García-Fernández, Lennart Svensson arxiv:6005585v7 [cssy] 2 Se 208 Abstract This aer resents the generalized otimal subattern
More informationRobustness of classifiers to uniform l p and Gaussian noise Supplementary material
Robustness of classifiers to uniform l and Gaussian noise Sulementary material Jean-Yves Franceschi Ecole Normale Suérieure de Lyon LIP UMR 5668 Omar Fawzi Ecole Normale Suérieure de Lyon LIP UMR 5668
More information1 Properties of Spherical Harmonics
Proerties of Sherical Harmonics. Reetition In the lecture the sherical harmonics Y m were introduced as the eigenfunctions of angular momentum oerators lˆz and lˆ2 in sherical coordinates. We found that
More informationElementary theory of L p spaces
CHAPTER 3 Elementary theory of L saces 3.1 Convexity. Jensen, Hölder, Minkowski inequality. We begin with two definitions. A set A R d is said to be convex if, for any x 0, x 1 2 A x = x 0 + (x 1 x 0 )
More informationMoment Generating Function. STAT/MTHE 353: 5 Moment Generating Functions and Multivariate Normal Distribution
Moment Generating Function STAT/MTHE 353: 5 Moment Generating Functions and Multivariate Normal Distribution T. Linder Queen s University Winter 07 Definition Let X (X,...,X n ) T be a random vector and
More informationMULTIVARIATE SHEWHART QUALITY CONTROL FOR STANDARD DEVIATION
MULTIVARIATE SHEWHART QUALITY CONTROL FOR STANDARD DEVIATION M. Jabbari Nooghabi, Deartment of Statistics, Faculty of Mathematical Sciences, Ferdowsi University of Mashhad, Mashhad-Iran. and H. Jabbari
More informationEconometrica Supplementary Material
Econometrica Sulementary Material SUPPLEMENT TO WEAKLY BELIEF-FREE EQUILIBRIA IN REPEATED GAMES WITH PRIVATE MONITORING (Econometrica, Vol. 79, No. 3, May 2011, 877 892) BY KANDORI,MICHIHIRO IN THIS SUPPLEMENT,
More informationDr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur
Analysis of Variance and Design of Exeriment-I MODULE II LECTURE -4 GENERAL LINEAR HPOTHESIS AND ANALSIS OF VARIANCE Dr. Shalabh Deartment of Mathematics and Statistics Indian Institute of Technology Kanur
More informationON UNIFORM BOUNDEDNESS OF DYADIC AVERAGING OPERATORS IN SPACES OF HARDY-SOBOLEV TYPE. 1. Introduction
ON UNIFORM BOUNDEDNESS OF DYADIC AVERAGING OPERATORS IN SPACES OF HARDY-SOBOLEV TYPE GUSTAVO GARRIGÓS ANDREAS SEEGER TINO ULLRICH Abstract We give an alternative roof and a wavelet analog of recent results
More informationAMS10 HW1 Grading Rubric
AMS10 HW1 Grading Rubric Problem 1 (16ts- ts/each). Left hand side is shown to equal right hand side using examles with real vectors. A vector sace is a set V on which two oerations, vector addition and
More informationCOMMUNICATION BETWEEN SHAREHOLDERS 1
COMMUNICATION BTWN SHARHOLDRS 1 A B. O A : A D Lemma B.1. U to µ Z r 2 σ2 Z + σ2 X 2r ω 2 an additive constant that does not deend on a or θ, the agents ayoffs can be written as: 2r rθa ω2 + θ µ Y rcov
More informationThe Fekete Szegő theorem with splitting conditions: Part I
ACTA ARITHMETICA XCIII.2 (2000) The Fekete Szegő theorem with slitting conditions: Part I by Robert Rumely (Athens, GA) A classical theorem of Fekete and Szegő [4] says that if E is a comact set in the
More informationTowards understanding the Lorenz curve using the Uniform distribution. Chris J. Stephens. Newcastle City Council, Newcastle upon Tyne, UK
Towards understanding the Lorenz curve using the Uniform distribution Chris J. Stehens Newcastle City Council, Newcastle uon Tyne, UK (For the Gini-Lorenz Conference, University of Siena, Italy, May 2005)
More informationGeneral Random Variables
Chater General Random Variables. Law of a Random Variable Thus far we have considered onl random variables whose domain and range are discrete. We now consider a general random variable X! defined on the
More informationLinear diophantine equations for discrete tomography
Journal of X-Ray Science and Technology 10 001 59 66 59 IOS Press Linear diohantine euations for discrete tomograhy Yangbo Ye a,gewang b and Jiehua Zhu a a Deartment of Mathematics, The University of Iowa,
More informationANALYTIC NUMBER THEORY AND DIRICHLET S THEOREM
ANALYTIC NUMBER THEORY AND DIRICHLET S THEOREM JOHN BINDER Abstract. In this aer, we rove Dirichlet s theorem that, given any air h, k with h, k) =, there are infinitely many rime numbers congruent to
More informationThe Binomial Approach for Probability of Detection
Vol. No. (Mar 5) - The e-journal of Nondestructive Testing - ISSN 45-494 www.ndt.net/?id=7498 The Binomial Aroach for of Detection Carlos Correia Gruo Endalloy C.A. - Caracas - Venezuela www.endalloy.net
More informationSlides Prepared by JOHN S. LOUCKS St. Edward s s University Thomson/South-Western. Slide
s Preared by JOHN S. LOUCKS St. Edward s s University 1 Chater 11 Comarisons Involving Proortions and a Test of Indeendence Inferences About the Difference Between Two Poulation Proortions Hyothesis Test
More informationProbability- the good parts version. I. Random variables and their distributions; continuous random variables.
Probability- the good arts version I. Random variables and their distributions; continuous random variables. A random variable (r.v) X is continuous if its distribution is given by a robability density
More informationDistributed K-means over Compressed Binary Data
1 Distributed K-means over Comressed Binary Data Elsa DUPRAZ Telecom Bretagne; UMR CNRS 6285 Lab-STICC, Brest, France arxiv:1701.03403v1 [cs.it] 12 Jan 2017 Abstract We consider a networ of binary-valued
More informationAnalysis of M/M/n/K Queue with Multiple Priorities
Analysis of M/M/n/K Queue with Multile Priorities Coyright, Sanjay K. Bose For a P-riority system, class P of highest riority Indeendent, Poisson arrival rocesses for each class with i as average arrival
More informationBayesian Model Averaging Kriging Jize Zhang and Alexandros Taflanidis
HIPAD LAB: HIGH PERFORMANCE SYSTEMS LABORATORY DEPARTMENT OF CIVIL AND ENVIRONMENTAL ENGINEERING AND EARTH SCIENCES Bayesian Model Averaging Kriging Jize Zhang and Alexandros Taflanidis Why use metamodeling
More informationFibration of Toposes PSSL 101, Leeds
Fibration of Tooses PSSL 101, Leeds Sina Hazratour sinahazratour@gmail.com Setember 2017 AUs AUs as finitary aroximation of Grothendieck tooses Pretooses 1 finite limits 2 stable finite disjoint coroducts
More informationBayesian inference & Markov chain Monte Carlo. Note 1: Many slides for this lecture were kindly provided by Paul Lewis and Mark Holder
Bayesian inference & Markov chain Monte Carlo Note 1: Many slides for this lecture were kindly rovided by Paul Lewis and Mark Holder Note 2: Paul Lewis has written nice software for demonstrating Markov
More informationImproved Capacity Bounds for the Binary Energy Harvesting Channel
Imroved Caacity Bounds for the Binary Energy Harvesting Channel Kaya Tutuncuoglu 1, Omur Ozel 2, Aylin Yener 1, and Sennur Ulukus 2 1 Deartment of Electrical Engineering, The Pennsylvania State University,
More informationPublished: 14 October 2013
Electronic Journal of Alied Statistical Analysis EJASA, Electron. J. A. Stat. Anal. htt://siba-ese.unisalento.it/index.h/ejasa/index e-issn: 27-5948 DOI: 1.1285/i275948v6n213 Estimation of Parameters of
More informationThe inverse Goldbach problem
1 The inverse Goldbach roblem by Christian Elsholtz Submission Setember 7, 2000 (this version includes galley corrections). Aeared in Mathematika 2001. Abstract We imrove the uer and lower bounds of the
More informationPell's Equation and Fundamental Units Pell's equation was first introduced to me in the number theory class at Caltech that I never comleted. It was r
Pell's Equation and Fundamental Units Kaisa Taiale University of Minnesota Summer 000 1 Pell's Equation and Fundamental Units Pell's equation was first introduced to me in the number theory class at Caltech
More informationNamed Entity Recognition using Maximum Entropy Model SEEM5680
Named Entity Recognition using Maximum Entroy Model SEEM5680 Named Entity Recognition System Named Entity Recognition (NER): Identifying certain hrases/word sequences in a free text. Generally it involves
More informationOptimal Learning Policies for the Newsvendor Problem with Censored Demand and Unobservable Lost Sales
Otimal Learning Policies for the Newsvendor Problem with Censored Demand and Unobservable Lost Sales Diana Negoescu Peter Frazier Warren Powell Abstract In this aer, we consider a version of the newsvendor
More informationPositive decomposition of transfer functions with multiple poles
Positive decomosition of transfer functions with multile oles Béla Nagy 1, Máté Matolcsi 2, and Márta Szilvási 1 Deartment of Analysis, Technical University of Budaest (BME), H-1111, Budaest, Egry J. u.
More informationOn the optimality of Naïve Bayes with dependent binary features
Pattern Recognition Letters 27 (26) 83 837 www.elsevier.com/locate/atrec On the otimality of Naïve Bayes with deendent binary features Ludmila I. Kuncheva * School of Informatics, University of Wales,
More informationMULTIVARIATE STATISTICAL PROCESS OF HOTELLING S T CONTROL CHARTS PROCEDURES WITH INDUSTRIAL APPLICATION
Journal of Statistics: Advances in heory and Alications Volume 8, Number, 07, Pages -44 Available at htt://scientificadvances.co.in DOI: htt://dx.doi.org/0.864/jsata_700868 MULIVARIAE SAISICAL PROCESS
More informationShort course A vademecum of statistical pattern recognition techniques with applications to image and video analysis. Agenda
Short course A vademecum of statistical attern recognition techniques with alications to image and video analysis Lecture 6 The Kalman filter. Particle filters Massimo Piccardi University of Technology,
More information