Bootstrap AMG for Markov Chain Computations

Similar documents
Report on Image warping

Relaxation Methods for Iterative Solution to Linear Systems of Equations

Google PageRank with Stochastic Matrix

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

Bootstrap AMG. Kailai Xu. July 12, Stanford University

Meshless Surfaces. presented by Niloy J. Mitra. An Nguyen

The Finite Element Method: A Short Introduction

ρ some λ THE INVERSE POWER METHOD (or INVERSE ITERATION) , for , or (more usually) to

Continuous Time Markov Chains

Lecture 21: Numerical methods for pricing American type derivatives

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Lecture 5.8 Flux Vector Splitting

Continuous Time Markov Chain

Hongyi Miao, College of Science, Nanjing Forestry University, Nanjing ,China. (Received 20 June 2013, accepted 11 March 2014) I)ϕ (k)

CSCE 790S Background Results

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

Problem adapted reduced models based on Reaction-Diffusion Manifolds (REDIMs)

Multigrid Methods and Applications in CFD

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

On a Parallel Implementation of the One-Sided Block Jacobi SVD Algorithm

Strong Markov property: Same assertion holds for stopping times τ.

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Parametric fractional imputation for missing data analysis. Jae Kwang Kim Survey Working Group Seminar March 29, 2010

Composite Hypotheses testing

Finding The Rightmost Eigenvalues of Large Sparse Non-Symmetric Parameterized Eigenvalue Problem

Singular Value Decomposition: Theory and Applications

Appendix B. The Finite Difference Scheme

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Anouncements. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers. Multigrid Solvers

New Method for Solving Poisson Equation. on Irregular Domains

APPENDIX A Some Linear Algebra

Affine and Riemannian Connections

2.29 Numerical Fluid Mechanics Fall 2011 Lecture 12

Construction of Serendipity Shape Functions by Geometrical Probability

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

Review: Fit a line to N data points

Random Walks on Digraphs

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

A Computational Viewpoint on Classical Density Functional Theory

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Invariant deformation parameters from GPS permanent networks using stochastic interpolation

An Multigrid Tutorial

Representation theory and quantum mechanics tutorial Representation theory and quantum conservation laws

Entropy of Markov Information Sources and Capacity of Discrete Input Constrained Channels (from Immink, Coding Techniques for Digital Recorders)

( ) [ ( k) ( k) ( x) ( ) ( ) ( ) [ ] ξ [ ] [ ] [ ] ( )( ) i ( ) ( )( ) 2! ( ) = ( ) 3 Interpolation. Polynomial Approximation.

2.29 Numerical Fluid Mechanics

Deriving the X-Z Identity from Auxiliary Space Method

Developing an Improved Shift-and-Invert Arnoldi Method

Exhaustive Search for the Binary Sequences of Length 2047 and 4095 with Ideal Autocorrelation

[7] R.S. Varga, Matrix Iterative Analysis, Prentice-Hall, Englewood Clis, New Jersey, (1962).

5 The Rational Canonical Form

4DVAR, according to the name, is a four-dimensional variational method.

JAB Chain. Long-tail claims development. ASTIN - September 2005 B.Verdier A. Klinger

An introduction to the analysis and implementation of sparse grid finite element methods

Rough incomplete sketch of history of the WorldWideWeb (Note first that WorldWideWeb Internet, WWW is rather a protocol and set of resources that is

Annexes. EC.1. Cycle-base move illustration. EC.2. Problem Instances

Inexact Newton Methods for Inverse Eigenvalue Problems

6. Stochastic processes (2)

Neuro-Adaptive Design - I:

Dynamic Programming. Lecture 13 (5/31/2017)

EFFICIENT DOMAIN DECOMPOSITION METHOD FOR ACOUSTIC SCATTERING IN MULTI-LAYERED MEDIA

6. Stochastic processes (2)

NON-CENTRAL 7-POINT FORMULA IN THE METHOD OF LINES FOR PARABOLIC AND BURGERS' EQUATIONS

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD

Formal solvers of the RT equation

Queueing Networks II Network Performance

w ). Then use the Cauchy-Schwartz inequality ( v w v w ).] = in R 4. Can you find a vector u 4 in R 4 such that the

Portfolios with Trading Constraints and Payout Restrictions

Formulas for the Determinant

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Finite Element Modelling of truss/cable structures

Statistical Mechanics and Combinatorics : Lecture III

Statistical pattern recognition

Homework Notes Week 7

Hidden Markov Models & The Multivariate Gaussian (10/26/04)

Generalized Linear Methods

10-701/ Machine Learning, Fall 2005 Homework 3

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Feb 14: Spatial analysis of data fields

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

Convexity preserving interpolation by splines of arbitrary degree

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

DISCRIMINANTS AND RAMIFIED PRIMES. 1. Introduction A prime number p is said to be ramified in a number field K if the prime ideal factorization

Markov Chain Monte Carlo (MCMC), Gibbs Sampling, Metropolis Algorithms, and Simulated Annealing Bioinformatics Course Supplement

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

On a direct solver for linear least squares problems

Computing Correlated Equilibria in Multi-Player Games

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

Technische Universität Graz

Modified Mass Matrices and Positivity Preservation for Hyperbolic and Parabolic PDEs

Computational Astrophysics

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

Computational Information Games Houman Owhadi

Point cloud to point cloud rigid transformations. Minimizing Rigid Registration Errors

LECTURE 9 CANONICAL CORRELATION ANALYSIS

1 Matrix representations of canonical matrices

Information Geometry of Gibbs Sampler

Tests of Exclusion Restrictions on Regression Coefficients: Formulation and Interpretation

p 1 c 2 + p 2 c 2 + p 3 c p m c 2

Transcription:

Bootstrap AMG for Markov Chan Computatons Karsten Kahl Bergsche Unverstät Wuppertal May 27, 200

Outlne Markov Chans Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 2/6

Fnte homogeneous Markov Chans States s,..., s n, n N Transton probabltes p(s j s ) Transton matrx T = (t j ),j R n n t j = p(s j s ) s 7 s 2 Example: 0 7 0 2 T = 0 0 5 2 2 2 0 7 7 0 5 0 2 s 2 7 5 2 7 s 2 5 Bootstrap AMG for Markov Chan Computatons, Karsten Kahl /6

Propertes of Markov Chans Column-stochastc transton matrces T, t T = t, t = ( ) T rreducble exstence of unque steady-state soluton Tx = x, x > 0, x = spec r (B) U (0) = {z C, z < } Equvalent formulaton as system of lnear equatons Ax = (I T ) x = 0 t A = 0, span({x}) = null r (A), spec r (A) U () Bootstrap AMG for Markov Chan Computatons, Karsten Kahl /6

Power Method Iteratve method for computaton of steady-state soluton x k+ = Tx k = (I A) x k = x k Ax k Power method for T Rchardson teraton for A Wth = λ > λ 2... λ n 0 egenvalues of T x k x 2 = c λ 2 k Slow convergence for λ 2, yet fast reducton of components of x k correspondng to λ << Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 5/6

Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Approxmaton of Egenpar Tx = λ max x n a subspace V Bass v,..., v k of V, V = ( v v k ) Galerkn formulaton V t TVy = λ max V t Vy x = Vy x, λ max λ max Petrov-Galerkn formulaton W t TVy = λ max W t Vy x = Vy x, λ max λ max Specal case: Krylov subspaces V = K k Orthonormal bass v,..., v k, V t V = I B-orthogonal bass v,..., v k and w,..., w k, W t V = I Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 6/6

Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Ingredents of (Needed, Gven) Sparse lnear system of equatons Au = f Herarchy of sparse systems of lnear equatons A l u l = f l Approprate smoothng teratons S l Defnton of restrcton and nterpolaton R l+ l : V l V l+ and P l l+ : V l+ V l Defnton of operator herarchy A = A 0, A,..., A L A l+ = R l+ l A l P l l+ Columns of P l l+ form sparse bass for subspace V l+ n V l complementary to the smoother Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 7/6

Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Least Squares Interpolaton Computaton of nterpolaton weghts (p ) j, F, j C L C (p ) = k s= ω s (u (s) (p ) j u (s) j ) 2 mn p j C Test vectors u (),..., u (k) R n, Set of nterpolatory ponts C C for F ( Weghts ω s R + to bas LS ft, e.g., ω s = u (s) Au (s) Splttng of varables Ω = F C, Interpolaton P from C to Ω, ( ) Pfc P =, p I j 0, F, j C ) 2 Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 8/6

Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Egensolver Bootstrap Setup Test vectors ntally postve random, slghtly smoothed S η u (),..., S η u (k) MG herarchy wth nterpolaton Pl+ l, averagng restrcton R l+ l ( t R l+ l = t ) A l+ = R l+ l A l Pl+ l B l+ = R l+ l B l Pl+ l Bootstrap Multgrd Egensolver f Coarsest level then V L = {v (L) } =,...,kv A L v (L) = λ (L) B L v (L) else v (l) = Pl+ l v (l+) = λ (l+) λ (l) ( ) Relax A l λ (l) B l Update λ (l) end f v (l) = 0 = A l v (l),v (l) 2 B l v (l),v (l) 2 New approxmaton of steady-state vector, enhancement of TV set, qualty control of MG herarchy Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 9/6

Subspace Egenvalue Approxmaton Ingredents of Least Squares Interpolaton Egensolver Bootstrap Setup Bootstrap Multgrd Egensolver Cyclng Strateges Relax on Au = 0, u U Compute V, s.t., Av = λbv, v V Relax on Av = λbv, v V Relax on Au = 0, u U and Av = λbv, v V Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 0/6

Unform 2D Network 2 2 N 7 65 29 MLE 0 9 0 parnold 7 V 8 V 0 V 9 V 2 Accuracy 0 8 ω-jacob smoother wth ω =.7 TV sets U = V = 6 V(2, 2)-cycle, calber 2 Coarsest grd 5 5 Bootstrap AMG for Markov Chan Computatons, Karsten Kahl /6

Tandem Queueng Network µ y µ y µ µ µ y µ y µ x µ x µ x µ µ x µ y µ x µ µ x µ y µ =, µ x = 0, µ y = 0 N 7 65 29 MLE 8 8 8 8 parnold 6 V 6 V 6 V 7 V Accuracy 0 8 ω-jacob smoother wth ω =.7 TV sets U = V = 6 V(2, 2)-cycle, calber 2 Coarsest grd 5 5 Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 2/6

Random Planar Graph (a) Random planar graph, n = 256 (b) Coarsenng, n = 256 p(j ) = d out (j) Bootstrap AMG for Markov Chan Computatons, Karsten Kahl /6

Random Planar Graph N 256 52 02 208 MLE 5 20 20 20 parnold 8 V 0 V 0 V V Accuracy 0 8 ω-jacob smoother wth ω =.7 TV sets U = V = 6, calber 2 V(2, 2)-cycle, -grd method Bootstrap AMG for Markov Chan Computatons, Karsten Kahl /6

Conclusons and Outlook Conclusons Egensolver Reuse of AMG herarchy as a precondtoner Promsng and scalng results for smple Markov Chans Outlook More complex Markov Chans Theory for LS nterpolaton and MG Egensolver Effcent (parallel) mplementaton of Bootstrap AMG Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 5/6

Thank you for your attenton! Bootstrap AMG for Markov Chan Computatons, Karsten Kahl 6/6