Case Study of Markov Chains Ray-Knight Compactification

Similar documents
Asymptotics of the Solution of a Boundary Value. Problem for One-Characteristic Differential. Equation Degenerating into a Parabolic Equation

The Order Relation and Trace Inequalities for. Hermitian Operators

Existence of Two Conjugate Classes of A 5 within S 6. by Use of Character Table of S 6

Comparison of the Population Variance Estimators. of 2-Parameter Exponential Distribution Based on. Multiple Criteria Decision Making Method

Research Article Relative Smooth Topological Spaces

The Jacobsthal and Jacobsthal-Lucas Numbers via Square Roots of Matrices

Using T.O.M to Estimate Parameter of distributions that have not Single Exponential Family

Research Article Green s Theorem for Sign Data

Foundations of Arithmetic

Convexity preserving interpolation by splines of arbitrary degree

More metrics on cartesian products

General viscosity iterative method for a sequence of quasi-nonexpansive mappings

Continuous Time Markov Chain

EXPANSIVE MAPPINGS. by W. R. Utz

EXPONENTIAL ERGODICITY FOR SINGLE-BIRTH PROCESSES

6. Stochastic processes (2)

6. Stochastic processes (2)

International Journal of Algebra, Vol. 8, 2014, no. 5, HIKARI Ltd,

Valuated Binary Tree: A New Approach in Study of Integers

Appendix B. Criterion of Riemann-Stieltjes Integrability

Research Article The Solution of Two-Point Boundary Value Problem of a Class of Duffing-Type Systems with Non-C 1 Perturbation Term

THERE ARE INFINITELY MANY FIBONACCI COMPOSITES WITH PRIME SUBSCRIPTS

Research Article Global Sufficient Optimality Conditions for a Special Cubic Minimization Problem

Lecture 3: Probability Distributions

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

On the spectral norm of r-circulant matrices with the Pell and Pell-Lucas numbers

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

A Solution of the Harry-Dym Equation Using Lattice-Boltzmannn and a Solitary Wave Methods

Sharp integral inequalities involving high-order partial derivatives. Journal Of Inequalities And Applications, 2008, v. 2008, article no.

Ridge Regression Estimators with the Problem. of Multicollinearity

Research Article A Generalized Sum-Difference Inequality and Applications to Partial Difference Equations

Genericity of Critical Types

The Stationary Distributions of a Class of Markov Chains

On the set of natural numbers

STEINHAUS PROPERTY IN BANACH LATTICES

Probability Theory (revisited)

A Smashing Subcategory of the Homotopy Category of Gorenstein Projective Modules

Google PageRank with Stochastic Matrix

REAL ANALYSIS I HOMEWORK 1

j) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1

E Tail Inequalities. E.1 Markov s Inequality. Non-Lecture E: Tail Inequalities

APPENDIX A Some Linear Algebra

Continuous Time Markov Chains

Exercise Solutions to Real Analysis

A PROBABILITY-DRIVEN SEARCH ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS

A note on almost sure behavior of randomly weighted sums of φ-mixing random variables with φ-mixing weights

SPECTRAL PROPERTIES OF IMAGE MEASURES UNDER THE INFINITE CONFLICT INTERACTION

Linear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.

Voting Games with Positive Weights and. Dummy Players: Facts and Theory

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

Markov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal

PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 125, Number 7, July 1997, Pages 2119{2125 S (97) THE STRONG OPEN SET CONDITION

Geometry of Müntz Spaces

Research Article An Extension of Stolarsky Means to the Multivariable Case

ANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)

TAIL PROBABILITIES OF RANDOMLY WEIGHTED SUMS OF RANDOM VARIABLES WITH DOMINATED VARIATION

Analysis of Discrete Time Queues (Section 4.6)

Maximizing the number of nonnegative subsets

A Pursuit Problem Described by Infinite System of Differential Equations with Coordinate-Wise Integral Constraints on Control Functions

MATH 5707 HOMEWORK 4 SOLUTIONS 2. 2 i 2p i E(X i ) + E(Xi 2 ) ä i=1. i=1

FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

A Solution of Porous Media Equation

Power law and dimension of the maximum value for belief distribution with the max Deng entropy

A P PL I CA TIONS OF FRACTIONAL EXTERIOR DI F F ER EN TIAL IN THR EE- DI M ENSIONAL S PAC E Ξ

Amusing Properties of Odd Numbers Derived From Valuated Binary Tree

MAT 578 Functional Analysis

On quasiperfect numbers

Lecture 4: Constant Time SVD Approximation

Y. Guo. A. Liu, T. Liu, Q. Ma UDC

Lecture 17 : Stochastic Processes II

Copyright 2017 by Taylor Enterprises, Inc., All Rights Reserved. Adjusted Control Limits for U Charts. Dr. Wayne A. Taylor

Durban Watson for Testing the Lack-of-Fit of Polynomial Regression Models without Replications

Perron Vectors of an Irreducible Nonnegative Interval Matrix

The internal structure of natural numbers and one method for the definition of large prime numbers

Randić Energy and Randić Estrada Index of a Graph

VARIATION OF CONSTANT SUM CONSTRAINT FOR INTEGER MODEL WITH NON UNIFORM VARIABLES

The lower and upper bounds on Perron root of nonnegative irreducible matrices

On Graphs with Same Distance Distribution

COMPARISON OF SOME RELIABILITY CHARACTERISTICS BETWEEN REDUNDANT SYSTEMS REQUIRING SUPPORTING UNITS FOR THEIR OPERATIONS

First day August 1, Problems and Solutions

Dirichlet s Theorem In Arithmetic Progressions

See Book Chapter 11 2 nd Edition (Chapter 10 1 st Edition)

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

International Journal of Mathematical Archive-9(3), 2018, Available online through ISSN

Quantum Particle Motion in Physical Space

Existence results for a fourth order multipoint boundary value problem at resonance

Lecture 4: September 12

Introduction. - The Second Lyapunov Method. - The First Lyapunov Method

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Section 3.6 Complex Zeros

On the smoothness and the totally strong properties for nearness frames

Recover plaintext attack to block ciphers

ISSN On error probability exponents of many hypotheses optimal testing illustrations

Fluctuation Results For Quadratic Continuous-State Branching Process

REGULAR POSITIVE TERNARY QUADRATIC FORMS. 1. Introduction

THE CHVÁTAL-ERDŐS CONDITION AND 2-FACTORS WITH A SPECIFIED NUMBER OF COMPONENTS

APPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14

Monotonic Interpolating Curves by Using Rational. Cubic Ball Interpolation

Transcription:

Internatonal Journal of Contemporary Mathematcal Scences Vol. 9, 24, no. 6, 753-76 HIKAI Ltd, www.m-har.com http://dx.do.org/.2988/cms.24.46 Case Study of Marov Chans ay-knght Compactfcaton HaXa Du and YanLng Pan Department of Mathematcs and Statstcs Zhengzhou Normal Unversty Zhengzhou, 4544, Chna Copyrght 24 HaXa Du and YanLng Pan. Ths s an open access artcle dstrbuted under the Creatve Commons Attrbuton Lcense, whch permts unrestrcted use, dstrbuton, and reproducton n any medum, provded the orgnal wor s properly cted. Abstract It gves ay-knght compactfcatons of specfc examples to llustrate the complexty. Keywords: ay - Knght compactfcaton; Transfer functon;esolvent. Introducton Structural problems of Marov chan suffered for decades, s not completely resolved, the man reason s the general Marov chan has only locally strong Marov property. eference [] usng ay-knght compactfcaton method, construct strong Marov process correspondng to the transfer functon. eference [2] usng ay - Knght of the Marov chan method, proves that the Marov chan the exstence of the local tme of. eference [3], [4], [5] usng Marov chan ay-knght compactfcaton method, solves the structural problem of blateral brth- death process. eference [6] usng Marov chan ay-knght compactfcaton method, solves the structural problem of brth- death process. eference [7], [8] llustrates the relatonshp of Martn entrance boundary and ay-knght compactfcaton of mnmal Q-processes. Thus, ay-knght compactfcaton s the brdge to solve the problem of Marov chan structure. In ths artcle, we wll through specfc examples to llustrate the ay - Knght com-

754 HaXa Du and YanLng Pan pactfcaton of Marov chan, at the same tme, t shows that ay - Knght compactfcaton complexty. 2. Prelmnares Let E =,2,,we agree on the topology of E s dscrete topology, then E s a locally compact and has a countable topologcal space, and the functon of E s a contnuous functon. Called the state of the elements n E. All bounded functons on E denoted as M, wth bounded nonnegatve functons denoted as M, M and M topology s the topology of unform convergence. Sometmes we tae M and M elements as nfnte dmensonal,, column vector. The famly of functons Pt p t t on called the transfer functon on E, f p t p t 2 3 p t s p t p s If there s lm p t p t,, E, s, then called Ptt as a standard. Sad Ptt s honest (or not nterrupted), f establshed for E all equal sgn n (2). Known that f Ptt transfer functon s the standard, then there s a lmt: Matrx t p lm q,, E. and q, q q, q q. t t s called, E Q q t P t t of densty matrx on E. t Let e p t dt,, E,. ( ) s called the resolvent of

Case study of Marov chans ay-knght compactfcaton 755 Ptt ( ) s the resolvent of the transfer functon of only f the followng condtons (6) (9) holds ( ) (6) E P t t, f and ( ) ( ) ( ) ( ) ( ) (7) E lm ( ) = ( 8) lm ( ) = q ( 9) Let E =,2,,P (t) s the honesty transfer functon on E, ( ) s the resolvent of P (t), The norm of M s defned as: for arbtrary f M, f sup f. Let the functon f E s f. Obvously, f E s lnerator on M and. For any G M, let n u( G) = { u f n,, u, f G, n}, ( G) = { f f n, f, f G}, n n Tae H= H I E, then H s countable sudset of G, let () ( n) ( n) ( n) = u( H), = ( + u( )), ( n) =. let g m m= n s the dense subset of, d( x, y) = [ gm( x) gm( y) ], x, y S, ( ) m 2 m Then d, s the measure on E. E s the completon of the E under d, Apparently, E s compact metrc space, called ay-knght compactfcaton of E. ( ) can expand nto U x, dy whch s the ray resolvent on E, P x, dy t.

756 HaXa Du and YanLng Pan s the ray sem-group correspondng to U x, dy E,P, x. Let D x x x, then D s called non-branch pont sets, the pont of D s called non-branch pont. 3. Example of ay-knght compactfcaton Let E =,2,, q q q2 q2 Q q3 q3 q, q 2, are a lst of ntegers. The mnmum transfer functon of Q s named m n m n P t, the resolvent of P t defned by f mn ( q ) ( q ), f () f ( q ) and m n P t s honest f and only f - = q (references 9 ). m n Example. Let the mnmum transfer functon P t s honest, then q - =. mn to satsfy the followng assumptons: () E s topologcal space whch s the locally compact and has countable topologcal base (eferred to as L.C.C.B); (2) C E C E s Marov and, b b for arbtrary > ; mn (3) For arbtrary f C E and x E, f x f x Proof. For arbtrary b lm,lm. f, lm f. Usng mathematcal nducton, t s

Case study of Marov chans ay-knght compactfcaton 757 easy to prove that for arbtrary n, lm. By denotng E f f E=, then E s the one pont compactfcaton of E. For arbtrary,, lm. so U E E, D E. then U,. s a non-branch pont. Example 2. Let,, 2, s a probablty measure on E., for arbtrary E, m n the mnmum transfer functon mnum Ptt s transfer founcton of Doob process whch s Proof. From references 9, we now that - = contnue. The condtons dstrbuton of P X = P t s nterrupt, Q, type. q, the orbt of {X t } s rght s remembered to P, the correspondng condtonal expectaton s remembered to E.Let nf sx s =, then s the frst leap pont and the followng equaton, E, > ( 2), The resolvent of holds. E { e } ( q ) mn ( ) mn E follows: ( ) ( ) +E{ e },, E ( 3). [ E { e }] For any, E,,obvously, E mn ( ) mn E E e E E e lm { },lm ( ),lm ( ). [ { }] P t s as Modeled on the example one, t s easy to prove that for arbtrary n, lm s exst. By the defnton of E, then f f arbtrary, by the defnton of U,then E= E, For

758 HaXa Du and YanLng Pan mn ( ) E U (, ) lm ( ), E. [ E { e }] E Therefore, U E P non-branch pont.,,,, for arbtrary E. s a E =. E, D E emar: In the same way to prove the followng concluson, f there s E mae that, then the ay-knght compactfcaton of E s named E whch meets the followng equaton, E E. and s the lmt pont of the sequence pont of,2,3,. At the same tme, E E E D. Example 3. Let,, 2, s a probablty measure on E., for arbtrary E, The Marov chan m n the mnmum transfer functon mnum t X correspondng to P t s nterrupt, P t t s not Doob process. Proof. From references, we now that - = q, q lm E e lm. q Snce Q s sngle outflow zero nflow, accordng to the general conclusons of sngle outflow of Marov chan, so there s,,2,,such that Moreover, ( ), [ E { e }], > ( 4) s the resolvent of the transfer functon of mn ( ) mn E E E e P t t and ( ) ( ) +E{ e },, E, > ( 5) [ { }] Modeled on the example two, we can prove that E= E, For arbtrary

Case study of Marov chans ay-knght compactfcaton 759, mn ( ) E U (, ) lm ( ), E. [ E { e }] E (6) t Use the formula of (4), then lm U,, that s P E E D E { }. lm,. So For the transfer functon whch contans nstantaneous state, t s ay-knght compactfcaton structure s more complcated, please loo at the case. Example 4. If q,, 2, s a lst of postve number, consder the followng matrx Q-. t q2 q2 Q q3 q3 q q 4 4 wth q. 2 The matrx s called Kolmogorov matrx. It corresponds to the resolvent ( ) ( 2 ) q ( ) ( ), q 2 q ( ) ( ), 2 q q ( ) ( ),, 2 q q q Obvously, lm ( ) ( ), t s easy to prove E= E, and under the topology of ay-knght, s the lmt pont of the sequence pont of 2,3,.

76 HaXa Du and YanLng Pan eferences [] J. C. Dong, Marov chans ay-knght compactfcaton, Zhengzhou Unversty, 26. [2] Q. L. Zhao, Local tme of Marov chans on the S, Zhengzhou Unversty, 26. [3] L. Chen, Paths of B-lateral Brth-Death Processes and constructon theory, Journal of Henan Unversty (Natural Scence), 4 (22), 337-342. [4] L. Chen, Paths of B-lateral Brth-Death Processes and constructon theory, Journal of, Henan Unversty (Natural Scence), (23), 5 -. [5] L. Chen, L. X. Xue, Paths of B-lateral Brth-Death Processes and theory of Motoo, Journal of Zhengzhou Unversty (Natural Scence Edton), (24), 42-46. [6] X. J. Zhao, G. J. Yan, Paths of Brth-Death Processes, Chnese Journal of Appled Probablty and Statstcs, (23), - 22. [7] C. W. Xu, G. J Yan, Martn Entrance Boundary and ay-knght Compactfcaton of Mnmal Q-Processes, Chnese Journal of Appled Probablty and Statstcs, 6 (2), 633-64. [8] S. S. Hao, C. W. Xu, Case Study of ay-knght Compactfcaton and Martn Entrance Boundary of Mnmal Q-Processes, Journal of Tonghua Teachers College, 6 (24), 28-3. [9] ogers, L. C. G. and Wllams, D., Dffusons, Marov Processes and Martngales (Volume Ito Calculus), Cambrdge Mathematcal Lbrary, Cambrdge Unversty Press, 2. [] Z. K. Wang, X. Q. Yang, brth and death processes and Marov chans, Scence Press, Beng, 25. eceved: October 5, 24; Publshed: December 8, 24