Weakly Short Memory Stochastic Processes: Signal Processing Perspectives
|
|
- Austin Benson
- 5 years ago
- Views:
Transcription
1 Weakly Short emory Stochastic Processes: Signal Processing Persectives by Garimella Ramamurthy Reort No: IIIT/TR/9/85 Centre for Security, Theory and Algorithms International Institute of Information Technology Hyderabad - 5 3, INDIA December 9
2 WEAKLY SHORT EORY STOCHASTIC PROCESSES: SIGNAL PROCESSING PERSPECTIVES Garimella Rama urthy, Associate Professor, International Institute of Information Technology, Gachibowli, Hyderabad-53, AP, INDIA ABSTRACT Traditionally wide sensor stationary (WSS) stochastic rocesses are classified as long memory and short memory rocesses based on the correlation coefficient series In this research aer, we roose a fine grain classification of WSS rocesses into weakly short memory stochastic rocesses using the associated set of indices Some roerties of the indices are roved The results are naturally extraolated to structured numerical and ower series Introduction: Probability theory originated in modeling games of chance Also, modeling dynamic games ( reeated exeriments ) led to the concet of a stochastic rocess characterized by the associated finite dimensional distributions By imosing some constraints on the finite dimensional distributions, strict and wide sense stationary stochastic rocesses were roosed These rocesses rovided tractable models of various natural and artificial henomena [PaP] In the case of wide sense stationary stochastic rocesses, the autocorrelation function summarizes the second order deendence of the underlying sequence of random variables Also, the autocorrelation coefficient sequence ( for different lags ), characterizes a wide sense stationary stochastic rocesses Let this sequence be denoted by { ρ ( s): s < } for non-negative lag values A wide sense stationary stochastic rocess was classified into the following two categories : (i) Short emory Stochastic Process and (ii) Long emory Stochastic Process based on the absolute summability of infinte series associated with the autocorrelation coefficient sequence The author felt that this classification was very coarse Thus, an effort to rovide a fine grain classification of WSS stochastic rocesses resulted in this research aer The classification is based on associating the autocorrelation coefficient sequence with an infinite set of indices This research aer is organized as follows In Section, discrete time weakly short memory stochastic rocesses are studied Section 3 considers the continuous time, weakly short memory stochastic rocesses In Section 4, results are generalized to structured
3 infinite series In Section 5, signal rocessing ersectives are included In Section 6, future research directions are included Finally, the conclusions are documented in Section 7 Weakly Short emory Stochastic Processes: Discrete Time Case: Consider a Wide Sense Stationary (WSS) discrete time stochastic rocess, X(t) Let the associated autocorrelation coefficient sequence be { ρ (s) } with s being the lag [PaP] The following definition is well known in the theory of such stochastic rocesses Definition: A discrete time, wide sense stationary stochastic rocess is called a short memory stochastic rocess if s < The following lemma follows easily Lemma : If X(t) is a short memory stochastic rocess with the associated autocorrelation coefficient sequence ρ (s) Then ρ ( s) is strictly equal to one for atmost finitely many lags s Proof: Suose not Thus, say that the autocorrelation coefficient is equal to one for infinitely many values of the lag Thus, consider the set B B { s: ρ ( } Suose the cardinality of B ( ie B ) is infinite ( countable ) Then, it is evident that + Z B Υ C, where C { s: ρ ( < } Thus, we necessarily have that + s s B + Hence X(t) is not a short memory rocess Thus we arrive at a contradiction Thus, we necessarily have that ρ (s) is equal to one for atmost finitely many values of the lag s QED Remark : Let L be the value of lag after which ρ (s) is strictly less than one Thus for the short memory stochastic rocess under consideration, we have the following inference: If s L, then ρ (s) or ρ (s) <
4 But for all s > L, ρ (s) < In view of this fact, let us redefine the sets B and C : B { s : s L} and C { s : s ( L + ) } () Now, let us consider the infinite dimensional vector of autocorrelation coefficient values for different lags ie ie ρ [ ρ ( ), ρ(), ρ() ] By definition, X(t) is a short memory stochastic rocess if the L norm of ρ is finite This interretation led us to consider the L norm of ρ for < < [Roy] Lemma : Let s For any discrete time WSS stochastic rocess, the following inequalities hold true ie 3 ie ' s constitute a monotone decreasing sequence Proof: By definition s ) + s ), s s B where the sets B and C are same as those defined in Remark Thus, we have + N + ρ( s) and + N + + ρ ( s) By the definition of sets B and C, we have N + N, with the strict inequality holding if for atleast one value of ρ ( < Also, it is clear that + s ) > ρ ( Hence, for all integer valuesof, we have that + Thus, QED 3 s B, Remark : The inequalities are strict for many interesting Wide Sense Stationary ( WSS ) discrete time stochastic rocesses Secifically, suose there exists an s B, for which ρ ( s) < Then > > 3 > ie
5 Lemma 3: For most interesting discrete time, Wide Sense Stationary (WSS), short memory stochastic rocesses, ( In the roof, we secify the required conditions ) < Proof: Suose there exists an s B, for which ρ ( s) < Also, suose the cardinality of set C is larger than or equal to one, then we have that Lt + < Hence, on the alication of the ratio test, we have that < QED Note: Using the modified definition of sets B, C and the integer L ( as in equation () ), we have that ρ( s L on exchanging the order of summation Thus we necessarily have that s L Remark 3: The set of quantities / indices ' s characterize a discrete time wide sense stationary stochastic rocess Equivalently, we define the following indices θ ' s : Let I s) Then s B s L s L θ I Suose, we consider a short memory stochastic rocess Then Lemma imlies that the indices s are all finite But in the case of an arbitrary discrete time stochastic rocess, it can haen that t and j < for all j t In the case of traditional classification, all such rocesses are broadly classified as long memory stochastic rocesses Thus this classification is very broad Using the following definition, we make a finer classification of long memory stochastic rocesses Definition: A discrete time wide sense stationary stochastic rocess is weakly short memory rocess of t th kind if
6 < for all j j t In the case of such stochastic rocesses, under reasonable conditions, we have that t < Remark 4: Using reasoning similar to the one utilized reviously, it is easy to see that t Lt Thus, using an aroriate truncation condition, any discrete time, short memory stochastic rocess can be characterized by finitely many indices s ie say {,,, l } Using, a similar aroach, long memory stochastic rocesses also can be characterized by finitely many indices Remark 5: Consider the vector of autocorrelation coefficients ie ρ [ ρ ( ), ρ(), ρ() ] Let this vector be associated with a discrete time short memory s stochastic rocess ie K < Consider the related vector ρ [ ), ρ(), ρ(),] and normalize all its comonents by the finite real number K Thus, we arrive at the following vector of robabilities ρ ρ() ) ),,, K K K K This robability mass function is naturally associated with the autocorrelation coefficient function Its moments will have interesting interretation 3 Weakly Short emory Stochastic Processes: Continuous Time Case: Now let us consider continuous time stochastic rocesses Secifically, we have the following definition Definition : A continuous time wide sense stationary stochastic rocess is called a short memory stochastic rocess if ρ( s) ds and <
7 As in the case of discrete time stochastic rocesses, we are led to the consideration of the following quantities [Roy]: ds Lemma 4: Using the above definition, we have that 3 for any continuous time, wide sense stationary stochastic rocess + R { s : } + { s : s) < } Proof: Let B Υ C We have that ds s ) ds + s) ds B m(b) + C C s ) ds ( m(b) denotes the Lebesgue measure of the set B ) Thus, if the stochastic rocess is a short term memory rocess, then m(b) < Goal : To rove that + for all ds m( B) + Now let us consider s) ds C C By the definition of set C, s C imlies that ρ ( < Hence, we necessarily have that + ρ ( s ) < s) Thus, we have + for all ie QED 3 Remark 6: The inequalities are strict if m( C ) > Under reasonable conditions, for a short memory continuous time, stochastic rocess, we have that ( as in Lemma 3 ) < ds
8 Remark 7: As in the case of discrete time, wide sense stationary stochastic rocesses, we have the following definition Definition: A continuous time wide sense stationary stochastic rocess is weakly short memory rocess of t th kind if t and j < for all j t For such a rocess, under reasonable conditions, we have that t < Thus, even in the case of continuous time, wide sense stationary stochastic rocesses, under reasonable truncation condition, finitely many indices ie s characterize the rocess Probability Density Function Associated with the Autocorrelation Function of a Continuous Time Short emory Process: Let ds Q Thus, on normalization, we necessarily have that ds Q Thus, g( s) is a robability density function associated with Q the autocorrelation coefficient function of a continuous time, short memory stochastic rocess It has interesting interretation in terms of the lag The moments of such a function will be of utility in characterizing the autocorrelation coefficient function The above results naturally motivate us to take a closer look of absolutely convergent numerical series This is done in the following section 4 Absolutely Convergent Series : New Direction: Consider an absolutely convergent infinite series ie s K( < (4) Hence the following necessary condition on K(s) is satisfied ie Lt K( s Thus, there exists an integer J such that K ( s) < for all s ( J +)
9 Now consider J K( K( + s s s J+ K( Thus, as in the case of autocorrelation coefficient series, we associate the following countable collection of infinite series with an arbitrary absolutely convergent series ( given in (4) ) s J + for N K( < As in the case of section, it is easy to show that N N N 3 Thus, a finite / infinite collection of indices ie N i ' s can be naturally associated with an absolutely convergent series ( as in (4)) Remark 8: As in the case of section 3, consider a bounded function of continuous variable t ie f(t) Define the following indices f ( t) dt As in section 3, it can be shown that 3 Details are avoided for brevity This result, thus deals with the relationshi between the norms of a bounded continuous function L - 5 Signal Processing Persectives: Consider the infinite sequence of correlation coefficients as a discrete time signal As in digital signal rocessing [OS], let the discrete time Fourier transform of the signal { ρ ( s): s < } be j ω ρ e ( ) s ρ ( s) e jω s j ω It is well known that ρ ( e ) is a eriodic function with eriod From the above definition, we have that j ω ρ ( e ) ρ ( s ω ) s π We know that if ρ ( < imlies that ρ ( s) < Thus, one s s can study the nature of Discrete Time Fourier Transform (DTFT) of the autocorrelation coefficient sequence leading to frequency domain ersectives
10 Consider a Linear Time Invariant ( LTI ) system with the imulse resonse sequence { h ( k) : < k < } The linear system is stable if and only if [OS] k h ( k) < The Discrete Time Fourier Transform of the imulse resonse sequence is also called the frequency resonse of the discrete time LTI system It is well known that the frequency resonse of a stable LTI system will always converge If a sequence is absolutely summable, it will also have finite energy ie n x( n) < This follows from the fact that [ x( )] ( n) n x It is not true, however, that a sequence with finite energy is absolutely summable For a general discrete time sequence x(n) j ω with the associated Discrete Time Fourier Transform X ( e ), we have the following result, called the Parseval s Theorem: n x( n) x * ( n) π + π π X ( e j ω ) X * ( e j ω ) dω In view of the results in Section, we introduce the following concet associated with a discrete time LTI system Let h (n) be the imulse resonse of such a system We call the system th order stable if n h ( n) < for < Thus, we can have an unstable system in the traditional sense, but is stable in the above modified sense Results related to such systems need to be investigated in detail 6 Future Research Directions: The investigation related to short memory rocesses naturally leads to the following research directions: In the theory of L saces and L norms of finite/infinite dimensional vectors, Holder, inkowski and Jensen inequalities
11 are well studied Those inequalities are invoked in the resent investigation [Roy] Consider a bounded infinite dimensional vector ( ie all the elements are bounded in absolute value by a finite constant) ie [ b, b,] Let the associated infinite series be absolutely convergent ie < Define the following ower series j associated with such a sequence ie b j j x ( ) b j x for x J j Thus, the set J constitutes the region of convergence Inside the region of convergence, the ower series is uniformly convergent ( by Weierstrass s -test ) We associate the following class of ower series with ( x ) ie j ( x) b j x for < j Using simle calculation the region of convergence of such ower series can easily be detemined Let ϕ () be a structured function ( such as a convex / monotone function ) Consider the case where < In other words, we have an absolutely convergent series and we would like to investigate the convergence of the associated series ϕ ( ) In such an investigation, we exect the Jensen inequality ( associated with infinite dimensional vectors ) to be of utility ore generally the convergence of associated ower series will be investigated j b j j b j ulti-dimensional Versions: Based on the results in sections and 3, one is naturally led to consider multi-variate wide sense stationary stochastic rocesses or random fields Thus, in its most generic form, we will investigate the convergence/ divergence of the following structured numerical as well as ower series ( for < ): s s sl ρ ( s, s,, s ) given that ρ ( s, s,, ) l s l s s sl ρ ( s s s, s,, sl ) x x x sl l
12 The results of this investigation are naturally extraolated to multi-variate ower series whose coefficients are bounded in magnitude Consider the stochastic rocess Y(t) such that q [ X ( t) ] for < Y ( t) q Given that X(t) is a short / long memory WSS stochastic rocess, we study the nature ( long / short memory ) of the stochastic rocess, Y(t) Secifically, suose we consider [ X ( ) ] Y ( t) t and X(t) is a Gaussian rocess Let { η Y (s) } be the autocorrelation coefficient sequence of the rocess Y(t) and { ρ X (s)} be the autocorrelation coefficient sequence of the rocess X(t) It can be easily shown that η (s) [ ( s)] Y 7 Conclusions: In this research aer, we roose a fine grain classification of long memory Wide Sense Stationary (WSS) stochastic rocesses by associating a set of indices Some roerties of the indices are roved The results are extraolated to structured absolutely convergent series Briefly signal rocessing ersectives are summarized Finally some future research directions are roosed ρ X ACKNOWLEDGEENTS The author would like to thank Prof TSubba Rao of the University of anchester During his talk on Time Series Analysis at the CR RAO Advanced Institute of athematics, Statistics and Comuter Science (AISCS) the author generated the ideas documented here REFERENCES: [Roy] HLRoyden, Real Analysis, Prentice Hall of India, New Delhi-7 [PaP] APaoulis and SUPillai, Probability, Random Variables and Stochastic Processes, Tata cgraw Hill, New Delhi [OS] AVOenheim and RWSchafer, Digital Signal Processing, Prentice Hall of India, New Delhi-
Bounded Infinite Sequences/Functions : Orders of Infinity
Bounded Infinite Sequences/Functions : Orders of Infinity by Garimella Ramamurthy Report No: IIIT/TR/2009/247 Centre for Security, Theory and Algorithms International Institute of Information Technology
More informationChance and Zero Polynomials
Chance and Zero Polynomials by Garimella Ramamurthy Report No: IIIT/TR/2015/-1 Centre for Security, Theory and Algorithms International Institute of Information Technology Hyderabad - 500 032, INDIA August
More informationAlso, in recent years, Tsallis proposed another entropy measure which in the case of a discrete random variable is given by
Gibbs-Shannon Entropy and Related Measures: Tsallis Entropy Garimella Rama Murthy, Associate Professor, IIIT---Hyderabad, Gachibowli, HYDERABAD-32, AP, INDIA ABSTRACT In this research paper, it is proved
More informationElementary Analysis in Q p
Elementary Analysis in Q Hannah Hutter, May Szedlák, Phili Wirth November 17, 2011 This reort follows very closely the book of Svetlana Katok 1. 1 Sequences and Series In this section we will see some
More informationGeneral Linear Model Introduction, Classes of Linear models and Estimation
Stat 740 General Linear Model Introduction, Classes of Linear models and Estimation An aim of scientific enquiry: To describe or to discover relationshis among events (variables) in the controlled (laboratory)
More informationTHE 2D CASE OF THE BOURGAIN-DEMETER-GUTH ARGUMENT
THE 2D CASE OF THE BOURGAIN-DEMETER-GUTH ARGUMENT ZANE LI Let e(z) := e 2πiz and for g : [0, ] C and J [0, ], define the extension oerator E J g(x) := g(t)e(tx + t 2 x 2 ) dt. J For a ositive weight ν
More informationLecture 6. 2 Recurrence/transience, harmonic functions and martingales
Lecture 6 Classification of states We have shown that all states of an irreducible countable state Markov chain must of the same tye. This gives rise to the following classification. Definition. [Classification
More informationStatics and dynamics: some elementary concepts
1 Statics and dynamics: some elementary concets Dynamics is the study of the movement through time of variables such as heartbeat, temerature, secies oulation, voltage, roduction, emloyment, rices and
More informationTowards understanding the Lorenz curve using the Uniform distribution. Chris J. Stephens. Newcastle City Council, Newcastle upon Tyne, UK
Towards understanding the Lorenz curve using the Uniform distribution Chris J. Stehens Newcastle City Council, Newcastle uon Tyne, UK (For the Gini-Lorenz Conference, University of Siena, Italy, May 2005)
More informationOptimization of Quadratic Forms: NP Hard Problems : Neural Networks
1 Optimization of Quadratic Forms: NP Hard Problems : Neural Networks Garimella Rama Murthy, Associate Professor, International Institute of Information Technology, Gachibowli, HYDERABAD, AP, INDIA ABSTRACT
More informationHaar type and Carleson Constants
ariv:0902.955v [math.fa] Feb 2009 Haar tye and Carleson Constants Stefan Geiss October 30, 208 Abstract Paul F.. Müller For a collection E of dyadic intervals, a Banach sace, and,2] we assume the uer l
More informationBrownian Motion and Random Prime Factorization
Brownian Motion and Random Prime Factorization Kendrick Tang June 4, 202 Contents Introduction 2 2 Brownian Motion 2 2. Develoing Brownian Motion.................... 2 2.. Measure Saces and Borel Sigma-Algebras.........
More informationApplications to stochastic PDE
15 Alications to stochastic PE In this final lecture we resent some alications of the theory develoed in this course to stochastic artial differential equations. We concentrate on two secific examles:
More informationAnalysis of some entrance probabilities for killed birth-death processes
Analysis of some entrance robabilities for killed birth-death rocesses Master s Thesis O.J.G. van der Velde Suervisor: Dr. F.M. Sieksma July 5, 207 Mathematical Institute, Leiden University Contents Introduction
More informationThe non-stochastic multi-armed bandit problem
Submitted for journal ublication. The non-stochastic multi-armed bandit roblem Peter Auer Institute for Theoretical Comuter Science Graz University of Technology A-8010 Graz (Austria) auer@igi.tu-graz.ac.at
More informationStochastic Processes. M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno
Stochastic Processes M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno 1 Outline Stochastic (random) processes. Autocorrelation. Crosscorrelation. Spectral density function.
More informationON JOINT CONVEXITY AND CONCAVITY OF SOME KNOWN TRACE FUNCTIONS
ON JOINT CONVEXITY ND CONCVITY OF SOME KNOWN TRCE FUNCTIONS MOHMMD GHER GHEMI, NHID GHRKHNLU and YOEL JE CHO Communicated by Dan Timotin In this aer, we rovide a new and simle roof for joint convexity
More informationSums of independent random variables
3 Sums of indeendent random variables This lecture collects a number of estimates for sums of indeendent random variables with values in a Banach sace E. We concentrate on sums of the form N γ nx n, where
More information1 Riesz Potential and Enbeddings Theorems
Riesz Potential and Enbeddings Theorems Given 0 < < and a function u L loc R, the Riesz otential of u is defined by u y I u x := R x y dy, x R We begin by finding an exonent such that I u L R c u L R for
More informationCHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules
CHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules. Introduction: The is widely used in industry to monitor the number of fraction nonconforming units. A nonconforming unit is
More informationElementary theory of L p spaces
CHAPTER 3 Elementary theory of L saces 3.1 Convexity. Jensen, Hölder, Minkowski inequality. We begin with two definitions. A set A R d is said to be convex if, for any x 0, x 1 2 A x = x 0 + (x 1 x 0 )
More information3.4 Design Methods for Fractional Delay Allpass Filters
Chater 3. Fractional Delay Filters 15 3.4 Design Methods for Fractional Delay Allass Filters Above we have studied the design of FIR filters for fractional delay aroximation. ow we show how recursive or
More informationSobolev Spaces with Weights in Domains and Boundary Value Problems for Degenerate Elliptic Equations
Sobolev Saces with Weights in Domains and Boundary Value Problems for Degenerate Ellitic Equations S. V. Lototsky Deartment of Mathematics, M.I.T., Room 2-267, 77 Massachusetts Avenue, Cambridge, MA 02139-4307,
More informationMultiplicity of weak solutions for a class of nonuniformly elliptic equations of p-laplacian type
Nonlinear Analysis 7 29 536 546 www.elsevier.com/locate/na Multilicity of weak solutions for a class of nonuniformly ellitic equations of -Lalacian tye Hoang Quoc Toan, Quô c-anh Ngô Deartment of Mathematics,
More informationChapter 7: Special Distributions
This chater first resents some imortant distributions, and then develos the largesamle distribution theory which is crucial in estimation and statistical inference Discrete distributions The Bernoulli
More informationChapter 6. Random Processes
Chapter 6 Random Processes Random Process A random process is a time-varying function that assigns the outcome of a random experiment to each time instant: X(t). For a fixed (sample path): a random process
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationA CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS. 1. Abstract
A CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS CASEY BRUCK 1. Abstract The goal of this aer is to rovide a concise way for undergraduate mathematics students to learn about how rime numbers behave
More informationMATHEMATICAL MODELLING OF THE WIRELESS COMMUNICATION NETWORK
Comuter Modelling and ew Technologies, 5, Vol.9, o., 3-39 Transort and Telecommunication Institute, Lomonosov, LV-9, Riga, Latvia MATHEMATICAL MODELLIG OF THE WIRELESS COMMUICATIO ETWORK M. KOPEETSK Deartment
More informationThe Longest Run of Heads
The Longest Run of Heads Review by Amarioarei Alexandru This aer is a review of older and recent results concerning the distribution of the longest head run in a coin tossing sequence, roblem that arise
More informationELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process
Department of Electrical Engineering University of Arkansas ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Definition of stochastic process (random
More informationOn Introducing Asymmetry into Circular Distributions
Statistics in the Twenty-First Century: Secial Volume In Honour of Distinguished Professor Dr. Mir Masoom Ali On the Occasion of his 75th Birthday Anniversary PJSOR, Vol. 8, No. 3, ages 531-535, July 2012
More informationUniversity Question Paper Solution
Unit 1: Introduction University Question Paper Solution 1. Determine whether the following systems are: i) Memoryless, ii) Stable iii) Causal iv) Linear and v) Time-invariant. i) y(n)= nx(n) ii) y(t)=
More informationIMPROVED BOUNDS IN THE SCALED ENFLO TYPE INEQUALITY FOR BANACH SPACES
IMPROVED BOUNDS IN THE SCALED ENFLO TYPE INEQUALITY FOR BANACH SPACES OHAD GILADI AND ASSAF NAOR Abstract. It is shown that if (, ) is a Banach sace with Rademacher tye 1 then for every n N there exists
More informationUniformly best wavenumber approximations by spatial central difference operators: An initial investigation
Uniformly best wavenumber aroximations by satial central difference oerators: An initial investigation Vitor Linders and Jan Nordström Abstract A characterisation theorem for best uniform wavenumber aroximations
More informationA FEW EQUIVALENCES OF WALL-SUN-SUN PRIME CONJECTURE
International Journal of Mathematics & Alications Vol 4, No 1, (June 2011), 77-86 A FEW EQUIVALENCES OF WALL-SUN-SUN PRIME CONJECTURE ARPAN SAHA AND KARTHIK C S ABSTRACT: In this aer, we rove a few lemmas
More informationRobustness of classifiers to uniform l p and Gaussian noise Supplementary material
Robustness of classifiers to uniform l and Gaussian noise Sulementary material Jean-Yves Franceschi Ecole Normale Suérieure de Lyon LIP UMR 5668 Omar Fawzi Ecole Normale Suérieure de Lyon LIP UMR 5668
More informationLECTURE 7 NOTES. x n. d x if. E [g(x n )] E [g(x)]
LECTURE 7 NOTES 1. Convergence of random variables. Before delving into the large samle roerties of the MLE, we review some concets from large samle theory. 1. Convergence in robability: x n x if, for
More informationReducing Risk in Convex Order
Reducing Risk in Convex Order Junnan He a, Qihe Tang b and Huan Zhang b a Deartment of Economics Washington University in St. Louis Camus Box 208, St. Louis MO 6330-4899 b Deartment of Statistics and Actuarial
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More informationMATH 2710: NOTES FOR ANALYSIS
MATH 270: NOTES FOR ANALYSIS The main ideas we will learn from analysis center around the idea of a limit. Limits occurs in several settings. We will start with finite limits of sequences, then cover infinite
More information6 Stationary Distributions
6 Stationary Distributions 6. Definition and Examles Definition 6.. Let {X n } be a Markov chain on S with transition robability matrix P. A distribution π on S is called stationary (or invariant) if π
More informationFeedback-Based Iterative Learning Control for MIMO LTI Systems
International Journal of Control, Feedback-Based Automation, Iterative and Systems, Learning vol. Control 6, no., for. MIMO 69-77, LTI Systems Aril 8 69 Feedback-Based Iterative Learning Control for MIMO
More informationOnline Appendix to Accompany AComparisonof Traditional and Open-Access Appointment Scheduling Policies
Online Aendix to Accomany AComarisonof Traditional and Oen-Access Aointment Scheduling Policies Lawrence W. Robinson Johnson Graduate School of Management Cornell University Ithaca, NY 14853-6201 lwr2@cornell.edu
More informationCalculation of MTTF values with Markov Models for Safety Instrumented Systems
7th WEA International Conference on APPLIE COMPUTE CIENCE, Venice, Italy, November -3, 7 3 Calculation of MTTF values with Markov Models for afety Instrumented ystems BÖCÖK J., UGLJEA E., MACHMU. University
More informationResearch Article Positive Solutions of Sturm-Liouville Boundary Value Problems in Presence of Upper and Lower Solutions
International Differential Equations Volume 11, Article ID 38394, 11 ages doi:1.1155/11/38394 Research Article Positive Solutions of Sturm-Liouville Boundary Value Problems in Presence of Uer and Lower
More informationA Note on Massless Quantum Free Scalar Fields. with Negative Energy Density
Adv. Studies Theor. Phys., Vol. 7, 13, no. 1, 549 554 HIKARI Ltd, www.m-hikari.com A Note on Massless Quantum Free Scalar Fields with Negative Energy Density M. A. Grado-Caffaro and M. Grado-Caffaro Scientific
More informationNew Schedulability Test Conditions for Non-preemptive Scheduling on Multiprocessor Platforms
New Schedulability Test Conditions for Non-reemtive Scheduling on Multirocessor Platforms Technical Reort May 2008 Nan Guan 1, Wang Yi 2, Zonghua Gu 3 and Ge Yu 1 1 Northeastern University, Shenyang, China
More informationOn the capacity of the general trapdoor channel with feedback
On the caacity of the general tradoor channel with feedback Jui Wu and Achilleas Anastasooulos Electrical Engineering and Comuter Science Deartment University of Michigan Ann Arbor, MI, 48109-1 email:
More informationStructured Multi Matrix Variate, Matrix Polynomial Equations: Solution Techniques
Structured Multi Matrix Variate, Matrix Polynomial Equations: Solution Techniques Garimella Rama Murthy, Associate Professor, IIIT Hyderabad, Gachibowli, HYDERABAD-32, AP, INDIA ABSTRACT In this research
More informationAnalysis of Multi-Hop Emergency Message Propagation in Vehicular Ad Hoc Networks
Analysis of Multi-Ho Emergency Message Proagation in Vehicular Ad Hoc Networks ABSTRACT Vehicular Ad Hoc Networks (VANETs) are attracting the attention of researchers, industry, and governments for their
More informationCommutators on l. D. Dosev and W. B. Johnson
Submitted exclusively to the London Mathematical Society doi:10.1112/0000/000000 Commutators on l D. Dosev and W. B. Johnson Abstract The oerators on l which are commutators are those not of the form λi
More informationA note on the random greedy triangle-packing algorithm
A note on the random greedy triangle-acking algorithm Tom Bohman Alan Frieze Eyal Lubetzky Abstract The random greedy algorithm for constructing a large artial Steiner-Trile-System is defined as follows.
More informationRecursive Estimation of the Preisach Density function for a Smart Actuator
Recursive Estimation of the Preisach Density function for a Smart Actuator Ram V. Iyer Deartment of Mathematics and Statistics, Texas Tech University, Lubbock, TX 7949-142. ABSTRACT The Preisach oerator
More informationDistributed Rule-Based Inference in the Presence of Redundant Information
istribution Statement : roved for ublic release; distribution is unlimited. istributed Rule-ased Inference in the Presence of Redundant Information June 8, 004 William J. Farrell III Lockheed Martin dvanced
More informationOn Doob s Maximal Inequality for Brownian Motion
Stochastic Process. Al. Vol. 69, No., 997, (-5) Research Reort No. 337, 995, Det. Theoret. Statist. Aarhus On Doob s Maximal Inequality for Brownian Motion S. E. GRAVERSEN and G. PESKIR If B = (B t ) t
More informationCommunication Theory II
Communication Theory II Lecture 8: Stochastic Processes Ahmed Elnakib, PhD Assistant Professor, Mansoura University, Egypt March 5 th, 2015 1 o Stochastic processes What is a stochastic process? Types:
More informationCERIAS Tech Report The period of the Bell numbers modulo a prime by Peter Montgomery, Sangil Nahm, Samuel Wagstaff Jr Center for Education
CERIAS Tech Reort 2010-01 The eriod of the Bell numbers modulo a rime by Peter Montgomery, Sangil Nahm, Samuel Wagstaff Jr Center for Education and Research Information Assurance and Security Purdue University,
More informationDEPARTMENT OF ECONOMICS ISSN DISCUSSION PAPER 20/07 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES
DEPARTMENT OF ECONOMICS ISSN 1441-549 DISCUSSION PAPER /7 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES ZuXiang Wang * & Russell Smyth ABSTRACT We resent two new Lorenz curve families by using the basic
More informationSets of Real Numbers
Chater 4 Sets of Real Numbers 4. The Integers Z and their Proerties In our revious discussions about sets and functions the set of integers Z served as a key examle. Its ubiquitousness comes from the fact
More informationOptimization of Quadratic Forms: Unified Minimum/Maximum Cut Computation in Directed/Undirected Graphs
Optimization of Quadratic Forms: Unified Minimum/Maximum Cut Computation in Directed/Undirected Graphs by Garimella Ramamurthy Report No: IIIT/TR/2015/-1 Centre for Security, Theory and Algorithms International
More information1 University of Edinburgh, 2 British Geological Survey, 3 China University of Petroleum
Estimation of fluid mobility from frequency deendent azimuthal AVO a synthetic model study Yingrui Ren 1*, Xiaoyang Wu 2, Mark Chaman 1 and Xiangyang Li 2,3 1 University of Edinburgh, 2 British Geological
More informationHEAT AND LAPLACE TYPE EQUATIONS WITH COMPLEX SPATIAL VARIABLES IN WEIGHTED BERGMAN SPACES
Electronic Journal of ifferential Equations, Vol. 207 (207), No. 236,. 8. ISSN: 072-669. URL: htt://ejde.math.txstate.edu or htt://ejde.math.unt.edu HEAT AN LAPLACE TYPE EQUATIONS WITH COMPLEX SPATIAL
More informationIntroduction to Banach Spaces
CHAPTER 8 Introduction to Banach Saces 1. Uniform and Absolute Convergence As a rearation we begin by reviewing some familiar roerties of Cauchy sequences and uniform limits in the setting of metric saces.
More informationSharp gradient estimate and spectral rigidity for p-laplacian
Shar gradient estimate and sectral rigidity for -Lalacian Chiung-Jue Anna Sung and Jiaing Wang To aear in ath. Research Letters. Abstract We derive a shar gradient estimate for ositive eigenfunctions of
More informationwhere x i is the ith coordinate of x R N. 1. Show that the following upper bound holds for the growth function of H:
Mehryar Mohri Foundations of Machine Learning Courant Institute of Mathematical Sciences Homework assignment 2 October 25, 2017 Due: November 08, 2017 A. Growth function Growth function of stum functions.
More information7 The Waveform Channel
7 The Waveform Channel The waveform transmitted by the digital demodulator will be corrupted by the channel before it reaches the digital demodulator in the receiver. One important part of the channel
More informationImproved Capacity Bounds for the Binary Energy Harvesting Channel
Imroved Caacity Bounds for the Binary Energy Harvesting Channel Kaya Tutuncuoglu 1, Omur Ozel 2, Aylin Yener 1, and Sennur Ulukus 2 1 Deartment of Electrical Engineering, The Pennsylvania State University,
More informationA Note on the Positive Nonoscillatory Solutions of the Difference Equation
Int. Journal of Math. Analysis, Vol. 4, 1, no. 36, 1787-1798 A Note on the Positive Nonoscillatory Solutions of the Difference Equation x n+1 = α c ix n i + x n k c ix n i ) Vu Van Khuong 1 and Mai Nam
More informationMollifiers and its applications in L p (Ω) space
Mollifiers and its alications in L () sace MA Shiqi Deartment of Mathematics, Hong Kong Batist University November 19, 2016 Abstract This note gives definition of mollifier and mollification. We illustrate
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationThe analysis and representation of random signals
The analysis and reresentation of random signals Bruno TOÉSNI Bruno.Torresani@cmi.univ-mrs.fr B. Torrésani LTP Université de Provence.1/30 Outline 1. andom signals Introduction The Karhunen-Loève Basis
More informationThe Nemytskii operator on bounded p-variation in the mean spaces
Vol. XIX, N o 1, Junio (211) Matemáticas: 31 41 Matemáticas: Enseñanza Universitaria c Escuela Regional de Matemáticas Universidad del Valle - Colombia The Nemytskii oerator on bounded -variation in the
More informationVarious Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various Families of R n Norms and Some Open Problems
Int. J. Oen Problems Comt. Math., Vol. 3, No. 2, June 2010 ISSN 1998-6262; Coyright c ICSRS Publication, 2010 www.i-csrs.org Various Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various
More informationMaximum Likelihood Asymptotic Theory. Eduardo Rossi University of Pavia
Maximum Likelihood Asymtotic Theory Eduardo Rossi University of Pavia Slutsky s Theorem, Cramer s Theorem Slutsky s Theorem Let {X N } be a random sequence converging in robability to a constant a, and
More information1 Probability Spaces and Random Variables
1 Probability Saces and Random Variables 1.1 Probability saces Ω: samle sace consisting of elementary events (or samle oints). F : the set of events P: robability 1.2 Kolmogorov s axioms Definition 1.2.1
More informationStochastic integration II: the Itô integral
13 Stochastic integration II: the Itô integral We have seen in Lecture 6 how to integrate functions Φ : (, ) L (H, E) with resect to an H-cylindrical Brownian motion W H. In this lecture we address the
More informationAsymptotic behavior of sample paths for retarded stochastic differential equations without dissipativity
Liu and Song Advances in Difference Equations 15) 15:177 DOI 1.1186/s1366-15-51-9 R E S E A R C H Oen Access Asymtotic behavior of samle aths for retarded stochastic differential equations without dissiativity
More informationA SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE
THE 19 TH INTERNATIONAL CONFERENCE ON COMPOSITE MATERIALS A SIMPLE PLASTICITY MODEL FOR PREDICTING TRANSVERSE COMPOSITE RESPONSE AND FAILURE K.W. Gan*, M.R. Wisnom, S.R. Hallett, G. Allegri Advanced Comosites
More informationA-optimal diallel crosses for test versus control comparisons. Summary. 1. Introduction
A-otimal diallel crosses for test versus control comarisons By ASHISH DAS Indian Statistical Institute, New Delhi 110 016, India SUDHIR GUPTA Northern Illinois University, Dekal, IL 60115, USA and SANPEI
More informationDetection Algorithm of Particle Contamination in Reticle Images with Continuous Wavelet Transform
Detection Algorithm of Particle Contamination in Reticle Images with Continuous Wavelet Transform Chaoquan Chen and Guoing Qiu School of Comuter Science and IT Jubilee Camus, University of Nottingham Nottingham
More informationConvex Optimization methods for Computing Channel Capacity
Convex Otimization methods for Comuting Channel Caacity Abhishek Sinha Laboratory for Information and Decision Systems (LIDS), MIT sinhaa@mit.edu May 15, 2014 We consider a classical comutational roblem
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More informationPositive Definite Uncertain Homogeneous Matrix Polynomials: Analysis and Application
BULGARIA ACADEMY OF SCIECES CYBEREICS AD IFORMAIO ECHOLOGIES Volume 9 o 3 Sofia 009 Positive Definite Uncertain Homogeneous Matrix Polynomials: Analysis and Alication Svetoslav Savov Institute of Information
More informationOn Isoperimetric Functions of Probability Measures Having Log-Concave Densities with Respect to the Standard Normal Law
On Isoerimetric Functions of Probability Measures Having Log-Concave Densities with Resect to the Standard Normal Law Sergey G. Bobkov Abstract Isoerimetric inequalities are discussed for one-dimensional
More informationPulse Propagation in Optical Fibers using the Moment Method
Pulse Proagation in Otical Fibers using the Moment Method Bruno Miguel Viçoso Gonçalves das Mercês, Instituto Suerior Técnico Abstract The scoe of this aer is to use the semianalytic technique of the Moment
More informationResearch Article An iterative Algorithm for Hemicontractive Mappings in Banach Spaces
Abstract and Alied Analysis Volume 2012, Article ID 264103, 11 ages doi:10.1155/2012/264103 Research Article An iterative Algorithm for Hemicontractive Maings in Banach Saces Youli Yu, 1 Zhitao Wu, 2 and
More informationHASSE INVARIANTS FOR THE CLAUSEN ELLIPTIC CURVES
HASSE INVARIANTS FOR THE CLAUSEN ELLIPTIC CURVES AHMAD EL-GUINDY AND KEN ONO Astract. Gauss s F x hyergeometric function gives eriods of ellitic curves in Legendre normal form. Certain truncations of this
More informationResearch Article Controllability of Linear Discrete-Time Systems with Both Delayed States and Delayed Inputs
Abstract and Alied Analysis Volume 203 Article ID 97546 5 ages htt://dxdoiorg/055/203/97546 Research Article Controllability of Linear Discrete-Time Systems with Both Delayed States and Delayed Inuts Hong
More informationShadow Computing: An Energy-Aware Fault Tolerant Computing Model
Shadow Comuting: An Energy-Aware Fault Tolerant Comuting Model Bryan Mills, Taieb Znati, Rami Melhem Deartment of Comuter Science University of Pittsburgh (bmills, znati, melhem)@cs.itt.edu Index Terms
More informationLinear diophantine equations for discrete tomography
Journal of X-Ray Science and Technology 10 001 59 66 59 IOS Press Linear diohantine euations for discrete tomograhy Yangbo Ye a,gewang b and Jiehua Zhu a a Deartment of Mathematics, The University of Iowa,
More informationProof: We follow thearoach develoed in [4]. We adot a useful but non-intuitive notion of time; a bin with z balls at time t receives its next ball at
A Scaling Result for Exlosive Processes M. Mitzenmacher Λ J. Sencer We consider the following balls and bins model, as described in [, 4]. Balls are sequentially thrown into bins so that the robability
More informationOn Wald-Type Optimal Stopping for Brownian Motion
J Al Probab Vol 34, No 1, 1997, (66-73) Prerint Ser No 1, 1994, Math Inst Aarhus On Wald-Tye Otimal Stoing for Brownian Motion S RAVRSN and PSKIR The solution is resented to all otimal stoing roblems of
More informationDirichlet s Theorem on Arithmetic Progressions
Dirichlet s Theorem on Arithmetic Progressions Thai Pham Massachusetts Institute of Technology May 2, 202 Abstract In this aer, we derive a roof of Dirichlet s theorem on rimes in arithmetic rogressions.
More informationEstimating function analysis for a class of Tweedie regression models
Title Estimating function analysis for a class of Tweedie regression models Author Wagner Hugo Bonat Deartamento de Estatística - DEST, Laboratório de Estatística e Geoinformação - LEG, Universidade Federal
More informationUNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE
Surveys in Mathematics and its Applications ISSN 1842-6298 (electronic), 1843-7265 (print) Volume 5 (2010), 275 284 UNCERTAINTY FUNCTIONAL DIFFERENTIAL EQUATIONS FOR FINANCE Iuliana Carmen Bărbăcioru Abstract.
More informationAge of Information: Whittle Index for Scheduling Stochastic Arrivals
Age of Information: Whittle Index for Scheduling Stochastic Arrivals Yu-Pin Hsu Deartment of Communication Engineering National Taiei University yuinhsu@mail.ntu.edu.tw arxiv:80.03422v2 [math.oc] 7 Ar
More informationOn the statistical and σ-cores
STUDIA MATHEMATICA 154 (1) (2003) On the statistical and σ-cores by Hüsamett in Çoşun (Malatya), Celal Çaan (Malatya) and Mursaleen (Aligarh) Abstract. In [11] and [7], the concets of σ-core and statistical
More informationStatistical signal processing
Statistical signal processing Short overview of the fundamentals Outline Random variables Random processes Stationarity Ergodicity Spectral analysis Random variable and processes Intuition: A random variable
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More information