What s more chaotic than chaos itself? Brownian Motion - before, after, and beyond.

Similar documents
Do probabilists flip coins all the time?

Some Tools From Stochastic Analysis

ELEMENTS OF PROBABILITY THEORY

ELEG 3143 Probability & Stochastic Process Ch. 6 Stochastic Process

Brownian Motion and Conditional Probability

Brownian motion. Samy Tindel. Purdue University. Probability Theory 2 - MA 539

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

Bernardo D Auria Stochastic Processes /12. Notes. March 29 th, 2012

Lecture 4: Introduction to stochastic processes and stochastic calculus

PROBABILITY: LIMIT THEOREMS II, SPRING HOMEWORK PROBLEMS

9 Brownian Motion: Construction

Rough paths methods 4: Application to fbm

(B(t i+1 ) B(t i )) 2

GAUSSIAN PROCESSES; KOLMOGOROV-CHENTSOV THEOREM

Stochastic Volatility and Correction to the Heat Equation

Modeling with Itô Stochastic Differential Equations

A Fourier analysis based approach of rough integration

Lecture 9. d N(0, 1). Now we fix n and think of a SRW on [0,1]. We take the k th step at time k n. and our increments are ± 1

Finite-dimensional spaces. C n is the space of n-tuples x = (x 1,..., x n ) of complex numbers. It is a Hilbert space with the inner product

Long-Range Dependence and Self-Similarity. c Vladas Pipiras and Murad S. Taqqu

1 Introduction. 2 Diffusion equation and central limit theorem. The content of these notes is also covered by chapter 3 section B of [1].

One-Parameter Processes, Usually Functions of Time

FE 5204 Stochastic Differential Equations

Gaussian, Markov and stationary processes

Topics in fractional Brownian motion

On pathwise stochastic integration

Brownian Motion. 1 Definition Brownian Motion Wiener measure... 3

Gaussian Processes. 1. Basic Notions

Stochastic Processes

Finite element approximation of the stochastic heat equation with additive noise

Multivariate Generalized Ornstein-Uhlenbeck Processes

ITO OLOGY. Thomas Wieting Reed College, Random Processes 2 The Ito Integral 3 Ito Processes 4 Stocastic Differential Equations

Local vs. Nonlocal Diffusions A Tale of Two Laplacians

Stochastic process. X, a series of random variables indexed by t

Lecture 19 L 2 -Stochastic integration

Brownian motion and the Central Limit Theorem

In terms of measures: Exercise 1. Existence of a Gaussian process: Theorem 2. Remark 3.

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

The Lévy-Itô decomposition and the Lévy-Khintchine formula in31 themarch dual of 2014 a nuclear 1 space. / 20

CHAPTER V. Brownian motion. V.1 Langevin dynamics

The Wiener Itô Chaos Expansion

Matrix-valued stochastic processes

Do stochastic processes exist?

Handbook of Stochastic Methods

The concentration of a drug in blood. Exponential decay. Different realizations. Exponential decay with noise. dc(t) dt.

4.4. Orthogonality. Note. This section is awesome! It is very geometric and shows that much of the geometry of R n holds in Hilbert spaces.

Some basic elements of Probability Theory

Statistics of Stochastic Processes

Exercises in stochastic analysis

Merging Mathematical Technologies by Applying the Reverse bra-ket Method By J.A.J. van Leunen

Stochastic Integration and Stochastic Differential Equations: a gentle introduction

Contents. 1 Preliminaries 3. Martingales

Brownian Motion and Poisson Process

1. Stochastic Process

21 Gaussian spaces and processes

Mathematics (MA) Mathematics (MA) 1. MA INTRO TO REAL ANALYSIS Semester Hours: 3

Infinitely divisible distributions and the Lévy-Khintchine formula

Lecture 3: Haar MRA (Multi Resolution Analysis)

Universal examples. Chapter The Bernoulli process

Handbook of Stochastic Methods

This is a Gaussian probability centered around m = 0 (the most probable and mean position is the origin) and the mean square displacement m 2 = n,or

Parametric Signal Modeling and Linear Prediction Theory 1. Discrete-time Stochastic Processes

MULTIDIMENSIONAL WICK-ITÔ FORMULA FOR GAUSSIAN PROCESSES

The Banach-Tarski paradox

M4A42 APPLIED STOCHASTIC PROCESSES

Exercises. T 2T. e ita φ(t)dt.

HILBERT SPACES AND THE RADON-NIKODYM THEOREM. where the bar in the first equation denotes complex conjugation. In either case, for any x V define

Rough paths methods 1: Introduction

Lévy Processes and Infinitely Divisible Measures in the Dual of afebruary Nuclear2017 Space 1 / 32

Pathwise volatility in a long-memory pricing model: estimation and asymptotic behavior

Weak convergence and Brownian Motion. (telegram style notes) P.J.C. Spreij

Optimal series representations of continuous Gaussian random fields

Modelling energy forward prices Representation of ambit fields

Inner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:

Simulation of stationary fractional Ornstein-Uhlenbeck process and application to turbulence

Karhunen-Loève decomposition of Gaussian measures on Banach spaces

High order Cubature on Wiener space applied to derivative pricing and sensitivity estimations

Higher order weak approximations of stochastic differential equations with and without jumps

Figure 1: Functions Viewed Optically. Math 425 Lecture 4. The Chain Rule

Fourier Analysis Linear transformations and lters. 3. Fourier Analysis. Alex Sheremet. April 11, 2007

Interactions of Information Theory and Estimation in Single- and Multi-user Communications

Lecture 3: Hilbert spaces, tensor products

WHITE NOISE APPROACH TO FEYNMAN INTEGRALS. Takeyuki Hida

2. SPECTRAL ANALYSIS APPLIED TO STOCHASTIC PROCESSES

Discretization of SDEs: Euler Methods and Beyond

Random Fields: Skorohod integral and Malliavin derivative

ECE534, Spring 2018: Solutions for Problem Set #4 Due Friday April 6, 2018

Chapter 1 Preliminaries

Structure, Probabiliy, Entropy. Misha Gromov September 22, 2014

Your first day at work MATH 806 (Fall 2015)

CALCULUS ON MANIFOLDS. 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M =

Strong approximation for additive functionals of geometrically ergodic Markov chains

Walsh Diffusions. Andrey Sarantsev. March 27, University of California, Santa Barbara. Andrey Sarantsev University of Washington, Seattle 1 / 1

Fourier and Wavelet Signal Processing

Beyond the color of the noise: what is memory in random phenomena?

DS-GA 1002 Lecture notes 0 Fall Linear Algebra. These notes provide a review of basic concepts in linear algebra.

Math 345 Intro to Math Biology Lecture 21: Diffusion

µ X (A) = P ( X 1 (A) )

Max stable processes: representations, ergodic properties and some statistical applications

Iowa State University. Instructor: Alex Roitershtein Summer Homework #5. Solutions

Transcription:

Include Only If Paper Has a Subtitle Department of Mathematics and Statistics What s more chaotic than chaos itself? Brownian Motion - before, after, and beyond. Math Graduate Seminar March 2, 2011

Outline 1 Bits of history 2 3 4 5 6

Selected historical moments 1820 Robert Brown - volatile movements of a polen particle (not really the first) 1853 Jules Regnault - a growing circle model of BM 1880 Thorvald Thiele - a computational construction of BM 1900 Louis Bachelier - BM derived from Random Walk and Central Limit Theorem and Heat Equation, modeled upon price fluctuations at the Paris Stock Exchange ( the one ) 1905-1906 Albert Einstein and Marian von Smoluchowski - a physical explanatory model (good for physicists, maybe) 1938 - multidimensional BM (also the one )

Bachelier s PhD Thesis "Theórie de la spéculation" (modeling stock prices by a stochastic process in time) Random walk: independent ±1 hits, summed up, centered and time-scaled, a continuous time random walk in the limit (later: Donsker s Theorem). Alternatively, Chapman-Kolmogorov equations yield the Gaussian probability distribution of the process. A random quantity Q(t) changes linearly with a value-and-time dependent coefficient P(Q(t) [x, x + dx]) p x,t dx

Bachelier s CK-equations p z,t1 +t 2 = p x,t1 p z x,t2 dx Solution (the functions is a probability, hence the normalizing constant π): p x,t = f (t) e πf 2 (t)x 2, where f (t 1 + t 2 ) = f (t 1 )f (t 2 ) f 2 (t 1 ) + f 2 (t 2 ). Solution: f (t) = c t Today we call Q(t) the Brownian motion.

Continuous homogenous chaos "Among the simplest and most important ensembles of physics are those which have a spatially homogeneous character. Among these are the homogeneous gas, the homogeneous liquid, the homogeneous state of turbulence. " Axioms will follow...

Discrete homogeneous chaos Wiener considered nested binary partitions of R n... "Let us require that the probability that a set be empty depend only on its measure, and that the probability that two non-overlapping sets be empty be the product of the probabilities that each be empty. Let us assume that both empty and occupied sets exist. Let every set contained in an empty set be empty, while if a set be occupied, let at least one-half always be occupied. We thus get an infinite class of schedules of emptiness and occupiednes"

Wiener s axioms of chaos Multidimensional Chaos: Any additive random quantity F(A) defined for measurable A R n. Additivity: F(A B) = F(A) + F(B), when A and B are disjoint. (For processes on R, it is an analog of the increment X(s, t] = X(t) X(s), rising to finite unions, then limits...) Metrical transitivity: F(A + y) = D F(A) (A weak analog of stationary increments)

Axioms, continued Ergodicity: E F(A) log F(A) < Birkhoff s Ergodic Theorem allows a construction of a chaos. Wiener did not use the Kolmogorov s axiomatic probability theory, with tools of measure theory. Every needed time the "randomness" had to be constructed from scratch. Implicitly, the additivity entails σ-additivity, a true random measure. For the Gaussian chaos, E F(A) p < for every p. The best: p = 2 (allows the tools of Hilbert spaces).

A picture, finally! Wiener s first "multidimensional chaos" was in fact one-dimensional, because R and R n are indistinguishable from the point of view of the basic measure theory (through "Borel isomorphism").

Wiener s pure multi-d chaos : 1. Non-deterministic random chaos; 2. Homogeneity; 3. Independent scatter; 4. Hilbertian L 2 -condition: E F(A) 2 <, E F(A) = 0. Two examples: 1. Gaussian G, mean 0. 2. Poisson D, centered: D E D, or symmetrized D D, with independent copies.

Wiener integral For step functions, f = c k on A k and the Hilbert norm: Wf = f df = k c k F(A k ); f df 2 = f 2, extends to the quantity defined and the isometry held over L 2. (only orthogonal scatter is needed)

Wiener s polynomial chaos: Let f be a step function, or alternatively, f (x 1,..., x n ) = f 1 (x 1 ) f n (x 1 ), f k L 2. (1) Then R n f (x 1,..., x n ) F(dx 1 ) F(dx n ) is well defined. The definition extends to a linear combinations of functions (1), and then to their limits, e.g., when f (x 1,..., x n ) f 1 (x 1 ) f n (x 1 ) (the Wiener s assumption).

Gaussian polynomial chaos, examples Let γ = (γ k ) be i.i.d. standard Gaussian N(0, 1). 2 nd order chaos: c k γ k k 1 st order chaos: c kj γ k γ j k j n th order chaos: c j1,...,j n γ j1 γ jn = c Jn γ Jn j 1,...,j n J n (J n = (j 1,..., j n )) polynomial chaos: c J γ J (J N N ) J chaos (diagonal-free): d c d γ d (d { 0, 1 } N )

Independent scatter and polynomial chaos 4 6 3 4 2 1 2 0 0 1 2 2 3 4 4 1 0.5 0 0 0.5 1 6 1 0.5 0 0 0.5 1

Rademacher and Haar functions Shift and scale the marks D S-square wave. Or, directly: ( ) ρ n (x) = sign sin(2 n π x), x [0, 1]. Haar function: a single double-tooth piece of a Rademacher function; a dyadic squeeze and shift of the square bump 2h(x) 1. 2 n of Haar functions of order n form a basis in the vector space D n of piecewise functions, constant on dyadic intervals ( k 1 2 n, k ] 2 n, k = 1,..., 2 n

Walsh functions Rademacher functions span only an n-dimensional subspace. The products ("chaoses") are called Walsh functions: w d1,...,d n = ρ d 1 1 ρdn n, d 1,..., d n { 0, 1 }. Since there are 2 n Walsh functions and they are independent, they also form a basis of D n.

Powers Walsh functions can be ordered lexicographically w 1 = w 1, w 2 = w 01, w 3 = w 11, w 4 = w 001, w 5 = w 101, w 6 = w 011,... (skipping zeros on the right). Indicate a sequence by a boldface font, e.g., d = (d n ). Put D = { d = (d n ) : d n = 0 eventually }. Define the power w d = ρ d, d D.

- bras and kets Walsh polynomials, a.k.a. Rademacher random chaos: x ρ = x d ρ d, d D The braket indicates the interaction between the array x = [x d ] of coefficients and the power-bearing sequence ρ. The symbol can be split into two parts, called by Paul Dirac bra : x and ket : ρ

Second order chaos In the Hilbert space L 2 [0, 1] of square-integrable functions with the norm ( 1/2 1 f 2 = f (t) dt) 2, the Walsh functions form an orthonormal basis. By the Pythagorean, a.k.a. Parseval s, theorem 2 x ρ = x 2 d. 0 d D That is, every f L 2 [0, 1] admits a representation.

Random chaos Geometric Brownian Motion is a functional of BM B t : G = e αb(t) α2 t/2. (it is a solution of the stochastic differential equation dg = αg db) Every square integrable functional of Brownian Motion, F L 2 (BM), admits a random chaos representation: F = d x d γ d, where γ = (γ n ) are i.i.d. standard normal random variables.

Spectral representation Every square integrable process with stationary increments can be represented as a simple stochastic integral w.r.t. an orthogonally scattered process: W (t) = ( 1 e itω) Z (dω) Example: Let B t be a (real or complex) BM, 0 < H < 1. ( ) W H (t) = 1 exp itω ω H 1/2 B(dω) S is called a Fractional BM, FBM(H). H = 1/2 yields a BM.

FBM The process can be perceived as a fractional derivative of BM: W H = D 1/2 H B : (rather "fractional integral" for H > 1/2). This heuristic concept can be defined and studied rigorously e.g. via Laurent Schwartz distribution theory or stochastic calculus. When H < 1/2, FBM is more volatile or "chaotic" than BM.