Thinning Algorithms for Simulating Point Processes

Size: px
Start display at page:

Download "Thinning Algorithms for Simulating Point Processes"

Transcription

1 Thinning Algorithms for Simulting Point Processes Yund Chen September, 2016 Abstrct In this tlk we will discuss the lgorithms for simulting point processes. The simplest point process is the (homogeneous) Poisson process, which hs n intensity function of constnt vlue λ. It cn be simulted by the sum of its interrrivl times. By llowing the intensity to vry, tking vlues given by deterministic function λ(t), we cn extend the Poisson process to the inhomogeneous cse. As proposed by (Lewis nd Shedler, 1979), inhomogeneous Poisson processes cn be simulted by thinning the points from the homogeneous versions. Further by llowing the intensity t time t to depend on ll informtion prior to t, we get the self-exciting processes such s the Hwkes processes. The simultion of such processes cn lso be performed by thinning, s given by (Ogt, 1981). 1 Introduction In this tlk we will discuss the simultion of point processes. A point process cn be thought of s being sequence of points on rel number line. The line represents time nd the points re the occurrence time of events. The ptterns how those points re locted gives us different point processes. The most commonly used nd simplest point process is the homogeneous Poisson process, which ssumes tht the points re evenly spred over ny intervl. It is perfectly resonble process to model the rrivl times of buses, ssuming you re stnding t bus stop. But it will not be good choice for modeling, sy erthqukes, becuse there re ftershocks fter the min ttck, or modeling occurrences of mrket events, which hs the clustering effect. The Hwkes process is developed for this purpose, nd our gol in this tlk is to introduced the simultion of Hwkes processes. Before we cn tlk bout point processes precisely, we need to define few concepts. 2 Fundmentls of Point Processes Definition 2.1. (Sigmn, 1995, p.1) Let (Ω, F, P) be probbility spce. A point process on R + is sequence of non-negtive rndom vribles {T k } k=1,2,..., such tht for ll k, T k T k+1. Here T k represents the occurrence times of events, nd such processes re clled temporl point processes. When the points re distributed in, sy two dimensionl spce, it is clled sptil point process. The elpsed time from n event to the next is clled the interrrivl time. Definition 2.2. (Ross, 1995, p.64) Consider point process {T k } k=1,2,.... Define W k = T k T k 1 with the convention T 0 = 0. The sequence {W k } k=1,2,... is clled the interrrivl times. Definition 2.3. (Sigmn, 1995, p.1, (1.2)) The process with right-continuous smple pths N(t) = k=1,2,... 1 {Tk t} is clled the counting process ssocited with the point process {T k } k=1,2,.... The counting process N(t) counts the number of occurrences up to nd including time t, nd N({t}) = N(t) N(t ) in the following. 1

2 Definition 2.4. (Dley nd Vere-Jones, 2003, p.47, Definition 3.3.II) A point process is clled simple when P {N({t}) = 0 or 1 for ll t} = 1. Definition 2.5. (Lst nd Brn, 1995, p.8, (1.5.1)) For point process {T k } k=1,2,... we define the point of explosion to be T = lim k T k nd the point process is clled non-explosive if T k lmost surely s k. We ssume the point processes discussed in this rticle re both simple nd non-explosive. Definition 2.6. (Grndell, 1997, p.6) A quntity which, for smll h, is of lower order thn h, is denoted s o(h), i.e. o(h) lim h 0 + h = 0. Definition 2.7. The intensity of point process N(t) is defined by Khinchin (1960) s P {N(t, t + h] > 0} λ(t) = lim. h 0 + h Intuitively λ(t) mesures the rte of occurrence of points becuse in most cses (under certin ssumptions) P {N(t, t + h] > 0} E[N(t, t + h)] lim = lim h 0 + h h 0 + h nd on the right hnd side we hve number over time, or rte. 3 Homogeneous Poisson Processes 3.1 Definition There re lterntive definitions for homogeneous Poisson processes. homogeneous Poisson process bsed on the intensity. The following definition defines Definition 3.1. (Ross, 2009, pp , Definition 5.3, Theorem 5.1) The point process N is (homogeneous) Poisson process with rte λ, λ > 0, if nd only if, for ll t 0 nd h 0 +, (i) N(0) = 0. (ii) The process hs independent increments. (iii) P {N(t + h) N(t) = 1} = λh + o(h). (iv) P {N(t + h) N(t) 2} = o(h). (i) sys the process strts from 0 t time 0. (ii) mens the increments re independent over disjoint bounded subintervls. (iii) simply sys tht λ is the intensity nd (iv) is clled orderly, which is the probbility distribution property nlogously to the smple pth property of simpleness in Definition

3 3.2 Properties Number of Occurrence The following property sttes tht the number of points from homogeneous Poisson process over ny intervl is Poisson distributed. Proposition 3.1. The number of events in ny intervl of length t is Poisson distributed with men λt. Tht is, for ll s, t 0, λt (λt)n P {N(t + s) N(s) = n} = e for n = 0, 1,.... Proof. Define p n (t) = P {N(t) = n} for t 0 nd integers n 0. Conditions (iii), (iv) of Definition 3.1 imply tht the process N is sttionry. Together with condition (ii) of Definition 3.1, it mens tht N hs both sttionry (not function of time t) nd independent increments, so we hve p 0 (t + h) = P {N(t + h) = 0} = P {N(t) N(0) = 0, N(t + h) N(t) = 0} [independent increments] = P {N(t) N(0) = 0} P {N(t + h) N(t) = 0} [sttionry] = P {N(t) = 0} P {N(h) = 0} = p 0 (t) (1 λh + o(h)) nd so, Let h 0 +, we hve the ODE or equivlently, with the generl solution By setting t = 0, we hve nd so, Now for n 1, p 0 (t + h) p 0 (t) h dp 0 (t) = p 0 (t)λ + o(h) h. = p 0 (t)λ dp 0 (t) p 0 (t) = λ p 0 (t) = Ce λt. 1 = P {N(0) = 0} = p 0 (0) = C p 0 (t) = e λt. (1) p n (t + h) = P {N(t + h) = n} = P {N(t) = n, N(t + h) N(t) = 0} + P {N(t) = n 1, N(t + h) N(t) = 1} +P {N(t + h) = n, N(t + h) N(t) 2} = P {N(t) = n} P {N(h) = 0} + P {N(t) = n 1} P {N(h) = 1} + o(h) = p n (t)(1 λh + o(h)) + p n 1 (t)(λh + o(h)) + o(h) = (1 λh)p n (t) + λhp n 1 (t) + o(h) (2) 3

4 In the derivtion bove we used the fct tht which is true, becuse, P {N(t + h) = n, N(t + h) N(t) 2} = o(h) P {N(t + h) = n, N(t + h) N(t) 2} P {N(t + h) N(t) 2} lim lim = 0. h 0 + h h 0 + h Rerrnging (2), we hve p n (t + h) p n (t) = λp n (t) + λp n 1 (t) + o(h) h h nd by letting h 0 + we hve dp n (t) = λp n (t) + λp n 1 (t) or equivlently, dp n (t) + λp n (t) = λp n 1 (t) (3) which is first order liner ODE nd by multiplying the integrting fctor e λt to both sides, we hve d ( e λt p n (t) ) = λe λt p n 1 (t) (4) We now use mthemticl induction to show tht (4) implies λt (λt)n p n (t) = e for ll integers n 1. When k = 1, (4) becomes d ( e λt p 1 (t) ) becuse of (1). Solving the ODE for p 1 (t) we get nd by setting t = 0 we hve so = λ e λt p 1 (t) = λt + C 0 = P {N(0) = 1} = p 1 (0) = C p 1 (t) = e λt λt nd (5) holds. Assuming (5) holds for k = n 1 1, then nd (4) becomes which yields or equivlently, By setting t = 0 we hve d ( e λt p n (t) ) λt (λt)n 1 p n 1 (t) = e (n 1)! = λe λt λt (λt)n 1 e (n 1)! = λ (λt)n 1 (n 1)! = λn (n 1)! tn 1 e λt p n (t) = λn (n 1)! tn n + C λt (λt)n p n (t) = e + Ce λt. 0 = P {N(0) = n} = p n (0) = C which proves tht (5) holds true for ll integers n 0, nd by sttionrity, for ny s, t 0, λt (λt)n P {N(t + s) N(s) = n} = P {N(t) N(0) = n} = P {N(t) = n} = e which completes the proof. 4 (5)

5 3.2.2 Interrrivl Times Immeditely we hve the following property bout the interrrivl times. Proposition 3.2. (Ross, 1995, p.64, Proposition 2.2.1) The interrrivl times {W k } k=1,2,... of (homogeneous) Poisson process with rte λ > 0, re independent identiclly distributed exponentil rndom vribles hving men 1/λ. Proof. From Proposition 3.1, P {W 1 > t} = P {N(t) = 0} = e λt so W 1 is exponentilly distributed with prmeter λ. For W 2, by independent increments, we hve nd P {W 2 > t W 1 = s} = P {N(t + s) N(s) = 0 N(s) N(s ) = 1} = P {N(t + s) N(s) = 0} = P {N(t) = 0} = e λt P {W 2 > t} = E [P {W 2 > t W 1 }] = e λt so W 2 is exponentilly distributed with prmeter λ. Also the fct tht P {W 2 > t} = P {W 2 > t W 1 = s} implies the independence between W 2 nd W 1. Repeting the sme rgument proves the proposition. Nturlly we hve the following lgorithm for generting the points t k in homogeneous Poisson process by generting the interrrivl times w k nd tking the sum t k = k i=1 w i. This is sometimes clled the interrrivl scheduling. Assuming there is rndom number genertor uniform(0,1) tht genertes uniformly distributed rndom vribles on (0, 1). Algorithm 1: Simultion of Homogeneous Poisson Process with Rte λ, on [0, T ]. Input: λ, T 1 Initilize n = 0, t 0 = 0; 2 while True do 3 Generte u uniform(0,1); 4 Let w = ln u/λ; // so tht w exponentil(λ) 5 Set t n+1 = t n + w; 6 if t n+1 > T then 7 return {t k } k=1,2,...,n 8 else 9 Set n = n + 1; 10 end 11 end Joint Density From Proposition 3.1 we cn esily derive the joint density of the occurrence times. Theorem 3.3. The joint density tht exctly n events occur in the intervl [0, T ] for Poisson process with rte λ tking vlues 0 < t 1 < t 2 < < t n T is f T1,...,T n (t 1,..., t n ; T n+1 > T ) = λ n e λt. 5

6 Proof. For k = 1, 2,..., n + 1, let W k = T k T k 1 be the interrrivl times nd w k = t k t k 1 be the reliztion, with the convention T 0 = t 0 = 0. By Proposition 3.2, {W k } k=1,2,...,n+1 re independent identiclly distributed exponentil rndom vribles with prmeter λ nd density nd til CDF f W (w) = λe λw P {W > t} = F (t) = 1 F (t) = e λt so by the chnge of vribles formul (see Csell nd Berger, 2002, p.158, (4.3.2) nd p.185, (4.6.7)), the joint density function of T 1,..., T n is f T1,...,T n (t 1,..., t n ; T n+1 > T ) = f W1,...,W n (w 1,..., w n ) J 1 P {W n+1 > T t n } = n k=1 λ(t tn) f W (t k t k 1 ) e where n = λ n e λ k t k 1 ) k=1(t e λ(t t n) = λ n e λt J ij = dt i dw j nd J = 1 becuse J is lower tringulr mtrix with ll non-zero elements being 1. 4 Inhomogeneous Poisson Processes 4.1 Definition By llowing the intensity λ in Definition 3.1 to vry ccording to deterministic function of t, we hve the following definition for inhomogeneous Poisson process. Definition 4.1. (Ross, 2009, p.339, Definition 5.4) The point process N is sid to be n inhomogeneous Poisson process with intensity function λ(t) 0, t 0, if (i) N(0) = 0. (ii) The process hs independent increments. (iii) P {N(t + h) N(h) = 1} = λ(t)h + o(h). (iv) P {N(t + h) N(h) 2} = o(h). Anlogously, we hve similr property for inhomogeneous Poisson processes. Proposition 4.1. Let the point process N be n inhomogeneous Poisson process with intensity function λ(t), then N(t) follows Poisson distribution with prmeter t λ(s)ds, i.e. 0 P {N(t) = n} = e t 0 λ(s)ds ( t 0 λ(s)ds ) n Proof. The proof is similr to the second prt of the proof for Proposition 3.1. Anlogously to (1) for the homogeneous cse, we now hve p 0 (t) = e t 0 λ(s)ds (6) 6

7 by replcing λ with λ(t) in the derivtion. Also (3) becomes dp n (t) + λ(t)p n (t) = λ(t)p n 1 (t) nd by multiplying e t 0 λ(s)ds to both sides, we now hve the ODE ( d e ) t 0 λ(s)ds p n (t) We gin use mthemticl induction by ssuming p n 1 (t) = = λ(t)e t 0 λ(s)ds p n 1 (t). e t 0 λ(s)ds ( t 0 λ(s)ds ) n 1 (n 1)! so tht solving which yields ( d e ) t 0 λ(s)ds p n (t) = λ(t) ( t 0 λ(s)ds ) n 1 (n 1)! ( ) t n p n (t) = e t 0 λ(s)ds 0 λ(s)ds. b Apprently, the number of points in the intervl [, b] follows Poisson distribution with prmeter λ(s)ds, or more precisely, P {N(b) N() = n} = e b λ(s)ds ( b λ(s)ds ) n Letting n = 0 we get the probbility tht there is no point in the intervl [, b] to be P {N(, b] = 0} = e b λ(s)ds (7) which determines the lw of occurrence for the next point. For simple point process, points occur one by one nd by the checking this condition we cn mke sure whether the point process is n inhomogeneous Poisson process. 4.2 Simultion To simulte the points in n inhomogeneous Poisson process, we cn simulte the points sequentilly. We only need to gurntee tht (7) is stisfied nd the following is one such lgorithm, sometimes clled the Lewis thinning lgorithm. Figure 1 shows n illustrtive exmple of simulted inhomogeneous Poisson process on the intervl [0, 2π], with the intensity function λ(t) = 1 + sin(t) shown s the solid curve. The rte of the homogeneous Poisson process which domintes λ(t) is set to be λ = sup 0 t 2π λ(t) = 2 nd is shown s the horizontl dshed line. The simulted points for the homogeneous Poisson process re shown s circles, while those ccepted s the points for the inhomogeneous Poisson process re lbeled with cross mrks. Verticlly bove ech point on the x-xis, there is nother point plotted with height of D λ, where D is the uniform rndom vrible used in line 7 of Algorithm 2. The points bove λ(t) re those rejected nd re mrked with circles; the ones below ccepted nd lbeled with cross mrks. The following theorem describes the lgorithm mthemticlly nd it mkes sure the resulting point process stisfies (7). 7.

8 Algorithm 2: (Lewis nd Shedler, 1979, p.7, Algorithm 1) Simultion of n Inhomogeneous Poisson Process with Bounded Intensity Function λ(t), on [0, T ]. Input: λ(t), T 1 Initilize n = m = 0, t 0 = s 0 = 0, λ = sup 0 t T λ(t); 2 while s m < T do 3 Generte u uniform(0,1); 4 Let w = ln u/ λ; // so tht w exponentil( λ) 5 Set s m+1 = s m + w; // {s m } re points in the homo. Poisson process 6 Generte D uniform(0,1); 7 if D λ(s m+1 )/ λ then // ccepting with probbility λ(s m+1 )/ λ 8 t n+1 = s m+1 ; // {t n } re points in the inhomo. Poisson process 9 n = n + 1; // updting n to the index of lst point in {t n } 10 end 11 m = m + 1; // updting m to the index of lst point in {s m } 12 end 13 if t n T then 14 return {t k } k=1,2,...,n 15 else 16 return {t k } k=1,2,...,n 1 17 end Theorem 4.2. Consider homogeneous Poisson process N(t) with intensity function λ. Let t 1, t 2,..., t N(T ) be the points of the process in the intervl (0, T ]. Suppose tht for 0 t T, 0 λ(t) λ. For k = 1, 2,..., N(T ), delete the point t k with probbility 1 λ( t k )/ λ; then the remining points form point process N(t) stisfying (7). Proof. Consider the probbility where there re n points in the point process N(t) nd ech of them is deleted nd denote it s p n. From Theorem 3.3 the joint density of n points tking vlues t 1 < < t n b is λ n e λ(b ). Consider the unordered vlues s 1,..., s n such tht {s 1,..., s n } = {t 1,..., t n }, where ech s k tkes vlue in [, b]. The probbility p n = b b t 1 = e λ(b ) = e λ(b ) = e λ(b ) b t n 1 λn e λ(b ) b b b n k=1 ( 1 λ(t ) k) 1 2 n λ n ( λ λ(tk ) ) ds 1 ds 2 ds n k=1 ( b ( λ λ(tk ) ) ds ( λ(b ) b ) n λ(s)ds Now the number of points in the point process N(t), or n, cn be ny non-negtive integer nd the sum ( n b p n = e λ(b ) λ(b ) λ(s)ds) / n=0 n=0 ) n = e λ(b ) e λ(b ) b λ(s)ds = e b λ(s)ds equls the probbility tht there is no point in the intervl [, b], nd (7) is stisfied. 8

9 Figure 1: An illustrtive exmple of simulting n inhomogeneous Poisson process with intensity function λ(t) = 1 + sin(t) on the intervl [0, 2π] using Algorithm 2. The intensity functions for the homogeneous nd inhomogeneous Poisson processes re shown s the horizontl dshed line nd the solid curve, respectively. On the x-xis, the simulted points for the homogeneous Poisson process re mrked by circles, nd the points lbeled s cross mrks, re the simulted points for the inhomogeneous Poisson process. Verticlly bove ech point on the x-xis, point with height of D λ is lso plotted, with D being the uniform rndom vrible generted during the simultion. The points bove λ(t) re rejected nd mrked with circles, while the points below re ccepted s the points for the inhomogeneous Poisson process nd re mrked with crosses. Remrk 4.1. Notice tht in Theorem 4.2 the only constrint on the constnt λ is tht λ(t) λ for ll t in the domin of interest, [0, T ]. Becuse λ is the intensity of the homogeneous Poisson process N, so lrger vlue of λ will led to more generted points in N. At the mentime, λ determines the probbility t which point is ccepted, nd lrger λ corresponds to smller probbility of point cceptnce. As result, smller vlue of λ is preferred in prctice when using Algorithm 2, for higher efficiency (less itertions of the while-loop) nd hence λ = sup t [0,T ] λ(t) is often the choice. Becuse Poisson process hs independent increments, i.e. P {N(s, t] = 0 N(0, s] = 0} = P {N(0, t] = 0} P {N(0, s] = 0} t = e 0 λ(u)du e s 0 λ(u)du = e t s λ(u)du = P {N(s, t] = 0} 9

10 for ny 0 < s < t T, nd the genertion of points is sequentil (the vrible s m is incresing through the itertions of the while-loop), the choice of λ cn be modified s λ = sup t [sm,t ] λ(t), to llow djustment of λ when generting the next point in N. 5 Hwkes Processes 5.1 Definition Definition 5.1. (Donld L. Snyder, 1991, p.287) A point process is clled self-exciting if the intensity λ( ) depends not only on time t but lso the entire pst of the point process. The entire pst, or history of point process, is defined mthemticlly by the definition given below. Definition 5.2. (Grndell, 1997, p.51) For ny process N(t), the nturl filtrtion F N = ( Ft N ; t 0 ) is defined by Ft N = σ {N(s); s t}. In other words, Ft N up to time t. is the σ-lgebr generted by N up to time t, nd represents the internl history of N With this definition, we cn define the intensity λ( ) for self-exciting point process nlogously s (2.7). However, more ppropritely here, it should be clled the intensity process, becuse λ( ) is itself rndom process whose smple pth depends on the reliztion of N( ). Definition 5.3. (Lst nd Brn, 1995, p.10, (1.6.4)) Let N(t) be point process with nturl filtrtion Ft N. The left-continuous process defined by λ(t Ft N P {N(t + h) N(t) > 0 Ft N } ) = lim h 0 + h is clled the stochstic intensity function of the point process. The reson for using left continuity is connected with predictbility: if the conditionl intensity hs discontinuity t point of the process, then its vlue t tht point should be defined by the history before tht point, not by wht hppens t the point itself (Dley nd Vere-Jones, 2003, p.232). The Hwkes processes introduced below is n exmple of self-exciting point processes. Definition 5.4. (Hwkes, 1971, p.84, (7) nd (8)) A univrite simple point process N(t) stisfying (i) N(t) = 0. (ii) λ(t) is left-continuous stochstic process given by the Stieltjes integrl λ(t) = µ + t αe β(t s) dn(s) = µ + αe β(t t k) 0 {k:t k <t} (8) where µ > 0 nd 0 < α < β. (iii) λ(t) is the stochstic intensity of the point process P {N(t + h) N(t) = 1 Ft N } = λ(t)h + o(h) (iv) The point process is orderly P {N(t + h) N(t) 2 Ft N } = o(h) is clled univrite Hwkes process with exponentil decy on [0, ). 10

11 From Definition 5.4, it is esy to see tht for given reliztion, λ(t) is piece-wisely non-incresing with jumps of size α t occurrences of points. More properties re shown in Figure 2 which illustrtes the smple pths of the conditionl intensity λ(t) nd the ssocited counting process N(t) for given univrite Hwkes process with exponentil decy tht hs prmeters µ = 1.2, α = 0.6 nd β = 0.8. The left-continuous conditionl intensity, which strts from nd keeps t the bse intensity µ = 1.2 until the occurrence of the first point, is shown in the top pnel. After ech occurrence, the intensity jumps with size of α = 0.6 nd then immeditely strts decying t rte determined by β = 0.8. On the other hnd, the ssocited right-continuous counting process, which is step function tht jump by 1 t ech occurrence, is shown in the bottom pnel. 5.2 Simultion From (8) it is obvious tht given the informtion of the first k points, t 1,..., t k, the intensity λ(t) is deterministic on [t k, t k+1 ], where t k+1 is the loction of the next point which is stochstic. As result, the genertion of the next point in Hwkes process cn be considered s generting the first point in n inhomogeneous Poisson process. Ogt modified Algorithm 2 to simulte Hwkes processes. This is sometimes clled Ogt s modified thinning lgorithm. In his modifiction, λ is llowed to be djusted s described in Remrk 4.1. Algorithm 3: (Ogt, 1981, p.25, Algorithm 2) Simultion of Univrite Hwkes Poisson with Exponentil Kernel γ(u) = αe βu, on [0, T ]. Input: µ, α, β, T 1 Initilize T = Ø, s = 0, n = 0; 2 while s < T do 3 Set λ = λ(s + ) = µ + τ T αe β(s τ) ; 4 Generte u uniform(0,1); 5 Let w = ln u/ λ; // so tht w exponentil( λ) 6 Set s = s + w; // so tht s is the next cndidte point 7 Generte D uniform(0,1); 8 if D λ λ(s) = µ + τ T αe β(s τ) then // ccepting with prob. λ(s)/ λ 9 n = n + 1; // updting the number of points ccepted 10 t n = s; // nming it t n 11 T = T {t n }; // dding t n to the ordered set T 12 end 13 end 14 if t n T then 15 return {t k } k=1,2,...,n 16 else 17 return {t k } k=1,2,...,n 1 18 end Figure 3 illustrtes the use of Algorithm 3 for univrite Hwkes process with exponentil decy. The prmeters re µ = 1.2, α = 0.6 nd β = 0.8. All the cndidte points re mrked on the x-xis where the verticl dotted lines re, mong which the ones ccepted to be the points for the Hwkes process re lbel with t k where k = 1, 2,..., 8. The conditionl intensity λ(t) is plotted s the solid curve. The left-continuous piece-wisely constnt λ used in ech itertion inside the while loop t line 2 of Algorithm 3 is plotted s the dshed lines. On ech verticl dotted line, there re two points plotted. The lower ones re mrked with tringles nd represent the vlues of the uniform rndom vrible D (rnges from 0 to 1) generted t line 7 of Algorithm 3; the upper ones represent the vlues of D λ (rnges from 0 to λ) t line 8 nd re either lbeled with cross mrks for those ccepted (when D λ λ( )) or with circles for those rejected. 11

12 12 Figure 2: An illustrtive exmple of the left-continuous conditionl intensity λ(t) (top pnel) nd the ssocited right-continuous counting process N(t) (bottom pnel) for univrite Hwkes process with exponentil decy tht hs prmeters µ = 1.2, α = 0.6 nd β = 0.8. The conditionl intensity strts from nd keeps t the bse intensity µ = 1.2 until the occurrence of the first point. After ech occurrence, the intensity jumps with size of α = 0.6 nd then immeditely strts decying t rte determined by β = 0.8. On the other hnd, the ssocited counting process is step function tht jump by 1 t ech occurrence.

13 Figure 3: An illustrtive exmple of simulting univrite Hwkes process with exponentil kernel γ(u) = αe βu where α = 0.6, β = 0.8 nd bse intensity u = 1.2, using Algorithm 3. All the cndidte points re mrked on the x-xis where the verticl dotted lines re, mong which the ones ccepted to be the points for the Hwkes process re lbel with t k where k = 1, 2,..., 8. The conditionl intensity λ(t) is plotted s the solid curve. The left-continuous piece-wisely constnt λ used in ech itertion inside the while loop t line 2 of Algorithm 3 is plotted s the dshed lines. On ech verticl dotted line, there re two points plotted. The lower ones re mrked with tringles nd represent the vlues of the uniform rndom vrible D (rnges from 0 to 1) generted t line 7 of Algorithm 3; the upper ones represent the vlues of D λ (rnges from 0 to λ) t line 8 nd re either lbeled with cross mrks for those ccepted (when D λ λ( )) or with circles for those rejected. References Csell, G. nd R. Berger Sttisticl Inference, Duxbury dvnced series in sttistics nd decision sciences. Thomson Lerning. Dley, D. nd D. Vere-Jones An Introduction to the Theory of Point Processes, Volume 1. Springer. Donld L. Snyder, M. I. M Rndom Point Processes in Time nd Spce, Springer Texts in Electricl Engineering, 2 edition. Springer-Verlg New York. Grndell, J Mixed Poisson Processes (Chpmn & Hll/CRC Monogrphs on Sttistics & Applied Probbility). Chpmn nd Hll/CRC. 13

14 Hwkes, A. G Spectr of some self-exciting nd mutully exciting point processes. Biometrik, 58(1): Khinchin, A Mthemticl Methods in the Theory of Queueing, Griffin s sttisticl monogrphs & courses no. 7. Hfner. Lst, G. nd A. Brn Mrked Point Processes on the Rel Line: The Dynmicl Approch (Probbility nd Its Applictions). Springer. Lewis, P. A. W. nd G. S. Shedler Simultion of nonhomogeneous Poisson processes by thinning. Nvl Res. Logistics Qurt, 26: Ogt, Y On lewis simultion method for point processes. IEEE Trns. Inform. Theory, 27(1): Ross, S. M Stochstic Processes. Wiley. Ross, S. M Introduction to Probbility Models, Tenth Edition. Acdemic Press. Sigmn, K Sttionry Mrked Point Processes: An Intuitive Approch (Stochstic Modeling Series). Chpmn nd Hll/CRC. 14

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS.

THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS. THE EXISTENCE-UNIQUENESS THEOREM FOR FIRST-ORDER DIFFERENTIAL EQUATIONS RADON ROSBOROUGH https://intuitiveexplntionscom/picrd-lindelof-theorem/ This document is proof of the existence-uniqueness theorem

More information

Chapter 5 : Continuous Random Variables

Chapter 5 : Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll

More information

Continuous Random Variables

Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht

More information

a < a+ x < a+2 x < < a+n x = b, n A i n f(x i ) x. i=1 i=1

a < a+ x < a+2 x < < a+n x = b, n A i n f(x i ) x. i=1 i=1 Mth 33 Volume Stewrt 5.2 Geometry of integrls. In this section, we will lern how to compute volumes using integrls defined by slice nlysis. First, we recll from Clculus I how to compute res. Given the

More information

7.2 The Definite Integral

7.2 The Definite Integral 7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where

More information

Chapter 0. What is the Lebesgue integral about?

Chapter 0. What is the Lebesgue integral about? Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous

More information

Recitation 3: More Applications of the Derivative

Recitation 3: More Applications of the Derivative Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech

More information

Math 8 Winter 2015 Applications of Integration

Math 8 Winter 2015 Applications of Integration Mth 8 Winter 205 Applictions of Integrtion Here re few importnt pplictions of integrtion. The pplictions you my see on n exm in this course include only the Net Chnge Theorem (which is relly just the Fundmentl

More information

Taylor Polynomial Inequalities

Taylor Polynomial Inequalities Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil

More information

Definite integral. Mathematics FRDIS MENDELU

Definite integral. Mathematics FRDIS MENDELU Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová Brno 1 Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function defined on [, b]. Wht is the re of the

More information

Review of basic calculus

Review of basic calculus Review of bsic clculus This brief review reclls some of the most importnt concepts, definitions, nd theorems from bsic clculus. It is not intended to tech bsic clculus from scrtch. If ny of the items below

More information

ECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance

ECO 317 Economics of Uncertainty Fall Term 2007 Notes for lectures 4. Stochastic Dominance Generl structure ECO 37 Economics of Uncertinty Fll Term 007 Notes for lectures 4. Stochstic Dominnce Here we suppose tht the consequences re welth mounts denoted by W, which cn tke on ny vlue between

More information

ODE: Existence and Uniqueness of a Solution

ODE: Existence and Uniqueness of a Solution Mth 22 Fll 213 Jerry Kzdn ODE: Existence nd Uniqueness of Solution The Fundmentl Theorem of Clculus tells us how to solve the ordinry differentil eqution (ODE) du = f(t) dt with initil condition u() =

More information

Definite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30

Definite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30 Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová (Mendel University) Definite integrl MENDELU / Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function

More information

1.1. Linear Constant Coefficient Equations. Remark: A differential equation is an equation

1.1. Linear Constant Coefficient Equations. Remark: A differential equation is an equation 1 1.1. Liner Constnt Coefficient Equtions Section Objective(s): Overview of Differentil Equtions. Liner Differentil Equtions. Solving Liner Differentil Equtions. The Initil Vlue Problem. 1.1.1. Overview

More information

W. We shall do so one by one, starting with I 1, and we shall do it greedily, trying

W. We shall do so one by one, starting with I 1, and we shall do it greedily, trying Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)

More information

The Regulated and Riemann Integrals

The Regulated and Riemann Integrals Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue

More information

Review of Calculus, cont d

Review of Calculus, cont d Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some

More information

STEP FUNCTIONS, DELTA FUNCTIONS, AND THE VARIATION OF PARAMETERS FORMULA. 0 if t < 0, 1 if t > 0.

STEP FUNCTIONS, DELTA FUNCTIONS, AND THE VARIATION OF PARAMETERS FORMULA. 0 if t < 0, 1 if t > 0. STEP FUNCTIONS, DELTA FUNCTIONS, AND THE VARIATION OF PARAMETERS FORMULA STEPHEN SCHECTER. The unit step function nd piecewise continuous functions The Heviside unit step function u(t) is given by if t

More information

Math 135, Spring 2012: HW 7

Math 135, Spring 2012: HW 7 Mth 3, Spring : HW 7 Problem (p. 34 #). SOLUTION. Let N the number of risins per cookie. If N is Poisson rndom vrible with prmeter λ, then nd for this to be t lest.99, we need P (N ) P (N ) ep( λ) λ ln(.)

More information

Conservation Law. Chapter Goal. 5.2 Theory

Conservation Law. Chapter Goal. 5.2 Theory Chpter 5 Conservtion Lw 5.1 Gol Our long term gol is to understnd how mny mthemticl models re derived. We study how certin quntity chnges with time in given region (sptil domin). We first derive the very

More information

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn

More information

(4.1) D r v(t) ω(t, v(t))

(4.1) D r v(t) ω(t, v(t)) 1.4. Differentil inequlities. Let D r denote the right hnd derivtive of function. If ω(t, u) is sclr function of the sclrs t, u in some open connected set Ω, we sy tht function v(t), t < b, is solution

More information

INTRODUCTION TO INTEGRATION

INTRODUCTION TO INTEGRATION INTRODUCTION TO INTEGRATION 5.1 Ares nd Distnces Assume f(x) 0 on the intervl [, b]. Let A be the re under the grph of f(x). b We will obtin n pproximtion of A in the following three steps. STEP 1: Divide

More information

1 Probability Density Functions

1 Probability Density Functions Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our

More information

Lecture 1. Functional series. Pointwise and uniform convergence.

Lecture 1. Functional series. Pointwise and uniform convergence. 1 Introduction. Lecture 1. Functionl series. Pointwise nd uniform convergence. In this course we study mongst other things Fourier series. The Fourier series for periodic function f(x) with period 2π is

More information

The Wave Equation I. MA 436 Kurt Bryan

The Wave Equation I. MA 436 Kurt Bryan 1 Introduction The Wve Eqution I MA 436 Kurt Bryn Consider string stretching long the x xis, of indeterminte (or even infinite!) length. We wnt to derive n eqution which models the motion of the string

More information

A NOTE ON ESTIMATION OF THE GLOBAL INTENSITY OF A CYCLIC POISSON PROCESS IN THE PRESENCE OF LINEAR TREND

A NOTE ON ESTIMATION OF THE GLOBAL INTENSITY OF A CYCLIC POISSON PROCESS IN THE PRESENCE OF LINEAR TREND A NOTE ON ESTIMATION OF THE GLOBAL INTENSITY OF A CYCLIC POISSON PROCESS IN THE PRESENCE OF LINEAR TREND I WAYAN MANGKU Deprtment of Mthemtics, Fculty of Mthemtics nd Nturl Sciences, Bogor Agriculturl

More information

1 The Riemann Integral

1 The Riemann Integral The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re

More information

Math 426: Probability Final Exam Practice

Math 426: Probability Final Exam Practice Mth 46: Probbility Finl Exm Prctice. Computtionl problems 4. Let T k (n) denote the number of prtitions of the set {,..., n} into k nonempty subsets, where k n. Argue tht T k (n) kt k (n ) + T k (n ) by

More information

Sections 5.2: The Definite Integral

Sections 5.2: The Definite Integral Sections 5.2: The Definite Integrl In this section we shll formlize the ides from the lst section to functions in generl. We strt with forml definition.. The Definite Integrl Definition.. Suppose f(x)

More information

We partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b.

We partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b. Mth 255 - Vector lculus II Notes 4.2 Pth nd Line Integrls We begin with discussion of pth integrls (the book clls them sclr line integrls). We will do this for function of two vribles, but these ides cn

More information

Riemann Integrals and the Fundamental Theorem of Calculus

Riemann Integrals and the Fundamental Theorem of Calculus Riemnn Integrls nd the Fundmentl Theorem of Clculus Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University September 16, 2013 Outline Grphing Riemnn Sums

More information

Stuff You Need to Know From Calculus

Stuff You Need to Know From Calculus Stuff You Need to Know From Clculus For the first time in the semester, the stuff we re doing is finlly going to look like clculus (with vector slnt, of course). This mens tht in order to succeed, you

More information

Solution for Assignment 1 : Intro to Probability and Statistics, PAC learning

Solution for Assignment 1 : Intro to Probability and Statistics, PAC learning Solution for Assignment 1 : Intro to Probbility nd Sttistics, PAC lerning 10-701/15-781: Mchine Lerning (Fll 004) Due: Sept. 30th 004, Thursdy, Strt of clss Question 1. Bsic Probbility ( 18 pts) 1.1 (

More information

Section 6.1 INTRO to LAPLACE TRANSFORMS

Section 6.1 INTRO to LAPLACE TRANSFORMS Section 6. INTRO to LAPLACE TRANSFORMS Key terms: Improper Integrl; diverge, converge A A f(t)dt lim f(t)dt Piecewise Continuous Function; jump discontinuity Function of Exponentil Order Lplce Trnsform

More information

1 1D heat and wave equations on a finite interval

1 1D heat and wave equations on a finite interval 1 1D het nd wve equtions on finite intervl In this section we consider generl method of seprtion of vribles nd its pplictions to solving het eqution nd wve eqution on finite intervl ( 1, 2. Since by trnsltion

More information

f(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral

f(x) dx, If one of these two conditions is not met, we call the integral improper. Our usual definition for the value for the definite integral Improper Integrls Every time tht we hve evluted definite integrl such s f(x) dx, we hve mde two implicit ssumptions bout the integrl:. The intervl [, b] is finite, nd. f(x) is continuous on [, b]. If one

More information

UNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction

UNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction Lesson : Logrithmic Functions s Inverses Prerequisite Skills This lesson requires the use of the following skills: determining the dependent nd independent vribles in n exponentil function bsed on dt from

More information

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004

Advanced Calculus: MATH 410 Notes on Integrals and Integrability Professor David Levermore 17 October 2004 Advnced Clculus: MATH 410 Notes on Integrls nd Integrbility Professor Dvid Levermore 17 October 2004 1. Definite Integrls In this section we revisit the definite integrl tht you were introduced to when

More information

P 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0)

P 3 (x) = f(0) + f (0)x + f (0) 2. x 2 + f (0) . In the problem set, you are asked to show, in general, the n th order term is a n = f (n) (0) 1 Tylor polynomils In Section 3.5, we discussed how to pproximte function f(x) round point in terms of its first derivtive f (x) evluted t, tht is using the liner pproximtion f() + f ()(x ). We clled this

More information

Math 31S. Rumbos Fall Solutions to Assignment #16

Math 31S. Rumbos Fall Solutions to Assignment #16 Mth 31S. Rumbos Fll 2016 1 Solutions to Assignment #16 1. Logistic Growth 1. Suppose tht the growth of certin niml popultion is governed by the differentil eqution 1000 dn N dt = 100 N, (1) where N(t)

More information

We divide the interval [a, b] into subintervals of equal length x = b a n

We divide the interval [a, b] into subintervals of equal length x = b a n Arc Length Given curve C defined by function f(x), we wnt to find the length of this curve between nd b. We do this by using process similr to wht we did in defining the Riemnn Sum of definite integrl:

More information

DIRECT CURRENT CIRCUITS

DIRECT CURRENT CIRCUITS DRECT CURRENT CUTS ELECTRC POWER Consider the circuit shown in the Figure where bttery is connected to resistor R. A positive chrge dq will gin potentil energy s it moves from point to point b through

More information

Improper Integrals. Type I Improper Integrals How do we evaluate an integral such as

Improper Integrals. Type I Improper Integrals How do we evaluate an integral such as Improper Integrls Two different types of integrls cn qulify s improper. The first type of improper integrl (which we will refer to s Type I) involves evluting n integrl over n infinite region. In the grph

More information

( dg. ) 2 dt. + dt. dt j + dh. + dt. r(t) dt. Comparing this equation with the one listed above for the length of see that

( dg. ) 2 dt. + dt. dt j + dh. + dt. r(t) dt. Comparing this equation with the one listed above for the length of see that Arc Length of Curves in Three Dimensionl Spce If the vector function r(t) f(t) i + g(t) j + h(t) k trces out the curve C s t vries, we cn mesure distnces long C using formul nerly identicl to one tht we

More information

p-adic Egyptian Fractions

p-adic Egyptian Fractions p-adic Egyptin Frctions Contents 1 Introduction 1 2 Trditionl Egyptin Frctions nd Greedy Algorithm 2 3 Set-up 3 4 p-greedy Algorithm 5 5 p-egyptin Trditionl 10 6 Conclusion 1 Introduction An Egyptin frction

More information

Riemann Sums and Riemann Integrals

Riemann Sums and Riemann Integrals Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties

More information

Green s functions. f(t) =

Green s functions. f(t) = Consider the 2nd order liner inhomogeneous ODE Green s functions d 2 u 2 + k(t)du + p(t)u(t) = f(t). Of course, in prctice we ll only del with the two prticulr types of 2nd order ODEs we discussed lst

More information

A product convergence theorem for Henstock Kurzweil integrals

A product convergence theorem for Henstock Kurzweil integrals A product convergence theorem for Henstock Kurzweil integrls Prsr Mohnty Erik Tlvil 1 Deprtment of Mthemticl nd Sttisticl Sciences University of Albert Edmonton AB Cnd T6G 2G1 pmohnty@mth.ulbert.c etlvil@mth.ulbert.c

More information

Math 360: A primitive integral and elementary functions

Math 360: A primitive integral and elementary functions Mth 360: A primitive integrl nd elementry functions D. DeTurck University of Pennsylvni October 16, 2017 D. DeTurck Mth 360 001 2017C: Integrl/functions 1 / 32 Setup for the integrl prtitions Definition:

More information

and that at t = 0 the object is at position 5. Find the position of the object at t = 2.

and that at t = 0 the object is at position 5. Find the position of the object at t = 2. 7.2 The Fundmentl Theorem of Clculus 49 re mny, mny problems tht pper much different on the surfce but tht turn out to be the sme s these problems, in the sense tht when we try to pproimte solutions we

More information

Bernoulli Numbers Jeff Morton

Bernoulli Numbers Jeff Morton Bernoulli Numbers Jeff Morton. We re interested in the opertor e t k d k t k, which is to sy k tk. Applying this to some function f E to get e t f d k k tk d k f f + d k k tk dk f, we note tht since f

More information

The First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a).

The First Fundamental Theorem of Calculus. If f(x) is continuous on [a, b] and F (x) is any antiderivative. f(x) dx = F (b) F (a). The Fundmentl Theorems of Clculus Mth 4, Section 0, Spring 009 We now know enough bout definite integrls to give precise formultions of the Fundmentl Theorems of Clculus. We will lso look t some bsic emples

More information

Line Integrals. Partitioning the Curve. Estimating the Mass

Line Integrals. Partitioning the Curve. Estimating the Mass Line Integrls Suppose we hve curve in the xy plne nd ssocite density δ(p ) = δ(x, y) t ech point on the curve. urves, of course, do not hve density or mss, but it my sometimes be convenient or useful to

More information

8 Laplace s Method and Local Limit Theorems

8 Laplace s Method and Local Limit Theorems 8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved

More information

S. S. Dragomir. 2, we have the inequality. b a

S. S. Dragomir. 2, we have the inequality. b a Bull Koren Mth Soc 005 No pp 3 30 SOME COMPANIONS OF OSTROWSKI S INEQUALITY FOR ABSOLUTELY CONTINUOUS FUNCTIONS AND APPLICATIONS S S Drgomir Abstrct Compnions of Ostrowski s integrl ineulity for bsolutely

More information

Riemann Sums and Riemann Integrals

Riemann Sums and Riemann Integrals Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct

More information

Reversals of Signal-Posterior Monotonicity for Any Bounded Prior

Reversals of Signal-Posterior Monotonicity for Any Bounded Prior Reversls of Signl-Posterior Monotonicity for Any Bounded Prior Christopher P. Chmbers Pul J. Hely Abstrct Pul Milgrom (The Bell Journl of Economics, 12(2): 380 391) showed tht if the strict monotone likelihood

More information

Numerical Analysis: Trapezoidal and Simpson s Rule

Numerical Analysis: Trapezoidal and Simpson s Rule nd Simpson s Mthemticl question we re interested in numericlly nswering How to we evlute I = f (x) dx? Clculus tells us tht if F(x) is the ntiderivtive of function f (x) on the intervl [, b], then I =

More information

7 - Continuous random variables

7 - Continuous random variables 7-1 Continuous rndom vribles S. Lll, Stnford 2011.01.25.01 7 - Continuous rndom vribles Continuous rndom vribles The cumultive distribution function The uniform rndom vrible Gussin rndom vribles The Gussin

More information

ARITHMETIC OPERATIONS. The real numbers have the following properties: a b c ab ac

ARITHMETIC OPERATIONS. The real numbers have the following properties: a b c ab ac REVIEW OF ALGEBRA Here we review the bsic rules nd procedures of lgebr tht you need to know in order to be successful in clculus. ARITHMETIC OPERATIONS The rel numbers hve the following properties: b b

More information

4.4 Areas, Integrals and Antiderivatives

4.4 Areas, Integrals and Antiderivatives . res, integrls nd ntiderivtives 333. Ares, Integrls nd Antiderivtives This section explores properties of functions defined s res nd exmines some connections mong res, integrls nd ntiderivtives. In order

More information

3.4 Numerical integration

3.4 Numerical integration 3.4. Numericl integrtion 63 3.4 Numericl integrtion In mny economic pplictions it is necessry to compute the definite integrl of relvlued function f with respect to "weight" function w over n intervl [,

More information

Reinforcement learning II

Reinforcement learning II CS 1675 Introduction to Mchine Lerning Lecture 26 Reinforcement lerning II Milos Huskrecht milos@cs.pitt.edu 5329 Sennott Squre Reinforcement lerning Bsics: Input x Lerner Output Reinforcement r Critic

More information

Chapters 4 & 5 Integrals & Applications

Chapters 4 & 5 Integrals & Applications Contents Chpters 4 & 5 Integrls & Applictions Motivtion to Chpters 4 & 5 2 Chpter 4 3 Ares nd Distnces 3. VIDEO - Ares Under Functions............................................ 3.2 VIDEO - Applictions

More information

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3

UNIFORM CONVERGENCE. Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 UNIFORM CONVERGENCE Contents 1. Uniform Convergence 1 2. Properties of uniform convergence 3 Suppose f n : Ω R or f n : Ω C is sequence of rel or complex functions, nd f n f s n in some sense. Furthermore,

More information

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.

NUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by. NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with

More information

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies

State space systems analysis (continued) Stability. A. Definitions A system is said to be Asymptotically Stable (AS) when it satisfies Stte spce systems nlysis (continued) Stbility A. Definitions A system is sid to be Asymptoticlly Stble (AS) when it stisfies ut () = 0, t > 0 lim xt () 0. t A system is AS if nd only if the impulse response

More information

Review of Riemann Integral

Review of Riemann Integral 1 Review of Riemnn Integrl In this chpter we review the definition of Riemnn integrl of bounded function f : [, b] R, nd point out its limittions so s to be convinced of the necessity of more generl integrl.

More information

Improper Integrals, and Differential Equations

Improper Integrals, and Differential Equations Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted

More information

AMATH 731: Applied Functional Analysis Fall Some basics of integral equations

AMATH 731: Applied Functional Analysis Fall Some basics of integral equations AMATH 731: Applied Functionl Anlysis Fll 2009 1 Introduction Some bsics of integrl equtions An integrl eqution is n eqution in which the unknown function u(t) ppers under n integrl sign, e.g., K(t, s)u(s)

More information

SUMMER KNOWHOW STUDY AND LEARNING CENTRE

SUMMER KNOWHOW STUDY AND LEARNING CENTRE SUMMER KNOWHOW STUDY AND LEARNING CENTRE Indices & Logrithms 2 Contents Indices.2 Frctionl Indices.4 Logrithms 6 Exponentil equtions. Simplifying Surds 13 Opertions on Surds..16 Scientific Nottion..18

More information

Chapter 3 Polynomials

Chapter 3 Polynomials Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling

More information

Mapping the delta function and other Radon measures

Mapping the delta function and other Radon measures Mpping the delt function nd other Rdon mesures Notes for Mth583A, Fll 2008 November 25, 2008 Rdon mesures Consider continuous function f on the rel line with sclr vlues. It is sid to hve bounded support

More information

Generalized Fano and non-fano networks

Generalized Fano and non-fano networks Generlized Fno nd non-fno networks Nildri Ds nd Brijesh Kumr Ri Deprtment of Electronics nd Electricl Engineering Indin Institute of Technology Guwhti, Guwhti, Assm, Indi Emil: {d.nildri, bkri}@iitg.ernet.in

More information

ON THE C-INTEGRAL BENEDETTO BONGIORNO

ON THE C-INTEGRAL BENEDETTO BONGIORNO ON THE C-INTEGRAL BENEDETTO BONGIORNO Let F : [, b] R be differentible function nd let f be its derivtive. The problem of recovering F from f is clled problem of primitives. In 1912, the problem of primitives

More information

Lecture 14: Quadrature

Lecture 14: Quadrature Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl

More information

10 Vector Integral Calculus

10 Vector Integral Calculus Vector Integrl lculus Vector integrl clculus extends integrls s known from clculus to integrls over curves ("line integrls"), surfces ("surfce integrls") nd solids ("volume integrls"). These integrls hve

More information

Joint distribution. Joint distribution. Marginal distributions. Joint distribution

Joint distribution. Joint distribution. Marginal distributions. Joint distribution Joint distribution To specify the joint distribution of n rndom vribles X 1,...,X n tht tke vlues in the smple spces E 1,...,E n we need probbility mesure, P, on E 1... E n = {(x 1,...,x n ) x i E i, i

More information

Topic 1 Notes Jeremy Orloff

Topic 1 Notes Jeremy Orloff Topic 1 Notes Jerem Orloff 1 Introduction to differentil equtions 1.1 Gols 1. Know the definition of differentil eqution. 2. Know our first nd second most importnt equtions nd their solutions. 3. Be ble

More information

SYDE 112, LECTURES 3 & 4: The Fundamental Theorem of Calculus

SYDE 112, LECTURES 3 & 4: The Fundamental Theorem of Calculus SYDE 112, LECTURES & 4: The Fundmentl Theorem of Clculus So fr we hve introduced two new concepts in this course: ntidifferentition nd Riemnn sums. It turns out tht these quntities re relted, but it is

More information

MAA 4212 Improper Integrals

MAA 4212 Improper Integrals Notes by Dvid Groisser, Copyright c 1995; revised 2002, 2009, 2014 MAA 4212 Improper Integrls The Riemnn integrl, while perfectly well-defined, is too restrictive for mny purposes; there re functions which

More information

1 Online Learning and Regret Minimization

1 Online Learning and Regret Minimization 2.997 Decision-Mking in Lrge-Scle Systems My 10 MIT, Spring 2004 Hndout #29 Lecture Note 24 1 Online Lerning nd Regret Minimiztion In this lecture, we consider the problem of sequentil decision mking in

More information

1.2. Linear Variable Coefficient Equations. y + b "! = a y + b " Remark: The case b = 0 and a non-constant can be solved with the same idea as above.

1.2. Linear Variable Coefficient Equations. y + b ! = a y + b  Remark: The case b = 0 and a non-constant can be solved with the same idea as above. 1 12 Liner Vrible Coefficient Equtions Section Objective(s): Review: Constnt Coefficient Equtions Solving Vrible Coefficient Equtions The Integrting Fctor Method The Bernoulli Eqution 121 Review: Constnt

More information

CS 188 Introduction to Artificial Intelligence Fall 2018 Note 7

CS 188 Introduction to Artificial Intelligence Fall 2018 Note 7 CS 188 Introduction to Artificil Intelligence Fll 2018 Note 7 These lecture notes re hevily bsed on notes originlly written by Nikhil Shrm. Decision Networks In the third note, we lerned bout gme trees

More information

Numerical Integration

Numerical Integration Chpter 5 Numericl Integrtion Numericl integrtion is the study of how the numericl vlue of n integrl cn be found. Methods of function pproximtion discussed in Chpter??, i.e., function pproximtion vi the

More information

Properties of the Riemann Integral

Properties of the Riemann Integral Properties of the Riemnn Integrl Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University Februry 15, 2018 Outline 1 Some Infimum nd Supremum Properties 2

More information

UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE

UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence

More information

Goals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite

Goals: Determine how to calculate the area described by a function. Define the definite integral. Explore the relationship between the definite Unit #8 : The Integrl Gols: Determine how to clculte the re described by function. Define the definite integrl. Eplore the reltionship between the definite integrl nd re. Eplore wys to estimte the definite

More information

CS667 Lecture 6: Monte Carlo Integration 02/10/05

CS667 Lecture 6: Monte Carlo Integration 02/10/05 CS667 Lecture 6: Monte Crlo Integrtion 02/10/05 Venkt Krishnrj Lecturer: Steve Mrschner 1 Ide The min ide of Monte Crlo Integrtion is tht we cn estimte the vlue of n integrl by looking t lrge number of

More information

Administrivia CSE 190: Reinforcement Learning: An Introduction

Administrivia CSE 190: Reinforcement Learning: An Introduction Administrivi CSE 190: Reinforcement Lerning: An Introduction Any emil sent to me bout the course should hve CSE 190 in the subject line! Chpter 4: Dynmic Progrmming Acknowledgment: A good number of these

More information

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz

More information

Definition of Continuity: The function f(x) is continuous at x = a if f(a) exists and lim

Definition of Continuity: The function f(x) is continuous at x = a if f(a) exists and lim Mth 9 Course Summry/Study Guide Fll, 2005 [1] Limits Definition of Limit: We sy tht L is the limit of f(x) s x pproches if f(x) gets closer nd closer to L s x gets closer nd closer to. We write lim f(x)

More information

Acceptance Sampling by Attributes

Acceptance Sampling by Attributes Introduction Acceptnce Smpling by Attributes Acceptnce smpling is concerned with inspection nd decision mking regrding products. Three spects of smpling re importnt: o Involves rndom smpling of n entire

More information

Numerical integration

Numerical integration 2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter

More information

Appendix 3, Rises and runs, slopes and sums: tools from calculus

Appendix 3, Rises and runs, slopes and sums: tools from calculus Appendi 3, Rises nd runs, slopes nd sums: tools from clculus Sometimes we will wnt to eplore how quntity chnges s condition is vried. Clculus ws invented to do just this. We certinly do not need the full

More information

A recursive construction of efficiently decodable list-disjunct matrices

A recursive construction of efficiently decodable list-disjunct matrices CSE 709: Compressed Sensing nd Group Testing. Prt I Lecturers: Hung Q. Ngo nd Atri Rudr SUNY t Bufflo, Fll 2011 Lst updte: October 13, 2011 A recursive construction of efficiently decodble list-disjunct

More information

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1

MATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1 MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further

More information

Math& 152 Section Integration by Parts

Math& 152 Section Integration by Parts Mth& 5 Section 7. - Integrtion by Prts Integrtion by prts is rule tht trnsforms the integrl of the product of two functions into other (idelly simpler) integrls. Recll from Clculus I tht given two differentible

More information