Average Reward Optimization Objective In Partially Observable Domains - Supplementary Material
|
|
- Allison Newton
- 6 years ago
- Views:
Transcription
1 Average Reward Optimizatio Objective I Partially Observable Domais - Supplemetary Material Aother example of a cotrolled system (see Sec. 4.2) Figure 3. The first two plots describe the behavior of the system which rotates the state by a 10 ad b 10, with the reset states aliged i a way that takig the opposite actio brigs the system to its topmost poit. The x ad y i the plots represet possible actios such that x y. The bottom plot demostrates how the average reward chages as a fuctio of α ad β, where the policies havig 2 hidde states (S {1, 2}) are parametrized as: P π(a S = 1) = P π(b S = 2) = 1, P π(s = 1 S = 1, a, o 1) = P π(s = 2 S = 2, a, o 1) = α, P π(s = 2 S = 1, a, o 2) = P π(s = 1 S = 2, a, o 2) = α, P π(s = 1 S = 1, b, o 1) = P π(s = 2 S = 2, b, o 1) = β, P π(s = 2 S = 1, b, o 2) = P π(s = 1 S = 2, b, o 2) = β.
2 Proof of Lemma 1 1.: EE = E E = E is immediate from the defiitio of E. Therefore 1 Et ]E = E for ay, implyig that also E E = E. 2.: ( ] (E E ) = (E EE ) = E (I E ) = E ( 1) )(E i ) i i i=0 ( ( ) ) ] = E I + ( 1) i 1 E = E E, i i=0 where some of the equalities follow from property 1, ad the last equality holds sice the alteratig sum of biomial coefficiets equals to 0. 3.: Sice (E I) has rak 1, the eigespace of E correspodig to the eigevalue 1 is oe dimesioal. So we have a uique ρ such that ρ E = ρ ad ρ 1 = 1. Also, if Ev = v the v is a costat vector because the rows of E sum to 1. Hece also, ρ E = ρ ad E 1 = 1. Now, from property 1 we have E (E I) = 0, meaig that the rows of E are multiples of ρ. Also, we have (E I)E = 0, meaig that the colums of E are costat vectors. Combiig all together we get E = 1ρ. 4.: Observe that (E E ) is Cesaro summable to 0, i.e. 1 (E E ) t = 1 E t ] E 0, due to property 2. So, by Kemey & Sell (1960) (Thm ) ad property 2, 1 I (E E )] 1 = lim k=0 t (E E ) t = I + lim 1 t=1 k=1 t (E k E ). 5.: Follows from replacig Z with the right-had side of Eq. (2). Proof of Theorem 2 The proof is essetially idetical to the proof of Theorem 1 i Schweitzer (1968), which is, however, restricted to Markov chai trasitio matrices. We have, I (E 2 E 1 )Z 1 = (Z 1 1 E 2 + E 1 )Z 1 = (I E 2 + E 1 )Z 1 = (Z E 1 E 2 )Z 1 = Z 1 2 (I + E 1 E 2 )Z 1, where all (except for the last) iequalities follow from the defiitio of Z i. The last equality holds sice Z 1 2 E 1 = E 1 ad Z 1 2 E 2 = E 2, which i tur is due to Z 1 2 havig rows sum to 1, ad property 3 i Lemma 1. Now, observe that (E 2 E 1 ) 2 = 0, meaig that Theorem i Kemey & Sell (1960) ca be applied o (E 2 E 1 ), ad we get I (E 2 E 1 )] 1 = I E 1 + E 2, which proves Eq. (3). Fially, ρ 1 H 1 2 = ρ 1 Z 1 1 I E 1 + E 2 ]Z 2 = ρ 1 E 2 Z 2 = ρ 2 Z 2 = ρ 2, where ( ) is due to property 3 i Lemma 1 ad ρ 1 1 = 1, while the last equality is due to property 5 i Lemma 1.
3 Proof of Theorem 3 Average Reward Optimizatio Objective - Supplemetary Material Recall the cocept of a system dyamics matrix (SDM) (Sigh et al., 2004), also kow as predictio matrix (Faigle & Schohuth, 2007). This is a ifiite dimesioal matrix, whose colums correspod to possible histories (ordered i a icreasig legth) ad rows correspod to possible tests (ordered i a icreasig legth). The elemets of this matrix represet coditioal probabilities of observig each test give each history (for more details see Sigh et al. (2004); Faigle & Schohuth (2007)). If the SDM has rak k the the system ca be represeted by a k-dimesioal liear PSR, ad the square submatrix of SDM of dimesio A O k will be of rak k (e.g. see James (2005)). Accordig to Wiewiora (2007), the system resultig from combiig a k-dimesioal liear PSR with cotrol ad a policy with memory of size l ca be represeted with a liear PSR without cotrol whose dimesio is at most k l. We will deote the distributio over future sequeces i such a system with P. Let be the largest rak of a SDM iduced by some policy, implyig that a miimal dimesioal PSR for this system has rak (Wiewiora, 2007). Let g (i) represet the expected state of the system after i time steps, i.e. g (i) is a ifiite-dimesioal vector such that g (i) of colums of SDM, we have that G spa{g (0) (t) = h A O P (t h)p i (h). Sice g (i) are liear combiatios, g(1),...} is at most dimesioal. Let m be the maximum dimesio of G for ay Θ. We will use the followig results from Faigle & Schohuth (2007), which cosider a stochastic process represeted by a OOM for a fixed Θ: 1. If G is m-dimesioal, {g (0),..., g(m 1) } is a basis for G. 2. the state evolutio operator ca be represeted by the matrix E R m m relative to this basis, such that E = c (0) c (1) c (2) c (m 1) where m 1 j=0 c(j) = 1, ad all c (j) -s are uique. E is the PSR evolutio matrix represeted uder a differet basis sice j N : g (j) = m 1 i=0 a(j) i g (i), where a(j) (a (j) 0,..., a(j) m 1 ) = (1, 0,..., 0) Ej. I other words, it outputs the ext expected state provided the curret state. 3. Furthermore, E lim k k Et exists. The remaiig of the proof cocers the costructio of c (i) -s as fuctios of ad showig that these are well defied ratioal fuctios of for all Θ. Oce this is doe, Theorem 2 ca be applied o two arbitrary matrices E 1 Θ, E 2 Θ, cocludig the proof. Due to the properties of SDM metioed above, we ca idetify ifiite-dimesioal vectors g (i) with their fiite dimesioal couterparts g (i) R A O, where t { A O i } i=1,..., : g (i) (t) = g(i) (t), such that dim spa{g (0) ], g(1),...} = dim, spa{g (0) ], g(1),...}, for all Θ. Note that the same matrix E represets the uique 1 evolutio matrix relative to {g (0),..., g(m 1) }. Let G R A O m be defied as ] G =,..., g(m 1). g (0), g(1) Note that is a direct parametrizatio of a policy, meaig that elemets of G are polyomials i. Thus, Propositio 1 is applicable to G, ad from there we obtai a well defied orthogoal basis {b (0),..., b(m 1) } for 1 As log as {g (0),..., g(m 1) } is liearly idepedet set of vectors.
4 the colum space of G, such that these basis vectors are ratioal fuctios of. Now we ca defie c (i) i the followig recursive way: ] ] i = m 1 : c (i) = g (m) b (m 1) b (m 1) 2 2 i < m 1 : c (i) = g (m) ] ]. i+1 j=m c(j) g(j) b (i) b (i) 2 2 It is easy to verify that ideed we get g (m) = m 1 i=0 c(i) g(i) for -s for which c (i) -s are well defied. We also kow that these coefficiets are uique as log as G has full rak. Sice these coefficiets are ratioal fuctios of, by the same argumet as i Propositio 1 we get that aroud ay potetial sigularity poit i c (i) we ca fid a sequece of -s covergig to the sigularity poit while c (i) is well defied o this sequece. However, we kow that for all -s where c (i) -s are well defied, they must be bouded. This is due to the fact that E exists for all such -s, implyig that the spectral radius of E is bouded (ad equals to 1). Hece, 0 i < m : c (i) do ot have sigularity poits, or i other words, are well defied for all Θ. Fially, we ote that every E satisfies rak(e I) = 1 by costructio, so the coditios of Theorem 2 for ay pair of these matrices are satisfied. The left eigevector correspodig to eigevalue 1 of E idetifies the statioary mea of the stochastic process S iduced by policy due to the followig: this vector represets the ivariat state of the system with respect to colum vectors i G, which are by themselves liear combiatios of ay fixed colum basis of SDM matrix. Recall that due to Theorem 2, the etries of this eigevector are ratioal fuctios of policy parameters. Therefore, we get that each etry of the statioary distributio of PSR is also a ratioal fuctio of policy parameters. To complete the proof, ote that the statioary distributio of PSR that we have obtaied coicides with the empirical distributio of sequeces observed from data sice the statioary distributio is uique, which it tur is due to the ergodicity assumptio. Propositio 1. Let G R m, m, be a ratioal matrix valued fuctio of Θ, such that G is bouded i Θ, ad Θ be a subspace of some fiite dimesioal Euclidea space. Assume that G has full rak for some Θ. Let {g (i) } 0 i< be the colums of G. The, {b (0),..., b( 1) } defied by i = 0 : i > 0 : b (i) b (i) = g (i) = g (i) i 1 j=0 g (i) ] 2 2 is a well defied orthogoal basis for the colum space of G for all Θ. Proof. Sice G is ratioal i, {b (i) } 0 i< are ratioal fuctios (elemet wise) i. For ay, i particular where the fuctio is ot defied/sigular 2, we ca fid a sequece 1, 2,... where this fuctio is well defied. Suppose that such a sigularity occurs to some elemet of b (i) 0 for some 0 Θ, ad without loss of geerality assume that 0 are well defied for 0 j < i. Sice j : g (j) -s are bouded, at least oe of the elemets of the followig terms (0 j < i) must approach sigularity as 0 : But 2 is bouded aroud 0, leadig to a cotradic- meaig that g (i) tio. g (i) ] 2 2 g (i) ] 2 2 ( = g (i) must have a sigularity poit at 0 sice ±. b(j) ] 2 ) 2,, 2 The fuctio f(x) is sigular at poits {x X limˆx x f(ˆx) = ± }. For ratioal fuctios, these are the roots of the polyomial i the deomiator, which do ot coicide with the roots of the polyomial i the umerator.
5 Proof of Theorem 4 Average Reward Optimizatio Objective - Supplemetary Material The proof of this theorem uses two results that are give i Propositios 2 ad 3 with their proofs attached. Propositio 2 provides a clear way of defiig parameters of a PSR without cotrol give a PSR (with cotrol) ad the parameters of a fiite memory policy. Propositio 3 shows that oe ca obtai the state of the PSR (with cotrol) from the state of the PSR without cotrol by applyig a liear operator. 1 First, we start by showig that lim R t exists almost surely for ay policy Θ. Recall that we do ot assume that the process is AMS (otherwise there is othig to prove), oly that the process is ergodic. Let R k = k R t, { limk R f( ) k if the limit exists R mi 1 otherwise, { Rk if f( ) R f k ( ) mi R mi 1 otherwise, where R mi is the lowest achievable reward (recall that the reward is bouded). From the defiitio we have that {f k } k f poitwise everywhere. Sice {f k } are uiformly bouded, lim E (f k ) = E (f). k Fially, ote that the set {f( ) = y} is ivariat for ay y because f is ivariat: f(tx) = f(x). By the defiitio of ergodicity, such a set has either probability 1 or 0. Further we show that lim k E (R k ) is well defied, which esures that E (f) = E (lim k R k ) R mi 3, f = E (f) almost surely. Let {w,, W,ao, p,0 } be the miimal PSR without cotrol for some policy, ad let W, ao W,ao be the PSR evolutio matrix. Due to the properties of this matrix discussed earlier we have that W lim W t, exists. 3 Let B idicate the set for which lim k R k exists. The lim k E (R k ) = lim k R B kdp + ] R B k dp = lim k R B kdp + lim k B R kdp = lim k E (R k B)P (B) + lim k B R kdp. Sice both the left had side limit ad the first right had side limit are well defied, the the secod right had side limit must exist as well, implyig that P ( B) = 0.
6 Therefore, lim k E ( k ) R t = lim 1 = lim E (R t ) = lim t=1 = lim 1 lim r a V t=1 E (R t ) (1) h (t) E(R t h (t) )P ( h (t) ) (2) t=1 h (t 1),a,o t=1 h (t 1),o lim r a p( h (t 1), a, o)p ( h (t 1), a, o) (3) r a V p ( h (t 1), a, o)p ( h (t 1), a, o) (4) t=1 h (t 1),o p ( h (t 1), a, o)p ( h (t 1), a, o) ] r a V lim (p,0w, W t,a ) (5) t=1 ] ) r a V (p,0 lim W, t W,a t=1 r ( a V p,0 W ) W,a = r a V (ρ W,a ) (6) a r W,a a V ρ w, W,a ρ w, W,a ρ r a V ρ (a) P (a) (7) r a V ρ (a) a ρ P ol r a ρ P RP (a) a ρ P ol (8) where (3) follows from the defiitio of the liear PRP; (4) ad (8) are due to Propositio 3 with V beig the liear operator trasformig the state of the PSR without cotrol to the state of the PSR (with cotrol); (5) is by defiitio of a liear PSR; (6) is due to the properties of the PSR evolutio matrix W,, where ρ is the statioary distributio of the PSR without cotrol iduced by policy ; ad ρ (a) i (7) ad (8) represets the state of the PSR without cotrol obtaied by startig from ρ ad takig actio a, while P (a) is the average probability of takig actio a. Fially, ote that ρ ad ρ (a) are ratioal fuctios of Θ by Theorem 3. Hece both ρ P ol ad ρ P RP (a) are ratioal fuctios of as well sice they ca be immediately obtaied from ρ ad ρ (a) through summatio ad divisio (i.e., observe that the PSR state ρ P RP is a vector of coditioal predictios while the PSR without cotrol state ρ is a vector of joit predictios). Propositio 2. Let {m, {M ao } ao A O, p 0, Q = {q 1,..., q }} be a -dimesioal liear PSR (with cotrol) ad {c 0, {T o } o O, {A a } a A } be the represetatio of a stochastic fiite state policy π of size l. Let s 0 p 0 c 0 R l, b m 1 R l, ao A O : B ao M ao A a T o R l l, where represets the Kroecker product. The, the triple {b, {B ao } ao A O, s 0 } satisfies the properties of a PSR without cotrol iduced by the policy π. I particular, P π (a 1 o 1,..., a k o k ) = s 0 B a1o 1 B ak o k b.
7 Proof. For clarity, here is the descriptio of the meaig of the stochastic fiite state policy parameters: c 0 - the iitial distributio over the states of the policy A a - the diagoal matrix with A a ] ii beig equal to probability of takig actio a i state i T o - the trasitio matrix defiig the state dyamics of the policy correspodig to observig percept o Let C ao A a T o. Recall that for ay history h, P π (o 1:k h, a 1:k ) = p(h) M a1o 1 M ak o k m = p(h) M ao1:k m, P π (a 1:k h, o 1: ) = c(h) A a1 T o1 A ak 1 c(h) C ao1: A ak 1, where 1 is a colum vector of oes of a appropriate size. Observe that By iductio (similarly to Wiewiora (2005)) we get, P π (ao) = P π (a)p π (o a) = c 0 C ao 1 p 0 M ao m. P π (ao 1:k, a k+1, o k+1 ) = P π (ao 1:k ) P π (a k+1 ao 1:k ) P π (o k+1 ao 1:k, a k+1 ) = c 0 C ao1:k 1 p 0 M ao1:k m c(ao 1:k ) A ak+1 1 p(ao 1:k ) M ak+1 o k+1 m = c 0 C ao1:k 1 p 0 M ao1:k m c 0 C ao1:k c 0 C ao 1:k 1 A a k+1 1 p 0 M ao1:k p 0 M M ak+1 o ao 1:k m k+1 m = c 0 C ao1:k A ak+1 T ok+1 1 p 0 M ao1:k+1 m = p 0 M ao1:k+1 m c 0 C ao1:k+1 1, where we used the fact that C ao1:k 1 = C ao1: A ak 1 sice every T o is a trasitio matrix. Now, the first property holds sice s 0 b = p 0 c 0 ] m 1] = p 0 m c 0 1 = 1. The secod property also holds because ] ] B ao b = M ao C ao m 1] = M ao m C ao 1] ao ao ao = M ao m A a 1] = ( ) ] M ao m A a 1 ao a o = ] m A a 1] = m A a 1 = m 1 = b. a a Fially, the last property is due to P π (ao 1:k ) = p 0 M ao1:k m c 0 C ao1:k 1 = p 0 c 0 ] M ao1:k C ao1:k ]m 1] = s 0 B ao1:k b. Propositio 3. Let the actio-observatio stochastic process be geerated from a liear -dimesioal PSR (with cotrol), p, ad a stochastic fiite state cotroller of size m parametrized by Θ. Let p be a miimal liear PSR without cotrol represetig this process. The, the state of PSR (with cotrol), p, ca be obtaied from the state of PSR without cotrol p by applyig a liear operator.
8 Proof. We will refer to p as both the PSR (with cotrol) ad the state of this PSR (which oe is meat should be clear from the cotext). Equivaletly, we will refer to p as both the PSR without cotrol ad the state of this PSR. First, let {b, B ao, s 0 } be defied as i Propositio 2 from p ad the parameters of the policy represeted as {c 0, {T o } o O, {A a } a A }. Let U = I 1 R m, where I is the -dimesioal idetity matrix. Let s(h) p(h) c(h) be the state of this PSR-like costruct after observig history h. The, Us(h) = I 1 ]s(h) = I 1 ]p(h) c(h)] = p(h) 1 c(h)] = p(h). Therefore we ca recover the state of the eviromet p from the state of our costruct by applyig a liear operator. What is missig yet, is the coectio betwee this costruct ad the PSR without cotrol p. Recall that p is a vector of predictios of some sequeces of observatios give some sequeces of actios. So it is clear that we ca compute p from the joit distributio over actio observatio pairs provided by the state of p, which i geeral is a ratioal fuctio of p. Let V ( ) : p p be such a mappig. Let the dimesio of p be k, ad W be m k matrix whose colums are coefficiets of k core tests with respect to the costruct {b, B ao, s 0 }: s(h) W = p (h) for ay h. Now, we have that for ay h: Us(h) = p(h) = V (s(h) W ) = V (p (h)). From here the coclusio follows. We ca represet the operator V with matrix V R k. V ca be obtaied by solvig the followig system of equatios: V = PP 1, where P R k k represets a collectio (matrix) of k liearly idepedet states (those correspodig to core histories) ad P R k represets a collectio of eviromet states correspodig to the same histories. Proof of Corollary 5 I both represetatios the average reward fuctio is liear i the statioary distributio as a fuctio of the policy parameters, hece the complexity of the statioary distributio gives the upper boud o the complexity of the average reward. Let k be the size of the stochastic fiite state cotrollers we cosider. We aalyze the complexity with respect to the POMDP represetatio first. Observe that the HMM represetig the combied system ad the policy will have km hidde states. Sice the Markov chai defied over the hidde states iduced by ay of the policies of iterest is irreducible due to the ergodicity assumptio, the correspodig trasitio matrix satisfies the coditios of Theorem 1 from Schweitzer (1968), which is a special case of Theorem 2. Each etry of this trasitio matrix is a polyomial of a fixed degree i the parameters of the policy. So are the etries of H i Theorem 2 whe we fix E 1, Z 1, ρ 1 ad let E 2 be our parametrized trasitio matrix. Oe ca aalytically ivert H usig Cramer s rule ad observe that each etry of H 1 2 is a ratioal fuctio whose degree is O(km). Therefore, by Theorem 2 the degree of the statioary belief state ρ 2 is also O(km). Now we cosider the reward process beig represeted by a liear PRP. Observe that the liear PSR without cotrol represetig the actio observatio stochastic process iduced by the policy above is at most k dimesioal. Each etry of the SDM describig this actio observatio stochastic process is a ratioal fuctio with the leadig degree equal to the legth of the history plus test. Therefore, the colum vectors stored i G i the proof of Theorem 3 are of degree at most k. The elemets of the basis costructed from the colums of G are also of degree at most O(k) (see Propositio 1), as well as the etries of the bottom row of the evolutio matrix E costructed i Theorem 3. Similarly to a POMDP case, we eed to apply Theorem 2 for some fixed E 1, Z 1, ρ 1, where E 2 E is the fuctio of the policy parameters. Observe that from Theorem 2 we also have H 1 2 = Z 1 1 (Z E 1 E 2 ) 1, where the resultig matrix Z E 1 E 2 has fixed etries i all the rows except for the bottom oe, which is a ratioal fuctio of degree at most O(k). Agai, usig Cramer s rule oe ca ivert the matrix aalytically, which results i H 1 2 havig etries beig ratioal fuctios of degree at most O(k). The, by Theorem 2 the degree of the statioary distributio of the PSR without cotrol, ρ ρ 2, is also at most O(k). Fially, oe ca verify that the quatities ρ P RP (a) ad ρ P ol appearig i Theorem 4 will also have the leadig degree of the
9 same order. To coclude the proof, recall that the umber of dimesios required to represet the same system i a liear PSR framework () is at most equal to the umber of hidde states i the correspodig POMDP (m), ad ca be, at times sigificatly, smaller (Jaeger, 2000; Littma et al., 2001). Refereces Faigle, U. ad Schohuth, A. Asymptotic mea statioarity of sources with fiite evolutio dimesio. Iformatio Theory, IEEE Trasactios o, 53(7): , Jaeger, H. Observable operator models for discrete stochastic time series. Neural Computatio, 12(6): , James, M.R. Usig predictios for plaig ad modelig i stochastic eviromets. PhD thesis, The Uiversity of Michiga, Kemey, J.G. ad Sell, J.L. Fiite Markov chais, volume 356. va Nostrad Priceto, NJ, Littma, M.L., Sutto, R.S., ad Sigh, S. Predictive represetatios of state. Advaces i eural iformatio processig systems, 14: , Schweitzer, P.J. Perturbatio theory ad fiite Markov chais. Joural of Applied Probability, pp , Sigh, S., James, M.R., ad Rudary, M.R. Predictive state represetatios: A ew theory for modelig dyamical systems. I Proceedigs of the 20th coferece o ucertaity i artificial itelligece, pp AUAI Press, Wiewiora, E. Learig predictive represetatios from a history. I Proceedigs of the 22d iteratioal coferece o machie learig, pp ACM, Wiewiora, E.W. Modelig probability distributios with predictive state represetatios. PhD thesis, The Uiversity of Califoria at Sa Diego, 2007.
Math 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More information5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.
40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More informationStochastic Matrices in a Finite Field
Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationEigenvalues and Eigenvectors
5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationEntropy Rates and Asymptotic Equipartition
Chapter 29 Etropy Rates ad Asymptotic Equipartitio Sectio 29. itroduces the etropy rate the asymptotic etropy per time-step of a stochastic process ad shows that it is well-defied; ad similarly for iformatio,
More informationMATH10212 Linear Algebra B Proof Problems
MATH22 Liear Algebra Proof Problems 5 Jue 26 Each problem requests a proof of a simple statemet Problems placed lower i the list may use the results of previous oes Matrices ermiats If a b R the matrix
More informationAchieving Stationary Distributions in Markov Chains. Monday, November 17, 2008 Rice University
Istructor: Achievig Statioary Distributios i Markov Chais Moday, November 1, 008 Rice Uiversity Dr. Volka Cevher STAT 1 / ELEC 9: Graphical Models Scribe: Rya E. Guerra, Tahira N. Saleem, Terrace D. Savitsky
More informationLecture 8: October 20, Applications of SVD: least squares approximation
Mathematical Toolkit Autum 2016 Lecturer: Madhur Tulsiai Lecture 8: October 20, 2016 1 Applicatios of SVD: least squares approximatio We discuss aother applicatio of sigular value decompositio (SVD) of
More informationNotes for Lecture 11
U.C. Berkeley CS78: Computatioal Complexity Hadout N Professor Luca Trevisa 3/4/008 Notes for Lecture Eigevalues, Expasio, ad Radom Walks As usual by ow, let G = (V, E) be a udirected d-regular graph with
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationGeneralized Semi- Markov Processes (GSMP)
Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual
More informationTENSOR PRODUCTS AND PARTIAL TRACES
Lecture 2 TENSOR PRODUCTS AND PARTIAL TRACES Stéphae ATTAL Abstract This lecture cocers special aspects of Operator Theory which are of much use i Quatum Mechaics, i particular i the theory of Quatum Ope
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationBeurling Integers: Part 2
Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers
More information15.083J/6.859J Integer Optimization. Lecture 3: Methods to enhance formulations
15.083J/6.859J Iteger Optimizatio Lecture 3: Methods to ehace formulatios 1 Outlie Polyhedral review Slide 1 Methods to geerate valid iequalities Methods to geerate facet defiig iequalities Polyhedral
More informationRoger Apéry's proof that zeta(3) is irrational
Cliff Bott cliffbott@hotmail.com 11 October 2011 Roger Apéry's proof that zeta(3) is irratioal Roger Apéry developed a method for searchig for cotiued fractio represetatios of umbers that have a form such
More informationLECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK)
LECTURE 8: ORTHOGONALITY (CHAPTER 5 IN THE BOOK) Everythig marked by is ot required by the course syllabus I this lecture, all vector spaces is over the real umber R. All vectors i R is viewed as a colum
More informationA Hadamard-type lower bound for symmetric diagonally dominant positive matrices
A Hadamard-type lower boud for symmetric diagoally domiat positive matrices Christopher J. Hillar, Adre Wibisoo Uiversity of Califoria, Berkeley Jauary 7, 205 Abstract We prove a ew lower-boud form of
More information5 Birkhoff s Ergodic Theorem
5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the
More informationWeek 5-6: The Binomial Coefficients
Wee 5-6: The Biomial Coefficiets March 6, 2018 1 Pascal Formula Theorem 11 (Pascal s Formula For itegers ad such that 1, ( ( ( 1 1 + 1 The umbers ( 2 ( 1 2 ( 2 are triagle umbers, that is, The petago umbers
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationThe multiplicative structure of finite field and a construction of LRC
IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationAssignment 5: Solutions
McGill Uiversity Departmet of Mathematics ad Statistics MATH 54 Aalysis, Fall 05 Assigmet 5: Solutios. Let y be a ubouded sequece of positive umbers satisfyig y + > y for all N. Let x be aother sequece
More informationSingular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine
Lecture 11 Sigular value decompositio Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaie V1.2 07/12/2018 1 Sigular value decompositio (SVD) at a glace Motivatio: the image of the uit sphere S
More informationA Note on the Symmetric Powers of the Standard Representation of S n
A Note o the Symmetric Powers of the Stadard Represetatio of S David Savitt 1 Departmet of Mathematics, Harvard Uiversity Cambridge, MA 0138, USA dsavitt@mathharvardedu Richard P Staley Departmet of Mathematics,
More informationLecture 7: October 18, 2017
Iformatio ad Codig Theory Autum 207 Lecturer: Madhur Tulsiai Lecture 7: October 8, 207 Biary hypothesis testig I this lecture, we apply the tools developed i the past few lectures to uderstad the problem
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationSymmetric Matrices and Quadratic Forms
7 Symmetric Matrices ad Quadratic Forms 7.1 DIAGONALIZAION OF SYMMERIC MARICES SYMMERIC MARIX A symmetric matrix is a matrix A such that. A = A Such a matrix is ecessarily square. Its mai diagoal etries
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More information4 The Sperner property.
4 The Sperer property. I this sectio we cosider a surprisig applicatio of certai adjacecy matrices to some problems i extremal set theory. A importat role will also be played by fiite groups. I geeral,
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationA 2nTH ORDER LINEAR DIFFERENCE EQUATION
A 2TH ORDER LINEAR DIFFERENCE EQUATION Doug Aderso Departmet of Mathematics ad Computer Sciece, Cocordia College Moorhead, MN 56562, USA ABSTRACT: We give a formulatio of geeralized zeros ad (, )-discojugacy
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math S-b Lecture # Notes This wee is all about determiats We ll discuss how to defie them, how to calculate them, lear the allimportat property ow as multiliearity, ad show that a square matrix A is ivertible
More informationMATH 205 HOMEWORK #2 OFFICIAL SOLUTION. (f + g)(x) = f(x) + g(x) = f( x) g( x) = (f + g)( x)
MATH 205 HOMEWORK #2 OFFICIAL SOLUTION Problem 2: Do problems 7-9 o page 40 of Hoffma & Kuze. (7) We will prove this by cotradictio. Suppose that W 1 is ot cotaied i W 2 ad W 2 is ot cotaied i W 1. The
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationSupplemental Material: Proofs
Proof to Theorem Supplemetal Material: Proofs Proof. Let be the miimal umber of traiig items to esure a uique solutio θ. First cosider the case. It happes if ad oly if θ ad Rak(A) d, which is a special
More informationRiesz-Fischer Sequences and Lower Frame Bounds
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.
More informationABOUT CHAOS AND SENSITIVITY IN TOPOLOGICAL DYNAMICS
ABOUT CHAOS AND SENSITIVITY IN TOPOLOGICAL DYNAMICS EDUARD KONTOROVICH Abstract. I this work we uify ad geeralize some results about chaos ad sesitivity. Date: March 1, 005. 1 1. Symbolic Dyamics Defiitio
More informationResolution Proofs of Generalized Pigeonhole Principles
Resolutio Proofs of Geeralized Pigeohole Priciples Samuel R. Buss Departmet of Mathematics Uiversity of Califoria, Berkeley Győrgy Turá Departmet of Mathematics, Statistics, ad Computer Sciece Uiversity
More informationAssignment 2 Solutions SOLUTION. ϕ 1 Â = 3 ϕ 1 4i ϕ 2. The other case can be dealt with in a similar way. { ϕ 2 Â} χ = { 4i ϕ 1 3 ϕ 2 } χ.
PHYSICS 34 QUANTUM PHYSICS II (25) Assigmet 2 Solutios 1. With respect to a pair of orthoormal vectors ϕ 1 ad ϕ 2 that spa the Hilbert space H of a certai system, the operator  is defied by its actio
More informationComplex Analysis Spring 2001 Homework I Solution
Complex Aalysis Sprig 2001 Homework I Solutio 1. Coway, Chapter 1, sectio 3, problem 3. Describe the set of poits satisfyig the equatio z a z + a = 2c, where c > 0 ad a R. To begi, we see from the triagle
More informationAnalytic Continuation
Aalytic Cotiuatio The stadard example of this is give by Example Let h (z) = 1 + z + z 2 + z 3 +... kow to coverge oly for z < 1. I fact h (z) = 1/ (1 z) for such z. Yet H (z) = 1/ (1 z) is defied for
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationThe Discrete Fourier Transform
The Discrete Fourier Trasform Complex Fourier Series Represetatio Recall that a Fourier series has the form a 0 + a k cos(kt) + k=1 b k si(kt) This represetatio seems a bit awkward, sice it ivolves two
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationa for a 1 1 matrix. a b a b 2 2 matrix: We define det ad bc 3 3 matrix: We define a a a a a a a a a a a a a a a a a a
Math E-2b Lecture #8 Notes This week is all about determiats. We ll discuss how to defie them, how to calculate them, lear the allimportat property kow as multiliearity, ad show that a square matrix A
More informationSOME TRIBONACCI IDENTITIES
Mathematics Today Vol.7(Dec-011) 1-9 ISSN 0976-38 Abstract: SOME TRIBONACCI IDENTITIES Shah Devbhadra V. Sir P.T.Sarvajaik College of Sciece, Athwalies, Surat 395001. e-mail : drdvshah@yahoo.com The sequece
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationThe Perturbation Bound for the Perron Vector of a Transition Probability Tensor
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Liear Algebra Appl. ; : 6 Published olie i Wiley IterSciece www.itersciece.wiley.com. DOI:./la The Perturbatio Boud for the Perro Vector of a Trasitio
More informationPower series are analytic
Power series are aalytic Horia Corea 1 1 The expoetial ad the logarithm For every x R we defie the fuctio give by exp(x) := 1 + x + x + + x + = x. If x = 0 we have exp(0) = 1. If x 0, cosider the series
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationOn the Linear Complexity of Feedback Registers
O the Liear Complexity of Feedback Registers A. H. Cha M. Goresky A. Klapper Northeaster Uiversity Abstract I this paper, we study sequeces geerated by arbitrary feedback registers (ot ecessarily feedback
More informationNotes The Incremental Motion Model:
The Icremetal Motio Model: The Jacobia Matrix I the forward kiematics model, we saw that it was possible to relate joit agles θ, to the cofiguratio of the robot ed effector T I this sectio, we will see
More information5.1 Review of Singular Value Decomposition (SVD)
MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of
More information1+x 1 + α+x. x = 2(α x2 ) 1+x
Math 2030 Homework 6 Solutios # [Problem 5] For coveiece we let α lim sup a ad β lim sup b. Without loss of geerality let us assume that α β. If α the by assumptio β < so i this case α + β. By Theorem
More information(for homogeneous primes P ) defining global complex algebraic geometry. Definition: (a) A subset V CP n is algebraic if there is a homogeneous
Math 6130 Notes. Fall 2002. 4. Projective Varieties ad their Sheaves of Regular Fuctios. These are the geometric objects associated to the graded domais: C[x 0,x 1,..., x ]/P (for homogeeous primes P )
More information6. Kalman filter implementation for linear algebraic equations. Karhunen-Loeve decomposition
6. Kalma filter implemetatio for liear algebraic equatios. Karhue-Loeve decompositio 6.1. Solvable liear algebraic systems. Probabilistic iterpretatio. Let A be a quadratic matrix (ot obligatory osigular.
More informationsubcaptionfont+=small,labelformat=parens,labelsep=space,skip=6pt,list=0,hypcap=0 subcaption ALGEBRAIC COMBINATORICS LECTURE 8 TUESDAY, 2/16/2016
subcaptiofot+=small,labelformat=pares,labelsep=space,skip=6pt,list=0,hypcap=0 subcaptio ALGEBRAIC COMBINATORICS LECTURE 8 TUESDAY, /6/06. Self-cojugate Partitios Recall that, give a partitio λ, we may
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationA Proof of Birkhoff s Ergodic Theorem
A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed
More informationMa 530 Introduction to Power Series
Ma 530 Itroductio to Power Series Please ote that there is material o power series at Visual Calculus. Some of this material was used as part of the presetatio of the topics that follow. What is a Power
More informationOn forward improvement iteration for stopping problems
O forward improvemet iteratio for stoppig problems Mathematical Istitute, Uiversity of Kiel, Ludewig-Mey-Str. 4, D-24098 Kiel, Germay irle@math.ui-iel.de Albrecht Irle Abstract. We cosider the optimal
More information(3) If you replace row i of A by its sum with a multiple of another row, then the determinant is unchanged! Expand across the i th row:
Math 50-004 Tue Feb 4 Cotiue with sectio 36 Determiats The effective way to compute determiats for larger-sized matrices without lots of zeroes is to ot use the defiitio, but rather to use the followig
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationThe Jordan Normal Form: A General Approach to Solving Homogeneous Linear Systems. Mike Raugh. March 20, 2005
The Jorda Normal Form: A Geeral Approach to Solvig Homogeeous Liear Sstems Mike Raugh March 2, 25 What are we doig here? I this ote, we describe the Jorda ormal form of a matrix ad show how it ma be used
More informationAdditional Notes on Power Series
Additioal Notes o Power Series Mauela Girotti MATH 37-0 Advaced Calculus of oe variable Cotets Quick recall 2 Abel s Theorem 2 3 Differetiatio ad Itegratio of Power series 4 Quick recall We recall here
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 3 9/11/2013. Large deviations Theory. Cramér s Theorem
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/5.070J Fall 203 Lecture 3 9//203 Large deviatios Theory. Cramér s Theorem Cotet.. Cramér s Theorem. 2. Rate fuctio ad properties. 3. Chage of measure techique.
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationPROBLEM SET 5 SOLUTIONS 126 = , 37 = , 15 = , 7 = 7 1.
Math 7 Sprig 06 PROBLEM SET 5 SOLUTIONS Notatios. Give a real umber x, we will defie sequeces (a k ), (x k ), (p k ), (q k ) as i lecture.. (a) (5 pts) Fid the simple cotiued fractio represetatios of 6
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More informationContinuous Functions
Cotiuous Fuctios Q What does it mea for a fuctio to be cotiuous at a poit? Aswer- I mathematics, we have a defiitio that cosists of three cocepts that are liked i a special way Cosider the followig defiitio
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationarxiv: v1 [math.fa] 3 Apr 2016
Aticommutator Norm Formula for Proectio Operators arxiv:164.699v1 math.fa] 3 Apr 16 Sam Walters Uiversity of Norther British Columbia ABSTRACT. We prove that for ay two proectio operators f, g o Hilbert
More informationMath 451: Euclidean and Non-Euclidean Geometry MWF 3pm, Gasson 204 Homework 3 Solutions
Math 451: Euclidea ad No-Euclidea Geometry MWF 3pm, Gasso 204 Homework 3 Solutios Exercises from 1.4 ad 1.5 of the otes: 4.3, 4.10, 4.12, 4.14, 4.15, 5.3, 5.4, 5.5 Exercise 4.3. Explai why Hp, q) = {x
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationMeasure and Measurable Functions
3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies
More informationOrthogonal transformations
Orthogoal trasformatios October 12, 2014 1 Defiig property The squared legth of a vector is give by takig the dot product of a vector with itself, v 2 v v g ij v i v j A orthogoal trasformatio is a liear
More information