Remarks on the Geometry of Coordinate Projections in R n
|
|
- Sophia Newton
- 5 years ago
- Views:
Transcription
1 Remarks o the Geometry of Coordiate Projectios i R S. Medelso R. Vershyi Abstract We study geometric properties of coordiate projectios. Amog other results, we show that if a body K R has a almost extremal volume ratio, the it has a projectio of proportioal dimesio which is close to the cube. We also establish a sharp estimate o the shatterig dimesio of the covex hull of a class of fuctios i terms of the shatterig dimesio of the class itself. 1 Itroductio I this article we preset several results o coordiate projectios. The majority of this article is devoted to ew applicatios of the etropy iequality established i [MV], which, roughly speakig, states that if a set of fuctios has a large etropy i L, it must have a coordiate projectio which cotais a large cube. Defiitio 1.1 We say that a subset σ of Ω is t-shattered by a class of real-valued fuctios F if there exists a level fuctio h o σ such that, give ay subset σ of σ, oe ca fid a fuctio f F with f(x) h(x) t if x σ ad f(x) h(x) + t if x σ \ σ. The shatterig dimesio of A, deoted by vc(f, Ω, t) after Vapik ad Chervoekis, is the maximal cardiality of a subset of Ω which is t-shattered by F. I cases where the uderlyig space is clear we deote the shatterig dimesio by vc(f, t). Research School of Iformatio Scieces ad Egieerig, The Australia Natioal Uiversity, Caberra, ACT 000, Australia, shahar.medelso@au.edu.au Departmet of Mathematical Scieces, Uiversity of Alberta, Edmoto, Alberta T6G G1, Caada, rvershyi@math.ualberta.ca 1
2 Theorem 1. Let A be a class of fuctios bouded by 1, defied o a set Ω. The for every probability measure µ o Ω, ( ) K vc(f, ct), N(F, t, L (µ)) 0 < t < 1, (1.1) t where K ad c are positive absolute costats. Every F R ca be idetified with a class of fuctios o {1,..., } i the atural way: v(i) = v i for v F. If we take µ to be the probability coutig measure o {1,..., } the (1.1) states that for ay 0 < t < 1, N(F, t ( B ) t ) K vc(f, ct). Note that if F happes to be covex ad symmetric with respect to the origi, the vc(f, t) is the maximal cardiality of a subset σ of {1,..., } such that P σ (F ) [ t, t] σ. We apply this result to study covex bodies whose volume ratio is almost maximal. Recall that the volume ratio, itroduced by Szarek ad Tomczak-Jaegerma [S, ST], is defied as vr(d) = ( D / E ) 1/, where E is the ellipsoid of maximal volume cotaied i D. The miimal volume ratio of a symmetric covex body i R is 1 ad is attaied by the Euclidea ball; the maximal is of the order of ad is attaied by the cube B [B]. This pair of extremal bodies is uique up to a liear trasformatio. Ideed, the uiqueess of the miimizer is immediate, while the fact that cube is the uique maximizer was established i [Ba]. The isomorphic versio of this fact describig the bodies whose volume ratio is of order either 1 or is of particular iterest. The questio is whether such bodies iherit ay structure from the Euclidea ball or, respectively, from the cube. If the volume ratio of a body D i R is bouded by a costat, the by the Volume Ratio Theorem [ST], D has a sectio of dimesio proportioal to, which is well isomorphic to the Euclidea ball. O the other had, if vr(d) is of order of, the by [R] ad [V], D has a sectio of dimesio proportioal to, which is well isomorphic to the cube, ad the order of i the dimesio ca ot be improved (the dual of Gluski s polytope is such a example see sectio ). However, we show i sectio that there exists a projectio of D of dimesio proportioal to, which is well isomorphic to the cube.
3 Two other applicatios we preset are based o the followig corollary of Theorem 1.. Theorem 1.3 [MV] Let F be a class of fuctios bouded by 1, defied o a fiite set I of cardiality. The the gaussia process idexed by F, X f = g if(i) satisfies E = E sup X f K f F 1 ce/ where K ad c are absolute costats. vc(f, t) log(/t) dt, Oe applicatio we preset is a compariso of the average E ε ix i to the miimum over all choices of sigs, mi ±x i. As a cosequece, we compare the type ad the ifratype costats of a Baach space. The, we establish a sharp estimate o the shatterig dimesio of a covex hull of a class of fuctios, based o the shatterig dimesio of the class itself. Namely, we show that for every ε > 0, vc(cov(f ), ε) (C/ε) vc(f, cε), where c ad C are absolute costats. The fial questio we address is whe a radom coordiate projectio a almost isometry. Let (Ω, µ) be a probability space ad f L (µ), ad for simplicity, assume that Ω = {1,..., } ad that µ is the uiform probability measure o Ω. For every ε > 0, our aim is to fid may sets σ {1,..., } of small cardiality such that the atural coordiate projectio P σ f satisfies (1 ε) f L P σ f L σ (1 + ε) f L, (1.) where L k is the L space defied o {1,..., k} with respect to the uiform probability measure. By a stadard cocetratio argumet, if f 1, the with high probability a radom coordiate projectio of dimesio C/ε is a almost isometry i the sese of (1.). We will show that the uiform boudedess of f ca be relaxed; it suffices to assume that f ψ 1, where ψ is the Orlicz orm geerated by the fuctio e t 1. I this case, a radom coordiate projectio of dimesio C/ε will be a almost isometry as 3
4 i (1.) with high probability. Although this result is relatively easy, we decided to preset it because it gives hope that the coditios i stroger cocetratio iequalities (e.g. Talagrad s cocetratio iequality for empirical processes [T 94, L]) ca also be relaxed. As a applicatio, we obtai a coordiate versio of the Johso-Lidestrauss Flatteig Lemma [JL]. Fially, we tur to some otatioal covetios. Throughout, all absolute costats are deoted by c, C, k ad K. Their values may chage from lie to lie or eve withi the same lie. We deote a b if there are absolute costats c ad C such that cb a Cb. ACKNOWLEDGEMENTS: The first author ackowledges partial support by a Australia Research Coucil Discovery Grat. The secod author thaks Nicole Tomczak-Jaegerma for her costat support. A part of this work was doe whe the secod author was visitig the Research School of Iformatio Scieces ad Egieerig at The Australia Natioal Uiversity, which he thaks for its hospitality. He also ackowledges a support from the Pacific Istitute of Mathematical Scieces ad is grateful to the Departmet of Mathematical Scieces of the Uiversity of Alberta for its hospitality. Extremal volume ratios The volume ratio of a covex body D i R is defied as vr(d) = if ( D ) 1/, E where deotes the volume i R, ad the ifimum is over all ellipsoids E cotaied i D. This importat ivariat was itroduced by Szarek ad Tomczak-Jaegerma (see [S], [ST] or [P]). The bodies with extremal volume ratios are the Euclidea ball ad the cube ad these are the oly extreme bodies up to a liear trasformatio (for the uiqueess of the cube, see [Ba]). Oe ca show that for every covex symmetric body i R, 1 = vr(b ) vr(d) vr(b ), (.1) (see [B]), while direct computatio shows that vr(b ) C ad the best value of the costat is C = / πe. 4
5 Ofte, oe ecouters bodies whose volume ratio is almost extremal, i.e. close to oe of sides of (.1). The problem is whether such a body iherits properties of the extremal bodies, the Euclidea ball or the cube. If vr(d) A, the by the Volume Ratio Theorem [ST], D has a sectio of dimesio k = / which is ca -isomorphic to the Euclidea ball B k, ad this result is asymptotically sharp. O the opposite side of the scale, if vr(d) A 1, D has a sectio of D of dimesio k = c(a) which is C(A) log -isomorphic to the cube B k [R, V]. It is ot kow whether the logarithmic term ca be elimiated, but the order of i the dimesio is optimal, as was oticed i [GTT]. Ideed, by a argumet of Figiel ad Johso (see [FJ], cor. 3.), a radom subspace E l (ad thus a dual of Gluski s space) of dimesio at least / satisfies that for ay F E, gl(f ) cdim(f )/, where gl(f ) is the Gordo-Lewis costat of F, ad c is a suitable absolute costat. By [GL], gl(f ) uc(f ), where uc(f ) is the least ucoditioality costat of a basis of F. Sice uc(l k ) = 1 the d(f, l k ) uc(f ) cdim(f ), ad thus, if F is -isomorphic to l k the dim(f ) c. Our ext result shows that D has a projectio of dimesio proportioal to which is ca-isomorphic to the cube B k. Theorem.1 There are absolute costats C ad c for which the followig holds. If D is a covex symmetric body i R for which vr(d) A 1, the there exists a projectio P of rak k c/ log A such that d(p K, B k ) CA. To prove the Theorem, recall the otio of the cubic ratio [B]. For every ball D R oe defies ( B cr(d) = if ) 1, T D where the ifimum is over all liear ivertible operators T o R such that T D B. Lemma. [B] There are absolute costats c ad C such that for every iteger ad every covex symmetric body D R, c vr(d) cr(d) C. 5
6 Proof of Theorem.1. Clearly, we ca assume to be larger tha a suitable absolute costat N, which esures that for every D R, vr(d) 0.8. Sice vr(d) A 1, the by Lemma., cr(d) CA. Hece, there is some T GL such that T D B ad T D 1 c/a. Recall that c 1 B c for some absolute costats c 1, c, ad thus there exists a absolute costat c 3 such that = T D c 3 A 1 ( B ). By a stadard volumetric argumet, the right-had side is bouded by N(T D, c 3 A 1 B ), ad by Theorem 1. there are absolute costats K ad c for which log N(T D, c 3 A 1 B ) K vc(t D, ca 1 ) log(ca). Hece, there is a set σ {1,..., }, such that σ /K log(ca) ad c 1 A 1 B σ P σ (T D) B σ. It oly remais to ote that log(ca) C log A, because A 5/4. Remark. Sice the volume ratio is always greater tha 1, the A 1/. Therefore, the dimesio of the cubic projectio i Theorem.1 is always bouded below by c/ log. I a very similar way, oe ca prove the followig Theorem.3 There are absolute costats C ad c for which the followig holds. Let D be a covex symmetric body i R for which vr(d) A 1. The there exists a projectio P of rak k c such that 3 Type ad Ifratype d(p K, B k ) CA. I this sectio we improve a result of M. Talagrad [T 9] which compares the average over the ± sigs to the miimum over the ± sigs of ±x i. 6
7 Recall that a Baach space X has a (gaussia) type p if there exists some M > 0 such that for all ad all sequeces of vectors (x i ) i, E ( g i x i M x i p) 1 p. (3.1) The best possible costat M i this iequality is deoted by T p (X). We say that X has ifratype p if there exists some M > 0 such that for all ad all sequeces of vectors (x i ) i, mi η i =±1 ( η i x i M x i p) 1 p. (3.) The best possible costat M i this iequality is deoted by I p (X). I [T 9] it was show that if 1 < p < the T p (X) C p I p (X), where C p is a costat which depeds oly o p. It is ot kow whether the square ca be removed. Regardig the case p =, M. Talagrad recetly costructed a symmetric sequece space which has ifratype but ot type [T 03]. Hece oe ca ot obtai dimesio free estimates o T (X) i terms of I (X). Our mai result i this sectio is that is dim(x) = the T (X) CI (X) log 3/. We begi with the followig fact that allows oe to compare Rademacher ad Gaussia averages. Lemma 3.1 There is a absolute costat C for which the followig holds. Let x 1,..., x be vectors i the uit ball of a Baach space ad let 0 < M. If 0 < λ < log 3 (/M ) ad mi η i =±1 i σ for all σ {1,..., } with σ λ, the, E η i x i M σ 1 g i x i CM(/λ) 1/. I the proof of Lemma 3.1 we require the followig observatio from [MS], that if {x 1,..., x } X is ε-shattered by B X, the for ay (a i ) R,. ε a i a i x i (3.3) 7
8 Proof of Lemma 3.1. Clearly we ca assume that the give Baach space is X = (R, ) ad that (x i ) i are the uit coordiate vectors i R. Set B = B X ad by the hypothesis of the lemma ad (3.3), vc(b, Mv 1/ ) v if 0 v λ. Hece, for ay M(λ) 1/ t 1, Set E = E vc(b, t) (M/t). (3.4) g i x i X = E sup b B g i b(i). By Theorem 1.3, there are absolute costats C ad c such that E K 1 vc(b, t) log(/t) dt. ce/ If ce/ M(λ) 1/, the lemma trivially follows. Otherwise, if the coverse iequality holds, the by (3.4) ad sice λ < 1, E K 1 (M/t) log(/t) dt K M log 3 (/M ), ce/ ad by the assumptio o λ, as claimed. E K M log 3 (/M ) K M/ λ, Usig Lemma 3.1, oe ca compare the type ad ifratype of a Baach space X. Let T () (X) ad I () (X) deote the best possible costats M i (3.1) ad (3.) respectively (with p = ). So, T () (X) ad I () (X) measure the type/ifratype computed o vectors. Clearly, I (X) T (X) ad I () (X) T () (X). Theorem 3. Let X be a -dimesioal Baach space. The, for every umber 0 < λ < log 3 (/I (X) ), T (X) C I (λ) (X)/ λ. 8
9 I particular, ( T (X) I (X) C log 3 ) I (X) I (X) C log 3. Proof. By [TJ] ad [BKT] Theorem 3.1, the Gaussia type ca be computed o vectors of orm oe. Precisely, this meas that T (X) is the smallest possible costat M for which the iequality E g i x i M 1/ holds for all vectors x 1,..., x of orm oe. Now, the assertio follows from Lemma The shatterig dimesio of covex hulls I this sectio we preset a sharp estimate which compares the shatterig dimesios of a class ad of its covex hull. To that ed, we coect the shatterig dimesio to the growth rate of the expectatio of the supremum of the gaussia process {X a, a P σ F } as a fuctio of σ. Defiitio 4.1 Let F be a class of fuctios bouded by 1 ad set l (F ) = sup E g sup g i f(x i ), (x 1,...,x ) Ω f F where g 1,..., g are idepedet, stadard gaussia radom variables. Hece, l (F ) is the largest gaussia average associated with a coordiate projectio of F o poits. Sice F B ( L (Ω) ) the for every σ = (x 1,..., x ), { (f(x1 P σ F = ),..., f(x ) ) } : f F B, ad the largest projectio oe might ecouter is whe P σ F = B, i which case l(p σ F ). We defie a scale-sesitive parameter which measures for every ε > 0 the largest cardiality of a projectio which has a large l-orm: t(f, ε) = sup{ : l (F ) ε}. 9
10 Theorem 4. There are absolute costats K, c ad c such that for ay F B ( L (Ω) ) ad every ε > 0, vc(f, c ε) t(f, ε) (K/ε ) vc(f, cε). I the proof, we will use the followig wordig: the fuctio f associated to a set σ i the Defiitio 1.1 will be called the fuctio that shatters σ. Proof of Theorem 4.. Assume that {x 1,..., x } is ε-shattered by F. For every J {x 1,..., x }, let f J be the fuctio shatterig J, ad for each (ε 1,..., ε ) { 1, 1} set I = {x i ε i = 1}. By the triagle iequality ad lettig f = f I, f = f I c i the secod iequality below, Hece, ε i f(x i ) 1 sup ( ε i f(xi ) f (x i ) ) f,f F 1 ( ε i fi (x i ) f I c(x i ) ) ε. sup f F sup f F ε i f(x i ) ε, ad i particular this holds for the average. The first boud is evidet because of the kow coectios betwee gaussia ad Rademacher averages [TJ1], amely, that there is a absolute costat C such that for ay class F ad ay set σ = (x 1,..., x ), l(p σ F ) = E g g i e i (PσF ) C E ε = C E ε sup f F ε i f(x i ). ε i e i (PσF ) The reverse iequality follows from Theorem 1.3 i a similar way to the proof of Elto s Theorem i [MV]. If l(p σ F ) ε, the E sup f F X f ε, where X f = g if(x i ). By Theorem 1.3, ε E sup X f K f F 1 cε vc(pσ F, t) log(/t) dt. 10
11 c Set v(t) = 0 t log 1.1 (/t) where c 0 > 0 is chose so that 1 0 v(t) dt = 1. Hece, there is some cε t 1 such that K vc(p σ F, t) ε v (t)/ log(/t), implyig that vc(f, cε) vc(p σ F, cε) vc(p σ F, t) c ε t log 3. (/t) c ε. The previous result ca be used to estimate the shatterig dimesio of a covex hull of a class. Corollary 4.3 There are absolute costats K ad c such that for ay F B ( L (Ω) ) ad every ε > 0, vc(cov(f), ε) (K/ε) vc(f, cε). Proof. Sice the l-orm of a set ad of its covex hull are the same, the for ay ε > 0, t(f, ε) = t(cov(f ), ε). By Theorem 4., vc(cov(f ), ε) t(cov(f ), ε) = t(f, ε) (K/ε) vc(f, cε). Next, we show that this estimate is sharp, i the sese that the expoet of 1/ε ca ot be improved. To that ed, we require some properties of the shatterig dimesio of classes of liear fuctioals metioed before, which was ivestigated i [MS]. If X is a ormed space the B X ca be viewed as a subset of L (B X ) i the atural way. It is ot difficult to characterize the shatterig dimesio i this case. Lemma 4.4 A set {x 1,..., x } B X is ε-shattered by B X if ad oly if (x i ) are liearly idepedet ad ε-domiate the l 1 uit-vector basis; i.e., ε a i a i x i a i for every a 1,..., a R. I particular, if X is -dimesioal, ad if the Baach-Mazur distace satisfies that d(x, l 1 ) α, the vc(b X, B X, 1/α) =. 11
12 Corollary 4.5 There exists a absolute costat k for which the followig holds. For every 0 < ε < 1/ there is a class F B ( L (Ω) ) such that vc(cov(f ), ε) k vc(f, ε) ε log(1/ε). Proof. For every iteger, let Ω = B ad set F = {e 1,..., e }, that is, the stadard uit vectors i R, whe cosidered as liear fuctioals o B. Sice F =, it follows that for every ε > 0, vc(f, Ω, ε) log. O the other had, cov(f ) = B1 whe cosidered as fuctioals o B. By Lemma 4.4 applied to X = l, ad sice d(l, l 1 ) K [TJ1], it is evidet that there is a subset o cardiality i B which is k/ -shattered by B1. Thus, for ε = k/, vc(cov(f ), Ω, ε ) k vc(f, Ω, ε ) ε, log(1/ε ) from which the proof easily follows. 5 Almost isometric coordiate projectios Give real-valued fuctio f o a probability space, its ψ p -orm (p 1) is defied as the Orlicz orm correspodig to the fuctio exp(t p ) 1. Precisely, f ψp is the ifimum of all umbers λ satisfyig E exp( f p /λ p ) e. It is possible to compare the ψ p with other ψ q orms ad the L p orms. Ideed, oe ca show that if 1 p q <, f ψp C p,q f ψq, ad f Lp C p f ψ1 (see, for example, [VW]). A fuctio f is bouded i the ψ orm if ad oly if f has a subgaussia tail. Namely, if f ψ 1 the by Chebychev s iequality P{ f > t} e t +1 for all t > 0. Coversely, if for some A 1 oe has P{ f > t} Ae t for all t > 1, the itegratig by parts it follows that E exp(f/) 1 + A/3 A, ad by Jese s iequality oe ca coclude that f ψ A (we did ot attempt here to give the right depedece o A). Aother simple but useful fact which follows from Jese s iequality is that f ψ C E exp(f ), where C is a absolute costat. We will focus o fuctios defied o a fiite domai, which we idetify with {1,..., }, equipped with a uiform measure, where each atom carries a weight of 1/. We deote the ψ orm of a fuctio f o this 1
13 probability space by f ψ. Sice f is defied o {1,..., }, we sometimes idetify f with the sequece of scalars (f(i)). We shall use the followig stadard probabilistic model for radom coordiate projectios. Give 0 < δ 1/, let δ 1,..., δ be selectors, i.e. idepedet {0, 1}-valued radom variables with mea δ. The σ = {i 1 i, δ i = 1} is a radom subset of the iterval {1,..., } with average cardiality δ. By Berstei s iequality [VW], for every 0 < ε < 1, { P (1 ε) f L 1 δ } δ i f(i) (1 + ε) f L ( 1 exp cε δ ), f ad by aother applicatio of Berstei s iequality, { 1 } P δ i δ ε exp( cε δ), (5.1) δ implyig that if f 1, the with probability at least 4 exp( cε σ ), (1 ε) f L P σ f L σ (1 + ε) f L. I this sectio we relax the assumptio that f is bouded i the uiform orm, ad assume that f is bouded i the ψ orm. Roughly speakig, we show that for every 1 p <, the set of vectors i S(L p ) which will be almost isometrically projected oto L σ p are those with a small ψ p orm. Propositio 5.1 Let (δ i ) be idepedet {0, 1}-valued radom variables with mea δ > 0. Set a = (a i ) R ad put M = a ψ 1. The, for every positive umber t < M/, { } P (δ i δ)a i > tδ where c is a absolute costat. ( exp ct δ ) M, The proof starts with the followig stadard lemma. Lemma 5. Let Z be a radom variable ad assume that for some b, λ > 0, E exp(λz) e b λ. The P{Z > b λ} e b λ. 13
14 Proof. For t > 0, P{Z > t} = P{exp(λ(Z t)) > 1} E exp(λ(z t)) = e λt E exp(λz) e b λ λt. Settig t = b λ completes the proof. Proof of Propositio 5.1. By homogeeity, we ca assume that M = 1, ad we shall evaluate E exp ( t (δ ) i δ)a i. To that ed, let δ i be a idepedet copy of δ i ad set δ i = δ i δ i. By Jese s iequality, E exp ( t ) ( (δ i δ)a i E exp t (δ i δ i)a ) i = E exp(t δ i a i ) = E. Set δ = δ(1 δ) ad ote that δ i is 0 with probability 1 δ, ad 1 ad 1, each with probability δ. Therefore, E exp(t δ i a i ) = (1 δ) + δe ta i + δe ta i = 1 + δ(cosh(ta i ) 1). Sice cosh x x e x for all real x, the E (1 + δt a i e t ai ) exp( δt a i e t ai ) = exp ( δt 1 ) a i e t a i. The ormalized sum is estimated by Cauchy-Schwartz ad usig the fact that t 1: 1 ( 1 a i e t ai a i 4) 1 ( 1 ) 1 e t a i ( 1 ) 1 a L e a i 4 a L 4 C, because c a L 4 a ψ 1 1. Hece, E exp(c δt ) exp(c δt ). We put this i a form coveiet for applyig Lemma 5.: ( 1 E exp tδ δ ) ( C (δ i δ)a i exp δ (tδ)) 14
15 ad apply the lemma for λ = tδ ad b = C δ. It follows that for every t > 0, { 1 P (δ i δ)a i > ct} exp( cδt ), δ which completes the proof. Corollary 5.3 Applyig Propositio 5.1 to a i it is evidet that where M = a ψ 1 { } ( P (δ i δ)a i > tδ exp ct δ ) M ad 0 < t < M/. A easy applicatio of this corollary is the fact that the ψ -orm of poits o the sphere determies the cardiality of a almost isometric projectio. Corollary 5.4 There is a absolute costat C for which the followig holds. For every iteger, ay f S(L ) ad every ε > 0, a radom set σ {1,..., } of average cardiality (CM/ε) satisfies with probability at least 1/ that 1 ε P σ f L σ 1 + ε, where M = f ψ. Proof. The proof follows immediately from Corollary 5.3, by takig a i = f (i) ad δ = (CM/ε), ad applyig (5.1). Note that a similar result ca be easily derived for ay 1 p <, simply by the fact that (a i ) ψ p = (a p i ) ψ 1. Corollary 5.3 ca be used to preset a ew isight to the well kow Johso-Lidestrauss Flatteig Lemma [JL], which states that every set {x 1,..., x } l ca be 1 + ε isometrically embedded i lm, where m (C/ε) log. Oe ca formulate the Johso-Lidestrauss Lemma as follows: Theorem 5.5 There is a absolute costat C for which the followig holds. For every f 1,..., f S(L ) ad every ε > 0 there is a orthogoal operator O ad a set σ {1,..., } of cardiality at most (C/ε) log, such that for all 1 i, 1 ε P σ Of i L σ 1 + ε. 15
16 As Corollary 5.4 shows, a almost isometric coordiate projectio of f is possible, as log as f ψ is small; hece, the ψ orm defies a good regio o the sphere for which a radom coordiate projectio will be a almost isometry. I a similar way, this ca also be performed with may fuctios simultaeously: Corollary 5.6 There is a absolute costat C for which the followig holds. For every f 1,..., f S(L ) ad every ε > 0 a radom set σ {1,..., } of cardiality (CM/ε) log satisfies that with probability at least 1/, 1 ε P σ f i L σ 1 + ε, 1 i. where M = max i f i ψ. Proof. As i Corollary 5.4, but takig δ = (CM/ε) log, we obtai the for every 1 i The P r{1 ε P σ f i L σ 1 + ε} 1 1. P r{ 1 i, 1 ε P σ f i L σ 1 + ε} 1/, which completes the proof. The coectio to the Johso-Lidestrauss Lemma is easy: with high probability, a radom orthogoal operator O will map ay set of vectors o the sphere to the good regio, i.e. to the regio where the ψ orm is bouded by a absolute costat. Lemma 5.7 There is a absolute costat C such that for every iteger ad ay x S(L ), P r O { Ox ψ C } < 1, where the probability measure is the Haar measure o the orthogoal group. As a cosequece, for every f 1,..., f S(L ), max Of i ψ i C with probability greater tha 1/, ad thus Theorem 5.5 is implied by Corollary
17 Proof. Clearly, it suffices to show that there is a absolute costat C such that P r { x S 1 : x ψ C } 1. Cosider the fuctio g : S 1 R defied by g(x) = x ψ. To estimate its Lipschitz costat, observe that for every x S 1, x ψ / log. Ideed, for 0 x 1, x / x + 1; hece, 1 exp( x i log ) = 1 x i / 1 (x i + 1). To boud the expectatio of g (with respect to the Haar measure o the sphere), recall the media of the fuctio f(x) = x 1 satisfies that M f c, ad that f lip 1. Hece, by cocetratio of measure o the sphere [MiS], for ay s > c ad every 1 i, P r { x S 1 : x i s } π / e s, ad thus, E exp(cx i ) for a appropriate absolute costat c. Recall that there is a absolute costat K such that for every fuctio f, f ψ KE exp(f ); therefore, for x = (x 1,..., x ), cx ψ K exp(cx i ). Takig the expectatio with respect to x o the sphere, E x ψ K E exp(cx i ) K for a absolute costat K. By the cocetratio of measure o the sphere applied to the fuctio g, P r { x S 1 : x ψ C + t } π log e ct, ad the claim follows by selectig t = C /. 17
18 Refereces [B] K. Ball, Volumes of sectios of cubes ad related problems, i Lecture Notes i Math. 1376, 51 60, Spriger-Berli, [Ba] F. Barthe, O a reverse form of the Brascamp-Lieb iequality, Ivet. Math. 134, , [BKT] J. Bourgai, N. Kalto, L. Tzafriri, Geometry of fiite-dimesioal subspaces ad quotiets of L p, i Lecture Notes i Math. 1376, , Spriger-Berli, [FJ] T. Figiel, W.B. Johso, Large subspaces of l N ad estimates of the Gordo Lewis costat, Israel J. Math. 37, 9 11, [GTT] E.D. Gluski, N. Tomczack-Jaegerma, L. Tzafriri, Subspaces of l N p of small codimesio, Israel J. Math , 199. [GL] Y. Gordo, D.R. Lewis, Absolutely summig operators ad local ucoditioal structure, Acta Math. 133, 7-48, [L] M. Ledoux: The cocetratio of measure pheomeo, Mathematical Surveys a Moographs, Vol 89, AMS, 001. [JL] W.B. Johso, J. Lidestrauss, Extesios of Lipschitz mappigs ito a Hilbert space, Cotemp. Math. 6, , [MV] S. Medelso, R. Vershyi, Etropy ad the combiatorial dimesio, Ivet. Math. 15(1), 37-55, 003. [MS] S. Medelso, G. Schechtma, The shatterig dimesio of sets of liear fuctioals, preprit. [MiS] V.D. Milma, G. Schechtma, Asymptotic theory of fiite dimesioal ormed spaces, Lecture Notes i Mathematics 100, Spriger [P] G. Pisier, The volume of covex bodies ad Baach space geometry, Cambridge Tracts i Mathematics, 94. Cambridge Uiversity Press, Cambridge, [R] M. Rudelso, Estimates of the weak distace betwee fiitedimesioal Baach spaces, Israel J. Math. 89, ,
19 [S] S. Szarek, O Kaši s almost Euclidea orthogoal decompositio of l 1, Bull. Acad. Polo. Sci 6, , [ST] S. Szarek, N. Tomczak-Jaegerma, O early Euclidea decompositios of some classes of Baach spaces, Compositio Math 40, , [T 9] M. Talagrad, Type, ifratype, ad Elto-Pajor Theorem, Ivet. Math. 107, 41 59, 199. [T 94] M. Talagrad, Sharper bouds for Gaussia ad empirical processes, A. Probab. (1), 8-76, [T 03] M. Talagrad, Type ad ifratype i symmetric sequece spaces, preprit. [TJ] N. Tomczak-Jaegerma, Computig -summig orm with few vectors, Ark. Mat. 17, 73 77, [TJ1] N. Tomczak-Jaegerma, Baach Mazur distace ad fiite dimesioal operator Ideals, Pitma moographs ad surveys i pure ad applied Mathematics 38, [VW] A. Va der Vaart, J. Weller, Weak covergece ad empirical processes, Spriger-Verlag, [V] R. Vershyi, Joh s decompositios: selectig a large part, Israel J. Math. 1, 53 77,
A remark on p-summing norms of operators
A remark o p-summig orms of operators Artem Zvavitch Abstract. I this paper we improve a result of W. B. Johso ad G. Schechtma by provig that the p-summig orm of ay operator with -dimesioal domai ca be
More informationThe random version of Dvoretzky s theorem in l n
The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More informationAn Extremal Property of the Regular Simplex
Covex Geometric Aalysis MSRI Publicatios Volume 34, 1998 A Extremal Property of the Regular Simplex MICHAEL SCHMUCKENSCHLÄGER Abstract. If C is a covex body i R such that the ellipsoid of miimal volume
More informationMinimal surface area position of a convex body is not always an M-position
Miimal surface area positio of a covex body is ot always a M-positio Christos Saroglou Abstract Milma proved that there exists a absolute costat C > 0 such that, for every covex body i R there exists a
More informationA REMARK ON A PROBLEM OF KLEE
C O L L O Q U I U M M A T H E M A T I C U M VOL. 71 1996 NO. 1 A REMARK ON A PROBLEM OF KLEE BY N. J. K A L T O N (COLUMBIA, MISSOURI) AND N. T. P E C K (URBANA, ILLINOIS) This paper treats a property
More informationLecture 3 The Lebesgue Integral
Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified
More informationarxiv: v1 [math.pr] 4 Dec 2013
Squared-Norm Empirical Process i Baach Space arxiv:32005v [mathpr] 4 Dec 203 Vicet Q Vu Departmet of Statistics The Ohio State Uiversity Columbus, OH vqv@statosuedu Abstract Jig Lei Departmet of Statistics
More informationRiesz-Fischer Sequences and Lower Frame Bounds
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationChapter 7 Isoperimetric problem
Chapter 7 Isoperimetric problem Recall that the isoperimetric problem (see the itroductio its coectio with ido s proble) is oe of the most classical problem of a shape optimizatio. It ca be formulated
More informationSeveral properties of new ellipsoids
Appl. Math. Mech. -Egl. Ed. 008 9(7):967 973 DOI 10.1007/s10483-008-0716-y c Shaghai Uiversity ad Spriger-Verlag 008 Applied Mathematics ad Mechaics (Eglish Editio) Several properties of ew ellipsoids
More informationAPPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS
APPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS 1. Itroductio Let C be a bouded, covex subset of. Thus, by defiitio, with every two poits i the set, the lie segmet coectig these two poits is
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationRates of Convergence by Moduli of Continuity
Rates of Covergece by Moduli of Cotiuity Joh Duchi: Notes for Statistics 300b March, 017 1 Itroductio I this ote, we give a presetatio showig the importace, ad relatioship betwee, the modulis of cotiuity
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationLaw of the sum of Bernoulli random variables
Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible
More informationON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 0002-9939(XX0000-0 ON MEAN ERGODIC CONVERGENCE IN THE CALKIN ALGEBRAS MARCH T. BOEDIHARDJO AND WILLIAM B. JOHNSON 2
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationA survey on penalized empirical risk minimization Sara A. van de Geer
A survey o pealized empirical risk miimizatio Sara A. va de Geer We address the questio how to choose the pealty i empirical risk miimizatio. Roughly speakig, this pealty should be a good boud for the
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationBoundaries and the James theorem
Boudaries ad the James theorem L. Vesely 1. Itroductio The followig theorem is importat ad well kow. All spaces cosidered here are real ormed or Baach spaces. Give a ormed space X, we deote by B X ad S
More informationEmpirical Processes: Glivenko Cantelli Theorems
Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationDimension-free PAC-Bayesian bounds for the estimation of the mean of a random vector
Dimesio-free PAC-Bayesia bouds for the estimatio of the mea of a radom vector Olivier Catoi CREST CNRS UMR 9194 Uiversité Paris Saclay olivier.catoi@esae.fr Ilaria Giulii Laboratoire de Probabilités et
More informationJOHN S DECOMPOSITION OF THE IDENTITY IN THE NON-CONVEX CASE. Jesus Bastero* and Miguel Romance**
JOHN S DECOMPOSITION OF THE IDENTITY IN THE NON-CONVEX CASE Jesus Bastero* ad Miguel Romace** Abstract We prove a extesio of the classical Joh s Theorem, that characterices the ellipsoid of maximal volume
More informationMcGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems
McGill Uiversity Math 354: Hoors Aalysis 3 Fall 212 Assigmet 3 Solutios to selected problems Problem 1. Lipschitz fuctios. Let Lip K be the set of all fuctios cotiuous fuctios o [, 1] satisfyig a Lipschitz
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationNotes 19 : Martingale CLT
Notes 9 : Martigale CLT Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: [Bil95, Chapter 35], [Roc, Chapter 3]. Sice we have ot ecoutered weak covergece i some time, we first recall
More informationBeurling Integers: Part 2
Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationA Proof of Birkhoff s Ergodic Theorem
A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed
More informationEquivalent Banach Operator Ideal Norms 1
It. Joural of Math. Aalysis, Vol. 6, 2012, o. 1, 19-27 Equivalet Baach Operator Ideal Norms 1 Musudi Sammy Chuka Uiversity College P.O. Box 109-60400, Keya sammusudi@yahoo.com Shem Aywa Maside Muliro Uiversity
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationA RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS
J. Japa Statist. Soc. Vol. 41 No. 1 2011 67 73 A RANK STATISTIC FOR NON-PARAMETRIC K-SAMPLE AND CHANGE POINT PROBLEMS Yoichi Nishiyama* We cosider k-sample ad chage poit problems for idepedet data i a
More informationDisjoint Systems. Abstract
Disjoit Systems Noga Alo ad Bey Sudaov Departmet of Mathematics Raymod ad Beverly Sacler Faculty of Exact Scieces Tel Aviv Uiversity, Tel Aviv, Israel Abstract A disjoit system of type (,,, ) is a collectio
More informationAN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS. Robert DEVILLE and Catherine FINET
2001 vol. XIV, um. 1, 95-104 ISSN 1139-1138 AN EXTENSION OF SIMONS INEQUALITY AND APPLICATIONS Robert DEVILLE ad Catherie FINET Abstract This article is devoted to a extesio of Simos iequality. As a cosequece,
More informationOn equivalent strictly G-convex renormings of Banach spaces
Cet. Eur. J. Math. 8(5) 200 87-877 DOI: 0.2478/s533-00-0050-3 Cetral Europea Joural of Mathematics O equivalet strictly G-covex reormigs of Baach spaces Research Article Nataliia V. Boyko Departmet of
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationREAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS
REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai
More informationChapter 3 Inner Product Spaces. Hilbert Spaces
Chapter 3 Ier Product Spaces. Hilbert Spaces 3. Ier Product Spaces. Hilbert Spaces 3.- Defiitio. A ier product space is a vector space X with a ier product defied o X. A Hilbert space is a complete ier
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationA NOTE ON INVARIANT SETS OF ITERATED FUNCTION SYSTEMS
Acta Math. Hugar., 2007 DOI: 10.1007/s10474-007-7013-6 A NOTE ON INVARIANT SETS OF ITERATED FUNCTION SYSTEMS L. L. STACHÓ ad L. I. SZABÓ Bolyai Istitute, Uiversity of Szeged, Aradi vértaúk tere 1, H-6720
More informationOFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS
OFF-DIAGONAL MULTILINEAR INTERPOLATION BETWEEN ADJOINT OPERATORS LOUKAS GRAFAKOS AND RICHARD G. LYNCH 2 Abstract. We exted a theorem by Grafakos ad Tao [5] o multiliear iterpolatio betwee adjoit operators
More informationComplex Analysis Spring 2001 Homework I Solution
Complex Aalysis Sprig 2001 Homework I Solutio 1. Coway, Chapter 1, sectio 3, problem 3. Describe the set of poits satisfyig the equatio z a z + a = 2c, where c > 0 ad a R. To begi, we see from the triagle
More information5.1 A mutual information bound based on metric entropy
Chapter 5 Global Fao Method I this chapter, we exted the techiques of Chapter 2.4 o Fao s method the local Fao method) to a more global costructio. I particular, we show that, rather tha costructig a local
More informationA Few Notes on Statistical Learning Theory
A Few Notes o Statistical Learig Theory Shahar Medelso RSISE, The Australia Natioal Uiversity, Caberra 000, ACT, Australia Itroductio I these otes our aim is to survey recet ad ot so recet) results regardig
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationTENSOR PRODUCTS AND PARTIAL TRACES
Lecture 2 TENSOR PRODUCTS AND PARTIAL TRACES Stéphae ATTAL Abstract This lecture cocers special aspects of Operator Theory which are of much use i Quatum Mechaics, i particular i the theory of Quatum Ope
More informationSOME SEQUENCE SPACES DEFINED BY ORLICZ FUNCTIONS
ARCHIVU ATHEATICU BRNO Tomus 40 2004, 33 40 SOE SEQUENCE SPACES DEFINED BY ORLICZ FUNCTIONS E. SAVAŞ AND R. SAVAŞ Abstract. I this paper we itroduce a ew cocept of λ-strog covergece with respect to a Orlicz
More informationLecture #20. n ( x p i )1/p = max
COMPSCI 632: Approximatio Algorithms November 8, 2017 Lecturer: Debmalya Paigrahi Lecture #20 Scribe: Yua Deg 1 Overview Today, we cotiue to discuss about metric embeddigs techique. Specifically, we apply
More informationThe Pointwise Ergodic Theorem and its Applications
The Poitwise Ergodic Theorem ad its Applicatios Itroductio Peter Oberly 11/9/2018 Algebra has homomorphisms ad topology has cotiuous maps; i these otes we explore the structure preservig maps for measure
More informationNotes on Snell Envelops and Examples
Notes o Sell Evelops ad Examples Example (Secretary Problem): Coside a pool of N cadidates whose qualificatios are represeted by ukow umbers {a > a 2 > > a N } from best to last. They are iterviewed sequetially
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationProbabilistic and Average Linear Widths in L -Norm with Respect to r-fold Wiener Measure
joural of approximatio theory 84, 3140 (1996) Article No. 0003 Probabilistic ad Average Liear Widths i L -Norm with Respect to r-fold Wieer Measure V. E. Maiorov Departmet of Mathematics, Techio, Haifa,
More informationINTEGER CELLS IN CONVEX SETS
INTEGER CELLS IN CONVEX SETS R. VERSHYNIN Abstract. Every covex body K i R has a coordiate projectio P K that cotais at least vol( 1 6 K) cells of the iteger lattice P Z, provided this volume is at least
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationOn Orlicz N-frames. 1 Introduction. Renu Chugh 1,, Shashank Goel 2
Joural of Advaced Research i Pure Mathematics Olie ISSN: 1943-2380 Vol. 3, Issue. 1, 2010, pp. 104-110 doi: 10.5373/jarpm.473.061810 O Orlicz N-frames Reu Chugh 1,, Shashak Goel 2 1 Departmet of Mathematics,
More informationLecture 3 : Random variables and their distributions
Lecture 3 : Radom variables ad their distributios 3.1 Radom variables Let (Ω, F) ad (S, S) be two measurable spaces. A map X : Ω S is measurable or a radom variable (deoted r.v.) if X 1 (A) {ω : X(ω) A}
More informationREGRESSION WITH QUADRATIC LOSS
REGRESSION WITH QUADRATIC LOSS MAXIM RAGINSKY Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X, Y ), where, as before, X is a R d
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More information1 Review and Overview
CS9T/STATS3: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #6 Scribe: Jay Whag ad Patrick Cho October 0, 08 Review ad Overview Recall i the last lecture that for ay family of scalar fuctios F, we
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationSupplemental Material: Proofs
Proof to Theorem Supplemetal Material: Proofs Proof. Let be the miimal umber of traiig items to esure a uique solutio θ. First cosider the case. It happes if ad oly if θ ad Rak(A) d, which is a special
More informationOn n-collinear elements and Riesz theorem
Available olie at www.tjsa.com J. Noliear Sci. Appl. 9 (206), 3066 3073 Research Article O -colliear elemets ad Riesz theorem Wasfi Shataawi a, Mihai Postolache b, a Departmet of Mathematics, Hashemite
More information2 Banach spaces and Hilbert spaces
2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud
More information5 Birkhoff s Ergodic Theorem
5 Birkhoff s Ergodic Theorem Amog the most useful of the various geeralizatios of KolmogorovâĂŹs strog law of large umbers are the ergodic theorems of Birkhoff ad Kigma, which exted the validity of the
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationMa 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5
Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationAnalytic Continuation
Aalytic Cotiuatio The stadard example of this is give by Example Let h (z) = 1 + z + z 2 + z 3 +... kow to coverge oly for z < 1. I fact h (z) = 1/ (1 z) for such z. Yet H (z) = 1/ (1 z) is defied for
More informationSolutions to home assignments (sketches)
Matematiska Istitutioe Peter Kumli 26th May 2004 TMA401 Fuctioal Aalysis MAN670 Applied Fuctioal Aalysis 4th quarter 2003/2004 All documet cocerig the course ca be foud o the course home page: http://www.math.chalmers.se/math/grudutb/cth/tma401/
More informationPROPORTIONAL CONCENTRATION PHENOMENA ON THE SPHERE
PROPORTIONAL CONCENTRATION PHENOMENA ON THE SPHERE by Shiri Artstei School of Mathematical Scieces Tel Aviv Uiversity Ramat Aviv, Tel Aviv 69978 Israel artst@math.tau.ac.il Research was partially supported
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationLecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound
Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee
More informationINEQUALITIES BJORN POONEN
INEQUALITIES BJORN POONEN 1 The AM-GM iequality The most basic arithmetic mea-geometric mea (AM-GM) iequality states simply that if x ad y are oegative real umbers, the (x + y)/2 xy, with equality if ad
More informationMAS111 Convergence and Continuity
MAS Covergece ad Cotiuity Key Objectives At the ed of the course, studets should kow the followig topics ad be able to apply the basic priciples ad theorems therei to solvig various problems cocerig covergece
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 21 11/27/2013 Fuctioal Law of Large Numbers. Costructio of the Wieer Measure Cotet. 1. Additioal techical results o weak covergece
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationStatistical Machine Learning II Spring 2017, Learning Theory, Lecture 7
Statistical Machie Learig II Sprig 2017, Learig Theory, Lecture 7 1 Itroductio Jea Hoorio jhoorio@purdue.edu So far we have see some techiques for provig geeralizatio for coutably fiite hypothesis classes
More informationLecture 19. sup y 1,..., yn B d n
STAT 06A: Polyomials of adom Variables Lecture date: Nov Lecture 19 Grothedieck s Iequality Scribe: Be Hough The scribes are based o a guest lecture by ya O Doell. I this lecture we prove Grothedieck s
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationarxiv: v1 [math.pr] 13 Oct 2011
A tail iequality for quadratic forms of subgaussia radom vectors Daiel Hsu, Sham M. Kakade,, ad Tog Zhag 3 arxiv:0.84v math.pr] 3 Oct 0 Microsoft Research New Eglad Departmet of Statistics, Wharto School,
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationA Note on Matrix Rigidity
A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationSolution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1
Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity
More informationThe multiplicative structure of finite field and a construction of LRC
IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationRegression with quadratic loss
Regressio with quadratic loss Maxim Ragisky October 13, 2015 Regressio with quadratic loss is aother basic problem studied i statistical learig theory. We have a radom couple Z = X,Y, where, as before,
More informationHomework 2. Show that if h is a bounded sesquilinear form on the Hilbert spaces X and Y, then h has the representation
omework 2 1 Let X ad Y be ilbert spaces over C The a sesquiliear form h o X Y is a mappig h : X Y C such that for all x 1, x 2, x X, y 1, y 2, y Y ad all scalars α, β C we have (a) h(x 1 + x 2, y) h(x
More informationOn Involutions which Preserve Natural Filtration
Proceedigs of Istitute of Mathematics of NAS of Ukraie 00, Vol. 43, Part, 490 494 O Ivolutios which Preserve Natural Filtratio Alexader V. STRELETS Istitute of Mathematics of the NAS of Ukraie, 3 Tereshchekivska
More informationInteger cells in convex sets
Iteger cells i covex sets R. Vershyi March 20, 2004 Abstract Every covex body K i R admits a coordiate projectio P K that cotais at least vol( 1 6 K) cells of the iteger lattice P Z, provided this volume
More information