Lecture 2. The Lovász Local Lemma

Size: px
Start display at page:

Download "Lecture 2. The Lovász Local Lemma"

Transcription

1 Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio ad motivatio We start with the Lovász Local Lemma, a fudametal tool of the probabilistic method ad a prototypical o-costructive argumet i combiatorics provig that a certai object exists without showig what it looks like. Ofte i applyig the probabilistic method, oe is tryig to show that it is possible to avoid bad evets E,..., E with positive probability, or i other words, [ ] P > 0. i= Here are subsets of a probability space Ω (typically a fiite set), ad = Ω \ deotes the complemetary evet for each i. If i P[] <, the the above iequality clearly follows, by the uio boud. However, this is ofte ot a strog eough tool, sice the sum i P[] may be much larger tha eve if the evets ca be avoided. A weaker costrait o the idividual probabilities P[ ] is sufficiet if the evets are also idepedet. I that case if P[ ] < for all i, the P[ i ] is clearly positive. The Lovász Local Lemma is a effective refiemet of this pheomeo, for evets that do ot have too much (iter)depedecy a otio that will be made precise presetly. A additioal attractive feature of the Local Lemma is that it does ot place ay restrictio o the (fiite) umber of evets. 2.2 Symmetric Local Lemma ad applicatio to hypergraph colorability Before we state ad prove the Local Lemma, we first preset a prototypical applicatio of the result, which serves to motivate it. Example 2. (Hypergraph 2-colorig) Give a iteger k 2, a k-uiform hypergraph G = (V (G), E(G)) cosists of a fiite set of odes V (G) ad a collectio of subsets e,..., e V (G), each of size k, which are termed edges (or hyper-edges ). We wat to color each ode i V (G) either red or blue. Uder what coditios ca we guaratee that there is a colorig with o moochromatic edge, i.e., every edge cotais both red ad blue odes? Such hypergraphs are said to be 2-colorable. Notice, if we color each ode red or blue uiformly at radom, the the evet that the ith edge is moochromatic has probability 2 k. Thus if the hypergraph G has less tha 2 k edges, the by the uio boud, the probability that there is at least oe moochromatic edge is < 2 k 2 k =. It follows that G is 2-colorable. However, this argumet fails whe G has 2 k edges. I this case, uder what assumptios ca we prove 2-colorability? Oe such assumptio is that every edge itersects at most d other

2 edges, for some d. Uder such a assumptio, we will show 2-colorability usig the Lovász Local Lemma. (Iterestigly, d will be comparable to 2 k.) We ow defie the followig otio of mutual idepedece. Defiitio 2.2 For all itegers > 0, defie [] := {,..., }. Give evets E,..., E Ω ad a subset J [], the evet is said to be mutually idepedet of {E j : j J} if for all choices of disjoit subsets J, J 2 J, P E j E j2 = P[ ] P E j E j2. j J j 2 J 2 j J j 2 J 2 Equipped with this otio, we ca state the first form of the Lovász Local Lemma, which will help aswer the above questio of 2-colorability for k-uiform hypergraphs. Theorem 2.3 (Symmetric Lovász Local Lemma) Suppose p (0, ), d, ad E,..., E are evets such that P[ ] p for all i. If each is mutually idepedet of all but d other evets E j, ad ep(d + ), where e = is Euler s umber, the P [ i= ] > 0. Remark 2.4 I the above result, d is sometimes called the depedece degree. The local -ess of the result has to do with the fact that assumptios deped oly o d rather tha, the umber of evets. Before we prove the Local Lemma (i a more geeral form), let us see how it ca be used to study 2-colorability for hypergraphs. I the settig of Example 2., suppose the hypergraph G has edges, deoted by e,..., e. Let deote the evet that the edge e i is moochromatic; as computed above, p = 2 k. We ow claim that d = d, that is, the d i Example 2. is precisely the d i Theorem 2.3. Ideed, fix a edge e i ; ow ay coditioig (i.e., ode-colorig) o the edges disjoit from e i is idepedet of, sice the ode colors are i.i.d. Beroulli radom variables. Thus, the assumptios of the Symmetric Lovász Local Lemma are ideed satisfied, as log as d + ep = 2k e. We stress agai that this coditio is idepedet of the umber of edges i the hypergraph G. 2.3 (Asymmetric) Lovász Local Lemma: statemet ad proof We ow prove the Symmetric Lovász Local Lemma, i.e., Theorem 2.3. I fact we show a stroger, asymmetric versio, ad use it to prove the symmetric versio. This will require the followig useful cocept. Defiitio 2.5 A (directed) graph G = (V (G), E(G)) is a depedecy (di)graph o evets E,..., E if V (G) = [] ad each evet is mutually idepedet of its o-eighbors {E j : j i, (i, j) E(G)}.

3 Remark 2.6 Most applicatios i the literature use the udirected versio of the depedecy graph; however, there are some applicatios that use the digraph structure. I such cases, give a directed edge (i, j), i is the source ad j the target. We ca ow state the Lovász Local Lemma i its more geeral form. Theorem 2.7 ((Asymmetric) Lovász Local Lemma) Suppose G is a depedecy (di)graph for evets E,..., E, ad there exist x,..., x (0, ) such that P[ ] x i (i,j) E(G) ( x j ), i []. (2.) The, [ ] P ( x i ) > 0. (2.2) i= i= Remark 2.8 Give a set of evets, the choice of a depedecy digraph G is ot uique, or is the choice of the parameters x i. Rather, the user decides which depedecy digraph G ad parameters x i to work with, i a give applicatio. The depedecy graph is ofte clear from the cotext (e.g. i the hypergraph colorability applicatio above), although the choice of x i might ot be. Remark 2.9 Theorem 2.7 is sharp whe the are idepedet, G is empty, ad x i = P[ ] i. Before we show the Asymmetric Local Lemma, let us quickly see why it implies the Symmetric versio. Ideed, if the hypotheses of Theorem 2.3 hold, set x i = d+ i. Now the hypotheses imply that there is a udirected depedecy graph G i which each ode has degree at most d. Therefore, x i (i,j) E(G) ( x j ) = d + ( ) deg(i) ( ) d d + d + d + It follows by the Asymmetric Lovász Local Lemma that P[ i ] > 0. Fially, we prove the Asymmetric Lovász Local Lemma. Proof of Theorem 2.7. Give S [], defie [ ] P S := P, P :=. i S d + e P[]. The result follows oce we show, by iductio o S, that for all S [] ad a S, P S x a. (2.3)

4 More precisely, we will show by iductio o S that P S ( x a ) > 0. Ideed, this yields the result, because applyig the iequality to S = [], the [ ], ad so o, yields: [ ] P = P [] ( x )P [ ] = ( x )( x )P [ 2] ( x i ) > 0, i= as desired. Thus it remais to prove (2.3). The base case is whe S = {a} is a sigleto. I this case, P {a} P = P[E a ] x a (a,j) E(G) ( x j ) x a, provig the assertio. Now suppose (2.3) holds for all subsets S [] with size at most k, ad say S [] has size k +. To proceed further, let us defie the eighborhood of a S, as well as its closure, via: Now fix a S, ad compute: [ ] P S = P = P i S Γ(a) := {j V (G) : (a, j) E(G)}, Γ + (a) := {a} Γ(a). (2.4) i S\{a} P E a i S\{a} P i S\{a} i= P E a = P[E a ]P S\Γ + (a), i S\Γ + (a) where the first equality ad the iequality are straightforward, ad the fial equality follows from the mutual idepedece of E a ad { : i Γ + (a)}. From this computatio it follows that P S P[E a ] P S\Γ+ (a), where > 0 by the iductio hypothesis. Now say Γ(a) S = {b,..., b d } for some d 0, ad write the fractio o the right-had side as a telescopig product: P S\Γ + (a) = P S\{a,b } P S\{a,b,b 2 } P S\{a,b } P S\{a,b,...,b d } P S\{a,b,...,b d } where all terms o the right-had side are strictly positive by the iductio hypothesis. By the same hypothesis, each ratio o the right-had side is bouded above by. Therefore, x bi P S\Γ + (a). x b x bd Recallig that by assumptio P[E a ] x a b Γ(a) ( x b), it follows that P S x a b Γ(a) ( x b ) c Γ(a) S This shows (2.3), ad with it, the Lovász Local Lemma. x c x a > 0.,

5 3 Applicatio to Ramsey umbers As a applicatio of the asymmetric LLL (Theorem 2.8) we will prove a lower boud for Ramsey umbers R(3,. For itegers k, l 2 the Ramsey umber R(k, is the miimal positive iteger N, such that for every edge-colorig of the complete graph K N there exists a red clique of size k or a blue clique of size l. By iductio o k ad l, oe ca easily prove a upper boud ( ) k + l 2 R(k,. k We will ow cosider the case k = 3 ad l 3. The the above iequality reads R(3, 2l(l + ). We would like obtai a lower boud for R(3, from the LLL. I order to do so, we cosider a complete graph o vertices ad a radom colorig of its edges with the colors red ad blue: We color each edge red with probability p ad blue with probability p; idepedetly for all edges. Here the umber of vertices ad the probability p will be specified later (depedig o the value of. Our goal is to obtai with positive probability a colorig without a red triagle ad without a blue l-clique, sice this would establish the lower boud R(3, >. For each 3-elemet subset T of the vertex set let A T be the evet that the three vertices i T form a red triagle. Note that for each such T we have P(A T ) = p 3 ad the umber of these evets A T is ( 3). Furthermore, for each l-elemet subset S of the vertex set let BS be the evet that the l vertices i S form a blue clique. Note that for each such S we have P(B S ) = ( p) (l 2) ad the umber of these evets B S is (. Let us ow defie a depedecy graph for these evets. We joi two evets of the form A T or B S, if the correspodig sets S or T itersect i at least two vertices (i.e. if they share a edge). It is clear that a evet A T or B S is mutually idepedet of all evets with which it does ot share a edge. Hece the graph we just defied is ideed a depedecy graph. Let us ow boud the degrees i this graph. First cosider a vertex A T. It is coected to at most 3 evets A T. (I order to be coected, the triagles T ad T eed to share a edge. T has 3 edges ad for each of them there are at most choices of a third vertex to form a triagle T ). Also, trivially A T is coected to at most ( evets BS. (We use a trivial boud here sice the actual umber of depedecies is ot much less.) Now, let us cosider a vertex B S. It is coected to at most ( l 2) evets AT (I order to have a coectio, the sets S ad T eed to itersect i at least 2 elemets. There are ( l 2) choices of two elemets i S ad for each of them at most choices for the third vertex i T ). Also, trivially B S is coected to at most ( evets BS. So i order to apply the LLL we eed to fid positive real umbers x, y (0, ) with p 3 = P(A T ) x( x) 3 ( y) ( ad ( p) (l 2) = P(BS ) y( x) (l 2) ( y) (.

6 Here x ad y shall be the values x i i Theorem 2.8. Note that we choose the same value x for all evets A T (sice the situatio is symmetric for all choices of T ) ad the same value y for all evets B S (sice the situatio is symmetric for all choices of S). Let us assume that for some value of we ca fid positive real umbers p, x, y (0, ) such that both of the above iequalities are fulfilled. The the LLL yields that with positive probability oe of the evets A T ad B S happe. This meas that there is a colorig of the edges of a complete graph o vertices such that there is o red triagle ad o blue l-clique. Therefore we have R(3, >, if we ca fid p, x, y (0, ) as above. Let us ow try to fid such p, x, y (0, ) for as large as we ca. We guess that y = ( would be a smart choice, because the the term ( y) ( is roughly costat (aroud e ). Furthermore, we observe that p ad x eed to fulfill the followig iequalities: ad p 3 x( x) 3 ( y) ( x e p(l 2) ( p) ( l 2) y( x) ( l 2) ( y) ( ( x) ( l 2) e x(l 2). Hece we eed p x p 3 ad therefore p. Fially, to guess the depedece of o l we ote e p(l 2) ( p) ( 2) l y( x) ( 2) l ( y) ( y = ( e l log, hece pl 2 p ( ) l 2 l log ad therefore l p log log. Motivated by this we assume l 20 log ad choose y = (, x = ad p = 9 3/2 3 (the costats here are ot really importat, they are just chose i such a way that the iequalities work out). The we have ( ) ( ( y) ( = ( e.0 if is sufficietly large (sice ( m )m e as m ). Furthermore for sufficietly large we also have ( ( x) 3 = ) 3 9 3/2 3 e 0.0 for sufficietly large. Thus, p 3 = 27 3/2 9 3/2 e.02 x( x) 3 ( y) (, which establishes the first desired iequality. For the secod iequality ote that for sufficietly small h > 0 we have h e 2h. So for sufficietly large we get ( x) (l 2) e 2x(l 2) = e 2 9 (l 2). Furthermore, usig l 20 log, y = ( ) l l = e l log e l2 20 e l(l ) 9 e l(l ) = e 9 (l 2)+.0.

7 Hece ( p) (l 2) e p( l 2) = e 3 (l 2) = e 9 (l 2)+.0 e 2 9 (l 2) e.0 y( x) (l 2) ( y) (, which verifies the secod desired iequality. Thus, for l 20 log we ca fid p, x, y (0, ) with the two desired iequalities. This implies (by the LLL, as described above) that R(3, > wheever l 20 log ad sufficietly large. Note that l 2 (40 log 2 implies 20 l log log l log(l2 ) = l. Therefore we have R(3, l 2 (40 log 2 for all sufficietly large l. This proves the followig theorem. Theorem 3. There is a positive costat c > 0, such that R(3, c l2 log 2 l for all l 3. So we have proved c l2 log 2 l R(3, 2l(l + ). We coclude this sectio by remarkig that the ) true aswer is R(3, = Θ. (The upper boud was proved by Ajtai, Komlós, Szemerédi ad ( l 2 log l the lower boud by Jeog Ha Kim.)

Lecture 14: Graph Entropy

Lecture 14: Graph Entropy 15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Problem Set 2 Solutions

Problem Set 2 Solutions CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S

More information

Disjoint Systems. Abstract

Disjoint Systems. Abstract Disjoit Systems Noga Alo ad Bey Sudaov Departmet of Mathematics Raymod ad Beverly Sacler Faculty of Exact Scieces Tel Aviv Uiversity, Tel Aviv, Israel Abstract A disjoit system of type (,,, ) is a collectio

More information

Application to Random Graphs

Application to Random Graphs A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let

More information

Math F215: Induction April 7, 2013

Math F215: Induction April 7, 2013 Math F25: Iductio April 7, 203 Iductio is used to prove that a collectio of statemets P(k) depedig o k N are all true. A statemet is simply a mathematical phrase that must be either true or false. Here

More information

Advanced Stochastic Processes.

Advanced Stochastic Processes. Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.

More information

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?

If a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero? 2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence

Chapter 3. Strong convergence. 3.1 Definition of almost sure convergence Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i

More information

Large holes in quasi-random graphs

Large holes in quasi-random graphs Large holes i quasi-radom graphs Joaa Polcy Departmet of Discrete Mathematics Adam Mickiewicz Uiversity Pozań, Polad joaska@amuedupl Submitted: Nov 23, 2006; Accepted: Apr 10, 2008; Published: Apr 18,

More information

Independence number of graphs with a prescribed number of cliques

Independence number of graphs with a prescribed number of cliques Idepedece umber of graphs with a prescribed umber of cliques Tom Bohma Dhruv Mubayi Abstract We cosider the followig problem posed by Erdős i 1962. Suppose that G is a -vertex graph where the umber of

More information

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.

Product measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014. Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the

More information

# fixed points of g. Tree to string. Repeatedly select the leaf with the smallest label, write down the label of its neighbour and remove the leaf.

# fixed points of g. Tree to string. Repeatedly select the leaf with the smallest label, write down the label of its neighbour and remove the leaf. Combiatorics Graph Theory Coutig labelled ad ulabelled graphs There are 2 ( 2) labelled graphs of order. The ulabelled graphs of order correspod to orbits of the actio of S o the set of labelled graphs.

More information

Lecture 2 Long paths in random graphs

Lecture 2 Long paths in random graphs Lecture Log paths i radom graphs 1 Itroductio I this lecture we treat the appearace of log paths ad cycles i sparse radom graphs. will wor with the probability space G(, p) of biomial radom graphs, aalogous

More information

On Random Line Segments in the Unit Square

On Random Line Segments in the Unit Square O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,

More information

HOMEWORK 2 SOLUTIONS

HOMEWORK 2 SOLUTIONS HOMEWORK SOLUTIONS CSE 55 RANDOMIZED AND APPROXIMATION ALGORITHMS 1. Questio 1. a) The larger the value of k is, the smaller the expected umber of days util we get all the coupos we eed. I fact if = k

More information

Lecture 9: Hierarchy Theorems

Lecture 9: Hierarchy Theorems IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture

More information

Online hypergraph matching: hiring teams of secretaries

Online hypergraph matching: hiring teams of secretaries Olie hypergraph matchig: hirig teams of secretaries Rafael M. Frogillo Advisor: Robert Kleiberg May 29, 2008 Itroductio The goal of this paper is to fid a competitive algorithm for the followig problem.

More information

Math 216A Notes, Week 5

Math 216A Notes, Week 5 Math 6A Notes, Week 5 Scribe: Ayastassia Sebolt Disclaimer: These otes are ot early as polished (ad quite possibly ot early as correct) as a published paper. Please use them at your ow risk.. Thresholds

More information

Notes for Lecture 11

Notes for Lecture 11 U.C. Berkeley CS78: Computatioal Complexity Hadout N Professor Luca Trevisa 3/4/008 Notes for Lecture Eigevalues, Expasio, ad Radom Walks As usual by ow, let G = (V, E) be a udirected d-regular graph with

More information

Lecture 2: April 3, 2013

Lecture 2: April 3, 2013 TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,

More information

Axioms of Measure Theory

Axioms of Measure Theory MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that

More information

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22

Discrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22 CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first

More information

STAT Homework 1 - Solutions

STAT Homework 1 - Solutions STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

arxiv: v3 [math.co] 6 Aug 2014

arxiv: v3 [math.co] 6 Aug 2014 NEAR PERFECT MATCHINGS IN -UNIFORM HYPERGRAPHS arxiv:1404.1136v3 [math.co] 6 Aug 2014 JIE HAN Abstract. Let H be a -uiform hypergraph o vertices where is a sufficietly large iteger ot divisible by. We

More information

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)

Randomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018) Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black

More information

lim za n n = z lim a n n.

lim za n n = z lim a n n. Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget

More information

Fall 2013 MTH431/531 Real analysis Section Notes

Fall 2013 MTH431/531 Real analysis Section Notes Fall 013 MTH431/531 Real aalysis Sectio 8.1-8. Notes Yi Su 013.11.1 1. Defiitio of uiform covergece. We look at a sequece of fuctios f (x) ad study the coverget property. Notice we have two parameters

More information

Lecture Notes for Analysis Class

Lecture Notes for Analysis Class Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

Lecture 12: November 13, 2018

Lecture 12: November 13, 2018 Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,

More information

Basics of Probability Theory (for Theory of Computation courses)

Basics of Probability Theory (for Theory of Computation courses) Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.

It is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function. MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied

More information

Week 5-6: The Binomial Coefficients

Week 5-6: The Binomial Coefficients Wee 5-6: The Biomial Coefficiets March 6, 2018 1 Pascal Formula Theorem 11 (Pascal s Formula For itegers ad such that 1, ( ( ( 1 1 + 1 The umbers ( 2 ( 1 2 ( 2 are triagle umbers, that is, The petago umbers

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.

Definition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4. 4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad

More information

The Boolean Ring of Intervals

The Boolean Ring of Intervals MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,

More information

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound

Lecture 27. Capacity of additive Gaussian noise channel and the sphere packing bound Lecture 7 Ageda for the lecture Gaussia chael with average power costraits Capacity of additive Gaussia oise chael ad the sphere packig boud 7. Additive Gaussia oise chael Up to this poit, we have bee

More information

Math 61CM - Solutions to homework 3

Math 61CM - Solutions to homework 3 Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig

More information

Introduction to Probability. Ariel Yadin. Lecture 7

Introduction to Probability. Ariel Yadin. Lecture 7 Itroductio to Probability Ariel Yadi Lecture 7 1. Idepedece Revisited 1.1. Some remiders. Let (Ω, F, P) be a probability space. Give a collectio of subsets K F, recall that the σ-algebra geerated by K,

More information

Few remarks on Ramsey-Turán-type problems Benny Sudakov Λ Abstract Let H be a fixed forbidden graph and let f be a function of n. Denote by RT n; H; f

Few remarks on Ramsey-Turán-type problems Benny Sudakov Λ Abstract Let H be a fixed forbidden graph and let f be a function of n. Denote by RT n; H; f Few remarks o Ramsey-Turá-type problems Bey Sudakov Abstract Let H be a fixed forbidde graph ad let f be a fuctio of. Deote by ; H; f () the maximum umber of edges a graph G o vertices ca have without

More information

Random Graphs and Erdős Magic Joel Spencer Asperen, October 30- November 1, 2018

Random Graphs and Erdős Magic Joel Spencer Asperen, October 30- November 1, 2018 Radom Graphs ad Erdős Magic Joel Specer Aspere, October 30- November 1, 2018 A Special Note: These otes are oly a approximatio to the actual lectures. There is some extra material here, ad there will almost

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

1 Review and Overview

1 Review and Overview DRAFT a fial versio will be posted shortly CS229T/STATS231: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #3 Scribe: Migda Qiao October 1, 2013 1 Review ad Overview I the first half of this course,

More information

Chapter 6 Infinite Series

Chapter 6 Infinite Series Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat

More information

Fundamental Theorem of Algebra. Yvonne Lai March 2010

Fundamental Theorem of Algebra. Yvonne Lai March 2010 Fudametal Theorem of Algebra Yvoe Lai March 010 We prove the Fudametal Theorem of Algebra: Fudametal Theorem of Algebra. Let f be a o-costat polyomial with real coefficiets. The f has at least oe complex

More information

b i u x i U a i j u x i u x j

b i u x i U a i j u x i u x j M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here

More information

Notes 5 : More on the a.s. convergence of sums

Notes 5 : More on the a.s. convergence of sums Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series

More information

Discrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions

Discrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the

More information

1 Convergence in Probability and the Weak Law of Large Numbers

1 Convergence in Probability and the Weak Law of Large Numbers 36-752 Advaced Probability Overview Sprig 2018 8. Covergece Cocepts: i Probability, i L p ad Almost Surely Istructor: Alessadro Rialdo Associated readig: Sec 2.4, 2.5, ad 4.11 of Ash ad Doléas-Dade; Sec

More information

MAT1026 Calculus II Basic Convergence Tests for Series

MAT1026 Calculus II Basic Convergence Tests for Series MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real

More information

Lecture 3: August 31

Lecture 3: August 31 36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,

More information

Introduction to Probability. Ariel Yadin

Introduction to Probability. Ariel Yadin Itroductio to robability Ariel Yadi Lecture 2 *** Ja. 7 ***. Covergece of Radom Variables As i the case of sequeces of umbers, we would like to talk about covergece of radom variables. There are may ways

More information

Lecture 10 October Minimaxity and least favorable prior sequences

Lecture 10 October Minimaxity and least favorable prior sequences STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak

More information

Lecture 3 The Lebesgue Integral

Lecture 3 The Lebesgue Integral Lecture 3: The Lebesgue Itegral 1 of 14 Course: Theory of Probability I Term: Fall 2013 Istructor: Gorda Zitkovic Lecture 3 The Lebesgue Itegral The costructio of the itegral Uless expressly specified

More information

1. By using truth tables prove that, for all statements P and Q, the statement

1. By using truth tables prove that, for all statements P and Q, the statement Author: Satiago Salazar Problems I: Mathematical Statemets ad Proofs. By usig truth tables prove that, for all statemets P ad Q, the statemet P Q ad its cotrapositive ot Q (ot P) are equivalet. I example.2.3

More information

Lecture 2 February 8, 2016

Lecture 2 February 8, 2016 MIT 6.854/8.45: Advaced Algorithms Sprig 206 Prof. Akur Moitra Lecture 2 February 8, 206 Scribe: Calvi Huag, Lih V. Nguye I this lecture, we aalyze the problem of schedulig equal size tasks arrivig olie

More information

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1

Solution. 1 Solutions of Homework 1. Sangchul Lee. October 27, Problem 1.1 Solutio Sagchul Lee October 7, 017 1 Solutios of Homework 1 Problem 1.1 Let Ω,F,P) be a probability space. Show that if {A : N} F such that A := lim A exists, the PA) = lim PA ). Proof. Usig the cotiuity

More information

Metric Space Properties

Metric Space Properties Metric Space Properties Math 40 Fial Project Preseted by: Michael Brow, Alex Cordova, ad Alyssa Sachez We have already poited out ad will recogize throughout this book the importace of compact sets. All

More information

CS 171 Lecture Outline October 09, 2008

CS 171 Lecture Outline October 09, 2008 CS 171 Lecture Outlie October 09, 2008 The followig theorem comes very hady whe calculatig the expectatio of a radom variable that takes o o-egative iteger values. Theorem: Let Y be a radom variable that

More information

ABOUT CHAOS AND SENSITIVITY IN TOPOLOGICAL DYNAMICS

ABOUT CHAOS AND SENSITIVITY IN TOPOLOGICAL DYNAMICS ABOUT CHAOS AND SENSITIVITY IN TOPOLOGICAL DYNAMICS EDUARD KONTOROVICH Abstract. I this work we uify ad geeralize some results about chaos ad sesitivity. Date: March 1, 005. 1 1. Symbolic Dyamics Defiitio

More information

Empirical Processes: Glivenko Cantelli Theorems

Empirical Processes: Glivenko Cantelli Theorems Empirical Processes: Gliveko Catelli Theorems Mouliath Baerjee Jue 6, 200 Gliveko Catelli classes of fuctios The reader is referred to Chapter.6 of Weller s Torgo otes, Chapter??? of VDVW ad Chapter 8.3

More information

Chapter 0. Review of set theory. 0.1 Sets

Chapter 0. Review of set theory. 0.1 Sets Chapter 0 Review of set theory Set theory plays a cetral role i the theory of probability. Thus, we will ope this course with a quick review of those otios of set theory which will be used repeatedly.

More information

DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES

DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES DANIELA KÜHN AND DERYK OSTHUS Abstract. I 1973 Bermod, Germa, Heydema ad Sotteau cojectured that if divides (, the the complete

More information

Distribution of Random Samples & Limit theorems

Distribution of Random Samples & Limit theorems STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to

More information

Cardinality Homework Solutions

Cardinality Homework Solutions Cardiality Homework Solutios April 16, 014 Problem 1. I the followig problems, fid a bijectio from A to B (you eed ot prove that the fuctio you list is a bijectio): (a) A = ( 3, 3), B = (7, 1). (b) A =

More information

Math Solutions to homework 6

Math Solutions to homework 6 Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

On matchings in hypergraphs

On matchings in hypergraphs O matchigs i hypergraphs Peter Frakl Tokyo, Japa peter.frakl@gmail.com Tomasz Luczak Adam Mickiewicz Uiversity Faculty of Mathematics ad CS Pozań, Polad ad Emory Uiversity Departmet of Mathematics ad CS

More information

page Suppose that S 0, 1 1, 2.

page Suppose that S 0, 1 1, 2. page 10 1. Suppose that S 0, 1 1,. a. What is the set of iterior poits of S? The set of iterior poits of S is 0, 1 1,. b. Give that U is the set of iterior poits of S, evaluate U. 0, 1 1, 0, 1 1, S. The

More information

Law of the sum of Bernoulli random variables

Law of the sum of Bernoulli random variables Law of the sum of Beroulli radom variables Nicolas Chevallier Uiversité de Haute Alsace, 4, rue des frères Lumière 68093 Mulhouse icolas.chevallier@uha.fr December 006 Abstract Let be the set of all possible

More information

Here are some examples of algebras: F α = A(G). Also, if A, B A(G) then A, B F α. F α = A(G). In other words, A(G)

Here are some examples of algebras: F α = A(G). Also, if A, B A(G) then A, B F α. F α = A(G). In other words, A(G) MATH 529 Probability Axioms Here we shall use the geeral axioms of a probability measure to derive several importat results ivolvig probabilities of uios ad itersectios. Some more advaced results will

More information

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15

Discrete Mathematics and Probability Theory Summer 2014 James Cook Note 15 CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model

More information

As stated by Laplace, Probability is common sense reduced to calculation.

As stated by Laplace, Probability is common sense reduced to calculation. Note: Hadouts DO NOT replace the book. I most cases, they oly provide a guidelie o topics ad a ituitive feel. The math details will be covered i class, so it is importat to atted class ad also you MUST

More information

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.

Let us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f. Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,

More information

The log-behavior of n p(n) and n p(n)/n

The log-behavior of n p(n) and n p(n)/n Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity

More information

DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES

DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES DECOMPOSITIONS OF COMPLETE UNIFORM HYPERGRAPHS INTO HAMILTON BERGE CYCLES DANIELA KÜHN AND DERYK OSTHUS Abstract. I 1973 Bermod, Germa, Heydema ad Sotteau cojectured that if divides (, the the complete

More information

Homework 9. (n + 1)! = 1 1

Homework 9. (n + 1)! = 1 1 . Chapter : Questio 8 If N, the Homewor 9 Proof. We will prove this by usig iductio o. 2! + 2 3! + 3 4! + + +! +!. Base step: Whe the left had side is. Whe the right had side is 2! 2 +! 2 which proves

More information

Math 220A Fall 2007 Homework #2. Will Garner A

Math 220A Fall 2007 Homework #2. Will Garner A Math 0A Fall 007 Homewor # Will Garer Pg 3 #: Show that {cis : a o-egative iteger} is dese i T = {z œ : z = }. For which values of q is {cis(q): a o-egative iteger} dese i T? To show that {cis : a o-egative

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Math 104: Homework 2 solutions

Math 104: Homework 2 solutions Math 04: Homework solutios. A (0, ): Sice this is a ope iterval, the miimum is udefied, ad sice the set is ot bouded above, the maximum is also udefied. if A 0 ad sup A. B { m + : m, N}: This set does

More information

Polynomial identity testing and global minimum cut

Polynomial identity testing and global minimum cut CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem

More information

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.

Random Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A. Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)

More information

Lecture 9: Expanders Part 2, Extractors

Lecture 9: Expanders Part 2, Extractors Lecture 9: Expaders Part, Extractors Topics i Complexity Theory ad Pseudoradomess Sprig 013 Rutgers Uiversity Swastik Kopparty Scribes: Jaso Perry, Joh Kim I this lecture, we will discuss further the pseudoradomess

More information

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory

ACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory 1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.

More information

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.

6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer. 6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio

More information

Introduction to Probability. Ariel Yadin. Lecture 2

Introduction to Probability. Ariel Yadin. Lecture 2 Itroductio to Probability Ariel Yadi Lecture 2 1. Discrete Probability Spaces Discrete probability spaces are those for which the sample space is coutable. We have already see that i this case we ca take

More information

Lecture 4: April 10, 2013

Lecture 4: April 10, 2013 TTIC/CMSC 1150 Mathematical Toolkit Sprig 01 Madhur Tulsiai Lecture 4: April 10, 01 Scribe: Haris Agelidakis 1 Chebyshev s Iequality recap I the previous lecture, we used Chebyshev s iequality to get a

More information

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n =

sin(n) + 2 cos(2n) n 3/2 3 sin(n) 2cos(2n) n 3/2 a n = 60. Ratio ad root tests 60.1. Absolutely coverget series. Defiitio 13. (Absolute covergece) A series a is called absolutely coverget if the series of absolute values a is coverget. The absolute covergece

More information

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?

(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m? MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle

More information

Pairs of disjoint q-element subsets far from each other

Pairs of disjoint q-element subsets far from each other Pairs of disjoit q-elemet subsets far from each other Hikoe Eomoto Departmet of Mathematics, Keio Uiversity 3-14-1 Hiyoshi, Kohoku-Ku, Yokohama, 223 Japa, eomoto@math.keio.ac.jp Gyula O.H. Katoa Alfréd

More information

The random version of Dvoretzky s theorem in l n

The random version of Dvoretzky s theorem in l n The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the

More information

Solutions to Tutorial 5 (Week 6)

Solutions to Tutorial 5 (Week 6) The Uiversity of Sydey School of Mathematics ad Statistics Solutios to Tutorial 5 (Wee 6 MATH2962: Real ad Complex Aalysis (Advaced Semester, 207 Web Page: http://www.maths.usyd.edu.au/u/ug/im/math2962/

More information