Polynomial identity testing and global minimum cut
|
|
- Derick Knight
- 5 years ago
- Views:
Transcription
1 CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem Polyomial Idetity Testig (PIT), ad i the secod half we will cosider the problem of fidig a global miimum cut i a graph. 1. Polyomial idetity testig 1.1. Polyomials ad polyomial idetity testig. You will all kow what a polyomial of a sigle variable, X say, is: it is simply a expressio of the form p(x) = c 0 + c 1 X + c 2 X c d X d, (6.1) where the coefficiets are take from some field F. If c d 0, the d is called the degree of the polyomial. A polyomial of more tha oe variable is defied similarly: a moomial i the variables X 1, X 2,..., X is defied as X α 1 1 Xα X α, (6. where the α i are oegative itegers. A polyomial (over F) is simply a fiite F-liear combiatio of moomials. There is a obvious way of defiig additio ad multiplicatio of polyomials, ad it ca be show that polyomials i the variables X 1, X 2,..., X over F form a rig uder this multiplicatio ad additio, that is ofte writte F[X 1, X 2,..., X ]. The degree of a moomial X α 1 1 Xα X α is just the sum of the expoets, i.e. deg(x α 1 1 Xα X α ) = α 1 + α α. (6.3) The degree of a polyomial p(x 1, X 2,..., X ) is simply the maximum degree over its costituet moomials. If p(x 1, X 2,..., X ) is a polyomial i which all coefficiets are equal to 0, the it is called the zero-polyomial. Every polyomial p(x 1, X 2,..., X ) gives rise to a polyomial fuctio p : F F i a obvious way. Remark. Note that the polyomial fuctio p may be the zero-fuctio, eve though the polyomial p(x 1, X 2,..., X ) is ot the zero-polyomial. For example, over the biary field F = GF(, the polyomial p(x) = X 2 + X evaluates to zero for all values of X, but it is ot the zero-polyomial. It ca be show that if the size of the field is larger tha the degree of p, beig the zero-fuctio ad beig the zero-polyomial is actually equivalet. Polyomials are ot always give as a sum of fiitely may moomials. For example, the polyomial p(x 1, X 2 ) = (X 1 +X 2 )(X 1 X 2 ) is equal to the polyomial q(x 1, X 2 ) = X 2 1 X2 2. I geeral, two polyomials p(x 1, X 2,..., X ) ad q(x 1, X 2,..., X ) are said to be equal if their differece is equal to the zero-polyomial (or equivaletly, if the coefficiets after expadig match). Hece, we are iterested i decidig whether a give polyomial is the zero-polyomial or ot. This is the problem Polyomial Idetity Testig (PIT). Problem: Polyomial Idetity Testig (PIT) Iput: Polyomial p(x 1, X 2,..., X ) Output: YES, if p 0; NO otherwise. 33
2 The problem PIT is ot as trivial as it may appear at first sight. Oe might be tempted to take the polyomial p, expad it, ad the check if all of the coefficiets are equal to 0. However, expadig the polyomial may take expoetial time, as illustrated by the followig example. Example. If A is a -matrix, the its determiat is defied as the polyomial det(a) = σ S sg(σ) A i,σ(i), (6.4) where the sum is over the permutatios of []. The -Vadermode matrix is the matrix 1 X 1 X X 1 1 V () 1 X 2 X X 1 2 =..... (6.5) 1 X X 2... X 1 It is kow that the determiat of the Vadermode matrix is give by 1 i<j (X j X i ). Therefore, the polyomial σ S sg(σ) X σ(i) 1 i 1 i<j (X j X i ) (6.6) is the zero-polyomial. Expadig the double product requires a expoetial umber of computatios. No polyomial time algorithm for solvig PIT is kow (ad fidig such a algorithm will have importat cosequeces i complexity theory, see [KI03]) Schwartz-Zippel lemma. The followig result, due to Schwartz [Sch80] ad Zippel [Zip79], forms the core of the probabilistic algorithm for solvig PIT. Theorem 6.1 (Schwartz-Zippel lemma). Let p(x 1, X 2,..., X ) be a polyomial over a field F that is ot the zero-polyomial, ad let S F be a fiite set of field elemets. Let R 1, R 2,..., R be chose uiformly ad idepedetly at radom from the elemets i S, the P (p(r 1, R 2,..., R ) = 0) deg(p). (6.7) Proof. We will prove this theorem by iductio o the umber of variables. For the base case, = 1, it is well-kow that a polyomial of degree d has at most d roots, ad the claim follows. Now suppose that the theorem holds for polyomials o at most variables. We will show that it holds for polyomials o + 1 variables as well. So let p be a polyomial o + 1 variables, ad let K be the largest power of X +1 i p. This allows us to write p(x 1, X 2,..., X +1 ) = X K +1 ˆp(X 1, X 2,..., X ) +ˆp(X 1, X 2,..., X +1 ), (6.8) where ˆp is a polyomial of degree at most deg(p) K that does ot deped o X +1, ad is ot the zero-polyomial. Let A be the evet that ˆp(X 1, X 2,..., X ) = 0. The, by the iductio hypothesis, P (A) deg(p) K. (6.9) 34
3 Coditioig o A, we fid that P (p(r 1, R 2,..., R +1 ) = 0) = P (p(r 1, R 2,..., R +1 ) = 0 A) P (A) + P ( p(r 1, R 2,..., R +1 ) = 0 Ā) P ( Ā ) P (A) + P ( p(r 1, R 2,..., R +1 ) = 0 Ā) deg(p) K + K = deg(p), (6.10) where we use (6.9) to boud P (A), while the secod term ca be bouded by coditioig o R 1, R 2, R as well as Ā, otig that after this coditioig p is a polyomial of degree K i the variable X +1 oly, so that we ca apply the = 1-case. The Schwartz-Zippel lemma immediately gives a probabilistic algorithm for PIT: draw radom elemets R 1, R 2,..., R uiformly at radom from a large set ad compute p(r 1, R 2,..., R ). If the polyomial evaluates to 0, retur YES; otherwise retur NO. Note that the algorithm always returs YES if the polyomial p is the zero-polyomial. If p is ot the zero-polyomial, the the probability that the algorithm mistakely returs YES is at most d. There are two ways of makig the error probability smaller: makig S larger, or repeatig the algorithm a umber of times Two further complexity classes. I this sectio, we itroduce three ew complexity classes: RP (for radomised polyomial time), co-rp, ad ZPP (zero-error probabilistic polyomial time). Defiitio 6.2. A decisio problem is said to be i RP if there exists a polyomial time algorithm such that if the correct aswer is NO, it always returs NO; if the correct aswer is YES, it returs YES with probability at least 1/2. This meas that if the algorithm returs YES, we are sure that this is the right aswer. O the other had, if the algorithm returs NO, it may be the case that the aswer actually should be YES. The class co-rp is similar to RP, but with the roles of YES ad NO reversed. Defiitio 6.3. A decisio problem is said to be i RP if there exists a polyomial time algorithm such that if the correct aswer is YES, it always returs YES; if the correct aswer is NO, it returs NO with probability at least 1/2. Usig the Schwarz-Zippel lemma, it is easy to show that PIT is i co-rp, provided that the uderlyig field is large eough. Defiitio 6.4. A decisio problem is said to be i ZPP if there exists a polyomial time algorithm that returs either YES, NO, or DO NOT KNOW, such that it outputs DO NOT KNOW or the correct aswer; it outputs DO NOT KNOW with probability at most 1/2. It is ot hard to show that ZPP = RP co-rp Applicatio: Perfect matchigs i bipartite graphs. A matchig i a graph G is a subset of the edges, such that o two edges share a ed poit. A matchig is called a perfect matchig or 1-factor if it does ot leave ay vertex umatched, i.e. every vertex is icidet to exactly oe edge i the matchig. I this sectio, we will look at perfect matchigs i bipartite graphs. If G is a bipartite graph with bipartitio classes A ad B, the a ecessary coditio for the existece of a perfect matchig is that A ad B cotai the same umber of elemets (i which case the graph is called equibipartite). Ideed, a perfect matchig ca be see as a bijectio φ : A B, such 35
4 that each {a, φ(a)}, a A is a edge. The decisio versio of bipartite perfect matchig is the followig. Problem: Iput: Output: Bipartite Perfect Matchig (Decisio) A equibipartite graph G YES, if G cotais a perfect matchig; NO otherwise We will relate the decisio versio of Bipartite Perfect Matchig to Polyomial Idetity Testig. Give a equibipartite graph G with bipartitio classes A ad B, costruct the (square) matrix M i which the rows are idexed by A ad the colums are idexed by B, ad { x i,j if {i, j} E M i,j = (6.11) 0 otherwise The relatioship of bipartite perfect matchig to PIT is cotaied i the followig lemma. Lemma 6.5. A perfect matchig exists if ad oly if det(m) is the zero-polyomial. Hece the radomised algorithm for solvig PIT ca be tured ito a algorithm for solvig the decisio versio of bipartite perfect matchig that always aswers NO if G does ot cotai a perfect matchig, ad icorrectly aswers NO with probability at most 1/2 if G does cotai a perfect matchig. Proof of Lemma 6.5. For coveiece, we will assume that the vertices o both sides are labelled 1, 2,...,. As i (6.4), the determiat of M ca be writte as det(m) = sg(σ) M i,σ(i). (6.1 σ S Note that every permutatio σ S ca be iterpreted as a possible perfect matchig, M(σ) = {(i, σ(i)) : i A} A B, (6.13) which is oly a actual perfect matchig if each of the pairs (i, σ(i)) is i fact a edge i G. If some pair (i, σ(i)) is ot a edge i G, the correspodig M i,σ(i) = 0, ad so all the summads correspodig with permutatios that do ot give perfect matchigs evaluate to 0. It follows that if G does ot cotai ay perfect matchigs, det(m) is the zero-polyomial. O the other had, if a perfect matchig P exists, this gives rise to a summad ± A i,j = ± x i,j, (6.14) (i,j) P so det(m) caot be the zero-polyomial. (i,j) P 2. Global miimum cut Let G = (V, E) be a graph with vertices ad m edges. A cut i G is a partitio of the vertices of G i two o-empty sets S ad V \ S. We will write (S, V \ S) for the set of edges crossig the cut, i.e. the edges with oe ed i S ad the other ed i V \ S (we will ofte refer to the set of edges crossig the cut simply as the cut). The size of a cut is the umber of edges crossig it, i.e. the size of the cut (S, V \ S) is (S, V \ S). A cut is a miimum cut (or mi-cut) if it is of miimum size amog all cuts i G. Note that there is ot ecessarily a uique mi-cut. Problem: Iput: Output: Mi-Cut A graph G A cut of miimum size i G We have see mi-cuts before i the cotext of miimum s, t-cuts. I that variat of the problem, we distiguish two vertices s ad t (ofte called the source ad the sik), ad 36
5 the objective is to fid a cut (S, V \ S) of miimum size that separates s ad t (i.e. s S ad t V \ S). By replacig each edge i G by two directed edges, the mi-s, t-cut problem ca be solved easily by relatig it to a max-flow problem o the same graph. The global mi-cut problem ca be solved efficietly by fixig some vertex s, varyig t over the remaiig vertices, ad solvig the correspodig mi-s, t-cut problems. Lemma 6.6. Mi-cut ca be solved i polyomial time. I this lecture, we will see a radomised algorithm for solvig Mi-cut, kow as Karger s mi-cut algorithm, which was first published i [Kar93] Cotractios. A multigraph is a graph i which it is possible to have multiple edges betwee ay pair of vertices. Karger s mi-cut algorithm that we will describe below, will iitially take a graph as iput, but o the way might costruct multiple edges. I a multigraph, a edge that starts ad eds at the same vertex is called a self-loop. I our settig, we will oly cosider multigraphs without self-loops. The cetral operatio i Karger s mi-cut algorithm is called cotractio. If G is a multigraph, ad e is a edge with ed poits u ad v the the multigraph G/e obtaied by cotractig e is formed as follows: 1. Replace u ad v by a sigle vertex w; 2. Replace all edges {x, u} ad {x, v} by a ew edge {x, w}; 3. Remove all self-loops at w. Note that the umber of vertices decreases with every cotractio. The followig lemma provides the cetral idea to Karger s mi-cut algorithm. Lemma 6.7. Let e = {u, v} be a edge. There is a oe-to-oe correspodece betwee cuts (S, V \ S) i G avoidig e ad cuts i G/e Karger s mi-cut algorithm. We are ow ready to state the algorithm. Repeat util V = 2: Pick a radom edge e; Replace G G/e. The idea of the algorithm is to cotract radom edges, util two vertices remai. By Lemma 6.7, these two vertices correspod to a cut i the origial graph, which is the output. Hopefully, the output is i fact a mi-cut i the origial graph. The key i the aalysis is that we ca fid a lower boud o the probability that the output i fact is a mi-cut. By repeatig the algorithm a suitable umber of times, ad takig the smallest cut that is retured, we ca make the probability of fidig a mi-cut as large as we wat. Recall that if A 1 ad A 2 are evets, the P (A 1 A 2 ) = P (A 1 ) P (A 2 A 1 ). (6.15) The followig lemma geeralises this equality to itersectio of more tha two evets. Lemma 6.8. Let A 1, A 2,..., A be evets, the ( ) P A i = P (A 1 ) P (A 2 A 1 ) P (A 3 A 1, A 2 )... P (A A 1, A 2,..., A 1 ). (6.16) We ca ow prove the mai result of this sectio. We say that a cut survives the procedure, if oe of its edges is cotracted durig the executio. Theorem 6.9. Let C = (S, V \ S) be a miimum cut i G. The probability that C survives the procedure is at least 1/ (. 37
6 Proof. Let A i be the evet that the cut C survives the first i cotractios, i = 1, 2,..., 2. Note that A 1 A 2... A 2. We are iterested i the probability that C survives the first 2 cotractios, that is ( 2 ) P (A 2 ) = P A i = P (A 1 ) P (A 2 A 1 )... P (A 2 A 1, A 2,..., A 3 ). (6.17) We boud each of the probabilities o the right-had side from below. To start with ote that C survives the first cotractio if the radomly selected edge is ot oe of the edges crossig C. Let κ = C be the size of the miimum cut. As the edges adjacet to a sigle vertex form a cut, it follows that the degree of every vertex is at least κ. Therefore, the umber of edges i G is at least 1 2κ. It follows that P (A 1 ) 1 κ 1 2 κ = 2. (6.18) Next, ote that coditioal o C survivig the first i cotractios, C is still a miimum cut i the multigraph. As the umber of edges ow is at least 1 2κ( i), it follows that κ i 2 P (A i+1 A 1, A 2,..., A i ) 1 =. (6.19) κ( i) i Upo combiig (6.18) (6.19) with (6.17), we obtai the desired boud P (A 2 ) = 2 ( 1) = ( 1 (6.20). Accordig to the theorem, each ru of the algorithm produces a mi-cut with probability at least 1/ ( (. By repeatig the algorithm l 2 times, ad takig the smallest cut retured, the success probability is improved to at least 1/2, as ( ) l 2( 1 1 ( 1 1 e l 2 = 1 2. (6.21) 1 2 [Kar93] [KI03] [Sch80] [Zip79] Bibliography David R. Karger. Global Mi-cuts i RNC, ad Other Ramificatios of a Simple Mi-Cut Algorithm. I: SODA. Vol , pp Valetie Kabaets ad Russell Impagliazzo. Deradomizig polyomial idetity tests meas provig circuit lower bouds. I: Proceedigs of the thirty-fifth aual ACM symposium ACM. 2003, pp Jack Schwartz. Fast probabilistic algorithms for verificatio of polyomial idetities. I: Joural of the ACM 27.4 (1980), pp Richard Zippel. Probabilistic algorithms for sparse polyomials. I: Proceedigs of the Iteratioa 1979, pp
Notes on the Combinatorial Nullstellensatz
Notes o the Combiatorial Nullstellesatz Costructive ad Nocostructive Methods i Combiatorics ad TCS U. Chicago, Sprig 2018 Istructor: Adrew Drucker Scribe: Roberto Ferádez For the followig theorems ad examples
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationLecture 14: Randomized Computation (cont.)
CSE 200 Computability ad Complexity Wedesday, May 15, 2013 Lecture 14: Radomized Computatio (cot.) Istructor: Professor Shachar Lovett Scribe: Dogcai She 1 Radmized Algorithm Examples 1.1 The k-th Elemet
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More information# fixed points of g. Tree to string. Repeatedly select the leaf with the smallest label, write down the label of its neighbour and remove the leaf.
Combiatorics Graph Theory Coutig labelled ad ulabelled graphs There are 2 ( 2) labelled graphs of order. The ulabelled graphs of order correspod to orbits of the actio of S o the set of labelled graphs.
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationLecture 11: Pseudorandom functions
COM S 6830 Cryptography Oct 1, 2009 Istructor: Rafael Pass 1 Recap Lecture 11: Pseudoradom fuctios Scribe: Stefao Ermo Defiitio 1 (Ge, Ec, Dec) is a sigle message secure ecryptio scheme if for all uppt
More informationThe multiplicative structure of finite field and a construction of LRC
IERG6120 Codig for Distributed Storage Systems Lecture 8-06/10/2016 The multiplicative structure of fiite field ad a costructio of LRC Lecturer: Keeth Shum Scribe: Zhouyi Hu Notatios: We use the otatio
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More information1. By using truth tables prove that, for all statements P and Q, the statement
Author: Satiago Salazar Problems I: Mathematical Statemets ad Proofs. By usig truth tables prove that, for all statemets P ad Q, the statemet P Q ad its cotrapositive ot Q (ot P) are equivalet. I example.2.3
More informationWeek 5-6: The Binomial Coefficients
Wee 5-6: The Biomial Coefficiets March 6, 2018 1 Pascal Formula Theorem 11 (Pascal s Formula For itegers ad such that 1, ( ( ( 1 1 + 1 The umbers ( 2 ( 1 2 ( 2 are triagle umbers, that is, The petago umbers
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationIf a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?
2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a
More informationThe Boolean Ring of Intervals
MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationTEACHER CERTIFICATION STUDY GUIDE
COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 12
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract I this lecture we derive risk bouds for kerel methods. We will start by showig that Soft Margi kerel SVM correspods to miimizig
More informationBeurling Integers: Part 2
Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers
More informationOn the Linear Complexity of Feedback Registers
O the Liear Complexity of Feedback Registers A. H. Cha M. Goresky A. Klapper Northeaster Uiversity Abstract I this paper, we study sequeces geerated by arbitrary feedback registers (ot ecessarily feedback
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationDeterminants of order 2 and 3 were defined in Chapter 2 by the formulae (5.1)
5. Determiats 5.. Itroductio 5.2. Motivatio for the Choice of Axioms for a Determiat Fuctios 5.3. A Set of Axioms for a Determiat Fuctio 5.4. The Determiat of a Diagoal Matrix 5.5. The Determiat of a Upper
More informationLinear Regression Demystified
Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationComplex Numbers Solutions
Complex Numbers Solutios Joseph Zoller February 7, 06 Solutios. (009 AIME I Problem ) There is a complex umber with imagiary part 64 ad a positive iteger such that Fid. [Solutio: 697] 4i + + 4i. 4i 4i
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More information11. FINITE FIELDS. Example 1: The following tables define addition and multiplication for a field of order 4.
11. FINITE FIELDS 11.1. A Field With 4 Elemets Probably the oly fiite fields which you ll kow about at this stage are the fields of itegers modulo a prime p, deoted by Z p. But there are others. Now although
More information4 The Sperner property.
4 The Sperer property. I this sectio we cosider a surprisig applicatio of certai adjacecy matrices to some problems i extremal set theory. A importat role will also be played by fiite groups. I geeral,
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationMath 216A Notes, Week 5
Math 6A Notes, Week 5 Scribe: Ayastassia Sebolt Disclaimer: These otes are ot early as polished (ad quite possibly ot early as correct) as a published paper. Please use them at your ow risk.. Thresholds
More informationCS / MCS 401 Homework 3 grader solutions
CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationNICK DUFRESNE. 1 1 p(x). To determine some formulas for the generating function of the Schröder numbers, r(x) = a(x) =
AN INTRODUCTION TO SCHRÖDER AND UNKNOWN NUMBERS NICK DUFRESNE Abstract. I this article we will itroduce two types of lattice paths, Schröder paths ad Ukow paths. We will examie differet properties of each,
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationDavenport-Schinzel Sequences and their Geometric Applications
Advaced Computatioal Geometry Sprig 2004 Daveport-Schizel Sequeces ad their Geometric Applicatios Prof. Joseph Mitchell Scribe: Mohit Gupta 1 Overview I this lecture, we itroduce the cocept of Daveport-Schizel
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationLecture 9: Pseudo-random generators against space bounded computation,
Lecture 9: Pseudo-radom geerators agaist space bouded computatio, Primality Testig Topics i Pseudoradomess ad Complexity (Sprig 2018) Rutgers Uiversity Swastik Kopparty Scribes: Harsha Tirumala, Jiyu Zhag
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationQuantum Computing Lecture 7. Quantum Factoring
Quatum Computig Lecture 7 Quatum Factorig Maris Ozols Quatum factorig A polyomial time quatum algorithm for factorig umbers was published by Peter Shor i 1994. Polyomial time meas that the umber of gates
More informationHere, e(a, B) is defined as the number of edges between A and B in the n dimensional boolean hypercube.
Lecture 2 Topics i Complexity Theory ad Pseudoradomess (Sprig 2013) Rutgers Uiversity Swastik Kopparty Scribes: Amey Bhagale, Mrial Kumar 1 Overview I this lecture, we will complete the proof of formula
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationCourse : Algebraic Combinatorics
Course 18.312: Algebraic Combiatorics Lecture Notes # 18-19 Addedum by Gregg Musier March 18th - 20th, 2009 The followig material ca be foud i a umber of sources, icludig Sectios 7.3 7.5, 7.7, 7.10 7.11,
More information2.4 Sequences, Sequences of Sets
72 CHAPTER 2. IMPORTANT PROPERTIES OF R 2.4 Sequeces, Sequeces of Sets 2.4.1 Sequeces Defiitio 2.4.1 (sequece Let S R. 1. A sequece i S is a fuctio f : K S where K = { N : 0 for some 0 N}. 2. For each
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationSymmetrization maps and differential operators. 1. Symmetrization maps
July 26, 2011 Symmetrizatio maps ad differetial operators Paul Garrett garrett@math.um.edu http://www.math.um.edu/ garrett/ The symmetrizatio map s : Sg Ug is a liear surjectio from the symmetric algebra
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationEnd-of-Year Contest. ERHS Math Club. May 5, 2009
Ed-of-Year Cotest ERHS Math Club May 5, 009 Problem 1: There are 9 cois. Oe is fake ad weighs a little less tha the others. Fid the fake coi by weighigs. Solutio: Separate the 9 cois ito 3 groups (A, B,
More informationLecture 2 Clustering Part II
COMS 4995: Usupervised Learig (Summer 8) May 24, 208 Lecture 2 Clusterig Part II Istructor: Nakul Verma Scribes: Jie Li, Yadi Rozov Today, we will be talkig about the hardess results for k-meas. More specifically,
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLecture 2: Uncomputability and the Haling Problem
CSE 200 Computability ad Complexity Wedesday, April 3, 2013 Lecture 2: Ucomputability ad the Halig Problem Istructor: Professor Shachar Lovett Scribe: Dogcai She 1 The Uiversal Turig Machie I the last
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationNotes for Lecture 11
U.C. Berkeley CS78: Computatioal Complexity Hadout N Professor Luca Trevisa 3/4/008 Notes for Lecture Eigevalues, Expasio, ad Radom Walks As usual by ow, let G = (V, E) be a udirected d-regular graph with
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES.
ALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES. ANDREW SALCH 1. The Jacobia criterio for osigularity. You have probably oticed by ow that some poits o varieties are smooth i a sese somethig
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More informationLovász Local Lemma a new tool to asymptotic enumeration?
Lovász Local Lemma a ew tool to asymptotic eumeratio? Liyua Licol Lu László Székely Uiversity of South Carolia Supported by NSF DMS Overview LLL ad its geeralizatios LLL a istace of the Poisso paradigm
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationSome remarks for codes and lattices over imaginary quadratic
Some remarks for codes ad lattices over imagiary quadratic fields Toy Shaska Oaklad Uiversity, Rochester, MI, USA. Caleb Shor Wester New Eglad Uiversity, Sprigfield, MA, USA. shaska@oaklad.edu Abstract
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More informationPolynomials with Rational Roots that Differ by a Non-zero Constant. Generalities
Polyomials with Ratioal Roots that Differ by a No-zero Costat Philip Gibbs The problem of fidig two polyomials P(x) ad Q(x) of a give degree i a sigle variable x that have all ratioal roots ad differ by
More informationStochastic Matrices in a Finite Field
Stochastic Matrices i a Fiite Field Abstract: I this project we will explore the properties of stochastic matrices i both the real ad the fiite fields. We first explore what properties 2 2 stochastic matrices
More informationM A T H F A L L CORRECTION. Algebra I 1 4 / 1 0 / U N I V E R S I T Y O F T O R O N T O
M A T H 2 4 0 F A L L 2 0 1 4 HOMEWORK ASSIGNMENT #4 CORRECTION Algebra I 1 4 / 1 0 / 2 0 1 4 U N I V E R S I T Y O F T O R O N T O P r o f e s s o r : D r o r B a r - N a t a Correctio Homework Assigmet
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationIntensive Algorithms Lecture 11. DFT and DP. Lecturer: Daniel A. Spielman February 20, f(n) O(g(n) log c g(n)).
Itesive Algorithms Lecture 11 DFT ad DP Lecturer: Daiel A. Spielma February 20, 2018 11.1 Itroductio The purpose of this lecture is to lear how use the Discrete Fourier Trasform to save space i Dyamic
More informationRademacher Complexity
EECS 598: Statistical Learig Theory, Witer 204 Topic 0 Rademacher Complexity Lecturer: Clayto Scott Scribe: Ya Deg, Kevi Moo Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved for
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationLecture 14: Graph Entropy
15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationCS 171 Lecture Outline October 09, 2008
CS 171 Lecture Outlie October 09, 2008 The followig theorem comes very hady whe calculatig the expectatio of a radom variable that takes o o-egative iteger values. Theorem: Let Y be a radom variable that
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationExercises 1 Sets and functions
Exercises 1 Sets ad fuctios HU Wei September 6, 018 1 Basics Set theory ca be made much more rigorous ad built upo a set of Axioms. But we will cover oly some heuristic ideas. For those iterested studets,
More information1 Generating functions for balls in boxes
Math 566 Fall 05 Some otes o geeratig fuctios Give a sequece a 0, a, a,..., a,..., a geeratig fuctio some way of represetig the sequece as a fuctio. There are may ways to do this, with the most commo ways
More informationIn number theory we will generally be working with integers, though occasionally fractions and irrationals will come into play.
Number Theory Math 5840 otes. Sectio 1: Axioms. I umber theory we will geerally be workig with itegers, though occasioally fractios ad irratioals will come ito play. Notatio: Z deotes the set of all itegers
More informationChapter 2 The Solution of Numerical Algebraic and Transcendental Equations
Chapter The Solutio of Numerical Algebraic ad Trascedetal Equatios Itroductio I this chapter we shall discuss some umerical methods for solvig algebraic ad trascedetal equatios. The equatio f( is said
More informationHomework 3. = k 1. Let S be a set of n elements, and let a, b, c be distinct elements of S. The number of k-subsets of S is
Homewor 3 Chapter 5 pp53: 3 40 45 Chapter 6 p85: 4 6 4 30 Use combiatorial reasoig to prove the idetity 3 3 Proof Let S be a set of elemets ad let a b c be distict elemets of S The umber of -subsets of
More information