Computability and computational complexity
|
|
- Angelica Quinn
- 5 years ago
- Views:
Transcription
1 Computability ad computatioal complexity Lecture 6: Relatios betwee complexity classes Io Petre Computer Sciece, Åbo Akademi Uiversity Fall May
2 Cotet Complexity classes Precise Turig machies The time hierarchy Space vs time LÍNL ÍP ÍNP ÍPSPACE Nodetermiistic space PSPACE=NPSPACE NSPACE=coNSPACE Savitch s theorem Immerma-Szelepscéyi theorem 21 May
3 Complexity classes A complexity class is specified by: the uderlyig model of computatio (for us multi-tape Turig machies) mode of computatio (already see the determiistic ad the odetermiistic modes) a resource that will be boud (time, space, ) a boud (f:n N): logarithmic, polyomial, expoetial, The complexity class is the set of all laguages decided by a multitape TM M operatig i the appropriate mode ad such that for ay iput x, M uses at most f( x ) uits of the specified resource 21 May
4 Proper complexity fuctios Questio: what kid of fuctios f:n N is reasoable to cosider how about weird fuctios such as 2 if is prime, the th smallest otherwise such uusual fuctios lead to very ivolved cosideratios; perhaps ot useful for atural computatioal problems Defiitio: We say that f:n N is a proper complexity fuctio if f is odecreasig: f(+1)³f(), for all ÎN there is a k-tape TM M f =(K,S,d,s) with iput ad output such that for ay iput x we have that: 1. M f (x)= f( x ), where is a uasi-blak symbol 2. M f halts withi O( x +f( x )) steps 3. M f uses O(f( x )) space besides its iput We oly use proper complexity fuctio as bouds Examples of proper complexity fuctios f(): c,, ëlog û, ëlog 2 û, ë log û, 2, 3 +3, 2, 1/2,! 21 May
5 PRECISE TURING MACHINES 21 May
6 Precise Turig machies Defiitio. A TM M (with iput/output or ot, determiistic or odetermiistic) is precise if there are fuctios f,g:n N such that for every ad for every iput x of legth ad for every computatio of M o x: M halts after precisely f() steps all of its tapes (except the first ad the last i case of machies with iput ad output) are at haltig of legth precisely g() 21 May
7 Simulatig Turig machies with precise Turig machies Propositio. Suppose that a (determiistic or odetermistic) TM M decides a laguage L withi time (or space) f(), where f is a proper fuctio. The there is a precise Turig machie M which decides the same laguage i time (or space, resp.) O(f()). Proof idea. There are 4 cases to cosider: determiistic/odetermiistic, time/space complexity We first eed to compute f( x ) from the defiitio of proper fuctios, there is a TM M f givig output f( x ) Use the output strig of M f as a alarm clock to decide withi either time f( x ) or space f( x ) Simulate M o x for exactly f( x ) steps / withi f( x ) space 21 May
8 Time ad space complexity classes Let f:n N be a proper complexity fuctio We defie: TIME(f) (determiistic time) SPACE(f) (determiistic space) NTIME(f) (odetermiistic time) NSPACE(f) (odetermiistic space) 21 May
9 Time ad space complexity classes Use a class of parameterized fuctios istead of fuctio f P = TIME( k ) =È j>0 TIME( j ) NP = NTIME( k ) =È j>0 NTIME( j ) PSPACE = SPACE( k ) =È j>0 SPACE( j ) NPSPACE = NSPACE( k ) =È j>0 NSPACE( j ) EXP = TIME(2 k ) =È j>0 TIME(2 j ) L = SPACE(log ) NL = NSPACE(log ) 21 May
10 Complemets of complexity classes The complemet of a laguage LÍS* is L=S*-L Recall: a decisio problem ca be idetified with the laguage of its yes istace The complemet of a decisio problem A, deoted A COMPLEMENT, is that problem whose aswer is yes iff the aswer of A o the same iput is o Example: SAT COMPLEMENT give a Boolea formula i CNF, is it usatisfiable? HAMILTON PATH COMPLEMENT give a graph G, decide if G does ot have a Hamiltoia path The complemet of a complexity class C is coc={l: LÎC} 21 May
11 Closure uder complemet Observatio: all determiistic time ad space complexity classes are closed uder complemet Chage the yes with the o states of the TM For example, P=coP Later i this lecture we prove that the same is true for odetermiistic space complexity Ope problem: are the odetermiistic time complexity classes closed uder complemet? For example, is NP=coNP? 21 May
12 COMPLEXITY CLASSES: HIERARCHIES 21 May
13 Hierarchies Addig ew features to the computatioal model ofte leads to more computatioal power Example: Chomsky s hierarchy from fiite automata to pushdow automata, to liear bouded (odetermiistic) TM, to TM Example: the ability of a TM to reject through o-haltig computatios gives the jump from recursive laguages (REC) to RE laguages Discuss ow a uatitative versio of the same observatio: with sufficietly greater time allocatio, TM are able to perform more complex computatioal tasks The proof will employ a uatitative sort of diagoalizatio 21 May
14 Upper boud Let f:n N be a proper complexity fuctio. Defie H f ={M;x: M accepts iput x after at most f( x ) steps} i other words: the time-bouded versio of the HALTING laguage H Lemma. H f ÎTIME( f 3 () ) Proof idea Describe a TM U f with 4 tapes decidig H f i f 3 () steps based o: the uiversal TM U, the sigle-tape simulator of multi-tape machies, the liear speed-up machie, ad the machie M f that computes a yardstick of legth exactly f() 21 May
15 Proof - cotiued Mode of operatio for U f : use M f o x to iitialize the 4 th tape o the appropriate alarm clock f( x ) so far: O(f( x )) steps, where the costat depeds just o f, ot o M,x copy the descriptio of M to the 3 rd tape covert x o the first tape to >x write o the secod tape the ecodig of state s of M simulate M o x: the iput is maipulated o the first tape, the cofiguratios are kept o the secod tape, descriptio of M o the third if M accepts i at most f( x ) steps, the U f also accepts; if ot, U f rejects Time complexity each step of M is simulated i O(f ( x ) 2 ); ru at most f( x ) steps total time: O(f ( x ) 3 ) it ca be made exactly f ( x ) 3 through the liear speed-up theorem 21 May
16 Lower boud Lemma. H f ÏTIME( f(ë/2û) ) Proof idea. Suppose that there is a TM M H f decidig H f i time f(ë/2û) Costruct ow a diagoalizig machie D f with the followig behavior: D f (M): if M H (M;M)= yes, the o, else yes f D f o iput M rus i the same time as M H o iput M;M, i.e., i time f f(ë(2+1)/2û)=f(), where = M Questio: does D f accept its ow descriptio? If D f (D f )= yes, the M H f (D f;d f )= o, i.e., D f does ot halt o D f i at most f( D f ) steps. But D f always rus i at most f() steps for a iput of legth. Coclusio: D f (D f )= o If D f (D f )= o, the M H f (D f;d f )= yes, i.e., o D f o iput D f halts with aswer yes, i.e., D f (D f )= yes 21 May
17 The time hierarchy theorem Theorem. If f()³ is a proper complexity fuctio, the TIME(f()) is strictly icluded withi TIME( (f(2+1)) 3 ) Proof Upper boud lemma: H f(2+1) ÎTIME( (f(2+1)) 3 ) Lower boud lemma: H f(2+1) ÏTIME( f(ë(2+1)/2û) )=TIME(f()) Corollary. P Ì EXP Proof. Ay polyomial is evetually smaller tha 2 ad so, PÍTIME(2 )ÍEXP By the theorem: TIME(2 ) Ì TIME( (2 2+1 ) 3 ) Í EXP 21 May
18 The space hierarchy theorem Theorem. If f() is a proper complexity fuctio, the SPACE(f()) Ì SPACE( f()log f() ) Proof. Skip it. Similar to the time hierarchy results 21 May
19 COMPLEXITY CLASSES: SPACE VS. TIME, DETERMINISTIC VS. NONDETERMINISTIC 21 May
20 Comparig classes of differet kids So far: relatioships betwee classes of the same kid (determiistic time, determiistic space) relate to each other similar results hold also for odetermiistic classes Switch to discuss relatioships betwee classes of differet kids P vs. NP is a example here 21 May
21 SPACE vs. TIME, DET vs. NONDET Theorem. Let f:n N be a proper complexity fuctio a) SPACE(f()) Í NSPACE(f()) ad TIME(f()) Í NTIME(f()) b) NTIME(f()) Í SPACE(f()) c) NSPACE(f()) Í TIME( c log +f() ) Proof a) A determiistic TM is also a (trivial) odetermiistic TM b) Simulate all computatio paths withi bouded space details below c) The reachability method for simulatig space-bouded machies details below 21 May
22 NTIME(f()) Í SPACE(f()) proof Let LÎNTIME(f()) ad a precise odetermiistic TM M decidig L i time f(). Desig a determiistic TM M decidig L i space f() Idea: check all computatio paths; similar to simulatig a odetermiistic machie with a determiistic oe (i exp. time) let d be the degree of odetermiism of M; ay computatio of M is described by a seuece of umbers 0 d-1 of legth f() M starts by geeratig seuece 0 0 of legth f() crucial here that f is proper M simulates M o the computatio described by the curret d-ary seuece of legth f() it ca be doe i space f() because i time f() oly O(f()) characters ca be writte M geerates the ext seuece of legth f(), simulates it i the same space as before, etc. 21 May
23 NSPACE(f()) Í TIME( c log +f() ) proof Let L be a laguage decided by a k-tape odetermiistic TM M with iput ad output i space f(); let x be a iput of legth Challege: simulate determiistically the odetermiistic computatio of M o x withi time c log +f(), for some costat c depedig o M Cofiguratio of M: a 2k+1-tuple (,w 1,u 1,,w k,u k ). But M is a machie with iput ad output ad so: w 1 u 1 =x throughout the computatio the output tape w k u k is ot of iterest for a decidig machie its cotet ca be igored all other strigs w i u i are of legth at most f() Coclusio: ay cofiguratio ca be represeted as (,i,w 2,u 2,,w k-1,u k-1 ), where i is the positio of the cursor o the first tape Questio: how may cofiguratios are there? at most K choices for at most +1 choices for i at most S (2k-2)f() choices for the strigs, couted altogether Aswer: for a iput of legth, there are at most c f() 1 =c log +f() 1 cofiguratios, where c 1 is a costat depedig o M 21 May
24 NSPACE(f()) Í TIME( k log +f() ) proof cotd. Defie the cofiguratio graph of M odes: all possible cofiguratios of M edges (i,j) if there is a trasitio of M trasformig i ito j Observatio: decidig whether x is i L is the same as decidig whether a state ( yes,i, ) is reachable from the iitial state (s,0,>,1,,>,1) But this is REACHABILITY decidable i uadratic time c 2 m 2 for a iput of size m I other words, we ca aswer the origial uestio i time c 2 (c log +f() 1 ) 2 = c 2 (c 12 ) log +f() The result follows ow with c=c 2 c 1 2 How to hadle the cofiguratio graph of M oe optio: describe its adjacecy matrix i full more elegat optio: for ay two cofiguratios C, C decide o-the-fly whether C ca be yielded from C 21 May
25 Class iclusios Corollary: L Í NL Í P Í NP Í PSPACE Í EXP Note: from the space hierarchy theorem we kow L Ì PSPACE Note: from the time hierarchy theorem we kow P Ì EXP Coseuece: at least oe of the iclusios above is proper! Ope uestio: Which oe? Cojecture: all of them! 21 May
26 NONDETERMINISTIC SPACE 21 May
27 Nodetermiistic space It follows from our previous results that NSPACE(f())ÍSPACE(k log +f() ) Questio: Is there a better way to simulate odetermiistic space? Aswer (to be show i the remaiig of this lecture): YES! Prove it through the reachability method Prove first a result about REACHABILITY Recall our first lecture: REACHABILITYÎSPACE() We ca do better (ad pay the price i time) 21 May
28 Savitch s theorem Savitch s theorem. REACHABLITYÎSPACE(log 2 ) Proof (sketch): a middle-first search techiue Let G be a graph with odes, x, y odes of G, i³0 Defie predicate PATH(x,y,i)=true iff there is a path i G from x to y of legth at most 2 i Clearly, we ca solve REACHABILITY if we ca compute PATH(x, y, élog ù) for ay x,yîg Ay o-cyclic path i G has legth at most 21 May
29 Savitch s theorem proof (cotiued) Desig a TM with two work tapes, i additio to the the iput tape, decidig PATH(x,y,i) Iput: the adjacecy matrix of G First work tape: x,y,i, all i biary Throughout the computatio, the first work tape will cotai several triples, of which (x,y,i) is the leftmost oe Secod work tape: at most O(log ) space will be eough 21 May
30 Savitch s theorem proof (cotiued) Decidig PATH(x,y,i) If i=0, the it is eough to check if x=y or if there is a edge from x to y Otherwise, apply the followig recursive algorithm: For all odes z test whether PATH(x,z,i-1) ad PATH(z,y,i-1) Idea here: ay path of legth at most 2 i is made of two paths, each of legth at most 2 i-1 Space-efficiet implemetatio: Aalysis: geerate all z oe after the other reusig the space; for each ew z, add (x,z,i-1) to the first work strig ad start workig o this problem I case of a egative aswer, erase the triplet ad move to the ext z I case of positive aswer, erase (x,z,i-1), write (z,y,i-1) o the first work strig ad start o this problem I case of egative aswer, erase the triplet ad move to the ext z I case of positive aswer, detect by compariso with (x,y,i) to the left that this is the secod call ad retur yes to PATH(x,y,i) The descriptio above clearly implemets the recursive algorithm First work strig: at most élog ù triplets, each of legth at most 3 log Coclusio: O(log 2 ) space 21 May
31 Nodetermiistic space Corollary: NSPACE(f())ÍSPACE(f 2 ()) Proof. To simulate a f()-space bouded odetermiistic TM o a iput of legth, we ru the algorithm i Savitch theorem o the cofiguratio graph of M o iput x Cofiguratio graph has c f() odes, for some costat c Coclusio: O(f 2 ()) is eough for the determiistic space simulatio 21 May
32 PSPACE=NPSPACE Coseuece: PSPACE=NPSPACE! I other words, odetermiism is less powerful with respect to space tha it seems to be with respect to time 21 May
33 Learig objectives of this lecture Defiitios of major complexity classes: P, NP, PSPACE, NPSPACE, EXP, L, NL The kow relatioships betwee the major complexity classes Nodetermiistic space NPSPACE=PSPACE NSPACE(f())=coNSPACE(f()) REACHABILITYÎSPACE(log 2 ), umber of reachable odes ca computed i NSPACE(log ) 21 May
Computability and computational complexity
Computability ad computatioal complexity Lecture 4: Uiversal Turig machies. Udecidability Io Petre Computer Sciece, Åbo Akademi Uiversity Fall 2015 http://users.abo.fi/ipetre/computability/ 21. toukokuu
More informationCS151 Complexity Theory
Time ad Space CS151 Complexity Theory Lecture 2 April 1, 2004 A motivatig questio: Boolea formula with odes evaluate usig O(log ) space? depth-first traversal requires storig itermediate values idea: short-circuit
More informationComputability and computational complexity
Computability ad computatioal complexity Lecture 12: O P vs NP Io Petre Computer Sciece, Åbo Akademi Uiversity Fall 2015 http://users.abo.fi/ipetre/computability/ December 9, 2015 http://users.abo.fi/ipetre/computability/
More informationLecture 9: Hierarchy Theorems
IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture
More informationLecture 2: Uncomputability and the Haling Problem
CSE 200 Computability ad Complexity Wedesday, April 3, 2013 Lecture 2: Ucomputability ad the Halig Problem Istructor: Professor Shachar Lovett Scribe: Dogcai She 1 The Uiversal Turig Machie I the last
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More informationHardness Results for Intersection Non-Emptiness
Hardess Results for Itersectio No-Emptiess Michael Wehar Uiversity at Buffalo mwehar@buffalo.edu Jauary 16, 2015 Abstract We carefully reexamie a costructio of Karakostas, Lipto, ad Viglas (2003) to show
More informationLecture 11: Pseudorandom functions
COM S 6830 Cryptography Oct 1, 2009 Istructor: Rafael Pass 1 Recap Lecture 11: Pseudoradom fuctios Scribe: Stefao Ermo Defiitio 1 (Ge, Ec, Dec) is a sigle message secure ecryptio scheme if for all uppt
More informationPRACTICE FINAL SOLUTIONS
CSE 303 PRACTICE FINAL SOLUTIONS FOR FINAL stud Practice Fial (mius PUMPING LEMMA ad Turig Machies) ad Problems from Q1 Q4, Practice Q1 Q4, ad Midterm ad Practice midterm. I will choose some of these problems
More informationA Turing Machine. The Tape. Languages accepted by Turing Machines. Tape... Read-Write head. Context-Free n Languages. Control Unit.
CS 30 - ecture 9 Turig Machies Fall 2008 eview aguages ad Grammars Alphaets, strigs, laguages egular aguages Determiistic Fiite ad Nodetermiistic Automata Equivalece of NFA ad DFA ad Miimizig a DFA egular
More informationModel of Computation and Runtime Analysis
Model of Computatio ad Rutime Aalysis Model of Computatio Model of Computatio Specifies Set of operatios Cost of operatios (ot ecessarily time) Examples Turig Machie Radom Access Machie (RAM) PRAM Map
More informationCourse 8 Properties of Regular Languages
Course 8 Properties of Regular Laguages The structure ad the cotet of the lecture is based o http://www.eecs.wsu.edu/~aath/cpts37/lectures/idex.htm Topics ) How to prove whether a give laguage is ot regular?
More informationOutline. Complexity Theory. Example. Sketch of a log-space TM for palindromes. Log-space computations. Example VU , SS 2018
Complexity Theory Complexity Theory Outline Complexity Theory VU 181.142, SS 2018 3. Logarithmic Space Reinhard Pichler Institute of Logic and Computation DBAI Group TU Wien 3. Logarithmic Space 3.1 Computational
More informationTest One (Answer Key)
CS395/Ma395 (Sprig 2005) Test Oe Name: Page 1 Test Oe (Aswer Key) CS395/Ma395: Aalysis of Algorithms This is a closed book, closed otes, 70 miute examiatio. It is worth 100 poits. There are twelve (12)
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationProperties of Regular Languages. Reading: Chapter 4
Properties of Regular Laguages Readig: Chapter 4 Topics ) How to prove whether a give laguage is regular or ot? 2) Closure properties of regular laguages 3) Miimizatio of DFAs 2 Some laguages are ot regular
More informationModel of Computation and Runtime Analysis
Model of Computatio ad Rutime Aalysis Model of Computatio Model of Computatio Specifies Set of operatios Cost of operatios (ot ecessarily time) Examples Turig Machie Radom Access Machie (RAM) PRAM Map
More informationAdvanced Course of Algorithm Design and Analysis
Differet complexity measures Advaced Course of Algorithm Desig ad Aalysis Asymptotic complexity Big-Oh otatio Properties of O otatio Aalysis of simple algorithms A algorithm may may have differet executio
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationPolynomial reduction. Outline Lecture. Non deterministic polynomial time. Example 1 : discrete log. Lecture: Polynomial reduction.
Outlie Lecture Part 1 : Asymmetric cryptography, oe way fuctio, complexity Part 2 : arithmetic complexity ad lower bouds : expoetiatio Part 3 : Provable security ad polyomial time reductio : P, NP classes.
More informationIf a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?
2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a
More informationFinite Automata. Reading: Chapter 2
Fiite Automata Readig: Chapter 2 Fiite Automato (FA) Iformally, a state diagram that comprehesively captures all possible states ad trasitios that a machie ca take while respodig to a stream or sequece
More informationHashing and Amortization
Lecture Hashig ad Amortizatio Supplemetal readig i CLRS: Chapter ; Chapter 7 itro; Sectio 7.. Arrays ad Hashig Arrays are very useful. The items i a array are statically addressed, so that isertig, deletig,
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationMA131 - Analysis 1. Workbook 2 Sequences I
MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................
More informationSome special clique problems
Some special clique problems Reate Witer Istitut für Iformatik Marti-Luther-Uiversität Halle-Witteberg Vo-Seckedorff-Platz, D 0620 Halle Saale Germay Abstract: We cosider graphs with cliques of size k
More informationRecursive Algorithm for Generating Partitions of an Integer. 1 Preliminary
Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More information) n. ALG 1.3 Deterministic Selection and Sorting: Problem P size n. Examples: 1st lecture's mult M(n) = 3 M ( È
Algorithms Professor Joh Reif ALG 1.3 Determiistic Selectio ad Sortig: (a) Selectio Algorithms ad Lower Bouds (b) Sortig Algorithms ad Lower Bouds Problem P size fi divide ito subproblems size 1,..., k
More informationDe Morgan s a Laws. De Morgan s laws say that. (φ 1 φ 2 ) = φ 1 φ 2, (φ 1 φ 2 ) = φ 1 φ 2.
De Morgan s a Laws De Morgan s laws say that (φ 1 φ 2 ) = φ 1 φ 2, (φ 1 φ 2 ) = φ 1 φ 2. Here is a proof for the first law: φ 1 φ 2 (φ 1 φ 2 ) φ 1 φ 2 0 0 1 1 0 1 1 1 1 0 1 1 1 1 0 0 a Augustus DeMorgan
More informationContext-free grammars and. Basics of string generation methods
Cotext-free grammars ad laguages Basics of strig geeratio methods What s so great about regular expressios? A regular expressio is a strig represetatio of a regular laguage This allows the storig a whole
More informationLecture 9: Pseudo-random generators against space bounded computation,
Lecture 9: Pseudo-radom geerators agaist space bouded computatio, Primality Testig Topics i Pseudoradomess ad Complexity (Sprig 2018) Rutgers Uiversity Swastik Kopparty Scribes: Harsha Tirumala, Jiyu Zhag
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More informationPolynomial identity testing and global minimum cut
CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem
More informationLecture 2 Clustering Part II
COMS 4995: Usupervised Learig (Summer 8) May 24, 208 Lecture 2 Clusterig Part II Istructor: Nakul Verma Scribes: Jie Li, Yadi Rozov Today, we will be talkig about the hardess results for k-meas. More specifically,
More informationAlgorithm Analysis. Algorithms that are equally correct can vary in their utilization of computational resources
Algorithm Aalysis Algorithms that are equally correct ca vary i their utilizatio of computatioal resources time ad memory a slow program it is likely ot to be used a program that demads too much memory
More informationComplexity Theory 112. Space Complexity
Complexity Theory 112 Space Complexity We ve already seen the definition SPACE(f(n)): the languages accepted by a machine which uses O(f(n)) tape cells on inputs of length n. Counting only work space NSPACE(f(n))
More informationIntro to Learning Theory
Lecture 1, October 18, 2016 Itro to Learig Theory Ruth Urer 1 Machie Learig ad Learig Theory Comig soo 2 Formal Framework 21 Basic otios I our formal model for machie learig, the istaces to be classified
More informationClassification of problem & problem solving strategies. classification of time complexities (linear, logarithmic etc)
Classificatio of problem & problem solvig strategies classificatio of time complexities (liear, arithmic etc) Problem subdivisio Divide ad Coquer strategy. Asymptotic otatios, lower boud ad upper boud:
More information2.4 - Sequences and Series
2.4 - Sequeces ad Series Sequeces A sequece is a ordered list of elemets. Defiitio 1 A sequece is a fuctio from a subset of the set of itegers (usually either the set 80, 1, 2, 3,... < or the set 81, 2,
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationSolutions for the Exam 9 January 2012
Mastermath ad LNMB Course: Discrete Optimizatio Solutios for the Exam 9 Jauary 2012 Utrecht Uiversity, Educatorium, 15:15 18:15 The examiatio lasts 3 hours. Gradig will be doe before Jauary 23, 2012. Studets
More information2 High-level Complexity vs. Concrete Complexity
COMS 6998: Advaced Complexity Sprig 2017 Lecture 1: Course Itroductio ad Boolea Formulas Lecturer: Rocco Servedio Scribes: Jiahui Liu, Kailash Karthik Meiyappa 1 Overview of Topics 1. Boolea formulas (examples,
More informationLecture 1: Basic problems of coding theory
Lecture 1: Basic problems of codig theory Error-Correctig Codes (Sprig 016) Rutgers Uiversity Swastik Kopparty Scribes: Abhishek Bhrushudi & Aditya Potukuchi Admiistrivia was discussed at the begiig of
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationSequences I. Chapter Introduction
Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which
More informationCS / MCS 401 Homework 3 grader solutions
CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of
More informationIntroduction to Automata Theory. Reading: Chapter 1
Itroductio to Automata Theory Readig: Chapter 1 1 What is Automata Theory? Study of abstract computig devices, or machies Automato = a abstract computig device Note: A device eed ot eve be a physical hardware!
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationSums, products and sequences
Sums, products ad sequeces How to write log sums, e.g., 1+2+ (-1)+ cocisely? i=1 Sum otatio ( sum from 1 to ): i 3 = 1 + 2 + + If =3, i=1 i = 1+2+3=6. The ame ii does ot matter. Could use aother letter
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationInternal Information Representation and Processing
Iteral Iformatio Represetatio ad Processig CSCE 16 - Fudametals of Computer Sciece Dr. Awad Khalil Computer Sciece & Egieerig Departmet The America Uiversity i Cairo Decimal Number System We are used to
More informationChapter 9 Computer Design Basics
Logic ad Computer Desig Fudametals Chapter 9 Computer Desig Basics Part 1 Datapaths Overview Part 1 Datapaths Itroductio Datapath Example Arithmetic Logic Uit (ALU) Shifter Datapath Represetatio Cotrol
More informationDisjoint set (Union-Find)
CS124 Lecture 7 Fall 2018 Disjoit set (Uio-Fid) For Kruskal s algorithm for the miimum spaig tree problem, we foud that we eeded a data structure for maitaiig a collectio of disjoit sets. That is, we eed
More informationMA131 - Analysis 1. Workbook 3 Sequences II
MA3 - Aalysis Workbook 3 Sequeces II Autum 2004 Cotets 2.8 Coverget Sequeces........................ 2.9 Algebra of Limits......................... 2 2.0 Further Useful Results........................
More informationHOMEWORK 2 SOLUTIONS
HOMEWORK SOLUTIONS CSE 55 RANDOMIZED AND APPROXIMATION ALGORITHMS 1. Questio 1. a) The larger the value of k is, the smaller the expected umber of days util we get all the coupos we eed. I fact if = k
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More informationLecture 10: Universal coding and prediction
0-704: Iformatio Processig ad Learig Sprig 0 Lecture 0: Uiversal codig ad predictio Lecturer: Aarti Sigh Scribes: Georg M. Goerg Disclaimer: These otes have ot bee subjected to the usual scrutiy reserved
More information6.867 Machine learning, lecture 7 (Jaakkola) 1
6.867 Machie learig, lecture 7 (Jaakkola) 1 Lecture topics: Kerel form of liear regressio Kerels, examples, costructio, properties Liear regressio ad kerels Cosider a slightly simpler model where we omit
More informationChapter 9: Numerical Differentiation
178 Chapter 9: Numerical Differetiatio Numerical Differetiatio Formulatio of equatios for physical problems ofte ivolve derivatives (rate-of-chage quatities, such as velocity ad acceleratio). Numerical
More informationQuantum Computing Lecture 7. Quantum Factoring
Quatum Computig Lecture 7 Quatum Factorig Maris Ozols Quatum factorig A polyomial time quatum algorithm for factorig umbers was published by Peter Shor i 1994. Polyomial time meas that the umber of gates
More informationMachine Learning Theory Tübingen University, WS 2016/2017 Lecture 11
Machie Learig Theory Tübige Uiversity, WS 06/07 Lecture Tolstikhi Ilya Abstract We will itroduce the otio of reproducig kerels ad associated Reproducig Kerel Hilbert Spaces (RKHS). We will cosider couple
More informationLast time, we talked about how Equation (1) can simulate Equation (2). We asserted that Equation (2) can also simulate Equation (1).
6896 Quatum Complexity Theory Sept 23, 2008 Lecturer: Scott Aaroso Lecture 6 Last Time: Quatum Error-Correctio Quatum Query Model Deutsch-Jozsa Algorithm (Computes x y i oe query) Today: Berstei-Vazirii
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationSolutions to Final Exam
Solutios to Fial Exam 1. Three married couples are seated together at the couter at Moty s Blue Plate Dier, occupyig six cosecutive seats. How may arragemets are there with o wife sittig ext to her ow
More informationChapter 10: Power Series
Chapter : Power Series 57 Chapter Overview: Power Series The reaso series are part of a Calculus course is that there are fuctios which caot be itegrated. All power series, though, ca be itegrated because
More informationsatisfiability (sat) Satisfiability unsatisfiability (unsat or sat complement) and validity Any Expression φ Can Be Converted into CNFs and DNFs
Any Expression φ Can Be Converted into CNFs and DNFs φ = x j : This is trivially true. φ = φ 1 and a CNF is sought: Turn φ 1 into a DNF and apply de Morgan s laws to make a CNF for φ. φ = φ 1 and a DNF
More informationCSI 2101 Discrete Structures Winter Homework Assignment #4 (100 points, weight 5%) Due: Thursday, April 5, at 1:00pm (in lecture)
CSI 101 Discrete Structures Witer 01 Prof. Lucia Moura Uiversity of Ottawa Homework Assigmet #4 (100 poits, weight %) Due: Thursday, April, at 1:00pm (i lecture) Program verificatio, Recurrece Relatios
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationCSE 202 Homework 1 Matthias Springer, A Yes, there does always exist a perfect matching without a strong instability.
CSE 0 Homework 1 Matthias Spriger, A9950078 1 Problem 1 Notatio a b meas that a is matched to b. a < b c meas that b likes c more tha a. Equality idicates a tie. Strog istability Yes, there does always
More informationSquare-Congruence Modulo n
Square-Cogruece Modulo Abstract This paper is a ivestigatio of a equivalece relatio o the itegers that was itroduced as a exercise i our Discrete Math class. Part I - Itro Defiitio Two itegers are Square-Cogruet
More informationMATH 262A LECTURE 1: AN INTRODUCTION TO BOOLEAN CIRCUITS AND FORMULAE
MATH 262A LECTURE 1: AN INTRODUCTION TO BOOLEAN CIRCUITS AND FORMULAE SCRIBE: CHRISTIAN WOODS 1. Admiistrivia MATH 262A - Circuit Compleit WF 3:30-5:00, APM B412 Istructor: Dr. Sam Buss, sbuss@math.ucsd.edu
More informationThe Boolean Ring of Intervals
MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationECE 308 Discrete-Time Signals and Systems
ECE 38-5 ECE 38 Discrete-Time Sigals ad Systems Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa ECE 38-5 1 Additio, Multiplicatio, ad Scalig of Sequeces Amplitude Scalig: (A Costat
More informationDesign and Analysis of Algorithms
Desig ad Aalysis of Algorithms Probabilistic aalysis ad Radomized algorithms Referece: CLRS Chapter 5 Topics: Hirig problem Idicatio radom variables Radomized algorithms Huo Hogwei 1 The hirig problem
More informationMedian and IQR The median is the value which divides the ordered data values in half.
STA 666 Fall 2007 Web-based Course Notes 4: Describig Distributios Numerically Numerical summaries for quatitative variables media ad iterquartile rage (IQR) 5-umber summary mea ad stadard deviatio Media
More informationDe Bruijn Sequences for the Binary Strings with Maximum Density
De Bruij Sequeces for the Biary Strigs with Maximum Desity Joe Sawada 1, Brett Steves 2, ad Aaro Williams 2 1 jsawada@uoguelph.ca School of Computer Sciece, Uiversity of Guelph, CANADA 2 brett@math.carleto.ca
More informationApplication to Random Graphs
A Applicatio to Radom Graphs Brachig processes have a umber of iterestig ad importat applicatios. We shall cosider oe of the most famous of them, the Erdős-Réyi radom graph theory. 1 Defiitio A.1. Let
More informationCS161: Algorithm Design and Analysis Handout #10 Stanford University Wednesday, 10 February 2016
CS161: Algorithm Desig ad Aalysis Hadout #10 Staford Uiversity Wedesday, 10 February 2016 Lecture #11: Wedesday, 10 February 2016 Topics: Example midterm problems ad solutios from a log time ago Sprig
More informationDe Bruijn Sequences for the Binary Strings with Maximum Specified Density
De Bruij Sequeces for the Biary Strigs with Maximum Specified Desity Joe Sawada 1, Brett Steves 2, ad Aaro Williams 2 1 jsawada@uoguelph.ca School of Computer Sciece, Uiversity of Guelph, CANADA 2 brett@math.carleto.ca
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationA representation approach to the tower of Hanoi problem
Uiversity of Wollogog Research Olie Departmet of Computig Sciece Workig Paper Series Faculty of Egieerig ad Iformatio Scieces 98 A represetatio approach to the tower of Haoi problem M. C. Er Uiversity
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationOn the Linear Complexity of Feedback Registers
O the Liear Complexity of Feedback Registers A. H. Cha M. Goresky A. Klapper Northeaster Uiversity Abstract I this paper, we study sequeces geerated by arbitrary feedback registers (ot ecessarily feedback
More information2017 PRACTICE MIDTERM SOLUTIONS
CSE303 2017 PRACTICE MIDTERM SOLUTIONS 1 YES/NO questios 1. For a biar relatio R A A, R exists. Justif: defiitio 2. For a biar relatio R A A, R 1 exists. Justif: The set R 1 = {(b, a) : (a, b) R} alwas
More informationAlgebra II Notes Unit Seven: Powers, Roots, and Radicals
Syllabus Objectives: 7. The studets will use properties of ratioal epoets to simplify ad evaluate epressios. 7.8 The studet will solve equatios cotaiig radicals or ratioal epoets. b a, the b is the radical.
More informationOutput Analysis (2, Chapters 10 &11 Law)
B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationCSE 191, Class Note 05: Counting Methods Computer Sci & Eng Dept SUNY Buffalo
Coutig Methods CSE 191, Class Note 05: Coutig Methods Computer Sci & Eg Dept SUNY Buffalo c Xi He (Uiversity at Buffalo CSE 191 Discrete Structures 1 / 48 Need for Coutig The problem of coutig the umber
More informationThe minimum value and the L 1 norm of the Dirichlet kernel
The miimum value ad the L orm of the Dirichlet kerel For each positive iteger, defie the fuctio D (θ + ( cos θ + cos θ + + cos θ e iθ + + e iθ + e iθ + e + e iθ + e iθ + + e iθ which we call the (th Dirichlet
More informationLecture 9: Expanders Part 2, Extractors
Lecture 9: Expaders Part, Extractors Topics i Complexity Theory ad Pseudoradomess Sprig 013 Rutgers Uiversity Swastik Kopparty Scribes: Jaso Perry, Joh Kim I this lecture, we will discuss further the pseudoradomess
More information1 Hash tables. 1.1 Implementation
Lecture 8 Hash Tables, Uiversal Hash Fuctios, Balls ad Bis Scribes: Luke Johsto, Moses Charikar, G. Valiat Date: Oct 18, 2017 Adapted From Virgiia Williams lecture otes 1 Hash tables A hash table is a
More informationµ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion
Poit Estimatio Poit estimatio is the rather simplistic (ad obvious) process of usig the kow value of a sample statistic as a approximatio to the ukow value of a populatio parameter. So we could for example
More informationChapter 9 Computer Design Basics
Logic ad Computer Desig Fudametals Chapter 9 Computer Desig asics Part Datapaths Charles Kime & Thomas Kamiski 008 Pearso Educatio, Ic. (Hyperliks are active i View Show mode) Overview Part Datapaths Itroductio
More informationCHAPTER I: Vector Spaces
CHAPTER I: Vector Spaces Sectio 1: Itroductio ad Examples This first chapter is largely a review of topics you probably saw i your liear algebra course. So why cover it? (1) Not everyoe remembers everythig
More information