On the BDD of a Random Boolean Function
|
|
- Preston Baker
- 6 years ago
- Views:
Transcription
1 On the BDD of a Random Boolean Functon Jean Vullemn Fredérc Béal. October, 00 Abstract The Bnary Decson Dagram BDD, the Bnary Moment Dagram BMD and the Mnmal Determnstc Automaton MDA are three canoncal representatons for Boolean functons. Exact expresson a() and are provded for the average and worst sze BDD over B B, andthey are proved equal to those for the average and worst sze BMD. The expressons a() and for MDA are just slghtly bgger snce a() = lm a() = lm. The sgnfcant dfferences between worst and average szes are shown locatedonlevelsc and c +: the crtcal depth c = r s the nteger part of the root r R of = r + r. The analyss shows that the average to worst sze ratos a() a() and oscllate between = and as. e Successve mnma are found for = n + n and n N, where the gan between average and worst szes s about 8%. Yet, such numbers are far n between: the gan far less than %, wth probablty one over the ntegers. The BDD/BMD/MDA szes of a random functon wth a random number of nputs are all equvalent to those of the worst sze structure a() a(). Introducton The MDA, BDD and BMD are classcal [,, ] strong normal forms for representng Boolean functons, and they are key to modern crcut verfcaton. Ths paper provdes an exact analyss for the worst and average sze of these three structures. The worst case analyss relates to countng arguments whch are well known for crcuts [6]. Our contrbuton les n the exact and asymptotc analyss of the average szes. Ecole Normale Supéreure, 45 rue d Ulm, Pars France. Bryant s publcaton [] on BDDs s reputed to be the most often quoted n Computer Scence. Thus, we expect that the present analyss of the random BDD may have already been publshed, for whole or n part. We wll happly retract/amend/acknowledge our clams, based on all pror-art provded by our knd readers.
2 The example functon s defned by the expresson E = x x + x x, wth x k = x k Graphs of MDA (E), BDD (E) andbmd (E). BDD (E) = {0,,x,x,x x,x x,e}, BMD (E) = {0,,x,x,x x,e}. Fgure : Example MDA, BDD and BMD. Boolean Functons and Canoncal Forms Let B = B B denote the set formed by the β = B = Boolean functons havng N nputs and a sngle output. An abstract Boolean functon f e =[[e]] B s represented by some concrete expresson (a.k.a. crcut net-lst) e E = 0,,x,,x,,,, composed from 0,, nputs x = x x and say, the logcal not, and, or, xor. In turn, each expresson e E denotes a unque functon f e (x) =[[e]] B. The Boolean value f e (b) =[[e x=b ]] B = {0, } s computed by substtutng b = b b B for x = x x n e and by smplfyng, to ether 0 or. Let e E be some Boolean expresson wth nputs, and f e =[[e]] B be the denoted Boolean functon. For > 0 and b B, the partal substtutons e x=b project f e on two prefx functons wth nputs: f e x =b =[[e x=b]] B. A functon f B s thus unquely expressed by Shannon s prefx decomposton: f = x f x= +( x )f x=0. The MDA for f B can be constructed as follows:. Recursvely apply Shannon s prefx decomposton down to the constant functons 0, B 0 ; the result s a complete bnary decson tree of depth, whose leaves are labelled by the bts: f(b) B for b B.. Systematcally share the nodes whch represent equal Boolean functons, at all levels p for p n the decson tree.
3 The resultng MDA data structure s a drected acyclc graph n whch: all paths from the root to a leaf have the same length ; dstnct nodes e e E p at depth p represent dstnct Boolean functons: f e (b) = f e (b) for some b B p. The prefx closure of f B s the set MDA (f) of Boolean functons whch label nodes n the MDA for f. It s recursvely defned by: MDA 0 (f) = {f} for f =0andf =, >0: MDA (f) = {f} MDA (f x=0) MDA (f x=). The partal dervatve of f B wth respect to varable x s defned by =(f x=0 f x=), so that ( =0) (f = f x=0 = f x=). g Condton x p = 0 detects when g s ndependent of nput bt x p. We let B g p = {g B p : x p 0} denote the β p = B p = β p β p functons n B p whch effectvely depend upon nput bt x p. The BDD for f B may be constructed from the MDA, by smplfyng away all nodes g/ B p wth are ndependent of x p. It s recursvely defned by: BDD 0 (f) = {f}, =0: BDD (f) = BDD (f x=0), 0: BDD (f) = {f} BDD (f x=0) BDD (f x=). A dual of Shannon s decomposton s the Reed-Muller decomposton: f = f x=0 x. The BMD for f B s constructed by recursvely applyng Reed-Muller s decomposton and by systematcally sharng all common sub-expressons: BMD 0 (f) = {f}, =0: BMD (f) = BMD (f x=0), 0: BMD (f) = {f} BMD (f x=0) BMD ( ). Worst Case Analyss In defnng the sze of our structures, t s convenent to only count nternal nodes and to exclude the two leaf nodes 0, B 0, as n the tables n Fgure. Defnton Let the worst sze MDA, BDD, BMD over f B be: W mda () = max{ MDA (f) : f B }, W bdd () = max{ BDD (f) : f B }, W bmd () = max{ BMD (f) : f B }.
4 \p Table for w p () and. \p Table for w p () and. Fgure : Worst Sze tables. The analyss for N relates to the unque root r = r() R 0of = r + r. () The crtcal depth c = c() N of s the nteger part c = r of r.. Exact Analyss In the worst case structures of depth N, the nodes above c+ form a complete bnary tree. The nodes beneath c enumerate all the Boolean functons n B c - n a redundant way wthn the MDA, non-redundant wthn the BDD/BMD. Proposton The worst BDD and BMD over f B have equal szes =W bdd () =W bmd () = c + c () and c = c() s the crtcal depth of. The worst MDA has the related sze for β j = 0<p j β p. =W mda () =+β c () Proof: Let w p () count the nodes at depth p n the worst sze MDA, so that = p w p(). There are p nodes at depth p n a complete bnary decson tree of depth. In the worst case, each node represents a dfferent Boolean functon and w p () = p. Ths s true for as long as there are enough functons to choose from, namely p β p. Otherwse, the worst case w p () =β p takes place when each Boolean functon n B p s represented by some node at depth p n MDA. In summary w p () = mn( p,β p ). The root of () s related to that x = L(y) of Lambert s transcendental equaton xe x = y by r = e L(ln() ) - functon L s called LambertW by [5]. 4
5 Fgure : Graphs of β r(), and nw(n) n. n The number of nodes at depth p n the worst BDD or BMD s then w p () = mn( p,β p), snce β p = β p β p counts there the Boolean functons n B p. The sgn of p β p s equal to the sgn of d p = p p and to the sgn of p r snce d p = p r + p r. The followng equvalence ( p <β p ) (d p > 0) (p >r) ( p <β p) s smply derved for p>0. Substtutng n the above expressons gves us: { βp f p r, w p () = { p f p>r, β and w p () = p f p r, p f p>r. Summng up = w p () and = w p () yeld (,).. Asymptotc Analyss Q.E.D. One classcal [6] asymptotc equvalent to s ; yet Fgure ndcates that the rato has no lmt for. Proposton For large enough, the sze of worst MDA s equvalent to that of worst BDD/BMD: = lm. The ratos between worst-sze and (or β r = r for r + r = ) oscllate: = lm nf = lm sup β r β r and lkewse for, β r and lkewse for the above ratos. and ; The average rato s half way between the lmtng values: = lm w(n) and lkewse for the above ratos. β r(n) n 5
6 Proof: Expresson () gves the equvalence =+β c =+O( )=+O( ) β c whose lmt s sharply for, c. Let f = r c be the fractonal part of r = r(). From (), we derve that += c + β c = β r ( f + βc f )=β r g( f, /β c ) where g(t, x) =+t + x t. Functon g decreases from g(0,x)=tog mn = g(t x,x)ast ncreases from 0 to t x ; g then ncreases from g mn to ts maxmum g(,x)=+x as t( goes from ) t m to. The mnmum s reached at x tx log x =andg log log x mn =+O. log x Snce lm x 0 g(,x) = and lm x 0 g(t x,x) =, we conclude that = lm nf g(t n,x n ) and = lm sup g(t n,x n ) x n 0 x n 0 over all real sequences t n [0, ], hence the clamed lmts for β r Snce, the same lmts apply to β r and to as = g(t, x). β r = r = r = ( + O(log() )). Smlarly for E(n) { w(n) β r(n), nw(n), w(n) n β r(n), nw(n) }, all lm n n E(n)have a lmt equal to L. The value L = s obtaned for c, from the fnte sum over ntegers whch have crtcal depth c: + c c(n)=c nw(n) n = + c d c ( + (c + d) c )( + d )=+ + O(/c). The analyss confrms the ntuton from Fgure : n the lmt, the rato tends to the pece-wse-lnear pseudo-perodc functon ρ () = c+, where c c N s the crtcal nteger such that C(c) =c + c <C(c +). Q.E.D. 4 Average Case Analyss Defnton Let the average sze MDA, BDD, BMD over f B be: A mda () = β f B MDA (f), A bdd () = β f B BDD (f), A bmd () = β f B BMD (f). 6
7 q\p 4 oa(q) Table for a p (q) anda(q). q\p 4 a(q) Table for a p (q) anda(q). Fgure 4: Average sze tables. Let A mda p () count the nodes at depth p n A mda () = p Amda p (), and smlarly for BDD and BMD. The average analyss s related to that of hashng [4]. Let N =[n n k ]be some sequence of k ntegers chosen at random n {0 m }. The probablty that an nteger j such that 0 j<mbelongs to N s Pr(j N)= ( m )k = h(,k). (4) m The hash functon to analyze here s h(x, y) = ( x) y. 4. Exact Analyss Proposton The average BDD and BMD have the same sze at depth p: for all p ; here, x p = β p a p () =A bdd p () =A bmd p () =β ph(x p,y p ) (5) and y p = p. The sze of the average MDA s a p () =A mda p () =β p h(x p,y p ). (6) Proof: The probablty that some Boolean functon g B p s g MDA (f) among the p prefxes of a random f B amounts to h(x p,y p ) by (4). The average number of nodes at depth p n MDA (f) s the sum a p () =β p h(x p,y p ) of these probabltes over B p. Summng over B p yelds a p () =β ph(x p,y p )for BDD (f) and as well for BMD (f). Q.E.D. 4. Asymptotc Analyss The lmt (f any) of the hash functon h(x, y) = ( x) y for x 0and y depends on that (f any) of the product p = xy: h(x, y) 0fp 0; h(x, y) fp ; fnally h(x, y) e p f xy p R > 0. 7
8 Lemma Let N have crtcal depth c = r() ; let x p = β p < and y p = p. The number h(x p,y p )= ( x p ) yp = e yp log( xp) equals θx c+ f p<c; e h(x p,y p )= xpyp θx p f p = c; x p y p ( xpyp ( θ 6 )) f p = c +; x p (y p θ) f c +<p. Proof: Throughout ths paper, the reader should see θ n whenever she/he/t reads the letter θ. Thenvsble ndex n s the number of occurrences of θ before ths pont n the text. Each varable θ n represents a real number such that 0 <θ n <, and no relaton s assumed beyond that. The usage of θ s restrcted to a sngle occurrence per real-valued expresson. By (), the sgn of d p = p p s equal to the sgn of r p snce d p = log (x p y p )=(r p)+( r p ). The condton p<c p r d p > p mples that e yp log( xp) = e xpyp/(+θ) = θe xpyp/ = θx c+ ; ndeed, x p y p /= dp > c+ follows from d p c >c+ whch s true for c>. A computer verfcaton confrms the expresson for c. The condton p = c r <p r 0 d p c mples that e yc log( xc) = e xcyc+ θ x c yc = e xcyc ( + θx cy c )=e xcyc + θx c snce θ x cy c = θ dc c < / andx c y c <e xcyc. The condton p>c p>r d p < 0 x p y p < mples that e xpyp+θxp = e xpyp θx p = x p y p ( x py p ( θ 6 )). Condton p>c+ p>r+ d p +< p fnally entals h(x p,y p )=x p y p θ(x p y p ) = x p y p θx p snce x p y p <x p mples that (x p y p ) <x p = x p. Q.E.D. 4. Average versus Worst Szes The tables n Fgures and 4 ndcate that the average and worst cases have almost equal szes, except near the crtcal depth c = c(). Indeed, Lemma mples that the dfferences w p () a p () andw p () a p () are nfntesmals unless p = c or p = c +. In other words, the average sze structure s the same as the worst sze structure at all levels, except sometmes at depths c or c +. 8
9 Fgure 5: Graphs of ρ() = a() and ρ() = a(). The dfference between worst and average sze s maxmzed when the number of nputs s of the crtcal form = n + n,forn N. In ths crtcal case, the rato between worst and average sze quckly approaches e =0.860 for a maxmal gan of 8%. Yet, t follows from (0) that ths rato s greater than for almost all N: on average, the gan s thus far less than %. Proposton 4 For large enough, the average BDD, BMD and MDA all have the same relatve sze: a() = lm a(), (7) The average to worst sze ratos ρ() = a() = lm sup = lm nf e = lm and ρ() = a() are such that: ρ() = lm sup ρ(), (8) ρ() = lm nf ρ(), (9) n ρ(n) = lm n ρ(n). (0) Proof: Let c = c() be the crtal depth, so that = c + d + c and 0 d c. We splt the sum a() = p<c a p()+a c ()+a c+ () p>c+ a p() and replace each term a p () =β p h(x p,y p ) by ts equvalent from Lemma to fnd that a() = δ() θ () where δ() = β c e d + d ( θ ). () 6 θ Snce 0 = lm and = lm, t follows from () that lm sup ρ() = lm nf 9 δ() = lm nf δ(),
10 δ() δ() lm nf ρ() = lm sup = lm sup. The rato δ() canbeexpressedntermsofx = β c δ() e z = k(x, z) = +z + xz 8 and z = d by: θxz ( ). () For x< fxed, functon k(x, z) s un-modal n the nterval z x : t s exponentally decreasng from k(x, ) = e + θx to some nfntesmal k mn = k(x, z x )=O(xlog(x)) n the nterval z z x = O(log(x)). It s (almost lnearly) ncreasng from k mn to k(x, x ) < 8 <k(x, ) n z x z x, hence 0 = lm nf δ() and δ() = lm sup e. By a smlar evaluaton through Lemma, the average BDD/BMD has sze a() = δ() θ where δ() = β ce d + d ( θ 6 )=δ() β c e d. d βc e Equalty δ() = δ() are equal to the above for δ(), and (8,9) are proved. Lmt (7) follows from: a() δ() θ = =+ β c (θ + e d ) a() δ() δ() = δ() θ/β c mples that the lmts as =+O( ). β c The lmt (0) s establshed by provng that 0 = lm c c S(c) for the sum S(c) = δ(c + d +c ) w(c + d + c ) = d c We evaluate S(c) by () to fnd that d c k(x c, d ). 0 <S(c) < d e d + d + x c 8 d c d = x c 8 (β c ) < and the convergence of c S(c) to 0 s exponentally fast. Q.E.D. References [] R. E. Bryant. Graph-based algorthms for boolean functon manpulaton. IEEE Trans. on Computers, 5:8:677 69,
11 [] R. E. Bryant. Symbolc boolean manpulatons wth ordered bnary decson dagrams. ACM Comp. Surveys, 4:9 8, 99. [] R. E. Bryant and Y.-A. Chen. Verfcaton of arthmetc functons wth bnary moment dagrams. Desgn Automaton Conf., pages 55 54, 995. [4] D. E. Knuth. The Art of Computer Programmng, vol., Sortng and Searchng. Addson Wesley, 97. [5] MapleSoft. Maple 9 Gude. Waterloo Maple Inc., 00. [6] I. Wegener. The Complexty of Boolean Functons. John Wley and Sons Ltd, 987.
Problem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationRepresentations of Elementary Functions Using Binary Moment Diagrams
Representatons of Elementary Functons Usng Bnary Moment Dagrams Tsutomu Sasao Department of Computer Scence and Electroncs, Kyushu Insttute of Technology Izua 82-852, Japan Shnobu Nagayama Department of
More informationANSWERS. Problem 1. and the moment generating function (mgf) by. defined for any real t. Use this to show that E( U) var( U)
Econ 413 Exam 13 H ANSWERS Settet er nndelt 9 deloppgaver, A,B,C, som alle anbefales å telle lkt for å gøre det ltt lettere å stå. Svar er gtt . Unfortunately, there s a prntng error n the hnt of
More informationAppendix B. Criterion of Riemann-Stieltjes Integrability
Appendx B. Crteron of Remann-Steltes Integrablty Ths note s complementary to [R, Ch. 6] and [T, Sec. 3.5]. The man result of ths note s Theorem B.3, whch provdes the necessary and suffcent condtons for
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationComplete subgraphs in multipartite graphs
Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G
More informationLearning Theory: Lecture Notes
Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be
More informationLecture 4: Universal Hash Functions/Streaming Cont d
CSE 5: Desgn and Analyss of Algorthms I Sprng 06 Lecture 4: Unversal Hash Functons/Streamng Cont d Lecturer: Shayan Oves Gharan Aprl 6th Scrbe: Jacob Schreber Dsclamer: These notes have not been subjected
More informationStanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011
Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected
More informationSolutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.
Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,
More informationBézier curves. Michael S. Floater. September 10, These notes provide an introduction to Bézier curves. i=0
Bézer curves Mchael S. Floater September 1, 215 These notes provde an ntroducton to Bézer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of
More informationFinding Dense Subgraphs in G(n, 1/2)
Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng
More informationBezier curves. Michael S. Floater. August 25, These notes provide an introduction to Bezier curves. i=0
Bezer curves Mchael S. Floater August 25, 211 These notes provde an ntroducton to Bezer curves. 1 Bernsten polynomals Recall that a real polynomal of a real varable x R, wth degree n, s a functon of the
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationSELECTED PROOFS. DeMorgan s formulas: The first one is clear from Venn diagram, or the following truth table:
SELECTED PROOFS DeMorgan s formulas: The frst one s clear from Venn dagram, or the followng truth table: A B A B A B Ā B Ā B T T T F F F F T F T F F T F F T T F T F F F F F T T T T The second one can be
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationAssortment Optimization under MNL
Assortment Optmzaton under MNL Haotan Song Aprl 30, 2017 1 Introducton The assortment optmzaton problem ams to fnd the revenue-maxmzng assortment of products to offer when the prces of products are fxed.
More informationWeek3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity
Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationAn (almost) unbiased estimator for the S-Gini index
An (almost unbased estmator for the S-Gn ndex Thomas Demuynck February 25, 2009 Abstract Ths note provdes an unbased estmator for the absolute S-Gn and an almost unbased estmator for the relatve S-Gn for
More informationEGR 544 Communication Theory
EGR 544 Communcaton Theory. Informaton Sources Z. Alyazcoglu Electrcal and Computer Engneerng Department Cal Poly Pomona Introducton Informaton Source x n Informaton sources Analog sources Dscrete sources
More informationIntroduction to Algorithms
Introducton to Algorthms 6.046J/8.40J Lecture 7 Prof. Potr Indyk Data Structures Role of data structures: Encapsulate data Support certan operatons (e.g., INSERT, DELETE, SEARCH) Our focus: effcency of
More informationSUCCESSIVE MINIMA AND LATTICE POINTS (AFTER HENK, GILLET AND SOULÉ) M(B) := # ( B Z N)
SUCCESSIVE MINIMA AND LATTICE POINTS (AFTER HENK, GILLET AND SOULÉ) S.BOUCKSOM Abstract. The goal of ths note s to present a remarably smple proof, due to Hen, of a result prevously obtaned by Gllet-Soulé,
More informationNotes on Frequency Estimation in Data Streams
Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to
More informationFoundations of Arithmetic
Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an
More informationDUE: WEDS FEB 21ST 2018
HOMEWORK # 1: FINITE DIFFERENCES IN ONE DIMENSION DUE: WEDS FEB 21ST 2018 1. Theory Beam bendng s a classcal engneerng analyss. The tradtonal soluton technque makes smplfyng assumptons such as a constant
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationIntroduction to Information Theory, Data Compression,
Introducton to Informaton Theory, Data Compresson, Codng Mehd Ibm Brahm, Laura Mnkova Aprl 5, 208 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on the 3th of March 208 for a Data Structures
More informationEEE 241: Linear Systems
EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More informationarxiv: v1 [math.ho] 18 May 2008
Recurrence Formulas for Fbonacc Sums Adlson J. V. Brandão, João L. Martns 2 arxv:0805.2707v [math.ho] 8 May 2008 Abstract. In ths artcle we present a new recurrence formula for a fnte sum nvolvng the Fbonacc
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationLecture 3 January 31, 2017
CS 224: Advanced Algorthms Sprng 207 Prof. Jelan Nelson Lecture 3 January 3, 207 Scrbe: Saketh Rama Overvew In the last lecture we covered Y-fast tres and Fuson Trees. In ths lecture we start our dscusson
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More informationLecture 3. Ax x i a i. i i
18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest
More informationMarginal Effects in Probit Models: Interpretation and Testing. 1. Interpreting Probit Coefficients
ECON 5 -- NOE 15 Margnal Effects n Probt Models: Interpretaton and estng hs note ntroduces you to the two types of margnal effects n probt models: margnal ndex effects, and margnal probablty effects. It
More informationEdge Isoperimetric Inequalities
November 7, 2005 Ross M. Rchardson Edge Isopermetrc Inequaltes 1 Four Questons Recall that n the last lecture we looked at the problem of sopermetrc nequaltes n the hypercube, Q n. Our noton of boundary
More informationMin Cut, Fast Cut, Polynomial Identities
Randomzed Algorthms, Summer 016 Mn Cut, Fast Cut, Polynomal Identtes Instructor: Thomas Kesselhem and Kurt Mehlhorn 1 Mn Cuts n Graphs Lecture (5 pages) Throughout ths secton, G = (V, E) s a mult-graph.
More informationModule 2. Random Processes. Version 2 ECE IIT, Kharagpur
Module Random Processes Lesson 6 Functons of Random Varables After readng ths lesson, ou wll learn about cdf of functon of a random varable. Formula for determnng the pdf of a random varable. Let, X be
More informationOpen Systems: Chemical Potential and Partial Molar Quantities Chemical Potential
Open Systems: Chemcal Potental and Partal Molar Quanttes Chemcal Potental For closed systems, we have derved the followng relatonshps: du = TdS pdv dh = TdS + Vdp da = SdT pdv dg = VdP SdT For open systems,
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationOn the correction of the h-index for career length
1 On the correcton of the h-ndex for career length by L. Egghe Unverstet Hasselt (UHasselt), Campus Depenbeek, Agoralaan, B-3590 Depenbeek, Belgum 1 and Unverstet Antwerpen (UA), IBW, Stadscampus, Venusstraat
More informationCalculation of time complexity (3%)
Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add
More informationLecture 10 Support Vector Machines II
Lecture 10 Support Vector Machnes II 22 February 2016 Taylor B. Arnold Yale Statstcs STAT 365/665 1/28 Notes: Problem 3 s posted and due ths upcomng Frday There was an early bug n the fake-test data; fxed
More informationGeorgia Tech PHYS 6124 Mathematical Methods of Physics I
Georga Tech PHYS 624 Mathematcal Methods of Physcs I Instructor: Predrag Cvtanovć Fall semester 202 Homework Set #7 due October 30 202 == show all your work for maxmum credt == put labels ttle legends
More informationDecision Diagrams Derivatives
Decson Dagrams Dervatves Logc Crcuts Desgn Semnars WS2010/2011, Lecture 3 Ing. Petr Fšer, Ph.D. Department of Dgtal Desgn Faculty of Informaton Technology Czech Techncal Unversty n Prague Evropský socální
More information1 Matrix representations of canonical matrices
1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:
More informationUncertainty in measurements of power and energy on power networks
Uncertanty n measurements of power and energy on power networks E. Manov, N. Kolev Department of Measurement and Instrumentaton, Techncal Unversty Sofa, bul. Klment Ohrdsk No8, bl., 000 Sofa, Bulgara Tel./fax:
More informationExpected Value and Variance
MATH 38 Expected Value and Varance Dr. Neal, WKU We now shall dscuss how to fnd the average and standard devaton of a random varable X. Expected Value Defnton. The expected value (or average value, or
More information= z 20 z n. (k 20) + 4 z k = 4
Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5
More informationWeek 5: Neural Networks
Week 5: Neural Networks Instructor: Sergey Levne Neural Networks Summary In the prevous lecture, we saw how we can construct neural networks by extendng logstc regresson. Neural networks consst of multple
More informationErrors for Linear Systems
Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch
More informationAPPROXIMATE PRICES OF BASKET AND ASIAN OPTIONS DUPONT OLIVIER. Premia 14
APPROXIMAE PRICES OF BASKE AND ASIAN OPIONS DUPON OLIVIER Prema 14 Contents Introducton 1 1. Framewor 1 1.1. Baset optons 1.. Asan optons. Computng the prce 3. Lower bound 3.1. Closed formula for the prce
More informationFINITELY-GENERATED MODULES OVER A PRINCIPAL IDEAL DOMAIN
FINITELY-GENERTED MODULES OVER PRINCIPL IDEL DOMIN EMMNUEL KOWLSKI Throughout ths note, s a prncpal deal doman. We recall the classfcaton theorem: Theorem 1. Let M be a fntely-generated -module. (1) There
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationFirst day August 1, Problems and Solutions
FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve
More informationLinear Approximation with Regularization and Moving Least Squares
Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...
More informationCSCE 790S Background Results
CSCE 790S Background Results Stephen A. Fenner September 8, 011 Abstract These results are background to the course CSCE 790S/CSCE 790B, Quantum Computaton and Informaton (Sprng 007 and Fall 011). Each
More informationMath 426: Probability MWF 1pm, Gasson 310 Homework 4 Selected Solutions
Exercses from Ross, 3, : Math 26: Probablty MWF pm, Gasson 30 Homework Selected Solutons 3, p. 05 Problems 76, 86 3, p. 06 Theoretcal exercses 3, 6, p. 63 Problems 5, 0, 20, p. 69 Theoretcal exercses 2,
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationLOGIT ANALYSIS. A.K. VASISHT Indian Agricultural Statistics Research Institute, Library Avenue, New Delhi
LOGIT ANALYSIS A.K. VASISHT Indan Agrcultural Statstcs Research Insttute, Lbrary Avenue, New Delh-0 02 amtvassht@asr.res.n. Introducton In dummy regresson varable models, t s assumed mplctly that the dependent
More informationCurvature and isoperimetric inequality
urvature and sopermetrc nequalty Julà ufí, Agustí Reventós, arlos J Rodríguez Abstract We prove an nequalty nvolvng the length of a plane curve and the ntegral of ts radus of curvature, that has as a consequence
More informationDigital Signal Processing
Dgtal Sgnal Processng Dscrete-tme System Analyss Manar Mohasen Offce: F8 Emal: manar.subh@ut.ac.r School of IT Engneerng Revew of Precedent Class Contnuous Sgnal The value of the sgnal s avalable over
More informationPolynomials. 1 More properties of polynomials
Polynomals 1 More propertes of polynomals Recall that, for R a commutatve rng wth unty (as wth all rngs n ths course unless otherwse noted), we defne R[x] to be the set of expressons n =0 a x, where a
More informationHow Strong Are Weak Patents? Joseph Farrell and Carl Shapiro. Supplementary Material Licensing Probabilistic Patents to Cournot Oligopolists *
How Strong Are Weak Patents? Joseph Farrell and Carl Shapro Supplementary Materal Lcensng Probablstc Patents to Cournot Olgopolsts * September 007 We study here the specal case n whch downstream competton
More information18.1 Introduction and Recap
CS787: Advanced Algorthms Scrbe: Pryananda Shenoy and Shjn Kong Lecturer: Shuch Chawla Topc: Streamng Algorthmscontnued) Date: 0/26/2007 We contnue talng about streamng algorthms n ths lecture, ncludng
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationEconomics 130. Lecture 4 Simple Linear Regression Continued
Economcs 130 Lecture 4 Contnued Readngs for Week 4 Text, Chapter and 3. We contnue wth addressng our second ssue + add n how we evaluate these relatonshps: Where do we get data to do ths analyss? How do
More informationj) = 1 (note sigma notation) ii. Continuous random variable (e.g. Normal distribution) 1. density function: f ( x) 0 and f ( x) dx = 1
Random varables Measure of central tendences and varablty (means and varances) Jont densty functons and ndependence Measures of assocaton (covarance and correlaton) Interestng result Condtonal dstrbutons
More informationMaximum Likelihood Estimation of Binary Dependent Variables Models: Probit and Logit. 1. General Formulation of Binary Dependent Variables Models
ECO 452 -- OE 4: Probt and Logt Models ECO 452 -- OE 4 Maxmum Lkelhood Estmaton of Bnary Dependent Varables Models: Probt and Logt hs note demonstrates how to formulate bnary dependent varables models
More informationManaging Capacity Through Reward Programs. on-line companion page. Byung-Do Kim Seoul National University College of Business Administration
Managng Caacty Through eward Programs on-lne comanon age Byung-Do Km Seoul Natonal Unversty College of Busness Admnstraton Mengze Sh Unversty of Toronto otman School of Management Toronto ON M5S E6 Canada
More informationStanford University CS254: Computational Complexity Notes 7 Luca Trevisan January 29, Notes for Lecture 7
Stanford Unversty CS54: Computatonal Complexty Notes 7 Luca Trevsan January 9, 014 Notes for Lecture 7 1 Approxmate Countng wt an N oracle We complete te proof of te followng result: Teorem 1 For every
More informationTAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES
TAIL BOUNDS FOR SUMS OF GEOMETRIC AND EXPONENTIAL VARIABLES SVANTE JANSON Abstract. We gve explct bounds for the tal probabltes for sums of ndependent geometrc or exponental varables, possbly wth dfferent
More informationLecture 2: Gram-Schmidt Vectors and the LLL Algorithm
NYU, Fall 2016 Lattces Mn Course Lecture 2: Gram-Schmdt Vectors and the LLL Algorthm Lecturer: Noah Stephens-Davdowtz 2.1 The Shortest Vector Problem In our last lecture, we consdered short solutons to
More informationAffine and Riemannian Connections
Affne and Remannan Connectons Semnar Remannan Geometry Summer Term 2015 Prof Dr Anna Wenhard and Dr Gye-Seon Lee Jakob Ullmann Notaton: X(M) space of smooth vector felds on M D(M) space of smooth functons
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationIntroduction to information theory and data compression
Introducton to nformaton theory and data compresson Adel Magra, Emma Gouné, Irène Woo March 8, 207 Ths s the augmented transcrpt of a lecture gven by Luc Devroye on March 9th 207 for a Data Structures
More informationREAL ANALYSIS I HOMEWORK 1
REAL ANALYSIS I HOMEWORK CİHAN BAHRAN The questons are from Tao s text. Exercse 0.0.. If (x α ) α A s a collecton of numbers x α [0, + ] such that x α
More informationDifferentiating Gaussian Processes
Dfferentatng Gaussan Processes Andrew McHutchon Aprl 17, 013 1 Frst Order Dervatve of the Posteror Mean The posteror mean of a GP s gven by, f = x, X KX, X 1 y x, X α 1 Only the x, X term depends on the
More informationProf. Dr. I. Nasser Phys 630, T Aug-15 One_dimensional_Ising_Model
EXACT OE-DIMESIOAL ISIG MODEL The one-dmensonal Isng model conssts of a chan of spns, each spn nteractng only wth ts two nearest neghbors. The smple Isng problem n one dmenson can be solved drectly n several
More informationExercises. 18 Algorithms
18 Algorthms Exercses 0.1. In each of the followng stuatons, ndcate whether f = O(g), or f = Ω(g), or both (n whch case f = Θ(g)). f(n) g(n) (a) n 100 n 200 (b) n 1/2 n 2/3 (c) 100n + log n n + (log n)
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationA Note on Bound for Jensen-Shannon Divergence by Jeffreys
OPEN ACCESS Conference Proceedngs Paper Entropy www.scforum.net/conference/ecea- A Note on Bound for Jensen-Shannon Dvergence by Jeffreys Takuya Yamano, * Department of Mathematcs and Physcs, Faculty of
More informationfind (x): given element x, return the canonical element of the set containing x;
COS 43 Sprng, 009 Dsjont Set Unon Problem: Mantan a collecton of dsjont sets. Two operatons: fnd the set contanng a gven element; unte two sets nto one (destructvely). Approach: Canoncal element method:
More informationLinear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.
Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +
More informationA 2D Bounded Linear Program (H,c) 2D Linear Programming
A 2D Bounded Lnear Program (H,c) h 3 v h 8 h 5 c h 4 h h 6 h 7 h 2 2D Lnear Programmng C s a polygonal regon, the ntersecton of n halfplanes. (H, c) s nfeasble, as C s empty. Feasble regon C s unbounded
More informationMaximizing the number of nonnegative subsets
Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationa b a In case b 0, a being divisible by b is the same as to say that
Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :
More informationMath 217 Fall 2013 Homework 2 Solutions
Math 17 Fall 013 Homework Solutons Due Thursday Sept. 6, 013 5pm Ths homework conssts of 6 problems of 5 ponts each. The total s 30. You need to fully justfy your answer prove that your functon ndeed has
More informationMarkov chains. Definition of a CTMC: [2, page 381] is a continuous time, discrete value random process such that for an infinitesimal
Markov chans M. Veeraraghavan; March 17, 2004 [Tp: Study the MC, QT, and Lttle s law lectures together: CTMC (MC lecture), M/M/1 queue (QT lecture), Lttle s law lecture (when dervng the mean response tme
More informationU.C. Berkeley CS278: Computational Complexity Professor Luca Trevisan 2/21/2008. Notes for Lecture 8
U.C. Berkeley CS278: Computatonal Complexty Handout N8 Professor Luca Trevsan 2/21/2008 Notes for Lecture 8 1 Undrected Connectvty In the undrected s t connectvty problem (abbrevated ST-UCONN) we are gven
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More informationGlobal Sensitivity. Tuesday 20 th February, 2018
Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values
More informationIntroduction to Vapor/Liquid Equilibrium, part 2. Raoult s Law:
CE304, Sprng 2004 Lecture 4 Introducton to Vapor/Lqud Equlbrum, part 2 Raoult s Law: The smplest model that allows us do VLE calculatons s obtaned when we assume that the vapor phase s an deal gas, and
More informationModelli Clamfim Equazione del Calore Lezione ottobre 2014
CLAMFIM Bologna Modell 1 @ Clamfm Equazone del Calore Lezone 17 15 ottobre 2014 professor Danele Rtell danele.rtell@unbo.t 1/24? Convoluton The convoluton of two functons g(t) and f(t) s the functon (g
More informationHomework Assignment 3 Due in class, Thursday October 15
Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.
More informationC/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1
C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned
More informationThe Order Relation and Trace Inequalities for. Hermitian Operators
Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence
More informationSL n (F ) Equals its Own Derived Group
Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu
More information