Fundamenta Informaticae XXI (2001) IOS Press
|
|
- Darrell Abner Hodge
- 5 years ago
- Views:
Transcription
1 Fudameta Iformaticae XXI (2001) IOS Press Approximate Sortig Joachim Giese Max Plak Istitute for Computer Sciece Saarbrücke, Germay Eva Schuberth Istitute for Theoretical Computer Sciece ETH Zurich, Switzerlad Miloš Stojaković Departmet of Mathematics ad Iformatics Uiversity of Novi Sad, Serbia Abstract. We show that ay compariso based, radomized algorithm to approximate ay give rakig of items withi expected Spearma s footrule distace 2 /ν() eeds at least (mi{log ν(), log } 6) comparisos i the worst case. This boud is tight up to a costat factor sice there exists a determiistic algorithm that shows that 6 log ν() comparisos are always sufficiet. Keywords: algorithms, sortig, rakig, Spearma s footrule metric, Kedall s tau metric 1. Itroductio Our motivatio to study approximate sortig comes from the followig market research applicatio. We wat to fid out how a respodet raks a set of products. I order to simulate real buyig situatios the respodet is preseted pairs of products out of which he has to choose the oe that he prefers, i.e., he has to perform paired comparisos. The respodet s rakig is the recostructed from the sequece of his choices. That is, a procedure that presets a sequece of product pairs to the respodet i order to obtai the product rakig is othig else tha a compariso based sortig algorithm. We ca measure the efficiecy of such a algorithm i terms of the umber of (pairwise) comparisos eeded i order to Partly supported by the Swiss Natioal Sciece Foudatio uder the grat Robust Algorithms for Cojoit Aalysis. Correspodig author. Partly supported by the Miistry of Sciece ad Evirometal Protectio, Republic of Serbia, ad Provicial Secretariat for Sciece, Provice of Vojvodia.
2 1002 J. Giese, E. Schubert, M. Stojaković / Approximate Sortig obtai the rakig. The iformatio theoretic lower boud o sortig [6] states that there is o procedure that ca determie a rakig by posig less tha log e paired compariso questios to the respodet, i.e., i geeral Ω( log ) comparisos are eeded. Eve for oly moderately large that easily is too much sice respodets ofte get wor out after a certai umber of questios (idepedet of ) ad do ot aswer further questios faithfully aymore. O the other had, it might be eough to kow the respodet s rakig approximately. I this paper we pursue the questio of how may comparisos are ecessary ad sufficiet i order to approximately rak products. I order to give sese to the term approximately we eed some metric to compare rakigs. Assume that we are dealig with products. Sice a rakig is a permutatio of the products, this meas that we eed a metric o the permutatio group S. Not all of the metrics, e.g., the Hammig distace that couts how may products are raked differetly, are meaigful for our applicatio. For example, if i the respodet s rakig oe exchages every secod product with its predecessor, the the resultig rakig has maximal Hammig distace to the origial oe. Nevertheless, this rakig still tells a lot about the respodet s prefereces. I marketig applicatios Kedall s tau metric [3] is frequetly used sice it seems to capture the ituitive otio of closeess of two rakigs ad also arises aturally i the statistics of certai radom rakigs [7]. Our results. Istead of workig with Kedall s metric we use Spearma s footrule metric [3] which essetially is equivalet to Kedall s metric, sice the two metrics are withi a costat factor of each other [3]. The maximal distace betwee ay two rakigs of products i Spearma s footrule metric is less tha 2. We show that i order to obtai a rakig at distace 2 /ν() to the actual rakig, with ay strategy, a respodet has i geeral to perform at least (mi{log ν(), log } 6) comparisos i the worst case, i.e., there is a istace for which ay compariso based algorithm performs at least (mi{log ν(), log } 6) comparisos. Moreover, if we allow the strategy to be radomized such that the obtaied rakig is at expected distace 2 /ν() to the respodet s rakig, we ca show that the same boud o the miimum umber of comparisos holds. O the other had, there is a determiistic strategy (algorithm) that shows that 6 log ν() comparisos are always sufficiet. Related work. At first glace our work seems related to work doe o pre-sortig. I pre-sortig the goal is to pre-process the data such that fewer comparisos are eeded afterwards to sort them. For example i [4] it is show that with O(1) pre-processig oe ca save Θ() comparisos for Quicksort o average. Pre-processig ca be see as computig a partial order o the data that helps for a give sortig algorithm to reduce the umber of ecessary comparisos. The structural quatity that determies how may comparisos are eeded i geeral to fid the rakig give a partial order is the umber of liear extesios of the partial order, i.e., the umber of rakigs cosistet with the partial order. Actually, the logarithm of this umber is a lower boud o the umber of comparisos eeded i geeral [5]. Here we study aother structural measure, amely, the maximum diameter i the Spearma s metric of the set of rakigs cosistet with a partial order. Our results show that with o( log ) comparisos oe ca make this diameter asymptotically smaller tha the diameter of the set of all rakigs. That is ot the case for the umber of liear extesios which stays i Θ(2 log ). Notatio. The logarithm log i this paper is assumed to be biary, ad by id we deote the idetity (icreasig) permutatio of [].
3 J. Giese, E. Schubert, M. Stojaković / Approximate Sortig Lower Boud Here, we show that i order to obtai a rakig reasoably close to the actual rakig, a respodet has to perform a substatial umber of comparisos i the worst case. More precisely, for ay (possibly radomized) compariso based algorithm that outputs a rakig at distace 2 /ν() to the actual rakig, there is a istace for which it performs (i expectatio) at least (mi{log ν(), log } 6) comparisos. The distace of a approximate rakig from the actual rakig will be measured i Spearma s footrule metric, D(π, id) = D(π) = i π(i), where π(i) is the rak of the elemet of rak i i the approximate rakig, i.e., i π(i) measures deviatio of the approximated rak from the actual rak. Note that for ay rakig the distace i the Spearma s footrule metric to id is at most 2 2. For r > 0, by B D (id, r) we deote the ball cetered at id of radius r with respect to the Spearma s footrule metric, so B D (id, r) := {π S : D(π, id) r}. Next we estimate the umber of permutatios i a ball of radius r. i=1 Lemma 2.1. ( ) 2e(r + ) B D (id, r). Proof: Every permutatio π S is uiquely determied by the sequece {π(i) i} i. Hece, for ay sequece of o-egative itegers d i, i = 1,...,, there are at most 2 permutatios π S satisfyig π(i) i = d i. If D(π, id) r, the i π(i) i r. Sice the umber of sequeces of o-egative itegers whose sum is at most r is ( ) r+, we have ( r + B D (id, r) ) 2 ( ) 2e(r + ). Usig the previous lemma ad Yao s Priciple [8], we give a lower boud for the worst case ruig time of ay (radomized) compariso based approximate sortig algorithm. Theorem 2.1. Let A be a radomized approximate sortig algorithm based o comparisos, let ν = ν() be a fuctio, ad let r = r() = 2 ν(). If for every iput permutatio π S the expected Spearma s footrule distace of the output to id is at most r, the the algorithm performs at least (mi{log ν, log } 6) comparisos i expectatio i the worst case.
4 1004 J. Giese, E. Schubert, M. Stojaković / Approximate Sortig Proof: Let k be the smallest iteger such that A performs at most k comparisos for every iput. For a cotradictio, let us assume that k < (mi{log ν, log } 6). First, we are goig to prove Sice log ν 6 > k/, we have ν 2 6 1! > 2k 2 ( ) 2e(2r + ). (1) > 2 k/ ad sice ν = 2 r O the other had, from log 6 > k/ we get 2 6 Puttig (2) ad (3) together, we obtai e we get 2e 2r > 2k/ 2e. (2) > 2 k/ implyig 2e > 2k/ 2e. (3) 2e(2r + ) > 2k/. Hece 1 ( ) ( ) 2! > 2 k 2e(2r + ), e provig (1). We deote by R the source of radom bits for A. Oe ca see R as the set of all ifiite 0-1 sequeces, ad the the algorithm is give a radom elemet of R alog with the iput. For a permutatio π S ad α R, we deote by A(π, α) the output of the algorithm with iput π ad radom bits α. We fix α R ad ru the algorithm for every permutatio π S. Note that with the radom bits fixed the algorithm is determiistic. For every compariso made by the algorithm there are two possible outcomes. We partitio the set of all permutatios S ito classes such that all permutatios i a class have the same outcomes of all the comparisos the algorithm makes. Sice there is o radomess ivolved, we have that for every class C there exists a σ S such that for every π C we have A(π, α) = σ π, where is the multiplicatio i the permutatio group S. I particular, this implies that the set {A(π, α) : π C} is of size C. O the other had, sice the algorithm i this settig is determiistic ad the umber of comparisos of the algorithm is at most k, there ca be at most 2 k classes. Hece, each permutatio i S is the ) output for at most 2 k differet iput permutatios. From, Lemma 2.1 we have B D (id, 2r) ad this together with (1) implies that at least ( 2e(2r+)! 2 k ( 2e(2r + ) ) > 1 2! iput permutatios have output at distace to id more tha 2r. Now, if both the radom bits α R ad the iput permutatio π S are chose at radom, the expected distace of the output A(π, α) to id is more tha r. Therefore, there exists a permutatio π 0 such that for a radomly chose α R the expected distace d D (A(π 0, α), id) is more tha r. Cotradictio.
5 J. Giese, E. Schubert, M. Stojaković / Approximate Sortig Algorithm The idea of ASORT algorithm is to partitio the products ito a sorted sequece of equal-sized bis such that the elemets i each bi have smaller rak tha ay elemet i subsequet bis. It is based o a well-studied variatio of Quicksort algorithm i which the media is chose to be the pivot elemet (see, e.g., [2]). The output of the algorithm is the sequece of bis. Note that we do ot specify the orderig of elemets iside each bi, but cosider ay rakig cosistet with the orderig of the bis. As it turs out, ay such rakig approximates the actual rakig of the elemets i terms of Spearma s footrule metric well. The algorithm ASORT iteratively performs a umber of media searches, each time placig the media ito the right positio i the rakig. Here the media of elemets is defied to be the elemet of rak ASORT (B : set, m : it) 1 B 01 := B // B ij is the j th bi i the i th roud 2 for i := 1 to m do 3 for j := 1 to 2 i 1 do 4 compute the media of B (i 1)j 5 B i(2j 1) := {x B (i 1)j x media} 6 B i(2j) := {x B (i 1)j x > media} 7 ed for 8 ed for 9 retur B m1,..., B m(2 m ) To compute the media i lie 4 ad to partitio the elemets i lie 5 ad 6 we use the determiistic algorithm by Blum et al. [1] that performs at most 5.73 comparisos i order to compute the media of elemets ad to partitio them accordig to the media. We ote that i puttig the algorithm ASORT to practice oe may wat to use a differet media algorithm, like, e.g., RANDOMIZEDSELECT [2]. I each roud, the sum of the cardialities of all the bis is. Hece, oe roud takes at most 5.73 comparisos. As the algorithm rus for m rouds overall, the total umber of comparisos is less tha 6m. Theorem 3.1. Let r = 2 ν(). Ay rakig cosistet with the orderig of the bis computed by ASORT i log ν() rouds, i.e., with less tha 6 log ν() comparisos, has a Spearma s footrule distace of at most r to the actual rakig of the elemets from B. Proof: The distace of the actual rakig of the elemets i B to ay rakig cosistet with the orderig of the bis computed by ASORT i m rouds ca be bouded by ( ) 2 m m. Pluggig i m = log ν(), we see that the distace is at most r. As we saw earlier, the algorithm performs at most 6m = 6 log ν() comparisos.
6 1006 J. Giese, E. Schubert, M. Stojaković / Approximate Sortig Ackowledgmets. We are idebted to Jiří Matoušek for commets ad isights that made this paper possible. Refereces [1] Blum, M., Floyd, R. W., Pratt, V., Rivest, R. L., Tarja, R. E.: Liear time bouds for media computatios, STOC 72: Proceedigs of the fourth aual ACM symposium o Theory of computig, ACM Press, [2] Corme, T. H., Leiserso, C. E., Rivest, R. L.: Itroductio to Algorithms, 2d ed., The MIT Press/McGraw- Hill, [3] Diacois, P., Graham, R. L.: Spearma s Footrule as a Measure of Disarray, Joural of the Royal Statistical Society, 39(2), 1977, [4] Hwag, H. K., Yag, B. Y., Yeh, Y. N.: Presortig algorithms: a average-case poit of view, Theoretical Computer Sciece, 242(1-2), 2000, [5] Kah, J., Kim, J. H.: Etropy ad Sortig, STOC 92: Proceedigs of the twety-fourth aual ACM symposium o Theory of computig, ACM Press, [6] Kuth, D. E.: The Art of Computer Programmig, vol. 3, Addiso Wesley, [7] Mallows, C. L.: No-ull rakig models, Biometrica, 44, 1957, [8] Yao, A. C.: Probabilistic computatios: Towards a uified measure of complexity, FOCS 77: Proceedigs of 18th Aual Symposium o Foudatios of Computer Sciece, IEEE Computer Society Press, 1977.
Approximate Sorting. Institute for Theoretical Computer Science, ETH Zürich, CH-8092 Zürich
Approximate Sortig Joachim Giese, Eva Schuberth, ad Miloš Stojaković Istitute for Theoretical Computer Sciece, ETH Zürich, CH-809 Zürich Abstract. We show that ay radomized algorithm to approximate ay
More informationRecursive Algorithm for Generating Partitions of an Integer. 1 Preliminary
Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the
More informationPairs of disjoint q-element subsets far from each other
Pairs of disjoit q-elemet subsets far from each other Hikoe Eomoto Departmet of Mathematics, Keio Uiversity 3-14-1 Hiyoshi, Kohoku-Ku, Yokohama, 223 Japa, eomoto@math.keio.ac.jp Gyula O.H. Katoa Alfréd
More informationLecture 14: Randomized Computation (cont.)
CSE 200 Computability ad Complexity Wedesday, May 15, 2013 Lecture 14: Radomized Computatio (cot.) Istructor: Professor Shachar Lovett Scribe: Dogcai She 1 Radmized Algorithm Examples 1.1 The k-th Elemet
More informationMA131 - Analysis 1. Workbook 2 Sequences I
MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................
More informationSequences I. Chapter Introduction
Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which
More informationProblem Set 2 Solutions
CS271 Radomess & Computatio, Sprig 2018 Problem Set 2 Solutios Poit totals are i the margi; the maximum total umber of poits was 52. 1. Probabilistic method for domiatig sets 6pts Pick a radom subset S
More informationCS / MCS 401 Homework 3 grader solutions
CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationTHE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS
THE ASYMPTOTIC COMPLEXITY OF MATRIX REDUCTION OVER FINITE FIELDS DEMETRES CHRISTOFIDES Abstract. Cosider a ivertible matrix over some field. The Gauss-Jorda elimiatio reduces this matrix to the idetity
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationCS 332: Algorithms. Linear-Time Sorting. Order statistics. Slide credit: David Luebke (Virginia)
1 CS 332: Algorithms Liear-Time Sortig. Order statistics. Slide credit: David Luebke (Virgiia) Quicksort: Partitio I Words Partitio(A, p, r): Select a elemet to act as the pivot (which?) Grow two regios,
More informationAnalysis of Algorithms. Introduction. Contents
Itroductio The focus of this module is mathematical aspects of algorithms. Our mai focus is aalysis of algorithms, which meas evaluatig efficiecy of algorithms by aalytical ad mathematical methods. We
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More information6.895 Essential Coding Theory October 20, Lecture 11. This lecture is focused in comparisons of the following properties/parameters of a code:
6.895 Essetial Codig Theory October 0, 004 Lecture 11 Lecturer: Madhu Suda Scribe: Aastasios Sidiropoulos 1 Overview This lecture is focused i comparisos of the followig properties/parameters of a code:
More informationFeedback in Iterative Algorithms
Feedback i Iterative Algorithms Charles Byre (Charles Byre@uml.edu), Departmet of Mathematical Scieces, Uiversity of Massachusetts Lowell, Lowell, MA 01854 October 17, 2005 Abstract Whe the oegative system
More informationMath 2784 (or 2794W) University of Connecticut
ORDERS OF GROWTH PAT SMITH Math 2784 (or 2794W) Uiversity of Coecticut Date: Mar. 2, 22. ORDERS OF GROWTH. Itroductio Gaiig a ituitive feel for the relative growth of fuctios is importat if you really
More informationMetric Space Properties
Metric Space Properties Math 40 Fial Project Preseted by: Michael Brow, Alex Cordova, ad Alyssa Sachez We have already poited out ad will recogize throughout this book the importace of compact sets. All
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationCS 270 Algorithms. Oliver Kullmann. Growth of Functions. Divide-and- Conquer Min-Max- Problem. Tutorial. Reading from CLRS for week 2
Geeral remarks Week 2 1 Divide ad First we cosider a importat tool for the aalysis of algorithms: Big-Oh. The we itroduce a importat algorithmic paradigm:. We coclude by presetig ad aalysig two examples.
More informationMath 155 (Lecture 3)
Math 55 (Lecture 3) September 8, I this lecture, we ll cosider the aswer to oe of the most basic coutig problems i combiatorics Questio How may ways are there to choose a -elemet subset of the set {,,,
More informationIntroduction to Machine Learning DIS10
CS 189 Fall 017 Itroductio to Machie Learig DIS10 1 Fu with Lagrage Multipliers (a) Miimize the fuctio such that f (x,y) = x + y x + y = 3. Solutio: The Lagragia is: L(x,y,λ) = x + y + λ(x + y 3) Takig
More informationUC Berkeley CS 170: Efficient Algorithms and Intractable Problems Handout 17 Lecturer: David Wagner April 3, Notes 17 for CS 170
UC Berkeley CS 170: Efficiet Algorithms ad Itractable Problems Hadout 17 Lecturer: David Wager April 3, 2003 Notes 17 for CS 170 1 The Lempel-Ziv algorithm There is a sese i which the Huffma codig was
More informationSpectral Partitioning in the Planted Partition Model
Spectral Graph Theory Lecture 21 Spectral Partitioig i the Plated Partitio Model Daiel A. Spielma November 11, 2009 21.1 Itroductio I this lecture, we will perform a crude aalysis of the performace of
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationRecursive Algorithms. Recurrences. Recursive Algorithms Analysis
Recursive Algorithms Recurreces Computer Sciece & Egieerig 35: Discrete Mathematics Christopher M Bourke cbourke@cseuledu A recursive algorithm is oe i which objects are defied i terms of other objects
More informationDiscrete Mathematics for CS Spring 2005 Clancy/Wagner Notes 21. Some Important Distributions
CS 70 Discrete Mathematics for CS Sprig 2005 Clacy/Wager Notes 21 Some Importat Distributios Questio: A biased coi with Heads probability p is tossed repeatedly util the first Head appears. What is the
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationLecture 4 February 16, 2016
MIT 6.854/18.415: Advaced Algorithms Sprig 16 Prof. Akur Moitra Lecture 4 February 16, 16 Scribe: Be Eysebach, Devi Neal 1 Last Time Cosistet Hashig - hash fuctios that evolve well Radom Trees - routig
More informationRandom Walks on Discrete and Continuous Circles. by Jeffrey S. Rosenthal School of Mathematics, University of Minnesota, Minneapolis, MN, U.S.A.
Radom Walks o Discrete ad Cotiuous Circles by Jeffrey S. Rosethal School of Mathematics, Uiversity of Miesota, Mieapolis, MN, U.S.A. 55455 (Appeared i Joural of Applied Probability 30 (1993), 780 789.)
More informationA Note on Matrix Rigidity
A Note o Matrix Rigidity Joel Friedma Departmet of Computer Sciece Priceto Uiversity Priceto, NJ 08544 Jue 25, 1990 Revised October 25, 1991 Abstract I this paper we give a explicit costructio of matrices
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationAnalysis of Algorithms -Quicksort-
Aalysis of Algorithms -- Adreas Ermedahl MRTC (Mälardales Real-Time Research Ceter) adreas.ermedahl@mdh.se Autum 2004 Proposed by C.A.R. Hoare i 962 Worst- case ruig time: Θ( 2 ) Expected ruig time: Θ(
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More information1 Hash tables. 1.1 Implementation
Lecture 8 Hash Tables, Uiversal Hash Fuctios, Balls ad Bis Scribes: Luke Johsto, Moses Charikar, G. Valiat Date: Oct 18, 2017 Adapted From Virgiia Williams lecture otes 1 Hash tables A hash table is a
More informationRandomized Algorithms I, Spring 2018, Department of Computer Science, University of Helsinki Homework 1: Solutions (Discussed January 25, 2018)
Radomized Algorithms I, Sprig 08, Departmet of Computer Sciece, Uiversity of Helsiki Homework : Solutios Discussed Jauary 5, 08). Exercise.: Cosider the followig balls-ad-bi game. We start with oe black
More informationn outcome is (+1,+1, 1,..., 1). Let the r.v. X denote our position (relative to our starting point 0) after n moves. Thus X = X 1 + X 2 + +X n,
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 9 Variace Questio: At each time step, I flip a fair coi. If it comes up Heads, I walk oe step to the right; if it comes up Tails, I walk oe
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationSection 11.8: Power Series
Sectio 11.8: Power Series 1. Power Series I this sectio, we cosider geeralizig the cocept of a series. Recall that a series is a ifiite sum of umbers a. We ca talk about whether or ot it coverges ad i
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationDesign and Analysis of Algorithms
Desig ad Aalysis of Algorithms Probabilistic aalysis ad Radomized algorithms Referece: CLRS Chapter 5 Topics: Hirig problem Idicatio radom variables Radomized algorithms Huo Hogwei 1 The hirig problem
More informationPH 425 Quantum Measurement and Spin Winter SPINS Lab 1
PH 425 Quatum Measuremet ad Spi Witer 23 SPIS Lab Measure the spi projectio S z alog the z-axis This is the experimet that is ready to go whe you start the program, as show below Each atom is measured
More informationPolynomial identity testing and global minimum cut
CHAPTER 6 Polyomial idetity testig ad global miimum cut I this lecture we will cosider two further problems that ca be solved usig probabilistic algorithms. I the first half, we will cosider the problem
More informationLast time, we talked about how Equation (1) can simulate Equation (2). We asserted that Equation (2) can also simulate Equation (1).
6896 Quatum Complexity Theory Sept 23, 2008 Lecturer: Scott Aaroso Lecture 6 Last Time: Quatum Error-Correctio Quatum Query Model Deutsch-Jozsa Algorithm (Computes x y i oe query) Today: Berstei-Vazirii
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationMathematical Induction
Mathematical Iductio Itroductio Mathematical iductio, or just iductio, is a proof techique. Suppose that for every atural umber, P() is a statemet. We wish to show that all statemets P() are true. I a
More informationLecture 4: April 10, 2013
TTIC/CMSC 1150 Mathematical Toolkit Sprig 01 Madhur Tulsiai Lecture 4: April 10, 01 Scribe: Haris Agelidakis 1 Chebyshev s Iequality recap I the previous lecture, we used Chebyshev s iequality to get a
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationThe random version of Dvoretzky s theorem in l n
The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationMath 216A Notes, Week 5
Math 6A Notes, Week 5 Scribe: Ayastassia Sebolt Disclaimer: These otes are ot early as polished (ad quite possibly ot early as correct) as a published paper. Please use them at your ow risk.. Thresholds
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 2 Clustering Part II
COMS 4995: Usupervised Learig (Summer 8) May 24, 208 Lecture 2 Clusterig Part II Istructor: Nakul Verma Scribes: Jie Li, Yadi Rozov Today, we will be talkig about the hardess results for k-meas. More specifically,
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationOn Algorithm for the Minimum Spanning Trees Problem with Diameter Bounded Below
O Algorithm for the Miimum Spaig Trees Problem with Diameter Bouded Below Edward Kh. Gimadi 1,2, Alexey M. Istomi 1, ad Ekateria Yu. Shi 2 1 Sobolev Istitute of Mathematics, 4 Acad. Koptyug aveue, 630090
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationHarmonic Number Identities Via Euler s Transform
1 2 3 47 6 23 11 Joural of Iteger Sequeces, Vol. 12 2009), Article 09.6.1 Harmoic Number Idetities Via Euler s Trasform Khristo N. Boyadzhiev Departmet of Mathematics Ohio Norther Uiversity Ada, Ohio 45810
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More information4.3 Growth Rates of Solutions to Recurrences
4.3. GROWTH RATES OF SOLUTIONS TO RECURRENCES 81 4.3 Growth Rates of Solutios to Recurreces 4.3.1 Divide ad Coquer Algorithms Oe of the most basic ad powerful algorithmic techiques is divide ad coquer.
More informationAnalysis of the Expected Number of Bit Comparisons Required by Quickselect
Aalysis of the Expected Number of Bit Comparisos Required by Quickselect James Alle Fill Takéhiko Nakama Abstract Whe algorithms for sortig ad searchig are applied to keys that are represeted as bit strigs,
More information6.883: Online Methods in Machine Learning Alexander Rakhlin
6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationLecture 10 October Minimaxity and least favorable prior sequences
STATS 300A: Theory of Statistics Fall 205 Lecture 0 October 22 Lecturer: Lester Mackey Scribe: Brya He, Rahul Makhijai Warig: These otes may cotai factual ad/or typographic errors. 0. Miimaxity ad least
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationRandom Sampling with Removal
Radom Samplig with Removal Berd Gärter 1, Johaes Legler 1, ad May Szedlák 1 1 Departmet of Computer Sciece Istitute of Theoretical Computer Sciece, ETH Zürich CH-8092 Zürich, Switzerlad {gaerter, johaes.legler,
More informationSorting Algorithms. Algorithms Kyuseok Shim SoEECS, SNU.
Sortig Algorithms Algorithms Kyuseo Shim SoEECS, SNU. Desigig Algorithms Icremetal approaches Divide-ad-Coquer approaches Dyamic programmig approaches Greedy approaches Radomized approaches You are ot
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationAlgorithm Analysis. Chapter 3
Data Structures Dr Ahmed Rafat Abas Computer Sciece Dept, Faculty of Computer ad Iformatio, Zagazig Uiversity arabas@zu.edu.eg http://www.arsaliem.faculty.zu.edu.eg/ Algorithm Aalysis Chapter 3 3. Itroductio
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationCSE 202 Homework 1 Matthias Springer, A Yes, there does always exist a perfect matching without a strong instability.
CSE 0 Homework 1 Matthias Spriger, A9950078 1 Problem 1 Notatio a b meas that a is matched to b. a < b c meas that b likes c more tha a. Equality idicates a tie. Strog istability Yes, there does always
More informationLecture 1: Basic problems of coding theory
Lecture 1: Basic problems of codig theory Error-Correctig Codes (Sprig 016) Rutgers Uiversity Swastik Kopparty Scribes: Abhishek Bhrushudi & Aditya Potukuchi Admiistrivia was discussed at the begiig of
More informationIP Reference guide for integer programming formulations.
IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more
More informationSelf-normalized deviation inequalities with application to t-statistic
Self-ormalized deviatio iequalities with applicatio to t-statistic Xiequa Fa Ceter for Applied Mathematics, Tiaji Uiversity, 30007 Tiaji, Chia Abstract Let ξ i i 1 be a sequece of idepedet ad symmetric
More informationModel of Computation and Runtime Analysis
Model of Computatio ad Rutime Aalysis Model of Computatio Model of Computatio Specifies Set of operatios Cost of operatios (ot ecessarily time) Examples Turig Machie Radom Access Machie (RAM) PRAM Map
More informationThe inverse eigenvalue problem for symmetric doubly stochastic matrices
Liear Algebra ad its Applicatios 379 (004) 77 83 www.elsevier.com/locate/laa The iverse eigevalue problem for symmetric doubly stochastic matrices Suk-Geu Hwag a,,, Sug-Soo Pyo b, a Departmet of Mathematics
More informationA Note on the Kolmogorov-Feller Weak Law of Large Numbers
Joural of Mathematical Research with Applicatios Mar., 015, Vol. 35, No., pp. 3 8 DOI:10.3770/j.iss:095-651.015.0.013 Http://jmre.dlut.edu.c A Note o the Kolmogorov-Feller Weak Law of Large Numbers Yachu
More informationSequences, Mathematical Induction, and Recursion. CSE 2353 Discrete Computational Structures Spring 2018
CSE 353 Discrete Computatioal Structures Sprig 08 Sequeces, Mathematical Iductio, ad Recursio (Chapter 5, Epp) Note: some course slides adopted from publisher-provided material Overview May mathematical
More informationLecture 14: Graph Entropy
15-859: Iformatio Theory ad Applicatios i TCS Sprig 2013 Lecture 14: Graph Etropy March 19, 2013 Lecturer: Mahdi Cheraghchi Scribe: Euiwoog Lee 1 Recap Bergma s boud o the permaet Shearer s Lemma Number
More informationDiscrete Mathematics and Probability Theory Spring 2012 Alistair Sinclair Note 15
CS 70 Discrete Mathematics ad Probability Theory Sprig 2012 Alistair Siclair Note 15 Some Importat Distributios The first importat distributio we leared about i the last Lecture Note is the biomial distributio
More informationHOMEWORK 2 SOLUTIONS
HOMEWORK SOLUTIONS CSE 55 RANDOMIZED AND APPROXIMATION ALGORITHMS 1. Questio 1. a) The larger the value of k is, the smaller the expected umber of days util we get all the coupos we eed. I fact if = k
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationComplex Stochastic Boolean Systems: Generating and Counting the Binary n-tuples Intrinsically Less or Greater than u
Proceedigs of the World Cogress o Egieerig ad Computer Sciece 29 Vol I WCECS 29, October 2-22, 29, Sa Fracisco, USA Complex Stochastic Boolea Systems: Geeratig ad Coutig the Biary -Tuples Itrisically Less
More informationSequences. Notation. Convergence of a Sequence
Sequeces A sequece is essetially just a list. Defiitio (Sequece of Real Numbers). A sequece of real umbers is a fuctio Z (, ) R for some real umber. Do t let the descriptio of the domai cofuse you; it
More informationAverage-Case Analysis of QuickSort
Average-Case Aalysis of QuickSort Comp 363 Fall Semester 003 October 3, 003 The purpose of this documet is to itroduce the idea of usig recurrece relatios to do average-case aalysis. The average-case ruig
More informationDivide & Conquer. Divide-and-conquer algorithms. Conventional product of polynomials. Conventional product of polynomials.
Divide-ad-coquer algorithms Divide & Coquer Strategy: Divide the problem ito smaller subproblems of the same type of problem Solve the subproblems recursively Combie the aswers to solve the origial problem
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationQuantum Computing Lecture 7. Quantum Factoring
Quatum Computig Lecture 7 Quatum Factorig Maris Ozols Quatum factorig A polyomial time quatum algorithm for factorig umbers was published by Peter Shor i 1994. Polyomial time meas that the umber of gates
More informationDiscrete Mathematics and Probability Theory Summer 2014 James Cook Note 15
CS 70 Discrete Mathematics ad Probability Theory Summer 2014 James Cook Note 15 Some Importat Distributios I this ote we will itroduce three importat probability distributios that are widely used to model
More informationBeurling Integers: Part 2
Beurlig Itegers: Part 2 Isomorphisms Devi Platt July 11, 2015 1 Prime Factorizatio Sequeces I the last article we itroduced the Beurlig geeralized itegers, which ca be represeted as a sequece of real umbers
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More information