Uncertain Compression & Graph Coloring. Madhu Sudan Harvard
|
|
- Wesley Copeland
- 5 years ago
- Views:
Transcription
1 Uncertain Compression & Graph Coloring Madhu Sudan Harvard Based on joint works with: (1) Adam Kalai (MSR), Sanjeev Khanna (U.Penn), Brendan Juba (WUStL) (2) Elad Haramaty (Harvard) (3) Badih Ghazi (MIT), Elad Haramaty (Harvard), Pritish Kamath (MIT) August 4, 2017 IITB: Uncertain Compression & Coloring 1 of 21
2 Classical Compression The Shannon setting Alice gets mm [NN] chosen from distribution PP Sends compression yy = EE PP mm 0,1 to Bob. Bob computes mm = DD PP yy (Alice and Bob both know PP). Require mm = mm (whp). Goal: min EE PP,DD PP EExp mm PP EE PP mm Further (technical) requirement: Prefix-free mm mm, EE PP (mm) not prefix of EE PP mm Ensures we can encode sequence of messages August 4, 2017 IITB: Uncertain Compression & Coloring 2 of 21
3 Shannon+Huffman [Kraft]: Prefix-free compression: Encoding message ii with length l ii possible iff 2 l ii 1 [Shannon]: Assign length log 2 ii PP(ii) with message ii Expected length EE ii log PP(ii) HH PP + 1 Motivates HH PP EE ii log PP ii [Huffman]: Constructive, explicit, optimal August 4, 2017 IITB: Uncertain Compression & Coloring 3 of 21
4 Compression Fundamental problem: gzip, Lempel-Ziv Leads to entropy: Fundamental measure. Fundamental role in learning Learning Compression A goal in language too! Language evolves Words introduced, others fade. Why? Intuitive explanation: distributions on messages evolve! August 4, 2017 IITB: Uncertain Compression & Coloring 4 of 21
5 Compression as proxy for language Understanding languages: Complex, not all forces well understood. Others hard to analyze. Compression: Clean mathematical problem. Faces similar issues as language. (Sometimes) easier to analyze. But to model issues associated with natural language, need to incorporate uncertainty! People don t have same priors on messages. Need to estimate/bound each others priors Can compression work with uncertain priors? August 4, 2017 IITB: Uncertain Compression & Coloring 5 of 21
6 Outline Part 1: Motivation Part 2: Formalism Part 3: Randomized Solution Part 4: Issues with Randomized Solution Part 5: Deterministic Issues. August 4, 2017 IITB: Uncertain Compression & Coloring 6 of 21
7 Uncertain Compression Design encoding/decoding schemes (EE/DD) so that Sender has distribution PP on [NN] Receiver has distribution QQ on [NN] Sender gets mm [NN] Sends EE(PP, mm) to receiver. Receiver receives yy = EE(PP, mm) Decodes to mm = DD(QQ, yy) Want: mm = mm (provided PP, QQ close), While minimizing EExp mm PP EE(PP, mm) August 4, 2017 IITB: Uncertain Compression & Coloring 7 of 21
8 Proximity of Distributions Many alternatives. Our goal: Find anything non-trivial that allows compression. Eventual choice: Δ PP, QQ = max mm [NN] max log PP mm QQ mm, log QQ mm PP mm Symmetrized worst-case KL divergence KL Divergence: DD PP, QQ = EExp mm PP (So trivially: DD PP, QQ Δ(PP, QQ) ) August 4, 2017 IITB: Uncertain Compression & Coloring 8 of 21 log PP mm QQ(mm) Question: Can message be compressed to within ff HH PP, Δ? Or is it ff(hh PP, Δ, NN)?
9 Solution 1: Assuming Randomness Assume sender+receiver share rr Unif( 0,1 tt ) In particular rr independent of PP, QQ, mm Compression scheme: Let rr = (rr 1,, rr NN ) with rr ii 0,1 tt NN Sender sends prefix zz of rr mm ; long enough so that mm s.t. zz is a prefix of rr mm : PP mm EExp rr rr mm log PP mm + 2Δ < PP mm 4 Δ Thm: Expected compression length HH PP + 2Δ Deterministic? August 4, 2017 IITB: Uncertain Compression & Coloring 9 of 21
10 Combinatorial Reinterpretation Can fix PP(mm) (adds log PP mm to compression). Define: AA 0 = mm, AA 1 = mm PP mm 4 Δ PP(mm), AA ii = mm PP mm 4 ii Δ PP(mm) Similarly BB 1 = mm QQ mm 2 Δ PP(mm), BB ii = mm QQ mm 2 2ii 1 Δ PP(mm) Nesting: AA 0 BB 1 AA 1 BB 2 AA 2 Sizes: AA ii KK CC 2ii, BB ii KK CC 2ii 1 for KK = 1 ; CC = 2Δ PP mm Question: Given KK, CC can mm be distinguished from mm BB 1 with OO KK,CC 1 bits? August 4, 2017 IITB: Uncertain Compression & Coloring 10 of 21
11 Compression Coloring Weak Uncertainty graph WW NN,KK,CC Vertices = AA 0, AA 1,, AA l : Nested, AA 0 = 1, AA ii KK CC 2ii, AA l = [NN] Edges: AA 0, AA 1,, AA l AA 0, AA 1,, AA l AA 0 AA 0 AA ii AA ii+1 ; AA ii AA ii+1 Claim: Compression length = ff HH PP, Δ iff KK, CC, NN χχ WW NN,KK,CC = OO KK,CC (1) χχ WW NN,KK,CC = open! Did we reduce to a harder problem? iff August 4, 2017 IITB: Uncertain Compression & Coloring 11 of 21
12 Bounding chromatic number Upper bounds: Easy! Just give the coloring! not always. E.g., Shift Graph SS nn,kk Vertices: nn kk Sequences of kk distinct elements of [nn] Edges ii 1, ii 2,, ii kk (ii 2, ii 3,, ii kk, ii kk+1 ) Thm: [Cole-Vishkin, Linial] If kk log nn, then χχ SS nn,kk = 3. More generally χχ SS nn,kk = max 3, log kk+θ 1 nn Lower bounds much more challenging! August 4, 2017 IITB: Uncertain Compression & Coloring 12 of 21
13 Some Results [Haramaty+S.] χχ WW NN,KK,CC exp KK. CC l log l NN l [Golowich] χχ WW NN,KK,CC exp exp KK CC l log 2l NN l [Trivial] χχ WW NN,KK,CC KK CC 2 l For further understanding define WW NN,KK,CC Like WW NN,KK,CC but without size restriction on AA l. (so wlog AA l = [NN]) l Upper bounds hold even for WW NN,KK,CC l [Haramaty+S]: χχ WW NN,KK,CC = log Ω l NN Need slow growth for long to get NN-independence August 4, 2017 IITB: Uncertain Compression & Coloring 13 of 21
14 Upper Bounds 1 [Cole-Vishkin/Linial] Coloring Shift graph: Given coloring χχ: SS nn,kk 1 0,1 cc, construct coloring χχ : SS nn,kk cc {0,1} as follows: To color ii 1,, ii kk : Let (aa 1,, aa cc ) = χχ(ii 1,, ii kk 1 ) And bb 1,, bb cc = χχ ii 2,, ii kk Let jj be least index s.t. aa jj bb jj (exists!) χχ ii 1,, ii kk = jj, aa jj Valid? χχ ii 2,, ii kk+1 = jj, bb jj or jj, xx for jj jj! August 4, 2017 IITB: Uncertain Compression & Coloring 14 of 21
15 Generalizing: Homorphisms GG homomorphic to HH (GG HH) if φφ: VV GG VV HH s. t. uu GG vv φφ uu HH φφ vv Homorphisms? GG is kk-colorable GG KK kk GG HH and HH LL GG LL Homomorphisms and Shift/Uncertainty graphs. SS nn,kk SS nn,kk 1 SS nn,kk 2 NN WW NN,KK,CC = WW NN,KK,CC WW NN 1 l NN,KK,CC WW NN,KK,CC l Suffices to upper bound χχ WW NN,KK,CC August 4, 2017 IITB: Uncertain Compression & Coloring 15 of 21
16 Degree of Homomorphisms Say φφ: GG HH dd φφ uu φφ vv vv GG uu dd φφ max {dd φφ uu } uu Lemma [HS]: χχ GG OO(dd φφ 2 log χχ HH ) Lemma [Golowich]: χχ GG OO(exp dd φφ log log χχ HH ) l For φφ: WW NN,KK,CC l 1 WW NN,KK,CC dd φφ = exp KK CC l GG HH August 4, 2017 IITB: Uncertain Compression & Coloring 16 of 21
17 Proof: (of χχ GG OO(dd φφ 2 log χχ HH ) ) Denote χχ HH = cc; dd φφ = dd Let MM = OO dd log cc ; tt = 2dd Claim: h 1,, h MM, h ii : cc tt s.t. ii SS cc, SS dd, jj ss. tt. h jj ii h jj SS Proof: Pick h jj s at random Claim: tt MM coloring of GG Proof: Given χχ: HH [cc], let χχ : GG MM [tt] be: Let SS uu = χχ φφ vv ) vv GG uu ; ii = χχ φφ uu Let jj be s.t. h jj ii h jj SS χχ uu = jj, h jj ii August 4, 2017 IITB: Uncertain Compression & Coloring 17 of 21
18 l Lower bounds: χχ WW NN,KK,CC log (2l) NN l Claim: SS NN,2l subgraph of WW NN,KK,CC Proof: by inspection Linial s Proof: χχ SS NN,l log χχ SS NN,l 1 χχ SS NN,l 1 2 χχ SS NN,l (lower bounds by upper bounds!) Given χχ: SS NN,l [cc], let χχ : SS NN,l 1 2 [cc] be: χχ ii 1,, ii l 1 = χχ ii 1, ii l ii l Claim: χχ ii 1,, ii l 1 χχ ii 2,, ii l Proof: χχ ii 1,, ii l χχ ii 1,, ii l 1 But χχ ii 1,, ii l χχ ii 2,, ii l+1 χχ ii 1,, ii l χχ ii 2,, ii l August 4, 2017 IITB: Uncertain Compression & Coloring 18 of 21
19 Conclusion Compression (Uncertain) Graph Coloring Unfortunately latter is hard! (not only to solve optimally, but also to understand analytically) Intriguing Special Case: WW NN AA ii 3ii (linear, not exponential, growth) Is χχ WW NN = OO 1? Fundamental underlying question: Is entropy the correct measure of natural compressibility August 4, 2017 IITB: Uncertain Compression & Coloring 19 of 21
20 Thank You August 4, 2017 IITB: Uncertain Compression & Coloring 20 of 21
General Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) December 4, 2017 IAS:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) May 1, 018 G.Tech:
More informationProperty Testing and Affine Invariance Part I Madhu Sudan Harvard University
Property Testing and Affine Invariance Part I Madhu Sudan Harvard University December 29-30, 2015 IITB: Property Testing & Affine Invariance 1 of 31 Goals of these talks Part I Introduce Property Testing
More informationLocality in Coding Theory
Locality in Coding Theory Madhu Sudan Harvard April 9, 2016 Skoltech: Locality in Coding Theory 1 Error-Correcting Codes (Linear) Code CC FF qq nn. FF qq : Finite field with qq elements. nn block length
More informationLow-Degree Polynomials
Low-Degree Polynomials Madhu Sudan Harvard University October 7, 2016 Avi60!! Low-degree Polynomials 1 of 27 October 7, 2016 Avi60!! Low-degree Polynomials 2 of 27 Happy Birthday, Avi!! October 7, 2016
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 8, 018 Berkeley:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 5, 018 Stanford:
More informationTerms of Use. Copyright Embark on the Journey
Terms of Use All rights reserved. No part of this packet may be reproduced, stored in a retrieval system, or transmitted in any form by any means - electronic, mechanical, photo-copies, recording, or otherwise
More informationWorksheets for GCSE Mathematics. Quadratics. mr-mathematics.com Maths Resources for Teachers. Algebra
Worksheets for GCSE Mathematics Quadratics mr-mathematics.com Maths Resources for Teachers Algebra Quadratics Worksheets Contents Differentiated Independent Learning Worksheets Solving x + bx + c by factorisation
More informationAlgebraic Codes and Invariance
Algebraic Codes and Invariance Madhu Sudan Harvard April 30, 2016 AAD3: Algebraic Codes and Invariance 1 of 29 Disclaimer Very little new work in this talk! Mainly: Ex- Coding theorist s perspective on
More informationLocal Decoding and Testing Polynomials over Grids
Local Decoding and Testing Polynomials over Grids Madhu Sudan Harvard University Joint work with Srikanth Srinivasan (IIT Bombay) January 11, 2018 ITCS: Polynomials over Grids 1 of 12 DeMillo-Lipton-Schwarz-Zippel
More informationCS Lecture 8 & 9. Lagrange Multipliers & Varitional Bounds
CS 6347 Lecture 8 & 9 Lagrange Multipliers & Varitional Bounds General Optimization subject to: min ff 0() R nn ff ii 0, h ii = 0, ii = 1,, mm ii = 1,, pp 2 General Optimization subject to: min ff 0()
More information1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. Ans: x = 4, x = 3, x = 2,
1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. x = 4, x = 3, x = 2, x = 1, x = 1, x = 2, x = 3, x = 4, x = 5 b. Find the value(s)
More informationSupport Vector Machines. CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington
Support Vector Machines CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 A Linearly Separable Problem Consider the binary classification
More informationClassical RSA algorithm
Classical RSA algorithm We need to discuss some mathematics (number theory) first Modulo-NN arithmetic (modular arithmetic, clock arithmetic) 9 (mod 7) 4 3 5 (mod 7) congruent (I will also use = instead
More informationA A A A A A A A A A A A. a a a a a a a a a a a a a a a. Apples taste amazingly good.
Victorian Handwriting Sheet Aa A A A A A A A A A A A A Aa Aa Aa Aa Aa Aa Aa a a a a a a a a a a a a a a a Apples taste amazingly good. Apples taste amazingly good. Now make up a sentence of your own using
More informationBig Bang Planck Era. This theory: cosmological model of the universe that is best supported by several aspects of scientific evidence and observation
Big Bang Planck Era Source: http://www.crystalinks.com/bigbang.html Source: http://www.odec.ca/index.htm This theory: cosmological model of the universe that is best supported by several aspects of scientific
More informationPatterns of soiling in the Old Library Trinity College Dublin. Allyson Smith, Robbie Goodhue, Susie Bioletti
Patterns of soiling in the Old Library Trinity College Dublin Allyson Smith, Robbie Goodhue, Susie Bioletti Trinity College aerial view Old Library E N S W Old Library main (south) elevation Gallery Fagel
More informationWorksheets for GCSE Mathematics. Algebraic Expressions. Mr Black 's Maths Resources for Teachers GCSE 1-9. Algebra
Worksheets for GCSE Mathematics Algebraic Expressions Mr Black 's Maths Resources for Teachers GCSE 1-9 Algebra Algebraic Expressions Worksheets Contents Differentiated Independent Learning Worksheets
More informationTwo Decades of Property Testing Madhu Sudan Harvard
Two Decades of Property Testing Madhu Sudan Harvard April 8, 2016 Two Decades of Property Testing 1 of 29 Kepler s Big Data Problem Tycho Brahe (~1550-1600): Wished to measure planetary motion accurately.
More information" = Y(#,$) % R(r) = 1 4& % " = Y(#,$) % R(r) = Recitation Problems: Week 4. a. 5 B, b. 6. , Ne Mg + 15 P 2+ c. 23 V,
Recitation Problems: Week 4 1. Which of the following combinations of quantum numbers are allowed for an electron in a one-electron atom: n l m l m s 2 2 1! 3 1 0 -! 5 1 2! 4-1 0! 3 2 1 0 2 0 0 -! 7 2-2!
More informationLecture 6. Notes on Linear Algebra. Perceptron
Lecture 6. Notes on Linear Algebra. Perceptron COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Notes on linear algebra Vectors
More informationTSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points)
IB PHYSICS Name: Period: Date: DEVIL PHYSICS BADDEST CLASS ON CAMPUS TSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points) 1. IB Assessment Statements for Topic 8.5.
More informationInferring the origin of an epidemic with a dynamic message-passing algorithm
Inferring the origin of an epidemic with a dynamic message-passing algorithm HARSH GUPTA (Based on the original work done by Andrey Y. Lokhov, Marc Mézard, Hiroki Ohta, and Lenka Zdeborová) Paper Andrey
More informationLecture 11. Kernel Methods
Lecture 11. Kernel Methods COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture The kernel trick Efficient computation of a dot product
More informationSecondary 3H Unit = 1 = 7. Lesson 3.3 Worksheet. Simplify: Lesson 3.6 Worksheet
Secondary H Unit Lesson Worksheet Simplify: mm + 2 mm 2 4 mm+6 mm + 2 mm 2 mm 20 mm+4 5 2 9+20 2 0+25 4 +2 2 + 2 8 2 6 5. 2 yy 2 + yy 6. +2 + 5 2 2 2 0 Lesson 6 Worksheet List all asymptotes, holes and
More informationCommunication with Imperfect Shared Randomness
Communication with Imperfect Shared Randomness (Joint work with Venkatesan Guruswami (CMU), Raghu Meka (?) and Madhu Sudan (MSR)) Who? Clément Canonne (Columbia University) When? November 19, 2014 1 /
More informationLecture No. 1 Introduction to Method of Weighted Residuals. Solve the differential equation L (u) = p(x) in V where L is a differential operator
Lecture No. 1 Introduction to Method of Weighted Residuals Solve the differential equation L (u) = p(x) in V where L is a differential operator with boundary conditions S(u) = g(x) on Γ where S is a differential
More informationWork, Energy, and Power. Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition
Work, Energy, and Power Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 With the knowledge we got so far, we can handle the situation on the left but not the one on the right.
More informationKENNESAW STATE UNIVERSITY ATHLETICS VISUAL IDENTITY
KENNESAW STATE UNIVERSITY ATHLETICS VISUAL IDENTITY KENNESAW STATE DEPARTMENT OF ATHLETICS VISUAL IDENTITY GENERAL University Athletics Brand History...3 Referencing the Institution...3 Referencing the
More informationGrover s algorithm. We want to find aa. Search in an unordered database. QC oracle (as usual) Usual trick
Grover s algorithm Search in an unordered database Example: phonebook, need to find a person from a phone number Actually, something else, like hard (e.g., NP-complete) problem 0, xx aa Black box ff xx
More informationControl of Mobile Robots
Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and
More information10.4 The Cross Product
Math 172 Chapter 10B notes Page 1 of 9 10.4 The Cross Product The cross product, or vector product, is defined in 3 dimensions only. Let aa = aa 1, aa 2, aa 3 bb = bb 1, bb 2, bb 3 then aa bb = aa 2 bb
More informationModule 7 (Lecture 27) RETAINING WALLS
Module 7 (Lecture 27) RETAINING WALLS Topics 1.1 RETAINING WALLS WITH METALLIC STRIP REINFORCEMENT Calculation of Active Horizontal and vertical Pressure Tie Force Factor of Safety Against Tie Failure
More informationSECTION 7: STEADY-STATE ERROR. ESE 499 Feedback Control Systems
SECTION 7: STEADY-STATE ERROR ESE 499 Feedback Control Systems 2 Introduction Steady-State Error Introduction 3 Consider a simple unity-feedback system The error is the difference between the reference
More informationMath 171 Spring 2017 Final Exam. Problem Worth
Math 171 Spring 2017 Final Exam Problem 1 2 3 4 5 6 7 8 9 10 11 Worth 9 6 6 5 9 8 5 8 8 8 10 12 13 14 15 16 17 18 19 20 21 22 Total 8 5 5 6 6 8 6 6 6 6 6 150 Last Name: First Name: Student ID: Section:
More informationChapter 22 : Electric potential
Chapter 22 : Electric potential What is electric potential? How does it relate to potential energy? How does it relate to electric field? Some simple applications What does it mean when it says 1.5 Volts
More informationLesson 24: True and False Number Sentences
NYS COMMON CE MATHEMATICS CURRICULUM Lesson 24 6 4 Student Outcomes Students identify values for the variables in equations and inequalities that result in true number sentences. Students identify values
More informationClassification of Components
Classification of Components Classification of SMD LEDs TLM.31../TLM.32../TLM.33../ + 3... series, Mini LEDs TLM.21... / TLM.23.. / TLM.2.. and 63 LEDs TLM.11../TLM1.. Light Intensity / Color Devices are
More informationCourse Business. Homework 3 Due Now. Homework 4 Released. Professor Blocki is travelling, but will be back next week
Course Business Homework 3 Due Now Homework 4 Released Professor Blocki is travelling, but will be back next week 1 Cryptography CS 555 Week 11: Discrete Log/DDH Applications of DDH Factoring Algorithms,
More informationCharge carrier density in metals and semiconductors
Charge carrier density in metals and semiconductors 1. Introduction The Hall Effect Particles must overlap for the permutation symmetry to be relevant. We saw examples of this in the exchange energy in
More informationApproximate Second Order Algorithms. Seo Taek Kong, Nithin Tangellamudi, Zhikai Guo
Approximate Second Order Algorithms Seo Taek Kong, Nithin Tangellamudi, Zhikai Guo Why Second Order Algorithms? Invariant under affine transformations e.g. stretching a function preserves the convergence
More informationQuantitative Screening of 46 Illicit Drugs in Urine using Exactive Ultrahigh Resolution and Accurate Mass system
Quantitative Screening of 46 Illicit Drugs in Urine using Exactive Ultrahigh Resolution and Accurate Mass system Kevin Mchale Thermo Fisher Scientific, San Jose CA Presentation Overview Anabolic androgenic
More informationNumber Representations
Computer Arithmetic Algorithms Prof. Dae Hyun Kim School of Electrical Engineering and Computer Science Washington State University Number Representations Information Textbook Israel Koren, Computer Arithmetic
More informationPHL424: Nuclear Shell Model. Indian Institute of Technology Ropar
PHL424: Nuclear Shell Model Themes and challenges in modern science Complexity out of simplicity Microscopic How the world, with all its apparent complexity and diversity can be constructed out of a few
More informationReview for Exam Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa
57:020 Fluids Mechanics Fall2013 1 Review for Exam3 12. 11. 2013 Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa 57:020 Fluids Mechanics Fall2013 2 Chapter
More informationChapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell
Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea
More informationCOMPRESSION FOR QUANTUM POPULATION CODING
COMPRESSION FOR QUANTUM POPULATION CODING Ge Bai, The University of Hong Kong Collaborative work with: Yuxiang Yang, Giulio Chiribella, Masahito Hayashi INTRODUCTION Population: A group of identical states
More informationEureka Lessons for 6th Grade Unit FIVE ~ Equations & Inequalities
Eureka Lessons for 6th Grade Unit FIVE ~ Equations & Inequalities These 2 lessons can easily be taught in 2 class periods. If you like these lessons, please consider using other Eureka lessons as well.
More informationVariations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationPredicting Winners of Competitive Events with Topological Data Analysis
Predicting Winners of Competitive Events with Topological Data Analysis Conrad D Souza Ruben Sanchez-Garcia R.Sanchez-Garcia@soton.ac.uk Tiejun Ma tiejun.ma@soton.ac.uk Johnnie Johnson J.E.Johnson@soton.ac.uk
More informationSECTION 7: FAULT ANALYSIS. ESE 470 Energy Distribution Systems
SECTION 7: FAULT ANALYSIS ESE 470 Energy Distribution Systems 2 Introduction Power System Faults 3 Faults in three-phase power systems are short circuits Line-to-ground Line-to-line Result in the flow
More informationON A CONTINUED FRACTION IDENTITY FROM RAMANUJAN S NOTEBOOK
Asian Journal of Current Engineering and Maths 3: (04) 39-399. Contents lists available at www.innovativejournal.in ASIAN JOURNAL OF CURRENT ENGINEERING AND MATHS Journal homepage: http://www.innovativejournal.in/index.php/ajcem
More informationIntroduction to Algorithms
Introduction to Algorithms 6.046J/18.401J LECTURE 14 Shortest Paths I Properties of shortest paths Dijkstra s algorithm Correctness Analysis Breadth-first search Prof. Charles E. Leiserson Paths in graphs
More informationRotational Motion. Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition
Rotational Motion Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 We ll look for a way to describe the combined (rotational) motion 2 Angle Measurements θθ ss rr rrrrrrrrrrrrrr
More informationInformation Complexity and Applications. Mark Braverman Princeton University and IAS FoCM 17 July 17, 2017
Information Complexity and Applications Mark Braverman Princeton University and IAS FoCM 17 July 17, 2017 Coding vs complexity: a tale of two theories Coding Goal: data transmission Different channels
More informationCS60020: Foundations of Algorithm Design and Machine Learning. Sourangshu Bhattacharya
CS6000: Foundations of Algorithm Design and Machine Learning Sourangshu Bhattacharya Paths in graphs Consider a digraph G = (V, E) with edge-weight function w : E R. The weight of path p = v 1 v L v k
More informationLesson 24: Using the Quadratic Formula,
, b ± b 4ac x = a Opening Exercise 1. Examine the two equation below and discuss what is the most efficient way to solve each one. A. 4xx + 5xx + 3 = xx 3xx B. cc 14 = 5cc. Solve each equation with the
More informationLecture 1: Shannon s Theorem
Lecture 1: Shannon s Theorem Lecturer: Travis Gagie January 13th, 2015 Welcome to Data Compression! I m Travis and I ll be your instructor this week. If you haven t registered yet, don t worry, we ll work
More informationTECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES
COMPUTERS AND STRUCTURES, INC., FEBRUARY 2016 TECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES Introduction This technical note
More informationLecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher
Lecture 3 STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher Previous lectures What is machine learning? Objectives of machine learning Supervised and
More informationA Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions
Lin Lin A Posteriori DG using Non-Polynomial Basis 1 A Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions Lin Lin Department of Mathematics, UC Berkeley;
More informationThermodynamic Cycles
Thermodynamic Cycles Content Thermodynamic Cycles Carnot Cycle Otto Cycle Rankine Cycle Refrigeration Cycle Thermodynamic Cycles Carnot Cycle Derivation of the Carnot Cycle Efficiency Otto Cycle Otto Cycle
More informationQuantum Mechanics. An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc.
Quantum Mechanics An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 3 Experimental Basis of
More informationSource Coding. Master Universitario en Ingeniería de Telecomunicación. I. Santamaría Universidad de Cantabria
Source Coding Master Universitario en Ingeniería de Telecomunicación I. Santamaría Universidad de Cantabria Contents Introduction Asymptotic Equipartition Property Optimal Codes (Huffman Coding) Universal
More informationSystems of Linear Equations
Systems of Linear Equations As stated in Section G, Definition., a linear equation in two variables is an equation of the form AAAA + BBBB = CC, where AA and BB are not both zero. Such an equation has
More informationModule 7 (Lecture 25) RETAINING WALLS
Module 7 (Lecture 25) RETAINING WALLS Topics Check for Bearing Capacity Failure Example Factor of Safety Against Overturning Factor of Safety Against Sliding Factor of Safety Against Bearing Capacity Failure
More informationChapter 6 Reed-Solomon Codes. 6.1 Finite Field Algebra 6.2 Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding
Chapter 6 Reed-Solomon Codes 6. Finite Field Algebra 6. Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding 6. Finite Field Algebra Nonbinary codes: message and codeword symbols
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationA semi-device-independent framework based on natural physical assumptions
AQIS 2017 4-8 September 2017 A semi-device-independent framework based on natural physical assumptions and its application to random number generation T. Van Himbeeck, E. Woodhead, N. Cerf, R. García-Patrón,
More informationCoding for Computing. ASPITRG, Drexel University. Jie Ren 2012/11/14
Coding for Computing ASPITRG, Drexel University Jie Ren 2012/11/14 Outline Background and definitions Main Results Examples and Analysis Proofs Background and definitions Problem Setup Graph Entropy Conditional
More informationExtreme value statistics: from one dimension to many. Lecture 1: one dimension Lecture 2: many dimensions
Extreme value statistics: from one dimension to many Lecture 1: one dimension Lecture 2: many dimensions The challenge for extreme value statistics right now: to go from 1 or 2 dimensions to 50 or more
More informationSection 5: Quadratic Equations and Functions Part 1
Section 5: Quadratic Equations and Functions Part 1 Topic 1: Real-World Examples of Quadratic Functions... 121 Topic 2: Factoring Quadratic Expressions... 125 Topic 3: Solving Quadratic Equations by Factoring...
More informationOn The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time Delays
Journal of Mathematics and System Science 6 (216) 194-199 doi: 1.17265/2159-5291/216.5.3 D DAVID PUBLISHING On The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time
More informationGravitation. Chapter 8 of Essential University Physics, Richard Wolfson, 3 rd Edition
Gravitation Chapter 8 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 What you are about to learn: Newton's law of universal gravitation About motion in circular and other orbits How to
More informationLecture No. 5. For all weighted residual methods. For all (Bubnov) Galerkin methods. Summary of Conventional Galerkin Method
Lecture No. 5 LL(uu) pp(xx) = 0 in ΩΩ SS EE (uu) = gg EE on ΓΓ EE SS NN (uu) = gg NN on ΓΓ NN For all weighted residual methods NN uu aaaaaa = uu BB + αα ii φφ ii For all (Bubnov) Galerkin methods ii=1
More informationIntroduction to Algorithms
Introduction to Algorithms 6.046J/18.401J LECTURE 17 Shortest Paths I Properties of shortest paths Dijkstra s algorithm Correctness Analysis Breadth-first search Prof. Erik Demaine November 14, 005 Copyright
More informationMotivation for Arithmetic Coding
Motivation for Arithmetic Coding Motivations for arithmetic coding: 1) Huffman coding algorithm can generate prefix codes with a minimum average codeword length. But this length is usually strictly greater
More informationA A. an at and April fat Ana black orange gray cage. A a A a a f A a g A N a A n N p A G a A g A n a A a a A g a. Name. Copy the letter Aa.
Copy the letter Aa. A A a a Highlight the letter Aa. an at and April that fat Ana black orange gray cage Glue the uppercase A here. Glue the lowercase a here. A a A a a f A a g A N a A n N p A G a A g
More informationIntroduction to Algorithms
Introduction to Algorithms 6.046J/8.40J/SMA550 Lecture 7 Prof. Erik Demaine Paths in graphs Consider a digraph G = (V, E) with edge-weight function w : E R. The weight of path p = v v L v k is defined
More informationGradient expansion formalism for generic spin torques
Gradient expansion formalism for generic spin torques Atsuo Shitade RIKEN Center for Emergent Matter Science Atsuo Shitade, arxiv:1708.03424. Outline 1. Spintronics a. Magnetoresistance and spin torques
More information7.3 The Jacobi and Gauss-Seidel Iterative Methods
7.3 The Jacobi and Gauss-Seidel Iterative Methods 1 The Jacobi Method Two assumptions made on Jacobi Method: 1.The system given by aa 11 xx 1 + aa 12 xx 2 + aa 1nn xx nn = bb 1 aa 21 xx 1 + aa 22 xx 2
More information10.1 Three Dimensional Space
Math 172 Chapter 10A notes Page 1 of 12 10.1 Three Dimensional Space 2D space 0 xx.. xx-, 0 yy yy-, PP(xx, yy) [Fig. 1] Point PP represented by (xx, yy), an ordered pair of real nos. Set of all ordered
More informationSECTION 8: ROOT-LOCUS ANALYSIS. ESE 499 Feedback Control Systems
SECTION 8: ROOT-LOCUS ANALYSIS ESE 499 Feedback Control Systems 2 Introduction Introduction 3 Consider a general feedback system: Closed-loop transfer function is KKKK ss TT ss = 1 + KKKK ss HH ss GG ss
More informationSection 2: Equations and Inequalities
Topic 1: Equations: True or False?... 29 Topic 2: Identifying Properties When Solving Equations... 31 Topic 3: Solving Equations... 34 Topic 4: Solving Equations Using the Zero Product Property... 36 Topic
More informationHeat, Work, and the First Law of Thermodynamics. Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition
Heat, Work, and the First Law of Thermodynamics Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Different ways to increase the internal energy of system: 2 Joule s apparatus
More informationCryptography CS 555. Topic 22: Number Theory/Public Key-Cryptography
Cryptography CS 555 Topic 22: Number Theory/Public Key-Cryptography 1 Exam Recap 2 Exam Recap Highest Average Score on Question Question 4: (Feistel Network with round function f(x) = 0 n ) Tougher Questions
More informationCOMM901 Source Coding and Compression. Quiz 1
German University in Cairo - GUC Faculty of Information Engineering & Technology - IET Department of Communication Engineering Winter Semester 2013/2014 Students Name: Students ID: COMM901 Source Coding
More informationAa Bb Cc Dd. Ee Ff Gg Hh
Aa Bb Cc Dd ------------------------------------------------------------------------------------------------------------------------------------------------------- Ee Ff Gg Hh -------------------------------------------------------------------------------------------------------------------------------------------------------
More informationInformation Theory. Week 4 Compressing streams. Iain Murray,
Information Theory http://www.inf.ed.ac.uk/teaching/courses/it/ Week 4 Compressing streams Iain Murray, 2014 School of Informatics, University of Edinburgh Jensen s inequality For convex functions: E[f(x)]
More informationPhysics 371 Spring 2017 Prof. Anlage Review
Physics 71 Spring 2017 Prof. Anlage Review Special Relativity Inertial vs. non-inertial reference frames Galilean relativity: Galilean transformation for relative motion along the xx xx direction: xx =
More informationTheory of Computation Chapter 12: Cryptography
Theory of Computation Chapter 12: Cryptography Guan-Shieng Huang Dec. 20, 2006 0-0 Introduction Alice wants to communicate with Bob secretely. x Alice Bob John Alice y=e(e,x) y Bob y??? John Assumption
More informationPHY103A: Lecture # 9
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 9 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 20-Jan-2018 Summary of Lecture # 8: Force per unit
More informationCHAPTER 4 Structure of the Atom
CHAPTER 4 Structure of the Atom Fall 2018 Prof. Sergio B. Mendes 1 Topics 4.1 The Atomic Models of Thomson and Rutherford 4.2 Rutherford Scattering 4.3 The Classic Atomic Model 4.4 The Bohr Model of the
More informationUniversal Semantic Communication
Universal Semantic Communication Madhu Sudan MIT CSAIL Joint work with Brendan Juba (MIT). An fantasy setting (SETI) Alice 010010101010001111001000 No common language! Is meaningful communication possible?
More informationA Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter
A Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter Murat Akcakaya Department of Electrical and Computer Engineering University of Pittsburgh Email: akcakaya@pitt.edu Satyabrata
More informationMath 95--Review Prealgebra--page 1
Math 95--Review Prealgebra--page 1 Name Date In order to do well in algebra, there are many different ideas from prealgebra that you MUST know. Some of the main ideas follow. If these ideas are not just
More informationEntropy Coding. Connectivity coding. Entropy coding. Definitions. Lossles coder. Input: a set of symbols Output: bitstream. Idea
Connectivity coding Entropy Coding dd 7, dd 6, dd 7, dd 5,... TG output... CRRRLSLECRRE Entropy coder output Connectivity data Edgebreaker output Digital Geometry Processing - Spring 8, Technion Digital
More informationchildren's illustrator
th, The summer before kindergarten is so exciting. This packet was designed to give you insight in to the different activities you can do with your child. After completing a worksheet, you have an idea
More informationA new procedure for sensitivity testing with two stress factors
A new procedure for sensitivity testing with two stress factors C.F. Jeff Wu Georgia Institute of Technology Sensitivity testing : problem formulation. Review of the 3pod (3-phase optimal design) procedure
More information