General Strong Polarization
|
|
- Nicholas Godwin McGee
- 5 years ago
- Views:
Transcription
1 General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 8, 018 Berkeley: General Strong Polarization 1 of 1
2 Part I: Motivation Achieving Shannon Capacity Oct. 8, 018 Berkeley: General Strong Polarization of 1
3 Shannon and Channel Capacity Shannon [ 48]: For every (noisy) channel of communication, capacity CC s.t. communication at rate RR < CC is possible and RR > CC is not. formalization omitted. Example: XX FF Acts independently on bits Capacity = 1 HH(pp) ; HH(pp) = binary entropy! HH pp = pp log 1 pp BBBBBB(pp) XX w.p. 1 pp 1 XX w.p. pp + 1 pp log 1 1 pp Capacity? EE: FF kk nn FF nn DD: FF nn FF kk nn w. Pr DD BBBBBB EE mm mm = oo(1) kk lim nn nn nn RR (Rate) Oct. 8, 018 Berkeley: General Strong Polarization 3 of 1
4 Achieving Shannon Capacity Commonly used phrase. Many mathematical interpretations. Some possibilities: How small can nn be? Get RR > CC εε with polytime algorithms? [Luby et al. 95] running time poly nn εε? (or nn = poly 1 εε?) Open till 008 Shannon 48: nn = OO 1 εε ; εε CC RR Forney 66 :time = pppppppp nn, 1 εε Arikan 08: Invented Polar Codes Final resolution: Guruswami+Xia 13, Hassani+Alishahi+Urbanke 13 Strong analysis Oct. 8, 018 Berkeley: General Strong Polarization 4 of 1
5 Polar Codes and Polarization Arikan: Defined Polar Codes, one for every tt Associated Martingale XX 0,, XX tt, XX tt [0,1] ttth code: Length nn = tt If Pr XX tt ττ tt, 1 δδ tt εε tt then ttth code is εε tt + δδ tt -close to capacity, and Pr Decode BSC Encode mm mm nn ττ tt Need ττ tt = oo 1 nn (strong polarization ττ = nnnnnn(nn)) Need εε tt = 1/nn Ω(1) ( strong polarization) Arikan et al. ττ = nnnnnn nn ; εε = oo 1 ; [GX13,HAU13] Oct. 8, 018 Berkeley: General Strong Polarization 5 of 1
6 Part II: Martingales, Polarization, Strong & Local Oct. 8, 018 Berkeley: General Strong Polarization 6 of 1
7 Martingales and Polarization [0,1]-Martingale: Sequence of r.v.s XX 0, XX 1, XX, XX tt 0,1, EE XX tt+1 XX 0,, XX tt = XX tt Well-studied in algorithms: [MotwaniRaghavan, 4.4], [MitzenmacherUpfal, 1] E.g., XX tt = Expected approx. factor of algorithm given first tt random choices. Usually study concentration E.g. whp XX final [XX 0 ± σσ] lim XX tt = NN(XX 0, σσ ) tt Today: Polarization: whp XX final εε, 1 εε lim XX tt = Bern XX 0 tt Oct. 8, 018 Berkeley: General Strong Polarization 7 of 1
8 Some examples XX tt+1 = XX tt + 4 tt w. p. 1 XX tt 4 tt w. p. 1 Converges! XX tt+1 = XX tt + tt w. p. 1 XX tt tt w. p. 1 Uniform on [0,1] XX tt+1 = XX tt w. p XX tt w. p. 1 if XX tt 1 if XX tt 1 Polarizes (weakly)! XX tt w. p. 1 if XX tt 1 XX tt+1 = XX tt XX tt w. p. 1 if XX tt 1 Polarizes (strongly)! Oct. 8, 018 Berkeley: General Strong Polarization 8 of 1
9 Main Result: Definition and Theorem Strong Polarization: (informally) Pr XX tt (ττ, 1 ττ) εε if ττ = ωω(tt) and εε = OO(tt) formally γγ > 0 ββ < 1, cc ss. tt. tt Pr XX tt (γγ tt, 1 γγ tt ) cc ββ tt Local Polarization: Both definitions qualitative! Variance in the middle: XX tt (ττ, 1 ττ) ττ > 0 σσ > 0 ss. tt. tt, XX tt ττ, 1 ττ VVVVVV XX tt+1 XX tt Suction at the ends: XX tt ττ, 1 ττ θθ > 0, cc <, ττ > 0 ss. tt. XX tt < ττ Pr XX tt+1 < XX tt cc σσ θθ Theorem: Local Polarization Strong Polarization. low end condition. Similar condition for high end Oct. 8, 018 Berkeley: General Strong Polarization 9 of 1
10 Proof (Idea): Step 1: The potential Φ tt min XX tt, 1 XX tt decreases by constant factor in expectation in each step. EE Φ TT = exp TT Pr XX TT exp TT/ exp TT/ Step : Next TT time steps, XX tt plummets whp.1: Say, If XX tt ττ then Pr XX tt+1 XX tt 100 1/..: Pr tt TT, TT ss. tt. XX tt > ττ XX TT /ττ [Doob].3: If above doesn t happen XX TT < 5 TT whp QED Oct. 8, 018 Berkeley: General Strong Polarization 10 of 1
11 Part III: Polar Codes Encoding, Decoding, Martingale, Polarization Oct. 8, 018 Berkeley: General Strong Polarization 11 of 1
12 Lesson 0: Compression Coding Defn: Linear Compression Scheme: MM, DD form compression scheme for bern pp nn if Linear map MM: FF nn mm FF Pr ZZ bern pp nn DD MM ZZ ZZ = oo 1 Hopefully mm HH pp + εε nn Compression Coding Let MM be such that MM MM = 0; Encoder: XX MM XX Error-Corrector: YY = MM XX + ZZ YY DD MM YY = YY DD MM MM XX + MM. ZZ = ww.pp. 1 oo(1) MM XX MM MM Oct. 8, 018 Berkeley: General Strong Polarization 1 of 1
13 Question: How to compress? Arikan s key idea: Start with Polarization Transform : UU, VV UU + VV, VV Invertible so does nothing? If UU, VV independent, then UU + VV more random than either VV UU + VV less random than either Iterate (ignoring conditioning) End with bits that are almost random, or almost determined (by others). Output totally random part to get compression! Oct. 8, 018 Berkeley: General Strong Polarization 13 of 1
14 Iteration elaborated: A Martingale: XX tt conditional entropy of A+B random A+B+C+D output after tt iterations B C B C+D C+D B+D D E F G D E+F F G+H D E+F+G+H G+H F+H H H H Oct. 8, 018 Berkeley: General Strong Polarization 14 of 1
15 The Polarization Butterfly PP nn UU, VV = PPnn UU + VV, PPnn VV UU ZZ 1 ZZ ZZ ZZ + + WW 1 WW Polarization SS nn HH WW nn SS WW SS 0 SS HH pp + εε nn + ZZ nn WWnn Compression EE ZZ = PP nn ZZ SS VV WWnn +1 WWnn + Encoding time = OO nn log nn (given SS) To be shown: ZZ nn ZZ nn WW nn 1. Decoding = OO nn log nn. Polarization! Oct. 8, 018 Berkeley: General Strong Polarization 15 of 1
16 The Polarization Butterfly: Decoding ZZ 1 ZZ ZZ ZZ + + WW 1 WW Decoding idea: Given SS, WW SS = PP nn UU, VV Compute UU + VV Bern pp pp Determine VV? VV UU + VV ii Bern(rr ii ) ZZ nn WWnn WWnn +1 WWnn + Key idea: Stronger induction! - non-identical product distribution Decoding Algorithm: Given SS, WW SS = PP nn UU, VV, pp 1,, pp nn - Compute qq 1,.. qqnn pp 1 pp nn ZZ nn ZZ nn WW nn - Determine UU + VV = DD WW SS +, qq 1 qqnn - Compute rr 1 rrnn pp 1 pp nn ; UU + VV - Determine VV = DD WW SS, rr 1 rrnn Oct. 8, 018 Berkeley: General Strong Polarization 16 of 1
17 Polarization Martingale ZZ 1 ZZ ZZ ZZ + + WW 1 WW ZZ ii,0 ZZ ii,1 Z ii,tt ZZ ii,log nn Idea: Follow XX tt = HH ZZ ii,tt ZZ <ii,tt for random ii +1 + ZZ nn +1 + ZZ nn + ZZ nn WWnn WWnn +1 WWnn + WW nn XX tt Martingale! Polarizes? Strongly? Locally? Oct. 8, 018 Berkeley: General Strong Polarization 17 of 1
18 Local Polarization of Arikan Martingale Variance in the Middle: Roughly: HH pp, HH pp (HH pp pp, HH pp HH pp pp ) pp ττ, 1 ττ pp pp far from pp + continuity of HH HH pp pp far from HH(pp) Suction: High end:hh 1 γγ HH 1 γγ HH 1 γγ = 1 Θ γγ 1 γγ 1 Θ γγ 4 Low end: HH pp pp log 1 ; HH pp pp log 1 ; pp pp HH pp pp HH pp pp log 1 pp HH pp pp 1 log 1 pp Dealing with conditioning more work (lots of Markov) HH pp Oct. 8, 018 Berkeley: General Strong Polarization 18 of 1
19 New contributions So far: Reproduced old work (simpler proofs?) Main new technical contributions: Strong polarization of general transforms E.g. UU, VV, WW (UU + VV, VV, WW)? Exponentially strong polarization [BGS 18] Suction at low end is very strong! Random kk kk matrix yields XX tt+1 XX tt kk.99 whp Strong polarization of Markovian sources [GNS 19?] Separation of compression of known sources from unknown ones. Oct. 8, 018 Berkeley: General Strong Polarization 19 of 1
20 Conclusions Polarization: Important phenomenon associated with bounded random variables. Not always bad Needs better understanding! Recently also used in CS: [Lovett Meka] implicit [Chattopadhyay-Hatami-Hosseini-Lovett] - explicit Oct. 8, 018 Berkeley: General Strong Polarization 0 of 1
21 Thank You! Oct. 8, 018 Berkeley: General Strong Polarization 1 of 1
22 Rest of the talk Background/Motivation: The Shannon Capacity Challenge Resolution by [Arikan 08], [Guruswami-Xia 13], [Hassani,Alishahi,Urbanke 13]: Polar Codes! Key ideas: Polar Codes & Arikan-Martingale. Implications of Weak/Strong Polarization. Our Contributions: Simplification & Generalization Local Polarization Strong Polarization Arikan-Martingale Locally Polarizes (generally) Oct. 8, 018 Berkeley: General Strong Polarization 31 of 1
23 Context for today s talk [Arikan 08]: Martingale associated to general class of codes. Martingale polarizes (weakly) implies code achieves capacity (weakly) Martingale polarizes weakly for entire class. [GX 13, HAU 13]: Strong polarization for one specific code. Why so specific? Bottleneck: Strong Polarization Rest of talk: Polar codes, Martingale and Strong Polarization Oct. 8, 018 Berkeley: General Strong Polarization 3 of 1
General Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 5, 018 Stanford:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) May 1, 018 G.Tech:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) December 4, 2017 IAS:
More informationLocality in Coding Theory
Locality in Coding Theory Madhu Sudan Harvard April 9, 2016 Skoltech: Locality in Coding Theory 1 Error-Correcting Codes (Linear) Code CC FF qq nn. FF qq : Finite field with qq elements. nn block length
More informationLow-Degree Polynomials
Low-Degree Polynomials Madhu Sudan Harvard University October 7, 2016 Avi60!! Low-degree Polynomials 1 of 27 October 7, 2016 Avi60!! Low-degree Polynomials 2 of 27 Happy Birthday, Avi!! October 7, 2016
More informationUncertain Compression & Graph Coloring. Madhu Sudan Harvard
Uncertain Compression & Graph Coloring Madhu Sudan Harvard Based on joint works with: (1) Adam Kalai (MSR), Sanjeev Khanna (U.Penn), Brendan Juba (WUStL) (2) Elad Haramaty (Harvard) (3) Badih Ghazi (MIT),
More informationProperty Testing and Affine Invariance Part I Madhu Sudan Harvard University
Property Testing and Affine Invariance Part I Madhu Sudan Harvard University December 29-30, 2015 IITB: Property Testing & Affine Invariance 1 of 31 Goals of these talks Part I Introduce Property Testing
More informationVariations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationAlgebraic Codes and Invariance
Algebraic Codes and Invariance Madhu Sudan Harvard April 30, 2016 AAD3: Algebraic Codes and Invariance 1 of 29 Disclaimer Very little new work in this talk! Mainly: Ex- Coding theorist s perspective on
More informationCOMPRESSION FOR QUANTUM POPULATION CODING
COMPRESSION FOR QUANTUM POPULATION CODING Ge Bai, The University of Hong Kong Collaborative work with: Yuxiang Yang, Giulio Chiribella, Masahito Hayashi INTRODUCTION Population: A group of identical states
More informationLocal Decoding and Testing Polynomials over Grids
Local Decoding and Testing Polynomials over Grids Madhu Sudan Harvard University Joint work with Srikanth Srinivasan (IIT Bombay) January 11, 2018 ITCS: Polynomials over Grids 1 of 12 DeMillo-Lipton-Schwarz-Zippel
More informationHeteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Heteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction For pedagogical reasons, OLS is presented initially under strong simplifying assumptions. One of these is homoskedastic errors,
More informationTwo Decades of Property Testing Madhu Sudan Harvard
Two Decades of Property Testing Madhu Sudan Harvard April 8, 2016 Two Decades of Property Testing 1 of 29 Kepler s Big Data Problem Tycho Brahe (~1550-1600): Wished to measure planetary motion accurately.
More informationECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations
ECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations Last Time Minimum Variance Unbiased Estimators Sufficient Statistics Proving t = T(x) is sufficient Neyman-Fischer Factorization
More informationLecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher
Lecture 3 STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher Previous lectures What is machine learning? Objectives of machine learning Supervised and
More informationLecture 11: Polar codes construction
15-859: Information Theory and Applications in TCS CMU: Spring 2013 Lecturer: Venkatesan Guruswami Lecture 11: Polar codes construction February 26, 2013 Scribe: Dan Stahlke 1 Polar codes: recap of last
More informationChapter 6 Reed-Solomon Codes. 6.1 Finite Field Algebra 6.2 Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding
Chapter 6 Reed-Solomon Codes 6. Finite Field Algebra 6. Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding 6. Finite Field Algebra Nonbinary codes: message and codeword symbols
More information9. Switched Capacitor Filters. Electronic Circuits. Prof. Dr. Qiuting Huang Integrated Systems Laboratory
9. Switched Capacitor Filters Electronic Circuits Prof. Dr. Qiuting Huang Integrated Systems Laboratory Motivation Transmission of voice signals requires an active RC low-pass filter with very low ff cutoff
More informationModule 7 (Lecture 27) RETAINING WALLS
Module 7 (Lecture 27) RETAINING WALLS Topics 1.1 RETAINING WALLS WITH METALLIC STRIP REINFORCEMENT Calculation of Active Horizontal and vertical Pressure Tie Force Factor of Safety Against Tie Failure
More information1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. Ans: x = 4, x = 3, x = 2,
1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. x = 4, x = 3, x = 2, x = 1, x = 1, x = 2, x = 3, x = 4, x = 5 b. Find the value(s)
More informationWork, Energy, and Power. Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition
Work, Energy, and Power Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 With the knowledge we got so far, we can handle the situation on the left but not the one on the right.
More informationList Decoding of Reed Solomon Codes
List Decoding of Reed Solomon Codes p. 1/30 List Decoding of Reed Solomon Codes Madhu Sudan MIT CSAIL Background: Reliable Transmission of Information List Decoding of Reed Solomon Codes p. 2/30 List Decoding
More informationReview for Exam Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa
57:020 Fluids Mechanics Fall2013 1 Review for Exam3 12. 11. 2013 Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa 57:020 Fluids Mechanics Fall2013 2 Chapter
More informationEstimate by the L 2 Norm of a Parameter Poisson Intensity Discontinuous
Research Journal of Mathematics and Statistics 6: -5, 24 ISSN: 242-224, e-issn: 24-755 Maxwell Scientific Organization, 24 Submied: September 8, 23 Accepted: November 23, 23 Published: February 25, 24
More informationControl of Mobile Robots
Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and
More informationWave Motion. Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition
Wave Motion Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Waves: propagation of energy, not particles 2 Longitudinal Waves: disturbance is along the direction of wave propagation
More informationChapter 22 : Electric potential
Chapter 22 : Electric potential What is electric potential? How does it relate to potential energy? How does it relate to electric field? Some simple applications What does it mean when it says 1.5 Volts
More informationError-Correcting Codes:
Error-Correcting Codes: Progress & Challenges Madhu Sudan Microsoft/MIT Communication in presence of noise We are not ready Sender Noisy Channel We are now ready Receiver If information is digital, reliability
More information" = Y(#,$) % R(r) = 1 4& % " = Y(#,$) % R(r) = Recitation Problems: Week 4. a. 5 B, b. 6. , Ne Mg + 15 P 2+ c. 23 V,
Recitation Problems: Week 4 1. Which of the following combinations of quantum numbers are allowed for an electron in a one-electron atom: n l m l m s 2 2 1! 3 1 0 -! 5 1 2! 4-1 0! 3 2 1 0 2 0 0 -! 7 2-2!
More informationMath, Stats, and Mathstats Review ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Math, Stats, and Mathstats Review ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Outline These preliminaries serve to signal to students what tools they need to know to succeed in ECON 360 and refresh their
More informationSupport Vector Machines. CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington
Support Vector Machines CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 A Linearly Separable Problem Consider the binary classification
More informationLesson 24: True and False Number Sentences
NYS COMMON CE MATHEMATICS CURRICULUM Lesson 24 6 4 Student Outcomes Students identify values for the variables in equations and inequalities that result in true number sentences. Students identify values
More informationTerms of Use. Copyright Embark on the Journey
Terms of Use All rights reserved. No part of this packet may be reproduced, stored in a retrieval system, or transmitted in any form by any means - electronic, mechanical, photo-copies, recording, or otherwise
More informationAngular Momentum, Electromagnetic Waves
Angular Momentum, Electromagnetic Waves Lecture33: Electromagnetic Theory Professor D. K. Ghosh, Physics Department, I.I.T., Bombay As before, we keep in view the four Maxwell s equations for all our discussions.
More informationCHAPTER 2 Special Theory of Relativity
CHAPTER 2 Special Theory of Relativity Fall 2018 Prof. Sergio B. Mendes 1 Topics 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 2.10 2.11 2.12 2.13 2.14 Inertial Frames of Reference Conceptual and Experimental
More informationGrover s algorithm. We want to find aa. Search in an unordered database. QC oracle (as usual) Usual trick
Grover s algorithm Search in an unordered database Example: phonebook, need to find a person from a phone number Actually, something else, like hard (e.g., NP-complete) problem 0, xx aa Black box ff xx
More informationIntroduction to time series econometrics and VARs. Tom Holden PhD Macroeconomics, Semester 2
Introduction to time series econometrics and VARs Tom Holden http://www.tholden.org/ PhD Macroeconomics, Semester 2 Outline of today s talk Discussion of the structure of the course. Some basics: Vector
More informationLecture 8: Shannon s Noise Models
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 8: Shannon s Noise Models September 14, 2007 Lecturer: Atri Rudra Scribe: Sandipan Kundu& Atri Rudra Till now we have
More informationLecture 6. Notes on Linear Algebra. Perceptron
Lecture 6. Notes on Linear Algebra. Perceptron COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Notes on linear algebra Vectors
More informationReview for Exam Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa
Review for Exam3 12. 9. 2015 Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa Assistant Research Scientist IIHR-Hydroscience & Engineering, University
More informationA A A A A A A A A A A A. a a a a a a a a a a a a a a a. Apples taste amazingly good.
Victorian Handwriting Sheet Aa A A A A A A A A A A A A Aa Aa Aa Aa Aa Aa Aa a a a a a a a a a a a a a a a Apples taste amazingly good. Apples taste amazingly good. Now make up a sentence of your own using
More informationLecture 4: Proof of Shannon s theorem and an explicit code
CSE 533: Error-Correcting Codes (Autumn 006 Lecture 4: Proof of Shannon s theorem and an explicit code October 11, 006 Lecturer: Venkatesan Guruswami Scribe: Atri Rudra 1 Overview Last lecture we stated
More informationarxiv: v1 [cs.it] 9 Oct 2018
Polar Codes with exponentially small error at finite block length Jarosław Błasiok Venkatesan Guruswami Madhu Sudan arxiv:1810.04298v1 [cs.it] 9 Oct 2018 Abstract We show that the entire class of polar
More informationWorksheets for GCSE Mathematics. Quadratics. mr-mathematics.com Maths Resources for Teachers. Algebra
Worksheets for GCSE Mathematics Quadratics mr-mathematics.com Maths Resources for Teachers Algebra Quadratics Worksheets Contents Differentiated Independent Learning Worksheets Solving x + bx + c by factorisation
More informationLecture 4: Codes based on Concatenation
Lecture 4: Codes based on Concatenation Error-Correcting Codes (Spring 206) Rutgers University Swastik Kopparty Scribe: Aditya Potukuchi and Meng-Tsung Tsai Overview In the last lecture, we studied codes
More informationPHY103A: Lecture # 4
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 4 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 10-Jan-2018 Notes The Solutions to HW # 1 have been
More informationIntroduction to Density Estimation and Anomaly Detection. Tom Dietterich
Introduction to Density Estimation and Anomaly Detection Tom Dietterich Outline Definition and Motivations Density Estimation Parametric Density Estimation Mixture Models Kernel Density Estimation Neural
More information3. Mathematical Modelling
3. Mathematical Modelling 3.1 Modelling principles 3.1.1 Model types 3.1.2 Model construction 3.1.3 Modelling from first principles 3.2 Models for technical systems 3.2.1 Electrical systems 3.2.2 Mechanical
More informationCS249: ADVANCED DATA MINING
CS249: ADVANCED DATA MINING Vector Data: Clustering: Part II Instructor: Yizhou Sun yzsun@cs.ucla.edu May 3, 2017 Methods to Learn: Last Lecture Classification Clustering Vector Data Text Data Recommender
More informationRotational Motion. Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition
Rotational Motion Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 We ll look for a way to describe the combined (rotational) motion 2 Angle Measurements θθ ss rr rrrrrrrrrrrrrr
More informationMultiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Multiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction When you perform statistical inference, you are primarily doing one of two things: Estimating the boundaries
More informationPHY103A: Lecture # 9
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 9 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 20-Jan-2018 Summary of Lecture # 8: Force per unit
More informationA Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions
Lin Lin A Posteriori DG using Non-Polynomial Basis 1 A Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions Lin Lin Department of Mathematics, UC Berkeley;
More informationUnit WorkBook 2 Level 4 ENG U13 Fundamentals of Thermodynamics and Heat Engines UniCourse LTD. All Rights Reserved. Sample
Pearson BTEC Levels 4 Higher Nationals in Engineering (RQF) Unit 13: Fundamentals of Thermodynamics and Heat Engines Unit Workbook 2 in a series of 4 for this unit Learning Outcome 2 Plant Equipment Page
More informationName: Discussion Section:
CBE 141: Chemical Engineering Thermodynamics, Spring 2018, UC Berkeley Midterm 2 March 22, 2018 Time: 80 minutes, closed-book and closed-notes, one-sided 8 ½ x 11 equation sheet allowed Please show all
More informationSpecialist Mathematics 2019 v1.2
181314 Mensuration circumference of a circle area of a parallelogram CC = ππππ area of a circle AA = ππrr AA = h area of a trapezium AA = 1 ( + )h area of a triangle AA = 1 h total surface area of a cone
More informationSECTION 5: POWER FLOW. ESE 470 Energy Distribution Systems
SECTION 5: POWER FLOW ESE 470 Energy Distribution Systems 2 Introduction Nodal Analysis 3 Consider the following circuit Three voltage sources VV sss, VV sss, VV sss Generic branch impedances Could be
More informationQuantum Mechanics. An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc.
Quantum Mechanics An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 3 Experimental Basis of
More informationStatistical Learning with the Lasso, spring The Lasso
Statistical Learning with the Lasso, spring 2017 1 Yeast: understanding basic life functions p=11,904 gene values n number of experiments ~ 10 Blomberg et al. 2003, 2010 The Lasso fmri brain scans function
More informationIntegrating Rational functions by the Method of Partial fraction Decomposition. Antony L. Foster
Integrating Rational functions by the Method of Partial fraction Decomposition By Antony L. Foster At times, especially in calculus, it is necessary, it is necessary to express a fraction as the sum of
More informationHeat, Work, and the First Law of Thermodynamics. Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition
Heat, Work, and the First Law of Thermodynamics Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Different ways to increase the internal energy of system: 2 Joule s apparatus
More information(1) Correspondence of the density matrix to traditional method
(1) Correspondence of the density matrix to traditional method New method (with the density matrix) Traditional method (from thermal physics courses) ZZ = TTTT ρρ = EE ρρ EE = dddd xx ρρ xx ii FF = UU
More informationPatterns of soiling in the Old Library Trinity College Dublin. Allyson Smith, Robbie Goodhue, Susie Bioletti
Patterns of soiling in the Old Library Trinity College Dublin Allyson Smith, Robbie Goodhue, Susie Bioletti Trinity College aerial view Old Library E N S W Old Library main (south) elevation Gallery Fagel
More informationCharge carrier density in metals and semiconductors
Charge carrier density in metals and semiconductors 1. Introduction The Hall Effect Particles must overlap for the permutation symmetry to be relevant. We saw examples of this in the exchange energy in
More informationNumber Representations
Computer Arithmetic Algorithms Prof. Dae Hyun Kim School of Electrical Engineering and Computer Science Washington State University Number Representations Information Textbook Israel Koren, Computer Arithmetic
More informationContinuous Random Variables
Continuous Random Variables Page Outline Continuous random variables and density Common continuous random variables Moment generating function Seeking a Density Page A continuous random variable has an
More informationOn The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time Delays
Journal of Mathematics and System Science 6 (216) 194-199 doi: 1.17265/2159-5291/216.5.3 D DAVID PUBLISHING On The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time
More informationInternational Journal of Mathematical Archive-5(3), 2014, Available online through ISSN
International Journal of Mathematical Archive-5(3), 214, 189-195 Available online through www.ijma.info ISSN 2229 546 COMMON FIXED POINT THEOREMS FOR OCCASIONALLY WEAKLY COMPATIBLE MAPPINGS IN INTUITIONISTIC
More informationLecture 7 MOS Capacitor
EE 471: Transport Phenomena in Solid State Devices Spring 2018 Lecture 7 MOS Capacitor Bryan Ackland Department of Electrical and Computer Engineering Stevens Institute of Technology Hoboken, NJ 07030
More informationWorksheets for GCSE Mathematics. Algebraic Expressions. Mr Black 's Maths Resources for Teachers GCSE 1-9. Algebra
Worksheets for GCSE Mathematics Algebraic Expressions Mr Black 's Maths Resources for Teachers GCSE 1-9 Algebra Algebraic Expressions Worksheets Contents Differentiated Independent Learning Worksheets
More informationReview for Exam Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa
Review for Exam2 11. 13. 2015 Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa Assistant Research Scientist IIHR-Hydroscience & Engineering, University
More information(1) Introduction: a new basis set
() Introduction: a new basis set In scattering, we are solving the S eq. for arbitrary VV in integral form We look for solutions to unbound states: certain boundary conditions (EE > 0, plane and spherical
More informationGradient expansion formalism for generic spin torques
Gradient expansion formalism for generic spin torques Atsuo Shitade RIKEN Center for Emergent Matter Science Atsuo Shitade, arxiv:1708.03424. Outline 1. Spintronics a. Magnetoresistance and spin torques
More informationExtreme value statistics: from one dimension to many. Lecture 1: one dimension Lecture 2: many dimensions
Extreme value statistics: from one dimension to many Lecture 1: one dimension Lecture 2: many dimensions The challenge for extreme value statistics right now: to go from 1 or 2 dimensions to 50 or more
More informationModule 7 (Lecture 25) RETAINING WALLS
Module 7 (Lecture 25) RETAINING WALLS Topics Check for Bearing Capacity Failure Example Factor of Safety Against Overturning Factor of Safety Against Sliding Factor of Safety Against Bearing Capacity Failure
More informationSECTION 7: STEADY-STATE ERROR. ESE 499 Feedback Control Systems
SECTION 7: STEADY-STATE ERROR ESE 499 Feedback Control Systems 2 Introduction Steady-State Error Introduction 3 Consider a simple unity-feedback system The error is the difference between the reference
More informationA new procedure for sensitivity testing with two stress factors
A new procedure for sensitivity testing with two stress factors C.F. Jeff Wu Georgia Institute of Technology Sensitivity testing : problem formulation. Review of the 3pod (3-phase optimal design) procedure
More informationLecture 3. Linear Regression
Lecture 3. Linear Regression COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne Weeks 2 to 8 inclusive Lecturer: Andrey Kan MS: Moscow, PhD:
More informationA linear operator of a new class of multivalent harmonic functions
International Journal of Scientific Research Publications, Volume 7, Issue 8, August 2017 278 A linear operator of a new class of multivalent harmonic functions * WaggasGalibAtshan, ** Ali Hussein Battor,
More informationChapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell
Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea
More informationBig Bang Planck Era. This theory: cosmological model of the universe that is best supported by several aspects of scientific evidence and observation
Big Bang Planck Era Source: http://www.crystalinks.com/bigbang.html Source: http://www.odec.ca/index.htm This theory: cosmological model of the universe that is best supported by several aspects of scientific
More informationBelief-Propagation Decoding of LDPC Codes
LDPC Codes: Motivation Belief-Propagation Decoding of LDPC Codes Amir Bennatan, Princeton University Revolution in coding theory Reliable transmission, rates approaching capacity. BIAWGN, Rate =.5, Threshold.45
More informationInternational Journal of Mathematical Archive-4(7), 2013, Available online through ISSN
International Journal of Mathematical Archive-4(7), 2013, 310-317 Available online through www.ijma.info ISSN 2229 5046 RESULT ON RADIATION EFFECTS ON A UNSTEADY MHD FLOW 1 M.V.S.S. Kiran Kumar*, 2 D.Atchutha
More informationQuantum Chosen-Ciphertext Attacks against Feistel Ciphers
SESSION ID: CRYP-R09 Quantum Chosen-Ciphertext Attacks against Feistel Ciphers Gembu Ito Nagoya University Joint work with Akinori Hosoyamada, Ryutaroh Matsumoto, Yu Sasaki and Tetsu Iwata Overview 3-round
More informationCHAPTER 5 Wave Properties of Matter and Quantum Mechanics I
CHAPTER 5 Wave Properties of Matter and Quantum Mechanics I 1 5.1 X-Ray Scattering 5.2 De Broglie Waves 5.3 Electron Scattering 5.4 Wave Motion 5.5 Waves or Particles 5.6 Uncertainty Principle Topics 5.7
More informationQUIZ 1 September 4, NAME: ACETONE Score: /10
QUIZ 1 September 4, 2015 NAME: AETONE Score: /10 Be sure to show proper units in every case.] 1. (5 points) Draw structures for the following molecules to the right of each name. 2 N O O 2S p-aminobenzoic
More informationTSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points)
IB PHYSICS Name: Period: Date: DEVIL PHYSICS BADDEST CLASS ON CAMPUS TSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points) 1. IB Assessment Statements for Topic 8.5.
More informationModule 4 (Lecture 16) SHALLOW FOUNDATIONS: ALLOWABLE BEARING CAPACITY AND SETTLEMENT
Topics Module 4 (Lecture 16) SHALLOW FOUNDATIONS: ALLOWABLE BEARING CAPACITY AND SETTLEMENT 1.1 STRIP FOUNDATION ON GRANULAR SOIL REINFORCED BY METALLIC STRIPS Mode of Failure Location of Failure Surface
More informationThe Elasticity of Quantum Spacetime Fabric. Viorel Laurentiu Cartas
The Elasticity of Quantum Spacetime Fabric Viorel Laurentiu Cartas The notion of gravitational force is replaced by the curvature of the spacetime fabric. The mass tells to spacetime how to curve and the
More informationON INFLUENCE OF SHEAR TRACTION ON HYDRAULIC FRACTURE PROPAGATION
Materials Physics and Mechanics 32 (2017) 272-277 Received: November 2, 2017 ON INFLUENCE OF SHEAR TRACTION ON HYDRAULIC FRACTURE PROPAGATION A. M. Linkov 1, 2 1 Rzeszow University of Technology, Poland
More informationClassical RSA algorithm
Classical RSA algorithm We need to discuss some mathematics (number theory) first Modulo-NN arithmetic (modular arithmetic, clock arithmetic) 9 (mod 7) 4 3 5 (mod 7) congruent (I will also use = instead
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationCHAPTER 4 Structure of the Atom
CHAPTER 4 Structure of the Atom Fall 2018 Prof. Sergio B. Mendes 1 Topics 4.1 The Atomic Models of Thomson and Rutherford 4.2 Rutherford Scattering 4.3 The Classic Atomic Model 4.4 The Bohr Model of the
More informationLimits to List Decoding Random Codes
Limits to List Decoding Random Codes Atri Rudra Department of Computer Science and Engineering, University at Buffalo, The State University of New York, Buffalo, NY, 14620. atri@cse.buffalo.edu Abstract
More informationCharged-Particle Interactions in Matter
Radiation Dosimetry Attix 8 Charged-Particle Interactions in Matter Ho Kyung Kim hokyung@pusan.ac.kr Pusan National University References F. H. Attix, Introduction to Radiological Physics and Radiation
More information10.4 The Cross Product
Math 172 Chapter 10B notes Page 1 of 9 10.4 The Cross Product The cross product, or vector product, is defined in 3 dimensions only. Let aa = aa 1, aa 2, aa 3 bb = bb 1, bb 2, bb 3 then aa bb = aa 2 bb
More informationLecture 11. Kernel Methods
Lecture 11. Kernel Methods COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture The kernel trick Efficient computation of a dot product
More informationThornton & Rex, 4th ed. Fall 2018 Prof. Sergio B. Mendes 1
Modern Physics for Scientists and Engineers Thornton & Rex, 4th ed. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 1 The Birth of Modern Physics Fall 2018 Prof. Sergio B. Mendes 2 Topics 1) Classical Physics
More informationRevision : Thermodynamics
Revision : Thermodynamics Formula sheet Formula sheet Formula sheet Thermodynamics key facts (1/9) Heat is an energy [measured in JJ] which flows from high to low temperature When two bodies are in thermal
More information