General Strong Polarization
|
|
- Derick McGee
- 5 years ago
- Views:
Transcription
1 General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 5, 018 Stanford: General Strong Polarization 1 of 0
2 This Talk: Martingales and Polarization [0,1]-Martingale: Sequence of r.v.s XX 0, XX 1, XX, XX tt 0,1, EE XX tt+1 XX 0,, XX tt = XX tt Well-studied in algorithms: [MotwaniRaghavan, 4.4], [MitzenmacherUpfal, 1] E.g., XX tt = Expected approx. factor of algorithm given first tt random choices. Usually study concentration E.g. whp XX final [XX 0 ± σσ] lim XX tt = NN(XX 0, σσ ) tt Today: Polarization: whp XX final εε, 1 εε lim XX tt = Bern XX 0 tt Why? Polar codes Oct. 5, 018 Stanford: General Strong Polarization of 0
3 Some examples XX tt+1 = XX tt + 4 tt w. p. 1 XX tt 4 tt w. p. 1 Converges! XX tt+1 = XX tt + tt w. p. 1 XX tt tt w. p. 1 Uniform on [0,1] XX tt+1 = XX tt w. p XX tt w. p. 1 if XX tt 1 if XX tt 1 Polarizes (weakly)! XX tt w. p. 1 if XX tt 1 XX tt+1 = XX tt XX tt w. p. 1 if XX tt 1 Polarizes (strongly)! Oct. 5, 018 Stanford: General Strong Polarization 3 of 0
4 Main Result: Definition and Theorem Strong Polarization: (informally) Pr XX tt (ττ, 1 ττ) εε if tt max OO(log 1/εε), oo(log 1/ττ) formally γγ > 0 ββ < 1, cc ss. tt. tt Pr XX tt (γγ tt, 1 γγ tt ) cc ββ tt Local Polarization: Both definitions qualitative! Variance in the middle: XX tt (ττ, 1 ττ) ττ > 0 σσ > 0 ss. tt. tt, XX tt ττ, 1 ττ VVVVVV XX tt+1 XX tt Suction at the ends: XX tt ττ, 1 ττ θθ > 0, cc <, ττ > 0 ss. tt. XX tt < ττ Pr XX tt+1 < XX tt cc σσ θθ Theorem: Local Polarization Strong Polarization. low end condition. Similar condition for high end Oct. 5, 018 Stanford: General Strong Polarization 4 of 0
5 Proof (Idea): Step 1: The potential Φ tt min XX tt, 1 XX tt decreases by constant factor in expectation in each step. EE Φ TT = exp TT Pr XX TT exp TT/ exp TT/ Step : Next TT time steps, XX tt plummets whp.1: Say, If XX tt ττ then Pr XX tt+1 XX tt 100 1/..: Pr tt TT, TT ss. tt. XX tt > ττ XX TT /ττ [Doob].3: If above doesn t happen XX TT < 5 TT whp QED Oct. 5, 018 Stanford: General Strong Polarization 5 of 0
6 Rest of the talk Background/Motivation: The Shannon Capacity Challenge Resolution by [Arikan 08], [Guruswami-Xia 13], [Hassani,Alishahi,Urbanke 13]: Polar Codes! Key ideas: Polar Codes & Arikan-Martingale. Implications of Weak/Strong Polarization. Our Contributions: Simplification & Generalization Local Polarization Strong Polarization Arikan-Martingale Locally Polarizes (generally) Oct. 5, 018 Stanford: General Strong Polarization 6 of 0
7 Shannon and Channel Capacity Shannon [ 48]: For every (noisy) channel of communication, capacity CC s.t. communication at rate RR < CC is possible and RR > CC is not. Needs lot of formalization omitted. Example: XX FF BBBBBB(pp) Acts independently on bits XX w.p. 1 pp 1 XX w.p. pp Capacity = 1 HH(pp) ; HH(pp) = binary entropy! Capacity? Encode:FF kk nn FF nn kk lim nn nn nn RR (Rate) HH pp = pp log 1 pp + 1 pp log 1 1 pp Oct. 5, 018 Stanford: General Strong Polarization 7 of 0
8 Achieving Channel Capacity Commonly used phrase. Many mathematical interpretations. Some possibilities: How small can nn be? Get RR > CC εε with polytime algorithms? [Luby et al. 95] Make running time poly nn εε? Open till 008 Shannon 48 : nn = OO CC RR Forney 66 :time = pppppppp nn, 1 εε Arikan 08: Invented Polar Codes Final resolution: Guruswami+Xia 13, Hassani+Alishahi+Urbanke 13 Strong analysis Oct. 5, 018 Stanford: General Strong Polarization 8 of 0
9 Polar Codes and Polarization Arikan: Defined Polar Codes, one for every tt Associated Martingale XX 0,, XX tt, ttth code: Length nn = tt If Pr XX tt γγ, 1 δδ εε then ttth code is εε + δδ - close to capacity, and Pr Decode Encode mm + eeeeeeeeee mm nn γγ Need γγ = oo 1 nn (strong polarization γγ = nnnnnn(nn)) Need εε = 1/nn Ω(1) ( strong polarization) Oct. 5, 018 Stanford: General Strong Polarization 9 of 0
10 Context for today s talk [Arikan 08]: Martingale associated to general class of codes. Martingale polarizes (weakly) implies code achieves capacity (weakly) Martingale polarizes weakly for entire class. [GX 13, HAU 13]: Strong polarization for one specific code. Why so specific? Bottleneck: Strong Polarization Rest of talk: Polar codes, Martingale and Strong Polarization Oct. 5, 018 Stanford: General Strong Polarization 10 of 0
11 Lesson 0: Compression Coding Defn: Linear Compression Scheme: HH, DD for compression scheme for bern pp nn if Linear map HH: FF nn FF mm Pr ZZ bern pp nn DD HH ZZ ZZ = oo 1 Hopefully mm HH pp + εε nn Compression Coding Let HH be such that HH HH = 0; Encoder: XX HH XX Error-Corrector: YY = HH XX + ZZ YY DD HH YY = YY DD HH HH XX + HH. ZZ = ww.pp. 1 oo(1) HH XX Oct. 5, 018 Stanford: General Strong Polarization 11 of 0
12 Question: How to compress? Arikan s key idea: Start with Polarization Transform : UU, VV UU + VV, VV Invertible so does nothing? If UU, VV independent, then UU + VV more random than either VV UU + VV less random than either Iterate (ignoring conditioning) End with bits that are almost random, or almost determined (by others). Output totally random part to get compression! Oct. 5, 018 Stanford: General Strong Polarization 1 of 0
13 Iteration elaborated: A Martingale: XX tt conditional entropy of A+B random A+B+C+D output after tt iterations B C B C+D C+D B+D D E F G D E+F F G+H D E+F+G+H G+H F+H H H H Oct. 5, 018 Stanford: General Strong Polarization 13 of 0
14 The Polarization Butterfly PP nn UU, VV = PPnn UU + VV, PPnn VV UU ZZ 1 ZZ ZZ ZZ + + WW 1 WW Polarization SS nn HH WW nn SS WW SS 0 SS HH pp + εε nn + ZZ nn WWnn Compression EE ZZ = PP nn ZZ SS VV WWnn +1 WWnn + Encoding time = OO nn log nn (given SS) To be shown: ZZ nn ZZ nn WW nn 1. Decoding = OO nn log nn. Polarization! Oct. 5, 018 Stanford: General Strong Polarization 14 of 0
15 The Polarization Butterfly: Decoding ZZ 1 ZZ ZZ ZZ + + WW 1 WW Decoding idea: Given SS, WW SS = PP nn UU, VV Compute UU + VV Bern pp pp Determine VV? VV UU + VV ii Bern(rr ii ) ZZ nn WWnn WWnn +1 WWnn + Key idea: Stronger induction! - non-identical product distribution Decoding Algorithm: Given SS, WW SS = PP nn UU, VV, pp 1,, pp nn - Compute qq 1,.. qqnn pp 1 pp nn ZZ nn ZZ nn WW nn - Determine UU + VV = DD WW SS +, qq 1 qqnn - Compute rr 1 rrnn pp 1 pp nn ; UU + VV - Determine VV = DD WW SS, rr 1 rrnn Oct. 5, 018 Stanford: General Strong Polarization 15 of 0
16 Polarization Martingale ZZ 1 ZZ ZZ ZZ + + WW 1 WW ZZ ii,0 ZZ ii,1 Z ii,tt ZZ ii,log nn Idea: Follow XX tt = HH ZZ ii,tt ZZ <ii,tt for random ii +1 + ZZ nn +1 + ZZ nn + ZZ nn WWnn WWnn +1 WWnn + WW nn XX tt Martingale! Polarizes? Strongly? Locally? Oct. 5, 018 Stanford: General Strong Polarization 16 of 0
17 Local Polarization of Arikan Martingale Variance in the Middle: Roughly: HH pp, HH pp (HH pp pp, HH pp HH pp pp ) pp ττ, 1 ττ pp pp far from pp + continuity of HH HH pp pp far from HH(pp) Suction: High end:hh 1 γγ HH 1 γγ HH 1 γγ = 1 Θ γγ 1 γγ 1 Θ γγ 4 Low end: HH pp pp log 1 ; HH pp pp log 1 ; pp pp HH pp pp HH pp pp log 1 pp HH pp pp 1 log 1 pp Dealing with conditioning more work (lots of Markov) HH pp Oct. 5, 018 Stanford: General Strong Polarization 17 of 0
18 New contributions So far: Reproduced old work (simpler proofs?) Main new technical contributions: Strong polarization of general transforms E.g. UU, VV, WW (UU + VV, VV, WW)? Exponentially strong polarization [BGS 18] Suction at low end is very strong! Random kk kk matrix yields XX tt+1 XX tt kk.99 whp Strong polarization of Markovian sources [GNS 19?] Separation of compression of known sources from unknown ones. Oct. 5, 018 Stanford: General Strong Polarization 18 of 0
19 Conclusions Polarization: Important phenomenon associated with bounded random variables. Not always bad Needs better understanding! Recently also used in CS: [Lovett Meka] implicit [Chattopadhyay-Hatami-Hosseini-Lovett] - explicit Oct. 5, 018 Stanford: General Strong Polarization 19 of 0
20 Thank You! Oct. 5, 018 Stanford: General Strong Polarization 0 of 0
General Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 8, 018 Berkeley:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) May 1, 018 G.Tech:
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) December 4, 2017 IAS:
More informationLocality in Coding Theory
Locality in Coding Theory Madhu Sudan Harvard April 9, 2016 Skoltech: Locality in Coding Theory 1 Error-Correcting Codes (Linear) Code CC FF qq nn. FF qq : Finite field with qq elements. nn block length
More informationLow-Degree Polynomials
Low-Degree Polynomials Madhu Sudan Harvard University October 7, 2016 Avi60!! Low-degree Polynomials 1 of 27 October 7, 2016 Avi60!! Low-degree Polynomials 2 of 27 Happy Birthday, Avi!! October 7, 2016
More informationUncertain Compression & Graph Coloring. Madhu Sudan Harvard
Uncertain Compression & Graph Coloring Madhu Sudan Harvard Based on joint works with: (1) Adam Kalai (MSR), Sanjeev Khanna (U.Penn), Brendan Juba (WUStL) (2) Elad Haramaty (Harvard) (3) Badih Ghazi (MIT),
More informationVariations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationProperty Testing and Affine Invariance Part I Madhu Sudan Harvard University
Property Testing and Affine Invariance Part I Madhu Sudan Harvard University December 29-30, 2015 IITB: Property Testing & Affine Invariance 1 of 31 Goals of these talks Part I Introduce Property Testing
More informationAlgebraic Codes and Invariance
Algebraic Codes and Invariance Madhu Sudan Harvard April 30, 2016 AAD3: Algebraic Codes and Invariance 1 of 29 Disclaimer Very little new work in this talk! Mainly: Ex- Coding theorist s perspective on
More informationCOMPRESSION FOR QUANTUM POPULATION CODING
COMPRESSION FOR QUANTUM POPULATION CODING Ge Bai, The University of Hong Kong Collaborative work with: Yuxiang Yang, Giulio Chiribella, Masahito Hayashi INTRODUCTION Population: A group of identical states
More informationLocal Decoding and Testing Polynomials over Grids
Local Decoding and Testing Polynomials over Grids Madhu Sudan Harvard University Joint work with Srikanth Srinivasan (IIT Bombay) January 11, 2018 ITCS: Polynomials over Grids 1 of 12 DeMillo-Lipton-Schwarz-Zippel
More informationHeteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Heteroskedasticity ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction For pedagogical reasons, OLS is presented initially under strong simplifying assumptions. One of these is homoskedastic errors,
More informationTwo Decades of Property Testing Madhu Sudan Harvard
Two Decades of Property Testing Madhu Sudan Harvard April 8, 2016 Two Decades of Property Testing 1 of 29 Kepler s Big Data Problem Tycho Brahe (~1550-1600): Wished to measure planetary motion accurately.
More informationECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations
ECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations Last Time Minimum Variance Unbiased Estimators Sufficient Statistics Proving t = T(x) is sufficient Neyman-Fischer Factorization
More informationLecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher
Lecture 3 STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher Previous lectures What is machine learning? Objectives of machine learning Supervised and
More informationLecture 11: Polar codes construction
15-859: Information Theory and Applications in TCS CMU: Spring 2013 Lecturer: Venkatesan Guruswami Lecture 11: Polar codes construction February 26, 2013 Scribe: Dan Stahlke 1 Polar codes: recap of last
More informationChapter 6 Reed-Solomon Codes. 6.1 Finite Field Algebra 6.2 Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding
Chapter 6 Reed-Solomon Codes 6. Finite Field Algebra 6. Reed-Solomon Codes 6.3 Syndrome Based Decoding 6.4 Curve-Fitting Based Decoding 6. Finite Field Algebra Nonbinary codes: message and codeword symbols
More informationModule 7 (Lecture 27) RETAINING WALLS
Module 7 (Lecture 27) RETAINING WALLS Topics 1.1 RETAINING WALLS WITH METALLIC STRIP REINFORCEMENT Calculation of Active Horizontal and vertical Pressure Tie Force Factor of Safety Against Tie Failure
More information1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. Ans: x = 4, x = 3, x = 2,
1. The graph of a function f is given above. Answer the question: a. Find the value(s) of x where f is not differentiable. x = 4, x = 3, x = 2, x = 1, x = 1, x = 2, x = 3, x = 4, x = 5 b. Find the value(s)
More informationChapter 22 : Electric potential
Chapter 22 : Electric potential What is electric potential? How does it relate to potential energy? How does it relate to electric field? Some simple applications What does it mean when it says 1.5 Volts
More informationMath, Stats, and Mathstats Review ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Math, Stats, and Mathstats Review ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Outline These preliminaries serve to signal to students what tools they need to know to succeed in ECON 360 and refresh their
More information" = Y(#,$) % R(r) = 1 4& % " = Y(#,$) % R(r) = Recitation Problems: Week 4. a. 5 B, b. 6. , Ne Mg + 15 P 2+ c. 23 V,
Recitation Problems: Week 4 1. Which of the following combinations of quantum numbers are allowed for an electron in a one-electron atom: n l m l m s 2 2 1! 3 1 0 -! 5 1 2! 4-1 0! 3 2 1 0 2 0 0 -! 7 2-2!
More informationControl of Mobile Robots
Control of Mobile Robots Regulation and trajectory tracking Prof. Luca Bascetta (luca.bascetta@polimi.it) Politecnico di Milano Dipartimento di Elettronica, Informazione e Bioingegneria Organization and
More informationSupport Vector Machines. CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington
Support Vector Machines CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 A Linearly Separable Problem Consider the binary classification
More informationLesson 24: True and False Number Sentences
NYS COMMON CE MATHEMATICS CURRICULUM Lesson 24 6 4 Student Outcomes Students identify values for the variables in equations and inequalities that result in true number sentences. Students identify values
More informationEstimate by the L 2 Norm of a Parameter Poisson Intensity Discontinuous
Research Journal of Mathematics and Statistics 6: -5, 24 ISSN: 242-224, e-issn: 24-755 Maxwell Scientific Organization, 24 Submied: September 8, 23 Accepted: November 23, 23 Published: February 25, 24
More informationTerms of Use. Copyright Embark on the Journey
Terms of Use All rights reserved. No part of this packet may be reproduced, stored in a retrieval system, or transmitted in any form by any means - electronic, mechanical, photo-copies, recording, or otherwise
More informationAngular Momentum, Electromagnetic Waves
Angular Momentum, Electromagnetic Waves Lecture33: Electromagnetic Theory Professor D. K. Ghosh, Physics Department, I.I.T., Bombay As before, we keep in view the four Maxwell s equations for all our discussions.
More informationList Decoding of Reed Solomon Codes
List Decoding of Reed Solomon Codes p. 1/30 List Decoding of Reed Solomon Codes Madhu Sudan MIT CSAIL Background: Reliable Transmission of Information List Decoding of Reed Solomon Codes p. 2/30 List Decoding
More informationGrover s algorithm. We want to find aa. Search in an unordered database. QC oracle (as usual) Usual trick
Grover s algorithm Search in an unordered database Example: phonebook, need to find a person from a phone number Actually, something else, like hard (e.g., NP-complete) problem 0, xx aa Black box ff xx
More informationError-Correcting Codes:
Error-Correcting Codes: Progress & Challenges Madhu Sudan Microsoft/MIT Communication in presence of noise We are not ready Sender Noisy Channel We are now ready Receiver If information is digital, reliability
More informationIntroduction to time series econometrics and VARs. Tom Holden PhD Macroeconomics, Semester 2
Introduction to time series econometrics and VARs Tom Holden http://www.tholden.org/ PhD Macroeconomics, Semester 2 Outline of today s talk Discussion of the structure of the course. Some basics: Vector
More informationReview for Exam Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa
57:020 Fluids Mechanics Fall2013 1 Review for Exam3 12. 11. 2013 Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa 57:020 Fluids Mechanics Fall2013 2 Chapter
More informationLecture 6. Notes on Linear Algebra. Perceptron
Lecture 6. Notes on Linear Algebra. Perceptron COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Notes on linear algebra Vectors
More informationA A A A A A A A A A A A. a a a a a a a a a a a a a a a. Apples taste amazingly good.
Victorian Handwriting Sheet Aa A A A A A A A A A A A A Aa Aa Aa Aa Aa Aa Aa a a a a a a a a a a a a a a a Apples taste amazingly good. Apples taste amazingly good. Now make up a sentence of your own using
More informationarxiv: v1 [cs.it] 9 Oct 2018
Polar Codes with exponentially small error at finite block length Jarosław Błasiok Venkatesan Guruswami Madhu Sudan arxiv:1810.04298v1 [cs.it] 9 Oct 2018 Abstract We show that the entire class of polar
More informationLecture 4: Codes based on Concatenation
Lecture 4: Codes based on Concatenation Error-Correcting Codes (Spring 206) Rutgers University Swastik Kopparty Scribe: Aditya Potukuchi and Meng-Tsung Tsai Overview In the last lecture, we studied codes
More informationWorksheets for GCSE Mathematics. Quadratics. mr-mathematics.com Maths Resources for Teachers. Algebra
Worksheets for GCSE Mathematics Quadratics mr-mathematics.com Maths Resources for Teachers Algebra Quadratics Worksheets Contents Differentiated Independent Learning Worksheets Solving x + bx + c by factorisation
More informationWork, Energy, and Power. Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition
Work, Energy, and Power Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 With the knowledge we got so far, we can handle the situation on the left but not the one on the right.
More informationPHY103A: Lecture # 4
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 4 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 10-Jan-2018 Notes The Solutions to HW # 1 have been
More informationWave Motion. Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition
Wave Motion Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Waves: propagation of energy, not particles 2 Longitudinal Waves: disturbance is along the direction of wave propagation
More informationRotational Motion. Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition
Rotational Motion Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 We ll look for a way to describe the combined (rotational) motion 2 Angle Measurements θθ ss rr rrrrrrrrrrrrrr
More informationMultiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Multiple Regression Analysis: Inference ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Introduction When you perform statistical inference, you are primarily doing one of two things: Estimating the boundaries
More informationPHY103A: Lecture # 9
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 9 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 20-Jan-2018 Summary of Lecture # 8: Force per unit
More informationSpecialist Mathematics 2019 v1.2
181314 Mensuration circumference of a circle area of a parallelogram CC = ππππ area of a circle AA = ππrr AA = h area of a trapezium AA = 1 ( + )h area of a triangle AA = 1 h total surface area of a cone
More informationQuantum Mechanics. An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc.
Quantum Mechanics An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 3 Experimental Basis of
More informationCHAPTER 2 Special Theory of Relativity
CHAPTER 2 Special Theory of Relativity Fall 2018 Prof. Sergio B. Mendes 1 Topics 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 2.10 2.11 2.12 2.13 2.14 Inertial Frames of Reference Conceptual and Experimental
More informationStatistical Learning with the Lasso, spring The Lasso
Statistical Learning with the Lasso, spring 2017 1 Yeast: understanding basic life functions p=11,904 gene values n number of experiments ~ 10 Blomberg et al. 2003, 2010 The Lasso fmri brain scans function
More informationIntroduction to Density Estimation and Anomaly Detection. Tom Dietterich
Introduction to Density Estimation and Anomaly Detection Tom Dietterich Outline Definition and Motivations Density Estimation Parametric Density Estimation Mixture Models Kernel Density Estimation Neural
More informationLecture 8: Shannon s Noise Models
Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 8: Shannon s Noise Models September 14, 2007 Lecturer: Atri Rudra Scribe: Sandipan Kundu& Atri Rudra Till now we have
More informationIntegrating Rational functions by the Method of Partial fraction Decomposition. Antony L. Foster
Integrating Rational functions by the Method of Partial fraction Decomposition By Antony L. Foster At times, especially in calculus, it is necessary, it is necessary to express a fraction as the sum of
More informationLecture 4: Proof of Shannon s theorem and an explicit code
CSE 533: Error-Correcting Codes (Autumn 006 Lecture 4: Proof of Shannon s theorem and an explicit code October 11, 006 Lecturer: Venkatesan Guruswami Scribe: Atri Rudra 1 Overview Last lecture we stated
More information9. Switched Capacitor Filters. Electronic Circuits. Prof. Dr. Qiuting Huang Integrated Systems Laboratory
9. Switched Capacitor Filters Electronic Circuits Prof. Dr. Qiuting Huang Integrated Systems Laboratory Motivation Transmission of voice signals requires an active RC low-pass filter with very low ff cutoff
More informationHeat, Work, and the First Law of Thermodynamics. Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition
Heat, Work, and the First Law of Thermodynamics Chapter 18 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Different ways to increase the internal energy of system: 2 Joule s apparatus
More informationPatterns of soiling in the Old Library Trinity College Dublin. Allyson Smith, Robbie Goodhue, Susie Bioletti
Patterns of soiling in the Old Library Trinity College Dublin Allyson Smith, Robbie Goodhue, Susie Bioletti Trinity College aerial view Old Library E N S W Old Library main (south) elevation Gallery Fagel
More informationCharge carrier density in metals and semiconductors
Charge carrier density in metals and semiconductors 1. Introduction The Hall Effect Particles must overlap for the permutation symmetry to be relevant. We saw examples of this in the exchange energy in
More informationNumber Representations
Computer Arithmetic Algorithms Prof. Dae Hyun Kim School of Electrical Engineering and Computer Science Washington State University Number Representations Information Textbook Israel Koren, Computer Arithmetic
More informationOn The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time Delays
Journal of Mathematics and System Science 6 (216) 194-199 doi: 1.17265/2159-5291/216.5.3 D DAVID PUBLISHING On The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time
More informationInternational Journal of Mathematical Archive-5(3), 2014, Available online through ISSN
International Journal of Mathematical Archive-5(3), 214, 189-195 Available online through www.ijma.info ISSN 2229 546 COMMON FIXED POINT THEOREMS FOR OCCASIONALLY WEAKLY COMPATIBLE MAPPINGS IN INTUITIONISTIC
More informationReview for Exam Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa
Review for Exam3 12. 9. 2015 Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa Assistant Research Scientist IIHR-Hydroscience & Engineering, University
More information(1) Introduction: a new basis set
() Introduction: a new basis set In scattering, we are solving the S eq. for arbitrary VV in integral form We look for solutions to unbound states: certain boundary conditions (EE > 0, plane and spherical
More informationReview for Exam Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa
Review for Exam2 11. 13. 2015 Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa Assistant Research Scientist IIHR-Hydroscience & Engineering, University
More informationExtreme value statistics: from one dimension to many. Lecture 1: one dimension Lecture 2: many dimensions
Extreme value statistics: from one dimension to many Lecture 1: one dimension Lecture 2: many dimensions The challenge for extreme value statistics right now: to go from 1 or 2 dimensions to 50 or more
More informationModule 7 (Lecture 25) RETAINING WALLS
Module 7 (Lecture 25) RETAINING WALLS Topics Check for Bearing Capacity Failure Example Factor of Safety Against Overturning Factor of Safety Against Sliding Factor of Safety Against Bearing Capacity Failure
More informationA new procedure for sensitivity testing with two stress factors
A new procedure for sensitivity testing with two stress factors C.F. Jeff Wu Georgia Institute of Technology Sensitivity testing : problem formulation. Review of the 3pod (3-phase optimal design) procedure
More informationSECTION 7: STEADY-STATE ERROR. ESE 499 Feedback Control Systems
SECTION 7: STEADY-STATE ERROR ESE 499 Feedback Control Systems 2 Introduction Steady-State Error Introduction 3 Consider a simple unity-feedback system The error is the difference between the reference
More informationLecture 3. Linear Regression
Lecture 3. Linear Regression COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne Weeks 2 to 8 inclusive Lecturer: Andrey Kan MS: Moscow, PhD:
More informationA linear operator of a new class of multivalent harmonic functions
International Journal of Scientific Research Publications, Volume 7, Issue 8, August 2017 278 A linear operator of a new class of multivalent harmonic functions * WaggasGalibAtshan, ** Ali Hussein Battor,
More informationName: Discussion Section:
CBE 141: Chemical Engineering Thermodynamics, Spring 2018, UC Berkeley Midterm 2 March 22, 2018 Time: 80 minutes, closed-book and closed-notes, one-sided 8 ½ x 11 equation sheet allowed Please show all
More informationBig Bang Planck Era. This theory: cosmological model of the universe that is best supported by several aspects of scientific evidence and observation
Big Bang Planck Era Source: http://www.crystalinks.com/bigbang.html Source: http://www.odec.ca/index.htm This theory: cosmological model of the universe that is best supported by several aspects of scientific
More informationQuantum Chosen-Ciphertext Attacks against Feistel Ciphers
SESSION ID: CRYP-R09 Quantum Chosen-Ciphertext Attacks against Feistel Ciphers Gembu Ito Nagoya University Joint work with Akinori Hosoyamada, Ryutaroh Matsumoto, Yu Sasaki and Tetsu Iwata Overview 3-round
More informationCHAPTER 5 Wave Properties of Matter and Quantum Mechanics I
CHAPTER 5 Wave Properties of Matter and Quantum Mechanics I 1 5.1 X-Ray Scattering 5.2 De Broglie Waves 5.3 Electron Scattering 5.4 Wave Motion 5.5 Waves or Particles 5.6 Uncertainty Principle Topics 5.7
More informationThe Elasticity of Quantum Spacetime Fabric. Viorel Laurentiu Cartas
The Elasticity of Quantum Spacetime Fabric Viorel Laurentiu Cartas The notion of gravitational force is replaced by the curvature of the spacetime fabric. The mass tells to spacetime how to curve and the
More informationTSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points)
IB PHYSICS Name: Period: Date: DEVIL PHYSICS BADDEST CLASS ON CAMPUS TSOKOS READING ACTIVITY Section 7-2: The Greenhouse Effect and Global Warming (8 points) 1. IB Assessment Statements for Topic 8.5.
More informationModule 4 (Lecture 16) SHALLOW FOUNDATIONS: ALLOWABLE BEARING CAPACITY AND SETTLEMENT
Topics Module 4 (Lecture 16) SHALLOW FOUNDATIONS: ALLOWABLE BEARING CAPACITY AND SETTLEMENT 1.1 STRIP FOUNDATION ON GRANULAR SOIL REINFORCED BY METALLIC STRIPS Mode of Failure Location of Failure Surface
More informationON INFLUENCE OF SHEAR TRACTION ON HYDRAULIC FRACTURE PROPAGATION
Materials Physics and Mechanics 32 (2017) 272-277 Received: November 2, 2017 ON INFLUENCE OF SHEAR TRACTION ON HYDRAULIC FRACTURE PROPAGATION A. M. Linkov 1, 2 1 Rzeszow University of Technology, Poland
More informationGradient expansion formalism for generic spin torques
Gradient expansion formalism for generic spin torques Atsuo Shitade RIKEN Center for Emergent Matter Science Atsuo Shitade, arxiv:1708.03424. Outline 1. Spintronics a. Magnetoresistance and spin torques
More informationClassical RSA algorithm
Classical RSA algorithm We need to discuss some mathematics (number theory) first Modulo-NN arithmetic (modular arithmetic, clock arithmetic) 9 (mod 7) 4 3 5 (mod 7) congruent (I will also use = instead
More information3. Mathematical Modelling
3. Mathematical Modelling 3.1 Modelling principles 3.1.1 Model types 3.1.2 Model construction 3.1.3 Modelling from first principles 3.2 Models for technical systems 3.2.1 Electrical systems 3.2.2 Mechanical
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationSECTION 5: POWER FLOW. ESE 470 Energy Distribution Systems
SECTION 5: POWER FLOW ESE 470 Energy Distribution Systems 2 Introduction Nodal Analysis 3 Consider the following circuit Three voltage sources VV sss, VV sss, VV sss Generic branch impedances Could be
More informationLimits to List Decoding Random Codes
Limits to List Decoding Random Codes Atri Rudra Department of Computer Science and Engineering, University at Buffalo, The State University of New York, Buffalo, NY, 14620. atri@cse.buffalo.edu Abstract
More informationCHAPTER 4 Structure of the Atom
CHAPTER 4 Structure of the Atom Fall 2018 Prof. Sergio B. Mendes 1 Topics 4.1 The Atomic Models of Thomson and Rutherford 4.2 Rutherford Scattering 4.3 The Classic Atomic Model 4.4 The Bohr Model of the
More informationLecture 11. Kernel Methods
Lecture 11. Kernel Methods COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture The kernel trick Efficient computation of a dot product
More informationCharged-Particle Interactions in Matter
Radiation Dosimetry Attix 8 Charged-Particle Interactions in Matter Ho Kyung Kim hokyung@pusan.ac.kr Pusan National University References F. H. Attix, Introduction to Radiological Physics and Radiation
More information10.4 The Cross Product
Math 172 Chapter 10B notes Page 1 of 9 10.4 The Cross Product The cross product, or vector product, is defined in 3 dimensions only. Let aa = aa 1, aa 2, aa 3 bb = bb 1, bb 2, bb 3 then aa bb = aa 2 bb
More informationA Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions
Lin Lin A Posteriori DG using Non-Polynomial Basis 1 A Posteriori Error Estimates For Discontinuous Galerkin Methods Using Non-polynomial Basis Functions Lin Lin Department of Mathematics, UC Berkeley;
More informationUnit WorkBook 2 Level 4 ENG U13 Fundamentals of Thermodynamics and Heat Engines UniCourse LTD. All Rights Reserved. Sample
Pearson BTEC Levels 4 Higher Nationals in Engineering (RQF) Unit 13: Fundamentals of Thermodynamics and Heat Engines Unit Workbook 2 in a series of 4 for this unit Learning Outcome 2 Plant Equipment Page
More informationContinuous Random Variables
Continuous Random Variables Page Outline Continuous random variables and density Common continuous random variables Moment generating function Seeking a Density Page A continuous random variable has an
More informationTime Domain Analysis of Linear Systems Ch2. University of Central Oklahoma Dr. Mohamed Bingabr
Time Domain Analysis of Linear Systems Ch2 University of Central Oklahoma Dr. Mohamed Bingabr Outline Zero-input Response Impulse Response h(t) Convolution Zero-State Response System Stability System Response
More informationAPPROXIMATING A COMMON SOLUTION OF A FINITE FAMILY OF GENERALIZED EQUILIBRIUM AND FIXED POINT PROBLEMS
SINET: Ethiop. J. Sci., 38():7 28, 205 ISSN: 0379 2897 (Print) College of Natural Sciences, Addis Ababa University, 205 2520 7997 (Online) APPROXIMATING A COMMON SOLUTION OF A FINITE FAMILY OF GENERALIZED
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More informationMultiple Regression Analysis: Estimation ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
Multiple Regression Analysis: Estimation ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Outline Motivation. Mechanics and Interpretation. Expected Values and Variances of the Estimators. Motivation for multiple
More informationChapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell
Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea
More informationLise Meitner, Otto Hahn. Nuclear Fission Hans-Jürgen Wollersheim
Lise Meitner, Otto Hahn Nuclear Fission Hans-Jürgen Wollersheim Details of the 252 Cf decay α s: 96.9% SF: 3.1% T 1/2 = 2.647 a Q α = 6.217 MeV E α = 6.118 MeV α α α α α-decay of 252 Cf Mass data: nucleardata.nuclear.lu.se/database/masses/
More informationLecture 3 Optimization methods for econometrics models
Lecture 3 Optimization methods for econometrics models Cinzia Cirillo University of Maryland Department of Civil and Environmental Engineering 06/29/2016 Summer Seminar June 27-30, 2016 Zinal, CH 1 Overview
More informationApproximate Second Order Algorithms. Seo Taek Kong, Nithin Tangellamudi, Zhikai Guo
Approximate Second Order Algorithms Seo Taek Kong, Nithin Tangellamudi, Zhikai Guo Why Second Order Algorithms? Invariant under affine transformations e.g. stretching a function preserves the convergence
More informationRecurrence Relations
Recurrence Relations Recurrence Relations Reading (Epp s textbook) 5.6 5.8 1 Recurrence Relations A recurrence relation for a sequence aa 0, aa 1, aa 2, ({a n }) is a formula that relates each term a k
More informationNon-Parametric Weighted Tests for Change in Distribution Function
American Journal of Mathematics Statistics 03, 3(3: 57-65 DOI: 0.593/j.ajms.030303.09 Non-Parametric Weighted Tests for Change in Distribution Function Abd-Elnaser S. Abd-Rabou *, Ahmed M. Gad Statistics
More information