ECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations
|
|
- Todd Holmes
- 5 years ago
- Views:
Transcription
1 ECE 6540, Lecture 06 Sufficient Statistics & Complete Statistics Variations
2 Last Time Minimum Variance Unbiased Estimators Sufficient Statistics Proving t = T(x) is sufficient Neyman-Fischer Factorization 2
3 Practice Consider yy = xx + ww ww ~ NN 00, ΣΣ What is the distribution of yy yy + 11σσ 2 yy/nn HHHH HHyy yy TT HH yytt 11 NN yy TT xx xx TT ΛΛyy 3
4 Neyman-Fischer Factorization Let s reconsider the XX 1, XX 2, XX 3, XX NN ~ iid NN μμ, σσ 2 With unknown θθ = μμ σσ 2 pp xx; θθ = = 1 1 exp xx μμ11 2 2ππσσ2 NN/2 2σσ2 1 1 exp 2ππσσ2 NN/2 2σσ 2 xxtt xx 2μμxx TT 11 + NNμμ 2 Are these sufficient statistics for μμ and/or σσ 2? xx TT 11 xx TT xx xx μμ11 2 xx TT xx 2μμxx TT 11 xx TT xx xx TT 11/NN xx xxtt 11 NN xx TT xx 2xx TT 11 xx TT 11 xx TT xx 4
5 Neyman-Fischer Factorization Let s reconsider the XX 1, XX 2, XX 3, XX NN ~ iid NN μμ, σσ 2 With unknown θθ = μμ σσ 2 pp xx; θθ = = 1 1 exp xx μμ11 2 2ππσσ2 NN/2 2σσ2 1 1 exp 2ππσσ2 NN/2 2σσ 2 xxtt xx 2μμxx TT 11 + NNμμ 2 Are these sufficient statistics for μμ or σσ 2? xx TT 11 xx TT xx xx μμ11 2 xx TT xx 2μμxx TT 11 xx TT xx 2xx TT 11 xx TT 11 xx TT xx xx TT xx xx TT 11/NN xx xxtt 11 NN = xx TT 11/NN xx TT xx 2 xxtt NN Contains only xx TT 11 and xx TT xx + xxtt
6 Last Time Consider the random variables XX 1, XX 2, XX 3, XX NN are iid such that XX ii 1,2,3,, MM Pr XX = ii = pp ii θθ = pp 1 pp 2 pp MM What is this describing? 6
7 Practice Consider the random variables XX 1, XX 2, XX 3, XX NN are iid such that XX ii 1,2,3,, MM Pr XX = ii = pp ii θθ = pp 1 pp 2 pp MM δδ pp xx; θθ = pp xx 1 δδ 1 pp xx 2 δδ 2 pp xx 3 δδ xx MM 3 pp MM 7
8 Practice Consider the random variables XX 1, XX 2, XX 3, XX NN are iid such that XX ii 1,2,3,, MM Pr XX = ii = pp ii θθ = pp 1 pp 2 pp MM δδ pp xx; θθ = pp xx 1 δδ 1 pp xx 2 δδ 2 pp xx 3 δδ xx MM 3 pp MM pp xx; θθ = NN nn=1 pp xx; θθ = pp NN nn=1 1 pp 1 δδ xx nn 1 pp2 δδ xx nn 2 pp3 δδ xx nn 3 ppmm δδ xx nn MM δδ xx ii 1 NN nn=1 pp2 δδ xx ii 2 NN nn=1 pp3 δδ xx ii 3 NN nn=1 ppmm δδ xx ii MM gg TT xx = NN nn=1 δδ xx ii 1 A Histogram!!! NN nn=1 δδ xx ii MM ; θθ 8
9 Practice Beta Distribution Example Let s consider the XX 1, XX 2, XX 3, XX NN ~ iid Beta αα, ββ with unknown ββ p xx ii ; ββ = 1 BB αα,ββ xx ii αα 1 1 xx ii ββ 1 for 0 xx ii 1 Determine a sufficient statistic for ββ See Homework!! Source: 9
10 Neyman-Fischer Factorization Note about minimum sufficient statistics Kay s definition is misleading According to Kay: The data set that contains the least number of elements is called the minimal one. More correct definition A sufficient statistic SS(xx) is minimal sufficient if there exists a function ff such that SS(XX) = ff(tt(xx)) for any sufficient statistic TT(XX) That is, if a function of any other sufficient statistic from can make SS(XX), then SS(XX) is a minimal sufficient statistic 10
11 Using Sufficient Statistics to Find the MVU Estimator
12 Rao-Blackwell-Lehmann-Scheffe Theorem If θθ is an unbiased estimator of θθ and TT xx is a sufficient statistic for θθ, then θθ = E θθ TT xx is 1) A valid estimator for θθ (not dependent on θθ) 2) Unbiased TT xx represents more information 3) Of lesser or equal variance than that of θθ, for all θθ (each element of θθ has lesser or equal variance) 4) If the sufficient statistic is complete, then θθ is the MVU estimator 12
13 Rao-Blackwell-Lehmann-Scheffe Theorem If θθ is an unbiased estimator of θθ and TT xx is a sufficient statistic for θθ, then θθ = E θθ TT xx is. Use another Use another suff. statistic suff. statistic TT 1 xx TT 2 xx θθ 1 θθ 2 A smaller variance estimate! θθ 3 A smaller variance estimate! Use another suff. statistic TT 3 xx θθ 4 A smaller variance estimate! θθ Smallest variance estimate! 13
14 Rao-Blackwell-Lehmann-Scheffe Theorem If θθ is an unbiased estimator of θθ and TT xx is a sufficient statistic for θθ, then θθ = E θθ TT xx is. Use a complete statistic TT 1 xx θθ 1 θθ Smallest variance estimate! 14
15 Using Complete, Sufficient Statistics to Find the MVU Estimator
16 A Complete Statistics A statistic is complete if there is only one function gg of the statistic t = TT xx that is unbiased. That is, A statistic is complete if only one gg exists such that EE gg TT xx = θθ 16
17 Procedure for finding the MVU Estimator (using sufficient statistics) 1. Find a sufficient statistic TT xx using the Neyman-Fisher factorization 2. Show that TT xx is complete (if not, stop) 3. The MVU estimator is 1. θθ = EE θθ TT xx where θθ is any unbiased estimator for θθ Variance Space of all unbiased estimators Space of all sufficient unbiased estimators MVUB estimator In the end though, proving that a statistic TT xx is complete is difficult 17
18 Example: Consider the signal xx = AA11 + ww ww ~ NN 0, IIσσ 22 Show that tt = TT xx = NN nn=1 xx ii is complete. DC voltage 18
19 Example: Consider the signal xx = AA11 + ww ww ~ NN 0, IIσσ 22 Show that tt = TT xx = NN nn=1 xx ii is complete. DC voltage Assume the exists a function gg such that E gg tt = AA Assume there exists a second function h such that E h tt = AA Then E gg tt h tt = AA AA = 0 Let vv tt = gg tt h tt Then E vv tt = vv tt pp tt; θθ ddtt = 0 19
20 Example: Consider the signal xx = AA11 + ww ww ~ NN 0, IIσσ 22 Show that tt = TT xx = NN nn=1 xx ii is complete. DC voltage Then E vv tt = vv tt pp tt; θθ ddtt = 0 tt ~ NN NNNN, NNσσ 22, so E vv tt = vv tt 1 2 ππππ σσ 2 exp tt NNNN 2 2NNσσ 2 dddd = 0 If ττ = tt, E vv tt = NN vv ττ NN 2 ππππ σσ NN exp AA ττ 2 ddττ = 0 2 2σσ 2 vvv ττ ff AA ττ 20
21 Example: Consider the signal xx = AA11 + ww ww ~ NN 0, IIσσ 22 Show that tt = TT xx = NN nn=1 xx ii is complete. DC voltage If ττ = tt, E vv tt = NN vv ττ vvv ττ NN 2 ππππ σσ NN exp AA ττ 2 ddττ = 0 2 2σσ 2 ff AA ττ E vv tt = vv ττ ff AA ττ dddd = vv ττ ff ττ = 0 VV ωω FF ωω = 0 21
22 Example: Consider the signal xx = AA11 + ww ww ~ NN 0, IIσσ 22 Show that tt = TT xx = NN nn=1 xx ii is complete. DC voltage VV ωω FF ωω = 0 Fourier Transform of a Gaussian is Gaussian, so not zero Therefore, VV ωω = 0 vv ττ = 0 vv tt = 0 gg tt h tt = 0 Hence gg tt = h tt -> There can only be one unbiased function! TT xx is a complete statistic! 22
23 A Complete Statistics A statistic is complete if there is only one function gg of the statistic t = TT xx that is unbiased. That is, A statistic is complete if only one gg exists such that EE gg TT xx = θθ Alternatively, A statistic is complete if vv tt pp tt; θθ ddtt = EE vv TT xx = 0, for all θθ Is satisfied only when vv tt = 0 for all tt = TT xx. 23
24 There is one simplification Consider the Fischer Factorization: pp xx; θθ = gg tt; θθ h xx If gg tt; θθ has the form gg tt; θθ = cc θθ exp aa kk θθ tt kk KK kk=1 Then pp xx; θθ and pp tt; θθ are said to be in the exponential family And tt = TT xx is a complete, sufficient statistic Many common PDFs satisfy this. 24
25 Example: Are the following distributions in the exponential family? Exponential: pp xx; λλ = λλee λλλλ, xx 0 0, xx < 0 Gamma: pp xx; kk, θθ = xkk 1 ee xx θθ θθ kk Γ kk Gaussian: pp xx; μμ, σσ 2 = 2ππσσ /2 exp 2 xx μμ 2 2σσ 25
26 Example Let XX 1, XX 2, XX 3, XX NN ~ iid Bernoulli θθ Determine a complete, sufficient statistics for θθ Determine an MVUB Estimator 26
27 Example Let XX 1, XX 2, XX 3, XX NN ~ iid Bernoulli θθ NN pp xx; θθ = ii=1 θθ xx ii θθ 1 1 xx ii = θθ NN ii=1 xxii 1 θθ NN NN ii=1 xxii tt tt = 1 1 θθ NN θθ 1 θθ h xx Hence, NN ii=1 gg ii=1 NN TT xx = xx ii ; θθ NN xxii = 1 1 θθ NN exp ii=1 xx ii is a complete sufficient statistic NN ii=1 xx ii gg tt; θθ = cc θθ exp log θθ 1 θθ KK aa kk θθ tt kk kk=1 27
28 Example Let XX 1, XX 2, XX 3, XX NN ~ iid Bernoulli θθ The expected value of the sufficient statistic is NN EE tt = EE ii=1 xx ii NN = EE xx ii ii=1 = NNθθ Therefore tt is an unbiased estimator. Since t is complete, it is also MVUB. So the NN MVUB estimator is NN θθ = ii=1 xx ii 28
29 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, 1 Determine a complete, sufficient statistic for θθ 29
30 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, 1 pp xx; θθ = 1 2ππ NN/2 exp 1 2 xx θθ11 2 = 1 2ππ NN/2 exp 1 2 xxtt xx 2θθxx TT 11 + NNθθ 2 = 1 2ππ NN/2 exp 1 2 2θθxxTT 11 + NNθθ 2 exp xxtt xx 2 = 1 2ππ NN/2 exp 1 2 2θθθθ xx + NNθθ2 exp xxtt xx 2 gg TT xx = xx TT 11; θθ h xx = cc θθ exp aa kk θθ tt kk KK kk=1 30
31 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, 1 The unbiased complete, sufficient statistic is xx TT 11/NN Hence the MVUB estimator is θθ = xx TT 11/NN 31
32 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, σσ 2 with unknown θθ, σσ 2 Determine a complete, sufficient statistic for θθ and σσ 2 32
33 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, σσ 2 with unknown θθ, σσ 2 pp xx; θθ = = 1 1 exp xx θθ11 2 2ππσσ2 NN/2 2σσ2 1 1 exp 2ππσσ2 NN/2 2σσ 2 xxtt xx 2θθxx TT 11 + NNθθ 2 = 1 2ππσσ 2 NN 2 exp 1 2σσ 2 TT 2 xx 2θθTT 1 xx + NNθθ 2 1 gg tt = xxtt 11 xx TT xx ; θθ σσ 2 h xx gg tt; θθ = cc θθ exp KK aa kk θθ tt kk kk=1 33
34 Example Let XX 1, XX 2, XX 3, XX NN ~ iid NN θθ, σσ 2 with unknown θθ, σσ 2 The unbiased complete, sufficient statistic for θθ is xx TT 11/NN The unbiased complete, sufficient statistic for σσ 2 is xx xxtt 11 NN Hence the MVUB estimators are θθ = xx TT 11/NN σσ 2 = xx xxtt 11 NN
35 Beta Distribution Example Let s consider the XX 1, XX 2, XX 3, XX NN ~ iid Beta αα, ββ with unknown ββ p xx ii ; ββ = 1 BB αα,ββ xx ii αα 1 1 xx ii ββ 1 for 0 xx ii 1 Determine a complete, sufficient statistic for ββ See Homework!!! 35
36 Consider XX 1, XX 2, XX 3, XX NN ~ iid exponential λλ The statistic NN tt = nn=1 Is a complete, sufficient statistic for λλ. What is the MVUB estimator? xx nn 36
37 Consider XX 1, XX 2, XX 3, XX NN ~ iid exponential λλ The statistic NN tt = nn=1 Is a complete, sufficient statistic for λλ. What is the MVUB estimator? tt~erlang NN, λλ or Gamma NN, 1 λλ xx nn EE tt = 1 λλ 1 tt ~ InvGamma NN, λλ EE 1 = λλ = λλ 1 tt NN 1 NN 1 So the MVUB estimator is λλ = NN 1 1 NN nn=1 xx nn 37
38 Procedure for finding the MVU Estimator (using sufficient statistics) For xx = AA11 + ww, ww ~ NN 0, IIσσ Find a sufficient statistic TT xx using the Neyman-Fisher factorization 2. Show that TT xx is complete (if not, stop) 3. The MVU estimator is 1. θθ = EE θθ TT xx where θθ is any unbiased estimator for θθ
39 In the end, Applying Neyman-Fisher factorization can be difficult Proving that a statistic is complete can be difficult (unless you have an exponential family PDF) Applying Rao-Blackwell-Lehmann-Scheffe Theorem can be difficult What else can we do???? 39
Variations. ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra
Variations ECE 6540, Lecture 02 Multivariate Random Variables & Linear Algebra Last Time Probability Density Functions Normal Distribution Expectation / Expectation of a function Independence Uncorrelated
More informationVariations. ECE 6540, Lecture 10 Maximum Likelihood Estimation
Variations ECE 6540, Lecture 10 Last Time BLUE (Best Linear Unbiased Estimator) Formulation Advantages Disadvantages 2 The BLUE A simplification Assume the estimator is a linear system For a single parameter
More informationContinuous Random Variables
Continuous Random Variables Page Outline Continuous random variables and density Common continuous random variables Moment generating function Seeking a Density Page A continuous random variable has an
More informationTime Domain Analysis of Linear Systems Ch2. University of Central Oklahoma Dr. Mohamed Bingabr
Time Domain Analysis of Linear Systems Ch2 University of Central Oklahoma Dr. Mohamed Bingabr Outline Zero-input Response Impulse Response h(t) Convolution Zero-State Response System Stability System Response
More information(1) Correspondence of the density matrix to traditional method
(1) Correspondence of the density matrix to traditional method New method (with the density matrix) Traditional method (from thermal physics courses) ZZ = TTTT ρρ = EE ρρ EE = dddd xx ρρ xx ii FF = UU
More informationCHAPTER 5 Wave Properties of Matter and Quantum Mechanics I
CHAPTER 5 Wave Properties of Matter and Quantum Mechanics I 1 5.1 X-Ray Scattering 5.2 De Broglie Waves 5.3 Electron Scattering 5.4 Wave Motion 5.5 Waves or Particles 5.6 Uncertainty Principle Topics 5.7
More informationEE 341 A Few Review Problems Fall 2018
EE 341 A Few Review Problems Fall 2018 1. A linear, time-invariant system with input, xx(tt), and output, yy(tt), has the unit-step response, cc(tt), shown below. a. Find, and accurately sketch, the system
More informationAngular Momentum, Electromagnetic Waves
Angular Momentum, Electromagnetic Waves Lecture33: Electromagnetic Theory Professor D. K. Ghosh, Physics Department, I.I.T., Bombay As before, we keep in view the four Maxwell s equations for all our discussions.
More informationEE120 Fall 2016 HOMEWORK 3 Solutions. Problem 1 Solution. 1.a. GSI: Phillip Sandborn
EE Fall 6 HOMEWORK 3 Solutions GSI: Phillip Sandborn Problem Solution For each solution, draw xx(ττ) and flip around ττ =, then slide the result across h(ττ)..a. .b Use the same x as part a. .c .d Analytical
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) December 4, 2017 IAS:
More informationLecture 3. STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher
Lecture 3 STAT161/261 Introduction to Pattern Recognition and Machine Learning Spring 2018 Prof. Allie Fletcher Previous lectures What is machine learning? Objectives of machine learning Supervised and
More informationWave Motion. Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition
Wave Motion Chapter 14 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Waves: propagation of energy, not particles 2 Longitudinal Waves: disturbance is along the direction of wave propagation
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Gurswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) May 1, 018 G.Tech:
More informationCharge carrier density in metals and semiconductors
Charge carrier density in metals and semiconductors 1. Introduction The Hall Effect Particles must overlap for the permutation symmetry to be relevant. We saw examples of this in the exchange energy in
More informationChapter 5: Spectral Domain From: The Handbook of Spatial Statistics. Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell
Chapter 5: Spectral Domain From: The Handbook of Spatial Statistics Dr. Montserrat Fuentes and Dr. Brian Reich Prepared by: Amanda Bell Background Benefits of Spectral Analysis Type of data Basic Idea
More information(1) Introduction: a new basis set
() Introduction: a new basis set In scattering, we are solving the S eq. for arbitrary VV in integral form We look for solutions to unbound states: certain boundary conditions (EE > 0, plane and spherical
More informationMath 171 Spring 2017 Final Exam. Problem Worth
Math 171 Spring 2017 Final Exam Problem 1 2 3 4 5 6 7 8 9 10 11 Worth 9 6 6 5 9 8 5 8 8 8 10 12 13 14 15 16 17 18 19 20 21 22 Total 8 5 5 6 6 8 6 6 6 6 6 150 Last Name: First Name: Student ID: Section:
More informationModule 7 (Lecture 27) RETAINING WALLS
Module 7 (Lecture 27) RETAINING WALLS Topics 1.1 RETAINING WALLS WITH METALLIC STRIP REINFORCEMENT Calculation of Active Horizontal and vertical Pressure Tie Force Factor of Safety Against Tie Failure
More informationRotational Motion. Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition
Rotational Motion Chapter 10 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 We ll look for a way to describe the combined (rotational) motion 2 Angle Measurements θθ ss rr rrrrrrrrrrrrrr
More informationChemical Engineering 412
Chemical Engineering 412 Introductory Nuclear Engineering Lecture 7 Nuclear Decay Behaviors Spiritual Thought Sooner or later, I believe that all of us experience times when the very fabric of our world
More informationA Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter
A Step Towards the Cognitive Radar: Target Detection under Nonstationary Clutter Murat Akcakaya Department of Electrical and Computer Engineering University of Pittsburgh Email: akcakaya@pitt.edu Satyabrata
More informationGradient expansion formalism for generic spin torques
Gradient expansion formalism for generic spin torques Atsuo Shitade RIKEN Center for Emergent Matter Science Atsuo Shitade, arxiv:1708.03424. Outline 1. Spintronics a. Magnetoresistance and spin torques
More informationWork, Energy, and Power. Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition
Work, Energy, and Power Chapter 6 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 With the knowledge we got so far, we can handle the situation on the left but not the one on the right.
More informationRadial Basis Function (RBF) Networks
CSE 5526: Introduction to Neural Networks Radial Basis Function (RBF) Networks 1 Function approximation We have been using MLPs as pattern classifiers But in general, they are function approximators Depending
More information1. (Regular) Exponential Family
1. (Regular) Exponential Family The density function of a regular exponential family is: [ ] Example. Poisson(θ) [ ] Example. Normal. (both unknown). ) [ ] [ ] [ ] [ ] 2. Theorem (Exponential family &
More information2.4 Error Analysis for Iterative Methods
2.4 Error Analysis for Iterative Methods 1 Definition 2.7. Order of Convergence Suppose {pp nn } nn=0 is a sequence that converges to pp with pp nn pp for all nn. If positive constants λλ and αα exist
More informationCDS 101/110: Lecture 6.2 Transfer Functions
CDS 11/11: Lecture 6.2 Transfer Functions November 2, 216 Goals: Continued study of Transfer functions Review Laplace Transform Block Diagram Algebra Bode Plot Intro Reading: Åström and Murray, Feedback
More informationLecture 3 Optimization methods for econometrics models
Lecture 3 Optimization methods for econometrics models Cinzia Cirillo University of Maryland Department of Civil and Environmental Engineering 06/29/2016 Summer Seminar June 27-30, 2016 Zinal, CH 1 Overview
More informationEstimate by the L 2 Norm of a Parameter Poisson Intensity Discontinuous
Research Journal of Mathematics and Statistics 6: -5, 24 ISSN: 242-224, e-issn: 24-755 Maxwell Scientific Organization, 24 Submied: September 8, 23 Accepted: November 23, 23 Published: February 25, 24
More informationProf. Dr.-Ing. Armin Dekorsy Department of Communications Engineering. Stochastic Processes and Linear Algebra Recap Slides
Prof. Dr.-Ing. Armin Dekorsy Department of Communications Engineering Stochastic Processes and Linear Algebra Recap Slides Stochastic processes and variables XX tt 0 = XX xx nn (tt) xx 2 (tt) XX tt XX
More information5.6 Multistep Methods
5.6 Multistep Methods 1 Motivation: Consider IVP: yy = ff(tt, yy), aa tt bb, yy(aa) = αα. To compute solution at tt ii+1, approximate solutions at mesh points tt 0, tt 1, tt 2, tt ii are already obtained.
More informationEECE 2150 Circuits and Signals Final Exam Fall 2016 Dec 9
EECE 2150 Circuits and Signals Final Exam Fall 2016 Dec 9 Name: Instructions: Write your name and section number on all pages Closed book, closed notes; Computers and cell phones are not allowed You can
More informationIntroduction to Density Estimation and Anomaly Detection. Tom Dietterich
Introduction to Density Estimation and Anomaly Detection Tom Dietterich Outline Definition and Motivations Density Estimation Parametric Density Estimation Mixture Models Kernel Density Estimation Neural
More informationPHY103A: Lecture # 4
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 4 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 10-Jan-2018 Notes The Solutions to HW # 1 have been
More informationSVARs & identification, and advanced time series (continuous time processes and the frequency domain)
SVARs & identification, and advanced time series (continuous time processes and the frequency domain) Tom Holden http://www.tholden.org/ PhD Macroeconomics, Semester 2 Outline of today s talk SVARs. Identification
More informationSupport Vector Machines. CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington
Support Vector Machines CSE 4309 Machine Learning Vassilis Athitsos Computer Science and Engineering Department University of Texas at Arlington 1 A Linearly Separable Problem Consider the binary classification
More informationCHAPTER 4 Structure of the Atom
CHAPTER 4 Structure of the Atom Fall 2018 Prof. Sergio B. Mendes 1 Topics 4.1 The Atomic Models of Thomson and Rutherford 4.2 Rutherford Scattering 4.3 The Classic Atomic Model 4.4 The Bohr Model of the
More informationYang-Hwan Ahn Based on arxiv:
Yang-Hwan Ahn (CTPU@IBS) Based on arxiv: 1611.08359 1 Introduction Now that the Higgs boson has been discovered at 126 GeV, assuming that it is indeed exactly the one predicted by the SM, there are several
More informationKalman Filters for Mapping and Localization
Kalman Filters for Mapping and Localization Sensors If you can t model the world, then sensors are the robot s link to the external world (obsession with depth) Laser Kinect IR rangefinder sonar rangefinder
More informationBIOE 198MI Biomedical Data Analysis. Spring Semester Lab 4: Introduction to Probability and Random Data
BIOE 98MI Biomedical Data Analysis. Spring Semester 209. Lab 4: Introduction to Probability and Random Data A. Random Variables Randomness is a component of all measurement data, either from acquisition
More information7.3 The Jacobi and Gauss-Seidel Iterative Methods
7.3 The Jacobi and Gauss-Seidel Iterative Methods 1 The Jacobi Method Two assumptions made on Jacobi Method: 1.The system given by aa 11 xx 1 + aa 12 xx 2 + aa 1nn xx nn = bb 1 aa 21 xx 1 + aa 22 xx 2
More informationPHY103A: Lecture # 9
Semester II, 2017-18 Department of Physics, IIT Kanpur PHY103A: Lecture # 9 (Text Book: Intro to Electrodynamics by Griffiths, 3 rd Ed.) Anand Kumar Jha 20-Jan-2018 Summary of Lecture # 8: Force per unit
More informationExtreme value statistics: from one dimension to many. Lecture 1: one dimension Lecture 2: many dimensions
Extreme value statistics: from one dimension to many Lecture 1: one dimension Lecture 2: many dimensions The challenge for extreme value statistics right now: to go from 1 or 2 dimensions to 50 or more
More informationUnit WorkBook 4 Level 4 ENG U8 Mechanical Principles 2018 UniCourse Ltd. All Rights Reserved. Sample
2018 UniCourse Ltd. A Rights Reserved. Pearson BTEC Levels 4 Higher Nationals in Engineering (RQF) Unit 8: Mechanical Principles Unit Workbook 4 in a series of 4 for this unit Learning Outcome 4 Translational
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 5, 018 Stanford:
More informationNon-Parametric Weighted Tests for Change in Distribution Function
American Journal of Mathematics Statistics 03, 3(3: 57-65 DOI: 0.593/j.ajms.030303.09 Non-Parametric Weighted Tests for Change in Distribution Function Abd-Elnaser S. Abd-Rabou *, Ahmed M. Gad Statistics
More informationFluids in Rigid-Body Motion
Fluids in Rigid-Body Motion 9. 14. 2016 Hyunse Yoon, Ph.D. Associate Research Scientist IIHR-Hydroscience & Engineering Newton s 2 nd Law of Motion In general, for a body of mass mm, mmaa = FF where, aa
More informationElastic light scattering
Elastic light scattering 1. Introduction Elastic light scattering in quantum mechanics Elastic scattering is described in quantum mechanics by the Kramers Heisenberg formula for the differential cross
More information10.4 Controller synthesis using discrete-time model Example: comparison of various controllers
10. Digital 10.1 Basic principle of digital control 10.2 Digital PID controllers 10.2.1 A 2DOF continuous-time PID controller 10.2.2 Discretisation of PID controllers 10.2.3 Implementation and tuning 10.3
More informationA new procedure for sensitivity testing with two stress factors
A new procedure for sensitivity testing with two stress factors C.F. Jeff Wu Georgia Institute of Technology Sensitivity testing : problem formulation. Review of the 3pod (3-phase optimal design) procedure
More informationLast Name _Piatoles_ Given Name Americo ID Number
Last Name _Piatoles_ Given Name Americo ID Number 20170908 Question n. 1 The "C-V curve" method can be used to test a MEMS in the electromechanical characterization phase. Describe how this procedure is
More informationRadiation. Lecture40: Electromagnetic Theory. Professor D. K. Ghosh, Physics Department, I.I.T., Bombay
Radiation Zone Approximation We had seen that the expression for the vector potential for a localized cuent distribution is given by AA (xx, tt) = μμ 4ππ ee iiiiii dd xx eeiiii xx xx xx xx JJ (xx ) In
More informationLecture No. 1 Introduction to Method of Weighted Residuals. Solve the differential equation L (u) = p(x) in V where L is a differential operator
Lecture No. 1 Introduction to Method of Weighted Residuals Solve the differential equation L (u) = p(x) in V where L is a differential operator with boundary conditions S(u) = g(x) on Γ where S is a differential
More informationGeneral Strong Polarization
General Strong Polarization Madhu Sudan Harvard University Joint work with Jaroslaw Blasiok (Harvard), Venkatesan Guruswami (CMU), Preetum Nakkiran (Harvard) and Atri Rudra (Buffalo) Oct. 8, 018 Berkeley:
More informationDressing up for length gauge: Aspects of a debate in quantum optics
Dressing up for length gauge: Aspects of a debate in quantum optics Rainer Dick Department of Physics & Engineering Physics University of Saskatchewan rainer.dick@usask.ca 1 Agenda: Attosecond spectroscopy
More informationCHAPTER 2 Special Theory of Relativity
CHAPTER 2 Special Theory of Relativity Fall 2018 Prof. Sergio B. Mendes 1 Topics 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 2.10 2.11 2.12 2.13 2.14 Inertial Frames of Reference Conceptual and Experimental
More informationEstimation and Detection
stimation and Detection Lecture 2: Cramér-Rao Lower Bound Dr. ir. Richard C. Hendriks & Dr. Sundeep P. Chepuri 7//207 Remember: Introductory xample Given a process (DC in noise): x[n]=a + w[n], n=0,,n,
More informationMathematics Ext 2. HSC 2014 Solutions. Suite 403, 410 Elizabeth St, Surry Hills NSW 2010 keystoneeducation.com.
Mathematics Ext HSC 4 Solutions Suite 43, 4 Elizabeth St, Surry Hills NSW info@keystoneeducation.com.au keystoneeducation.com.au Mathematics Extension : HSC 4 Solutions Contents Multiple Choice... 3 Question...
More informationOn The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time Delays
Journal of Mathematics and System Science 6 (216) 194-199 doi: 1.17265/2159-5291/216.5.3 D DAVID PUBLISHING On The Cauchy Problem For Some Parabolic Fractional Partial Differential Equations With Time
More informationDiffusive DE & DM Diffusve DE and DM. Eduardo Guendelman With my student David Benisty, Joseph Katz Memorial Conference, May 23, 2017
Diffusive DE & DM Diffusve DE and DM Eduardo Guendelman With my student David Benisty, Joseph Katz Memorial Conference, May 23, 2017 Main problems in cosmology The vacuum energy behaves as the Λ term in
More informationLecture 3. Linear Regression
Lecture 3. Linear Regression COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne Weeks 2 to 8 inclusive Lecturer: Andrey Kan MS: Moscow, PhD:
More informationQ. 1 Q. 25 carry one mark each.
Q. 1 Q. 25 carry one mark each. Q.1 Given ff(zz) = gg(zz) + h(zz), where ff, gg, h are complex valued functions of a complex variable zz. Which one of the following statements is TUE? (A) If ff(zz) is
More informationProblem 4.1 (Verdeyen Problem #8.7) (a) From (7.4.7), simulated emission cross section is defined as following.
Problem 4.1 (Verdeyen Problem #8.7) (a) From (7.4.7), simulated emission cross section is defined as following. σσ(νν) = AA 21 λλ 2 8ππnn 2 gg(νν) AA 21 = 6 10 6 ssssss 1 From the figure, the emission
More informationInternational Journal of Scientific & Engineering Research, Volume 7, Issue 8, August ISSN MM Double Exponential Distribution
International Journal of Scientific & Engineering Research, Volume 7, Issue 8, August-216 72 MM Double Exponential Distribution Zahida Perveen, Mubbasher Munir Abstract: The exponential distribution is
More informationCharged-Particle Interactions in Matter
Radiation Dosimetry Attix 8 Charged-Particle Interactions in Matter Ho Kyung Kim hokyung@pusan.ac.kr Pusan National University References F. H. Attix, Introduction to Radiological Physics and Radiation
More informationQuantum Mechanics. An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc.
Quantum Mechanics An essential theory to understand properties of matter and light. Chemical Electronic Magnetic Thermal Optical Etc. Fall 2018 Prof. Sergio B. Mendes 1 CHAPTER 3 Experimental Basis of
More informationWorksheets for GCSE Mathematics. Quadratics. mr-mathematics.com Maths Resources for Teachers. Algebra
Worksheets for GCSE Mathematics Quadratics mr-mathematics.com Maths Resources for Teachers Algebra Quadratics Worksheets Contents Differentiated Independent Learning Worksheets Solving x + bx + c by factorisation
More informationProperty Testing and Affine Invariance Part I Madhu Sudan Harvard University
Property Testing and Affine Invariance Part I Madhu Sudan Harvard University December 29-30, 2015 IITB: Property Testing & Affine Invariance 1 of 31 Goals of these talks Part I Introduce Property Testing
More informationIntegrating Rational functions by the Method of Partial fraction Decomposition. Antony L. Foster
Integrating Rational functions by the Method of Partial fraction Decomposition By Antony L. Foster At times, especially in calculus, it is necessary, it is necessary to express a fraction as the sum of
More informationReview for Exam Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa
Review for Exam2 11. 13. 2015 Hyunse Yoon, Ph.D. Adjunct Assistant Professor Department of Mechanical Engineering, University of Iowa Assistant Research Scientist IIHR-Hydroscience & Engineering, University
More informationECE531 Lecture 8: Non-Random Parameter Estimation
ECE531 Lecture 8: Non-Random Parameter Estimation D. Richard Brown III Worcester Polytechnic Institute 19-March-2009 Worcester Polytechnic Institute D. Richard Brown III 19-March-2009 1 / 25 Introduction
More informationTECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES
COMPUTERS AND STRUCTURES, INC., FEBRUARY 2016 TECHNICAL NOTE AUTOMATIC GENERATION OF POINT SPRING SUPPORTS BASED ON DEFINED SOIL PROFILES AND COLUMN-FOOTING PROPERTIES Introduction This technical note
More informationABSTRACT OF THE DISSERTATION
A Study of an N Molecule-Quantized Radiation Field-Hamiltonian BY MICHAEL THOMAS TAVIS DOCTOR OF PHILOSOPHY, GRADUATE PROGRAM IN PHYSICS UNIVERSITY OF CALIFORNIA, RIVERSIDE, DECEMBER 1968 PROFESSOR FREDERICK
More informationEECE 2150 Circuits and Signals Final Exam Fall 2016 Dec 12
EECE 2150 Circuits and Signals Final Exam Fall 2016 Dec 12 Instructions: Write your name and section number on all pages Closed book, closed notes; Computers and cell phones are not allowed You can use
More informationA linear operator of a new class of multivalent harmonic functions
International Journal of Scientific Research Publications, Volume 7, Issue 8, August 2017 278 A linear operator of a new class of multivalent harmonic functions * WaggasGalibAtshan, ** Ali Hussein Battor,
More informationSpecialist Mathematics 2019 v1.2
181314 Mensuration circumference of a circle area of a parallelogram CC = ππππ area of a circle AA = ππrr AA = h area of a trapezium AA = 1 ( + )h area of a triangle AA = 1 h total surface area of a cone
More informationHaar Basis Wavelets and Morlet Wavelets
Haar Basis Wavelets and Morlet Wavelets September 9 th, 05 Professor Davi Geiger. The Haar transform, which is one of the earliest transform functions proposed, was proposed in 90 by a Hungarian mathematician
More informationCoarse-Graining via the Mori-Zwanzig Formalism
Coarse-Graining via the Mori-Zwanzig Formalism George Em Karniadakis & Zhen Li http://www.pnnl.gov/computing/cm4/ Supported by DOE ASCR Mori-Zwanzig can be used to: 1. Derive coarse-grained equations 2.
More information(2) Orbital angular momentum
(2) Orbital angular momentum Consider SS = 0 and LL = rr pp, where pp is the canonical momentum Note: SS and LL are generators for different parts of the wave function. Note: from AA BB ii = εε iiiiii
More informationA Circular Cylinder. 1 Introduction. RITA CHOUDHURY 1 and BIBHASH DEKA 2
MHD V -E F F H T A Circular Cylinder RITA CHOUDHURY 1 and BIBHASH DEKA 2 1,2 Department of Mathematics, Gauhati University, Guwahati-78114, Assam, INDIA. 1 E-mail: rchoudhury66@yahoo.in 2 E-mail: bibhashdeka66@gmail.com
More informationReview for Exam Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa
57:020 Fluids Mechanics Fall2013 1 Review for Exam3 12. 11. 2013 Hyunse Yoon, Ph.D. Assistant Research Scientist IIHR-Hydroscience & Engineering University of Iowa 57:020 Fluids Mechanics Fall2013 2 Chapter
More informationSecondary 3H Unit = 1 = 7. Lesson 3.3 Worksheet. Simplify: Lesson 3.6 Worksheet
Secondary H Unit Lesson Worksheet Simplify: mm + 2 mm 2 4 mm+6 mm + 2 mm 2 mm 20 mm+4 5 2 9+20 2 0+25 4 +2 2 + 2 8 2 6 5. 2 yy 2 + yy 6. +2 + 5 2 2 2 0 Lesson 6 Worksheet List all asymptotes, holes and
More informationLise Meitner, Otto Hahn. Nuclear Fission Hans-Jürgen Wollersheim
Lise Meitner, Otto Hahn Nuclear Fission Hans-Jürgen Wollersheim Details of the 252 Cf decay α s: 96.9% SF: 3.1% T 1/2 = 2.647 a Q α = 6.217 MeV E α = 6.118 MeV α α α α α-decay of 252 Cf Mass data: nucleardata.nuclear.lu.se/database/masses/
More informationPhysics 371 Spring 2017 Prof. Anlage Review
Physics 71 Spring 2017 Prof. Anlage Review Special Relativity Inertial vs. non-inertial reference frames Galilean relativity: Galilean transformation for relative motion along the xx xx direction: xx =
More informationEquation Sheet, Phys 1321 (Exam II), University of Houston, Fall 2016 Instructor: Dr. W. P. Su
vv (tt) = ddrr (tt) dddd vv aaaaaa = Δrr Δtt aa (tt) = ddvv (tt) dddd aa aaaaaa = Δvv Δtt Equation Sheet, Phys 1321 (Exam II), University of Houston, Fall 2016 Instructor: Dr. W. P. Su AAAAAA. ssssssssss
More informationME5286 Robotics Spring 2017 Quiz 2
Page 1 of 5 ME5286 Robotics Spring 2017 Quiz 2 Total Points: 30 You are responsible for following these instructions. Please take a minute and read them completely. 1. Put your name on this page, any other
More informationModule 7 (Lecture 25) RETAINING WALLS
Module 7 (Lecture 25) RETAINING WALLS Topics Check for Bearing Capacity Failure Example Factor of Safety Against Overturning Factor of Safety Against Sliding Factor of Safety Against Bearing Capacity Failure
More informationGrover s algorithm. We want to find aa. Search in an unordered database. QC oracle (as usual) Usual trick
Grover s algorithm Search in an unordered database Example: phonebook, need to find a person from a phone number Actually, something else, like hard (e.g., NP-complete) problem 0, xx aa Black box ff xx
More informationCHEMISTRY Spring, 2018 QUIZ 1 February 16, NAME: HANS ZIMMER Score /20
QUIZ 1 February 16, 018 NAME: HANS ZIMMER Score /0 [Numbers without decimal points are to be considered infinitely precise. Show reasonable significant figures and proper units. In particular, use generally
More informationRandom Vectors Part A
Random Vectors Part A Page 1 Outline Random Vectors Measurement of Dependence: Covariance Other Methods of Representing Dependence Set of Joint Distributions Copulas Common Random Vectors Functions of
More informationDetection & Estimation Lecture 1
Detection & Estimation Lecture 1 Intro, MVUE, CRLB Xiliang Luo General Course Information Textbooks & References Fundamentals of Statistical Signal Processing: Estimation Theory/Detection Theory, Steven
More informationCOMPRESSION FOR QUANTUM POPULATION CODING
COMPRESSION FOR QUANTUM POPULATION CODING Ge Bai, The University of Hong Kong Collaborative work with: Yuxiang Yang, Giulio Chiribella, Masahito Hayashi INTRODUCTION Population: A group of identical states
More informationChapter 8: Least squares (beginning of chapter)
Chapter 8: Least squares (beginning of chapter) Least Squares So far, we have been trying to determine an estimator which was unbiased and had minimum variance. Next we ll consider a class of estimators
More informationAnalysis of Survival Data Using Cox Model (Continuous Type)
Australian Journal of Basic and Alied Sciences, 7(0): 60-607, 03 ISSN 99-878 Analysis of Survival Data Using Cox Model (Continuous Type) Khawla Mustafa Sadiq Department of Mathematics, Education College,
More informationMATH 1080: Calculus of One Variable II Fall 2018 Textbook: Single Variable Calculus: Early Transcendentals, 7e, by James Stewart.
MATH 1080: Calculus of One Variable II Fall 2018 Textbook: Single Variable Calculus: Early Transcendentals, 7e, by James Stewart Unit 2 Skill Set Important: Students should expect test questions that require
More informationKinetic Model Parameter Estimation for Product Stability: Non-uniform Finite Elements and Convexity Analysis
Kinetic Model Parameter Estimation for Product Stability: Non-uniform Finite Elements and Convexity Analysis Mark Daichendt, Lorenz Biegler Carnegie Mellon University Pittsburgh, PA 15217 Ben Weinstein,
More informationExpectation Propagation performs smooth gradient descent GUILLAUME DEHAENE
Expectation Propagation performs smooth gradient descent 1 GUILLAUME DEHAENE In a nutshell Problem: posteriors are uncomputable Solution: parametric approximations 2 But which one should we choose? Laplace?
More informationGibbs Sampler Derivation for Latent Dirichlet Allocation (Blei et al., 2003) Lecture Notes Arjun Mukherjee (UH)
Gibbs Sampler Derivation for Latent Dirichlet Allocation (Blei et al., 2003) Lecture Notes Arjun Mukherjee (UH) I. Generative process, Plates, Notations II. The joint distribution: PP (WW, ZZ; αα; ββ)
More informationModule 6 (Lecture 22) LATERAL EARTH PRESSURE
Module 6 (Lecture ) LATERAL EARTH PRESSURE 1.1 LATERAL EARTH PRESSURE DUE TO SURCHARGE 1. ACTIVE PRESSURE FOR WALL ROTATION ABOUT TOP- BRACED CUT 1.3 ACTIVE EARTH PRESSURE FOR TRANSLATION OF RETAINING
More informationEffect of First Order Chemical Reaction for Coriolis Force and Dust Particles for Small Reynolds Number in the Atmosphere Over Territory
Global Journal of Science Frontier Research: H Environment & Earth Science Volume 16 Issue 1 Version 1.0 Year 2016 Type : Double Blind Peer Reviewed International Research Journal Publisher: Global Journals
More information