Topics in MMSE Estimation for Sparse Approximation
|
|
- Bertina Hood
- 6 years ago
- Views:
Transcription
1 for Spare Approximatio * Michael Elad The Computer Sciece Departmet The Techio Irael Ititute of techology Haifa 3, Irael Workhop: Sparity ad Computatio Haudorff ceter of Mathematic Uiverity of Bo Jue 7-, Joit work with Irad Yaveh Mata Protter Javier Turek The CS Departmet, The Techio
2 Part I - Motivatio Deoiig By Averagig Several Spare Repreetatio
3 Spare Repreetatio Deoiig Spare repreetatio modelig: K x Aume that we get a oiy meauremet vector N y = x + v = D+ v where i AWGN Our goal recovery of x (or ). A fixed Dictioary D The commo practice Approximate the olutio of mi.t. D y ε 3
4 Orthogoal Matchig Puruit OMP fid oe atom at a time for approximatig the olutio of mi.t. D y ε Mai Iteratio =, r Iitializatio ad = y S = D = { } = y = + i z.t. i K, E(i ). Compute E(i) = mi z d r for i. Chooe i E(i) 3. Update S : S = S {i } 4. LS : = mi y.t. up p = S { } K 5. Update D Re idual: r = y D No r ε Ye Stop 4
5 Uig everal Repreetatio Coider the deoiig problem mi.t. D ad uppoe that we ca fid a group of J cadidate olutio j { } J j j= uch that D j j y << y N ε ε Baic Quetio: What could we do with uch a et of competig olutio i order to better deoie y? Why hould thi help? How hall we practically fid uch a et of olutio? Relevat work: [Leug & Barro ( 6)] [Laro & Sele ( 7)] [Schitter et. al. (`8)] [Elad ad Yaveh ( 8)] [Giraud ( 8)] [Protter et. al. ( )] 5
6 Geeratig May Repreetatio Our * Awer: Radomizig the OMP Mai Iteratio =, r Iitializatio ad = y S = D = { } = y = + i z.t. i K, E(i ). Compute E(i) = mi z d r for i. Chooe i E(i) 3. Update S : S = S {i } 4. LS : = mi y.t. up p = S { } K 5. Update D Re idual: r = y D No r ε * Laro ad Schitter propoe a more complicated Ye ad Stop determiitic tree pruig method 6
7 Geeratig May Repreetatio Our * Awer: Radomizig the OMP Iitializatio =, = r = y D = y ad S = { } = + Mai Iteratio z i. Compute E(i) = mi z d r for i K. Chooe i with.t. probability i K, E(i ) exp E(i) c E(i) 3. Update S : S = S {i } 4. LS : = mi D y.t. up p = 5. Update Re idual : r = y D { } For ow, let et the parameter c maually for bet performace. { } S Later we hall defie a way to et it automatically No r ε Ye Stop 7
8 Let Try Propoed Experimet : Form a radom D. Multiply by a pare vector ( = ). Add Gauia iid oie (σ=) ad obtai y. Solve the problem mi.t. D y OMP uig OMP, ad obtai. { } j Ue RadOMP ad obtai RadOMP. Let look at the obtaied repreetatio j= D + = v y 8
9 Some Obervatio Hitogram Hitogram 5 5 Radom-OMP cardialitie OMP cardiality 3 4 Cadiality ˆ Radom-OMP deoiig OMP deoiig D ˆ D Noie Atteuatio y D Hitogram Noie Atteuatio Radom-OMP error OMP error Repreetatio Error Dˆ y Radom-OMP deoiig OMP deoiig Cardiality We ee that The OMP give the paret olutio Neverthele, it i ot the mot effective for deoiig. The cardiality of a repreetatio doe ot reveal it efficiecy. 9
10 The Surprie (to ome of u) Let propoe the average RadOMP = ˆ j = j a our repreetatio 3 Averaged Rep. Origial Rep. OMP Rep. value Thi repreetatio IS NOT SPARSE AT ALL but it oie atteuatio i:.6 (OMP give.6) idex
11 Repeat thi Experimet Dictioary (radom) of ize N=, K= True upport of i σ x = ad ε= We ru OMP for deoiig. We ru RadOMP J= time ad average J RadOMP ˆ = j J j= Deoiig i aeed by Dˆ D y D RadOMP Deoiig Factor OMP veru RadOMP reult Mea Poit Cae of zero olutio, where y OMP Deoiig Factor
12 Part II - Explaatio It i Time to be More Precie
13 Our Sigal Model K x D i fixed ad kow. Aume that i built by: N A fixed Dictioary D Chooig the upport with probability P() from all the K poibilitie Ω. Let aume that P(i S)=P i are draw idepedetly. Chooig the coefficiet uig iid Gauia etrie N, σ x. ( ) The ideal igal i x=d=d. The p.d.f. P() ad P(x) are clear ad kow 3
14 Addig Noie K x Noie Aumed: N A fixed Dictioary D v + y The oie v i additive white Gauia vector with probability P v (v) P ( y x) = C exp x σ y The coditioal p.d.f. P(y ), P( y), ad eve P(y ), P( y), are all clear ad well-defied (although they may appear aty). 4
15 The Key The Poterior P( y) We have acce to P ( y) MAP MAP* ˆ = ArgMax P( y) Oracle kow upport oracle ˆ MMSE MMSE { } ˆ = E y * Actually, there i a delicate problem with thi defiitio, due to the uavoidable mixture of cotiuou ad dicrete PDF. The olutio i to etimate the MAP upport S. 5
16 6 Let Start with The Oracle ( ) ( ) ( ) ( ) ( ) y P P y P y P y, P = = ( ) σ x exp P ( ) σ y exp y P D ( ) σ σ x y exp y P D T x T h y ˆ = σ σ + σ = Q D I D D * Whe i kow * Commet: Thi etimate i both the MAP ad MMSE. The oracle etimate of x i obtaied by multiplicatio by D.
17 The MAP Etimatio MAP P(y )P() ŝ = ArgMax P( y) = ArgMax Ω Ω P(y) P(y ) = P(y, )P( )d =... T hq h log(det( Q)) σx exp Baed o our prior for geeratig the upport ( ) = i ( j) P P P i j ŝ h h log(det( Q)) = ArgMax exp Ω T MAP Q i Pi σ x ( P ) j j 7
18 The MAP Etimatio ŝ MAP T hq h log(det( Q)) = ArgMax Ω P i + log log( P ) + j i σx j Implicatio: The MAP etimator require to tet all the poible upport for the maximizatio. For the foud upport, the oracle formula i ued. I typical problem, thi proce i impoible a there i a combiatorial et of poibilitie. Thi i why we rarely ue exact MAP, ad we typically replace it with approximatio algorithm (e.g., OMP). 8
19 The MMSE Etimatio ˆ MMSE P( y) P() P(y ) =... = E { y} = P( y) E{ y,} T h Q h log( det( Q)) Pi exp i σ Ω Thi i the oracle for, a we have ee before E { } y, = ˆ = Q h x ( P ) j j ˆ MMSE = Ω P( y) ˆ 9
20 The MMSE Etimatio ˆ MMSE Implicatio: = E { y} = P( y) E{ y,} Ω ˆ MMSE = Ω P( y) ˆ The bet etimator (i term of L error) i a weighted average of may pare repreetatio!!! A i the MAP cae, i typical problem oe caot compute thi expreio, a the ummatio i over a combiatorial et of poibilitie. We hould propoe approximatio here a well.
21 The Cae of = ad P i =P P( y) Thi i our c i the Radom-OMP T hq h log(det( Q)) exp σx exp (y d ) σ σ x +σ T i Baed o thi we ca propoe a greedy algorithm for both MAP ad MMSE: i Pi σ x ( Pj ) j The i-th atom i D MAP chooe the atom with the larget ier product (out of K), ad do o oe at a time, while freezig the previou oe (almot OMP). MMSE draw at radom a atom i a greedy algorithm, baed o the above probability et, gettig cloe to P( y) i the overall draw (almot RadOMP).
22 Comparative Reult The followig reult correpod to a mall dictioary ( 6), where the combiatorial formula ca be evaluated a well. Parameter: N,K: 6 P=. (varyig cardiality) σ x = J=5 (RadOMP) Averaged over experimet Relative Repreetatio Mea-Squared-Error Oracle MMSE MAP OMP Rad-OMP σ
23 Part III Divig I A Cloer Look At the Uitary Cae DD T = D T D = I 3
24 Few Baic Obervatio Let u deote β = D T y σ +σ Q DD I I T x = + = σ σx σσx T h = D y = β σ σ σ ˆ = = β = β oracle x Q h c σ +σx (The Oracle) 4
25 Back to the MAP Etimatio T h Q h log(det( Q )) P i σ ( ) exp i ( P ) j P S y x j T Q = β h h c σ log(det( Q)) = S log c ( ) σ x ( ) i exp β i = qi P S y i c σ P c P i i 5
26 The MAP Etimator q i = exp β c Pi i σ Pi c Ŝ MAP i obtaied by maximizig the expreio ( ) qi P S y i Thu, every i uch that q i > hould be i the upport, which lead to σ P i MAP c βi β i > log c i i ˆ = P c Otherwie i MAP P=. σ=.3 σ x = β 6
27 The MMSE Etimatio q i = exp β c Pi i σ Pi c Some algebra ad we get that 3 P=. σ=.3 σ x = q ˆ = β + MMSE i c i qi i i MMSE β g i Thi reult lead to a dee repreetatio vector. The curve i a moothed verio of the MAP oe. 7
28 What About the Error? { } ˆ { Q } oracle i= E = trace =... = c σg { } ( ) { Q } MMSE MMSE oracle Ω E ˆ = P y trace + ˆ ˆ E ( ) 4 i i i i i= i= =... = c σ g + c β g g { } ˆ = ˆ ˆ + E{ ˆ } MAP MAP MMSE MMSE i ( ) 4 MAP i i i i i i= i= =... = c σ g + c β g + I ( g ) g i qi = + q i 8
29 A Sythetic Experimet The followig reult correpod to a dictioary of ize ( ).5. Relative Mea-Squared-Error Empirical Oracle Theoretical Oracle Empirical MMSE Theoretical MMSE Empirical MAP Theoretical MAP Parameter:,K:.5 P=. σ x = Averaged over experimet. The average error are how relative to σ σ 9
30 Part IV - Theory Etimatio Error 3
31 Ueful Lemma Let (a k,b k ) k=,,, be pair of poitive real umber. Let m be the idex of a pair uch that a b k m k. k= m The. k= a b k k a b k m a b Equality i obtaied oly if all the ratio a k /b k are equal. m We are itereted i thi reult becaue : { } ˆ oracle E = c σg i= { } ˆ = σ + β ( ) MMSE 4 i i i i i= i= E c g c g g i { } ˆ = σ + β ( + ) MAP 4 MAP i i i i i i= i= E c g c g I ( g ) Thi lead to 3
32 Theorem MMSE Error P c k Defie Gk =. Chooe m uch that k, Gm Gk. Pk Pk = P = << K { } e MMSE E ˆ + log Gm 4Gm 4 { } oracle E ˆ + Otherwie Gme E E thi error ratio boud become { ˆ } { ˆ } MMSE oracle Cot logk 3
33 Theorem MAP Error P c k Defie Gk =. Chooe m uch that k, Gm Gk. Pk Pk = P = << K { } MAP E ˆ + log Gm e Gm { } oracle E ˆ + Otherwie Ge m E E thi error ratio boud become { ˆ } { ˆ } MMSE oracle Cot logk 33
34 The Boud Factor v. P Parameter: P=[,] σ x = σ=.3 Notice that the tedecy of the two etimator to alig for P i ot reflected i thee boud. Boud Factor e + log Gm 4Gm 4 + Otherwie Gme + log Gm e Gm + Otherwie Ge m P 34
35 Part V We Are Doe Summary ad Cocluio 35
36 Today We Have See that Sparity ad Redudacy are ued for deoiig of igal/image How? By fidig the paret repreetatio ad uig it to recover the clea igal MAP ad MMSE ejoy a cloed-form, exact ad cheap formulae. Their error i bouded ad tightly related to the oracle error Uitary cae? Ye! Averagig everal rep lead to better deoiig, a it approximate the MMSE Ca we do better? More o thee (icludig the lide ad the relevat paper) ca be foud i 36
u t u 0 ( 7) Intuitively, the maximum principles can be explained by the following observation. Recall
Oct. Heat Equatio M aximum priciple I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace
More informationSOLUTION: The 95% confidence interval for the population mean µ is x ± t 0.025; 49
C22.0103 Sprig 2011 Homework 7 olutio 1. Baed o a ample of 50 x-value havig mea 35.36 ad tadard deviatio 4.26, fid a 95% cofidece iterval for the populatio mea. SOLUTION: The 95% cofidece iterval for the
More informationComments on Discussion Sheet 18 and Worksheet 18 ( ) An Introduction to Hypothesis Testing
Commet o Dicuio Sheet 18 ad Workheet 18 ( 9.5-9.7) A Itroductio to Hypothei Tetig Dicuio Sheet 18 A Itroductio to Hypothei Tetig We have tudied cofidece iterval for a while ow. Thee are method that allow
More informationHeat Equation: Maximum Principles
Heat Equatio: Maximum Priciple Nov. 9, 0 I thi lecture we will dicu the maximum priciple ad uiquee of olutio for the heat equatio.. Maximum priciple. The heat equatio alo ejoy maximum priciple a the Laplace
More informationAnother Look at Estimation for MA(1) Processes With a Unit Root
Aother Look at Etimatio for MA Procee With a Uit Root F. Jay Breidt Richard A. Davi Na-Jug Hu Murray Roeblatt Colorado State Uiverity Natioal Tig-Hua Uiverity U. of Califoria, Sa Diego http://www.tat.colotate.edu/~rdavi/lecture
More information10-716: Advanced Machine Learning Spring Lecture 13: March 5
10-716: Advaced Machie Learig Sprig 019 Lecture 13: March 5 Lecturer: Pradeep Ravikumar Scribe: Charvi Ratogi, Hele Zhou, Nicholay opi Note: Lae template courtey of UC Berkeley EECS dept. Diclaimer: hee
More informationStatistical Inference Procedures
Statitical Iferece Procedure Cofidece Iterval Hypothei Tet Statitical iferece produce awer to pecific quetio about the populatio of iteret baed o the iformatio i a ample. Iferece procedure mut iclude a
More informationSTA 4032 Final Exam Formula Sheet
Chapter 2. Probability STA 4032 Fial Eam Formula Sheet Some Baic Probability Formula: (1) P (A B) = P (A) + P (B) P (A B). (2) P (A ) = 1 P (A) ( A i the complemet of A). (3) If S i a fiite ample pace
More informationConfidence Intervals. Confidence Intervals
A overview Mot probability ditributio are idexed by oe me parameter. F example, N(µ,σ 2 ) B(, p). I igificace tet, we have ued poit etimat f parameter. F example, f iid Y 1,Y 2,...,Y N(µ,σ 2 ), Ȳ i a poit
More informationApplied Mathematical Sciences, Vol. 9, 2015, no. 3, HIKARI Ltd,
Applied Mathematical Sciece Vol 9 5 o 3 7 - HIKARI Ltd wwwm-hiaricom http://dxdoiorg/988/am54884 O Poitive Defiite Solutio of the Noliear Matrix Equatio * A A I Saa'a A Zarea* Mathematical Sciece Departmet
More informationLast time: Completed solution to the optimum linear filter in real-time operation
6.3 tochatic Etimatio ad Cotrol, Fall 4 ecture at time: Completed olutio to the oimum liear filter i real-time operatio emi-free cofiguratio: t D( p) F( p) i( p) dte dp e π F( ) F( ) ( ) F( p) ( p) 4444443
More informationM227 Chapter 9 Section 1 Testing Two Parameters: Means, Variances, Proportions
M7 Chapter 9 Sectio 1 OBJECTIVES Tet two mea with idepedet ample whe populatio variace are kow. Tet two variace with idepedet ample. Tet two mea with idepedet ample whe populatio variace are equal Tet
More information13.4 Scalar Kalman Filter
13.4 Scalar Kalma Filter Data Model o derive the Kalma filter we eed the data model: a 1 + u < State quatio > + w < Obervatio quatio > Aumptio 1. u i zero mea Gauia, White, u } σ. w i zero mea Gauia, White,
More informationIntroEcono. Discrete RV. Continuous RV s
ItroEcoo Aoc. Prof. Poga Porchaiwiekul, Ph.D... ก ก e-mail: Poga.P@chula.ac.th Homepage: http://pioeer.chula.ac.th/~ppoga (c) Poga Porchaiwiekul, Chulalogkor Uiverity Quatitative, e.g., icome, raifall
More informationStatistics and Chemical Measurements: Quantifying Uncertainty. Normal or Gaussian Distribution The Bell Curve
Statitic ad Chemical Meauremet: Quatifyig Ucertaity The bottom lie: Do we trut our reult? Should we (or ayoe ele)? Why? What i Quality Aurace? What i Quality Cotrol? Normal or Gauia Ditributio The Bell
More informationSociété de Calcul Mathématique, S. A. Algorithmes et Optimisation
Société de Calcul Mathématique S A Algorithme et Optimiatio Radom amplig of proportio Berard Beauzamy Jue 2008 From time to time we fid a problem i which we do ot deal with value but with proportio For
More informationLECTURE 13 SIMULTANEOUS EQUATIONS
NOVEMBER 5, 26 Demad-upply ytem LETURE 3 SIMULTNEOUS EQUTIONS I thi lecture, we dicu edogeeity problem that arie due to imultaeity, i.e. the left-had ide variable ad ome of the right-had ide variable are
More information8.6 Order-Recursive LS s[n]
8.6 Order-Recurive LS [] Motivate ti idea wit Curve Fittig Give data: 0,,,..., - [0], [],..., [-] Wat to fit a polyomial to data.., but wic oe i te rigt model?! Cotat! Quadratic! Liear! Cubic, Etc. ry
More informationChapter 9. Key Ideas Hypothesis Test (Two Populations)
Chapter 9 Key Idea Hypothei Tet (Two Populatio) Sectio 9-: Overview I Chapter 8, dicuio cetered aroud hypothei tet for the proportio, mea, ad tadard deviatio/variace of a igle populatio. However, ofte
More informationConfidence Intervals: Three Views Class 23, Jeremy Orloff and Jonathan Bloom
Cofidece Iterval: Three View Cla 23, 18.05 Jeremy Orloff ad Joatha Bloom 1 Learig Goal 1. Be able to produce z, t ad χ 2 cofidece iterval baed o the correpodig tadardized tatitic. 2. Be able to ue a hypothei
More information100(1 α)% confidence interval: ( x z ( sample size needed to construct a 100(1 α)% confidence interval with a margin of error of w:
Stat 400, ectio 7. Large Sample Cofidece Iterval ote by Tim Pilachowki a Large-Sample Two-ided Cofidece Iterval for a Populatio Mea ectio 7.1 redux The poit etimate for a populatio mea µ will be a ample
More information20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE
20. CONFIDENCE INTERVALS FOR THE MEAN, UNKNOWN VARIANCE If the populatio tadard deviatio σ i ukow, a it uually will be i practice, we will have to etimate it by the ample tadard deviatio. Sice σ i ukow,
More informationVIII. Interval Estimation A. A Few Important Definitions (Including Some Reminders)
VIII. Iterval Etimatio A. A Few Importat Defiitio (Icludig Some Remider) 1. Poit Etimate - a igle umerical value ued a a etimate of a parameter.. Poit Etimator - the ample tatitic that provide the poit
More informationA Tail Bound For Sums Of Independent Random Variables And Application To The Pareto Distribution
Applied Mathematic E-Note, 9009, 300-306 c ISSN 1607-510 Available free at mirror ite of http://wwwmaththuedutw/ ame/ A Tail Boud For Sum Of Idepedet Radom Variable Ad Applicatio To The Pareto Ditributio
More informationON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION
Review of the Air Force Academy No. (34)/7 ON THE SCALE PARAMETER OF EXPONENTIAL DISTRIBUTION Aca Ileaa LUPAŞ Military Techical Academy, Bucharet, Romaia (lua_a@yahoo.com) DOI:.96/84-938.7.5..6 Abtract:
More informationx z Increasing the size of the sample increases the power (reduces the probability of a Type II error) when the significance level remains fixed.
] z-tet for the mea, μ If the P-value i a mall or maller tha a pecified value, the data are tatitically igificat at igificace level. Sigificace tet for the hypothei H 0: = 0 cocerig the ukow mea of a populatio
More informationME 410 MECHANICAL ENGINEERING SYSTEMS LABORATORY REGRESSION ANALYSIS
ME 40 MECHANICAL ENGINEERING REGRESSION ANALYSIS Regreio problem deal with the relatiohip betwee the frequec ditributio of oe (depedet) variable ad aother (idepedet) variable() which i (are) held fied
More informationLast time: Ground rules for filtering and control system design
6.3 Stochatic Etimatio ad Cotrol, Fall 004 Lecture 7 Lat time: Groud rule for filterig ad cotrol ytem deig Gral ytem Sytem parameter are cotaied i w( t ad w ( t. Deired output i grated by takig the igal
More informationREVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION
REVIEW OF SIMPLE LINEAR REGRESSION SIMPLE LINEAR REGRESSION I liear regreio, we coider the frequecy ditributio of oe variable (Y) at each of everal level of a ecod variable (X). Y i kow a the depedet variable.
More informationTESTS OF SIGNIFICANCE
TESTS OF SIGNIFICANCE Seema Jaggi I.A.S.R.I., Library Aveue, New Delhi eema@iari.re.i I applied ivetigatio, oe i ofte itereted i comparig ome characteritic (uch a the mea, the variace or a meaure of aociatio
More informationFig. 1: Streamline coordinates
1 Equatio of Motio i Streamlie Coordiate Ai A. Soi, MIT 2.25 Advaced Fluid Mechaic Euler equatio expree the relatiohip betwee the velocity ad the preure field i ivicid flow. Writte i term of treamlie coordiate,
More informationFractional parts and their relations to the values of the Riemann zeta function
Arab. J. Math. (08) 7: 8 http://doi.org/0.007/40065-07-084- Arabia Joural of Mathematic Ibrahim M. Alabdulmohi Fractioal part ad their relatio to the value of the Riema zeta fuctio Received: 4 Jauary 07
More informationErick L. Oberstar Fall 2001 Project: Sidelobe Canceller & GSC 1. Advanced Digital Signal Processing Sidelobe Canceller (Beam Former)
Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC 1 Advaced Digital Sigal Proceig Sidelobe Caceller (Beam Former) Erick L. Obertar 001 Erick L. Obertar Fall 001 Project: Sidelobe Caceller & GSC
More informationCHAPTER 6. Confidence Intervals. 6.1 (a) y = 1269; s = 145; n = 8. The standard error of the mean is = s n = = 51.3 ng/gm.
} CHAPTER 6 Cofidece Iterval 6.1 (a) y = 1269; = 145; = 8. The tadard error of the mea i SE ȳ = = 145 8 = 51.3 g/gm. (b) y = 1269; = 145; = 30. The tadard error of the mea i ȳ = 145 = 26.5 g/gm. 30 6.2
More informationa 1 = 1 a a a a n n s f() s = Σ log a 1 + a a n log n sup log a n+1 + a n+2 + a n+3 log n sup () s = an /n s s = + t i
0 Dirichlet Serie & Logarithmic Power Serie. Defiitio & Theorem Defiitio.. (Ordiary Dirichlet Serie) Whe,a,,3, are complex umber, we call the followig Ordiary Dirichlet Serie. f() a a a a 3 3 a 4 4 Note
More informationOn the 2-Domination Number of Complete Grid Graphs
Ope Joural of Dicrete Mathematic, 0,, -0 http://wwwcirporg/oural/odm ISSN Olie: - ISSN Prit: - O the -Domiatio Number of Complete Grid Graph Ramy Shahee, Suhail Mahfud, Khame Almaea Departmet of Mathematic,
More informationGeneralized Likelihood Functions and Random Measures
Pure Mathematical Sciece, Vol. 3, 2014, o. 2, 87-95 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/pm.2014.437 Geeralized Likelihood Fuctio ad Radom Meaure Chrito E. Koutzaki Departmet of Mathematic
More informationSTRONG DEVIATION THEOREMS FOR THE SEQUENCE OF CONTINUOUS RANDOM VARIABLES AND THE APPROACH OF LAPLACE TRANSFORM
Joural of Statitic: Advace i Theory ad Applicatio Volume, Number, 9, Page 35-47 STRONG DEVIATION THEORES FOR THE SEQUENCE OF CONTINUOUS RANDO VARIABLES AND THE APPROACH OF LAPLACE TRANSFOR School of athematic
More informationOn the Signed Domination Number of the Cartesian Product of Two Directed Cycles
Ope Joural of Dicrete Mathematic, 205, 5, 54-64 Publihed Olie July 205 i SciRe http://wwwcirporg/oural/odm http://dxdoiorg/0426/odm2055005 O the Siged Domiatio Number of the Carteia Product of Two Directed
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationWe will look for series solutions to (1) around (at most) regular singular points, which without
ENM 511 J. L. Baai April, 1 Frobeiu Solutio to a d order ODE ear a regular igular poit Coider the ODE y 16 + P16 y 16 + Q1616 y (1) We will look for erie olutio to (1) aroud (at mot) regular igular poit,
More informationBrief Review of Linear System Theory
Brief Review of Liear Sytem heory he followig iformatio i typically covered i a coure o liear ytem theory. At ISU, EE 577 i oe uch coure ad i highly recommeded for power ytem egieerig tudet. We have developed
More informationS T A T R a c h e l L. W e b b, P o r t l a n d S t a t e U n i v e r s i t y P a g e 1. = Population Variance
S T A T 4 - R a c h e l L. W e b b, P o r t l a d S t a t e U i v e r i t y P a g e Commo Symbol = Sample Size x = Sample Mea = Sample Stadard Deviatio = Sample Variace pˆ = Sample Proportio r = Sample
More informationQueueing Theory (Part 3)
Queueig Theory art 3 M/M/ Queueig Sytem with Variatio M/M/, M/M///K, M/M//// Queueig Theory- M/M/ Queueig Sytem We defie λ mea arrival rate mea ervice rate umber of erver > ρ λ / utilizatio ratio We require
More informationAssignment 1 - Solutions. ECSE 420 Parallel Computing Fall November 2, 2014
Aigmet - Solutio ECSE 420 Parallel Computig Fall 204 ovember 2, 204. (%) Decribe briefly the followig term, expoe their caue, ad work-aroud the idutry ha udertake to overcome their coequece: (i) Memory
More informationObject Matching with a Locally Affine Invariant. Hongsheng Li Dept. of CSE, Lehigh University Feb. 17th, 2011
Object Matchig with a Locall Affie Ivariat Hogheg Li Dept. of SE, Lehigh Uiverit Feb. 7th, 2 Outlie Backgroud Notatio ad Problem Formulatio A Locall Affie Ivariat Numerical Scheme Eperimet Dicuio ad ocluio
More informationExpectation of the Ratio of a Sum of Squares to the Square of the Sum : Exact and Asymptotic results
Expectatio of the Ratio of a Sum of Square to the Square of the Sum : Exact ad Aymptotic reult A. Fuch, A. Joffe, ad J. Teugel 63 October 999 Uiverité de Strabourg Uiverité de Motréal Katholieke Uiveriteit
More informationCOMPARISONS INVOLVING TWO SAMPLE MEANS. Two-tail tests have these types of hypotheses: H A : 1 2
Tetig Hypothee COMPARISONS INVOLVING TWO SAMPLE MEANS Two type of hypothee:. H o : Null Hypothei - hypothei of o differece. or 0. H A : Alterate Hypothei hypothei of differece. or 0 Two-tail v. Oe-tail
More informationExplicit scheme. Fully implicit scheme Notes. Fully implicit scheme Notes. Fully implicit scheme Notes. Notes
Explicit cheme So far coidered a fully explicit cheme to umerically olve the diffuio equatio: T + = ( )T + (T+ + T ) () with = κ ( x) Oly table for < / Thi cheme i ometime referred to a FTCS (forward time
More informationQuestions about the Assignment. Describing Data: Distributions and Relationships. Measures of Spread Standard Deviation. One Quantitative Variable
Quetio about the Aigmet Read the quetio ad awer the quetio that are aked Experimet elimiate cofoudig variable Decribig Data: Ditributio ad Relatiohip GSS people attitude veru their characteritic ad poue
More informationIsolated Word Recogniser
Lecture 5 Iolated Word Recogitio Hidde Markov Model of peech State traitio ad aligmet probabilitie Searchig all poible aligmet Dyamic Programmig Viterbi Aligmet Iolated Word Recogitio 8. Iolated Word Recogier
More informationHidden Markov Model Parameters
.PPT 5/04/00 Lecture 6 HMM Traiig Traiig Hidde Markov Model Iitial model etimate Viterbi traiig Baum-Welch traiig 8.7.PPT 5/04/00 8.8 Hidde Markov Model Parameter c c c 3 a a a 3 t t t 3 c a t A Hidde
More informationSTUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN ( )
STUDENT S t-distribution AND CONFIDENCE INTERVALS OF THE MEAN Suppoe that we have a ample of meaured value x1, x, x3,, x of a igle uow quatity. Aumig that the meauremet are draw from a ormal ditributio
More informationChapter 8.2. Interval Estimation
Chapter 8.2. Iterval Etimatio Baic of Cofidece Iterval ad Large Sample Cofidece Iterval 1 Baic Propertie of Cofidece Iterval Aumptio: X 1, X 2,, X are from Normal ditributio with a mea of µ ad tadard deviatio.
More informationStat 3411 Spring 2011 Assignment 6 Answers
Stat 3411 Sprig 2011 Aigmet 6 Awer (A) Awer are give i 10 3 cycle (a) 149.1 to 187.5 Sice 150 i i the 90% 2-ided cofidece iterval, we do ot reject H 0 : µ 150 v i favor of the 2-ided alterative H a : µ
More informationNew integral representations. . The polylogarithm function
New itegral repreetatio of the polylogarithm fuctio Djurdje Cvijović Atomic Phyic Laboratory Viča Ititute of Nuclear Sciece P.O. Box 5 Belgrade Serbia. Abtract. Maximo ha recetly give a excellet ummary
More informationTools Hypothesis Tests
Tool Hypothei Tet The Tool meu provide acce to a Hypothei Tet procedure that calculate cofidece iterval ad perform hypothei tet for mea, variace, rate ad proportio. It i cotrolled by the dialog box how
More informationChapter 9: Hypothesis Testing
Chapter 9: Hypothei Tetig Chapter 5 dicued the cocept of amplig ditributio ad Chapter 8 dicued how populatio parameter ca be etimated from a ample. 9. Baic cocept Hypothei Tetig We begi by makig a tatemet,
More informationFormula Sheet. December 8, 2011
Formula Sheet December 8, 2011 Abtract I type thi for your coveice. There may be error. Ue at your ow rik. It i your repoible to check it i correct or ot before uig it. 1 Decriptive Statitic 1.1 Cetral
More informationState space systems analysis
State pace ytem aalyi Repreetatio of a ytem i tate-pace (tate-pace model of a ytem To itroduce the tate pace formalim let u tart with a eample i which the ytem i dicuio i a imple electrical circuit with
More informationStatistics Problem Set - modified July 25, _. d Q w. i n
Statitic Problem Set - modified July 5, 04 x i x i i x i _ x x _ t d Q w F x x t pooled calculated pooled. f d x x t calculated / /.. f d Kow cocept of Gauia Curve Sytematic Error Idetermiate Error t-tet
More informationReasons for Sampling. Forest Sampling. Scales of Measurement. Scales of Measurement. Sampling Error. Sampling - General Approach
Foret amplig Aver & Burkhart, Chpt. & Reao for amplig Do NOT have the time or moe to do a complete eumeratio Remember that the etimate of the populatio parameter baed o a ample are ot accurate, therefore
More informationLecture 7: Testing Distributions
CSE 5: Sublinear (and Streaming) Algorithm Spring 014 Lecture 7: Teting Ditribution April 1, 014 Lecturer: Paul Beame Scribe: Paul Beame 1 Teting Uniformity of Ditribution We return today to property teting
More informationEstimation Theory. goavendaño. Estimation Theory
Etimatio Theory Statitical Iferece method by which geeralizatio are made about a populatio Two Major Area of Statitical Iferece. Etimatio a parameter i etablihed baed o the amplig ditributio of a proportio,
More informationStatistical Intervals Based on a Single Sample (Devore Chapter Seven)
Statitical Iterval Baed o a Sigle Sample Devore Chapter Seve MATH-252-01: robability ad Statitic II Sprig 2018 Cotet 0 Itroductio 1 0.1 Motivatio...................... 1 0.2 Remider of Notatio................
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTables and Formulas for Sullivan, Fundamentals of Statistics, 2e Pearson Education, Inc.
Table ad Formula for Sulliva, Fudametal of Statitic, e. 008 Pearo Educatio, Ic. CHAPTER Orgaizig ad Summarizig Data Relative frequecy frequecy um of all frequecie Cla midpoit: The um of coecutive lower
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationMAT1026 Calculus II Basic Convergence Tests for Series
MAT026 Calculus II Basic Covergece Tests for Series Egi MERMUT 202.03.08 Dokuz Eylül Uiversity Faculty of Sciece Departmet of Mathematics İzmir/TURKEY Cotets Mootoe Covergece Theorem 2 2 Series of Real
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationJOURNAL OF THE INDIAN SOCIETY OF AGRICULTURAL STATISTICS
Available olie at www.ia.org.i/jia JOURA OF THE IDIA OIETY OF AGRIUTURA TATITI 64() 00 55-60 Variace Etimatio for te Regreio Etimator of te Mea i tratified amplig UMMARY at Gupta * ad Javid abbir Departmet
More informationGeneralized Fibonacci Like Sequence Associated with Fibonacci and Lucas Sequences
Turkih Joural of Aalyi ad Number Theory, 4, Vol., No. 6, 33-38 Available olie at http://pub.ciepub.com/tjat//6/9 Sciece ad Educatio Publihig DOI:.69/tjat--6-9 Geeralized Fiboacci Like Sequece Aociated
More informationOn The Computation Of Weighted Shapley Values For Cooperative TU Games
O he Computatio Of Weighted hapley Value For Cooperative U Game Iriel Draga echical Report 009-0 http://www.uta.edu/math/preprit/ Computatio of Weighted hapley Value O HE COMPUAIO OF WEIGHED HAPLEY VALUE
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More information18.05 Problem Set 9, Spring 2014 Solutions
18.05 Problem Set 9, Sprig 2014 Solutio Problem 1. (10 pt.) (a) We have x biomial(, θ), o E(X) =θ ad Var(X) = θ(1 θ). The rule-of-thumb variace i jut 4. So the ditributio beig plotted are biomial(250,
More informationProduction Scheduling with Genetic Algorithm
Productio Schedulig with Geetic Algorithm Áko Gubá 1, Mikló Gubá 2 1 college profeor, head of departmet, Departmet of Iformatio Sciece ad Techology, Budapet Buie School 2 college profeor, head of ititute,
More informationPositive solutions of singular (k,n-k) conjugate boundary value problem
Joural of Applied Mathematic & Bioiformatic vol5 o 25-2 ISSN: 792-662 prit 792-699 olie Sciepre Ltd 25 Poitive olutio of igular - cojugate boudar value problem Ligbi Kog ad Tao Lu 2 Abtract Poitive olutio
More informationA tail bound for sums of independent random variables : application to the symmetric Pareto distribution
A tail boud for um of idepedet radom variable : applicatio to the ymmetric Pareto ditributio Chritophe Cheeau To cite thi verio: Chritophe Cheeau. A tail boud for um of idepedet radom variable : applicatio
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationWidely used? average out effect Discrete Prior. Examplep. More than one observation. using MVUE (sample mean) yy 1 = 3.2, y 2 =2.2, y 3 =3.6, y 4 =4.
Dicrete Prior for (μ Widely ued? average out effect Dicrete Prior populatio td i kow equally likely or ubjective weight π ( μ y ~ π ( μ l( y μ π ( μ e Examplep ( μ y Set a ubjective prior ad a gueig value
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More informationProperties and Tests of Zeros of Polynomial Functions
Properties ad Tests of Zeros of Polyomial Fuctios The Remaider ad Factor Theorems: Sythetic divisio ca be used to fid the values of polyomials i a sometimes easier way tha substitutio. This is show by
More informationELEC 372 LECTURE NOTES, WEEK 4 Dr. Amir G. Aghdam Concordia University
ELEC 37 LECTURE NOTES, WEE 4 Dr Amir G Aghdam Cocordia Uiverity Part of thee ote are adapted from the material i the followig referece: Moder Cotrol Sytem by Richard C Dorf ad Robert H Bihop, Pretice Hall
More informationOn the Positive Definite Solutions of the Matrix Equation X S + A * X S A = Q
The Ope Applied Mathematic Joural 011 5 19-5 19 Ope Acce O the Poitive Defiite Solutio of the Matrix Equatio X S + A * X S A = Q Maria Adam * Departmet of Computer Sciece ad Biomedical Iformatic Uiverity
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 30 Sigal & Sytem Prof. Mark Fowler Note Set #8 C-T Sytem: Laplace Traform Solvig Differetial Equatio Readig Aigmet: Sectio 6.4 of Kame ad Heck / Coure Flow Diagram The arrow here how coceptual flow
More informationLesson 5. Chapter 7. Wiener Filters. Bengt Mandersson. r x k We assume uncorrelated noise v(n). LTH. September 2010
Optimal Sigal Poceig Leo 5 Chapte 7 Wiee Filte I thi chapte we will ue the model how below. The igal ito the eceive i ( ( iga. Nomally, thi igal i ditubed by additive white oie v(. The ifomatio i i (.
More information2015 Fermat Contest (Grade 11)
The CENTRE for EDUCATION i MATHEMATICS ad COMPUTING cemc.uwaterloo.ca 015 Fermat Cotet (Grade 11) Tueday, February 4, 015 (i North America ad South America) Wededay, February 5, 015 (outide of North America
More informationGroup Bayesian Sparse Channel Estimation for Massive MIMO Systems
Group Bayeia Spare Chael Etimatio for Maive MIMO Sytem Huajia Che ad Chehao Qi School of Iformatio Sciece ad Egieerig Southeat Uiverity, Najig 0096, Chia Email: qch@eu.edu.c Abtract I maive MIMO ytem,
More informationCollective Support Recovery for Multi-Design Multi-Response Linear Regression
IEEE TRANACTION ON INFORMATION THEORY, VOL XX, NO XX, XX 4 Collective upport Recovery for Multi-Deig Multi-Repoe Liear Regreio eiguag ag, Yigbi Liag, Eric P Xig Abtract The multi-deig multi-repoe MDMR
More information1. The F-test for Equality of Two Variances
. The F-tet for Equality of Two Variance Previouly we've learned how to tet whether two population mean are equal, uing data from two independent ample. We can alo tet whether two population variance are
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationWeak formulation and Lagrange equations of motion
Chapter 4 Weak formulatio ad Lagrage equatio of motio A mot commo approach to tudy tructural dyamic i the ue of the Lagrage equatio of motio. Thee are obtaied i thi chapter tartig from the Cauchy equatio
More informationCapacity-Approaching Signal Constellations for the Additive Exponential Noise Channel
Capacity-Approachig Sigal Cotellatio for the Additive Expoetial Noie Chael Stéphae Y. Le Goff School of Electrical, Electroic ad Computer Egieerig Newcatle Uiverity, Uited Kigdom Abtract We preet a ew
More informationμ + = σ = D 4 σ = D 3 σ = σ = All units in parts (a) and (b) are in V. (1) x chart: Center = μ = 0.75 UCL =
Our online Tutor are available 4*7 to provide Help with Proce control ytem Homework/Aignment or a long term Graduate/Undergraduate Proce control ytem Project. Our Tutor being experienced and proficient
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationEstimation of Backward Perturbation Bounds For Linear Least Squares Problem
dvaced Sciece ad Techology Letters Vol.53 (ITS 4), pp.47-476 http://dx.doi.org/.457/astl.4.53.96 Estimatio of Bacward Perturbatio Bouds For Liear Least Squares Problem Xixiu Li School of Natural Scieces,
More informationTrial division, Pollard s p 1, Pollard s ρ, and Fermat s method. Christopher Koch 1. April 8, 2014
Iteger Divisio Algorithm ad Cogruece Iteger Trial divisio,,, ad with itegers mod Iverses mod Multiplicatio ad GCD Iteger Christopher Koch 1 1 Departmet of Computer Sciece ad Egieerig CSE489/589 Algorithms
More information