RAINFALL PREDICTION BY WAVELET DECOMPOSITION
|
|
- Beryl Gardner
- 5 years ago
- Views:
Transcription
1 RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces, Beijig, Chia F. L. TSAG Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia A ovel approach of simulatig dail raifall data usig wavelet ad hidde Markov model is preseted i this stud. It is the applied to simulate dail raifall data i three gaugig statios i the Chao Phraa Basi i Thailad. ITRODUCTIO Because of the strog determiistic character of the large-scale (mothl or bimothl) raifall data ad the strog stochastic character of the small-scale (dail) data, either determiistic or stochastic models ca produce successful simulatios of dail raifall data. I this paper, a mixed method which combies a determiistic model with a stochastic model is itroduced ad applied to simulate raifall data i the Chao Phraa Basi i Thailad. I the proposed approach, the raifall sigal is decomposed ito sub-sigals with differet scales, i.e., a large-scale sigal ad several small-scale sigals. For a give time series ad predictio origi t, the date correspodig to t i previous ears, t (e.g. if t, t 7 ad t 3 ), is first idetified, ad sigals of dail data i the das periods [ t +, t + ] is decomposed ito sub-sigals (wavelet tree), where is required to be determied a priori. After decompositio, a determiistic model is used to describe the large-scale sigal, ad a hidde Markov tree model is used to simulate the small-scale sigals i a wavelet tree (Crouse et al., []; Smth et al., [8]). The odes of the wavelet trees have some hidde states (Rabier, []) that follow a mixed Gaussia distributio ad the state probabilities are treated as Markov stochastic processes. The EM algorithm (Crouse et al., []; McLachla, []; Roe et al., [7]; Dempster et al., [3]) is applied to estimate the state ad trasitio probabilities (Rabier, []) for the Markov model. Oce the state probabilities are obtaied, the wavelet coefficiets are simulated b Mote Carlo method. Together with the large-scale sigal determied, the dail raifall data ca be simulated via iverse trasformatio. The approach is the used to simulate three dail raifall time series i the Chao Phraa Basi (CPB) i Thailad. The data series are from the gaugig statio os.,
2 ad 7 respectivel for the periods April, 98 to March 3, 994, April, 98 to Jul 3, 994, ad April, 98 to Jul 3, 994. The statistics of the three data sets are give i Table. SMALL SCALE DATA SIMULATIO For a series of give dail raifall data r i ( i max ) ; max is the legth of the raifall time series, a ew time series u, which gives the mea raifalls for ever das ca be costructed as u r, () i i ( ) + where is the give scale (assiged to be i this stud). The ew time series u ca be cosidered as determiistic ad therefore predictable for sufficietl large scale. To estimate the dail raifall usig the predicted value C, of the mea raifall i a da period, a reasoable thought is to estimate the mea raifalls C, ad C, at the scale level, C,, C,, C, 3 ad C, 4 at the scale level etc. successivel, util the dail scale level C,, C,,, C, is reached. However, to obtai the mea raifall at the scale level, usig the predicted raifall at the scale level, more iformatio is eeded. Sice C,, ad C, & C, respectivel are the mea raifalls at ad scales, the satisf the equatio C, + C, C,. () To estimate the scale mea raifall, aother variable is itroduced: C, C, D,. (3) C +, The, the scale mea raifall ca be estimated b kow ad as C, D, C, (C, + ) D, C,, (4) C, + (C, + ) D, C,. () B the same method, if the wavelet coefficiets
3 Ck, Ck, D k, () C + k, are kow for all the scales k, the Ck, ad C k, ca be obtaied for all, k usig Ck, + Ck, C k,. (7) The estimatio of dail raifall data, C, for all, ca the be doe b sequetial applicatio of this procedure. I this stud, -order scale data correspod to dail raifall data ( ), -order correspod to -da data ( ), -order correspod to 4-da data ( ), 3-order correspod 3 to 8-da data ( ), etc., ad -order data correspod to -da data. The otatios (for example, C k, ad D k, ) without superscript i this paper are limited to the data that are to be estimated, whereas the otatios (for example, C k, ad D k, ) with a superscript refer to the historical data that have bee used i the simulatio process. B usig the above decompositio method the (observed) -order scale data C, ca be decomposed as follows: C, C, C, C, C, D, D, D, D, Coversel, the (simulated) -order scale data ca be recostructed b the wavelet sigal ad the large-scale sigal as: C, C, C, C, C, D, D, D, D, Sice the large-scale sigal of a dail raifall data is assumed to be determiistic, the -order scale data C, ca be predicted usig the historical data for large. I this stud, a local liear model is used for this purpose ad a tree model is used to simulate the k wavelet sigal D k,, for k ad ( D, ca be calculated b estimated C,, historical data C, ad Eq. (3)). I the wavelet tree, the ode ( k, ) where k is the laer umber ad is the positio umber i laer k has the paret ( k +,[( + ) / ]) while the offsprigs are ( k, ) ad ( k,). Here the fuctio [x] returs the largest iteger smaller tha (the paret-child termiolog is used i related papers, e.g. Roe et al. [7] ad x 3
4 Crouse et al. []). The data i the wavelet tree are all stochastic, ad therefore a stochastic method must be used for simulatio. A simple probabilit fuctio such as the Gaussia distributio will ot be suitable because the data i the wavelet tree which are built b the dail raifall data, will cotai ma small values (See Table which gives the dr probabilit, a idicator of the umber of das with zero raifall), ad some large values. I this stud, a mixture model, a combiatio of several Gaussia distributio fuctios, is used to simulate the wavelet sigal: p( x) M vk, ( i) exp( ) i πσ σ i i x, (8) where p(x) is the probabilit distributio of the wavelet sigal x (i this case x Dk, ). The weighted value for each Gaussia distributio fuctio, v k, ( i), is also stochastic. It is simulated b usig a ew radom variable S k,, called the hidde state variable, which has values of {,, 3, K, M}. The weighted value v k, ( i) is equal to the probabilit of hidde state variable i state i (i.e. vk, ( i) Pr( Sk, i) ). I the above defiitios, i is the umber of hidde states assumed ( i,, 3, K, M ), M is the maximum umber of hidde states, ad σ i is the variace of the Gaussia distributio. It ca also be see that the weighted values for the mixture model for the data poits D k, ad D k, or Dk, are depedet. A large value of D k, alwas meas that oe value of either Dk, or Dk, is large. So the weighted value v k, ( i), (or, vk, ( i) ) for the data poit Dk, (or, Dk, ) which is equal to the probabilit of the hidde state variable Sk, (or, Sk, ) depeds o the weighted value v k, (, the probabilit of the hidde state variable S k, equal to j. Sice probabilit of trasitio of the hidde state variable from S k, to S k, l ( l, ) could var with positio ( k, ), we itroduce the trasitio probabilities as follows: Tk, l ( i, Pr( Sk, l i Sk,, l,. (9) The the weighted values vk, ( i), or, vk, ( i) satisf the Markov coditio v (, l,. () M k, l i) Tk, l ( i, vk, ( j I order to simulate the dail raifall data b the above approach, we eed to kow the followig parameters: the -order scale data C, ; the umber of hidde states M ; the variace for each hidde state σ i ; the weighted value v, ( i) for each Gaussia distributio, i.e. the probabilit of the hidde state radom variable S, i ad the trasitio probabilities T k, ( i,. All the remaiig v k, ( i) ca the be obtaied b Eq. () ad the estimated v, ( i). I this stud, the umber of the hidde states M ad their 4
5 variaces σ i, i M, are fixed a priori. The weighted value v, ( i) is obtaied b the EM algorithm. The other weighted values v k, ( i) are give iterativel b Eq. () for k k,, K, ;,, K, ad i,, K, M. Together with the trasitio probabilities T k, ( i, estimated b the EM algorithm usig the previous ears dail raifall data, all the hidde state probabilities ca be obtaied. Usig the hidde state probabilities, the remaiig values D k, (other tha D, ) are simulated b the Mote Carlo method. LARGE SCALE DATA SIMULATIO The -order scale data C, ca be estimated b usig the historical dail raifall data. th For a give predictio origi t, we idetif the date correspodig to t i the ear as th t. If u ad u respectivel deote the mea raifalls for the ear for the periods [ t +, t + ] ad [ t 3 +, t ], the b the determiism of the -order scale data, it ca be assumed that u ad u satisf a evolutioar equatio of the form u h( u ) () where h deotes the evolutioar fuctio which is assumed to be liear of the form u w + w + ε () u where the parameters w ad w are estimated (as ŵ ad ŵ ) b the least squares method. Oce the coefficiets ŵ ad ŵ are kow, the mea raifall data u for the period [ t +, t + ] ca be estimated b u wˆ ˆ + wu (here u will be the mea raifall for the period [ t 3 +, t ], see Fig. for the results of large-scale simulatio). Sice the mea raifall for the period [ t +, t] deoted b C, is kow, the ( ) -order scale data C, ad -order wavelet data D, ca be obtaied from Eqs. () ad (3). APPLICATIO The proposed method is applied to three raifall data sets from the Chao Phraa River Basi i Thailad. As metioed earlier, some parameters eeded to be determied a priori. The iclude the umber of laers i the wavelet tree, the umber of hidde states M ad the variaces σ i for each hidde state. The umber of laers (or, the scale) i the wavelet tree,, is determied usig the False earest eighbours (F) method that has bee proposed for fidig the embeddig dimesio d e of a determiistic sstem (Abarbael []; Jaawardea et al., [4]). I this stud, the same cocept is exteded to determie the best scale order
6 which will esure that the data i the -order scale are determiistic. It should be metioed that, is chose to be the miimum, so that the data of scale less tha are cosidered as stochastic, ad therefore the wavelet tree coefficiets are stochastic. The secod parameter to be assiged a priori is the umber of hidde states which has bee set at 3. The third is the variaces. Sice all the wavelet sigals lie i the iterval (,), their variaces will be withi the rage (, ). Therefore, the are assiged the values σ., σ. 4, σ 3. 7 represetig large, medium ad small hidde states. The simulatio procedure for fixed, M ad predictio origi t, ivolves four steps: The first step is to estimate C, C, u - the mea of raifall data i the iterval [ t +, t + ] b the liear model. It is determied b usig the meas of correspodig das i the previous ears, i.e. the mea u i the iterval [ t +, t + ], ad the mea u i the iterval [ t 3 +, t ], for Y. Sice the raifall data of the period [ t +, t] is kow, C, is obtaied ad thus D, is evaluated b Eq. (3). The secod step is to estimate the weighted value v,( i) for i 3 usig D, obtaied i step oe ad the EM algorithm. The third step k is to estimate the trasitio probabilities T k, ( i, ( k, ad i, j 3) of the wavelet trees costructed b the historical data of the period [ t +, t + ] ad EM algorithm. The last step is to simulate the wavelet coefficiets D k, (other tha D, ) b the Mote Carlo method. The dail raifall data for the das followig the predictio origi ca the be calculated b iverse trasformatio. COCLUSIO t I this paper, a ovel approach of simulatig dail raifall data usig wavelet ad hidde Markov model is itroduced. Sice the model that has bee used is a mixed oe, it has iheretl some radomess built ito it. Therefore a determiistic compariso aloe is ot expected to give a oe to oe match. Istead, a frequec distributio of the umbers of das with raifalls of varig magitudes is show i Fig.. Table gives some parameters of compariso of the large scale simulatio with those of observatio. Obviousl, the liear model ma ot be the best, but it is the simplest. Other tpes of local models ca also be equall applicable. Table 3 gives some parameters of compariso of the simulated ad the observed. Several assumptios were ecessar i this stud. The iclude the assumptios that the 4-da data are determiistic, the wavelet coefficiets follow a mixed Gaussia distributio, ad that the trasitio probabilities for the same period of time i differet ears are the same. Table. Data summar for the Chao Phraa Basi Regios Gaugig statio umber of data poits Dr probabilit o. (CPB).7. o. (CPB) o. 7 (CPB7) Chao Phraa Basi Average aual raifall (mm)
7 Table. Data summar for the large-scale simulatio Gaugig statio Mea Stadard deviatio CPB CPB CPB Table 3. Mea ad stadard deviatios of simulated ad observed dail raifall data Gaugig statio Predictio Mea Stadard deviatio origi CPB t t t CPB t t t CPB7 t t t Mea raifall of 4 das at t (mm) Predictio origi t (Da) Fig. (a) Mea raifall of 4 das at t (mm) Predictio origi t (Da) Fig. (b) Figure. Large-scale simulatio usig -parameter liear fuctio: from t 4349 (Da ) to t 78 (Da 73) of (a) CPB, (b) CPB, 7
8 Mea raifall of 4 das at t (mm) Predictio origi t (Da) Fig. (c) Figure. Large-scale simulatio usig -parameter liear fuctio: from t 4349 ) to t 78 (Da 73) of (c) CPB7.( Cotiued) (Da umber of das 3 umber of das Raifall (mm) Raifall (mm) (A) (B) umber of das 3 umber of das Raifall (mm) Raifall (mm) (B) (D) Figure. Frequec distributio of dail raifall i Chao Phraa Basi. 8
9 umber of das 3 umber of das Raifall (mm) Raifall (mm) (E) (F) Figure. Frequec distributio of dail raifall i Chao Phraa Basi.(cotiued) (A. CPB at origi 48, B. CPB at origi 48, C. CPB at origi 49, D. CPB at origi 48, E. CPB at origi 48, F. CPB at origi 49) REFERECES [] Abarbael, H. D. I., Aalsis of observed chaotic data, ew York: Spriger-Verlag, (99) [] Crouse, M. S., owak, R. D., Baraiuk, R. G., Wavelet-based statistical sigal processig usig hidde Markov models, IEEE Trasactios o Sigal Processig, 4 (998), pp [3] Dempster, A. P., Laird,. M., Rubi, D. B.,. Maximum likelihood from icomplete data via the EM algorithm, J. Roal Stat. Soc. B. 39 (977), pp -38. [4] Jaawardea, A. W., Li, W. K., Xu, P., eighbourhood selectio for local modellig ad predictio of hdrological time series, J. Hdrol. 8 (), pp 4-7. [] McLachla, G. J., Krisha, T., The EM algorithm ad extesios, ew York: Joh Wile, (997). [] Rabier, L. R.,. A tutorial o hidde Markov models ad selected applicatios i speech recogitio, Proc. IEEE 77 (989), pp 7-8. [7] Roe, O., Rohlicek, J. R., Ostedorf, M., Parameter estimatio of depedece tree models usig the EM algorithm, IEEE Sigal Proc. Lett. (99), pp 7-9. [8] Smth, P., Hecherma, D., Jorda, M. I., Probabilistic idepedece etworks for hidde Markov probabilit models, eural comp. 9 (997), pp
Properties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationECE 901 Lecture 12: Complexity Regularization and the Squared Loss
ECE 90 Lecture : Complexity Regularizatio ad the Squared Loss R. Nowak 5/7/009 I the previous lectures we made use of the Cheroff/Hoeffdig bouds for our aalysis of classifier errors. Hoeffdig s iequality
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationChapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian
Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde
More informationStatistical Intervals for a Single Sample
3/5/06 Applied Statistics ad Probability for Egieers Sixth Editio Douglas C. Motgomery George C. Ruger Chapter 8 Statistical Itervals for a Sigle Sample 8 CHAPTER OUTLINE 8- Cofidece Iterval o the Mea
More informationMOMENT-METHOD ESTIMATION BASED ON CENSORED SAMPLE
Vol. 8 o. Joural of Systems Sciece ad Complexity Apr., 5 MOMET-METHOD ESTIMATIO BASED O CESORED SAMPLE I Zhogxi Departmet of Mathematics, East Chia Uiversity of Sciece ad Techology, Shaghai 37, Chia. Email:
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationU8L1: Sec Equations of Lines in R 2
MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie
More information6.867 Machine learning, lecture 7 (Jaakkola) 1
6.867 Machie learig, lecture 7 (Jaakkola) 1 Lecture topics: Kerel form of liear regressio Kerels, examples, costructio, properties Liear regressio ad kerels Cosider a slightly simpler model where we omit
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationA Unified Approach on Fast Training of Feedforward and Recurrent Networks Using EM Algorithm
2270 IEEE TRASACTIOS O SIGAL PROCESSIG, VOL. 46, O. 8, AUGUST 1998 [12] Q. T. Zhag, K. M. Wog, P. C. Yip, ad J. P. Reilly, Statistical aalysis of the performace of iformatio criteria i the detectio of
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationThe DOA Estimation of Multiple Signals based on Weighting MUSIC Algorithm
, pp.10-106 http://dx.doi.org/10.1457/astl.016.137.19 The DOA Estimatio of ultiple Sigals based o Weightig USIC Algorithm Chagga Shu a, Yumi Liu State Key Laboratory of IPOC, Beijig Uiversity of Posts
More informationMost text will write ordinary derivatives using either Leibniz notation 2 3. y + 5y= e and y y. xx tt t
Itroductio to Differetial Equatios Defiitios ad Termiolog Differetial Equatio: A equatio cotaiig the derivatives of oe or more depedet variables, with respect to oe or more idepedet variables, is said
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationADVANCED SOFTWARE ENGINEERING
ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio
More informationECON 3150/4150, Spring term Lecture 3
Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationStatistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons
Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationBayesian Control Charts for the Two-parameter Exponential Distribution
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com 2 Uiversity of the Free State Abstract By usig data that are the mileages
More informationFIR Filter Design: Part II
EEL335: Discrete-Time Sigals ad Systems. Itroductio I this set of otes, we cosider how we might go about desigig FIR filters with arbitrary frequecy resposes, through compositio of multiple sigle-peak
More informationConfidence Intervals
Cofidece Itervals Berli Che Deartmet of Comuter Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Referece: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chater 5 & Teachig Material Itroductio
More informationTopic 10: Introduction to Estimation
Topic 0: Itroductio to Estimatio Jue, 0 Itroductio I the simplest possible terms, the goal of estimatio theory is to aswer the questio: What is that umber? What is the legth, the reactio rate, the fractio
More informationMOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND.
XI-1 (1074) MOST PEOPLE WOULD RATHER LIVE WITH A PROBLEM THEY CAN'T SOLVE, THAN ACCEPT A SOLUTION THEY CAN'T UNDERSTAND. R. E. D. WOOLSEY AND H. S. SWANSON XI-2 (1075) STATISTICAL DECISION MAKING Advaced
More information3/8/2016. Contents in latter part PATTERN RECOGNITION AND MACHINE LEARNING. Dynamical Systems. Dynamical Systems. Linear Dynamical Systems
Cotets i latter part PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 13: SEQUENTIAL DATA Liear Dyamical Systems What is differet from HMM? Kalma filter Its stregth ad limitatio Particle Filter Its simple
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationConfidence Interval for Standard Deviation of Normal Distribution with Known Coefficients of Variation
Cofidece Iterval for tadard Deviatio of Normal Distributio with Kow Coefficiets of Variatio uparat Niwitpog Departmet of Applied tatistics, Faculty of Applied ciece Kig Mogkut s Uiversity of Techology
More informationJournal of Multivariate Analysis. Superefficient estimation of the marginals by exploiting knowledge on the copula
Joural of Multivariate Aalysis 102 (2011) 1315 1319 Cotets lists available at ScieceDirect Joural of Multivariate Aalysis joural homepage: www.elsevier.com/locate/jmva Superefficiet estimatio of the margials
More informationFilter banks. Separately, the lowpass and highpass filters are not invertible. removes the highest frequency 1/ 2and
Filter bas Separately, the lowpass ad highpass filters are ot ivertible T removes the highest frequecy / ad removes the lowest frequecy Together these filters separate the sigal ito low-frequecy ad high-frequecy
More informationThis is an introductory course in Analysis of Variance and Design of Experiments.
1 Notes for M 384E, Wedesday, Jauary 21, 2009 (Please ote: I will ot pass out hard-copy class otes i future classes. If there are writte class otes, they will be posted o the web by the ight before class
More informationRecursive Algorithm for Generating Partitions of an Integer. 1 Preliminary
Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the
More informationChapter 2 Feedback Control Theory Continued
Chapter Feedback Cotrol Theor Cotiued. Itroductio I the previous chapter, the respose characteristic of simple first ad secod order trasfer fuctios were studied. It was show that first order trasfer fuctio,
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationDiscrete Orthogonal Moment Features Using Chebyshev Polynomials
Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationEconomics 250 Assignment 1 Suggested Answers. 1. We have the following data set on the lengths (in minutes) of a sample of long-distance phone calls
Ecoomics 250 Assigmet 1 Suggested Aswers 1. We have the followig data set o the legths (i miutes) of a sample of log-distace phoe calls 1 20 10 20 13 23 3 7 18 7 4 5 15 7 29 10 18 10 10 23 4 12 8 6 (1)
More informationA NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS
Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet
More informationThe Choquet Integral with Respect to Fuzzy-Valued Set Functions
The Choquet Itegral with Respect to Fuzzy-Valued Set Fuctios Weiwei Zhag Abstract The Choquet itegral with respect to real-valued oadditive set fuctios, such as siged efficiecy measures, has bee used i
More informationDepartment of Mathematics
Departmet of Mathematics Ma 3/103 KC Border Itroductio to Probability ad Statistics Witer 2017 Lecture 19: Estimatio II Relevat textbook passages: Larse Marx [1]: Sectios 5.2 5.7 19.1 The method of momets
More informationTrimmed Mean as an Adaptive Robust Estimator of a Location Parameter for Weibull Distribution
World Academy of Sciece Egieerig ad echology Iteratioal Joural of Mathematical ad Computatioal Scieces Vol: No:6 008 rimmed Mea as a Adaptive Robust Estimator of a Locatio Parameter for Weibull Distributio
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that
More informationINF Introduction to classifiction Anne Solberg Based on Chapter 2 ( ) in Duda and Hart: Pattern Classification
INF 4300 90 Itroductio to classifictio Ae Solberg ae@ifiuioo Based o Chapter -6 i Duda ad Hart: atter Classificatio 90 INF 4300 Madator proect Mai task: classificatio You must implemet a classificatio
More informationOn the convergence, consistence and stability of a standard finite difference scheme
AMERICAN JOURNAL OF SCIENTIFIC AND INDUSTRIAL RESEARCH 2, Sciece Huβ, ttp://www.sciub.org/ajsir ISSN: 253-649X, doi:.525/ajsir.2.2.2.74.78 O te covergece, cosistece ad stabilit of a stadard fiite differece
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationSimulation. Two Rule For Inverting A Distribution Function
Simulatio Two Rule For Ivertig A Distributio Fuctio Rule 1. If F(x) = u is costat o a iterval [x 1, x 2 ), the the uiform value u is mapped oto x 2 through the iversio process. Rule 2. If there is a jump
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationOpen book and notes. 120 minutes. Cover page and six pages of exam. No calculators.
IE 330 Seat # Ope book ad otes 120 miutes Cover page ad six pages of exam No calculators Score Fial Exam (example) Schmeiser Ope book ad otes No calculator 120 miutes 1 True or false (for each, 2 poits
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationWHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT
WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still
More informationModule 5 EMBEDDED WAVELET CODING. Version 2 ECE IIT, Kharagpur
Module 5 EMBEDDED WAVELET CODING Versio ECE IIT, Kharagpur Lesso 4 SPIHT algorithm Versio ECE IIT, Kharagpur Istructioal Objectives At the ed of this lesso, the studets should be able to:. State the limitatios
More informationA Slight Extension of Coherent Integration Loss Due to White Gaussian Phase Noise Mark A. Richards
A Slight Extesio of Coheret Itegratio Loss Due to White Gaussia Phase oise Mark A. Richards March 3, Goal I [], the itegratio loss L i computig the coheret sum of samples x with weights a is cosidered.
More informationTMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.
Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx
More informationAN OPEN-PLUS-CLOSED-LOOP APPROACH TO SYNCHRONIZATION OF CHAOTIC AND HYPERCHAOTIC MAPS
http://www.paper.edu.c Iteratioal Joural of Bifurcatio ad Chaos, Vol. 1, No. 5 () 119 15 c World Scietific Publishig Compay AN OPEN-PLUS-CLOSED-LOOP APPROACH TO SYNCHRONIZATION OF CHAOTIC AND HYPERCHAOTIC
More informationAdvanced Stochastic Processes.
Advaced Stochastic Processes. David Gamarik LECTURE 2 Radom variables ad measurable fuctios. Strog Law of Large Numbers (SLLN). Scary stuff cotiued... Outlie of Lecture Radom variables ad measurable fuctios.
More informationDISTRIBUTION LAW Okunev I.V.
1 DISTRIBUTION LAW Okuev I.V. Distributio law belogs to a umber of the most complicated theoretical laws of mathematics. But it is also a very importat practical law. Nothig ca help uderstad complicated
More informationThe random version of Dvoretzky s theorem in l n
The radom versio of Dvoretzky s theorem i l Gideo Schechtma Abstract We show that with high probability a sectio of the l ball of dimesio k cε log c > 0 a uiversal costat) is ε close to a multiple of the
More informationAchieving Stationary Distributions in Markov Chains. Monday, November 17, 2008 Rice University
Istructor: Achievig Statioary Distributios i Markov Chais Moday, November 1, 008 Rice Uiversity Dr. Volka Cevher STAT 1 / ELEC 9: Graphical Models Scribe: Rya E. Guerra, Tahira N. Saleem, Terrace D. Savitsky
More informationClustering. CM226: Machine Learning for Bioinformatics. Fall Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar.
Clusterig CM226: Machie Learig for Bioiformatics. Fall 216 Sriram Sakararama Ackowledgmets: Fei Sha, Ameet Talwalkar Clusterig 1 / 42 Admiistratio HW 1 due o Moday. Email/post o CCLE if you have questios.
More informationConfidence interval for the two-parameter exponentiated Gumbel distribution based on record values
Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values
More information5.1 Review of Singular Value Decomposition (SVD)
MGMT 69000: Topics i High-dimesioal Data Aalysis Falll 06 Lecture 5: Spectral Clusterig: Overview (cotd) ad Aalysis Lecturer: Jiamig Xu Scribe: Adarsh Barik, Taotao He, September 3, 06 Outlie Review of
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationAsymptotic distribution of the first-stage F-statistic under weak IVs
November 6 Eco 59A WEAK INSTRUMENTS III Testig for Weak Istrumets From the results discussed i Weak Istrumets II we kow that at least i the case of a sigle edogeous regressor there are weak-idetificatio-robust
More informationCentral limit theorem and almost sure central limit theorem for the product of some partial sums
Proc. Idia Acad. Sci. Math. Sci. Vol. 8, No. 2, May 2008, pp. 289 294. Prited i Idia Cetral it theorem ad almost sure cetral it theorem for the product of some partial sums YU MIAO College of Mathematics
More informationAccess to the published version may require journal subscription. Published with permission from: Elsevier.
This is a author produced versio of a paper published i Statistics ad Probability Letters. This paper has bee peer-reviewed, it does ot iclude the joural pagiatio. Citatio for the published paper: Forkma,
More informationMolecular Mechanisms of Gas Diffusion in CO 2 Hydrates
Supportig Iformatio Molecular Mechaisms of Gas Diffusio i CO Hydrates Shuai Liag, * Deqig Liag, Negyou Wu,,3 Lizhi Yi, ad Gaowei Hu,3 Key Laboratory of Gas Hydrate, Guagzhou Istitute of Eergy Coversio,
More information6.867 Machine learning
6.867 Machie learig Mid-term exam October, ( poits) Your ame ad MIT ID: Problem We are iterested here i a particular -dimesioal liear regressio problem. The dataset correspodig to this problem has examples
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter 2 & Teachig
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationEconomics 241B Relation to Method of Moments and Maximum Likelihood OLSE as a Maximum Likelihood Estimator
Ecoomics 24B Relatio to Method of Momets ad Maximum Likelihood OLSE as a Maximum Likelihood Estimator Uder Assumptio 5 we have speci ed the distributio of the error, so we ca estimate the model parameters
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationTHE KALMAN FILTER RAUL ROJAS
THE KALMAN FILTER RAUL ROJAS Abstract. This paper provides a getle itroductio to the Kalma filter, a umerical method that ca be used for sesor fusio or for calculatio of trajectories. First, we cosider
More informationProbability and statistics: basic terms
Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample
More informationMathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution
America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical
More informationFastest mixing Markov chain on a path
Fastest mixig Markov chai o a path Stephe Boyd Persi Diacois Ju Su Li Xiao Revised July 2004 Abstract We ider the problem of assigig trasitio probabilities to the edges of a path, so the resultig Markov
More informationANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY
ANOTHER WEIGHTED WEIBULL DISTRIBUTION FROM AZZALINI S FAMILY Sulema Nasiru, MSc. Departmet of Statistics, Faculty of Mathematical Scieces, Uiversity for Developmet Studies, Navrogo, Upper East Regio, Ghaa,
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationU8L1: Sec Equations of Lines in R 2
MCVU Thursda Ma, Review of Equatios of a Straight Lie (-D) U8L Sec. 8.9. Equatios of Lies i R Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio
More informationAsymptotic distribution of products of sums of independent random variables
Proc. Idia Acad. Sci. Math. Sci. Vol. 3, No., May 03, pp. 83 9. c Idia Academy of Scieces Asymptotic distributio of products of sums of idepedet radom variables YANLING WANG, SUXIA YAO ad HONGXIA DU ollege
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationBayesian Methods: Introduction to Multi-parameter Models
Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested
More information