STUDY OF ATTRACTOR VARIATION IN THE RECONSTRUCTED PHASE SPACE OF SPEECH SIGNALS
|
|
- Kerry King
- 5 years ago
- Views:
Transcription
1 STUDY OF ATTRACTOR VARIATION IN THE RECONSTRUCTED PHASE SPACE OF SPEECH SIGNALS Jiji Ye Departmet of Electrical ad Computer Egieerig Milwaukee, WI USA Michael T. Johso Departmet of Electrical ad Computer Egieerig Milwaukee, WI USA Richard J. Povielli Departmet of Electrical ad Computer Egieerig Milwaukee, WI USA ABSTRACT This paper presets a study of the attractor variatio i the recostructed phase spaces of isolated phoemes. The approach is based o recet work i time-domai sigal classificatio usig dyamical sigal models, whereby a statistical distributio model is obtaied from the phase space ad used for maximum likelihood classificatio. Two sets of experimets are preseted i this paper. The first uses a variable time lag phase space to examie the effect of fudametal frequecy o attractor patters. The secod focuses o speaker variability through a ivestigatio of speaker-depedet phoeme classificatio across speaker sets of icreasig size. The results are discussed at the ed of the paper. 1. INTRODUCTION State of the art speech recogitio systems typically use cepstral coefficiet features, obtaied via a frame-based spectral aalysis of the speech sigal (Deller et al., 2). However, recet work i phase space recostructio techiques (Abarbael, 1996; Katz ad Schrieber, 2) for oliear modelig of time-series sigals has motivated ivestigatio ito the efficacy of usig dyamical systems models i the time-domai for speech recogitio (Ye et al., 22). I theory, recostructed phase spaces capture the full dyamics of the uderlyig system, icludig oliear iformatio ot preserved by traditioal spectral techiques, leadig to possibilities for improved recogitio accuracy. This paper is based o work supported by NSF uder Grat No. IIS The classical techique for phoeme classificatio is Hidde Markov Models (HMM) (Lee ad Ho, 1989; Youg, 1992), ofte based o Gaussia Mixture Model (GMM) observatio probabilities. The most commo features are Mel Frequecy Cepstral Coefficiets (MFCCs). I cotrast, the recostructed phase space is a plot of the time-lagged vectors of a sigal. Such phase spaces have bee show to be topologically equivalet to the origial system, if the embeddig dimesio is large eough (Sauer et al., 1991). Structural patters occur i this processig space, commoly referred to as trajectories or attractors, which ca be quatified through ivariat metrics such as correlatio dimesio or Lyapuov expoets or through direct models of the phase space distributio. Previous results o phoeme classificatio (Ye et al., 22) have show that a Bayes classifier over statistical models of the recostructed phase spaces are effective i classifyig phoemes. Phase space recostructios are ot specific to ay particular productio model of the uderlyig system, assumig oly that the dimesio of the system is fiite. We would like to be able to take advatage of our a priori kowledge about speech productio mechaisms to improve usefuless of phase space models for speech recogitio i particular. I pursuit of this, we have implemeted two sets of experimets to study attractor variatio, the first to look at fudametal frequecy effects i vowels ad the secod to look at speaker variability issues. Fudametal frequecy, as a parameter that varies sigificatly but does ot cotai iformatio about the geeratig phoeme, should clearly affect the phase space i a adverse way for classificatio. This hypothesis is examied through a compesatio techique usig variable lag recostructios. Speaker variability is
2 a as of yet ukow factor with regard to the amout of variace caused i uderlyig attractor characteristics, ad is a importat issue i the questio of how well this techique will work for speaker-idepedet tasks. Iitial experimets have show some sigificat discrimiability i such tasks, but performed at a measurably lower accuracy tha that for speaker-depedet tests. Each of these experimets use a oparametric distributio model based o bi couts with a maximum likelihood phoeme classifier, as described i more detail i the ext sectio. The TIMIT database is used for both tasks. 2. METHOD 2.1. Phase Space Recostructio Phase space recostructio techiques are fouded o uderlyig priciples of dyamical system theory (Sauer et al., 1991; Takes, 198) ad have bee applied to a variety of time series aalysis ad oliear sigals processig applicatios [refs xx] (Abarbael, 1996; Katz ad Schrieber, 2). Give a time series x = x, = 1... N (1) where is a time idex ad N is the umber of observatios, the vectors i a recostructed phase space are formed as x = [ x x x ], (2) ( d 1) where is the time lag ad d is the embeddig dimesio. Take as a whole, the sigal forms a trajectory matrix compiled from the time-lagged sigal vectors: X = x x x ( d 1) x x x ( d 1) x x x N ( d 1) N ( d 2) N Figure 1 shows a illustrative two-dimesioal recostructed phase space trajectory, while Figure 2 shows the same space with idividual poits oly, as modeled by the statistical approach used here. (3) Figure 1 Recostructed phase space of the vowel phoeme /aa/ illustratig trajectory Figure 2 Recostructed phase space of the vowel phoeme /aa/ illustratig desity The time lag used i the recostructed phase space is empirical but guided by some key measures such as mutual iformatio ad autocorrelatio (Abarbael, 1996; Katz ad Schrieber, 2). Usig such measures, a time lag of six is appropriate for isolated phoeme recogitio usig TIMIT. For the variable lag experimets baselie time lags of 6 ad 12 are used, as discussed i details later.
3 I practice, the phase-space recostructio is zeromeaed ad the amplitude variatio is radially ormalized via: x µ x X = (4) σ where σ r x N 1 x µ x N ( d 1) =+ r 1 ( d 1) is a origial poit i the phase space, µ is the sample mea of the colums of X. X 2.2. Noparametric Distributio Model of Recostructed Phase Space A statistical characterizatio of the recostructed phase space, related to the atural measure or atural distributio of the uderlyig attractor (Abarbael, 1996; Katz ad Schrieber, 2), is estimated by dividig the recostructed phase space ito 1 histogram bis as is illustrated i Figure 2. This is doe by dividig each dimesio ito te partitios such that each partitio cotais approximately 1% of the data poits. The itercepts of the bis are determied usig all the traiig data The Bayes Classifier The estimates of the atural distributio are used as models for a Bayes classifier. This classifier simply computes the coditioal probabilities of the differet classes give the phase space ad the selects the class with the highest coditioal probability: N ˆ ω = arg max{ pˆ ( )} pˆ i X = arg max i ( x ) (6) i= 1 C i= 1 C = 1 p x is the bi-based likelihood of a where ( ) ˆi poit i the phase space, C is the umber of phoeme classes, ad ˆω is the resultig maximum likelihood hypothesis. 3. EXPERIMENT DESIGN 3.1. Variable Lag Model for Vowels The basic idea of this experimet is to use variable time lags istead of a fixed time lag for embeddig vowel phoemes, as a fuctio of the uderlyig fudametal frequecy of the vowel. A estimate 2 (5) of the fudametal frequecy is used to determie the appropriate embeddig lag. The fudametal frequecy estimate algorithm for vowels used here is based o the computatio of autocorrelatio i the time domai as implemeted by the Etropic ESPS package (Etropic, 1993). The typical vowel fudametal frequecy rage for male speakers is 1~15Hz, with a average of about 125Hz, while the typical rage for female speakers is 175~256Hz, with a average of about 2Hz. For this experimet oly male speakers were used. I the recostructed phase space, a lower fudametal frequecy has a loger period, correspodig to a larger time lag. With a baselie time lag ad mea fudametal frequecy give as ad f respectively, we perform fudametal frequecy compesatio via the equatios f = f (7) ad f ' = (8) f where is the ew time lag ad f is the fudametal frequecy estimate of the phoeme example. This time lag is rouded ad used for phase space recostructio, for both estimatio of the phoeme distributios across the traiig set ad maximum likelihood classificatio of the test set examples. Two differet baselie time lags are used i the experimets. A time lag of 6 correspods to that chose through examiatio of the mutual iformatio ad autocorrelatio heuristics; however, roudig effects lead to quite a low resolutio o the lags i the experimet, which vary primarily betwee 5, 6, ad 7. To achieve a slightly higher resolutio, a secod set of experimets at a time lag of 12 is implemeted for compariso. Sice the fial time lags used for recostructio are give by a fudametal frequecy ratio, the value of the baselie frequecy is ot of great importace, but should be chose to be ear the mea fudametal frequecy. Baselies of 12Hz ad 13Hz were ivestigated. The fial time lag is give i accordace with equatio (8) above. The data set used here icludes 6 male speakers for traiig ad 3 differet male speakers for testig, all withi the same dialect regio.
4 3.2. Speaker Variability Usig the phase space recostructio techique for speaker-idepedet tasks clearly requires that the attractor patter across differet speakers is cosistet. Icosistecy of attractor structures across differet speakers would be expected to lead to smoothed ad imprecise phoeme models with resultig poor classificatio accuracy. The experimets preseted here are desiged to ivestigate the iter-speaker variatio of attractor patters. Although a umber of differet attractor distace metrics could be used for this purpose, the best such choice is ot readily apparet ad we have istead focused o classificatio accuracy as a fuctio of the umber of speakers i a closedset speaker depedet recogitio task. The higher the cosistecy of attractors across speakers, the less accuracy degradatio should be expected as the umber of speakers i the set is icreased. All speakers are male speakers selected from the same dialect regio withi the TIMIT corpus. The bi-based models ad maximum likelihood classificatio methods discussed previously are used i all cases. The oly variable is the umber of speakers for isolated phoeme classificatio tasks. To examie speaker variability effects across differet classes of phoemes, vowels, fricatives ad asals are tested separately. The overall data set is a group of 22 male speakers, from which subsets of 22, 17, 11, 6, 3, 2 or 1 speaker(s) have bee radomly selected. Classificatio experimets are performed o sets of 7 fricatives, 7 vowels, ad 5 asals. Exp 1: d = 2, = 6, =, f Exp 2: d = 2, = 6, f = 12 Hz, =, f f Exp 3: d = 2, = 6, f = 13 Hz, =, f Exp 4: d = 2, = 12, =, f Exp 5: d = 2, = 12, f = 12 Hz, = f, f Exp 6: d = 2, = 12, f = 13 Hz, = f, where d is the embeddig dimesio, is the default time lag, f is the default fudametal frequecy, f is the estimated fudametal frequecy, ad is the actual embeddig time lag. Table 1 shows the resultig rages for give the parameters, while Table 2 ad 3 show the classificatio results. f 6 12Hz 5~7 6 13Hz 5~ Hz 1~ Hz 1~16 Table 1 Rage of give ad f Exp 1 Exp 2 Exp % 33.78% 35.14% 4. RESULTS Table 2 Vowel phoeme classificatio results for 4.1. Variable Lag for Vowels lag of 6 The 7 vowel set { /aw/ /ay/ /ey/ /ix/ /iy/ /ow/ /oy/ } is used for these experimets. As described previously, data are selected from 6 male speakers for traiig ad 3 differet male speakers for testig, all withi the same dialect regio. There are a total of six experimets, three with a baselie lag of 6 ad three with a baselie lag of 12. I each case the tests are ru with a fixed lag as well as with variable lags based o both 12Hz ad 13Hz. The six experimets are summarized as follows: Exp 4 Exp 5 Exp % 35.14% 39.86% Table 3 Vowel phoeme classificatio results for lag of 12 As ca be see from the above results, the best classificatio accuracy is obtaied by usig a variable lag model with default fudametal frequecy of 13Hz.
5 4.2. Speaker Variability The evaluatio of speaker variability was carried out usig the leave-oe-out cross validatio. The overall classificatio accuracies for the three types of phoemes are show i Table 4, Table 5 ad Table 6. Spkr# Acc(%) Table 4 Phoeme classificatio results of fricatives with differet umber of speakers Spkr# Acc(%) Table 5 Phoeme classificatio results of vowels with differet umber of speakers Spkr# Acc(%) Table 6 Phoeme classificatio results of asals with differet umber of speakers Figure 3 is a visual iterpretatio of the results preseted above. The classificatio results are plotted agaist the umber of speakers for vowels, fricatives ad asals respectively. reported i the previous paper (Ye et al., 22), for a speaker-idepedet task over vowels, asals, ad fricatives. I all three phoeme types, the accuracy was relatively uchaged after 2 or 3 speakers. 5. WORK IN PROGRESS Because of the large differece betwee the baselie umbers i the variable lag experimets, we will verify ad ivestigate them by ruig other experimets. The experimets preseted are performed o a speaker-idepedet dataset, which could affect the results due to speaker variability. The additioal ivestigatio o the effect of fudametal frequecy o attractor patters will be icluded i the fial paper. 6. DISCUSSION AND CONCLUSIONS We have examied attractor variatio i the recostructed phase space of isolated phoemes. The variable lag experimets show a improvemet whe the phase space icorporates fudametal frequecy compesatio. The speaker variability experimets idicate that there is a sigificat amout of cosistecy across attractor patters betwee speakers, which shows that the recostructed phase space represetatio of speech sigal has the discrimiative power for the speaker-idepedet tasks. Future work would iclude discoverig the method to compesate speaker variability for the phase space recostructio techique o speech recogitio applicatios. REFERENCES Figure 3 The classificatio accuracy vs. umber of speakers As ca be see from Figure 3, the degree of attractor variatio across speakers is differet for these three types of phoemes. Nasals appear to have the largest variability while the fricatives have the least, which is cosistet with the results Abarbael, H.D.I., Aalysis of observed chaotic data. Spriger, New York, xiv, 272 pp. Deller, J.R., Hase, J.H.L. ad Proakis, J.G., 2. Discrete-Time Processig of Speech Sigals. IEEE Press, New York, 98 pp. Etropic, ESPS Programs Maual. Etropic Research laboratory. Katz, H. ad Schrieber, T., 2. Noliear Time Series Aalysis. Cambridge Noliear Sciece Series 7. Cambridge Uiversity Press, New York, NY, 34 pp. Lee, K.-F. ad Ho, H.-W., Speaker-idepedet phoe recogitio usig hidde Markov models.
6 IEEE Trasactios o Acoustics, Speech ad Sigal Processig, 37(11): Sauer, T., Yorke, J.A. ad Casdagli, M., Embedology. Joural of Statistical Physics, 65(3/4): Takes, F., 198. Detectig strage attractors i turbulece. Dyamical Systems ad Turbulece, 898: Ye, J., Povielli, R.J. ad Johso, M.T., 22. Phoeme Classificatio Usig Naive Bayes Classifier I Recostructed Phase Space. 1th Digital Sigal Processig Workshop. Youg, S., The geeral use of tyig i phoemebased HMM speech recogitio. ICASSP, 1:
PHONEME CLASSIFICATION OVER THE RECONSTRUCTED PHASE SPACE USING PRINCIPAL COMPONENT ANALYSIS
PHONEME CLASSIFICATION OVER THE RECONSTRUCTED PHASE SPACE USING PRINCIPAL COMPONENT ANALYSIS Jinjin Ye jinjin.ye@mu.edu Michael T. Johnson mike.johnson@mu.edu Richard J. Povinelli richard.povinelli@mu.edu
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationVector Quantization: a Limiting Case of EM
. Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z
More informationRun-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE
Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationGoodness-of-Fit Tests and Categorical Data Analysis (Devore Chapter Fourteen)
Goodess-of-Fit Tests ad Categorical Data Aalysis (Devore Chapter Fourtee) MATH-252-01: Probability ad Statistics II Sprig 2019 Cotets 1 Chi-Squared Tests with Kow Probabilities 1 1.1 Chi-Squared Testig................
More informationREGRESSION (Physics 1210 Notes, Partial Modified Appendix A)
REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data
More informationOptimum LMSE Discrete Transform
Image Trasformatio Two-dimesioal image trasforms are extremely importat areas of study i image processig. The image output i the trasformed space may be aalyzed, iterpreted, ad further processed for implemetig
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationRAINFALL PREDICTION BY WAVELET DECOMPOSITION
RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,
More informationDr. Maddah ENMG 617 EM Statistics 11/26/12. Multiple Regression (2) (Chapter 15, Hines)
Dr Maddah NMG 617 M Statistics 11/6/1 Multiple egressio () (Chapter 15, Hies) Test for sigificace of regressio This is a test to determie whether there is a liear relatioship betwee the depedet variable
More informationMixtures of Gaussians and the EM Algorithm
Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity
More informationChapter 11 Output Analysis for a Single Model. Banks, Carson, Nelson & Nicol Discrete-Event System Simulation
Chapter Output Aalysis for a Sigle Model Baks, Carso, Nelso & Nicol Discrete-Evet System Simulatio Error Estimatio If {,, } are ot statistically idepedet, the S / is a biased estimator of the true variace.
More informationAssessment of extreme discharges of the Vltava River in Prague
Flood Recovery, Iovatio ad Respose I 05 Assessmet of extreme discharges of the Vltava River i Prague M. Holický, K. Jug & M. Sýkora Kloker Istitute, Czech Techical Uiversity i Prague, Czech Republic Abstract
More informationADVANCED SOFTWARE ENGINEERING
ADVANCED SOFTWARE ENGINEERING COMP 3705 Exercise Usage-based Testig ad Reliability Versio 1.0-040406 Departmet of Computer Ssciece Sada Narayaappa, Aeliese Adrews Versio 1.1-050405 Departmet of Commuicatio
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 5 STATISTICS II. Mea ad stadard error of sample data. Biomial distributio. Normal distributio 4. Samplig 5. Cofidece itervals
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationGoodness-Of-Fit For The Generalized Exponential Distribution. Abstract
Goodess-Of-Fit For The Geeralized Expoetial Distributio By Amal S. Hassa stitute of Statistical Studies & Research Cairo Uiversity Abstract Recetly a ew distributio called geeralized expoetial or expoetiated
More informationExpectation-Maximization Algorithm.
Expectatio-Maximizatio Algorithm. Petr Pošík Czech Techical Uiversity i Prague Faculty of Electrical Egieerig Dept. of Cyberetics MLE 2 Likelihood.........................................................................................................
More informationHypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance
Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete
More information11 Correlation and Regression
11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record
More informationENGI 4421 Confidence Intervals (Two Samples) Page 12-01
ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly
More informationFinal Examination Solutions 17/6/2010
The Islamic Uiversity of Gaza Faculty of Commerce epartmet of Ecoomics ad Political Scieces A Itroductio to Statistics Course (ECOE 30) Sprig Semester 009-00 Fial Eamiatio Solutios 7/6/00 Name: I: Istructor:
More information7-1. Chapter 4. Part I. Sampling Distributions and Confidence Intervals
7-1 Chapter 4 Part I. Samplig Distributios ad Cofidece Itervals 1 7- Sectio 1. Samplig Distributio 7-3 Usig Statistics Statistical Iferece: Predict ad forecast values of populatio parameters... Test hypotheses
More informationBasis for simulation techniques
Basis for simulatio techiques M. Veeraraghava, March 7, 004 Estimatio is based o a collectio of experimetal outcomes, x, x,, x, where each experimetal outcome is a value of a radom variable. x i. Defiitios
More informationDouble Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution
Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.
More informationChapter 2 Descriptive Statistics
Chapter 2 Descriptive Statistics Statistics Most commoly, statistics refers to umerical data. Statistics may also refer to the process of collectig, orgaizig, presetig, aalyzig ad iterpretig umerical data
More informationChapter 13, Part A Analysis of Variance and Experimental Design
Slides Prepared by JOHN S. LOUCKS St. Edward s Uiversity Slide 1 Chapter 13, Part A Aalysis of Variace ad Eperimetal Desig Itroductio to Aalysis of Variace Aalysis of Variace: Testig for the Equality of
More informationJacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3
No-Parametric Techiques Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 Parametric vs. No-Parametric Parametric Based o Fuctios (e.g Normal Distributio) Uimodal Oly oe peak Ulikely real data cofies
More informationPattern Classification, Ch4 (Part 1)
Patter Classificatio All materials i these slides were take from Patter Classificatio (2d ed) by R O Duda, P E Hart ad D G Stork, Joh Wiley & Sos, 2000 with the permissio of the authors ad the publisher
More informationEE 6885 Statistical Pattern Recognition
EE 6885 Statistical Patter Recogitio Fall 5 Prof. Shih-Fu Chag http://www.ee.columbia.edu/~sfchag Lecture 6 (9/8/5 EE6887-Chag 6- Readig EM for Missig Features Textboo, DHS 3.9 Bayesia Parameter Estimatio
More informationThe target reliability and design working life
Safety ad Security Egieerig IV 161 The target reliability ad desig workig life M. Holický Kloker Istitute, CTU i Prague, Czech Republic Abstract Desig workig life ad target reliability levels recommeded
More informationPower and Type II Error
Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error
More information10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random
Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),
More informationDiscrete Orthogonal Moment Features Using Chebyshev Polynomials
Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical
More informationGeneral IxJ Contingency Tables
page1 Geeral x Cotigecy Tables We ow geeralize our previous results from the prospective, retrospective ad cross-sectioal studies ad the Poisso samplig case to x cotigecy tables. For such tables, the test
More informationBasics of Probability Theory (for Theory of Computation courses)
Basics of Probability Theory (for Theory of Computatio courses) Oded Goldreich Departmet of Computer Sciece Weizma Istitute of Sciece Rehovot, Israel. oded.goldreich@weizma.ac.il November 24, 2008 Preface.
More informationSession 5. (1) Principal component analysis and Karhunen-Loève transformation
200 Autum semester Patter Iformatio Processig Topic 2 Image compressio by orthogoal trasformatio Sessio 5 () Pricipal compoet aalysis ad Karhue-Loève trasformatio Topic 2 of this course explais the image
More information577. Estimation of surface roughness using high frequency vibrations
577. Estimatio of surface roughess usig high frequecy vibratios V. Augutis, M. Sauoris, Kauas Uiversity of Techology Electroics ad Measuremets Systems Departmet Studetu str. 5-443, LT-5368 Kauas, Lithuaia
More informationStatistical Analysis on Uncertainty for Autocorrelated Measurements and its Applications to Key Comparisons
Statistical Aalysis o Ucertaity for Autocorrelated Measuremets ad its Applicatios to Key Comparisos Nie Fa Zhag Natioal Istitute of Stadards ad Techology Gaithersburg, MD 0899, USA Outlies. Itroductio.
More informationAlgebra of Least Squares
October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal
More informationPSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 9
Hypothesis testig PSYCHOLOGICAL RESEARCH (PYC 34-C Lecture 9 Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I
More informationA proposed discrete distribution for the statistical modeling of
It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS047) p.5059 A proposed discrete distributio for the statistical modelig of Likert data Kidd, Marti Cetre for Statistical
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationSensitivity Analysis of Daubechies 4 Wavelet Coefficients for Reduction of Reconstructed Image Error
Proceedigs of the 6th WSEAS Iteratioal Coferece o SIGNAL PROCESSING, Dallas, Texas, USA, March -4, 7 67 Sesitivity Aalysis of Daubechies 4 Wavelet Coefficiets for Reductio of Recostructed Image Error DEVINDER
More informationR. van Zyl 1, A.J. van der Merwe 2. Quintiles International, University of the Free State
Bayesia Cotrol Charts for the Two-parameter Expoetial Distributio if the Locatio Parameter Ca Take o Ay Value Betwee Mius Iity ad Plus Iity R. va Zyl, A.J. va der Merwe 2 Quitiles Iteratioal, ruaavz@gmail.com
More informationStatistical Noise Models and Diagnostics
L. Yaroslavsky: Advaced Image Processig Lab: A Tutorial, EUSIPCO2 LECTURE 2 Statistical oise Models ad Diagostics 2. Statistical models of radom iterfereces: (i) Additive sigal idepedet oise model: r =
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationExcellent Performances of The Third-level Disturbed Chaos in The Cryptography Algorithm and The Spread Spectrum Communication
Joural of Iformatio Hidig ad Multimedia Sigal Processig c 26 ISSN 273-422 Ubiquitous Iteratioal Volume 7, Number 4, July 26 Excellet Performaces of The Third-level Disturbed Chaos i The Cryptography Algorithm
More informationExtended Weighted Linear Prediction Using the Autocorrelation Snapshot
Exteded Weighted Liear Predictio Usig the Autocorrelatio Sapshot - A Robust Speech Aalysis Method ad its Applicatio to Recogitio of Vocal Emotios Joui Pohjalaie ad Paavo Alku Departmet of Sigal Processig
More informationIf, for instance, we were required to test whether the population mean μ could be equal to a certain value μ
STATISTICAL INFERENCE INTRODUCTION Statistical iferece is that brach of Statistics i which oe typically makes a statemet about a populatio based upo the results of a sample. I oesample testig, we essetially
More informationInformation-based Feature Selection
Iformatio-based Feature Selectio Farza Faria, Abbas Kazeroui, Afshi Babveyh Email: {faria,abbask,afshib}@staford.edu 1 Itroductio Feature selectio is a topic of great iterest i applicatios dealig with
More informationLecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)
Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +
More informationTMA4245 Statistics. Corrected 30 May and 4 June Norwegian University of Science and Technology Department of Mathematical Sciences.
Norwegia Uiversity of Sciece ad Techology Departmet of Mathematical Scieces Corrected 3 May ad 4 Jue Solutios TMA445 Statistics Saturday 6 May 9: 3: Problem Sow desity a The probability is.9.5 6x x dx
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationOn an Application of Bayesian Estimation
O a Applicatio of ayesia Estimatio KIYOHARU TANAKA School of Sciece ad Egieerig, Kiki Uiversity, Kowakae, Higashi-Osaka, JAPAN Email: ktaaka@ifokidaiacjp EVGENIY GRECHNIKOV Departmet of Mathematics, auma
More informationSECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES
SECTION 1.5 : SUMMATION NOTATION + WORK WITH SEQUENCES Read Sectio 1.5 (pages 5 9) Overview I Sectio 1.5 we lear to work with summatio otatio ad formulas. We will also itroduce a brief overview of sequeces,
More information15-780: Graduate Artificial Intelligence. Density estimation
5-780: Graduate Artificial Itelligece Desity estimatio Coditioal Probability Tables (CPT) But where do we get them? P(B)=.05 B P(E)=. E P(A B,E) )=.95 P(A B, E) =.85 P(A B,E) )=.5 P(A B, E) =.05 A P(J
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationCHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION
CHAPTER 4 BIVARIATE DISTRIBUTION EXTENSION 4. Itroductio Numerous bivariate discrete distributios have bee defied ad studied (see Mardia, 97 ad Kocherlakota ad Kocherlakota, 99) based o various methods
More informationDiscrete Mathematics for CS Spring 2008 David Wagner Note 22
CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig
More informationLINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity
LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 9 Multicolliearity Dr Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Multicolliearity diagostics A importat questio that
More informationAnalysis of Experimental Measurements
Aalysis of Experimetal Measuremets Thik carefully about the process of makig a measuremet. A measuremet is a compariso betwee some ukow physical quatity ad a stadard of that physical quatity. As a example,
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationThere is no straightforward approach for choosing the warmup period l.
B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationLogit regression Logit regression
Logit regressio Logit regressio models the probability of Y= as the cumulative stadard logistic distributio fuctio, evaluated at z = β 0 + β X: Pr(Y = X) = F(β 0 + β X) F is the cumulative logistic distributio
More informationNon-Linear Maximum Likelihood Feature Transformation For Speech Recognition
No-Liear Maximum Likelihood Feature Trasformatio For Speech Recogitio Mohamed Kamal Omar, Mark Hasegawa-Johso Departmet of Electrical Ad Computer Egieerig, Uiversity of Illiois at Urbaa-Champaig, Urbaa,
More informationOverview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions
Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples
More informationAssessment and Modeling of Forests. FR 4218 Spring Assignment 1 Solutions
Assessmet ad Modelig of Forests FR 48 Sprig Assigmet Solutios. The first part of the questio asked that you calculate the average, stadard deviatio, coefficiet of variatio, ad 9% cofidece iterval of the
More informationChapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian
Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde
More informationANALYSIS OF EXPERIMENTAL ERRORS
ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder
More informationISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 4, Issue 10, April 2015
Attractors of Duffig Map: Applicatio of DLI ad - Test Aysha Ibraheem, Nareder Kumar Departmet of Mathematics, Uiversity of Delhi, Delhi-7, Idia. Associate Professor, Departmet of Mathematics, Aryabhatta
More informationDirection of Arrival Estimation Method in Underdetermined Condition Zhang Youzhi a, Li Weibo b, Wang Hanli c
4th Iteratioal Coferece o Advaced Materials ad Iformatio Techology Processig (AMITP 06) Directio of Arrival Estimatio Method i Uderdetermied Coditio Zhag Youzhi a, Li eibo b, ag Hali c Naval Aeroautical
More informationAccess to the published version may require journal subscription. Published with permission from: Elsevier.
This is a author produced versio of a paper published i Statistics ad Probability Letters. This paper has bee peer-reviewed, it does ot iclude the joural pagiatio. Citatio for the published paper: Forkma,
More informationNYU Center for Data Science: DS-GA 1003 Machine Learning and Computational Statistics (Spring 2018)
NYU Ceter for Data Sciece: DS-GA 003 Machie Learig ad Computatioal Statistics (Sprig 208) Brett Berstei, David Roseberg, Be Jakubowski Jauary 20, 208 Istructios: Followig most lab ad lecture sectios, we
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More informationPixel Recurrent Neural Networks
Pixel Recurret Neural Networks Aa ro va de Oord, Nal Kalchbreer, Koray Kavukcuoglu Google DeepMid August 2016 Preseter - Neha M Example problem (completig a image) Give the first half of the image, create
More informationWHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? ABSTRACT
WHAT IS THE PROBABILITY FUNCTION FOR LARGE TSUNAMI WAVES? Harold G. Loomis Hoolulu, HI ABSTRACT Most coastal locatios have few if ay records of tsuami wave heights obtaied over various time periods. Still
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed
More information[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION
[412] A TEST FOR HOMOGENEITY OF THE MARGINAL DISTRIBUTIONS IN A TWO-WAY CLASSIFICATION BY ALAN STUART Divisio of Research Techiques, Lodo School of Ecoomics 1. INTRODUCTION There are several circumstaces
More informationRiesz-Fischer Sequences and Lower Frame Bounds
Zeitschrift für Aalysis ud ihre Aweduge Joural for Aalysis ad its Applicatios Volume 1 (00), No., 305 314 Riesz-Fischer Sequeces ad Lower Frame Bouds P. Casazza, O. Christese, S. Li ad A. Lider Abstract.
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More information- E < p. ˆ p q ˆ E = q ˆ = 1 - p ˆ = sample proportion of x failures in a sample size of n. where. x n sample proportion. population proportion
1 Chapter 7 ad 8 Review for Exam Chapter 7 Estimates ad Sample Sizes 2 Defiitio Cofidece Iterval (or Iterval Estimate) a rage (or a iterval) of values used to estimate the true value of the populatio parameter
More informationAccuracy assessment methods and challenges
Accuracy assessmet methods ad challeges Giles M. Foody School of Geography Uiversity of Nottigham giles.foody@ottigham.ac.uk Backgroud Need for accuracy assessmet established. Cosiderable progress ow see
More informationa b c d e f g h Supplementary Information
Supplemetary Iformatio a b c d e f g h Supplemetary Figure S STM images show that Dark patters are frequetly preset ad ted to accumulate. (a) mv, pa, m ; (b) mv, pa, m ; (c) mv, pa, m ; (d) mv, pa, m ;
More informationActivity 3: Length Measurements with the Four-Sided Meter Stick
Activity 3: Legth Measuremets with the Four-Sided Meter Stick OBJECTIVE: The purpose of this experimet is to study errors ad the propagatio of errors whe experimetal data derived usig a four-sided meter
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationInvestigating the Significance of a Correlation Coefficient using Jackknife Estimates
Iteratioal Joural of Scieces: Basic ad Applied Research (IJSBAR) ISSN 2307-4531 (Prit & Olie) http://gssrr.org/idex.php?joural=jouralofbasicadapplied ---------------------------------------------------------------------------------------------------------------------------
More informationTHE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS
R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated
More information