Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis
|
|
- Ella Flynn
- 5 years ago
- Views:
Transcription
1 Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis
2 Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions (MLST) Experimenal resuls of MLST Basis Transformaions Experimenal resuls of Basis Transformaions
3 Wha is Speaker Adapaion? Curren speech recognizers are rained on a high number of speakers. Performance is no always opimal for each speaker. Speaker adapaion echniques aemp o adap an iniial sysem o a sysem ha beer maches a specific speaker.
4 The Benefis of Speaker Adapaion By using 40 senences from each speaker a 20% drop in WER is achieved (naive English speakers). A 50% drop in WER is observed for non-naive English speakers. Recognizers become 15%-20% faser due o beer mach beween he models and he speech inpu.
5 Speaker Adapaion Mehods Maximum Likelihood $ = arg max{ P( x θ) } θ θ Maximum a Poseriori $ = arg max { P( x) } = arg max{ P( x ) P( ) } θ θ θ θ θ θ
6 Maximum Likelihood esimae of he mean is given by: Maximum a Poseriori esimae of he mean wih a known sandard deviaion σ and normal prior disribuion for he mean wih mean µ and sandard deviaion κ: Esimaion of he Mean of a Normal Densiy = = T ML x T m 1 1 ˆ µ κ σ σ κ σ κ ˆ ˆ T m T T m ML MAP =
7 Speaker Adapaion Mehods Transformaion-Based [ P( θ+ )] Ab $, $ : max x A b Ab, The same linear ransform is ied over many HMM saes. Any unseen HMM saes during he adapaion daa will be ransformed in conras wih MAP.
8 Comparison of Speaker Adapaion Mehods Maximum Likelihood, requires housands of senences o robusly rain a large vocabulary sysem. Maximum a Poseriori, achieves improved performance bu inadequae for fewer han 40 senences. Transformaion-based, achieves he bes resuls for small daa ses bu performance does no scale well as he number of adapaion senences increases.
9 Maximum Likelihood Linear Regression Only he observaion probabiliies of he HMM saes are alered. Maximum Likelihood Linear Regression (MLLR) P SA Nω ( y s ) p( ω s ) N( y ; A m + b, S ) j= 1 Sae is mapped o class c wih ransform s = j c s j c c s j [ A b ] W = c c
10 Limiaions of MLLR All he Gaussians of a class are ransformed idenically. The ransforms for differen classes are esimaed independenly.
11 Maximum Likelihood Sochasic Transformaions Maximum Likelihood Sochasic Transformaions (MLST) esimaes muliple ransformaions per class and ransform weigh vecors: P SA Nω Nλ ( y s ) p( λ c ) p( ω s ) N( y ; A m + b, S ) = j= 1k= 1 k The key poin of MLST is he differen ying beween ransformaions and ransform weighs. j ck s j ck s j
12 Maximum Likelihood Sochasic Transformaions Robus esimaes of ransform weighs are obained using far fewer samples han ransformaions. Each HMM sae may now esimae is own ransform weigh vecor and use ransformaions shared by many saes. MLST achieves increased adapaion resoluion wihou sacrificing robusness.
13 Example Suppose here are enough daa for only wo ransforms W 1,W 2 λ + λ 11W 1 12W2 λ + λ n1w 1 n2w2 In effec we have n ransforms while MLLR could esimae wo.
14 Esimaing Transform Weighs Transform weighs are esimaed using: p ( λ c ) k = s c j s c j k γ sjk γ () sjk () where γ p () = p( s = s, ω = j, λ = k o ) = ( s = s, ω = j o, λ = k) p( λ = k o ) sjk Noice ha anoher hidden variable is added.
15 Esimaing Transformaions The ransformaions are esimaed using: s c j ) 1 ) ) γ sjk 1 () Ssj x µ sj = γ sjk() Ssj xwckµ sj µ sj ck s c j [ A b ] W = ck ck If each speech frame is of dimension d hen we need o solve d+1 linear sysems of d+1 equaions each (full roaion marix).
16 Grouping he Transformed Gaussians MLST increases he number of Gaussians by a facor of we need a way o reurn o he original number of Gaussians. Three grouping mehods are inroduced : highes ransform weigh (HTW), linear combinaion of ransforms (LCT) and merging ransformed gaussians (MTG). In HTW we use : P SA N ( y s ) = ω p( ω s ) N( y ; A m + b, S ) j= 1 j ck { p( λ c )} k = arg max k k s j ck s j N λ
17 In LCT we use: Advanage: The smoohing across all ransformed Gaussians reduces esimaion errors. Grouping he Transformed Gaussians ( ) ( ) ( ) j s ck j s ck N j j SA S b m A y N s s y P, ; p 1 = + = ω ω ( ) ( ) = = = = λ λ λ λ N k ck k ck ck N k k k c b c p b A c p A 1 1
18 In MTG we use: where: Disadvanage: Covariances are always broader now. Grouping he Transformed Gaussians ( ) = = λ µ λ N k i jk s k i j s c p m 1 ) ( ) ( ( ) ( ) ( )( ) ( ) 2 ) ( 1 2 ) ( 2 ) ( 2 ) ( i j s N k i jk s k i j s i j s m c p + = = λ µ λ σ σ ( ) ) ( ) ( i ck j s ck i jk s b m A + = µ
19 Memory and Time Requiremens ( ) MLST needs o sore Nω Nλ 2 d +1 real numbers in excess hose used from MLLR. Also he forward-backward algorihm, which is run during adapaion, is slower. In pracice he added memory requiremens are no more han 60MB. Caching mehods can be used o reduce his number. During adapaion, MLST is abou 15% slower han MLLR.
20 Experimenal Resuls Experimens were carried ou on he Wall Sree Journal daabase. Gender dependen sysems wih 15,000 Gaussians each, 12,000 conex-dependen phoneic models. When evaluaed on naive English speakers performance was benchmarked a 12.0% using bigram language models. For non-naive speakers performance was 27.4%.
21 Effec of Transform Weigh Tying 40 adapaion senences, 10 regression classes for ransformaions and 10 ransformaions per class. Transform weigh hreshold Inroducing ying on ransform weighs clearly helps.
22 Linear Combinaion of Transformed Gaussians 40 adapaion senences # Transforms per class # Acousic classes
23 Highes Transformed Gaussian 40 adapaion senences # Transforms per class # Acousic classes
24 Merging Transformed Gaussians 40 adapaion senences # Transforms per class # Acousic classes
25 Comparaive Resuls MLLR and MLST performance for various number of senences. # sens MLLR MLST Significan, consisen gains over MLLR for any number of senences.
26 Basis Transformaions Moivaion: Exploi similariies beween speakers. Use MLST wih ransformaions generaed from oher speakers and adap only he ransform weighs. Now here are very few adapaion parameers, so we can use i for very few adapaion senences.
27 Mehodology for Swedish ATIS Speaker independen sysem rained on non-dialec speakers, wih 5,700 Gaussians, 3600 conex-dependen phoneic models. Achieved a 8.9% WER for non-dialec speakers bu a 25.8% for dialec speakers (Scania region). We had available 39 Scania speakers, used 31 of hem o generae he basis ransforms and he res for evaluaion.
28 Mehodology for Swedish ATIS For various number of regression classes we generaed MLLR ransforms for each dialec speaker. The ransform weighs were esimaed on he same ying wih ransforms. Backoff ransform weighs are used when here are no enough daa.
29 Smoohing he Transform Weighs Under very small amouns of adapaion daa smoohing echniques for he ransform weighs are expeced o help. Esimae smoohed ransform weighs using : where: p ( λ c) k h = () s s j s j k 1 = 0.1 h () s γ () h if s c if s c sjk () s γ () sjk
30 Experimens on he ATIS MLLR performance: Number of classes Number of senences
31 Experimens on he ATIS Resuls of MLST wih basis ransforms using MTG Number of classes Number of senences
32 Experimens on he ATIS How imporan are ransform weighs? Perhaps he ransforms hemselves are capuring an imporan par of mismach. Number of classes Adaped weighs Equal weighs Random ransform
33 Mehodology for he WSJ Evaluaed basis ransformaions mehod for naive speakers on he WSJ ask. The very high number of raining speakers (245) necessiaed a differen mehodology han ATIS. Gender dependen sysems using 15,000 Gaussians wih 12,000 conex-dependen phoneic models.
34 Mehodology for he WSJ Cluser he speakers in ses. Esimae cluser-specific ransformaions or Deermine he cenroid speaker of each cluser, re-rain a sysem wihou he cenroid speakers and esimae speakerspecific ransformaions.
35 Clusering he Training Speakers Used MLLR o generae speaker-adaped models for each speaker. Disance beween speakers m and n is given by: D 1 2 ( m, n) = [ log p( x λ ) + log p( x λ ) log p( x λ ) log p( x λ )] m m Use he forward-backward algorihm o calculae he probabiliies. n n m n n m
36 Clusering he Training Speakers Hierarchical clusering echniques are used. Disance beween clusers c and k iniially defined as: D ( c, k) = avgd( m, n) m c, n k m, n To creae balanced clusers he crierion was modified o: D ( c, k) = avgd( m, n) + alog( l + l ) m c, n k m, n c k
37 Experimenal Resuls Baseline performance 11.9% MLLR performance for various number of senences Number of senences For 2 adapaion senences he 70% of he oal gain is obained.
38 Experimenal Resuls Cluser-specific ransformaions for 9 clusers, 2 ransformaion classes, 1 ransformaion per class # weigh classes Number of senences Speaker-specific ransformaions (re-rained sysem 12.0%) # weigh classes Number of senences
39 Experimenal Resuls Speaker-specific ransformaions for 9 clusers, 2 ransformaions classes, 7 ransformaions per class # weigh classes Number of senences Speaker-specific ransformaions for 23 clusers, 2 ransformaion classes, 3 ransformaions per class # weigh classes Number of senences
40 Experimenal Resuls Speaker-specific ransformaions for 23 clusers, 2 ransformaion classes, 3 full ransformaions per class # weigh classes Number of senences Speaker-specific ransformaions for 23 clusers, 10 ransformaion classes, 3 ransformaions per class # weigh classes Number of senences
41 Experimenal Resuls The only facor which seems o influence he resuls is he oal number of ransformaions per class. Insensiive o he number of ransformaion classes, he mehodology used, he ransform ype, he ransform weigh classes and he number of clusers used. Diagnosic experimens performed as expeced.
42 Comparing MLLR and BT Bes resuls for he wo mehods # senences MLLR BT Equal performance for few daa, MLLR makes beer use of increased amouns of daa.
43 Combining MLLR and BT We can cascade BT and MLLR (opposie is expensive) # senences MLLR BT+MLLR Marginal gains for any amoun of adapaion daa.
44 Conclusions Two speaker adapaion algorihms were presened. MLST is a more general mehod han MLLR and i was shown ha i ouperforms i by 13.5% for 40 senences. Basis Transformaions is a varian of MLST designed o work under very few daa. When cascaded wih MLLR here are marginal gains han MLLR alone.
Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract
Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical
More informationSequential Importance Resampling (SIR) Particle Filter
Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle
More informationRobust estimation based on the first- and third-moment restrictions of the power transformation model
h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,
More informationDoctoral Course in Speech Recognition
Docoral Course in Speech Recogniion Friday March 30 Mas Blomberg March-June 2007 March 29-30, 2007 Speech recogniion course 2007 Mas Blomberg General course info Home page hp://www.speech.h.se/~masb/speech_speaer_rec_course_2007/cours
More informationLecture 3: Exponential Smoothing
NATCOR: Forecasing & Predicive Analyics Lecure 3: Exponenial Smoohing John Boylan Lancaser Cenre for Forecasing Deparmen of Managemen Science Mehods and Models Forecasing Mehod A (numerical) procedure
More informationHidden Markov Models
Hidden Markov Models Probabilisic reasoning over ime So far, we ve mosly deal wih episodic environmens Excepions: games wih muliple moves, planning In paricular, he Bayesian neworks we ve seen so far describe
More informationDimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2
Daa-driven modelling. Par. Daa-driven Arificial di Neural modelling. Newors Par Dimiri Solomaine Arificial neural newors D.P. Solomaine. Daa-driven modelling par. 1 Arificial neural newors ANN: main pes
More informationVehicle Arrival Models : Headway
Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where
More information0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED
0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable
More informationPresentation Overview
Acion Refinemen in Reinforcemen Learning by Probabiliy Smoohing By Thomas G. Dieerich & Didac Busques Speaer: Kai Xu Presenaion Overview Bacground The Probabiliy Smoohing Mehod Experimenal Sudy of Acion
More informationDiebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles
Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance
More informationACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.
ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple
More informationContent-Based Shape Retrieval Using Different Shape Descriptors: A Comparative Study Dengsheng Zhang and Guojun Lu
Conen-Based Shape Rerieval Using Differen Shape Descripors: A Comparaive Sudy Dengsheng Zhang and Guojun Lu Gippsland School of Compuing and Informaion Technology Monash Universiy Churchill, Vicoria 3842
More informationA Bayesian Approach to Spectral Analysis
Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2
More informationEnsamble methods: Boosting
Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room
More informationEnsamble methods: Bagging and Boosting
Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par
More informationReferences are appeared in the last slide. Last update: (1393/08/19)
SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be
More informationDevelopment of a new metrological model for measuring of the water surface evaporation Tovmach L. Tovmach Yr. Abstract Introduction
Developmen of a new merological model for measuring of he waer surface evaporaion Tovmach L. Tovmach Yr. Sae Hydrological Insiue 23 Second Line, 199053 S. Peersburg, Russian Federaion Telephone (812) 323
More informationT Automatic Speech Recognition: From Theory to Practice
Auomaic Speech Recogniion: From Theory o Pracice hp://www.cis.hu.fi/opinno// November 15, 2004 Prof. Bryan Pellom Deparmen of Compuer Science Cener for Spoken Language Research Universiy of Colorado pellom@cslr.colorado.edu
More information20. Applications of the Genetic-Drift Model
0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0
More informationAugmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004
Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure
More informationState-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter
Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when
More informationIsolated-word speech recognition using hidden Markov models
Isolaed-word speech recogniion using hidden Markov models Håkon Sandsmark December 18, 21 1 Inroducion Speech recogniion is a challenging problem on which much work has been done he las decades. Some of
More information10. State Space Methods
. Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he
More informationRL Lecture 7: Eligibility Traces. R. S. Sutton and A. G. Barto: Reinforcement Learning: An Introduction 1
RL Lecure 7: Eligibiliy Traces R. S. Suon and A. G. Baro: Reinforcemen Learning: An Inroducion 1 N-sep TD Predicion Idea: Look farher ino he fuure when you do TD backup (1, 2, 3,, n seps) R. S. Suon and
More informationLinear Gaussian State Space Models
Linear Gaussian Sae Space Models Srucural Time Series Models Level and Trend Models Basic Srucural Model (BSM Dynamic Linear Models Sae Space Model Represenaion Level, Trend, and Seasonal Models Time Varying
More information5 The fitting methods used in the normalization of DSD
The fiing mehods used in he normalizaion of DSD.1 Inroducion Sempere-Torres e al. 1994 presened a general formulaion for he DSD ha was able o reproduce and inerpre all previous sudies of DSD. The mehodology
More informationAnnouncements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering
Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing
More informationTwo Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017
Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =
More informationAdaptive Noise Estimation Based on Non-negative Matrix Factorization
dvanced cience and Technology Leers Vol.3 (ICC 213), pp.159-163 hp://dx.doi.org/1.14257/asl.213 dapive Noise Esimaion ased on Non-negaive Marix Facorizaion Kwang Myung Jeon and Hong Kook Kim chool of Informaion
More informationTime series Decomposition method
Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,
More informationExcel-Based Solution Method For The Optimal Policy Of The Hadley And Whittin s Exact Model With Arma Demand
Excel-Based Soluion Mehod For The Opimal Policy Of The Hadley And Whiin s Exac Model Wih Arma Demand Kal Nami School of Business and Economics Winson Salem Sae Universiy Winson Salem, NC 27110 Phone: (336)750-2338
More informationINTRODUCTION TO MACHINE LEARNING 3RD EDITION
ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class
More informationChapter 5. Heterocedastic Models. Introduction to time series (2008) 1
Chaper 5 Heerocedasic Models Inroducion o ime series (2008) 1 Chaper 5. Conens. 5.1. The ARCH model. 5.2. The GARCH model. 5.3. The exponenial GARCH model. 5.4. The CHARMA model. 5.5. Random coefficien
More informationNon-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important
on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LTU, decision
More informationNature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.
Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike
More informationTypes of Exponential Smoothing Methods. Simple Exponential Smoothing. Simple Exponential Smoothing
M Business Forecasing Mehods Exponenial moohing Mehods ecurer : Dr Iris Yeung Room No : P79 Tel No : 788 8 Types of Exponenial moohing Mehods imple Exponenial moohing Double Exponenial moohing Brown s
More informationTemporal probability models
Temporal probabiliy models CS194-10 Fall 2011 Lecure 25 CS194-10 Fall 2011 Lecure 25 1 Ouline Hidden variables Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic
More informationProblem Set 5. Graduate Macro II, Spring 2017 The University of Notre Dame Professor Sims
Problem Se 5 Graduae Macro II, Spring 2017 The Universiy of Nore Dame Professor Sims Insrucions: You may consul wih oher members of he class, bu please make sure o urn in your own work. Where applicable,
More informationUnderstanding the asymptotic behaviour of empirical Bayes methods
Undersanding he asympoic behaviour of empirical Bayes mehods Boond Szabo, Aad van der Vaar and Harry van Zanen EURANDOM, 11.10.2011. Conens 2/20 Moivaion Nonparameric Bayesian saisics Signal in Whie noise
More informationHidden Markov Models. Adapted from. Dr Catherine Sweeney-Reed s slides
Hidden Markov Models Adaped from Dr Caherine Sweeney-Reed s slides Summary Inroducion Descripion Cenral in HMM modelling Exensions Demonsraion Specificaion of an HMM Descripion N - number of saes Q = {q
More information3.1 More on model selection
3. More on Model selecion 3. Comparing models AIC, BIC, Adjused R squared. 3. Over Fiing problem. 3.3 Sample spliing. 3. More on model selecion crieria Ofen afer model fiing you are lef wih a handful of
More informationUnit Root Time Series. Univariate random walk
Uni Roo ime Series Univariae random walk Consider he regression y y where ~ iid N 0, he leas squares esimae of is: ˆ yy y y yy Now wha if = If y y hen le y 0 =0 so ha y j j If ~ iid N 0, hen y ~ N 0, he
More informationPhysics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle
Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,
More informationA variational radial basis function approximation for diffusion processes.
A variaional radial basis funcion approximaion for diffusion processes. Michail D. Vreas, Dan Cornford and Yuan Shen {vreasm, d.cornford, y.shen}@ason.ac.uk Ason Universiy, Birmingham, UK hp://www.ncrg.ason.ac.uk
More informationL07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms
L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)
More informationLinear Combinations of Volatility Forecasts for the WIG20 and Polish Exchange Rates
Eliza Buszkowska Universiy of Poznań, Poland Linear Combinaions of Volailiy Forecass for he WIG0 and Polish Exchange Raes Absrak. As is known forecas combinaions may be beer forecass hen forecass obained
More informationEE3723 : Digital Communications
EE373 : Digial Communicaions Week 6-7: Deecion Error Probabiliy Signal Space Orhogonal Signal Space MAJU-Digial Comm.-Week-6-7 Deecion Mached filer reduces he received signal o a single variable zt, afer
More informationTesting for a Single Factor Model in the Multivariate State Space Framework
esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics
More informationACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin
ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model
More informationNavneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi
Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec
More informationTwo Coupled Oscillators / Normal Modes
Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own
More informationGMM - Generalized Method of Moments
GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................
More informationModal identification of structures from roving input data by means of maximum likelihood estimation of the state space model
Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix
More informationApplying Genetic Algorithms for Inventory Lot-Sizing Problem with Supplier Selection under Storage Capacity Constraints
IJCSI Inernaional Journal of Compuer Science Issues, Vol 9, Issue 1, No 1, January 2012 wwwijcsiorg 18 Applying Geneic Algorihms for Invenory Lo-Sizing Problem wih Supplier Selecion under Sorage Capaciy
More informationLinear Response Theory: The connection between QFT and experiments
Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and
More information2017 3rd International Conference on E-commerce and Contemporary Economic Development (ECED 2017) ISBN:
7 3rd Inernaional Conference on E-commerce and Conemporary Economic Developmen (ECED 7) ISBN: 978--6595-446- Fuures Arbirage of Differen Varieies and based on he Coinegraion Which is under he Framework
More informationEcon107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)
I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression
More informationSingle-Pass-Based Heuristic Algorithms for Group Flexible Flow-shop Scheduling Problems
Single-Pass-Based Heurisic Algorihms for Group Flexible Flow-shop Scheduling Problems PEI-YING HUANG, TZUNG-PEI HONG 2 and CHENG-YAN KAO, 3 Deparmen of Compuer Science and Informaion Engineering Naional
More information4.1 Other Interpretations of Ridge Regression
CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning
More informationUSP. Surplus-Production Models
USP Surplus-Producion Models 2 Overview Purpose of slides: Inroducion o he producion model Overview of differen mehods of fiing Go over some criique of he mehod Source: Haddon 2001, Chaper 10 Hilborn and
More informationArticle from. Predictive Analytics and Futurism. July 2016 Issue 13
Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning
More informationNotes on Kalman Filtering
Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren
More informationAn recursive analytical technique to estimate time dependent physical parameters in the presence of noise processes
WHAT IS A KALMAN FILTER An recursive analyical echnique o esimae ime dependen physical parameers in he presence of noise processes Example of a ime and frequency applicaion: Offse beween wo clocks PREDICTORS,
More informationDEPARTMENT OF ECONOMICS
ISSN 0819-6 ISBN 0 730 609 9 THE UNIVERSITY OF MELBOURNE DEPARTMENT OF ECONOMICS RESEARCH PAPER NUMBER 95 NOVEMBER 005 INTERACTIONS IN REGRESSIONS by Joe Hirschberg & Jenny Lye Deparmen of Economics The
More information1 Evaluating Chromatograms
3 1 Evaluaing Chromaograms Hans-Joachim Kuss and Daniel Sauffer Chromaography is, in principle, a diluion process. In HPLC analysis, on dissolving he subsances o be analyzed in an eluen and hen injecing
More informationReliability of Technical Systems
eliabiliy of Technical Sysems Main Topics Inroducion, Key erms, framing he problem eliabiliy parameers: Failure ae, Failure Probabiliy, Availabiliy, ec. Some imporan reliabiliy disribuions Componen reliabiliy
More informationNon-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important
on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LDA, logisic
More informationMechanical Fatigue and Load-Induced Aging of Loudspeaker Suspension. Wolfgang Klippel,
Mechanical Faigue and Load-Induced Aging of Loudspeaker Suspension Wolfgang Klippel, Insiue of Acousics and Speech Communicaion Dresden Universiy of Technology presened a he ALMA Symposium 2012, Las Vegas
More informationDEPARTMENT OF STATISTICS
A Tes for Mulivariae ARCH Effecs R. Sco Hacker and Abdulnasser Haemi-J 004: DEPARTMENT OF STATISTICS S-0 07 LUND SWEDEN A Tes for Mulivariae ARCH Effecs R. Sco Hacker Jönköping Inernaional Business School
More informationAuthors. Introduction. Introduction
Auhors Hidden Applied in Agriculural Crops Classificaion Caholic Universiy of Rio de Janeiro (PUC-Rio Paula B. C. Leie Raul Q. Feiosa Gilson A. O. P. Cosa Hidden Applied in Agriculural Crops Classificaion
More informationLinear Hidden Transformations for Adaptation of Hybrid ANN/HMM Models
Linear Hidden Transformaions for Adapaion of Hybrid ANN/HMM Models Robero Gemello, Franco Mana, Sefano Scanzio, Piero Laface, Renao De Mori To cie his version: Robero Gemello, Franco Mana, Sefano Scanzio,
More informationIntroduction to Mobile Robotics
Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel
More informationh[n] is the impulse response of the discrete-time system:
Definiion Examples Properies Memory Inveribiliy Causaliy Sabiliy Time Invariance Lineariy Sysems Fundamenals Overview Definiion of a Sysem x() h() y() x[n] h[n] Sysem: a process in which inpu signals are
More informationBiol. 356 Lab 8. Mortality, Recruitment, and Migration Rates
Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese
More informationPattern Classification (VI) 杜俊
Paern lassificaion VI 杜俊 jundu@usc.edu.cn Ouline Bayesian Decision Theory How o make he oimal decision? Maximum a oserior MAP decision rule Generaive Models Join disribuion of observaion and label sequences
More informationUsing the Kalman filter Extended Kalman filter
Using he Kalman filer Eended Kalman filer Doz. G. Bleser Prof. Sricker Compuer Vision: Objec and People Tracking SA- Ouline Recap: Kalman filer algorihm Using Kalman filers Eended Kalman filer algorihm
More informationTemporal probability models. Chapter 15, Sections 1 5 1
Temporal probabiliy models Chaper 15, Secions 1 5 Chaper 15, Secions 1 5 1 Ouline Time and uncerainy Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic Bayesian
More informationCombining Statistical and Knowledge-based Spoken Language Understanding in Conditional Models
COLING/ACL06, pp. 882 889, Associaion for Compuaional Linguisics, Sydney, Ausralia, 2006 Combining Saisical and Knowledge-based Spoken Language Undersanding in Condiional Models Ye-Yi Wang, Alex Acero,
More informationSummer Term Albert-Ludwigs-Universität Freiburg Empirische Forschung und Okonometrie. Time Series Analysis
Summer Term 2009 Alber-Ludwigs-Universiä Freiburg Empirische Forschung und Okonomerie Time Series Analysis Classical Time Series Models Time Series Analysis Dr. Sevap Kesel 2 Componens Hourly earnings:
More informationThe Simple Linear Regression Model: Reporting the Results and Choosing the Functional Form
Chaper 6 The Simple Linear Regression Model: Reporing he Resuls and Choosing he Funcional Form To complee he analysis of he simple linear regression model, in his chaper we will consider how o measure
More informationTOP-QUARK MASS MEASUREMENTS AT THE LHC
TOP-QUARK MASS MEASUREMENTS AT THE LHC S. Blyweer, on behalf of he ATLAS and CMS Collaboraions Vrije Universiei Brussel - Ineruniversiy Insiue for High Energies Pleinlaan 2, 1050 Brussel, Belgium The op-quark
More informationMethodology. -ratios are biased and that the appropriate critical values have to be increased by an amount. that depends on the sample size.
Mehodology. Uni Roo Tess A ime series is inegraed when i has a mean revering propery and a finie variance. I is only emporarily ou of equilibrium and is called saionary in I(0). However a ime series ha
More informationEstimation of Poses with Particle Filters
Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU
More information2016 Possible Examination Questions. Robotics CSCE 574
206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he
More informationBias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé
Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070
More informationm = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19
Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible
More informationFinancial Econometrics Kalman Filter: some applications to Finance University of Evry - Master 2
Financial Economerics Kalman Filer: some applicaions o Finance Universiy of Evry - Maser 2 Eric Bouyé January 27, 2009 Conens 1 Sae-space models 2 2 The Scalar Kalman Filer 2 21 Presenaion 2 22 Summary
More informationExponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits
DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,
More information3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon
3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of
More informationLet us start with a two dimensional case. We consider a vector ( x,
Roaion marices We consider now roaion marices in wo and hree dimensions. We sar wih wo dimensions since wo dimensions are easier han hree o undersand, and one dimension is a lile oo simple. However, our
More informationSmoothing. Backward smoother: At any give T, replace the observation yt by a combination of observations at & before T
Smoohing Consan process Separae signal & noise Smooh he daa: Backward smooher: A an give, replace he observaion b a combinaion of observaions a & before Simple smooher : replace he curren observaion wih
More informationTracking. Many slides adapted from Kristen Grauman, Deva Ramanan
Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image
More informationMaximum Likelihood Parameter Estimation in State-Space Models
Maximum Likelihood Parameer Esimaion in Sae-Space Models Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 4 h Ocober 212 A. Douce (UCL Maserclass Oc. 212 4 h Ocober 212 1 / 32
More informationKriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number
More informationST2352. Stochastic Processes constructed via Conditional Simulation. 09/02/2014 ST2352 Week 4 1
ST35 Sochasic Processes consruced via Condiional Simulaion 09/0/014 ST35 Week 4 1 Sochasic Processes consruced via Condiional Simulaion Markov Processes Simulaing Random Tex Google Sugges n grams Random
More informationSolutions to Odd Number Exercises in Chapter 6
1 Soluions o Odd Number Exercises in 6.1 R y eˆ 1.7151 y 6.3 From eˆ ( T K) ˆ R 1 1 SST SST SST (1 R ) 55.36(1.7911) we have, ˆ 6.414 T K ( ) 6.5 y ye ye y e 1 1 Consider he erms e and xe b b x e y e b
More informationSTATE-SPACE MODELLING. A mass balance across the tank gives:
B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing
More informationInstitute for Mathematical Methods in Economics. University of Technology Vienna. Singapore, May Manfred Deistler
MULTIVARIATE TIME SERIES ANALYSIS AND FORECASTING Manfred Deisler E O S Economerics and Sysems Theory Insiue for Mahemaical Mehods in Economics Universiy of Technology Vienna Singapore, May 2004 Inroducion
More informationA Specification Test for Linear Dynamic Stochastic General Equilibrium Models
Journal of Saisical and Economeric Mehods, vol.1, no.2, 2012, 65-70 ISSN: 2241-0384 (prin), 2241-0376 (online) Scienpress Ld, 2012 A Specificaion Tes for Linear Dynamic Sochasic General Equilibrium Models
More information