SAMPLING DYNAMICAL SYSTEMS
|
|
- Leon Lawson
- 6 years ago
- Views:
Transcription
1 SAMPLING DYNAMICAL SYSTEMS Melvin J. Hinich Applied Research Labratries The University f Texas at Austin Austin, TX , USA (512) (Vice) (Fax) hinich@mail.la.utexas.edu ABSTRACT Linear dynamical systems are widely used in many different fields frm engineering t ecnmics. One simple but imprtant class f such systems is called the single input transfer functin mdel. Suppse that all the variables f the system are sampled fr a perid using a fixed sample rate. The central issue f this paper is the determinatin f the smallest sampling rate that will yield a sample that will allw the investigatr t identify the discrete-time representatin f the system. A critical sampling rate exists that will identify the mdel. This rate, called the Nyquist rate, is twice the highest frequency cmpnent f the system. Sampling at a lwer rate will result in an identificatin prblem that is serius. The standard assumptins made abut the mdel and the unbserved innvatin errrs in the mdel prtect the investigatrs frm the identificatin prblem and resulting biases f undersampling. The critical assumptin that is needed t identify an undersampled system is that at least ne f the exgenus time series is white nise. 1. INTRODUCTION Linear dynamical systems are widely used in many different fields frm engineering t ecnmics. One simple but imprtant class f such systems is
2 called the single input transfer functin mdel. Suppse that all the variables f the system are sampled fr a perid using a fixed sample rate. The central issue f this paper is the determinatin f the smallest sampling rate that will yield a sample that will allw the investigatr t identify the discrete-time representatin f the system. The determinatin f the minimal sufficient sampling rate is a mathematical prblem that was slved years ag using Furier transfrms. A critical sampling rate exists that will identify the mdel. This rate, called the Nyquist rate (p.388, Andersn, 1971) is twice the highest frequency cmpnent f the system. The imprtance f the Nyquist rate fr system identificatin is knwn in the science and engineering spectral analysis literature yet it has been largely ignred in the literature that applies the time dmain methdlgy ppularized by Bx and Jenkins (1970). The standard apprach is t start with a discrete-time linear mdel. An alternative apprach, strngly advcated by Wymer (1972,1997) and Bergstrm (1990), is t start with a linear stchastic differential equatin mdel fr the system. Telser (1967) discusses the identificatin prblem inherent in estimating the parameters f a difference equatin using a data series that is a mving sum f discrete-time bservatins. Telser als recgnized the cnnectin between the parameter identificatin prblem fr discrete-time data and the aliasing f the perid f a sinusid. Phillips (1973) addresses the identificatin f parameters f a cntinuus time differential equatin using discrete-time data. Phillips shws that it is pssible t identify a finite parameter dynamical system by assuming linear cnstraints n the structural matrix even when the stchastic disturbance is aliased. His paper shuld have led t an imprtant set f advances in time series mdel identificatin but it did nt catch n, perhaps because as with Telser s paper it was vershadwed by the ppularity f the Bx and Jenkins pint and click methdlgy. The sampling rate issue is als cnfused r ignred in the ecnmetrics literature extending the Bx and Jenkins methdlgy t ecnmics (see Granger and Newbld, 1976, and Harvey, 1981). The standard reasn usually 2
3 given by time series ecnmetricians fr ignring the sampling issue is that it is irrelevant fr the identificatin and estimatin prblem fr a discrete-time linear system mdel. The parameters f the mdel are estimated by sample autcrrelatins and the sample autcrrelatins are unbiased. A mre subtle reasn fr ignring the sampling rate is that the sampling rate used t cllect the data was fixed when the data was cllected and it thus can nt be changed. This pint is well made by Telser in the paper previusly cited. These arguments are true but they deflect attentin away frm the fact that the mdels used and the assumptins made abut the unbserved innvatin errrs in the mdel prtect the investigatrs frm the identificatin prblem and resulting biases f undersampling. The critical assumptin needed t identify an undersampled system is that at least ne f the exgenus time series is white nise. The standard frm fr a causal linear transfer functin mdel in cntinuus time is as fllws where x (t) dentes the input time series and y (t) dentes the utput: (1.1) y ( t) = h( s) x( t s) ds 0 The functin h (t) is the impulse respnse f the mdel. In engineering and science applicatins, the time series are called signals and (1.1) is called a filtering peratin where the input signal x (t) is filtering by the impulse respnse t yield the utput signal y (t). Assume that h ( t) = 0 fr t > T. The impulse respnse has finite supprt. The input and utput signals are sampled t prduce a set f data. Since the prblem is mathematical and nt statistical there is n reasn t add a nise signal in (1.1) and the signals are functins f time and nt cntinuus time stchastic prcesses. The sampling issues discussed in this paper apply t any statistical time series mdel. 3
4 2. BANDLIMITED SAMPLING If x (t) and h (t) are abslutely integrable, the Furier transfrms (2.1) X ( f ) = x( t)exp( i2π t) dt and H ( f ) = h( t)exp( i2π t) dt exist and Y ( f ) = H ( f ) X ( f ). Since x (t) is real X ( f ) = X ( f ), the cmplex cnjugate f X ( f ) and similarly fr the cmplex transfer functin H ( f ). Assume that the set f psitive supprt fr X ( f ) is ( f, f ) fr sme frequency f. This frequency is the bandlimit f x (t). The transfer functin H ( f ) has infinite supprt since h (t) is finite. Suppse that the signal is sampled at the Nyquist rate 2 f, r equivalently at a fixed sampling interval τ = /(2 f ). Then the discrete time versin f the mdel (1.1) is 1 N sin(2π f ( t s)) (2.1) y( tk ) = h ( tn ) x( tk n ) where h ( t) = h( s) ds, π ( t s) n= 0 t k = kτ and N = T / τ (Chapter 10, Bracewell, 1986). If τ is much smaller than T then the impulse respnse parameters h ) h( kτ ) with an errr f rder 1 O ( τ ). The discrete-time cnvlutin f the finite h ) sequence with the x ) sequence t yield the y ) sequence is a set f linear equatins which can be slved t btain the impulse respnse parameters h ) fr k=1,, N. Suppse that the sampling rate used is f rather than the Nyquist rate 2 f. Then every ther h0 (( k n) τ ) and x ) are missing in the system f equatins (2.1). It thus is impssible t slve fr the N values f h ). Fr example, suppse that y ) = x( kτ ) + a x(( k 1) τ ). Then the tw equatins fr k=1 and 2 fr times t 1 = τ and t = 3 2 τ are (2.3) y ( τ ) = x( τ ) + a x(0) and y ( 3τ ) = x(3τ ) + a x(2τ ). 4
5 These equatins can nt be slved t find a since x (0) and x ( 2τ ) are nt bserved. Using mre equatins is fruitless since the x ) fr even values f k are nt bserved. The parameter a is nt estimable since the system is nt identified. The investigatr must interplate the missing values in rder t estimate a. Interplatin requires sme prir knwledge abut the functinal frm f the input. S far the sampling issue has been separated frm the stchastic linear mdel prblem which is the mtivatin fr this expsitin. Let us turn t the stchastic mdel. 3. STOCHASTIC TRANSFER FUNCTION MODEL Suppse that the { x )} in expressin (2.1) is a sequence f bservatins f a zer mean randm prcess with a given jint distributin. The cvariance functin f { x )} is c xx ) = Ex( nτ ) x(( n + k) τ ). Then the crss cvariance functin fr { x )} and { y )} is N (3.1) cxy ) = h ( nτ ) cxx (( k n) τ ). n= 0 This system f linear equatins is used t slve fr the parameters ). If the system in (2.1) were used t btain an rdinary least squares fit f the parameters, then the slutin wuld be the slutin using (3.1) with sample estimates f the cvariances c xx ) and the crss cvariances c xy ) ignring end effects. Cnsider the cvariances and crss cvariances t be knwn values t simplify expsitin. Once again if the prcesses are sampled at a slwer rate than 2 f then the slutin f the linear system (3.1) will prduce a distrted estimate f the filter parameters unless the investigatr can prduce a valid interplatin fr the missing cvariances. The impulse respnse is nt identified. h An example is helpful here. Suppse that the impulse respnse is ( nτ ) = 10 cs(2πnτ / N) and the input is a first rder autregressive prcess h 5
6 AR(ρ) whse innvatins variance is ne. Thus the cvariance f the input is kτ 2 1 c xx ) = ρ (1 ρ ). Assume that the prcesses are sampled at the rate f / 2 and thus every furth value f the prcesses is bserved. Figure 1 cmpares the impulse respnse recvered frm a least squares slutin f the under identified system fr ρ =0.9 with the skip sampled true impulse respnse. Figure 2 displays the results fr a sampling rate f f / 6. The undersampling prduces a distrted picture f the respnse f the system. 4. IDENTIFICATION BY WHITE NOISE There is a special case fr which a subset f the impulse respnse parameters will be identified. Suppse that { x )} is white nise, that is c xx ) = 0 fr all k 0 Then c 2 xy ( k ) h ) σ x τ = frm (3.1). In this case, if the prcesses are sampled at a slwer rate than Nyquist, the estimated impulse respnse parameters will be an under-sampled versin f the filter parameters. Fr example if h ) = exp( ckτ ) and the prcess is sampled at a rate f f / 10 the recvered filter parameters will be exp( ck10τ ) fr k N / 10. The recverd impulse respnse will prvide gd shrt-term predictin fr the y ( k10τ ). If ne culd cntrl the input then it is bvius that ne wuld use white nise input. It is the time series equivalent f an rthgnal design in the statistical design f experiments literature. In the mre general dynamical systems the state space representatin is f the frm (4.1) y ) = Ay(( k 1) τ ) + e( kτ ) where y ) is an n dimensinal vectr f bserved exgenus and endgenus time series, A is a nnsingular system matrix and e ) is an n dimensinal vectr f unbserved exgenus randm inputs which are called innvatins in ecnmics. The innvatins sequence mdels the real input t the linear system and are nt a mathematical representatin. If n the ther hand expressin (4.1) is seen as a statistical mdel t represent the crrelatins in the data, then 6
7 ne shuld questin the validity f using this statistical mdel t make statements abut causal relatinships in the true system. The system matrix is identified if the innvatins are jintly white. This is the generalizatin f the white input in expressin (3.1). If the system is undersampled then the eigenfunctins f the system are similarly under-sampled but their pattern is nt distrted. The identificatin assumptin n the unbserved innvatins time series is the mathematically equivalent t the identificatin f the impulse respnse f a linear transfer functin with an imprtant distinctin. The innvatins are nt bserved while the input f the transfer functin is. If nature is bliging and makes the innvatins white t help the investigatr, then all is well. If nt then the cvariance structure f the input must be mdeled. Anther apprach is t reject the Markv mdel (4.1) and use a prperly sampled multivariate transfer functin mdel fr frecasting. A multivariate transfer functin is an intellectually and technically valid apprach t mdeling and frecasting a linear system where the input can be measured. Transfer functins are widely applied in engineering and science. But it is nt in favr amng mst time series ecnmetricians. 5 CONCLUSIONS The results presented in this paper pse a real prblem fr macrecnmists wh use time series mdels t mdel ecnmics systems. It is impssible t btain high frequency data fr standard macrecnmic series such as interest rates, utput, and prices. The highest frequency macrecnmic data available is mnthly. Thus the analyst must use the dynamical mdel (4.1) and hpe that the innvatins are white. If the mdel is a gd apprximatin t reality then the analyst can get sme sense f the dynamical respnse f the system. Otherwise nly the trends can be analyzed. 7
8 Acknwledgments I wish t thank Chris Brks, Bart Brnnenberg, Hustn Stkes and Phil Wild fr reading the manuscript and giving me cnstructive criticism REFERENCES Andersn, T.W. (1971), The Statistical Analysis f Time Series. New Yrk: Jhn Wiley & Sns. Bergstrm, A.R. (1990), Cntinuus Time Ecnmetric Mdeling. Oxfrd: Oxfrd University Press. Bx, G.E.P. and G.M. Jenkins (1970), Time Series Analysis: Frecasting and Cntrl, San Francisc: Hlden-Day. Bracewell, R.N. (1986), The Furier Transfrm and Its Applicatins, Secnd Editin, Revised. New Yrk: McGraw-Hill. Granger, C.W.J. and P. Newbld (1976), Frecasting Ecnmic Time Series. New Yrk: Academic Press. Harvey, A.C (1981), Time Series Mdels. Oxfrd: Philip Allan. Phillips, P.C.B (1973), The prblem f identificatin in finite parameter cntinuus time mdels, Jurnal f Ecnmetrics 1, Telser, L.G. (1967), Discrete samples and mving sums in statinary stchastic prcesses, Jurnal f the American Statistical Assciatin 62, Wymer, C.R. (1972), Ecnmetric estimatin f stchastic differential equatin systems, Ecnmetrica 40, Wymer, C.R. (1997), Structural nnlinear cntinuus-time mdels in ecnmetrics, Macrecnmic Dynamics 1 (2),
9 Aliased & True Impulse Respnses fr a Sampling Interval f 4τ Aliased Respnse True Respnse 60 Amplitud Time Figure 1 9
10 120 Aliased & True Impulse Respnses fr a Sampling Interval f 12τ Aliased Respnse True Respnse Amplitud Time Figure 2 10
Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.
Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.
More information4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression
4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationA Matrix Representation of Panel Data
web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins
More informationIN a recent article, Geary [1972] discussed the merit of taking first differences
The Efficiency f Taking First Differences in Regressin Analysis: A Nte J. A. TILLMAN IN a recent article, Geary [1972] discussed the merit f taking first differences t deal with the prblems that trends
More informationLeast Squares Optimal Filtering with Multirate Observations
Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical
More information3.4 Shrinkage Methods Prostate Cancer Data Example (Continued) Ridge Regression
3.3.4 Prstate Cancer Data Example (Cntinued) 3.4 Shrinkage Methds 61 Table 3.3 shws the cefficients frm a number f different selectin and shrinkage methds. They are best-subset selectin using an all-subsets
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationDetermining the Accuracy of Modal Parameter Estimation Methods
Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system
More information2.161 Signal Processing: Continuous and Discrete Fall 2008
MIT OpenCurseWare http://cw.mit.edu 2.161 Signal Prcessing: Cntinuus and Discrete Fall 2008 Fr infrmatin abut citing these materials r ur Terms f Use, visit: http://cw.mit.edu/terms. Massachusetts Institute
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationReview Problems 3. Four FIR Filter Types
Review Prblems 3 Fur FIR Filter Types Fur types f FIR linear phase digital filters have cefficients h(n fr 0 n M. They are defined as fllws: Type I: h(n = h(m-n and M even. Type II: h(n = h(m-n and M dd.
More informationBuilding to Transformations on Coordinate Axis Grade 5: Geometry Graph points on the coordinate plane to solve real-world and mathematical problems.
Building t Transfrmatins n Crdinate Axis Grade 5: Gemetry Graph pints n the crdinate plane t slve real-wrld and mathematical prblems. 5.G.1. Use a pair f perpendicular number lines, called axes, t define
More informationHow do we solve it and what does the solution look like?
Hw d we slve it and what des the slutin l lie? KF/PFs ffer slutins t dynamical systems, nnlinear in general, using predictin and update as data becmes available. Tracing in time r space ffers an ideal
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationSimple Linear Regression (single variable)
Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationCAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank
CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal
More informationFebruary 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA
February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA Mental Experiment regarding 1D randm walk Cnsider a cntainer f gas in thermal
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More informationDifferentiation Applications 1: Related Rates
Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm
More informationCS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007
CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is
More informationDead-beat controller design
J. Hetthéssy, A. Barta, R. Bars: Dead beat cntrller design Nvember, 4 Dead-beat cntrller design In sampled data cntrl systems the cntrller is realised by an intelligent device, typically by a PLC (Prgrammable
More informationINSTRUMENTAL VARIABLES
INSTRUMENTAL VARIABLES Technical Track Sessin IV Sergi Urzua University f Maryland Instrumental Variables and IE Tw main uses f IV in impact evaluatin: 1. Crrect fr difference between assignment f treatment
More informationPSU GISPOPSCI June 2011 Ordinary Least Squares & Spatial Linear Regression in GeoDa
There are tw parts t this lab. The first is intended t demnstrate hw t request and interpret the spatial diagnstics f a standard OLS regressin mdel using GeDa. The diagnstics prvide infrmatin abut the
More informationStatistics, Numerical Models and Ensembles
Statistics, Numerical Mdels and Ensembles Duglas Nychka, Reinhard Furrer,, Dan Cley Claudia Tebaldi, Linda Mearns, Jerry Meehl and Richard Smith (UNC). Spatial predictin and data assimilatin Precipitatin
More informationLecture 10, Principal Component Analysis
Principal Cmpnent Analysis Lecture 10, Principal Cmpnent Analysis Ha Helen Zhang Fall 2017 Ha Helen Zhang Lecture 10, Principal Cmpnent Analysis 1 / 16 Principal Cmpnent Analysis Lecture 10, Principal
More informationPerformance Bounds for Detect and Avoid Signal Sensing
Perfrmance unds fr Detect and Avid Signal Sensing Sam Reisenfeld Real-ime Infrmatin etwrks, University f echnlgy, Sydney, radway, SW 007, Australia samr@uts.edu.au Abstract Detect and Avid (DAA) is a Cgnitive
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 11: Mdeling with systems f ODEs In Petre Department f IT, Ab Akademi http://www.users.ab.fi/ipetre/cmpmd/ Mdeling with differential equatins Mdeling strategy Fcus
More informationSmoothing, penalized least squares and splines
Smthing, penalized least squares and splines Duglas Nychka, www.image.ucar.edu/~nychka Lcally weighted averages Penalized least squares smthers Prperties f smthers Splines and Reprducing Kernels The interplatin
More informationModelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA
Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview
More informationPhysics 212. Lecture 12. Today's Concept: Magnetic Force on moving charges. Physics 212 Lecture 12, Slide 1
Physics 1 Lecture 1 Tday's Cncept: Magnetic Frce n mving charges F qv Physics 1 Lecture 1, Slide 1 Music Wh is the Artist? A) The Meters ) The Neville rthers C) Trmbne Shrty D) Michael Franti E) Radiatrs
More informationSlide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons
Slide04 supplemental) Haykin Chapter 4 bth 2nd and 3rd ed): Multi-Layer Perceptrns CPSC 636-600 Instructr: Ynsuck Che Heuristic fr Making Backprp Perfrm Better 1. Sequential vs. batch update: fr large
More informationSource Coding and Compression
Surce Cding and Cmpressin Heik Schwarz Cntact: Dr.-Ing. Heik Schwarz heik.schwarz@hhi.fraunhfer.de Heik Schwarz Surce Cding and Cmpressin September 22, 2013 1 / 60 PartI: Surce Cding Fundamentals Heik
More informationMATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use
More informationMODULE FOUR. This module addresses functions. SC Academic Elementary Algebra Standards:
MODULE FOUR This mdule addresses functins SC Academic Standards: EA-3.1 Classify a relatinship as being either a functin r nt a functin when given data as a table, set f rdered pairs, r graph. EA-3.2 Use
More informationNOTE ON A CASE-STUDY IN BOX-JENKINS SEASONAL FORECASTING OF TIME SERIES BY STEFFEN L. LAURITZEN TECHNICAL REPORT NO. 16 APRIL 1974
NTE N A CASE-STUDY IN B-JENKINS SEASNAL FRECASTING F TIME SERIES BY STEFFEN L. LAURITZEN TECHNICAL REPRT N. 16 APRIL 1974 PREPARED UNDER CNTRACT N00014-67-A-0112-0030 (NR-042-034) FR THE FFICE F NAVAL
More informationPerfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Key Wrds: Autregressive, Mving Average, Runs Tests, Shewhart Cntrl Chart
Perfrmance f Sensitizing Rules n Shewhart Cntrl Charts with Autcrrelated Data Sandy D. Balkin Dennis K. J. Lin y Pennsylvania State University, University Park, PA 16802 Sandy Balkin is a graduate student
More informationAP Statistics Practice Test Unit Three Exploring Relationships Between Variables. Name Period Date
AP Statistics Practice Test Unit Three Explring Relatinships Between Variables Name Perid Date True r False: 1. Crrelatin and regressin require explanatry and respnse variables. 1. 2. Every least squares
More informationECE 2100 Circuit Analysis
ECE 2100 Circuit Analysis Lessn 25 Chapter 9 & App B: Passive circuit elements in the phasr representatin Daniel M. Litynski, Ph.D. http://hmepages.wmich.edu/~dlitynsk/ ECE 2100 Circuit Analysis Lessn
More informationEric Klein and Ning Sa
Week 12. Statistical Appraches t Netwrks: p1 and p* Wasserman and Faust Chapter 15: Statistical Analysis f Single Relatinal Netwrks There are fur tasks in psitinal analysis: 1) Define Equivalence 2) Measure
More informationCHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS
CHAPTER 4 DIAGNOSTICS FOR INFLUENTIAL OBSERVATIONS 1 Influential bservatins are bservatins whse presence in the data can have a distrting effect n the parameter estimates and pssibly the entire analysis,
More informationCOMP 551 Applied Machine Learning Lecture 4: Linear classification
COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationElements of Machine Intelligence - I
ECE-175A Elements f Machine Intelligence - I Ken Kreutz-Delgad Nun Vascncels ECE Department, UCSD Winter 2011 The curse The curse will cver basic, but imprtant, aspects f machine learning and pattern recgnitin
More informationComparing Several Means: ANOVA. Group Means and Grand Mean
STAT 511 ANOVA and Regressin 1 Cmparing Several Means: ANOVA Slide 1 Blue Lake snap beans were grwn in 12 pen-tp chambers which are subject t 4 treatments 3 each with O 3 and SO 2 present/absent. The ttal
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins
More informationWe say that y is a linear function of x if. Chapter 13: The Correlation Coefficient and the Regression Line
Chapter 13: The Crrelatin Cefficient and the Regressin Line We begin with a sme useful facts abut straight lines. Recall the x, y crdinate system, as pictured belw. 3 2 1 y = 2.5 y = 0.5x 3 2 1 1 2 3 1
More informationBASD HIGH SCHOOL FORMAL LAB REPORT
BASD HIGH SCHOOL FORMAL LAB REPORT *WARNING: After an explanatin f what t include in each sectin, there is an example f hw the sectin might lk using a sample experiment Keep in mind, the sample lab used
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More informationSection 11 Simultaneous Equations
Sectin 11 Simultaneus Equatins The mst crucial f ur OLS assumptins (which carry er t mst f the ther estimatrs that we hae studied) is that the regressrs be exgenus uncrrelated with the errr term This assumptin
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationA Correlation of. to the. South Carolina Academic Standards for Mathematics Precalculus
A Crrelatin f Suth Carlina Academic Standards fr Mathematics Precalculus INTRODUCTION This dcument demnstrates hw Precalculus (Blitzer), 4 th Editin 010, meets the indicatrs f the. Crrelatin page references
More informationA New Evaluation Measure. J. Joiner and L. Werner. The problems of evaluation and the needed criteria of evaluation
III-l III. A New Evaluatin Measure J. Jiner and L. Werner Abstract The prblems f evaluatin and the needed criteria f evaluatin measures in the SMART system f infrmatin retrieval are reviewed and discussed.
More informationPrincipal Components
Principal Cmpnents Suppse we have N measurements n each f p variables X j, j = 1,..., p. There are several equivalent appraches t principal cmpnents: Given X = (X 1,... X p ), prduce a derived (and small)
More informationOptimization Programming Problems For Control And Management Of Bacterial Disease With Two Stage Growth/Spread Among Plants
Internatinal Jurnal f Engineering Science Inventin ISSN (Online): 9 67, ISSN (Print): 9 676 www.ijesi.rg Vlume 5 Issue 8 ugust 06 PP.0-07 Optimizatin Prgramming Prblems Fr Cntrl nd Management Of Bacterial
More informationSIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST. Mark C. Otto Statistics Research Division, Bureau of the Census Washington, D.C , U.S.A.
SIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST Mark C. Ott Statistics Research Divisin, Bureau f the Census Washingtn, D.C. 20233, U.S.A. and Kenneth H. Pllck Department f Statistics, Nrth Carlina State
More informationPhysics 2010 Motion with Constant Acceleration Experiment 1
. Physics 00 Mtin with Cnstant Acceleratin Experiment In this lab, we will study the mtin f a glider as it accelerates dwnhill n a tilted air track. The glider is supprted ver the air track by a cushin
More informationCambridge Assessment International Education Cambridge Ordinary Level. Published
Cambridge Assessment Internatinal Educatin Cambridge Ordinary Level ADDITIONAL MATHEMATICS 4037/1 Paper 1 Octber/Nvember 017 MARK SCHEME Maximum Mark: 80 Published This mark scheme is published as an aid
More informationKinematic transformation of mechanical behavior Neville Hogan
inematic transfrmatin f mechanical behavir Neville Hgan Generalized crdinates are fundamental If we assume that a linkage may accurately be described as a cllectin f linked rigid bdies, their generalized
More informationOn Out-of-Sample Statistics for Financial Time-Series
On Out-f-Sample Statistics fr Financial Time-Series Françis Gingras Yshua Bengi Claude Nadeau CRM-2585 January 1999 Département de physique, Université de Mntréal Labratire d infrmatique des systèmes adaptatifs,
More informationEmphases in Common Core Standards for Mathematical Content Kindergarten High School
Emphases in Cmmn Cre Standards fr Mathematical Cntent Kindergarten High Schl Cntent Emphases by Cluster March 12, 2012 Describes cntent emphases in the standards at the cluster level fr each grade. These
More informationModule 3: Gaussian Process Parameter Estimation, Prediction Uncertainty, and Diagnostics
Mdule 3: Gaussian Prcess Parameter Estimatin, Predictin Uncertainty, and Diagnstics Jerme Sacks and William J Welch Natinal Institute f Statistical Sciences and University f British Clumbia Adapted frm
More informationMATCHING TECHNIQUES Technical Track Session VI Céline Ferré The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Céline Ferré The Wrld Bank When can we use matching? What if the assignment t the treatment is nt dne randmly r based n an eligibility index, but n the basis
More informationMath Foundations 10 Work Plan
Math Fundatins 10 Wrk Plan Units / Tpics 10.1 Demnstrate understanding f factrs f whle numbers by: Prime factrs Greatest Cmmn Factrs (GCF) Least Cmmn Multiple (LCM) Principal square rt Cube rt Time Frame
More informationChE 471: LECTURE 4 Fall 2003
ChE 47: LECTURE 4 Fall 003 IDEL RECTORS One f the key gals f chemical reactin engineering is t quantify the relatinship between prductin rate, reactr size, reactin kinetics and selected perating cnditins.
More information1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp
THE POWER AND LIMIT OF NEURAL NETWORKS T. Y. Lin Department f Mathematics and Cmputer Science San Jse State University San Jse, Califrnia 959-003 tylin@cs.ssu.edu and Bereley Initiative in Sft Cmputing*
More informationCESAR Science Case The differential rotation of the Sun and its Chromosphere. Introduction. Material that is necessary during the laboratory
Teacher s guide CESAR Science Case The differential rtatin f the Sun and its Chrmsphere Material that is necessary during the labratry CESAR Astrnmical wrd list CESAR Bklet CESAR Frmula sheet CESAR Student
More information7 TH GRADE MATH STANDARDS
ALGEBRA STANDARDS Gal 1: Students will use the language f algebra t explre, describe, represent, and analyze number expressins and relatins 7 TH GRADE MATH STANDARDS 7.M.1.1: (Cmprehensin) Select, use,
More informationx 1 Outline IAML: Logistic Regression Decision Boundaries Example Data
Outline IAML: Lgistic Regressin Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester Lgistic functin Lgistic regressin Learning lgistic regressin Optimizatin The pwer f nn-linear basis functins Least-squares
More informationAPPLICATION OF THE BRATSETH SCHEME FOR HIGH LATITUDE INTERMITTENT DATA ASSIMILATION USING THE PSU/NCAR MM5 MESOSCALE MODEL
JP2.11 APPLICATION OF THE BRATSETH SCHEME FOR HIGH LATITUDE INTERMITTENT DATA ASSIMILATION USING THE PSU/NCAR MM5 MESOSCALE MODEL Xingang Fan * and Jeffrey S. Tilley University f Alaska Fairbanks, Fairbanks,
More informationProbability, Random Variables, and Processes. Probability
Prbability, Randm Variables, and Prcesses Prbability Prbability Prbability thery: branch f mathematics fr descriptin and mdelling f randm events Mdern prbability thery - the aximatic definitin f prbability
More informationLHS Mathematics Department Honors Pre-Calculus Final Exam 2002 Answers
LHS Mathematics Department Hnrs Pre-alculus Final Eam nswers Part Shrt Prblems The table at the right gives the ppulatin f Massachusetts ver the past several decades Using an epnential mdel, predict the
More informationSections 15.1 to 15.12, 16.1 and 16.2 of the textbook (Robbins-Miller) cover the materials required for this topic.
Tpic : AC Fundamentals, Sinusidal Wavefrm, and Phasrs Sectins 5. t 5., 6. and 6. f the textbk (Rbbins-Miller) cver the materials required fr this tpic.. Wavefrms in electrical systems are current r vltage
More informationMath Foundations 20 Work Plan
Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant
More information1 The limitations of Hartree Fock approximation
Chapter: Pst-Hartree Fck Methds - I The limitatins f Hartree Fck apprximatin The n electrn single determinant Hartree Fck wave functin is the variatinal best amng all pssible n electrn single determinants
More informationOn Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION
Malaysian Jurnal f Mathematical Sciences 4(): 7-4 () On Huntsberger Type Shrinkage Estimatr fr the Mean f Nrmal Distributin Department f Mathematical and Physical Sciences, University f Nizwa, Sultanate
More informationLearning to Control an Unstable System with Forward Modeling
324 Jrdan and Jacbs Learning t Cntrl an Unstable System with Frward Mdeling Michael I. Jrdan Brain and Cgnitive Sciences MIT Cambridge, MA 02139 Rbert A. Jacbs Cmputer and Infrmatin Sciences University
More informationSequential Allocation with Minimal Switching
In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University
More informationRevision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax
.7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical
More informationExperimental Design Initial GLM Intro. This Time
Eperimental Design Initial GLM Intr This Time GLM General Linear Mdel Single subject fmri mdeling Single Subject fmri Data Data at ne vel Rest vs. passive wrd listening Is there an effect? Linear in
More informationAdmissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs
Admissibility Cnditins and Asympttic Behavir f Strngly Regular Graphs VASCO MOÇO MANO Department f Mathematics University f Prt Oprt PORTUGAL vascmcman@gmailcm LUÍS ANTÓNIO DE ALMEIDA VIEIRA Department
More informationEnhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme
Enhancing Perfrmance f / Neural Classifiers via an Multivariate Data Distributin Scheme Halis Altun, Gökhan Gelen Nigde University, Electrical and Electrnics Engineering Department Nigde, Turkey haltun@nigde.edu.tr
More informationCOMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)
COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise
More informationOTHER USES OF THE ICRH COUPL ING CO IL. November 1975
OTHER USES OF THE ICRH COUPL ING CO IL J. C. Sprtt Nvember 1975 -I,," PLP 663 Plasma Studies University f Wiscnsin These PLP Reprts are infrmal and preliminary and as such may cntain errrs nt yet eliminated.
More informationDataflow Analysis and Abstract Interpretation
Dataflw Analysis and Abstract Interpretatin Cmputer Science and Artificial Intelligence Labratry MIT Nvember 9, 2015 Recap Last time we develped frm first principles an algrithm t derive invariants. Key
More informationBayesian nonparametric modeling approaches for quantile regression
Bayesian nnparametric mdeling appraches fr quantile regressin Athanasis Kttas Department f Applied Mathematics and Statistics University f Califrnia, Santa Cruz Department f Statistics Athens University
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical
More informationAnalysis on the Stability of Reservoir Soil Slope Based on Fuzzy Artificial Neural Network
Research Jurnal f Applied Sciences, Engineering and Technlgy 5(2): 465-469, 2013 ISSN: 2040-7459; E-ISSN: 2040-7467 Maxwell Scientific Organizatin, 2013 Submitted: May 08, 2012 Accepted: May 29, 2012 Published:
More information[COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t o m a k e s u r e y o u a r e r e a d y )
(Abut the final) [COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t m a k e s u r e y u a r e r e a d y ) The department writes the final exam s I dn't really knw what's n it and I can't very well
More informationPart a: Writing the nodal equations and solving for v o gives the magnitude and phase response: tan ( 0.25 )
+ - Hmewrk 0 Slutin ) In the circuit belw: a. Find the magnitude and phase respnse. b. What kind f filter is it? c. At what frequency is the respnse 0.707 if the generatr has a ltage f? d. What is the
More informationThe general linear model and Statistical Parametric Mapping I: Introduction to the GLM
The general linear mdel and Statistical Parametric Mapping I: Intrductin t the GLM Alexa Mrcm and Stefan Kiebel, Rik Hensn, Andrew Hlmes & J-B J Pline Overview Intrductin Essential cncepts Mdelling Design
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationArea of Learning: Mathematics Pre-calculus 12
Area f Learning: Mathematics Pre-calculus 12 Big Ideas Elabratins Using inverses is the fundatin f slving equatins and can be extended t relatinships between functins. Understanding the characteristics
More informationYou need to be able to define the following terms and answer basic questions about them:
CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f
More informationDavid HORN and Irit OPHER. School of Physics and Astronomy. Raymond and Beverly Sackler Faculty of Exact Sciences
Cmplex Dynamics f Neurnal Threshlds David HORN and Irit OPHER Schl f Physics and Astrnmy Raymnd and Beverly Sackler Faculty f Exact Sciences Tel Aviv University, Tel Aviv 69978, Israel hrn@neurn.tau.ac.il
More informationTree Structured Classifier
Tree Structured Classifier Reference: Classificatin and Regressin Trees by L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stne, Chapman & Hall, 98. A Medical Eample (CART): Predict high risk patients
More informationLead/Lag Compensator Frequency Domain Properties and Design Methods
Lectures 6 and 7 Lead/Lag Cmpensatr Frequency Dmain Prperties and Design Methds Definitin Cnsider the cmpensatr (ie cntrller Fr, it is called a lag cmpensatr s K Fr s, it is called a lead cmpensatr Ntatin
More information