Adaptive Filtering for Flow-Cytometric Particles

Size: px
Start display at page:

Download "Adaptive Filtering for Flow-Cytometric Particles"

Transcription

1 126 Part. Part. Syst. Charact. 17 (2000) 126±133 Adaptive Filtering for Flow-Cytometric Particles alek Adjouadi*, Carlos Reyes**, John Riley***, Patricio Vidal* (Received 15 June 2000; resubmitted 26 July 2000) Abstract This paper studies the effects of FIR ltering and introduces an adaptive FIR ltering technique designed speci cally to smooth one and two dimensional accumulated owcytometric particles through frequency histograms. The adaptive smoothing technique illustrated here will be shown to be particularly useful in compensating the uneven histogram accumulation effects which take place when data is accumulated at the lower histogram channels versus the higher histogram channels. Linear smoothing techniques will not compensate for this phenomenon which is inherent to all histograms of accumulated data. In this view, a thorough analysis is provided to deal with the dilemmas imposed by the uneven accumulation of data within these histograms. 1 Introduction When cytometric data from speci c blood cell particles is accumulated into a frequency histogram with a nite number of channels (or bins) the accumulation process inherently smoothes the histogram since an averaging effect is taking place. When the cytometric data is accumulated in the higher channels of the frequency histogram, the distribution appears more spread and noisier. This is due to the fact that more channels are available and the inherent averaging effect is diminished as data is accumulated over a larger band of channels. Because of this, when data is accumulated in a histogram with a discrete number of channels, it gives rise to an uneven resolution within the histogram. The idea behind the adaptive smoothing is to take advantage of the fact that as the lter coef cients are varied over an appropriate range, less smoothing will take place. The lter coef cients can be made to vary proportionally with respect to the histogram channel where smoothing is taking place. Smoothing is usually required prior to the analysis of frequency histogrammed data to attenuate the effect of noise. Smoothing through FIR ``Finite Impulse Response'' ltering is by far the preferred method since it will not shift the position of the data distributions. A perspective on density estimators from histograms to several univariate and *. Adjouadi, Ph.D., Chairperson, P. Vidal, Ph.D. Student, Department of Electrical and Computer Engineering, Center for Engineering and Applied Sciences, EAS 3935, W. Flagler Street, Florida International University, iami, Fl (USA). ** C. Reyes, Engineer, otorola, Test Systems Engineering, 8000 West Sunrise Blvd., Fort Lauderdale, Fl (USA). *** J. Riley, Engineer, Beckman Coulter Inc., SW 147th Avenue, iami, Fl (USA). multivariate statistical data analyses can be found in studies [1±3]. Other studies using histograms bring to focus several issues including the notions of stability in the appearance of the histogram [4], the interpolations that can be achieved in kernel density estimators [5], as well as the practical but traditional aspect of enhancing images through an adaptive histogram equalization method [6]. In general, it is desirable to select a smoothing function that has the following criteria to ensure that the resulting data is not distorted 1±The area under the curve should be maintained 2±The mean of the distribution should be unchanged 3±The change in the standard deviation should be kept to a minimum These criteria for smoothing are maintained by traditional FIR ltering provided that boundary conditions are satis- ed. A modi ed ltering scheme is introduced in this study based on these mechanisms to customize the traditional FIR-type ltering schemes for discrete time signals to accommodate for data accumulated into frequency histograms. This modi ed ltering scheme is viewed as an adaptive ltering scheme that linearizes and accommodates for uneven histogram accumulation effects. To illustrate this problem a random Gaussian distribution was created using the Box-uller ethod. The same pseudo-random distribution is illustrated with three separate gain settings (1, 5, 10) as shown in Figure 1. When this data is histogrammed, as shown in Figure 2, the uneven accumulation problem is encountered and analyzed. For experimental evaluation, similar histogram accumulation problems are discussed and analyzed utilizing Phycoerythrin (PE) bead particles containing a variety of bead populations at various amounts of uorochromes. # WILEY-VCH Verlag GmbH, D Weinheim, /00/0309-page 126±133 $ =0

2 Part. Part. Syst. Charact. 17 (2000) 126± Fig. 1 Normally distributed data at various gains. Fig. 2 Histogram of entire data set. 2 Finite Impulse Response Filtering Normally the causal Finite Impulse Response (FIR) lter is used in signal processing, but in histogram smoothing, the noncausal FIR must be used in order to maintain symmetry and to prevent skewness in the smoothed distributions. The causal FIR lter difference equation is given by H1 i ˆ PJ jˆ0 H i j The noncausal FIR lter difference equation is given by H1 i ˆ PJ H i j The lter architectures of both FIR types are shown in Figure 3. These lter structures offer the advantage of linear phase or constant time delays. This is essential in obtaining a smoothing function, which is capable of maintaining the means of populations in the histogrammed data. A simple and effective FIR ltering scheme is achieved here with the traditional tap FIR lter. Such a ltering scheme offers the essential mechanisms required obtaining a ``good'' smoothing function. Each requirement can be met by traditional FIR ltering and maintaining the area under the curve provided that the following constraints are met Fig. 3 Causal and non-causal FIR lter structures. (a) Causal FIR lter. (b) Non-causal FIR lter Ensure that the area under the curve is maintained i.e., the sum of the FIR lter coef cients must equal 1. ˆ 1; where the number of taps in the FIR lter is 2J Prevent the data from being skewed meaning that the lter coef cients be symmetric around a 0 such that ˆ a j This requires that the number of lter taps in the FIR lter be odd. 3. aintain the area under the curve meaning that the boundary conditions speci ed by Eq. (5) is assumed to overcome the spreading effect resulting from the FIR ltering process. H i ˆ 0 for i5j and i N J; where H represents the histogrammed data and N is the number of accumulated points. 2.1 Proof of Requirements to aintaining the Area Under the Curve Let H i denote the accumulated data histogram with the channel range given by i 2 0; 1;...; N 1Š, where N is the number of channels in the histogram. The coef cients of the FIR lter are given as for j 2 J...JŠ where J is one half the number of lter taps. Using Eq. (2), the area, 1, of the output of the lter is given as 1 ˆ H1 i ˆ H i j To illustrate that the area under the histogram is maintained, we need to prove that the the sum of all points before and after the data has been ltered is maintained. Rearranging the terms from Eq. (6) we nd that 1 ˆ PJ j H i j

3 128 Part. Part. Syst. Charact. 17 (2000) 126±133 Due to the symmetry of the FIR lter coef cients, we can expand Eq. (7) as follows 1 ˆ 0 H i PJ j H i j PJ j H i j aking a change of variables and grouping similar terms we obtain 1 ˆ 0 H i PJ N 1 j P iˆj H i N 1 j P iˆ j 8 H i! 9 If we let represent the summation of the total number of point in the accumulated frequency histogram so that ˆ i 0 H i, and modify the summation limits using the boundary conditions of Eq. (5), to write! 1 ˆ a 0 P a N 1 j H i ˆ a 0 10 And using the FIR lter coef cients properties, this equation satis es the rst requirement that the area under the curve be maintained, that is 1 ˆ 11 And because the mean of the distribution is given by m ˆ 1y P N 1 ih i we satisfy the second requirement that the area under the curve be maintained, that is m1 ˆ m The Effect on Variance due to FIR Filtering FIR ltering always effects the variance of a distribution. A good smoothing function should minimize changes in variance while still eliminating unwanted noise. In this proof, we formulate an approach to measuring the changes in variance due to ltering and recovering the original variance of the un ltered distribution. Given that the variance of the ltered data is given by s 2 ˆ 1 H1 i i m 2 17 The difference in variance can be de ned, as derived in the appendix, by the expression Ds 2 ˆ 1 i 2 H1 i 1 H i j i 2 ˆ PJ j Proof of Requirement in aintaining the eans The second desirable property of a good smoothing function is to maintain the means of the data distributions. This feature is inherent to all FIR type of lters provided the boundary conditions of Eq. (5) are satis ed. Because FIR lter coef cients are symmetric, the mean, m1, of the ltered data is maintained, and is derived as m1 ˆ 1 1 H i j i ˆ 1 j ih i j 12 Due to the symmetry of the FIR lter coef cients, we can expand Eq. (12) as follows m1 ˆ 1 a 0 ih i 1 j ih i j 1 j ih i j 13 aking a change of variables and grouping similar terms we obtain m1 ˆ 1 a 0 ih i 1 N 1 j P iˆj N 1 j i j H i P iˆ j i j H i! 14 By modifying the summation limits using the boundary conditions established in Eq. (5), it can be shown that m1 ˆ 1 a 0 ˆ 1 ih i ih i 1 a 0! N 1 P i j H i i j H i ˆ 1 ih i 15 Eq. (18) provides us with the ability to track and recover changes in variances through FIR ltering. 2.4 The 3-Tap Causal FIR Filter The standard 3-Tap FIR lter typically has lter coef cients of a 1 ˆ 025, a 0 ˆ 05, and a 1 ˆ 025 with the sum of the lter coef cients being equal to 1. This type of FIR lter is usually called the Filter. To explore different ltering possibilities, transfer functions for the coef cients given in Table 1 are shown in Figure 4. These transfer functions illustrate several key points. First, when the ltering coef cients are given as 0-1-0, no ltering occurs and the transfer function is thus a straight line. Second, as the ltering coef cients are varied from 0.1± 0.9±0.1 to the traditional 3-tap lter coef cients of 0.25± 0.5±0.25 the transfer function yields a low pass lter with the latter set of lter coef cients yielding the lowest cutoff frequency. Third, beyond the coef cients of the 3-tap FIR lter, all other coef cients yield a notch lter. To achieve variations on the traditional 3-tap FIR lter, the same data set can be applied through the 3-tap lter multiple times. If the histogrammed data is applied to the same set of lter coef cients as shown earlier in Table 1, the transfer functions illustrated in Figure 5 are obtained after 15 passes through the FIR lter. Table 1 Types of FIR lter coef cients considered. HP 0 HP 1 HP 2 HP 3 HP 4 HP 5 HP 6 HP 7 HP 8 HP

4 Part. Part. Syst. Charact. 17 (2000) 126± Fig Tap FIR ltering of histogrammed data. Fig. 4 Transfer functions for different FIR coef cients. The results illustrated in Figure 5 show how the cutoff frequency for the low pass lter is lowered as the number of iterations is increased. The band of frequencies eliminated by the notch lter is widened such that some of the coef- cients, which yielded a notch lter, appear as a low-pass lter after multiple iterations. 2.5 The Effects OF Tap FIR Filtering on Histogrammed Data Figure 6 below illustrates the smoothing effects of a typical standard tap FIR lter on the histogrammed data of Figure 1. It also illustrates the undesirable effects of smoothing the data at the low-resolution channels of the histogram. As was shown earlier in Figure 2, although the only difference in the three populations accumulated is the gain setting, the lower resolution channels of the histogram are naturally ltered by the accumulation of data into fewer channels. Because of this, the data at the low end of the histogram appears less noisy than the data accumulated in the higher histogram channels. 3 Introducing the Adaptive FIR Filter for Histogrammed Data To accommodate for the accumulation process which inherently smoothes the histogram in a linear fashion, since an averaging effect is taking place, the adaptive FIR lter is introduced. This new ltering scheme accommodates for data that is accumulated in the uneven resolution of the channels of the frequency histogram. The idea behind the adaptive smoothing is to take advantage of the fact that as the lter coef cients are varied over an appropriate range, the amount of smoothing can be altered to accommodate for the uneven accumulation of data. The adaptive FIR lter will thus adjust its weights based on its location in the histogram. This allows for less smoothing at the lower resolution channels (since the accumulation effect has already contributed a signi cant amount of smoothing) and increases the amount of smoothing at the higher resolution channels where the smoothing effect of the data accumulation is not as pronounced. 3.1 Basis of the Adaptive FIR ltering The Least eans Square (LS) algorithm is one of the simplest schemes for adaptively adjusting the weights of an adaptive lter. This is because of its ease of computation and also it does not require of ine gradient estimations or repetitions of data. The correction resulting from the adaptive lter is based on the relation y k ˆ x k w k. Since the reference signal as shown in Figure 7 is set to 1, x k ˆ 1, the correction is equal to the weight of the lter tap, y k ˆ w k. Fig. 5 ultiple iterations (n ˆ 15) of data through the 3-tap FIR lter. Fig. 7 Structure of the adaptive interference canceler.

5 130 Part. Part. Syst. Charact. 17 (2000) 126±133 The lter weight is adjusted using the LS algorithm as follows w k 1 ˆ w k m H k ˆ w k 2me k x k 19 Where m can be interpreted as the learning constant and e k is the error signal given by e k ˆ d k x T k w k. The sizes of these vectors in Eq. (19) are equal to the number of taps in the adaptive lter. For the particular type of adaptive interference canceler we are dealing here, the vectors become scalars. The adaptation of w k then becomes w k 1 ˆ w k 2me k x k Which yields y k 1 ˆ y k 2m d k y k Widrow in study [7] takes the z-transform of Eq. (7) to calculate the transfer function of the adaptive canceler and suggests the following relationship H z ˆE z D z ˆ z 1 z 1 2m 22 This transfer function de nes a single frequency notch lter with half the power frequency at o ˆ 2m. 3.2 Proof of Requirements to aintaining the Area under the Curve Letting again H i denote the accumulated histogram with the channel range given by i N 1, where N is the number of channels in the histogram. The coef cients of the adaptive FIR lter are given as i for j 2 J;...; JŠ where J is one half the number of lter taps. The area can then be expressed as ˆ H i i j 23 In order to maintain the area under the curve, and as derived in the Appendix, the solution for is ˆ a0 N 1 a 0 0 Š 2 N 1 PJ ( j 1 P H i 2i 2j 1Š PJ N 1 P iˆn 1 j ) H i 2i 2j 2N 1Š 3.3 The Effects of Adaptive Filtering on the ean De ning the mean, m, to be m ˆ 1 i PJ H i i j and expanding Eq. (25) yields m ˆ 1 i H i 0 PJ k i H i j PJ k i H i j 26 Using the boundary conditions of Eq. (5), the change in the mean value between the original distribution and the smoothed distribution can be expressed as Dm ˆ a0 N 1 a 0 0 Š P 2 j 2 j ih i 2 N 1 PJ The Effects of Adaptive Filtering on the Variance Just as was determined with the FIR ltering scheme, adaptive ltering also effects the variance of a data distribution. It should be a critical goal of any smoothing function to minimize changes in variance while eliminating unwanted noise. As was derived earlier in the FIR case, we formulate here an approach suitable for both measuring the changes in variance due to adaptive ltering and for recovering the original variance of the un ltered distribution. The variance of the ltered data is in this case given as s 2 ˆ 1 i PJ H i i j 28 Which, as derived in the Appendix, can be expressed as s 2 ˆ 1 i 2 H i j 2 a 0 N 1 a 0 0 Š P 3m J j 2 N 1 PJ 29 This provides the ability to track and recover changes in the variance due to adaptive ltering. 3.5 Application of the Adaptive FIR Filter Figure 8 illustrates the smoothing effects of an adaptive FIR lter on the histogram data shown earlier in Figure 2 after 20 passes. In this case a 0 was varied from a value of one (no smoothing) at channel zero to a value of 0.5 (maximum smoothing) at the last channel, which in this case is channel 255. In order to accomplish similar smoothing effects in the high resolution region of the histogram, more passes were necessary in the FIR adaptive lter (20 passes) as compared to the standard FIR lter (10 passes). Figure 9 contrasts both smoothed histograms together. In this case, there was a need for increased smoothing at the high end of the histogram while maintaining minimum smoothing at the low end. However, sometimes the opposite is desired as will be seen in the next application.

6 Part. Part. Syst. Charact. 17 (2000) 126± Fig. 8 Results of adaptive FIR histogram smoothing. 3.6 Adaptive FIR ltering Applied to PE Fluorescent Sensitivity Determination The ability to provide a quantitative measurement of the cellular uorescent sensitivity of a particular instrument is critical parameter in the quali cation of that instrument. To attain this, various sets of particles containing graded amounts of uorochromes have been developed which when combined with the background uorescent levels of the instrument provide a quantitative measurement of the instrument's sensitivity. Data was collected in an instrument with Phycoerythrin beads containing a mix of six-bead population at various amounts of uorochromes. The data was logarithmically transformed [8] and ltered with the adaptive FIR lter. In this case a 0 was varied from a value of 0.5 (maximum smoothing) at channel zero to a value of one (no smoothing) at the last channel. The purpose is to prepare the histogram for the automated algorithm, which nds the location of the six distributions and the background distribution in order to make the sensitivity calculations. Figure 10 shows the histogram of the transformed data and the smoothed histogram. It can be observed that the majority of the smoothing is achieved in the low end of the histogram where it is needed, Fig. 10 Histogram of uorescent particles with background. while the tight distributions at the high end of the histogram are left relatively undisturbed, which is the desired outcome. 4 Conclusion This study introduced a new adaptive FIR ltering scheme speci cally designed to deal with histogrammed data and the uneven histogram accumulation effects. A preliminary study involved the use of pseudo random Gaussian distributions that rstly illustrated the dynamic histogram resolution and illustrated how to compensate for this phenomenon by compensating for the averaging effect that histogramming has on sampled data. A mathematical framework was established to illustrate why the FIR ltering scheme is so effective as a smoothing function provided the proper boundary conditions are satis ed. However, it was also shown that for histogrammed data this might create several undesirable artifacts. The adaptive FIR ltering scheme introduced in this study provided a exible method to compensate for these undesirable artifacts while accomplishing the desired smoothing. Finally, it was shown how adjusting the initial and nal smoothing levels that are assumed could vary the smoothing function appropriately with respect to the accumulated data. It is also appropriate to note that such an adaptive ltering process could serve as a valuable preprocessing step for experimental set ups involving ow cytometric data applications as that described in study [9]. 5 Acknowledgments Fig. 9 Standard smooth histogram vs. adaptive smooth histogram. This work was supported by the National Science Foundation grants EIA and EIA , and the Of ce of Naval Research ONR Grant N with the Center for Advanced Technology & Education.

7 132 Part. Part. Syst. Charact. 17 (2000) 126±133 6 References [1] B. W. Silverman Density Estimation for Statistical Data Analysis. Chapman and Hall, New York [2] D. F. Heath Normal or Log-Normal Appropriate Distributions. Nature 213 (1967) 1159±1160. [3] P. N. Dean Data Processing, in. R. elamed, T. Lindmo,. L. endelsohn (Eds) Flow Cytometry and Sorting, 2nd edition, John Wiley & Sons, New York 1990, pp. 415±444. [4] J. S. Siminoff, F. Udinah easuring the Stability of Histogram Appearance when the Anchor Position is Changed. Computational Statistics and Data Analysis, Elsevier 1997, Vol. 23, pp. 335±353. [5] A. Kogure Effective Interpolations for Kernel Density Estimators. Nonparametrics Statistics, Overseas Publishers Association, 1998, Vol. 9, pp. 165±195. [6] J. A. Stark, W. J. Fitzgerald An Alternative Algorithm for Adaptive Histogram Equalization. Graphical odels and Image Processing 58 (1996) 180±185. [7] B. Widrow, S. D. Stearns Adaptive Signal Processing. Prentice-Hall, Inc., Englewood Cliffs, New Jersey [8] C.. David, D. Redelman, R. Vogt Computing the Central Location of Immuno- uorescence Distributions Logarithmic Data Transformations Are Not Always Appropriate. Cytometry (Communications in Clinical Cytometry) 18 (1994) 75±78. [9] C. Godefroy,. Adjouadi Particle Sizing in a Flow Environment Using Light Scattering Patterns. Part. Part. Syst. Charact. 17 (2000) 47±55. [10] C. Reyes,. Adjouadi A Directional Clustering Technique for Random Data Classi cation. J. Cytometry 27 (1997). Appendix athematical Derivations ean Value The area can be expressed as ˆ H i i j A1 Recall that in order to maintain the area under the curve, as was established in the FIR case, we require that a 0 i i ˆ1 where i ˆ 0 k i A2 By allowing ˆ 0, k i can be de ned as k i ˆ 1 a 0 i A3 With these conditions set, it can be shown that one possible expression for the adaptive lter coef cients is i a 0 i ˆa 0 0 a 0 N 1 a 0 0 Š N 1 A4 In this case, the lter coef cients are adjusted based on the location of the events on the frequency histogram. In this way, the lower resolution frequency bins are ltered less than the higher frequency bins at the upper end of the histogram. Due to symmetry of the adaptive FIR lter coef cients Eq. (A1) can be rewritten as " # ˆ a 0 H i i PJ H i i j PJ H i i j A5 And substituting Eqs. (A2) and (A3) into (A5) yields 2 3 ˆ a 0 H i i PJ 1 a o i P H i j J 1 a o i 6 H i j A6 Assuming a common denominator, and grouping like terms yields ˆ 1 8 >< > PJ N 1 j P iˆj H i 2a 0 i a 0 i j a 0 i j PJ N 1 j P iˆn j If a 0 is assumed linear, then N 1 j P iˆj and ˆ 1 " # Pj 1 a 0 i H i >= a 0 i H i iˆn j a 0 i j H i PJ j 1 7 P 5 a 0 i j H i >; iˆ j 39 A7 H i 2a 0 i a 0 i j a 0 i j ˆ 0 A8 8 >< > P N 1 P iˆn j H i 2a 0 i a 0 j 1 i a 0 i j Š H i 2a 0 i a 0 i j a 0 2N j i 1 Š 9 >= >; A9 Substituting Eq. (A4) into Eq. (A9) yields the solution for as ˆ a0 N 1 a 0 0 Š 2 N 1 PJ PJ j 1 P H i 2i 2j 1Š PJ j H i 2i 2j 2N 1Š iˆn 1 j The Variance A10 The variance of the ltered data which is in this case given by s 2 ˆ i PJ H i i j A11

8 Part. Part. Syst. Charact. 17 (2000) 126± which can be expressed as i 2 a 0 i H i i H i i j i H i i j s 2 ˆ And substituting the following expression 0 1 i ˆ 1 a 0 i B A a 0 i into Eq. (A12) yields; 8 i 1 a 0 i H i j >< s 2 ˆ or, s 2 ˆ > 8 >< > i A12 A a 0 i H i j >= j 2i 2 a 0 i H i PJ j i 2 1 a 0 i H i j PJ i 2 a 0 i H i >; A14 9 >= j i 2 1 a 0 i H i j >; A15 Rewriting the summation limits and adjusting the histogram data subscripts yields ( s 2 1 ˆ j 2i 2 a 0 i H i Thus, s 2 ˆ 1 PJ j i j 2 1 a 0 i j H i PJ i 2 H i j i j 2 1 a 0 i j H i ) 16 j 2 a 0 N 1 a 0 0 Š P 3m j 2 N 1 PJ easuring the Changes in Variance 17 derived. Recall that the variance of the ltered data is given by s 2 ˆ 1 H1 i i m 2 A18 Rewriting this expression in terms of the original un ltered data we nd that 1 H1 i i m 2ˆ 1 H i j i m 2 A19 Leaving the term momentarily out of the derivation we expand Eq. (A18) as i 2 N 1 j H1 i 2m P i H1 i m 2 H1 i ˆ ˆ " # H i j i 2 2m i PJ H i j m 2 H i j A20 Noting that the area under the curve remains unchanged and assuming that the mean remains constant, we have i 2 H1 i ˆ H i j i 2 Rearranging terms of Eq. (A21) yields i 2 H1 i ˆ PJ N 1 j P iˆj H i j A21 A22 Also, making use again of the boundary conditions of Eq. (A5), we establish that i 2 H1 i ˆ PJ j H i i j 2 and by expansion, we obtain i 2 H1 i ˆ PJ N 1 P i 2 H i 2j ih i j 2 H i A23 A24 Again, due to the symmetry of the FIR lter coef cients; we note that 2j P N 1 ih i ˆ 0. And thus, i 2 H1 i ˆ H i j i 2 PJ j 2 H i A25 Reintroducing the term to facilitate the last step of this formulation and de ning a difference in variance we nd that Due to ltering and recovering the original variance of the un ltered distribution, the changes in variance can now be Ds 2 ˆ 1 i 2 H1 i 1 H i j i 2 ˆ PJ j 2 A26

Title without the persistently exciting c. works must be obtained from the IEE

Title without the persistently exciting c.   works must be obtained from the IEE Title Exact convergence analysis of adapt without the persistently exciting c Author(s) Sakai, H; Yang, JM; Oka, T Citation IEEE TRANSACTIONS ON SIGNAL 55(5): 2077-2083 PROCESS Issue Date 2007-05 URL http://hdl.handle.net/2433/50544

More information

Temporal Backpropagation for FIR Neural Networks

Temporal Backpropagation for FIR Neural Networks Temporal Backpropagation for FIR Neural Networks Eric A. Wan Stanford University Department of Electrical Engineering, Stanford, CA 94305-4055 Abstract The traditional feedforward neural network is a static

More information

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems:

Examples. 2-input, 1-output discrete-time systems: 1-input, 1-output discrete-time systems: Discrete-Time s - I Time-Domain Representation CHAPTER 4 These lecture slides are based on "Digital Signal Processing: A Computer-Based Approach, 4th ed." textbook by S.K. Mitra and its instructor materials.

More information

Adaptive Inverse Control

Adaptive Inverse Control TA1-8:30 Adaptive nverse Control Bernard Widrow Michel Bilello Stanford University Department of Electrical Engineering, Stanford, CA 94305-4055 Abstract A plant can track an input command signal if it

More information

Adaptive Inverse Control based on Linear and Nonlinear Adaptive Filtering

Adaptive Inverse Control based on Linear and Nonlinear Adaptive Filtering Adaptive Inverse Control based on Linear and Nonlinear Adaptive Filtering Bernard Widrow and Gregory L. Plett Department of Electrical Engineering, Stanford University, Stanford, CA 94305-9510 Abstract

More information

III.C - Linear Transformations: Optimal Filtering

III.C - Linear Transformations: Optimal Filtering 1 III.C - Linear Transformations: Optimal Filtering FIR Wiener Filter [p. 3] Mean square signal estimation principles [p. 4] Orthogonality principle [p. 7] FIR Wiener filtering concepts [p. 8] Filter coefficients

More information

E cient Importance Sampling

E cient Importance Sampling E cient David N. DeJong University of Pittsburgh Spring 2008 Our goal is to calculate integrals of the form Z G (Y ) = ϕ (θ; Y ) dθ. Special case (e.g., posterior moment): Z G (Y ) = Θ Θ φ (θ; Y ) p (θjy

More information

Time Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley

Time Series Models and Inference. James L. Powell Department of Economics University of California, Berkeley Time Series Models and Inference James L. Powell Department of Economics University of California, Berkeley Overview In contrast to the classical linear regression model, in which the components of the

More information

QUANTIZATION MODE OPPORTUNITIES IN FIXED-POINT SYSTEM DESIGN

QUANTIZATION MODE OPPORTUNITIES IN FIXED-POINT SYSTEM DESIGN 8th European Signal Processing Conference (EUSIPCO-200 Aalborg, Denmark, August 23-27, 200 QUANTIZATION MODE OPPORTUNITIES IN FIXED-POINT SYSTEM DESIGN D. Menard, D. Novo, R. Rocher, F. Catthoor, O. Sentieys

More information

H Optimal Nonparametric Density Estimation from Quantized Samples

H Optimal Nonparametric Density Estimation from Quantized Samples H Optimal Nonparametric Density Estimation from Quantized Samples M. Nagahara 1, K. I. Sato 2, and Y. Yamamoto 1 1 Graduate School of Informatics, Kyoto University, 2 Graduate School of Economics, Kyoto

More information

On Information Maximization and Blind Signal Deconvolution

On Information Maximization and Blind Signal Deconvolution On Information Maximization and Blind Signal Deconvolution A Röbel Technical University of Berlin, Institute of Communication Sciences email: roebel@kgwtu-berlinde Abstract: In the following paper we investigate

More information

Ch. 7: Z-transform Reading

Ch. 7: Z-transform Reading c J. Fessler, June 9, 3, 6:3 (student version) 7. Ch. 7: Z-transform Definition Properties linearity / superposition time shift convolution: y[n] =h[n] x[n] Y (z) =H(z) X(z) Inverse z-transform by coefficient

More information

Lessons in Estimation Theory for Signal Processing, Communications, and Control

Lessons in Estimation Theory for Signal Processing, Communications, and Control Lessons in Estimation Theory for Signal Processing, Communications, and Control Jerry M. Mendel Department of Electrical Engineering University of Southern California Los Angeles, California PRENTICE HALL

More information

IS NEGATIVE STEP SIZE LMS ALGORITHM STABLE OPERATION POSSIBLE?

IS NEGATIVE STEP SIZE LMS ALGORITHM STABLE OPERATION POSSIBLE? IS NEGATIVE STEP SIZE LMS ALGORITHM STABLE OPERATION POSSIBLE? Dariusz Bismor Institute of Automatic Control, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland, e-mail: Dariusz.Bismor@polsl.pl

More information

ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING. Information Systems Lab., EE Dep., Stanford University

ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING. Information Systems Lab., EE Dep., Stanford University ADAPTIVE INVERSE CONTROL BASED ON NONLINEAR ADAPTIVE FILTERING Bernard Widrow 1, Gregory Plett, Edson Ferreira 3 and Marcelo Lamego 4 Information Systems Lab., EE Dep., Stanford University Abstract: Many

More information

Rate-Distortion Based Temporal Filtering for. Video Compression. Beckman Institute, 405 N. Mathews Ave., Urbana, IL 61801

Rate-Distortion Based Temporal Filtering for. Video Compression. Beckman Institute, 405 N. Mathews Ave., Urbana, IL 61801 Rate-Distortion Based Temporal Filtering for Video Compression Onur G. Guleryuz?, Michael T. Orchard y? University of Illinois at Urbana-Champaign Beckman Institute, 45 N. Mathews Ave., Urbana, IL 68 y

More information

MC3: Econometric Theory and Methods. Course Notes 4

MC3: Econometric Theory and Methods. Course Notes 4 University College London Department of Economics M.Sc. in Economics MC3: Econometric Theory and Methods Course Notes 4 Notes on maximum likelihood methods Andrew Chesher 25/0/2005 Course Notes 4, Andrew

More information

Computer Vision & Digital Image Processing

Computer Vision & Digital Image Processing Computer Vision & Digital Image Processing Image Restoration and Reconstruction I Dr. D. J. Jackson Lecture 11-1 Image restoration Restoration is an objective process that attempts to recover an image

More information

2 Tikhonov Regularization and ERM

2 Tikhonov Regularization and ERM Introduction Here we discusses how a class of regularization methods originally designed to solve ill-posed inverse problems give rise to regularized learning algorithms. These algorithms are kernel methods

More information

Filter Banks with Variable System Delay. Georgia Institute of Technology. Atlanta, GA Abstract

Filter Banks with Variable System Delay. Georgia Institute of Technology. Atlanta, GA Abstract A General Formulation for Modulated Perfect Reconstruction Filter Banks with Variable System Delay Gerald Schuller and Mark J T Smith Digital Signal Processing Laboratory School of Electrical Engineering

More information

Filter Banks for Image Coding. Ilangko Balasingham and Tor A. Ramstad

Filter Banks for Image Coding. Ilangko Balasingham and Tor A. Ramstad Nonuniform Nonunitary Perfect Reconstruction Filter Banks for Image Coding Ilangko Balasingham Tor A Ramstad Department of Telecommunications, Norwegian Institute of Technology, 7 Trondheim, Norway Email:

More information

EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS. Gary A. Ybarra and S.T. Alexander

EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS. Gary A. Ybarra and S.T. Alexander EFFECTS OF ILL-CONDITIONED DATA ON LEAST SQUARES ADAPTIVE FILTERS Gary A. Ybarra and S.T. Alexander Center for Communications and Signal Processing Electrical and Computer Engineering Department North

More information

Adaptive Filters. un [ ] yn [ ] w. yn n wun k. - Adaptive filter (FIR): yn n n w nun k. (1) Identification. Unknown System + (2) Inverse modeling

Adaptive Filters. un [ ] yn [ ] w. yn n wun k. - Adaptive filter (FIR): yn n n w nun k. (1) Identification. Unknown System + (2) Inverse modeling Adaptive Filters - Statistical digital signal processing: in many problems of interest, the signals exhibit some inherent variability plus additive noise we use probabilistic laws to model the statistical

More information

Submitted to Electronics Letters. Indexing terms: Signal Processing, Adaptive Filters. The Combined LMS/F Algorithm Shao-Jen Lim and John G. Harris Co

Submitted to Electronics Letters. Indexing terms: Signal Processing, Adaptive Filters. The Combined LMS/F Algorithm Shao-Jen Lim and John G. Harris Co Submitted to Electronics Letters. Indexing terms: Signal Processing, Adaptive Filters. The Combined LMS/F Algorithm Shao-Jen Lim and John G. Harris Computational Neuro-Engineering Laboratory University

More information

On the Frequency-Domain Properties of Savitzky-Golay Filters

On the Frequency-Domain Properties of Savitzky-Golay Filters On the Frequency-Domain Properties of Savitzky-Golay Filters Ronald W Schafer HP Laboratories HPL-2-9 Keyword(s): Savitzky-Golay filter, least-squares polynomial approximation, smoothing Abstract: This

More information

Y1 Y2 Y3 Y4 Y1 Y2 Y3 Y4 Z1 Z2 Z3 Z4

Y1 Y2 Y3 Y4 Y1 Y2 Y3 Y4 Z1 Z2 Z3 Z4 Inference: Exploiting Local Structure aphne Koller Stanford University CS228 Handout #4 We have seen that N inference exploits the network structure, in particular the conditional independence and the

More information

A general procedure for rst/second-order reliability method (FORM/SORM)

A general procedure for rst/second-order reliability method (FORM/SORM) Structural Safety 21 (1999) 95±112 www.elsevier.nl/locate/strusafe A general procedure for rst/second-order reliability method (FORM/SORM) Yan-Gang Zhao*, Tetsuro Ono Department of Architecture, Nagoya

More information

Butterworth Filter Properties

Butterworth Filter Properties OpenStax-CNX module: m693 Butterworth Filter Properties C. Sidney Burrus This work is produced by OpenStax-CNX and licensed under the Creative Commons Attribution License 3. This section develops the properties

More information

research papers Calculation of crystal truncation rod structure factors for arbitrary rational surface terminations

research papers Calculation of crystal truncation rod structure factors for arbitrary rational surface terminations Journal of Applied Crystallography ISSN 0021-8898 Received 22 April 2002 Accepted 5 August 2002 Calculation of crystal truncation rod structure factors for arbitrary rational surface terminations Thomas

More information

Derivation of dual forces in robot manipulators

Derivation of dual forces in robot manipulators PERGAMON Mechanism and Machine Theory (1998) 141±148 Derivation of dual forces in robot manipulators V. Brodsky, M. Shoham Department of Mechanical Engineering, Technion Israel Institute of Technology,

More information

A Program for Data Transformations and Kernel Density Estimation

A Program for Data Transformations and Kernel Density Estimation A Program for Data Transformations and Kernel Density Estimation John G. Manchuk and Clayton V. Deutsch Modeling applications in geostatistics often involve multiple variables that are not multivariate

More information

BLIND SEPARATION OF TEMPORALLY CORRELATED SOURCES USING A QUASI MAXIMUM LIKELIHOOD APPROACH

BLIND SEPARATION OF TEMPORALLY CORRELATED SOURCES USING A QUASI MAXIMUM LIKELIHOOD APPROACH BLID SEPARATIO OF TEMPORALLY CORRELATED SOURCES USIG A QUASI MAXIMUM LIKELIHOOD APPROACH Shahram HOSSEII, Christian JUTTE Laboratoire des Images et des Signaux (LIS, Avenue Félix Viallet Grenoble, France.

More information

Ch6-Normalized Least Mean-Square Adaptive Filtering

Ch6-Normalized Least Mean-Square Adaptive Filtering Ch6-Normalized Least Mean-Square Adaptive Filtering LMS Filtering The update equation for the LMS algorithm is wˆ wˆ u ( n 1) ( n) ( n) e ( n) Step size Filter input which is derived from SD as an approximation

More information

inear Adaptive Inverse Control

inear Adaptive Inverse Control Proceedings of the 36th Conference on Decision & Control San Diego, California USA December 1997 inear Adaptive nverse Control WM15 1:50 Bernard Widrow and Gregory L. Plett Department of Electrical Engineering,

More information

Simple Estimators for Semiparametric Multinomial Choice Models

Simple Estimators for Semiparametric Multinomial Choice Models Simple Estimators for Semiparametric Multinomial Choice Models James L. Powell and Paul A. Ruud University of California, Berkeley March 2008 Preliminary and Incomplete Comments Welcome Abstract This paper

More information

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis

Elec4621 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis Elec461 Advanced Digital Signal Processing Chapter 11: Time-Frequency Analysis Dr. D. S. Taubman May 3, 011 In this last chapter of your notes, we are interested in the problem of nding the instantaneous

More information

The Bias-Variance dilemma of the Monte Carlo. method. Technion - Israel Institute of Technology, Technion City, Haifa 32000, Israel

The Bias-Variance dilemma of the Monte Carlo. method. Technion - Israel Institute of Technology, Technion City, Haifa 32000, Israel The Bias-Variance dilemma of the Monte Carlo method Zlochin Mark 1 and Yoram Baram 1 Technion - Israel Institute of Technology, Technion City, Haifa 32000, Israel fzmark,baramg@cs.technion.ac.il Abstract.

More information

DIRECT AND INDIRECT LEAST SQUARES APPROXIMATING POLYNOMIALS FOR THE FIRST DERIVATIVE FUNCTION

DIRECT AND INDIRECT LEAST SQUARES APPROXIMATING POLYNOMIALS FOR THE FIRST DERIVATIVE FUNCTION Applied Probability Trust (27 October 2016) DIRECT AND INDIRECT LEAST SQUARES APPROXIMATING POLYNOMIALS FOR THE FIRST DERIVATIVE FUNCTION T. VAN HECKE, Ghent University Abstract Finite difference methods

More information

Adaptive MMSE Equalizer with Optimum Tap-length and Decision Delay

Adaptive MMSE Equalizer with Optimum Tap-length and Decision Delay Adaptive MMSE Equalizer with Optimum Tap-length and Decision Delay Yu Gong, Xia Hong and Khalid F. Abu-Salim School of Systems Engineering The University of Reading, Reading RG6 6AY, UK E-mail: {y.gong,x.hong,k.f.abusalem}@reading.ac.uk

More information

Statistical Analysis of fmrl Data

Statistical Analysis of fmrl Data Statistical Analysis of fmrl Data F. Gregory Ashby The MIT Press Cambridge, Massachusetts London, England Preface xi Acronyms xv 1 Introduction 1 What Is fmri? 2 The Scanning Session 4 Experimental Design

More information

A Fast Algorithm for. Nonstationary Delay Estimation. H. C. So. Department of Electronic Engineering, City University of Hong Kong

A Fast Algorithm for. Nonstationary Delay Estimation. H. C. So. Department of Electronic Engineering, City University of Hong Kong A Fast Algorithm for Nonstationary Delay Estimation H. C. So Department of Electronic Engineering, City University of Hong Kong Tat Chee Avenue, Kowloon, Hong Kong Email : hcso@ee.cityu.edu.hk June 19,

More information

Z - Transform. It offers the techniques for digital filter design and frequency analysis of digital signals.

Z - Transform. It offers the techniques for digital filter design and frequency analysis of digital signals. Z - Transform The z-transform is a very important tool in describing and analyzing digital systems. It offers the techniques for digital filter design and frequency analysis of digital signals. Definition

More information

Chapter 9. Non-Parametric Density Function Estimation

Chapter 9. Non-Parametric Density Function Estimation 9-1 Density Estimation Version 1.1 Chapter 9 Non-Parametric Density Function Estimation 9.1. Introduction We have discussed several estimation techniques: method of moments, maximum likelihood, and least

More information

RADIO SYSTEMS ETIN15. Lecture no: Equalization. Ove Edfors, Department of Electrical and Information Technology

RADIO SYSTEMS ETIN15. Lecture no: Equalization. Ove Edfors, Department of Electrical and Information Technology RADIO SYSTEMS ETIN15 Lecture no: 8 Equalization Ove Edfors, Department of Electrical and Information Technology Ove.Edfors@eit.lth.se Contents Inter-symbol interference Linear equalizers Decision-feedback

More information

Economics 241B Estimation with Instruments

Economics 241B Estimation with Instruments Economics 241B Estimation with Instruments Measurement Error Measurement error is de ned as the error resulting from the measurement of a variable. At some level, every variable is measured with error.

More information

Comparison of DDE and ETDGE for. Time-Varying Delay Estimation. H. C. So. Department of Electronic Engineering, City University of Hong Kong

Comparison of DDE and ETDGE for. Time-Varying Delay Estimation. H. C. So. Department of Electronic Engineering, City University of Hong Kong Comparison of DDE and ETDGE for Time-Varying Delay Estimation H. C. So Department of Electronic Engineering, City University of Hong Kong Tat Chee Avenue, Kowloon, Hong Kong Email : hcso@ee.cityu.edu.hk

More information

Simple Estimators for Monotone Index Models

Simple Estimators for Monotone Index Models Simple Estimators for Monotone Index Models Hyungtaik Ahn Dongguk University, Hidehiko Ichimura University College London, James L. Powell University of California, Berkeley (powell@econ.berkeley.edu)

More information

The relation between memory and power-law exponent

The relation between memory and power-law exponent The relation between memory and power-law exponent Fangjian Guo and Tao Zhou December 2, 22 Abstract The inter-event time of many real systems are empirically found to be power-law distributed, and memory

More information

IMPLEMENTATION OF SIGNAL POWER ESTIMATION METHODS

IMPLEMENTATION OF SIGNAL POWER ESTIMATION METHODS IMPLEMENTATION OF SIGNAL POWER ESTIMATION METHODS Sei-Yeu Cheng and Joseph B. Evans Telecommunications & Information Sciences Laboratory Department of Electrical Engineering & Computer Science University

More information

8 The Discrete Fourier Transform (DFT)

8 The Discrete Fourier Transform (DFT) 8 The Discrete Fourier Transform (DFT) ² Discrete-Time Fourier Transform and Z-transform are de ned over in niteduration sequence. Both transforms are functions of continuous variables (ω and z). For nite-duration

More information

GENERALIZED DEFLATION ALGORITHMS FOR THE BLIND SOURCE-FACTOR SEPARATION OF MIMO-FIR CHANNELS. Mitsuru Kawamoto 1,2 and Yujiro Inouye 1

GENERALIZED DEFLATION ALGORITHMS FOR THE BLIND SOURCE-FACTOR SEPARATION OF MIMO-FIR CHANNELS. Mitsuru Kawamoto 1,2 and Yujiro Inouye 1 GENERALIZED DEFLATION ALGORITHMS FOR THE BLIND SOURCE-FACTOR SEPARATION OF MIMO-FIR CHANNELS Mitsuru Kawamoto,2 and Yuiro Inouye. Dept. of Electronic and Control Systems Engineering, Shimane University,

More information

The goal of the Wiener filter is to filter out noise that has corrupted a signal. It is based on a statistical approach.

The goal of the Wiener filter is to filter out noise that has corrupted a signal. It is based on a statistical approach. Wiener filter From Wikipedia, the free encyclopedia In signal processing, the Wiener filter is a filter proposed by Norbert Wiener during the 1940s and published in 1949. [1] Its purpose is to reduce the

More information

Initial condition issues on iterative learning control for non-linear systems with time delay

Initial condition issues on iterative learning control for non-linear systems with time delay Internationa l Journal of Systems Science, 1, volume, number 11, pages 15 ±175 Initial condition issues on iterative learning control for non-linear systems with time delay Mingxuan Sun and Danwei Wang*

More information

Department of Econometrics and Business Statistics

Department of Econometrics and Business Statistics ISSN 1440-771X Australia Department of Econometrics and Business Statistics http://www.buseco.monash.edu.au/depts/ebs/pubs/wpapers/ Exponential Smoothing: A Prediction Error Decomposition Principle Ralph

More information

Chapter 9. Non-Parametric Density Function Estimation

Chapter 9. Non-Parametric Density Function Estimation 9-1 Density Estimation Version 1.2 Chapter 9 Non-Parametric Density Function Estimation 9.1. Introduction We have discussed several estimation techniques: method of moments, maximum likelihood, and least

More information

Digital Signal Processing, Homework 1, Spring 2013, Prof. C.D. Chung

Digital Signal Processing, Homework 1, Spring 2013, Prof. C.D. Chung Digital Signal Processing, Homework, Spring 203, Prof. C.D. Chung. (0.5%) Page 99, Problem 2.2 (a) The impulse response h [n] of an LTI system is known to be zero, except in the interval N 0 n N. The input

More information

SOLVE LEAST ABSOLUTE VALUE REGRESSION PROBLEMS USING MODIFIED GOAL PROGRAMMING TECHNIQUES

SOLVE LEAST ABSOLUTE VALUE REGRESSION PROBLEMS USING MODIFIED GOAL PROGRAMMING TECHNIQUES Computers Ops Res. Vol. 25, No. 12, pp. 1137±1143, 1998 # 1998 Elsevier Science Ltd. All rights reserved Printed in Great Britain PII: S0305-0548(98)00016-1 0305-0548/98 $19.00 + 0.00 SOLVE LEAST ABSOLUTE

More information

MITIGATING UNCORRELATED PERIODIC DISTURBANCE IN NARROWBAND ACTIVE NOISE CONTROL SYSTEMS

MITIGATING UNCORRELATED PERIODIC DISTURBANCE IN NARROWBAND ACTIVE NOISE CONTROL SYSTEMS 17th European Signal Processing Conference (EUSIPCO 29) Glasgow, Scotland, August 24-28, 29 MITIGATING UNCORRELATED PERIODIC DISTURBANCE IN NARROWBAND ACTIVE NOISE CONTROL SYSTEMS Muhammad Tahir AKHTAR

More information

Optimal Polynomial Control for Discrete-Time Systems

Optimal Polynomial Control for Discrete-Time Systems 1 Optimal Polynomial Control for Discrete-Time Systems Prof Guy Beale Electrical and Computer Engineering Department George Mason University Fairfax, Virginia Correspondence concerning this paper should

More information

The Missing-Index Problem in Process Control

The Missing-Index Problem in Process Control The Missing-Index Problem in Process Control Joseph G. Voelkel CQAS, KGCOE, RIT October 2009 Voelkel (RIT) Missing-Index Problem 10/09 1 / 35 Topics 1 Examples Introduction to the Problem 2 Models, Inference,

More information

Spread, estimators and nuisance parameters

Spread, estimators and nuisance parameters Bernoulli 3(3), 1997, 323±328 Spread, estimators and nuisance parameters EDWIN. VAN DEN HEUVEL and CHIS A.J. KLAASSEN Department of Mathematics and Institute for Business and Industrial Statistics, University

More information

Gaussian process for nonstationary time series prediction

Gaussian process for nonstationary time series prediction Computational Statistics & Data Analysis 47 (2004) 705 712 www.elsevier.com/locate/csda Gaussian process for nonstationary time series prediction Soane Brahim-Belhouari, Amine Bermak EEE Department, Hong

More information

Echo cancellation by deforming sound waves through inverse convolution R. Ay 1 ward DeywrfmzMf o/ D/g 0001, Gauteng, South Africa

Echo cancellation by deforming sound waves through inverse convolution R. Ay 1 ward DeywrfmzMf o/ D/g 0001, Gauteng, South Africa Echo cancellation by deforming sound waves through inverse convolution R. Ay 1 ward DeywrfmzMf o/ D/g 0001, Gauteng, South Africa Abstract This study concerns the mathematical modelling of speech related

More information

A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION

A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION A METHOD OF ADAPTATION BETWEEN STEEPEST- DESCENT AND NEWTON S ALGORITHM FOR MULTI- CHANNEL ACTIVE CONTROL OF TONAL NOISE AND VIBRATION Jordan Cheer and Stephen Daley Institute of Sound and Vibration Research,

More information

4.0 Update Algorithms For Linear Closed-Loop Systems

4.0 Update Algorithms For Linear Closed-Loop Systems 4. Update Algorithms For Linear Closed-Loop Systems A controller design methodology has been developed that combines an adaptive finite impulse response (FIR) filter with feedback. FIR filters are used

More information

Riccati difference equations to non linear extended Kalman filter constraints

Riccati difference equations to non linear extended Kalman filter constraints International Journal of Scientific & Engineering Research Volume 3, Issue 12, December-2012 1 Riccati difference equations to non linear extended Kalman filter constraints Abstract Elizabeth.S 1 & Jothilakshmi.R

More information

Hilbert Transforms in Signal Processing

Hilbert Transforms in Signal Processing Hilbert Transforms in Signal Processing Stefan L. Hahn Artech House Boston London Contents Preface xiii Introduction 1 Chapter 1 Theory of the One-Dimensional Hilbert Transformation 3 1.1 The Concepts

More information

Chapter 7 Interconnected Systems and Feedback: Well-Posedness, Stability, and Performance 7. Introduction Feedback control is a powerful approach to o

Chapter 7 Interconnected Systems and Feedback: Well-Posedness, Stability, and Performance 7. Introduction Feedback control is a powerful approach to o Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology c Chapter 7 Interconnected

More information

5.1 Least-Squares Line

5.1 Least-Squares Line 252 CHAP. 5 CURVE FITTING 5.1 Least-Squares Line In science and engineering it is often the case that an experiment produces a set of data points (x 1, y 1 ),...,(x N, y N ), where the abscissas {x k }

More information

Nonparametric Methods

Nonparametric Methods Nonparametric Methods Michael R. Roberts Department of Finance The Wharton School University of Pennsylvania July 28, 2009 Michael R. Roberts Nonparametric Methods 1/42 Overview Great for data analysis

More information

Parametric Inference on Strong Dependence

Parametric Inference on Strong Dependence Parametric Inference on Strong Dependence Peter M. Robinson London School of Economics Based on joint work with Javier Hualde: Javier Hualde and Peter M. Robinson: Gaussian Pseudo-Maximum Likelihood Estimation

More information

Mobile Robot Localization

Mobile Robot Localization Mobile Robot Localization 1 The Problem of Robot Localization Given a map of the environment, how can a robot determine its pose (planar coordinates + orientation)? Two sources of uncertainty: - observations

More information

Discussion of "Noisy News in Business Cycle" by Forni, Gambetti, Lippi, and Sala

Discussion of Noisy News in Business Cycle by Forni, Gambetti, Lippi, and Sala Judgement Discussion of Cycle" by Università degli Studi Milano - Bicocca IV International Conference in memory of Carlo Giannini Judgement Great contribution in the literature of NEWS and NOISE shocks:

More information

2 Formulation. = arg = 2 (1)

2 Formulation. = arg = 2 (1) Acoustic di raction by an impedance wedge Aladin H. Kamel (alaahassan.kamel@yahoo.com) PO Box 433 Heliopolis Center 11757, Cairo, Egypt Abstract. We consider the boundary-value problem for the Helmholtz

More information

Separating Magnitude Response into Real and Imaginary Parts by Mellin Convolution Filters

Separating Magnitude Response into Real and Imaginary Parts by Mellin Convolution Filters Separating Magnitude Response into Real and Imaginary Parts by Mellin Convolution Filters VAIRIS SHTRAUSS ALDIS KALPINSH ULDIS LOMANOVSKIS Institute for Material Mechanics University of Latvia 3 Aizkraukles

More information

Confidence Intervals of the Simple Difference between the Proportions of a Primary Infection and a Secondary Infection, Given the Primary Infection

Confidence Intervals of the Simple Difference between the Proportions of a Primary Infection and a Secondary Infection, Given the Primary Infection Biometrical Journal 42 (2000) 1, 59±69 Confidence Intervals of the Simple Difference between the Proportions of a Primary Infection and a Secondary Infection, Given the Primary Infection Kung-Jong Lui

More information

"ZERO-POINT" IN THE EVALUATION OF MARTENS HARDNESS UNCERTAINTY

ZERO-POINT IN THE EVALUATION OF MARTENS HARDNESS UNCERTAINTY "ZERO-POINT" IN THE EVALUATION OF MARTENS HARDNESS UNCERTAINTY Professor Giulio Barbato, PhD Student Gabriele Brondino, Researcher Maurizio Galetto, Professor Grazia Vicario Politecnico di Torino Abstract

More information

Epistemic independence for imprecise probabilities

Epistemic independence for imprecise probabilities International Journal of Approximate Reasoning 24 (2000) 235±250 www.elsevier.com/locate/ijar Epistemic independence for imprecise probabilities Paolo Vicig Dipartimento di Matematica Applicata ``B. de

More information

Notes on Time Series Modeling

Notes on Time Series Modeling Notes on Time Series Modeling Garey Ramey University of California, San Diego January 17 1 Stationary processes De nition A stochastic process is any set of random variables y t indexed by t T : fy t g

More information

Descriptive Data Summarization

Descriptive Data Summarization Descriptive Data Summarization Descriptive data summarization gives the general characteristics of the data and identify the presence of noise or outliers, which is useful for successful data cleaning

More information

AN ALTERNATIVE FEEDBACK STRUCTURE FOR THE ADAPTIVE ACTIVE CONTROL OF PERIODIC AND TIME-VARYING PERIODIC DISTURBANCES

AN ALTERNATIVE FEEDBACK STRUCTURE FOR THE ADAPTIVE ACTIVE CONTROL OF PERIODIC AND TIME-VARYING PERIODIC DISTURBANCES Journal of Sound and Vibration (1998) 21(4), 517527 AN ALTERNATIVE FEEDBACK STRUCTURE FOR THE ADAPTIVE ACTIVE CONTROL OF PERIODIC AND TIME-VARYING PERIODIC DISTURBANCES M. BOUCHARD Mechanical Engineering

More information

VECTORS. 3-1 What is Physics? 3-2 Vectors and Scalars CHAPTER

VECTORS. 3-1 What is Physics? 3-2 Vectors and Scalars CHAPTER CHAPTER 3 VECTORS 3-1 What is Physics? Physics deals with a great many quantities that have both size and direction, and it needs a special mathematical language the language of vectors to describe those

More information

Lecture Note 2: Estimation and Information Theory

Lecture Note 2: Estimation and Information Theory Univ. of Michigan - NAME 568/EECS 568/ROB 530 Winter 2018 Lecture Note 2: Estimation and Information Theory Lecturer: Maani Ghaffari Jadidi Date: April 6, 2018 2.1 Estimation A static estimation problem

More information

Magnitude F y. F x. Magnitude

Magnitude F y. F x. Magnitude Design of Optimum Multi-Dimensional Energy Compaction Filters N. Damera-Venkata J. Tuqan B. L. Evans Imaging Technology Dept. Dept. of ECE Dept. of ECE Hewlett-Packard Labs Univ. of California Univ. of

More information

EMPIRICAL EVALUATION OF DATA-BASED DENSITY ESTIMATION

EMPIRICAL EVALUATION OF DATA-BASED DENSITY ESTIMATION Proceedings of the 2006 Winter Simulation Conference L. F. Perrone, F. P. Wieland, J. Liu, B. G. Lawson, D. M. Nicol, and R. M. Fujimoto, eds. EMPIRICAL EVALUATION OF DATA-BASED DENSITY ESTIMATION E. Jack

More information

Equivalence of several methods for decomposing time series into permananent and transitory components

Equivalence of several methods for decomposing time series into permananent and transitory components Equivalence of several methods for decomposing time series into permananent and transitory components Don Harding Department of Economics and Finance LaTrobe University, Bundoora Victoria 3086 and Centre

More information

Vector analysis and vector identities by means of cartesian tensors

Vector analysis and vector identities by means of cartesian tensors Vector analysis and vector identities by means of cartesian tensors Kenneth H. Carpenter August 29, 2001 1 The cartesian tensor concept 1.1 Introduction The cartesian tensor approach to vector analysis

More information

Construction of `Wachspress type' rational basis functions over rectangles

Construction of `Wachspress type' rational basis functions over rectangles Proc. Indian Acad. Sci. (Math. Sci.), Vol. 110, No. 1, February 2000, pp. 69±77. # Printed in India Construction of `Wachspress type' rational basis functions over rectangles P L POWAR and S S RANA Department

More information

Digital Signal Processing

Digital Signal Processing COMP ENG 4TL4: Digital Signal Processing Notes for Lecture #21 Friday, October 24, 2003 Types of causal FIR (generalized) linear-phase filters: Type I: Symmetric impulse response: with order M an even

More information

Analysis methods for fault trees that contain secondary failures

Analysis methods for fault trees that contain secondary failures Loughborough University Institutional Repository Analysis methods for fault trees that contain secondary failures This item was submitted to Loughborough University's Institutional Repository by the/an

More information

Managing Uncertainty

Managing Uncertainty Managing Uncertainty Bayesian Linear Regression and Kalman Filter December 4, 2017 Objectives The goal of this lab is multiple: 1. First it is a reminder of some central elementary notions of Bayesian

More information

arxiv: v1 [cs.sd] 28 Feb 2017

arxiv: v1 [cs.sd] 28 Feb 2017 Nonlinear Volterra Model of a Loudspeaker Behavior Based on Laser Doppler Vibrometry Alessandro Loriga, Parvin Moyassari, and Daniele Bernardini Intranet Standard GmbH, Ottostrasse 3, 80333 Munich, Germany

More information

Design of Higher Order LP and HP Digital IIR Filter Using the Concept of Teaching-Learning Based Optimization

Design of Higher Order LP and HP Digital IIR Filter Using the Concept of Teaching-Learning Based Optimization Design of Higher Order LP and HP Digital IIR Filter Using the Concept of Teaching-Learning Based Optimization DAMANPREET SINGH, J.S. DHILLON Department of Computer Science & Engineering Department of Electrical

More information

CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation

CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation CS 534: Computer Vision Segmentation III Statistical Nonparametric Methods for Segmentation Ahmed Elgammal Dept of Computer Science CS 534 Segmentation III- Nonparametric Methods - - 1 Outlines Density

More information

Chapter 1. GMM: Basic Concepts

Chapter 1. GMM: Basic Concepts Chapter 1. GMM: Basic Concepts Contents 1 Motivating Examples 1 1.1 Instrumental variable estimator....................... 1 1.2 Estimating parameters in monetary policy rules.............. 2 1.3 Estimating

More information

A Comparison between Linear and Nonlinear Forecasts for Nonlinear AR Models

A Comparison between Linear and Nonlinear Forecasts for Nonlinear AR Models JOURNAL OF FORECASTING, VOL. 6, 49±508 (997) A Comparison between Linear and Nonlinear Forecasts for Nonlinear AR Models MEIHUI GUO* AND Y. K. TSENG National Sun Yat-sen University, Taiwan, ROC ABSTRACT

More information

Error Entropy Criterion in Echo State Network Training

Error Entropy Criterion in Echo State Network Training Error Entropy Criterion in Echo State Network Training Levy Boccato 1, Daniel G. Silva 1, Denis Fantinato 1, Kenji Nose Filho 1, Rafael Ferrari 1, Romis Attux 1, Aline Neves 2, Jugurta Montalvão 3 and

More information

Context-dependent spatial analysis: A role for GIS?

Context-dependent spatial analysis: A role for GIS? J Geograph Syst (2000) 2:71±76 ( Springer-Verlag 2000 Context-dependent spatial analysis: A role for GIS? A. Stewart Fotheringham Department of Geography, University of Newcastle, Newcastle-upon-Tyne NE1

More information

ECON 7335 INFORMATION, LEARNING AND EXPECTATIONS IN MACRO LECTURE 1: BASICS. 1. Bayes Rule. p(b j A)p(A) p(b)

ECON 7335 INFORMATION, LEARNING AND EXPECTATIONS IN MACRO LECTURE 1: BASICS. 1. Bayes Rule. p(b j A)p(A) p(b) ECON 7335 INFORMATION, LEARNING AND EXPECTATIONS IN MACRO LECTURE : BASICS KRISTOFFER P. NIMARK. Bayes Rule De nition. Bayes Rule. The probability of event A occurring conditional on the event B having

More information

Reliability of uncertain dynamical systems with multiple design points

Reliability of uncertain dynamical systems with multiple design points Structural Safety 21 (1999) 113±133 www.elsevier.nl/locate/strusafe Reliability of uncertain dynamical systems with multiple design points S.K. Au, C. Papadimitriou, J.L. Beck* Division of Engineering

More information