TIME-DELAY ESTIMATION USING FARROW-BASED FRACTIONAL-DELAY FIR FILTERS: FILTER APPROXIMATION VS. ESTIMATION ERRORS
|
|
- Jonathan Lane
- 5 years ago
- Views:
Transcription
1 TIME-DEAY ESTIMATION USING FARROW-BASED FRACTIONA-DEAY FIR FITERS: FITER APPROXIMATION VS. ESTIMATION ERRORS Mattias Olsson, Håkan Johansson, an Per öwenborg Div. of Electronic Systems, Dept. of Electrical Engineering, inköpings universitet Campus Valla, SE-58 8 inköping, Sween phone: , {matol, hakanj, perl}@isy.liu.se web: ABSTRACT This paper provies error analysis regaring filter approximation errors versus estimation errors when utilizing Farrowbase fractional-elay filters for time-elay estimation. Further, a new technique is introuce which works on batches of samples an utilizes the Newton-Raphson technique for fining the minimum of the corresponing cost function.. INTRODUCTION The nee for estimating time-elays between two signals arises in many ifferent fiels, incluing biomeicine, communications, geophysics, raar, an ultrasonics. In [], a technique utilizing Farrow-base igital fractional-elay (FD) filters [] was introuce for this purpose. The use of Farrow-base FD filters has two major avantages over other elay estimation techniques working in the igital omain. First, it is eminently suitable to hanle elays that are fractions of the sampling interval. This is in contrast to cross correlation-base methos that require aitional interpolation []. Secon, it can hanle general banlimite signals. This is in contrast to techniques that assume a known input signal, like a sinusoial signal [4]. In [], the iea of using Farrow-base FD filters for elay-estimation was propose. However, no analysis was provie as to filter approximation error versus estimation error. Such an analysis will be provie in this paper. Furthermore, a new technique is introuce that works on batches of samples an utilizes the Newton-Raphson technique for fining the minimum of the corresponing cost function. Since the fractional elay of Farrow-base FD filters is governe by only one parameter, analytical erivatives can be erive for this purpose. Thereby, the problems associate with the use of numerical erivatives are avoie. Following this introuction, Section will provie a short introuction to time-elay estimation using FD filters, followe by a presentation of the elay-estimation technique in Section an an error analysis in Section 4. In Section 5 we write FD filter esign an in Section 6 we verify the error analysis. Finally some conclusions are rawn.. TIME-DEAY ESTIMATION USING FD FITERS Two (or more) iscrete-time signals, originally coming from one source, might experience ifferent elays. We moel this as x(n) = x a (nt)+e () v(n) = x a (nt T)+e () F The cost function F for =.5 an w =π/ Figure : Example of the cost function F for a sinus input with =.5. where is the unknown ifference in elay between the signals, T is the sampling perio an e an e are uncorrelate aitive noise. We assume that the elay is a fraction of T an that any integer sample elay has alreay been taken care of in a proper manner. Now, let v(n) act as a reference signal an let the other signal x(n) pass through a FD filter generating the output y(n, ) [see (7)]. The average square ifference function (ASDF) F() for a certain elay over a batch of N samples can then be written as F() = N n +N (y(n,) v(n)). () n=n An estimate of the unknown fractional elay in the reference signal can then be compute by minimizing F as = argmin F(). (4) An example of this cost function F for a sinusoial input can be seen in Fig.. Ieally, the function woul be equal to sin ( ω( ) ), which is approximately square for small, however, if noise, magnitue errors, elay errors, etc, are present, it will eviate from the square shape. Due to lack of space, the effect of noise is not inclue in this paper. It will not affect the filter approximation error vs. estimation error which is in focus in this paper. The noise can be reuce to a level that is negliable compare to the filter approximation error by increasing the batch length N.
2 upate equation is here n+ = n + F ( n ) F ( n ) (9) Figure : The moifie Farrow-base FD Filter where G k (z) are linear-phase FIR filters. In an implementation elays must ae to make sure the elay is equal for all the subfilters.. PROPOSED TIME-DEAY ESTIMATOR. Farrow-Base FD Filters The esire frequency response of an FD filter is H es (e jωt,) = e j(d+)ωt, ωt < ω c T < π (5) where D is an integer elay an is a subsample (fractional) elay. In practice an approximation of (5), esigne for frequencies up to ω c T, is use. The FD filters in this paper make use of the moifie Farrow structure shown in Fig. [5], [6] which is a moification of the original Farrow structure [] in that the subfilters G k (z) are linear-phase FIR filters. The avantage of using linear-phase filters is that their impulse responses are symmetrical an can be implemente with fewer multiplications. The overall transfer function can thus be written as H(z) = k= k G k (z) (6) where G k (z) are linear-phase FIR filters of either o or even orer, say M k, an with symmetric (anti-symmetric) impulse responses g k (n) for k even (k o), i.e., g k (n) = g k (M k n) [g k (n) = g k (M k n)] for k even (k o) [7]. When is fixe, the overall filter approximates an allpass filter with the fractional elay, provie that the subfilters have been esigne in a proper manner [5], [6]. The output y(n,) from the FD filter in Fig. can be written as where y(n,) = k= k y k (n). (7) y k (n) = g k (n) x(n). (8) In this paper, it is assume that the orer M = max{m k } is even. The reason is that the elay of H(z) is then an integer, D = M/, when =. This is suitable for the timeelay estimation problem. The filter is normally optimize for.5 to cover one sampling interval.. The Estimator To fin the minimum of F with respect to, the well-known Newton Raphson (NR) algorithm is use. The algorithm is iterative an tens towars the closest zero of a oneimensional function, in this case the erivative of F. The where F () an F () are the erivatives of F(). The principle of the estimator is epicte in Fig.. Compare to the common east-mean-square (MS) algorithm we o not nee to specify a step length since it is compute explicitly as /F ( n ). For a perfectly quaratic function this step length is optimal an only one iteration is neee. However, in a real situation, a few more iterations are neee. Each new iteration can use a new batch of samples N or the same batch, epening on the amount of memory at han an if the estimation is run on-line or off-line. To be able to calculate the next iterative estimate in (9), the first an secon erivatives of F(n,) with respect to are neee, which can be calculate as an F () = N n +N (y(n,) v(n))y (n,) () n=n F () = n +N N (y(n,) v(n))y (n,)+(y (n,)). n=n () When a Farrow-base FD-filter is use, the erivatives of (7) can be calculate analytically as an y (n,) = y (n,) = k= k k y k (n) () k(k ) k y k (n), () respectively. In Fig. 4, a straightforwar implementation of the erivatives () an () can be seen. Note that the subfilters G k (z) only have to be use once. Since a Farrow-base FD filer is an approximation of the ieal response in (5), the approximation errors will affect the estimator performance. In the next section we will investigate the performance of the algorithm when the FD filter is not ieal. 4. APPROXIMATION ERROR VS. ESTIMATION ERROR We moel the non-ieal FD filter as H(e jω,) = (+δ(ω,))e jω(d++ (ω,)) (4) where δ(,ω) enotes the magnitue error an (,ω) enotes the elay error of the FD filter for a certain fractional elay an a certain angular frequency ω. D is the integer elay of the FD-filter. This is a formulation which is general for all types of FD filters, not just the Farrow-base FD filter use in this paper, an the resulting expressions in this section is hence inepenent of the FD filter type. In Section 5, expressions specific for Farrow-base FD filters are erive.
3 Figure : The principle of the propose estimator. Accumulator F () x(n) G (z) G (z) G (z) G (z) y (n) y (n) y (n) y (n) v(n) y(n,) Aer Aer (.) Aer xx ( ) Accumulator F () G (z) y (n) Figure 4: A straightforwar implementation of the erivatives. Now, if we assume that x(n) is sinusoial (for the choice of signal see the conclusions), the output from the FD filter at a frequency ω is y(n,) = (+δ)sin(ω (n )) (5) an the reference signal v(n) is v(n) = sin(ω (n )). (6) Henceforth, the epenence of δ an δ on an ω will be omitte in the notation for the sake of clarity. After inserting (5) an (6) into () an some simplifications we arrive at F (ω,) = δ [(+δ) cos(ω( + ))]+ +(+δ)ω(+ )sin(ω( + ))+ [ (+δ)ω (+ )sin(ω ( ( + + )+ϕ) N (+δ) ω (+ )sin(ω ( ( + )+ϕ)+ + δ cos(ω ( ( + + )+ϕ) (+δ)δ cos(ω ( (+ )+ϕ) ] sin(nω ) sin(ω ) = F (ω,)+f N(ω,) (7) where F oes not epen on the batch length N an F N contains the terms that o. At the minimum of F, as we will see later, + will be close to. Using this fact we can rewrite F N as F N(ω,) + = = δ sin(nω ) N sin(ω ) [ (+δ)ω (+ ) sin(ω ( + N ))+δ cos(ω ( + N )) ]. (8) Since δ an δ usually are very small, (8) will be small even for a small N. However, when ω tens towars, (8) will ten towars δ δ, inepenently of N. The iterative Newton-Raphson algorithm in (9) will, if the function is behaving well, converge towars the zero of F. If we assume that N is so large that F N can be approximate as zero for all an ω, it can be seen from (7) that if δ an are zero, F will be zero when =, irrespective of δ. On the other han, if δ is small, but not zero, the effect of a constant magnitue error δ will affect the estimator. The effect of a elay error erivative is normally neglible since it tens to be small compare to. Unfortunately, it is impossible to irectly from (7) analytically fin the that makes F zero. It can be one numerically an to fin an approximation of the estimation error we o a first-orer Taylor expansion of the sine an cosine in F an write it as F δ (δ + ω ( + ) ) (+δ)(+ )ω ( + ) (9)
4 If + an +δ are approximate by, we can solve for err an get err δ + ω δ ω (δ ) δ. () This expression can be use to preict the final estimation error. The first part becomes small when ω is large compare to (δ ) δ an the error will then be ominate by. For small ω, if δ or δ are not zero, the error eviates more an more from. If = the error becomes err =. 5. FITER DESIGN As was seen in (7) the main error source is the elay error which irectly affects the estimate. However, when the erivative of the magnitue error, δ, is nonzero the magnitue error δ an the frequency ω will come into effect. To fin an FD filter which is optimize for small estimation errors, the expression in () can be use as cost function in an optimization problem. The optimization problem can for example be formulate as a minimax problem Simulate error x 6. Simulate estimator error, N= ω x 5. Simulate estimator error, N= Figure 5: The simulate estimation error for N = an N = samples.. < ω < π/. Simulate error ω. minimize ε subject to err (ω,) < ε () which is then optimize over a range of angular frequencies ω k an elays k. Thefminimax-routine in MATAB efficiently implements a sequential quaratic programming metho that is capable of solving the minimax constraint problem in (). However, the solution is not guarantee to be the global minimum as the problem is nonlinear. The erivative of δ, which is neee to calculate the expecte estimation error, can be foun analytically by noting that the magnitue of the Farrow-base FD filter can be written as H(,e jωt ) = / k= k G (k)r (ωt)+ (+)/ + j k G (k )R (ωt) = A()+ jb() = +δ () where G (k)r an G (k )R are the zero phase frequency responses for the even-orer linear-phase FIR filters with impulse responses g k (n). Since the erivative of the magnitue is equal to the erivative of the magnitue error we can calculate δ as δ = A()A ()+B()B () A() + B() () where A () an B () can be calculate as an / A () = (+)/ B () = k k G (k)r (ωt) (4) (k ) k G (k )R (ωt). (5) Figure 6: The expecte error..π < ω < π/. 6. PERFORMANCE OF THE ESTIMATION ERROR PREDICTION To verify the error analysis, a number of simulations were performe. An FD filter with = 7 subfilters was optimize for minimal error up to the frequency ω = π/. The resulting even-orer subfilters ha orers M k ranging from 8 to 8. The maximum magnitue error was δ max =.8 4, the maximum elay error was max =.68 5 an the maximum erivative of the elay error was max =. 4. In Fig. 5 the simulate estimation error for N = an N = samples can be seen. As preicte by () the estimation error increases for ecreasing frequencies when there is a magnitue error. The reason for the lower performance for N = samples is that N must be larger for the variance of F N to become small, especially when δ an δ are relatively large, which they ten to be for small ω an large. In Fig. 6 the expecte error err can be seen. Compare to the simulate error in Fig. 5 a smaller frequency range has been use to enhance the etails.
5 Difference x Difference between expecte an simulate error, N=.. Figure 7: The ifference between the expecte estimation error an the simulate error, N =..π < ω < π/. Difference x Figure 8: The ifference between the expecte estimation error an the simulate error, N =..π < ω < π/. When err was erive we omitte F N, assuming that N is infinite or at least large enough. If the batch size N is ecrease the expecte estimation error will increase, which can be seen in Fig. 7 an 8. As expecte, the ifference between the estimate error an the simulate error is increase when N becomes smaller so that F N no longer can be approximate to be zero. For N = samples the estimator still performs quite well, see Fig. 5, but the expecte error err no longer works as a goo estimation of the actual error since the expecte error is almost as large as the actual ifference between the simulate an expecte error. This is ω. ω.... because for small N noise an the variance of F N will ominate, while for large N the filter approximation errors will ominate. 7. CONCUSIONS We have presente a novel metho to estimate the elay error between two sets of samples using a FD filter. The iea is to use an iterative, Newton-Raphson-base, estimator to minimize the mean-square-ifference between a reference signal an a signal with an unknown elay. The effects of a nonieal FD filter with magnitue an elay errors have been stuie theoretically an in simulations. An expression of the expecte estimation error err was erive, which can be use to optimize the FD filter in the estimator for a minumum estimation error. The expecte estimation error err is a bias, or in other wors, the best one we can achieve without noise, i.e when N. In the analysis we have assume a single sinusoi, but the time elay estimator can be use for more general banlimite signals. However, in this case, the estimation error will iffer from the case where a sinusoial is use. The analysis one in this paper is still useful since it gives an insight into errors cause by the nonieal interpolation performe by the fractional-elay filters. Aitionally, in some applications where the training sequence may be chosen freely we can actually choose a sinusoi an achieve the limits compute in this paper. The time-elay estimation metho can easily be extene to more sets of samples, using one set as the reference, which coul be useful e.g. in the calibration of time-interleave analog-to-igital-converters (TIADCs). REFERENCES [] S. R. Dooley an A. K. Nani, On explicit time elay estimation using the Farrow structure, Signal Processing, vol. 7, pp. 5 57, 999. [] C. W. Farrow, A continously variable igital elay element, in Proc. IEEE Int. Symp. Circuits & Syst., June , vol., pp [] J. O. Smith an B. Frielaner, Aaptive interpolate time-elay estimation, IEEE Trans. Aerospace, Electronic Syst., vol. AES-, no., pp. 8 99, Mar 985. [4] D.. Maskell an G. S. Woos, The iscrete-time quarature subsample estimation of elay, IEEE Trans. Instrum. Meas., vol. 5, no., pp. 7, Feb. [5] J. Vesma an T. Saramäki, Optimization an efficient implementation of FIR filters with ajustable fractional elay, in Proc. IEEE Int. Symp. Circuits Syst., June 9 997, vol. IV, pp [6] H. Johansson an P. öwenborg, On the esign of ajustable fractional elay FIR filters, IEEE Trans. on Circuits an Syst. II: Analog an Digital Signal Processing, vol. 5, no. 4, pp , Apr.
Adjustable Fractional-Delay Filters Utilizing the Farrow Structure and Multirate Techniques
Ajustable Fractional-Delay Filters Utilizing the Farrow Structure an Multirate Techniques Håkan Johansson (hakanj@isy.liu.se)* an Ewa Hermanowicz (hewa@eti.pg.ga.pl)** *Division of Electronics Systems,
More informationDIGITAL FILTER FOR QUADRATURE SUB-SAMPLE DELAY ESTIMATION
DIGITAL FILTER FOR QUADRATURE SUB-SAMPLE DELAY ESTIMATIO Ewa Hermanowic Multimeia Systems Department, Faculty of Electronics, Telecommunications an Informatics Gans University of Technology, Gans, Polan
More informationAN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD. Mathcad Release 14. Khyruddin Akbar Ansari, Ph.D., P.E.
AN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD Mathca Release 14 Khyruin Akbar Ansari, Ph.D., P.E. Professor of Mechanical Engineering School of Engineering an Applie Science Gonzaga University SDC
More informationImplicit Differentiation
Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,
More informationAN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD. Mathcad Release 13. Khyruddin Akbar Ansari, Ph.D., P.E.
AN INTRODUCTION TO NUMERICAL METHODS USING MATHCAD Mathca Release 13 Khyruin Akbar Ansari, Ph.D., P.E. Professor of Mechanical Engineering School of Engineering Gonzaga University SDC PUBLICATIONS Schroff
More informationA Course in Machine Learning
A Course in Machine Learning Hal Daumé III 12 EFFICIENT LEARNING So far, our focus has been on moels of learning an basic algorithms for those moels. We have not place much emphasis on how to learn quickly.
More informationLinear First-Order Equations
5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)
More informationECE 422 Power System Operations & Planning 7 Transient Stability
ECE 4 Power System Operations & Planning 7 Transient Stability Spring 5 Instructor: Kai Sun References Saaat s Chapter.5 ~. EPRI Tutorial s Chapter 7 Kunur s Chapter 3 Transient Stability The ability of
More informationDigital Signal Processing II Lecture 2: FIR & IIR Filter Design
Digital Signal Processing II Lecture : FIR & IIR Filter Design Marc Moonen Dept EE/ESAT, KULeuven marcmoonen@esatuleuvenbe wwwesatuleuvenbe/sc/ DSP-II p PART-I : Filter Design/Realiation Step- : efine
More informationAdmin BACKPROPAGATION. Neural network. Neural network 11/3/16. Assignment 7. Assignment 8 Goals today. David Kauchak CS158 Fall 2016
Amin Assignment 7 Assignment 8 Goals toay BACKPROPAGATION Davi Kauchak CS58 Fall 206 Neural network Neural network inputs inputs some inputs are provie/ entere Iniviual perceptrons/ neurons Neural network
More informationThe derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)
Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)
More informationQuantum Mechanics in Three Dimensions
Physics 342 Lecture 20 Quantum Mechanics in Three Dimensions Lecture 20 Physics 342 Quantum Mechanics I Monay, March 24th, 2008 We begin our spherical solutions with the simplest possible case zero potential.
More informationThe Press-Schechter mass function
The Press-Schechter mass function To state the obvious: It is important to relate our theories to what we can observe. We have looke at linear perturbation theory, an we have consiere a simple moel for
More informationCascaded redundancy reduction
Network: Comput. Neural Syst. 9 (1998) 73 84. Printe in the UK PII: S0954-898X(98)88342-5 Cascae reunancy reuction Virginia R e Sa an Geoffrey E Hinton Department of Computer Science, University of Toronto,
More informationImage Denoising Using Spatial Adaptive Thresholding
International Journal of Engineering Technology, Management an Applie Sciences Image Denoising Using Spatial Aaptive Thresholing Raneesh Mishra M. Tech Stuent, Department of Electronics & Communication,
More informationWe G Model Reduction Approaches for Solution of Wave Equations for Multiple Frequencies
We G15 5 Moel Reuction Approaches for Solution of Wave Equations for Multiple Frequencies M.Y. Zaslavsky (Schlumberger-Doll Research Center), R.F. Remis* (Delft University) & V.L. Druskin (Schlumberger-Doll
More informationSurvey Sampling. 1 Design-based Inference. Kosuke Imai Department of Politics, Princeton University. February 19, 2013
Survey Sampling Kosuke Imai Department of Politics, Princeton University February 19, 2013 Survey sampling is one of the most commonly use ata collection methos for social scientists. We begin by escribing
More informationLectures - Week 10 Introduction to Ordinary Differential Equations (ODES) First Order Linear ODEs
Lectures - Week 10 Introuction to Orinary Differential Equations (ODES) First Orer Linear ODEs When stuying ODEs we are consiering functions of one inepenent variable, e.g., f(x), where x is the inepenent
More informationThe Principle of Least Action
Chapter 7. The Principle of Least Action 7.1 Force Methos vs. Energy Methos We have so far stuie two istinct ways of analyzing physics problems: force methos, basically consisting of the application of
More informationOptimization of Geometries by Energy Minimization
Optimization of Geometries by Energy Minimization by Tracy P. Hamilton Department of Chemistry University of Alabama at Birmingham Birmingham, AL 3594-140 hamilton@uab.eu Copyright Tracy P. Hamilton, 1997.
More informationA Review of Multiple Try MCMC algorithms for Signal Processing
A Review of Multiple Try MCMC algorithms for Signal Processing Luca Martino Image Processing Lab., Universitat e València (Spain) Universia Carlos III e Mari, Leganes (Spain) Abstract Many applications
More informationLinear and quadratic approximation
Linear an quaratic approximation November 11, 2013 Definition: Suppose f is a function that is ifferentiable on an interval I containing the point a. The linear approximation to f at a is the linear function
More informationLecture 2 Lagrangian formulation of classical mechanics Mechanics
Lecture Lagrangian formulation of classical mechanics 70.00 Mechanics Principle of stationary action MATH-GA To specify a motion uniquely in classical mechanics, it suffices to give, at some time t 0,
More informationComputing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions
Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5
More information2Algebraic ONLINE PAGE PROOFS. foundations
Algebraic founations. Kick off with CAS. Algebraic skills.3 Pascal s triangle an binomial expansions.4 The binomial theorem.5 Sets of real numbers.6 Surs.7 Review . Kick off with CAS Playing lotto Using
More informationA Novel Decoupled Iterative Method for Deep-Submicron MOSFET RF Circuit Simulation
A Novel ecouple Iterative Metho for eep-submicron MOSFET RF Circuit Simulation CHUAN-SHENG WANG an YIMING LI epartment of Mathematics, National Tsing Hua University, National Nano evice Laboratories, an
More informationAPPROXIMATE SOLUTION FOR TRANSIENT HEAT TRANSFER IN STATIC TURBULENT HE II. B. Baudouy. CEA/Saclay, DSM/DAPNIA/STCM Gif-sur-Yvette Cedex, France
APPROXIMAE SOLUION FOR RANSIEN HEA RANSFER IN SAIC URBULEN HE II B. Bauouy CEA/Saclay, DSM/DAPNIA/SCM 91191 Gif-sur-Yvette Ceex, France ABSRAC Analytical solution in one imension of the heat iffusion equation
More informationLecture 6: Control of Three-Phase Inverters
Yoash Levron The Anrew an Erna Viterbi Faculty of Electrical Engineering, Technion Israel Institute of Technology, Haifa 323, Israel yoashl@ee.technion.ac.il Juri Belikov Department of Computer Systems,
More informationθ x = f ( x,t) could be written as
9. Higher orer PDEs as systems of first-orer PDEs. Hyperbolic systems. For PDEs, as for ODEs, we may reuce the orer by efining new epenent variables. For example, in the case of the wave equation, (1)
More informationText S1: Simulation models and detailed method for early warning signal calculation
1 Text S1: Simulation moels an etaile metho for early warning signal calculation Steven J. Lae, Thilo Gross Max Planck Institute for the Physics of Complex Systems, Nöthnitzer Str. 38, 01187 Dresen, Germany
More informationThe Exact Form and General Integrating Factors
7 The Exact Form an General Integrating Factors In the previous chapters, we ve seen how separable an linear ifferential equations can be solve using methos for converting them to forms that can be easily
More informationVectors in two dimensions
Vectors in two imensions Until now, we have been working in one imension only The main reason for this is to become familiar with the main physical ieas like Newton s secon law, without the aitional complication
More informationCode_Aster. Detection of the singularities and calculation of a map of size of elements
Titre : Détection es singularités et calcul une carte [...] Date : 0/0/0 Page : /6 Responsable : DLMAS Josselin Clé : R4.0.04 Révision : Detection of the singularities an calculation of a map of size of
More informationLeast-Squares Regression on Sparse Spaces
Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction
More informationSYNCHRONOUS SEQUENTIAL CIRCUITS
CHAPTER SYNCHRONOUS SEUENTIAL CIRCUITS Registers an counters, two very common synchronous sequential circuits, are introuce in this chapter. Register is a igital circuit for storing information. Contents
More informationECEn 621 Computer Arithmetic. Method Comparisons
ECEn 61 Computer Arithmetic Chapter 7: Iterative Approximation Slie #1 Metho Comparisons Digit Recurrence Metho Computes Multiplication Division/Square Root Log/Exp Operations Use Shifting Aition Simple
More information1 Heisenberg Representation
1 Heisenberg Representation What we have been ealing with so far is calle the Schröinger representation. In this representation, operators are constants an all the time epenence is carrie by the states.
More informationSensors & Transducers 2015 by IFSA Publishing, S. L.
Sensors & Transucers, Vol. 184, Issue 1, January 15, pp. 53-59 Sensors & Transucers 15 by IFSA Publishing, S. L. http://www.sensorsportal.com Non-invasive an Locally Resolve Measurement of Soun Velocity
More informationCode_Aster. Detection of the singularities and computation of a card of size of elements
Titre : Détection es singularités et calcul une carte [...] Date : 0/0/0 Page : /6 Responsable : Josselin DLMAS Clé : R4.0.04 Révision : 9755 Detection of the singularities an computation of a car of size
More informationEuler equations for multiple integrals
Euler equations for multiple integrals January 22, 2013 Contents 1 Reminer of multivariable calculus 2 1.1 Vector ifferentiation......................... 2 1.2 Matrix ifferentiation........................
More informationAll s Well That Ends Well: Supplementary Proofs
All s Well That Ens Well: Guarantee Resolution of Simultaneous Rigi Boy Impact 1:1 All s Well That Ens Well: Supplementary Proofs This ocument complements the paper All s Well That Ens Well: Guarantee
More informationDesigning Information Devices and Systems II Spring 2019 A. Sahai, J. Roychowdhury, K. Pister Midterm 1: Practice
EES 16B Designing Information Devices an Systems II Spring 019 A. Sahai, J. Roychowhury, K. Pister Miterm 1: Practice 1. Speaker System Your job is to construct a speaker system that operates in the range
More informationHarmonic Modelling of Thyristor Bridges using a Simplified Time Domain Method
1 Harmonic Moelling of Thyristor Briges using a Simplifie Time Domain Metho P. W. Lehn, Senior Member IEEE, an G. Ebner Abstract The paper presents time omain methos for harmonic analysis of a 6-pulse
More informationCapacity Analysis of MIMO Systems with Unknown Channel State Information
Capacity Analysis of MIMO Systems with Unknown Channel State Information Jun Zheng an Bhaskar D. Rao Dept. of Electrical an Computer Engineering University of California at San Diego e-mail: juzheng@ucs.eu,
More informationTAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS
MISN-0-4 TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS f(x ± ) = f(x) ± f ' (x) + f '' (x) 2 ±... 1! 2! = 1.000 ± 0.100 + 0.005 ±... TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS by Peter Signell 1.
More informationFREQUENCY ESTIMATION BASED ON ADJACENT DFT BINS
FREQUENCY ESTIMATION BASED ON ADJACENT DFT BINS Michaël Betser, Patrice Collen, France Telecom R&D 3551 Cesson-Sévigné, France first.name@francetelecom.com Gaël Richar. Telecom Paris 75634 Paris, France
More information18 EVEN MORE CALCULUS
8 EVEN MORE CALCULUS Chapter 8 Even More Calculus Objectives After stuing this chapter you shoul be able to ifferentiate an integrate basic trigonometric functions; unerstan how to calculate rates of change;
More informationAdjoint Transient Sensitivity Analysis in Circuit Simulation
Ajoint Transient Sensitivity Analysis in Circuit Simulation Z. Ilievski 1, H. Xu 1, A. Verhoeven 1, E.J.W. ter Maten 1,2, W.H.A. Schilers 1,2 an R.M.M. Mattheij 1 1 Technische Universiteit Einhoven; e-mail:
More information4.2 First Differentiation Rules; Leibniz Notation
.. FIRST DIFFERENTIATION RULES; LEIBNIZ NOTATION 307. First Differentiation Rules; Leibniz Notation In this section we erive rules which let us quickly compute the erivative function f (x) for any polynomial
More informationExamining Geometric Integration for Propagating Orbit Trajectories with Non-Conservative Forcing
Examining Geometric Integration for Propagating Orbit Trajectories with Non-Conservative Forcing Course Project for CDS 05 - Geometric Mechanics John M. Carson III California Institute of Technology June
More informationLecture Notes: March C.D. Lin Attosecond X-ray pulses issues:
Lecture Notes: March 2003-- C.D. Lin Attosecon X-ray pulses issues: 1. Generation: Nee short pulses (less than 7 fs) to generate HHG HHG in the frequency omain HHG in the time omain Issues of attosecon
More informationELEC E7210: Communication Theory. Lecture 4: Equalization
ELEC E7210: Communication Theory Lecture 4: Equalization Equalization Delay sprea ISI irreucible error floor if the symbol time is on the same orer as the rms elay sprea. DF: Equalization a receiver signal
More informationTopic 7: Convergence of Random Variables
Topic 7: Convergence of Ranom Variables Course 003, 2016 Page 0 The Inference Problem So far, our starting point has been a given probability space (S, F, P). We now look at how to generate information
More informationSpace-time Linear Dispersion Using Coordinate Interleaving
Space-time Linear Dispersion Using Coorinate Interleaving Jinsong Wu an Steven D Blostein Department of Electrical an Computer Engineering Queen s University, Kingston, Ontario, Canaa, K7L3N6 Email: wujs@ieeeorg
More informationYaakov (Jonathan) Stein, RAD Data Communications and Brian Stroehlein, TranSwitch Corporation
Using ynchronization over PN Does IEEE 1588 M Really Mae a Difference? Yaaov (Jonathan) tein, RAD Data Communications an Brian troehlein, ranwitch Corporation pecial thans to Alon Geva, DP Algorithm eam
More informationTime-of-Arrival Estimation in Non-Line-Of-Sight Environments
2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor
More informationAdaptive Predictive Control with Controllers of Restricted Structure
Aaptive Preictive Control with Controllers of Restricte Structure Michael J Grimble an Peter Martin Inustrial Control Centre University of Strathclye 5 George Street Glasgow, G1 1QE Scotlan, UK Abstract
More information1 Lecture 20: Implicit differentiation
Lecture 20: Implicit ifferentiation. Outline The technique of implicit ifferentiation Tangent lines to a circle Derivatives of inverse functions by implicit ifferentiation Examples.2 Implicit ifferentiation
More information'HVLJQ &RQVLGHUDWLRQ LQ 0DWHULDO 6HOHFWLRQ 'HVLJQ 6HQVLWLYLW\,1752'8&7,21
Large amping in a structural material may be either esirable or unesirable, epening on the engineering application at han. For example, amping is a esirable property to the esigner concerne with limiting
More information19 Eigenvalues, Eigenvectors, Ordinary Differential Equations, and Control
19 Eigenvalues, Eigenvectors, Orinary Differential Equations, an Control This section introuces eigenvalues an eigenvectors of a matrix, an iscusses the role of the eigenvalues in etermining the behavior
More informationChapter 6: Energy-Momentum Tensors
49 Chapter 6: Energy-Momentum Tensors This chapter outlines the general theory of energy an momentum conservation in terms of energy-momentum tensors, then applies these ieas to the case of Bohm's moel.
More informationPeriods of quadratic twists of elliptic curves
Perios of quaratic twists of elliptic curves Vivek Pal with an appenix by Amo Agashe Abstract In this paper we prove a relation between the perio of an elliptic curve an the perio of its real an imaginary
More informationThis module is part of the. Memobust Handbook. on Methodology of Modern Business Statistics
This moule is part of the Memobust Hanbook on Methoology of Moern Business Statistics 26 March 2014 Metho: Balance Sampling for Multi-Way Stratification Contents General section... 3 1. Summary... 3 2.
More informationSolution to the exam in TFY4230 STATISTICAL PHYSICS Wednesday december 1, 2010
NTNU Page of 6 Institutt for fysikk Fakultet for fysikk, informatikk og matematikk This solution consists of 6 pages. Solution to the exam in TFY423 STATISTICAL PHYSICS Wenesay ecember, 2 Problem. Particles
More informationKolmogorov spectra of weak turbulence in media with two types of interacting waves
3 Decemer 2001 Physics Letters A 291 (2001) 139 145 www.elsevier.com/locate/pla Kolmogorov spectra of wea turulence in meia with two types of interacting waves F. Dias a P. Guyenne V.E.Zaharov c a Centre
More information6.003 Homework #7 Solutions
6.003 Homework #7 Solutions Problems. Secon-orer systems The impulse response of a secon-orer CT system has the form h(t) = e σt cos(ω t + φ)u(t) where the parameters σ, ω, an φ are relate to the parameters
More informationsampling, resulting in iscrete-time, iscrete-frequency functions, before they can be implemente in any igital system an be of practical use. A consier
DISTANCE METRICS FOR DISCRETE TIME-FREQUENCY REPRESENTATIONS James G. Droppo an Les E. Atlas Department of Electrical Engineering University of Washington Seattle, WA fjroppo atlasg@u.washington.eu ABSTRACT
More informationA Weak First Digit Law for a Class of Sequences
International Mathematical Forum, Vol. 11, 2016, no. 15, 67-702 HIKARI Lt, www.m-hikari.com http://x.oi.org/10.1288/imf.2016.6562 A Weak First Digit Law for a Class of Sequences M. A. Nyblom School of
More information6 Wave equation in spherical polar coordinates
6 Wave equation in spherical polar coorinates We now look at solving problems involving the Laplacian in spherical polar coorinates. The angular epenence of the solutions will be escribe by spherical harmonics.
More informationd dx But have you ever seen a derivation of these results? We ll prove the first result below. cos h 1
Lecture 5 Some ifferentiation rules Trigonometric functions (Relevant section from Stewart, Seventh Eition: Section 3.3) You all know that sin = cos cos = sin. () But have you ever seen a erivation of
More informationBalancing Expected and Worst-Case Utility in Contracting Models with Asymmetric Information and Pooling
Balancing Expecte an Worst-Case Utility in Contracting Moels with Asymmetric Information an Pooling R.B.O. erkkamp & W. van en Heuvel & A.P.M. Wagelmans Econometric Institute Report EI2018-01 9th January
More informationEE 370L Controls Laboratory. Laboratory Exercise #7 Root Locus. Department of Electrical and Computer Engineering University of Nevada, at Las Vegas
EE 370L Controls Laboratory Laboratory Exercise #7 Root Locus Department of Electrical an Computer Engineering University of Nevaa, at Las Vegas 1. Learning Objectives To emonstrate the concept of error
More informationNew Simple Controller Tuning Rules for Integrating and Stable or Unstable First Order plus Dead-Time Processes
Proceeings of the 3th WSEAS nternational Conference on SYSTEMS New Simple Controller Tuning Rules for ntegrating an Stable or Unstable First Orer plus Dea-Time Processes.G.ARVANTS Department of Natural
More informationChapter 11: Feedback and PID Control Theory
Chapter 11: Feeback an D Control Theory Chapter 11: Feeback an D Control Theory. ntrouction Feeback is a mechanism for regulating a physical system so that it maintains a certain state. Feeback works by
More informationA NONLINEAR SOURCE SEPARATION APPROACH FOR THE NICOLSKY-EISENMAN MODEL
6th European Signal Processing Conference EUSIPCO 28, Lausanne, Switzerlan, August 25-29, 28, copyright by EURASIP A NONLINEAR SOURCE SEPARATION APPROACH FOR THE NICOLSKY-EISENMAN MODEL Leonaro Tomazeli
More informationSturm-Liouville Theory
LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory
More informationKinematic Relative GPS Positioning Using State-Space Models: Computational Aspects
Kinematic Relative GPS Positioning Using State-Space Moels: Computational Aspects Xiao-Wen Chang, Mengjun Huang, McGill University, Canaa BIOGRAPHIES Dr. Chang is Associate Professor of Computer Science
More informationDifferentiation ( , 9.5)
Chapter 2 Differentiation (8.1 8.3, 9.5) 2.1 Rate of Change (8.2.1 5) Recall that the equation of a straight line can be written as y = mx + c, where m is the slope or graient of the line, an c is the
More informationPredictive Control of a Laboratory Time Delay Process Experiment
Print ISSN:3 6; Online ISSN: 367-5357 DOI:0478/itc-03-0005 Preictive Control of a aboratory ime Delay Process Experiment S Enev Key Wors: Moel preictive control; time elay process; experimental results
More informationPhysics 251 Results for Matrix Exponentials Spring 2017
Physics 25 Results for Matrix Exponentials Spring 27. Properties of the Matrix Exponential Let A be a real or complex n n matrix. The exponential of A is efine via its Taylor series, e A A n = I + n!,
More informationCalculus of Variations
16.323 Lecture 5 Calculus of Variations Calculus of Variations Most books cover this material well, but Kirk Chapter 4 oes a particularly nice job. x(t) x* x*+ αδx (1) x*- αδx (1) αδx (1) αδx (1) t f t
More informationConsider for simplicity a 3rd-order IIR filter with a transfer function. where
Basic IIR Digital Filter The causal IIR igital filters we are concerne with in this course are characterie by a real rational transfer function of or, equivalently by a constant coefficient ifference equation
More informationConstruction of the Electronic Radial Wave Functions and Probability Distributions of Hydrogen-like Systems
Construction of the Electronic Raial Wave Functions an Probability Distributions of Hyrogen-like Systems Thomas S. Kuntzleman, Department of Chemistry Spring Arbor University, Spring Arbor MI 498 tkuntzle@arbor.eu
More informationSubspace Estimation from Incomplete Observations: A High-Dimensional Analysis
Subspace Estimation from Incomplete Observations: A High-Dimensional Analysis Chuang Wang, Yonina C. Elar, Fellow, IEEE an Yue M. Lu, Senior Member, IEEE Abstract We present a high-imensional analysis
More informationBasic IIR Digital Filter Structures
Basic IIR Digital Filter Structures The causal IIR igital filters we are concerne with in this course are characterie by a real rational transfer function of or, equivalently by a constant coefficient
More informationAn Introduction to Event-triggered and Self-triggered Control
An Introuction to Event-triggere an Self-triggere Control W.P.M.H. Heemels K.H. Johansson P. Tabuaa Abstract Recent evelopments in computer an communication technologies have le to a new type of large-scale
More informationELECTRON DIFFRACTION
ELECTRON DIFFRACTION Electrons : wave or quanta? Measurement of wavelength an momentum of electrons. Introuction Electrons isplay both wave an particle properties. What is the relationship between the
More informationState observers and recursive filters in classical feedback control theory
State observers an recursive filters in classical feeback control theory State-feeback control example: secon-orer system Consier the riven secon-orer system q q q u x q x q x x x x Here u coul represent
More informationA Comparison between a Conventional Power System Stabilizer (PSS) and Novel PSS Based on Feedback Linearization Technique
J. Basic. Appl. Sci. Res., ()9-99,, TextRoa Publication ISSN 9-434 Journal of Basic an Applie Scientific Research www.textroa.com A Comparison between a Conventional Power System Stabilizer (PSS) an Novel
More informationLagrangian and Hamiltonian Mechanics
Lagrangian an Hamiltonian Mechanics.G. Simpson, Ph.. epartment of Physical Sciences an Engineering Prince George s Community College ecember 5, 007 Introuction In this course we have been stuying classical
More informationParameter estimation: A new approach to weighting a priori information
Parameter estimation: A new approach to weighting a priori information J.L. Mea Department of Mathematics, Boise State University, Boise, ID 83725-555 E-mail: jmea@boisestate.eu Abstract. We propose a
More informationAdvanced Partial Differential Equations with Applications
MIT OpenCourseWare http://ocw.mit.eu 18.306 Avance Partial Differential Equations with Applications Fall 2009 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.eu/terms.
More informationMath Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors
Math 18.02 Notes on ifferentials, the Chain Rule, graients, irectional erivative, an normal vectors Tangent plane an linear approximation We efine the partial erivatives of f( xy, ) as follows: f f( x+
More informationContributions to Delay, Gain, and Offset Estimation
Linköping Studies in Science and Technology, Dissertations, No. 1189 Contributions to Delay, Gain, and Offset Estimation Mattias Olsson Department of Electrical Engineering Linköping University, SE-581
More informationarxiv:hep-th/ v1 3 Feb 1993
NBI-HE-9-89 PAR LPTHE 9-49 FTUAM 9-44 November 99 Matrix moel calculations beyon the spherical limit arxiv:hep-th/93004v 3 Feb 993 J. Ambjørn The Niels Bohr Institute Blegamsvej 7, DK-00 Copenhagen Ø,
More informationIntroduction to variational calculus: Lecture notes 1
October 10, 2006 Introuction to variational calculus: Lecture notes 1 Ewin Langmann Mathematical Physics, KTH Physics, AlbaNova, SE-106 91 Stockholm, Sween Abstract I give an informal summary of variational
More informationPolynomial Inclusion Functions
Polynomial Inclusion Functions E. e Weert, E. van Kampen, Q. P. Chu, an J. A. Muler Delft University of Technology, Faculty of Aerospace Engineering, Control an Simulation Division E.eWeert@TUDelft.nl
More informationMath 1B, lecture 8: Integration by parts
Math B, lecture 8: Integration by parts Nathan Pflueger 23 September 2 Introuction Integration by parts, similarly to integration by substitution, reverses a well-known technique of ifferentiation an explores
More informationA Simple Model for the Calculation of Plasma Impedance in Atmospheric Radio Frequency Discharges
Plasma Science an Technology, Vol.16, No.1, Oct. 214 A Simple Moel for the Calculation of Plasma Impeance in Atmospheric Raio Frequency Discharges GE Lei ( ) an ZHANG Yuantao ( ) Shanong Provincial Key
More informationA simple model for the small-strain behaviour of soils
A simple moel for the small-strain behaviour of soils José Jorge Naer Department of Structural an Geotechnical ngineering, Polytechnic School, University of São Paulo 05508-900, São Paulo, Brazil, e-mail:
More information