AR PROCESSES AND SOURCES CAN BE RECONSTRUCTED FROM. Radu Balan, Alexander Jourjine, Justinian Rosca. Siemens Corporation Research
|
|
- Dwain Rafe Carson
- 6 years ago
- Views:
Transcription
1 AR PROCESSES AND SOURCES CAN BE RECONSTRUCTED FROM DEGENERATE MIXTURES Radu Balan, Alexander Jourjine, Justinian Rosca Siemens Cororation Research 7 College Road East Princeton, NJ 8 fradu,jourjine,roscag@scr.siemens.com ABSTRACT When mixing of sources is degenerate the known blind source searation methods fail, since in general the degenerate BSS is an ill-osed roblem. Here we reort that if signal transmission is modeled by AR() rocesses one can reconstruct the rocesses and estimate the sources from their degenerate mixture using only second order statistics. We also rove that the aroach fails for a general ARMA(,q) model. The theoretical results are veried in the case of degenerate mixing of two voices and on synthetic data.. INTRODUCTION AND STATEMENT OF THE PROBLEM Current Blind Source Searation (BSS) literature addresses the case when the number of sources is equal to the number of microhones [JH9, Com9, BS9, Ama9, Tor9, Car97, PP9]. Little work has been done to address the degenerate case when this constraint is not satised. Particularly hard is the case of interest for many BSS alications when there are more sources than the number of microhones. This reort demonstrates that seartion in such a degenerate case is feasible. We roose a source searation architecture where sources are modeled as AR rocesses. We solve a secial case of the singular multivariate AR identication roblem, namely when the measurement is scalar but the noise term is a - dimensional vector. Our current aroach is based on the second order statistics only. Methods based on second order statistics have for regular mutivariate AR identication and signal searation (see for instance [S.M88, S.N9, WFO9]). In contrast to these studies, our work concerns the singular case for both the mutivariate AR identication and signal estimation in the BSS roblem. csiemens Cororate Research 998 We aly ths aroach to the degenerate case of the BSS roblem, secically when a scalar mixture of indeendent source signals is recorded with one microhone. The theory for singular multivariate AR rocess identication that is develoed here can be extended to higher dimensions (i.e. more sources than two voices). Let us consider two indeendent univariate AR() rocesses of order and the measurement given by the sum of the two oututs (see Figure ). The timedomain evolution equations are the following: s (n) P =, a k= ks (n, k)+g (n) s (n) =, b k= ks (n, k)+g (n) x(n) =s (n)+s (n) () where and are two indeendent unit variance white-noises, a ;:::;a and b ;:::;b are the arameters of the rst and second AR rocess resectively and G and G are real constants. The roblem is to identify the + real arameters a ;:::;a ;b ;:::;b, G and G based on the measurement fx(n)g n=;:::;n of a realisation of (). Our solution is based on the second order statistics of the measurements ractically given by the samled autocovariance coecients ^r(l) = N NX k=l x(k)x(k, l): The organization of the reort is the following: section resents the main theoretical results. First we show how the sectral density of x can be decomosed; second we derive a modied ARMA estimator by a olynomial system that involves second order statistics of the measurements. Section resents a gradient algorithm to solve these equations together with some other algorithm to address the estimation roblem. Section contains numerical exeriments showing a successful alication of the theory and is followed by conclusions.
2 - AR () - AR () h +,, Figure : The Singular Multivariate AR Model. THE MAIN RESULTS Since the two signals s and s are indeendent, the rocess () has the sectral ower density given by the following formula: R x (z) = G P (z)p ( z ) + G P (z)p ( z ) () Now it is easy to rove the following decomosition (factorization) result: THEOREM Suose we are given the sum x of two indeendent and stable AR() rocess oututs s and s.furthermore suose the rocesses have no common oles. Then the second order statistics is generically enough to uniquely identify the two AR rocesses. Remarks. By generical we mean that the set of \bad" AR rocesses form an algebraic manifold of ositive codimension in the + dimensional sace of arameters. Actually we can say a lot more about this algebraic manifold. These results will aear shortly in a full-length reort.. We oint out that the uniqueness of the decomosition () holds only for AR rocesses. If we relace them by ARMA rocesses, the result no longer holds true, as can be easily seen.. Equation () shows that x(n) is second-order statistics equivalent with an ARMA(,) rocess whose transfer function Q(z)=P (z) is related to our AR() rocesses by: P (z) =P (z)p (z) Q(z)Q( z )=G P (z)p ( z )+G P (z)p ( z ) This would suggest the following identication algorithm: ALGORITHM (ARMA(,) Identication). Identify the rocess fx(n)g as an ARMA(; ) rocess Q(z)=P (z);. For each artition of the roots of P into two subsets of zeros each, construct the olynomials P and P that have these roots and comute G and G - x that best t the second equation above (we exlain what we mean by best t in the next section after the Algorithm );. Choose the artition that gives the smallest error, and that will be an estimate of G ;P, G ;P. We tried this algorithm but it does not give accetable estimates, articularly for large. A second aroach to this roblem is to look for a Modied ARMA estimator (MARMA estimator), adated to our secial form. To do this we need to obtain the time-domain evolution equation of the measurement. In the z transform domain we have: P ( z )P ( z )x(z) =G P ( z ) (z)+g P ( z ) (z) which turns into the following equation: P x(n)+ P(a k= b) kx(n, k) =G (n)+g (n)+ + (G k= b k (n, k)+g a k (n, k)) P k where (a b) k = a l= lb k,l with the convention a = b =. To obtain the second order statistics evolution, we correlate x(n) with x(n, l) and s (n) with (n, l), resectively s (n) with (n, l) in (). Let us denote as follows: r(l) =E[x(n)x(n, l)], (l) = E[s (n) (n, l)], (l) = E[s (n) (n, l)], where E[X] is the exected value of the random variable X. Then we obtain the following system of olynomial equations: P r(l)+ P(a k= b) kr(l, k) =G P (,l)+g (,l)+ + G k= b k (k, l)+ G k= a k (k, l) (l) =, P k= a k (l, k)+g l; (l) =, P k= b k (l, k)+g l; () where is the Dirac imulse. Now note two things; First we do not know the theoretical autocovariance coecients, so we have to relace r(l) by the samled values ^r(l); Second note the causality relations between s ;s and the noise inuts. This causality imlies (l) = (l) = for every l<. Therefore the system () becomes: P ^r(l)+ P (a k= b) k^r(l, k), (G + G) l;,, k=l (G b k (k, l)+g a k (k, l))= (l) P min(l;) =, a k= k (l, k) ; () = G min(l;) (l) =, k= a k (l, k) ; () = G () We solve this nonlinear system in G ;G ;a;b by looking for the least square solution that minimizes a quadratic criterion of the form: P P L J = l= lj^r(l)+ (a k= b) k^r(l, k)(g + G) l;,, P k=l (G b k (k, l)+g a k (k, l))j ()
3 where L + and ( l ) l are some ositiveweights. Thus the Least Square estimator (LS estimator) is given by solving the following otimization roblem: ( ^G ; ^G ; ^a;^b) =argmin J(^r) (). IDENTIFICATION AND SEPARATION ALGORITHMS In this section we resent an algorithm to solve the identication issue and then we discuss the degenerate case of the BSS roblem. Here we reort only one algorithm we tried so far. A longer discussion will follow in an extended version of this reort... The Least Square Estimator The Least Square estimator resented before is based on a gradient descent scheme. One issue related to this algorithm is howtochoose an initial oint(g ;G ;a;b). We resent here an algorithm for obtaining this intialization. The idea is the following: we identify rst the time series fx(n)g; n =;:::;N as a \long" AR rocess, say AR(L ), and then we aroximate its sectral ower density by a decomosition of the tye (). ALGORITHM (Initialization of G ;G ;a;b). Choose L >and nd an AR(L ) estimator of the time series fx(n)g n=:::n, say ~ G= ~ P(z).. For each artition of the L roots of ~ P into two grous of zeros, construct P (z) and P (z) the olynomials corresonding to these zeros. Let S(z) be the remainder olynomial in ~ P, ~ P = P P S. Find G and G that best aroximate the equation: ~G = G P (z)s(z)p ( z )S( z )+G P (z)s(z)p ( z )S( z ) (7) (we indicate below how to obtain G and G ). Choose the best artition with resect to the aroximation error and obtain the corresonding estimates for G ;G, a, b. To choose G and G in (7) we have tried both a Pade aroximation [K.K87] and a least -norm solution. Both seem to work equaly ne. We describe here the -norm aroximation. Let us denote X P (z)s(z)p ( z )S( z )= L, X l=,l + f l z l ; P (z)s(z)p ( z )S( z )= L, l=,l + f l zl and Then the -norm error comuted on the unit circle in the comlex lane is given by: Error = X L, l=,l + jg f l + G f l, ~ G l; j Then we easily obtain a linear system in G and G by setting to zero the derivatives of the Error with resect to G, resectively G... The Estimation Problem Recall the roblem is the following: we have two voice signals recorded by the same microhone and we want, based on this mixed signal, to estimate the original two signals. The solution we roose is reresented in Figure and consists of two stages: an identication art and a linear estimation art. For identication, we assume the two voices are aroximated resectively by AR() rocesses and our task is to identify the roccesses arameters. For the linear estimation we tried both the Wiener ltering [Poo9]as well the causal art of the Wiener lter. It seems the causal art gives better results is terms of the sound quality. The Wiener lter formulae are given by: F (z) = F (z) = and the causal arts are then: F c (z, )= G P (z, ) T (z, ) G P(z)P( z ) G P(z)P( z )+G P(z)P( z ) G (8) P(z)P( z ) G P(z)P( z )+G P(z)P( z ) F c (z, )= G P (z, ) T (z, ) (9) where T (z) is the sectral factor in the factorization T (z)t ( z )=G P (z)p ( z )+G P (z)p ( z ). The adatation algorithm is the following: ALGORITHM (On-line Adatation). Initialize the arameter estimation on the rst N samles using the revious algorithm.. Aly a coule of gradient descent stes to \olish" the aroximation.. At each new samle, udate the samled autocovariance coecient by using a rectangular window (or an exonential window) and aly a gradient ste to adat the estimation of ^G ; ^G ; ^a;^b. Estimate ^s ; ^s using the udated (causal) Wiener lters. Exerimentally, the gradient correction at Ste seems not to track well the actual values of the arameters (obtained by an AR() estimator on the actual signals). Nonetheless, the more comutationally exensive algorithm that simly alies the estimation
4 s + h,, - F,,, - Identification Block Figure : The Adative Estimation Diagram. ^s - ^s - on a sliding nonoverlaing window gives better results. Future work is needed to obtain a better on-line algorithm. mization, for several values of L. The rst lot gives the Yule-Walker estimation [GH9] of the sectral owers of the two AR() rocesses. The theoretical sectral ower is deicted in Figure, to lots, using the actual values of the arameters. In Figure we also resent the sectral ower densities where the gradient algorithm converged after stes. Dierent initializations imlied dierent limiting densities each of them corresonding to a dierent local minimum of the criterion J. For L =we show in Figure the convergence of the arameters. Figure lots the decimal logarithm of the criterion. Note how fast J decays during the rst stes. The limiting sectral ower densities obtained in Figure, second row, aroximates very well the original sectral densities. The gradient descent stes decreased the criterion to about times less the initial value. The arameters of the two AR() roccesses used were the following: G = G =, a =:;a =,:;a =,:;a =: and b =,:;b = :;b =,:;b = :. The identication algorithm gave a better estimate for the second rocess which was the most owerful rocess.. NUMERICAL EXPERIMENTS We reort exeriments on both synthetic and voice data. First we describe AR identication exeriments of singular mutivariate AR rocesses on synthetic data. Second we describe an alication of the theory to the estimation of two voices from one scalar mixture. All exeriments were erformed in Matlab. Estimated from s Initialization Initialization Estimated from s Exeriments on Synthetic Data We constructed two stable and indeendent AR() rocesses. Then we estimated the rocesses from their sum by ltering the observed signal with Wiener lters dened by arameters estimated by alying gradient descent with the initialization given by the Algorithm. Here we reort only one set of results, those corresonding to =. We considered N = samles to estimate the autocovariance coecients at various lags ^r(l); this corresonded to a ms window ofaseech signal samled at Hz, on which the signal may be considered stationary (see [LJ9]). For the criterion () we took L = to avoid the contribution of the uctuations in ^r(l) for large l. For diferent values of L we obtained dierent initializations. Surrisingly, the best initialization has been given by the lowest value L = =. In Figure we lot the initial sectral ower obtained with the Algorithm using the -norm mini- Initialization Initialization Initialization Initialization Figure : Sectral ower densities for the Yule-Walker estimations (rst row), initial sectral owers for L = (second row), L = (third row) and L = (fourth row) From these exeriments we conclude that the algorithm we roosed gives a fairly good estimate of the sectral ower densities of the two sources. The arameters of the most owerful rocess are estimated better.
5 The criterion at each iteration Norm aroximation *L=8 = J =.8897 J = System Signal.... Signal G.7. Identified Identified 8 a Identified Identified a a Identified.. Identified a. Figure : The theoretical sectral ower densities (rst row), limiting sectral owers for L = (second row), L = (third row) and L = (fourth row) System G... Exeriments on Voice Data We erformed exeriments with voices from the TIMIT database. The two voice signals (called A and A here) consist of 78 samles at khz samling frequency (about seconds of data). We tested how feasible the estimation roblem is. We identied the two voices as AR() rocesses, directly on the actual signals, and then we estimated the two voices from their sum using the lters from equations ( 8) and ( 9). In Figure 7 we show the time-series of the original voices (uer grahs), of their sum (the middle lot), and the estimated signals (lower lots). We used = and N =. The quality of the oututs is good for this rather low dimensional AR models we are aroximating voices with. We exerimented with longer AR rocesses as well, but the quality of the oututs does not imrove signicantly. These exeriments were meant to show that the estimation roblem can be solved reasonably well when we identify the two voices as AR rocesses. b b b b Figure : The arameters of the two rocesses.. CONCLUSIONS In this reort we solved the identication roblem of a sum of two indeendent AR rocesses. First we roved that this system is identiable, next we deduced an estimator for the rocesses arameters and nally we resented a family of algorithms to imlement this estimator. As a direct alication we considered the de- Log(J) Figure : The criterion log J
6 The Mixture of the two voices. s s +s s^ Voice A Estimated Voice A x. x s s^ Voice A x Estimated Voice A x. x Figure 7: Voice exeriments: source voices (uer row), mixture calculated as sum (middle row), and estimated oututs (bottom row). generate case of the Blind Source Searation roblem where a mixture of two voices is given, as recorded with one microhone. From this one measurement (more secically one sequence of samles) we estimated the original two signals. This alication raised the adatation roblem of the singular AR identication algorithm. We showed how to adat the revious algorithm to an on-line rocedure. The resent study shows that the second order statistics is sucient for both the identication of singular multivariate AR rocesses of the articular form considered here, as well as estimation of indeendent signals in a scalar mixture of two voices when these voices can be well aroximated by AR rocesses. Future work will deal with various issues raised in the on-line imlementation, such as faster and more reliable algorithms. [Car97] [Com9] J.F. Cardoso. Infomax and maximum likelihood for blind source searation. IEEE Signal Processing Letters, ():{, Aril 997. P. Comon. Indeendent comonent analysis, a new concet? Signal Processing, ():87{, 99. [GH9] Arthur A. Giordano and Frank M. Hsu. Least Square Estimation with Alications to Digital Signal Processing. Sringer-Verlag, 99. [JH9] C. Jutten and J. Herault. Blind searation of sources, art i: An adative algorithm based on neuromimetic architecture. Signal Processing, ():{, 99. [K.K87] K.Kumar. Identication of autoregeressivemoving average (arma) models using ade aroximations. Bull.Inst.Statis.Inst., Proc.th Session, ():77{89, [LJ9] L.Rabiner and B-H. Juang. Fundamentals of Seech Recognition. PTR Prentince Hall, 99. [Poo9] [PP9] [S.M88] [S.N9] H. Vincent Poor. An Introduction to Signal Detection and Estimation. Sringer-Verlag, 99. B. A. Pearlmutter and L. C. Parra. A contextsensitive generalization of ica. In International Conference on Neural Information Processing, Hong Kong, 99. S.M.Kay. Modern Sectral Estimation. Prentice Hall, 988. S.Nakamori. Estimation of multivariate signals by outut autocovariance data in linear discretetime systems. Math.and Com.Moddeling, ():97{, [Tor9] K. Torkkola. Blind searation of convolved sources based on information maximization. In IEEE Worksho on Neural Networks for Signal Processing, Kyoto, Jaan, 99. [WFO9] E. Weinstein, M. Feder, and A. Oenheim. Multi-channel signal searation by decorrelation. IEEE Trans. on Seech and Audio Processing, ():{, 99.. REFERENCES [Ama9] S. Amari. Minimum mutual information blind searation. Neural Comutation, 99. [BS9] A.J. Bell and T.J. Sejnowski. An informationmaximization aroach to blind searation and blind deconvolution. Neural Comutation, 7:9{9, 99.
Keywords: Vocal Tract; Lattice model; Reflection coefficients; Linear Prediction; Levinson algorithm.
Volume 3, Issue 6, June 213 ISSN: 2277 128X International Journal of Advanced Research in Comuter Science and Software Engineering Research Paer Available online at: www.ijarcsse.com Lattice Filter Model
More informationApproximating min-max k-clustering
Aroximating min-max k-clustering Asaf Levin July 24, 2007 Abstract We consider the roblems of set artitioning into k clusters with minimum total cost and minimum of the maximum cost of a cluster. The cost
More informationRadial Basis Function Networks: Algorithms
Radial Basis Function Networks: Algorithms Introduction to Neural Networks : Lecture 13 John A. Bullinaria, 2004 1. The RBF Maing 2. The RBF Network Architecture 3. Comutational Power of RBF Networks 4.
More informationA Recursive Block Incomplete Factorization. Preconditioner for Adaptive Filtering Problem
Alied Mathematical Sciences, Vol. 7, 03, no. 63, 3-3 HIKARI Ltd, www.m-hiari.com A Recursive Bloc Incomlete Factorization Preconditioner for Adative Filtering Problem Shazia Javed School of Mathematical
More informationAutoregressive (AR) Modelling
Autoregressive (AR) Modelling A. Uses of AR Modelling () Alications (a) Seech recognition and coding (storage) (b) System identification (c) Modelling and recognition of sonar, radar, geohysical signals
More informationRecursive Estimation of the Preisach Density function for a Smart Actuator
Recursive Estimation of the Preisach Density function for a Smart Actuator Ram V. Iyer Deartment of Mathematics and Statistics, Texas Tech University, Lubbock, TX 7949-142. ABSTRACT The Preisach oerator
More informationMULTI-CHANNEL PARAMETRIC ESTIMATOR FAST BLOCK MATRIX INVERSES
MULTI-CANNEL ARAMETRIC ESTIMATOR FAST BLOCK MATRIX INVERSES S Lawrence Marle Jr School of Electrical Engineering and Comuter Science Oregon State University Corvallis, OR 97331 Marle@eecsoregonstateedu
More informationThe Recursive Fitting of Multivariate. Complex Subset ARX Models
lied Mathematical Sciences, Vol. 1, 2007, no. 23, 1129-1143 The Recursive Fitting of Multivariate Comlex Subset RX Models Jack Penm School of Finance and lied Statistics NU College of Business & conomics
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationDamage Identification from Power Spectrum Density Transmissibility
6th Euroean Worksho on Structural Health Monitoring - h.3.d.3 More info about this article: htt://www.ndt.net/?id=14083 Damage Identification from Power Sectrum Density ransmissibility Y. ZHOU, R. PERERA
More informationFeedback-error control
Chater 4 Feedback-error control 4.1 Introduction This chater exlains the feedback-error (FBE) control scheme originally described by Kawato [, 87, 8]. FBE is a widely used neural network based controller
More informationCorrespondence Between Fractal-Wavelet. Transforms and Iterated Function Systems. With Grey Level Maps. F. Mendivil and E.R.
1 Corresondence Between Fractal-Wavelet Transforms and Iterated Function Systems With Grey Level Mas F. Mendivil and E.R. Vrscay Deartment of Alied Mathematics Faculty of Mathematics University of Waterloo
More informationEstimating Time-Series Models
Estimating ime-series Models he Box-Jenkins methodology for tting a model to a scalar time series fx t g consists of ve stes:. Decide on the order of di erencing d that is needed to roduce a stationary
More informationL P -NORM NON-NEGATIVE MATRIX FACTORIZATION AND ITS APPLICATION TO SINGING VOICE ENHANCEMENT. Tomohiko Nakamura and Hirokazu Kameoka,
L P -NORM NON-NEGATIVE MATRIX FACTORIZATION AND ITS APPLICATION TO SINGING VOICE ENHANCEMENT Tomohio Naamura and Hiroazu Kameoa, Graduate School of Information Science and Technology, The University of
More informationFor q 0; 1; : : : ; `? 1, we have m 0; 1; : : : ; q? 1. The set fh j(x) : j 0; 1; ; : : : ; `? 1g forms a basis for the tness functions dened on the i
Comuting with Haar Functions Sami Khuri Deartment of Mathematics and Comuter Science San Jose State University One Washington Square San Jose, CA 9519-0103, USA khuri@juiter.sjsu.edu Fax: (40)94-500 Keywords:
More informationA Simple Weight Decay Can Improve. Abstract. It has been observed in numerical simulations that a weight decay can improve
In Advances in Neural Information Processing Systems 4, J.E. Moody, S.J. Hanson and R.P. Limann, eds. Morgan Kaumann Publishers, San Mateo CA, 1995,. 950{957. A Simle Weight Decay Can Imrove Generalization
More informationState Estimation with ARMarkov Models
Deartment of Mechanical and Aerosace Engineering Technical Reort No. 3046, October 1998. Princeton University, Princeton, NJ. State Estimation with ARMarkov Models Ryoung K. Lim 1 Columbia University,
More informationx and y suer from two tyes of additive noise [], [3] Uncertainties e x, e y, where the only rior knowledge is their boundedness and zero mean Gaussian
A New Estimator for Mixed Stochastic and Set Theoretic Uncertainty Models Alied to Mobile Robot Localization Uwe D. Hanebeck Joachim Horn Institute of Automatic Control Engineering Siemens AG, Cororate
More informationUncorrelated Multilinear Principal Component Analysis for Unsupervised Multilinear Subspace Learning
TNN-2009-P-1186.R2 1 Uncorrelated Multilinear Princial Comonent Analysis for Unsuervised Multilinear Subsace Learning Haiing Lu, K. N. Plataniotis and A. N. Venetsanooulos The Edward S. Rogers Sr. Deartment
More informationProbability Estimates for Multi-class Classification by Pairwise Coupling
Probability Estimates for Multi-class Classification by Pairwise Couling Ting-Fan Wu Chih-Jen Lin Deartment of Comuter Science National Taiwan University Taiei 06, Taiwan Ruby C. Weng Deartment of Statistics
More informationCERIAS Tech Report The period of the Bell numbers modulo a prime by Peter Montgomery, Sangil Nahm, Samuel Wagstaff Jr Center for Education
CERIAS Tech Reort 2010-01 The eriod of the Bell numbers modulo a rime by Peter Montgomery, Sangil Nahm, Samuel Wagstaff Jr Center for Education and Research Information Assurance and Security Purdue University,
More informationUsing a Computational Intelligence Hybrid Approach to Recognize the Faults of Variance Shifts for a Manufacturing Process
Journal of Industrial and Intelligent Information Vol. 4, No. 2, March 26 Using a Comutational Intelligence Hybrid Aroach to Recognize the Faults of Variance hifts for a Manufacturing Process Yuehjen E.
More informationSystem Reliability Estimation and Confidence Regions from Subsystem and Full System Tests
009 American Control Conference Hyatt Regency Riverfront, St. Louis, MO, USA June 0-, 009 FrB4. System Reliability Estimation and Confidence Regions from Subsystem and Full System Tests James C. Sall Abstract
More information4. Score normalization technical details We now discuss the technical details of the score normalization method.
SMT SCORING SYSTEM This document describes the scoring system for the Stanford Math Tournament We begin by giving an overview of the changes to scoring and a non-technical descrition of the scoring rules
More information1 Introduction Independent component analysis (ICA) [10] is a statistical technique whose main applications are blind source separation, blind deconvo
The Fixed-Point Algorithm and Maximum Likelihood Estimation for Independent Component Analysis Aapo Hyvarinen Helsinki University of Technology Laboratory of Computer and Information Science P.O.Box 5400,
More informationMODELING THE RELIABILITY OF C4ISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL
Technical Sciences and Alied Mathematics MODELING THE RELIABILITY OF CISR SYSTEMS HARDWARE/SOFTWARE COMPONENTS USING AN IMPROVED MARKOV MODEL Cezar VASILESCU Regional Deartment of Defense Resources Management
More informationGeneration of Linear Models using Simulation Results
4. IMACS-Symosium MATHMOD, Wien, 5..003,. 436-443 Generation of Linear Models using Simulation Results Georg Otte, Sven Reitz, Joachim Haase Fraunhofer Institute for Integrated Circuits, Branch Lab Design
More informationGeneralized Coiflets: A New Family of Orthonormal Wavelets
Generalized Coiflets A New Family of Orthonormal Wavelets Dong Wei, Alan C Bovik, and Brian L Evans Laboratory for Image and Video Engineering Deartment of Electrical and Comuter Engineering The University
More informationSpectral Analysis by Stationary Time Series Modeling
Chater 6 Sectral Analysis by Stationary Time Series Modeling Choosing a arametric model among all the existing models is by itself a difficult roblem. Generally, this is a riori information about the signal
More informationPreconditioning techniques for Newton s method for the incompressible Navier Stokes equations
Preconditioning techniques for Newton s method for the incomressible Navier Stokes equations H. C. ELMAN 1, D. LOGHIN 2 and A. J. WATHEN 3 1 Deartment of Comuter Science, University of Maryland, College
More informationUse of Transformations and the Repeated Statement in PROC GLM in SAS Ed Stanek
Use of Transformations and the Reeated Statement in PROC GLM in SAS Ed Stanek Introduction We describe how the Reeated Statement in PROC GLM in SAS transforms the data to rovide tests of hyotheses of interest.
More informationarxiv: v1 [physics.data-an] 26 Oct 2012
Constraints on Yield Parameters in Extended Maximum Likelihood Fits Till Moritz Karbach a, Maximilian Schlu b a TU Dortmund, Germany, moritz.karbach@cern.ch b TU Dortmund, Germany, maximilian.schlu@cern.ch
More informationProvided by the author(s) and University College Dublin Library in accordance with ublisher olicies. Please cite the ublished version when available. Title Low Comlexity Stochastic Otimization-Based Model
More informationCatalan s Equation Has No New Solution with Either Exponent Less Than 10651
Catalan s Euation Has No New Solution with Either Exonent Less Than 065 Maurice Mignotte and Yves Roy CONTENTS. Introduction and Overview. Bounding One Exonent as a Function of the Other 3. An Alication
More informationEfficient Approximations for Call Admission Control Performance Evaluations in Multi-Service Networks
Efficient Aroximations for Call Admission Control Performance Evaluations in Multi-Service Networks Emre A. Yavuz, and Victor C. M. Leung Deartment of Electrical and Comuter Engineering The University
More informationCOMPARISON OF VARIOUS OPTIMIZATION TECHNIQUES FOR DESIGN FIR DIGITAL FILTERS
NCCI 1 -National Conference on Comutational Instrumentation CSIO Chandigarh, INDIA, 19- March 1 COMPARISON OF VARIOUS OPIMIZAION ECHNIQUES FOR DESIGN FIR DIGIAL FILERS Amanjeet Panghal 1, Nitin Mittal,Devender
More informationA BSS-BASED APPROACH FOR LOCALIZATION OF SIMULTANEOUS SPEAKERS IN REVERBERANT CONDITIONS
A BSS-BASED AROACH FOR LOCALIZATION OF SIMULTANEOUS SEAKERS IN REVERBERANT CONDITIONS Hamid Reza Abutalebi,2, Hedieh Heli, Danil Korchagin 2, and Hervé Bourlard 2 Seech rocessing Research Lab (SRL), Elec.
More informationPassive Identification is Non Stationary Objects With Closed Loop Control
IOP Conerence Series: Materials Science and Engineering PAPER OPEN ACCESS Passive Identiication is Non Stationary Obects With Closed Loo Control To cite this article: Valeriy F Dyadik et al 2016 IOP Con.
More informationarxiv: v1 [quant-ph] 20 Jun 2017
A Direct Couling Coherent Quantum Observer for an Oscillatory Quantum Plant Ian R Petersen arxiv:76648v quant-h Jun 7 Abstract A direct couling coherent observer is constructed for a linear quantum lant
More informationOn Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm
On Line Parameter Estimation of Electric Systems using the Bacterial Foraging Algorithm Gabriel Noriega, José Restreo, Víctor Guzmán, Maribel Giménez and José Aller Universidad Simón Bolívar Valle de Sartenejas,
More informationElementary Analysis in Q p
Elementary Analysis in Q Hannah Hutter, May Szedlák, Phili Wirth November 17, 2011 This reort follows very closely the book of Svetlana Katok 1. 1 Sequences and Series In this section we will see some
More informationLinear diophantine equations for discrete tomography
Journal of X-Ray Science and Technology 10 001 59 66 59 IOS Press Linear diohantine euations for discrete tomograhy Yangbo Ye a,gewang b and Jiehua Zhu a a Deartment of Mathematics, The University of Iowa,
More information1 1 c (a) 1 (b) 1 Figure 1: (a) First ath followed by salesman in the stris method. (b) Alternative ath. 4. D = distance travelled closing the loo. Th
18.415/6.854 Advanced Algorithms ovember 7, 1996 Euclidean TSP (art I) Lecturer: Michel X. Goemans MIT These notes are based on scribe notes by Marios Paaefthymiou and Mike Klugerman. 1 Euclidean TSP Consider
More information216 S. Chandrasearan and I.C.F. Isen Our results dier from those of Sun [14] in two asects: we assume that comuted eigenvalues or singular values are
Numer. Math. 68: 215{223 (1994) Numerische Mathemati c Sringer-Verlag 1994 Electronic Edition Bacward errors for eigenvalue and singular value decomositions? S. Chandrasearan??, I.C.F. Isen??? Deartment
More informationAn Investigation on the Numerical Ill-conditioning of Hybrid State Estimators
An Investigation on the Numerical Ill-conditioning of Hybrid State Estimators S. K. Mallik, Student Member, IEEE, S. Chakrabarti, Senior Member, IEEE, S. N. Singh, Senior Member, IEEE Deartment of Electrical
More informationDeriving Indicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V.
Deriving ndicator Direct and Cross Variograms from a Normal Scores Variogram Model (bigaus-full) David F. Machuca Mory and Clayton V. Deutsch Centre for Comutational Geostatistics Deartment of Civil &
More informationConvex Optimization methods for Computing Channel Capacity
Convex Otimization methods for Comuting Channel Caacity Abhishek Sinha Laboratory for Information and Decision Systems (LIDS), MIT sinhaa@mit.edu May 15, 2014 We consider a classical comutational roblem
More informationEstimating function analysis for a class of Tweedie regression models
Title Estimating function analysis for a class of Tweedie regression models Author Wagner Hugo Bonat Deartamento de Estatística - DEST, Laboratório de Estatística e Geoinformação - LEG, Universidade Federal
More informationAN IMPROVED BABY-STEP-GIANT-STEP METHOD FOR CERTAIN ELLIPTIC CURVES. 1. Introduction
J. Al. Math. & Comuting Vol. 20(2006), No. 1-2,. 485-489 AN IMPROVED BABY-STEP-GIANT-STEP METHOD FOR CERTAIN ELLIPTIC CURVES BYEONG-KWEON OH, KIL-CHAN HA AND JANGHEON OH Abstract. In this aer, we slightly
More informationUsing the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process
Using the Divergence Information Criterion for the Determination of the Order of an Autoregressive Process P. Mantalos a1, K. Mattheou b, A. Karagrigoriou b a.deartment of Statistics University of Lund
More informationPrincipal Components Analysis and Unsupervised Hebbian Learning
Princial Comonents Analysis and Unsuervised Hebbian Learning Robert Jacobs Deartment of Brain & Cognitive Sciences University of Rochester Rochester, NY 1467, USA August 8, 008 Reference: Much of the material
More informationF. Augustin, P. Rentrop Technische Universität München, Centre for Mathematical Sciences
NUMERICS OF THE VAN-DER-POL EQUATION WITH RANDOM PARAMETER F. Augustin, P. Rentro Technische Universität München, Centre for Mathematical Sciences Abstract. In this article, the roblem of long-term integration
More informationChater Matrix Norms and Singular Value Decomosition Introduction In this lecture, we introduce the notion of a norm for matrices The singular value de
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A Dahleh George Verghese Deartment of Electrical Engineering and Comuter Science Massachuasetts Institute of Technology c Chater Matrix Norms
More informationNotes on Instrumental Variables Methods
Notes on Instrumental Variables Methods Michele Pellizzari IGIER-Bocconi, IZA and frdb 1 The Instrumental Variable Estimator Instrumental variable estimation is the classical solution to the roblem of
More informationHotelling s Two- Sample T 2
Chater 600 Hotelling s Two- Samle T Introduction This module calculates ower for the Hotelling s two-grou, T-squared (T) test statistic. Hotelling s T is an extension of the univariate two-samle t-test
More informationRobustness of classifiers to uniform l p and Gaussian noise Supplementary material
Robustness of classifiers to uniform l and Gaussian noise Sulementary material Jean-Yves Franceschi Ecole Normale Suérieure de Lyon LIP UMR 5668 Omar Fawzi Ecole Normale Suérieure de Lyon LIP UMR 5668
More informationSparsity Promoting LMS for Adaptive Feedback Cancellation
7 5th Euroean Signal Processing Conference (EUSIPCO) Sarsity Promoting MS for Adative Feedback Cancellation Ching-Hua ee, Bhaskar D. Rao, and Harinath Garudadri Deartment of Electrical and Comuter Engineering
More informationAn Ant Colony Optimization Approach to the Probabilistic Traveling Salesman Problem
An Ant Colony Otimization Aroach to the Probabilistic Traveling Salesman Problem Leonora Bianchi 1, Luca Maria Gambardella 1, and Marco Dorigo 2 1 IDSIA, Strada Cantonale Galleria 2, CH-6928 Manno, Switzerland
More informationA generalization of Amdahl's law and relative conditions of parallelism
A generalization of Amdahl's law and relative conditions of arallelism Author: Gianluca Argentini, New Technologies and Models, Riello Grou, Legnago (VR), Italy. E-mail: gianluca.argentini@riellogrou.com
More informationIntroduction Consider a set of jobs that are created in an on-line fashion and should be assigned to disks. Each job has a weight which is the frequen
Ancient and new algorithms for load balancing in the L norm Adi Avidor Yossi Azar y Jir Sgall z July 7, 997 Abstract We consider the on-line load balancing roblem where there are m identical machines (servers)
More informationSolved Problems. (a) (b) (c) Figure P4.1 Simple Classification Problems First we draw a line between each set of dark and light data points.
Solved Problems Solved Problems P Solve the three simle classification roblems shown in Figure P by drawing a decision boundary Find weight and bias values that result in single-neuron ercetrons with the
More informationCHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules
CHAPTER-II Control Charts for Fraction Nonconforming using m-of-m Runs Rules. Introduction: The is widely used in industry to monitor the number of fraction nonconforming units. A nonconforming unit is
More informationEXACTLY PERIODIC SUBSPACE DECOMPOSITION BASED APPROACH FOR IDENTIFYING TANDEM REPEATS IN DNA SEQUENCES
EXACTLY ERIODIC SUBSACE DECOMOSITION BASED AROACH FOR IDENTIFYING TANDEM REEATS IN DNA SEUENCES Ravi Guta, Divya Sarthi, Ankush Mittal, and Kuldi Singh Deartment of Electronics & Comuter Engineering, Indian
More informationIndirect Rotor Field Orientation Vector Control for Induction Motor Drives in the Absence of Current Sensors
Indirect Rotor Field Orientation Vector Control for Induction Motor Drives in the Absence of Current Sensors Z. S. WANG *, S. L. HO ** * College of Electrical Engineering, Zhejiang University, Hangzhou
More information3.4 Design Methods for Fractional Delay Allpass Filters
Chater 3. Fractional Delay Filters 15 3.4 Design Methods for Fractional Delay Allass Filters Above we have studied the design of FIR filters for fractional delay aroximation. ow we show how recursive or
More informationGIVEN an input sequence x 0,..., x n 1 and the
1 Running Max/Min Filters using 1 + o(1) Comarisons er Samle Hao Yuan, Member, IEEE, and Mikhail J. Atallah, Fellow, IEEE Abstract A running max (or min) filter asks for the maximum or (minimum) elements
More informationNumerical Linear Algebra
Numerical Linear Algebra Numerous alications in statistics, articularly in the fitting of linear models. Notation and conventions: Elements of a matrix A are denoted by a ij, where i indexes the rows and
More informationElliptic Curves and Cryptography
Ellitic Curves and Crytograhy Background in Ellitic Curves We'll now turn to the fascinating theory of ellitic curves. For simlicity, we'll restrict our discussion to ellitic curves over Z, where is a
More informationScaling Multiple Point Statistics for Non-Stationary Geostatistical Modeling
Scaling Multile Point Statistics or Non-Stationary Geostatistical Modeling Julián M. Ortiz, Steven Lyster and Clayton V. Deutsch Centre or Comutational Geostatistics Deartment o Civil & Environmental Engineering
More informationEvaluating Circuit Reliability Under Probabilistic Gate-Level Fault Models
Evaluating Circuit Reliability Under Probabilistic Gate-Level Fault Models Ketan N. Patel, Igor L. Markov and John P. Hayes University of Michigan, Ann Arbor 48109-2122 {knatel,imarkov,jhayes}@eecs.umich.edu
More informationElements of Asymptotic Theory. James L. Powell Department of Economics University of California, Berkeley
Elements of Asymtotic Theory James L. Powell Deartment of Economics University of California, Berkeley Objectives of Asymtotic Theory While exact results are available for, say, the distribution of the
More informationA MIXED CONTROL CHART ADAPTED TO THE TRUNCATED LIFE TEST BASED ON THE WEIBULL DISTRIBUTION
O P E R A T I O N S R E S E A R C H A N D D E C I S I O N S No. 27 DOI:.5277/ord73 Nasrullah KHAN Muhammad ASLAM 2 Kyung-Jun KIM 3 Chi-Hyuck JUN 4 A MIXED CONTROL CHART ADAPTED TO THE TRUNCATED LIFE TEST
More informationA numerical implementation of a predictor-corrector algorithm for sufcient linear complementarity problem
A numerical imlementation of a redictor-corrector algorithm for sufcient linear comlementarity roblem BENTERKI DJAMEL University Ferhat Abbas of Setif-1 Faculty of science Laboratory of fundamental and
More informationMinimax Design of Nonnegative Finite Impulse Response Filters
Minimax Design of Nonnegative Finite Imulse Resonse Filters Xiaoing Lai, Anke Xue Institute of Information and Control Hangzhou Dianzi University Hangzhou, 3118 China e-mail: laix@hdu.edu.cn; akxue@hdu.edu.cn
More informationRobust Discrete Optimization Under Ellipsoidal Uncertainty Sets. Abstract
Robust Discrete Otimization Under Ellisoidal Uncertainty Sets Dimitris Bertsimas Melvyn Sim y March, 004 Abstract We address the comlexity and ractically ecient methods for robust discrete otimization
More informationINTRODUCTION. Please write to us at if you have any comments or ideas. We love to hear from you.
Casio FX-570ES One-Page Wonder INTRODUCTION Welcome to the world of Casio s Natural Dislay scientific calculators. Our exeriences of working with eole have us understand more about obstacles eole face
More informationPairwise active appearance model and its application to echocardiography tracking
Pairwise active aearance model and its alication to echocardiograhy tracking S. Kevin Zhou 1, J. Shao 2, B. Georgescu 1, and D. Comaniciu 1 1 Integrated Data Systems, Siemens Cororate Research, Inc., Princeton,
More informationOn split sample and randomized confidence intervals for binomial proportions
On slit samle and randomized confidence intervals for binomial roortions Måns Thulin Deartment of Mathematics, Usala University arxiv:1402.6536v1 [stat.me] 26 Feb 2014 Abstract Slit samle methods have
More informationMonte Carlo Studies. Monte Carlo Studies. Sampling Distribution
Monte Carlo Studies Do not let yourself be intimidated by the material in this lecture This lecture involves more theory but is meant to imrove your understanding of: Samling distributions and tests of
More informationInformation collection on a graph
Information collection on a grah Ilya O. Ryzhov Warren Powell February 10, 2010 Abstract We derive a knowledge gradient olicy for an otimal learning roblem on a grah, in which we use sequential measurements
More informationResearch of power plant parameter based on the Principal Component Analysis method
Research of ower lant arameter based on the Princial Comonent Analysis method Yang Yang *a, Di Zhang b a b School of Engineering, Bohai University, Liaoning Jinzhou, 3; Liaoning Datang international Jinzhou
More informationDecoding Linear Block Codes Using a Priority-First Search: Performance Analysis and Suboptimal Version
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 44, NO. 3, MAY 1998 133 Decoding Linear Block Codes Using a Priority-First Search Performance Analysis Subotimal Version Yunghsiang S. Han, Member, IEEE, Carlos
More informationFig. 4. Example of Predicted Workers. Fig. 3. A Framework for Tackling the MQA Problem.
217 IEEE 33rd International Conference on Data Engineering Prediction-Based Task Assignment in Satial Crowdsourcing Peng Cheng #, Xiang Lian, Lei Chen #, Cyrus Shahabi # Hong Kong University of Science
More informationAn efficient Jacobi-like deflationary ICA algorithm: application to EEG denoising
An efficient Jacobi-like deflationary ICA algorithm: alication to EEG denoising Seideh Hajiour, Laurent Albera, Mohammad Bagher, Isabelle Merlet To cite this version: Seideh Hajiour, Laurent Albera, Mohammad
More informationBayesian Model Averaging Kriging Jize Zhang and Alexandros Taflanidis
HIPAD LAB: HIGH PERFORMANCE SYSTEMS LABORATORY DEPARTMENT OF CIVIL AND ENVIRONMENTAL ENGINEERING AND EARTH SCIENCES Bayesian Model Averaging Kriging Jize Zhang and Alexandros Taflanidis Why use metamodeling
More information2-D Analysis for Iterative Learning Controller for Discrete-Time Systems With Variable Initial Conditions Yong FANG 1, and Tommy W. S.
-D Analysis for Iterative Learning Controller for Discrete-ime Systems With Variable Initial Conditions Yong FANG, and ommy W. S. Chow Abstract In this aer, an iterative learning controller alying to linear
More informationEfficient algorithms for the smallest enclosing ball problem
Efficient algorithms for the smallest enclosing ball roblem Guanglu Zhou, Kim-Chuan Toh, Jie Sun November 27, 2002; Revised August 4, 2003 Abstract. Consider the roblem of comuting the smallest enclosing
More informationFinding recurrent sources in sequences
Finding recurrent sources in sequences Aristides Gionis Deartment of Comuter Science Stanford University Stanford, CA, 94305, USA gionis@cs.stanford.edu Heikki Mannila HIIT Basic Research Unit Deartment
More informationON THE LEAST SIGNIFICANT p ADIC DIGITS OF CERTAIN LUCAS NUMBERS
#A13 INTEGERS 14 (014) ON THE LEAST SIGNIFICANT ADIC DIGITS OF CERTAIN LUCAS NUMBERS Tamás Lengyel Deartment of Mathematics, Occidental College, Los Angeles, California lengyel@oxy.edu Received: 6/13/13,
More informationThe Graph Accessibility Problem and the Universality of the Collision CRCW Conflict Resolution Rule
The Grah Accessibility Problem and the Universality of the Collision CRCW Conflict Resolution Rule STEFAN D. BRUDA Deartment of Comuter Science Bisho s University Lennoxville, Quebec J1M 1Z7 CANADA bruda@cs.ubishos.ca
More informationON OPTIMIZATION OF THE MEASUREMENT MATRIX FOR COMPRESSIVE SENSING
8th Euroean Signal Processing Conference (EUSIPCO-2) Aalborg, Denmark, August 23-27, 2 ON OPTIMIZATION OF THE MEASUREMENT MATRIX FOR COMPRESSIVE SENSING Vahid Abolghasemi, Saideh Ferdowsi, Bahador Makkiabadi,2,
More informationDETC2003/DAC AN EFFICIENT ALGORITHM FOR CONSTRUCTING OPTIMAL DESIGN OF COMPUTER EXPERIMENTS
Proceedings of DETC 03 ASME 003 Design Engineering Technical Conferences and Comuters and Information in Engineering Conference Chicago, Illinois USA, Setember -6, 003 DETC003/DAC-48760 AN EFFICIENT ALGORITHM
More informationImproved Capacity Bounds for the Binary Energy Harvesting Channel
Imroved Caacity Bounds for the Binary Energy Harvesting Channel Kaya Tutuncuoglu 1, Omur Ozel 2, Aylin Yener 1, and Sennur Ulukus 2 1 Deartment of Electrical Engineering, The Pennsylvania State University,
More informationGOOD MODELS FOR CUBIC SURFACES. 1. Introduction
GOOD MODELS FOR CUBIC SURFACES ANDREAS-STEPHAN ELSENHANS Abstract. This article describes an algorithm for finding a model of a hyersurface with small coefficients. It is shown that the aroach works in
More informationThe inverse Goldbach problem
1 The inverse Goldbach roblem by Christian Elsholtz Submission Setember 7, 2000 (this version includes galley corrections). Aeared in Mathematika 2001. Abstract We imrove the uer and lower bounds of the
More informationDesign of NARMA L-2 Control of Nonlinear Inverted Pendulum
International Research Journal of Alied and Basic Sciences 016 Available online at www.irjabs.com ISSN 51-838X / Vol, 10 (6): 679-684 Science Exlorer Publications Design of NARMA L- Control of Nonlinear
More informationAKRON: An Algorithm for Approximating Sparse Kernel Reconstruction
: An Algorithm for Aroximating Sarse Kernel Reconstruction Gregory Ditzler Det. of Electrical and Comuter Engineering The University of Arizona Tucson, AZ 8572 USA ditzler@email.arizona.edu Nidhal Carla
More informationCovariance Matrix Estimation for Reinforcement Learning
Covariance Matrix Estimation for Reinforcement Learning Tomer Lancewicki Deartment of Electrical Engineering and Comuter Science University of Tennessee Knoxville, TN 37996 tlancewi@utk.edu Itamar Arel
More informationRecent Developments in Multilayer Perceptron Neural Networks
Recent Develoments in Multilayer Percetron eural etworks Walter H. Delashmit Lockheed Martin Missiles and Fire Control Dallas, Texas 75265 walter.delashmit@lmco.com walter.delashmit@verizon.net Michael
More informationDEPARTMENT OF ECONOMICS ISSN DISCUSSION PAPER 20/07 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES
DEPARTMENT OF ECONOMICS ISSN 1441-549 DISCUSSION PAPER /7 TWO NEW EXPONENTIAL FAMILIES OF LORENZ CURVES ZuXiang Wang * & Russell Smyth ABSTRACT We resent two new Lorenz curve families by using the basic
More information