Progressive Correction for Deterministic Dirac Mixture Approximations

Size: px
Start display at page:

Download "Progressive Correction for Deterministic Dirac Mixture Approximations"

Transcription

1 4th Internationa Conference on Information Fusion Chicago, Iinois, USA, Juy 5-8, Progressive Correction for Deterministic Dirac Miture Approimations Patrick Ruoff, Peter Krauthausen, and Uwe D. Hanebeck Inteigent Sensor-Actuator-Systems Laboratory (ISAS), Institute for Anthropomatics, Karsruhe Institute of Technoogy (KIT), Germany. Emai: Abstract Since the advent of Monte-Caro partice fitering, partice representations of densities have become increasingy popuar due to their feibiity and impicit adaptive resoution. In this paper, an agorithm for the mutipication of a systematic Dirac miture (DM) approimation with a continuous ikeihood function is presented, which appies a progressive correction scheme, in order to avoid the partice degeneration probem. The preservation of sampe reguarity and therefore, representation quaity of the underying smooth density, is ensured by incuding a new measure of smoothness for Dirac mitures, the DM energy, into the distance measure. A comparison to common correction schemes in Monte-Caro methods reveas arge improvements especiay in cases of sma overap between the ikeihood and prior density, as we as for muti-moda ikeihoods. Keywords: state estimation, noninear fitering. I. INTRODUCTION State estimation as the inference of a hidden system state based on noisy observations is a fundamenta probem in engineering. Due to the uncertainty inherent in the probem, Bayesian estimation methods are commony empoyed. The soution to the state estimation probem is then obtained by recursive prediction and correction steps. Even though anaytic soutions eist for some specia type of systems, e.g., inear systems [], in genera no anaytic soutions to the prediction and correction equation are obtainabe. Therefore, suitabe approimations of the systems and/or the densities are required. The rest of this paper is concerned with deriving an approimation of the correction step as needed in a Bayesian state estimator for the case of systematic Dirac miture approimations of the underying densities. For noninear systems, the eisting approaches may be categorized according to the empoyed density approimation schemes, as the specific type of approimation governs the treatment of the correction step. For eampe, the etended Kaman fiter (EKF) [] uses a Gaussian density approimation and inearization of the ikeihood around the current state estimate. Gaussian miture fiters [3] offer a more feibe density representation, but in genera suffer from an eponentia increase in components. The conceptuay simpest density representation is an approimation by a Dirac miture (DM) of equay weighted partices, as used in canonica partice fiters. The partice representation is not ony very advantageous for simuations, but aso offers an impicit adaptive resoution of the density approimation. As pure Monte- Caro partice representations suffer from sow convergence rates to the true density in the number of partices used, different approimation schemes were deveoped, such as quasi-monte-caro approimations [4]. However, as partice representations do not capture the smoothness of the origina density, naïve agorithms for the correction step in a state estimator ead to the typica partice degeneration probem, where eventuay ony a few different partices contribute to the posterior distribution. This paper introduces a reguarized progressive correction step in the case that a certain distance measure to the underying density sha be minimized by deterministicay pacing partices. In contrast to a progressive correction for Monte- Caro methods, this probem is especiay chaenging as the benefit of deterministic approimation schemes, i.e., a representation with fewer partices, is even more ikey to degrade in the correction step. Many different schemes have been proposed to hande the correction step for Monte-Caro partice fiters, cf. [5] for an overview. The approach resembing the present work most is [6], which is a progressive correction step for Monte Caro methods. We etend this scheme to deterministic Dirac miture approimations, spitting the ikeihood adaptivey into severa factors, each of which is easier to process. In the course of the progression, each factor of the ikeihood is mutipied with the current deterministic DM approimation and subsequenty reapproimated with equay weighted Diracs. As wi be shown, this effectivey reocates the Dirac components to regions with higher posterior density and thereby avoids the typica degeneration of the representation. In order to ensure that the DM representation maintains the smoothness/reguarity properties of the underying density throughout the progression, a nove energy term is added to the distance measure used for the reapproimation. This reguarization of the DM representation resuts in a reduced approimation error as a comparison to Monte-Caro fiters reveas for a ikeihood and prior density with sma overap as we as for mutimoda ikeihoods. The rest of this paper is structured as foows: After giving the mathematica probem formuation in Sec. II, the required distance measure for Dirac mitures is introduced in Sec. III and the progressive correction agorithm is stated in Sec. IV ISIF 35

2 The benefits of the proposed approach are discussed in an eperimenta vaidation in Sec. V. II. PROBLEM FORMULATION The Bayesian estimation framework consists of two recursivey aternating steps: a prediction and a correction step. The prediction step corresponds to cacuating the net state estimate k+ based on the current estimate k and the system dynamics a k (.). The correction step integrates a measurement ŷ according to the measurement function h k (.) into the current state estimate and thereby corrects the predicted state. This paper is concerned with the correction step ony, i.e., p( k+ y :k+ ) p( k+ y :k ) p(y k+ k+ ), where y :k denotes the set of measurements from timestep to k and focuses on a prior density approimated by a DM with n N equay weighted components minimizing the distance measure described in the Sec. III, p( k+ y :k ) n δ( n i ), () i= where δ( i ) denotes the Dirac measure at position i R N. The goa is to find the optima DM resuting from the mutipication of the prior density with a continuous ikeihood function (.) ( k+ ) p(ŷ k+ k+ ), () where ŷ k+ denotes the current observation and renormaization was omitted. As we focus on a singe correction step, we wi omit the time inde k from now on. The correction step () may be triviay soved by directy mutipying the () with the ikeihood and subsequent renormaization of the new weights w i = ( i ) n j= ( j ). (3) However, this approach wi ead to weight decay over time and thus, reduces the effective resoution per Dirac component. Eventuay, a but very few components wi have neary zero weights and coud be negected. In order to avoid this degeneracy probem, the basic SIR agorithm [7] draws new sampes from the reweighted Diracs in each correction step. This is probematic for systems with ow noise, where the propagated components wi mainy concentrate around the od partice positions. A possibe remedy that is used in post reguarized partice fiters, e.g., [8], is to reguarize the posterior measure by convoving the partice distribution - after samping from the reweighted DM - with a Gaussian kerne. Samping from this reguarized density then effectivey broadens the distribution, but erodes representation detais especiay for mutimoda densities. The origin of these probems is iustrated in Fig. : Let R n ( f) denote the optima representation in the set of DM with n components and equa weights for a given density f. The goa is to find the optima approimation of the underying true density f mutipied with the ikeihood as a DM, R n ( f ), given the optima approimation of the true density f = R n ( f). This probem is obviousy i-posed, as Figure. f R n M f R n f = R n ( f) M (f) R n ( f ) Diagram of the probem to be soved, see tet for epanation. the reduction R n (drawing sampes for Monte-Caro-based methods or minimization of a certain distance measure here) is not invertibe. In order to sove this probem, additiona prior information about the smoothness properties of and f has to be empoyed. Roughy speaking, what one assumes is that the true density has its probabiity mass smeared out uniformy between Dirac components. The goa is then to use an initia DM approimation and the smoothness assumptions in order to construct an agorithm M producing resuts as cose to the optima soution R n ( f ) as possibe. There are two chaenges when trying to incorporate the smoothness assumption of the underying densities. First, the ikeihood evauation at the origina Dirac positions wi yied ony a high resoution in regions where the prior density is high. What is sought, however, is a resoution that is adapted to the posterior density instead. Fig. iustrates this probem. Based on the insight that this probem is ess probematic for ikeihoods with ow variation, the idea of the proposed approach is to spit the ikeihood into factors with ower variation and perform the mutipication progressivey. The proposed approach resembes [6] and can be understood as an etension of this approach to systematic DM approimations. The factors of the ikeihood function are each mutipied pointwise with the current intermediate density and subsequenty reapproimated with an equay weighted DM. This effectivey moves the Dirac components to regions with higher posterior probabiity, thereby samping the ikeihood with a higher resoution in these regions. p() Prior Likeihood Posterior 4 Figure. Iustration of the resoution probem: The bue Dirac components approimate the prior Gaussian we, but offer ow resoution in regions with high posterior density. The optima evauation points for the ikeihood woud correspond to the points that optimay approimate the posterior density (dashed Dirac components). 36

3 A second chaenge is to guarantee consistency with the origina continuous density, in the sense that the processed sampes shoud sti represent a smooth function and therefore, must not form oca custers throughout the progression. Instead of ony working with a genera purpose distance measures on the ower path of Fig., one has to incorporate another term that connects to the underying true density f by enforcing inter-dirac distance preservation in the reapproimation step, which wi be described in Sec. IV-B. First, in Sec. III, the empoyed distance measure is introduced and in Sec. IV, the progressive correction step is epained. III. LOCALIZED CUMULATIVE DISTRIBUTION AND MODIFIED CRAMÉR-VON-MISES DISTANCE In order to compare two given Dirac miture distributions, a suitabe distance measure has to be defined. As pointwise evauation and integra distance measures are not defined for Dirac distributions, this distance measure has to be based on probabiity mass differences under a subset of possibe kerne functions, which motivates the foowing concepts, as originay defined in [9]. Definition (Locaized Cumuative Distribution, [9]) Let f : R N R + be a probabiity density function. The corresponding Locaized Cumuative Distribution (LCD) is defined as F f (m, b) f() K( m, b) d = (f K(., b))(m), R N where denotes the convoution product, b R N + is a width parameter, and K : R N R N [, ] a kerne function. In this paper, ony Gaussian kernes of the ) form K b () K(, b) = ep ( b, with a singe width parameter b R and the Eucidean distance. are used. In anaogy to the Cramér-von Mises distance, a distance between two generic probabiity distributions is defined in [9] via the squared integra distance of their corresponding LCDs. Definition (Modified Cramér-von Mises distance, [9]) Let f : R N R + and g : R N R + be two probabiity distributions and F f / F g their corresponding LCDs. The modified Cramér-von Mises distance (mcvmd) is defined as D(f, g) w(b) (F f (m, b) F g (m, b)) dm db R R N = w(b) K b f K b g L db, R with a suitabe weighting function w : R + R +. As defined above, the mcvmd compares two densities by their differences in probabiity mass under smooth ocaized kernes. As a weighted mean over a possibe kerne positions and kerne widths is performed, the resuting measure is transation-invariant and does not favor the equivaence of the given densities at a particuar scae. The use of isotropic Gaussian kernes and the squared integra distance measure aows for an anaytic soution of a integras in the mcvmd of the LCDs of two DMs. Theorem (mcvmd for Dirac Miture Densities) Let f() = n i= w i δ( i ) and g() = m i= w i δ( i ) denote two N-dimensiona Dirac miture densities. If f and g possess equa means, the mcvmd can be epressed as D(f, g) = πn/ ( w T Γ w w T Γ w + w T Γ w ), 8 where (w) i w i denote the weight vectors and the matrices Γ y are defined via Γ y i,j γ( i y j ) with the function γ(s) s n s. A proof of this theorem is given in []. IV. PROGRESSIVE CORRECTION In this section, the progressive correction step is derived. The ikeihood decomposition and the reguarization term are introduced, as we as the overa agorithm is stated. A. Likeihood Decomposition As motivated, the ikeihood decomposition addresses the probem of misaigned ikeihood evauation points by the introduction of sub-steps. To this end, the ikeihood function is dynamicay decomposed into a product of the form () = () λi, (4) i with the constraints λ i >, λ i =. (5) At a given intermediate progression step k, the DM from the previous progression step f k () n δ( n i ) (6) i= approimates the prior density mutipied with the pseudoikeihoods from a preceding steps, i.e., f k f λ... λ k. Note, that the DM in (6) has equa weights. The net eponent λ k is determined in the foowing way: In order to contro the oca error in this progression step due to misaigned ikeihood evauation points, we demand that the maimum and minimum Dirac weights after pointwise mutipication with the current pseudo-ikeihood λ k must not differ by a factor greater than α. The maimum eponent λ k meeting this requirement may be cacuated by λ k ma n α λ k = α λ k =, (7) min n ma n min where ma ma i {,..,n} ( i ) and min min i {,..,n} ( i ) denote the maimum and minimum ikeihood coefficients. The subprobem in this progression step is then to find a good DM representation of f k λ k given a DM representation of f k. As the weights of f k mutipied with λ k differ i= 37

4 p().4 p().4 p() (a) Step. (b) Step 6. (c) Step. Figure 3. Progressive correction with α = appied to the eampe in Fig., eading to correction steps. The pots show the current Dirac components before the respective progression step in red, which are reweighted with the current pseudo-ikeihood (dash-dotted curve), a broader version of the origina ikeihood. The resuting Diracs after reapproimation are shown in back. As the progression continues, the Dirac positions move into regions with higher posterior density. ony by a factor of α, the intermediate product f k λ k is cose to f k and, hence, the ikeihood evauation points are cose to optima, cf. Fig.. The resuting reweighted DM is then reapproimated by an equay weighted Dirac miture f k. As a resut, the DM components move into areas with higher posterior probabiity and consequenty increase the ikeihood samping resoution in those areas during the net progression step. This procedure is repeated unti the whoe ikeihood is processed. Fig. 3 shows an iustration of different stages in the progression. B. Reguarization As motivated before, processing the DM progressivey soey with a generic distance measure may produce soutions that are cose to the origina Dirac miture mutipied with the ikeihood f but not necessariy cose to the rea product f that one wants to approimate, cf. Fig.. In order to incorporate the smoothness assumption of the underying density during the progression s reapproimation step, a measure for the reguarity and smoothness of the underying density has to be defined. The energy of a DM provides such a measure. Definition 3 (Energy of a Dirac Miture) Let f n i= w iδ( i.) denote a DM density. The miture s energy is defined as n n w i w j E i j. (8) i= j= j i The definition of the energy in (8) is an anaogy from physics, resembing the energy of an eectric fied of charged partices at positions i carrying the charge w i. This new measure of reguarity or smoothness of the underying density is then empoyed in the reapproimation step as an additiona penaty term: In addition to a ow mcvmd to the reweighted DM, the reapproimating DM shoud aso have simiar smoothness properties and hence simiar energy vaues. The proportion β between approimation quaity and smoothness preservation quantifies the importance of the representation quaity for the probem at hand and may be determined by generic mode seection agorithms []. C. Agorithm In each progression step, the agorithm is composed of two main parts: the ikeihood factorization with the weight computation based on the mutipication of the preceding DM with the pseudo-ikeihood and the penaized reapproimation of the obtained DM. First, the new weights are cacuated based on the current ikeihood eponent as described in Sec. IV-A. As the constraints (5) have to be met, some additiona bookkeeping needs to be performed in order to obtain a vaid decomposition. Second, the subprogram REAPPROX in Ag., reapproimates the reweighted Dirac miture f = n i= w j δ( i.) with an equay weighted DM g[x] = n n i= δ( i.), where X i,j = (j) i denotes the matri of a Dirac positions, by minimizing the distance measure presented in Sec. III penaized by the energy difference as defined in Sec. IV-B. In summary, the foowing optimization probem is soved X = argmin D(f, g[x]) + β (E(f) E(g[X])) (9) s.t. T X/n = w T X. This probem may be soved with standard sovers, e.g., with a imited memory Broyden-Fetcher-Godfarb-Shanno (L- BFGS) agorithm []. The required gradient of the objective function is provided in the appendi. The agorithm summarizing both main parts is given in Ag.. V. EXPERIMENTS In this section, we perform an eperimenta comparison of the proposed agorithm with standard methods in Monte-Caro partice fitering. To this end, we set up two eperiments, which aow for an anaytic soution in order to compute different performance metrics on the resuts. First, the eperimenta setup of both eperiments is epained. Then, the different 38

5 Agorithm Progressive Correction t whie t < do i ( i ) i Cac. net eponent λ n α/(n ma n min ) if λ + t > then λ t end if w i λ i /( n j= j λ ) i Cac. new weights REAPPROX(, w) t t + λ end whie Reapproimation performance metrics are epained. Finay, the resuts are shown and discussed. A. Eperimenta Setup Eperiment (Unimoda ikeihood): The first eperiment considers a Gaussian prior distribution f = N ( µ; Σ ) with zero mean µ = [, ] T and covariance matri [ ] Σ =, which is to) be mutipied by a singe Gaussian ikeihood = N (µ ; Σ with mean µ = [3, ] T and covariance matri [ ].4.3 Σ =..3.4 The difficuties for partice agorithms in this eperiment ie in the reativey sma overap between prior density and ikeihood and, as the ikeihood covariance is not ais-aigned, to capture the rotation of the posterior distribution s covariance eipse in the right way. Eperiment (Bimoda ikeihood): The second eperiment consists of a zero-mean Gaussian prior distribution with unit covariance, which is to be mutipied with a bimoda ikeihood of the form N ( [ 3, ] T ) ( ; Σ + N [3, ] T ) ; Σ, with [ ]. Σ = 3, i.e., a Gaussian miture with two components that form two narrow strips in y-direction at = ±3. The chaenges for partice agorithms in this eperiment stem from the bimoda ikeihood that aso yieds a bimoda posterior distribution. Hence, the Gaussian assumption usuay made in additiona Monte-Caro reguarization steps is inappropriate. B. Initia Approimation and Performance Metrics First, the Gaussian prior density has to be approimated by a DM with equa weights. For the proposed deterministic agorithm this is performed by minimizing the mcvmd [3]. For the Monte-Caro agorithms, the initia density is approimated by random samping. In order to compare the resuts of the different agorithms quantitativey, suitabe performance metrics have to be defined. As the processed partice density is sti a DM, integra distance measures cannot be empoyed, so we imit ourseves to compare the first and second moment of the resuting densities as we as the mean modified Cramér-von Mises distance (MMCvMD). In the case of Monte-Caro methods, an average over n run = runs is performed, whereas the proposed deterministic agorithms are run ony once. If we define the residua probabiity in the k th run as r k f M (f) k, the empoyed error metrics are defined via RMSE m RMSE C ( n run n run k= i= n run n run / N ) E[r k ] i, k= i,j= N C[r k ] i,j MMCvMD n run D( n f, M (f) k ), run k= with E / C denoting the mean / covariance and N the dimension of the system. C. Resuts and Discussion Figure 4 shows a comparison of eempary runs of the two eperiments with 56 partices. In the foowing, the resuts of the different agorithms wi be discussed. COND: As epected, due to the ony weaky overapping ikeihood and prior density, the naïve condensation agorithm seects ony a few different partices which then have higher weight, thereby reducing the effective number of partices. PR: The probem of degenerating partice approimations is often addressed by adding a post-reguarization step, i.e., convoving the given partice density with a Gaussian kerne with a scaed version of the DM s covariance. The optima scaing parameter h opt = (4/(N + )) N+4 n N+4 with n the number of partices can be derived in a density estimation contet [4], but is ony optima for Gaussian densities. This epains the bad performance of post-reguarization in the second eampe: As the true density is bimoda, with arger etent in -direction, the smoothing kernes variance in this direction is too arge, which resuts in a arge partice variation in this direction. PPR: The same probem arises in progressive postreguarization [6], which uses h opt / as scaing parameter but yieds comparabe covariances to PR, as the error of mutipe post-reguarization steps accumuate. SRA: The naïve approach for a systematic mutipication in the mcvmd-minimization contet woud be to mutipy the given prior DM pointwise with the ikeihood and then reapproimate the resuting DM by equay weighted Diracs minimizing the mcvmd. This systematic reapproimation does not produce a high representation quaity as not enough information of the ikeihood is taken into account. /, 39

6 PSRA w/o energy: Appying the naïve systematic reapproimation procedure progressivey without the additiona energy distance term surprisingy does not improve the situation much. As the progression continues, partices tend to form oca custers. The probem here is that the reduction steps minimizing the mcvmd aone introduce sma errors that accumuate. Minimization of the mcvmd as a genera concept is not specificay taiored to preserve the smoothness properties of a DM, i.e., to assure that the approimated DM is sti the reduction of an underying smooth function. PSRA: In order to incorporate the assumption that the underying densities possess strong smoothness properties, another distance term based on the DM energy has to be introduced. The proposed progressive systematic reapproimation then produces high-quaity resuts as the resuting partices cover the posterior density more uniformy. Fig. 5 shows a quantitative evauation of the different agorithms as a function of the number of partices. One can ceary see that the proposed agorithm outperforms standard Monte- Caro techniques and the naïve systematic approimation in amost a cases. However, the main advantage of the proposed agorithm is the reguar coverage of the posterior distribution with partices, which increases the samping resoution for further processing and cannot be reay quantified by the empoyed error metrics. VI. CONCLUSION In this paper, we have proposed a progressive fiter step for deterministic Dirac miture approimations, which avoids partice degeneration by preserving an additiona energy term throughout the progression. The eperimenta comparison with current (progressive) Monte-Caro methods for the correction step, such as the method proposed by [6], reveas a much higher representation quaity per partice, as the partices are paced deterministicay to cover the posterior density homogeneousy. In contrast, Monte-Caro methods treat each sampe individuay, which on the one hand reduces the computationa compeity to grow ony ineary with the number of partices. On the other hand, this independence of partices eads to wasted sampes in terms of the posterior samping resoution and therefore to a worse representation quaity per sampe. The higher computationa costs invoved with the noninear optimization in this approach can become negigibe if compe system and measurement modes are empoyed. In such cases, the number of sampes and thereby evauations of the system mode, needed for Monte-Caro methods to reach the same representation quaity as the proposed method, becomes computationay unfeasibe. VII. APPENDIX Theorem (Gradient of Modified Distance Measure) Let f = n i= w j δ( i.) and g[] = n i= w iδ( i.) denote two Dirac miture densities. The gradient of the modified distance measure in (9) with respect to the k th component of the th Dirac ( position is then given as D(f, g[]) + β (E(f) E(g[])) ) = with (k) (k) (k) D(f, g[]) + β (E(f) E(g[])) (k) E(g[]), ( D(f, g[]) = w T (k) Γ ) ( w w T (k) Γ ) w n = 4w (w j γ( j )( (k) (k) j ) j= w j γ( j )( (k) where γ(s) = n s + and (k) E(g[]) = w n j= j REFERENCES (k) j w j (k) j )), (k) j 3. [] R. Kaman et a., A new approach to inear fitering and prediction probems, Journa of basic Engineering, vo. 8, no., pp , 96. [] S. Juier and J. Uhmann, A new etension of the Kaman fiter to noninear systems, in Int. Symp. Aerospace/Defense Sensing, Simu. and Contros, vo. 3. Citeseer, 997, p. 6. [3] D. Aspach and H. Sorenson, Noninear Bayesian estimation using Gaussian sum approimations, Automatic Contro, IEEE Transactions on, vo. 7, no. 4, pp , 97. [4] D. Guo and X. Wang, Quasi-Monte Caro fitering in noninear dynamic systems, Signa Processing, IEEE Transactions on, vo. 54, no. 6, pp , 6. [5] M. Aruampaam, S. Maske, N. Gordon, and T. Capp, A tutoria on partice fiters for onine noninear/non-gaussian Bayesian tracking, IEEE Transactions on signa processing, vo. 5, no., pp ,. [6] N. Oudjane and C. Musso, Progressive correction for reguarized partice fiters, in Information Fusion,. FUSION. Proceedings of the Third Internationa Conference on, vo.. IEEE,. [7] N. Gordon, D. Samond, and A. Smith, Nove approach to noninear/non-gaussian Bayesian state estimation, in Radar and Signa Processing, IEE Proceedings F, vo. 4, no.. IET, 993, pp [8] F. LeGand, C. Musso, and N. Oudjane, An anaysis of reguarized interacting partice methods for noninear fitering, in Proceedings of the 3rd IEEE European Workshop on Computer-Intensive Methods in Contro and Signa Processing. Citeseer, 998. [9] U. D. Hanebeck and V. Kumpp, Locaized Cumuative Distributions and a Mutivariate Generaization of the Cramér-von Mises Distance, in Proceedings of the 8 IEEE Internationa Conference on Mutisensor Fusion and Integration for Inteigent Systems (MFI 8), Seou, Repubic of Korea, Aug. 8, pp [] H. Eberhardt, V. Kumpp, and U. D. Hanebeck, Optima Dirac Approimation by Epoiting Independencies, in Proceedings of the American Contro Conference (ACC ), Batimore, Maryand, Jun.. [] T. Hastie, R. Tibshirani, and J. Friedman, The eements of statistica earning: data mining, inference, and prediction. Springer Verag,. [] R. Byrd, P. Lu, J. Noceda, and C. Zhu, A imited memory agorithm for bound constrained optimization, SIAM Journa on Scientific Computing, vo. 6, no. 5, pp. 9 8, 995. [3] U. D. Hanebeck, M. F. Huber, and V. Kumpp, Dirac Miture Approimation of Mutivariate Gaussian Densities, in Proceedings of the 9 IEEE Conference on Decision and Contro (CDC 9), Shanghai, China, Dec. 9. [4] B. Siverman, Density estimation for statistics and data anaysis. Chapman & Ha/CRC,

7 Eperiment Eperiment COND PR PPR SRA PSRA w.o. energy PSRA Figure 4. Eempary runs of typica partice fiter methods and the proposed deterministic agorithm for 56 partices. (COND) denotes the simpe condensation agorithm, (PR) adds a post-reguarization step, (PPR) is the progressive post-reguarization method as in Oudjane et a. [6] with α = 64, (SRA) is the naive systematic reapproimation, (PSRA w.o. energy) the proposed agorithm with α = 64 but β =, and (PSRA) the proposed agorithm with α = 64 and β =, cf. Sec. V-C for further detais. 33

8 Eperiment Eperiment.5 Mean Error og (RMSEm).5 og (RMSEm) og (n) og (n) Covariance Error og (RMSEC).5 og (RMSEC) og (n) og (n) MMCvMD og (MMCvMD).5.5 og (MMCvMD) og (n) og (n) PRSA SRA PPR PR Figure 5. Performance of the proposed method with α = 64 and β = (PRSA) versus the naïve systematic reapproimation (SRA), condensation and post-reguarization (PR) and progressive post-reguarization [6] with α = 64 (PPR) in different error metrics: RMSE of the mean and covariance matri, as we as the (shifted) mean mcvmd. More epanation can be found in the tet. 33

Stochastic Variational Inference with Gradient Linearization

Stochastic Variational Inference with Gradient Linearization Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,

More information

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance

Radar/ESM Tracking of Constant Velocity Target : Comparison of Batch (MLE) and EKF Performance adar/ racing of Constant Veocity arget : Comparison of Batch (LE) and EKF Performance I. Leibowicz homson-csf Deteis/IISA La cef de Saint-Pierre 1 Bd Jean ouin 7885 Eancourt Cede France Isabee.Leibowicz

More information

A Brief Introduction to Markov Chains and Hidden Markov Models

A Brief Introduction to Markov Chains and Hidden Markov Models A Brief Introduction to Markov Chains and Hidden Markov Modes Aen B MacKenzie Notes for December 1, 3, &8, 2015 Discrete-Time Markov Chains You may reca that when we first introduced random processes,

More information

ASummaryofGaussianProcesses Coryn A.L. Bailer-Jones

ASummaryofGaussianProcesses Coryn A.L. Bailer-Jones ASummaryofGaussianProcesses Coryn A.L. Baier-Jones Cavendish Laboratory University of Cambridge caj@mrao.cam.ac.uk Introduction A genera prediction probem can be posed as foows. We consider that the variabe

More information

Bayesian Unscented Kalman Filter for State Estimation of Nonlinear and Non-Gaussian Systems

Bayesian Unscented Kalman Filter for State Estimation of Nonlinear and Non-Gaussian Systems Bayesian Unscented Kaman Fiter for State Estimation of Noninear and Non-aussian Systems Zhong Liu, Shing-Chow Chan, Ho-Chun Wu and iafei Wu Department of Eectrica and Eectronic Engineering, he University

More information

Nonlinear Gaussian Filtering via Radial Basis Function Approximation

Nonlinear Gaussian Filtering via Radial Basis Function Approximation 51st IEEE Conference on Decision and Contro December 10-13 01 Maui Hawaii USA Noninear Gaussian Fitering via Radia Basis Function Approximation Huazhen Fang Jia Wang and Raymond A de Caafon Abstract This

More information

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c)

A Simple and Efficient Algorithm of 3-D Single-Source Localization with Uniform Cross Array Bing Xue 1 2 a) * Guangyou Fang 1 2 b and Yicai Ji 1 2 c) A Simpe Efficient Agorithm of 3-D Singe-Source Locaization with Uniform Cross Array Bing Xue a * Guangyou Fang b Yicai Ji c Key Laboratory of Eectromagnetic Radiation Sensing Technoogy, Institute of Eectronics,

More information

Optimality of Inference in Hierarchical Coding for Distributed Object-Based Representations

Optimality of Inference in Hierarchical Coding for Distributed Object-Based Representations Optimaity of Inference in Hierarchica Coding for Distributed Object-Based Representations Simon Brodeur, Jean Rouat NECOTIS, Département génie éectrique et génie informatique, Université de Sherbrooke,

More information

A proposed nonparametric mixture density estimation using B-spline functions

A proposed nonparametric mixture density estimation using B-spline functions A proposed nonparametric mixture density estimation using B-spine functions Atizez Hadrich a,b, Mourad Zribi a, Afif Masmoudi b a Laboratoire d Informatique Signa et Image de a Côte d Opae (LISIC-EA 4491),

More information

(This is a sample cover image for this issue. The actual cover is not yet available at this time.)

(This is a sample cover image for this issue. The actual cover is not yet available at this time.) (This is a sampe cover image for this issue The actua cover is not yet avaiabe at this time) This artice appeared in a journa pubished by Esevier The attached copy is furnished to the author for interna

More information

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION

NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION NEW DEVELOPMENT OF OPTIMAL COMPUTING BUDGET ALLOCATION FOR DISCRETE EVENT SIMULATION Hsiao-Chang Chen Dept. of Systems Engineering University of Pennsyvania Phiadephia, PA 904-635, U.S.A. Chun-Hung Chen

More information

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA)

FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA) 1 FRST 531 -- Mutivariate Statistics Mutivariate Discriminant Anaysis (MDA) Purpose: 1. To predict which group (Y) an observation beongs to based on the characteristics of p predictor (X) variabes, using

More information

Statistical Learning Theory: A Primer

Statistical Learning Theory: A Primer Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO

More information

Target Location Estimation in Wireless Sensor Networks Using Binary Data

Target Location Estimation in Wireless Sensor Networks Using Binary Data Target Location stimation in Wireess Sensor Networks Using Binary Data Ruixin Niu and Pramod K. Varshney Department of ectrica ngineering and Computer Science Link Ha Syracuse University Syracuse, NY 344

More information

STA 216 Project: Spline Approach to Discrete Survival Analysis

STA 216 Project: Spline Approach to Discrete Survival Analysis : Spine Approach to Discrete Surviva Anaysis November 4, 005 1 Introduction Athough continuous surviva anaysis differs much from the discrete surviva anaysis, there is certain ink between the two modeing

More information

Bayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with?

Bayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with? Bayesian Learning A powerfu and growing approach in machine earning We use it in our own decision making a the time You hear a which which coud equay be Thanks or Tanks, which woud you go with? Combine

More information

An Algorithm for Pruning Redundant Modules in Min-Max Modular Network

An Algorithm for Pruning Redundant Modules in Min-Max Modular Network An Agorithm for Pruning Redundant Modues in Min-Max Moduar Network Hui-Cheng Lian and Bao-Liang Lu Department of Computer Science and Engineering, Shanghai Jiao Tong University 1954 Hua Shan Rd., Shanghai

More information

Explicit overall risk minimization transductive bound

Explicit overall risk minimization transductive bound 1 Expicit overa risk minimization transductive bound Sergio Decherchi, Paoo Gastado, Sandro Ridea, Rodofo Zunino Dept. of Biophysica and Eectronic Engineering (DIBE), Genoa University Via Opera Pia 11a,

More information

Structural Control of Probabilistic Boolean Networks and Its Application to Design of Real-Time Pricing Systems

Structural Control of Probabilistic Boolean Networks and Its Application to Design of Real-Time Pricing Systems Preprints of the 9th Word Congress The Internationa Federation of Automatic Contro Structura Contro of Probabiistic Booean Networks and Its Appication to Design of Rea-Time Pricing Systems Koichi Kobayashi

More information

Combining reaction kinetics to the multi-phase Gibbs energy calculation

Combining reaction kinetics to the multi-phase Gibbs energy calculation 7 th European Symposium on Computer Aided Process Engineering ESCAPE7 V. Pesu and P.S. Agachi (Editors) 2007 Esevier B.V. A rights reserved. Combining reaction inetics to the muti-phase Gibbs energy cacuation

More information

Melodic contour estimation with B-spline models using a MDL criterion

Melodic contour estimation with B-spline models using a MDL criterion Meodic contour estimation with B-spine modes using a MDL criterion Damien Loive, Ney Barbot, Oivier Boeffard IRISA / University of Rennes 1 - ENSSAT 6 rue de Kerampont, B.P. 80518, F-305 Lannion Cedex

More information

Adaptive Localization in a Dynamic WiFi Environment Through Multi-view Learning

Adaptive Localization in a Dynamic WiFi Environment Through Multi-view Learning daptive Locaization in a Dynamic WiFi Environment Through Muti-view Learning Sinno Jiain Pan, James T. Kwok, Qiang Yang, and Jeffrey Junfeng Pan Department of Computer Science and Engineering Hong Kong

More information

BP neural network-based sports performance prediction model applied research

BP neural network-based sports performance prediction model applied research Avaiabe onine www.jocpr.com Journa of Chemica and Pharmaceutica Research, 204, 6(7:93-936 Research Artice ISSN : 0975-7384 CODEN(USA : JCPRC5 BP neura networ-based sports performance prediction mode appied

More information

V.B The Cluster Expansion

V.B The Cluster Expansion V.B The Custer Expansion For short range interactions, speciay with a hard core, it is much better to repace the expansion parameter V( q ) by f( q ) = exp ( βv( q )), which is obtained by summing over

More information

Lobontiu: System Dynamics for Engineering Students Website Chapter 3 1. z b z

Lobontiu: System Dynamics for Engineering Students Website Chapter 3 1. z b z Chapter W3 Mechanica Systems II Introduction This companion website chapter anayzes the foowing topics in connection to the printed-book Chapter 3: Lumped-parameter inertia fractions of basic compiant

More information

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons

Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Brandon Maone Department of Computer Science University of Hesini February 18, 2014 Abstract This document derives, in excrutiating

More information

Intuitionistic Fuzzy Optimization Technique for Nash Equilibrium Solution of Multi-objective Bi-Matrix Games

Intuitionistic Fuzzy Optimization Technique for Nash Equilibrium Solution of Multi-objective Bi-Matrix Games Journa of Uncertain Systems Vo.5, No.4, pp.27-285, 20 Onine at: www.jus.org.u Intuitionistic Fuzzy Optimization Technique for Nash Equiibrium Soution of Muti-objective Bi-Matri Games Prasun Kumar Naya,,

More information

V.B The Cluster Expansion

V.B The Cluster Expansion V.B The Custer Expansion For short range interactions, speciay with a hard core, it is much better to repace the expansion parameter V( q ) by f(q ) = exp ( βv( q )) 1, which is obtained by summing over

More information

18-660: Numerical Methods for Engineering Design and Optimization

18-660: Numerical Methods for Engineering Design and Optimization 8-660: Numerica Methods for Engineering esign and Optimization in i epartment of ECE Carnegie Meon University Pittsburgh, PA 523 Side Overview Conjugate Gradient Method (Part 4) Pre-conditioning Noninear

More information

An Information Geometrical View of Stationary Subspace Analysis

An Information Geometrical View of Stationary Subspace Analysis An Information Geometrica View of Stationary Subspace Anaysis Motoaki Kawanabe, Wojciech Samek, Pau von Bünau, and Frank C. Meinecke Fraunhofer Institute FIRST, Kekuéstr. 7, 12489 Berin, Germany Berin

More information

Statistical Learning Theory: a Primer

Statistical Learning Theory: a Primer ??,??, 1 6 (??) c?? Kuwer Academic Pubishers, Boston. Manufactured in The Netherands. Statistica Learning Theory: a Primer THEODOROS EVGENIOU AND MASSIMILIANO PONTIL Center for Bioogica and Computationa

More information

Translation Microscopy (TRAM) for super-resolution imaging.

Translation Microscopy (TRAM) for super-resolution imaging. ransation Microscopy (RAM) for super-resoution imaging. Zhen Qiu* 1,,3, Rhodri S Wison* 1,3, Yuewei Liu 1,3, Aison Dun 1,3, Rebecca S Saeeb 1,3, Dongsheng Liu 4, Coin Ricman 1,3, Rory R Duncan 1,3,5, Weiping

More information

XSAT of linear CNF formulas

XSAT of linear CNF formulas XSAT of inear CN formuas Bernd R. Schuh Dr. Bernd Schuh, D-50968 Kön, Germany; bernd.schuh@netcoogne.de eywords: compexity, XSAT, exact inear formua, -reguarity, -uniformity, NPcompeteness Abstract. Open

More information

Asynchronous Control for Coupled Markov Decision Systems

Asynchronous Control for Coupled Markov Decision Systems INFORMATION THEORY WORKSHOP (ITW) 22 Asynchronous Contro for Couped Marov Decision Systems Michae J. Neey University of Southern Caifornia Abstract This paper considers optima contro for a coection of

More information

Research Article New Iterative Method: An Application for Solving Fractional Physical Differential Equations

Research Article New Iterative Method: An Application for Solving Fractional Physical Differential Equations Abstract and Appied Anaysis Voume 203, Artice ID 6700, 9 pages http://d.doi.org/0.55/203/6700 Research Artice New Iterative Method: An Appication for Soving Fractiona Physica Differentia Equations A. A.

More information

II. PROBLEM. A. Description. For the space of audio signals

II. PROBLEM. A. Description. For the space of audio signals CS229 - Fina Report Speech Recording based Language Recognition (Natura Language) Leopod Cambier - cambier; Matan Leibovich - matane; Cindy Orozco Bohorquez - orozcocc ABSTRACT We construct a rea time

More information

CS229 Lecture notes. Andrew Ng

CS229 Lecture notes. Andrew Ng CS229 Lecture notes Andrew Ng Part IX The EM agorithm In the previous set of notes, we taked about the EM agorithm as appied to fitting a mixture of Gaussians. In this set of notes, we give a broader view

More information

Determining The Degree of Generalization Using An Incremental Learning Algorithm

Determining The Degree of Generalization Using An Incremental Learning Algorithm Determining The Degree of Generaization Using An Incrementa Learning Agorithm Pabo Zegers Facutad de Ingeniería, Universidad de os Andes San Caros de Apoquindo 22, Las Condes, Santiago, Chie pzegers@uandes.c

More information

Paragraph Topic Classification

Paragraph Topic Classification Paragraph Topic Cassification Eugene Nho Graduate Schoo of Business Stanford University Stanford, CA 94305 enho@stanford.edu Edward Ng Department of Eectrica Engineering Stanford University Stanford, CA

More information

Uniformly Reweighted Belief Propagation: A Factor Graph Approach

Uniformly Reweighted Belief Propagation: A Factor Graph Approach Uniformy Reweighted Beief Propagation: A Factor Graph Approach Henk Wymeersch Chamers University of Technoogy Gothenburg, Sweden henkw@chamers.se Federico Penna Poitecnico di Torino Torino, Itay federico.penna@poito.it

More information

Multilayer Kerceptron

Multilayer Kerceptron Mutiayer Kerceptron Zotán Szabó, András Lőrincz Department of Information Systems, Facuty of Informatics Eötvös Loránd University Pázmány Péter sétány 1/C H-1117, Budapest, Hungary e-mai: szzoi@csetehu,

More information

From Margins to Probabilities in Multiclass Learning Problems

From Margins to Probabilities in Multiclass Learning Problems From Margins to Probabiities in Muticass Learning Probems Andrea Passerini and Massimiiano Ponti 2 and Paoo Frasconi 3 Abstract. We study the probem of muticass cassification within the framework of error

More information

Paper presented at the Workshop on Space Charge Physics in High Intensity Hadron Rings, sponsored by Brookhaven National Laboratory, May 4-7,1998

Paper presented at the Workshop on Space Charge Physics in High Intensity Hadron Rings, sponsored by Brookhaven National Laboratory, May 4-7,1998 Paper presented at the Workshop on Space Charge Physics in High ntensity Hadron Rings, sponsored by Brookhaven Nationa Laboratory, May 4-7,998 Noninear Sef Consistent High Resoution Beam Hao Agorithm in

More information

arxiv: v1 [cs.lg] 31 Oct 2017

arxiv: v1 [cs.lg] 31 Oct 2017 ACCELERATED SPARSE SUBSPACE CLUSTERING Abofaz Hashemi and Haris Vikao Department of Eectrica and Computer Engineering, University of Texas at Austin, Austin, TX, USA arxiv:7.26v [cs.lg] 3 Oct 27 ABSTRACT

More information

A. Distribution of the test statistic

A. Distribution of the test statistic A. Distribution of the test statistic In the sequentia test, we first compute the test statistic from a mini-batch of size m. If a decision cannot be made with this statistic, we keep increasing the mini-batch

More information

Appendix for Stochastic Gradient Monomial Gamma Sampler

Appendix for Stochastic Gradient Monomial Gamma Sampler 3 4 5 6 7 8 9 3 4 5 6 7 8 9 3 4 5 6 7 8 9 3 3 3 33 34 35 36 37 38 39 4 4 4 43 44 45 46 47 48 49 5 5 5 53 54 Appendix for Stochastic Gradient Monomia Gamma Samper A The Main Theorem We provide the foowing

More information

Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps

Efficient Visual-Inertial Navigation using a Rolling-Shutter Camera with Inaccurate Timestamps Efficient Visua-Inertia Navigation using a Roing-Shutter Camera with Inaccurate Timestamps Chao X. Guo, Dimitrios G. Kottas, Ryan C. DuToit Ahmed Ahmed, Ruipeng Li and Stergios I. Roumeiotis Mutipe Autonomous

More information

Deep Gaussian Processes for Multi-fidelity Modeling

Deep Gaussian Processes for Multi-fidelity Modeling Deep Gaussian Processes for Muti-fideity Modeing Kurt Cutajar EURECOM Sophia Antipois, France Mark Puin Andreas Damianou Nei Lawrence Javier Gonzáez Abstract Muti-fideity modes are prominenty used in various

More information

Separation of Variables and a Spherical Shell with Surface Charge

Separation of Variables and a Spherical Shell with Surface Charge Separation of Variabes and a Spherica She with Surface Charge In cass we worked out the eectrostatic potentia due to a spherica she of radius R with a surface charge density σθ = σ cos θ. This cacuation

More information

17 Lecture 17: Recombination and Dark Matter Production

17 Lecture 17: Recombination and Dark Matter Production PYS 652: Astrophysics 88 17 Lecture 17: Recombination and Dark Matter Production New ideas pass through three periods: It can t be done. It probaby can be done, but it s not worth doing. I knew it was

More information

Hierarchical Fault Response Modeling of Analog/RF Circuits. Gurusubrahmaniyan Subrahmaniyan Radhakrishnan

Hierarchical Fault Response Modeling of Analog/RF Circuits. Gurusubrahmaniyan Subrahmaniyan Radhakrishnan Hierarchica Faut Response Modeing of Anaog/RF Circuits by Gurusubrahmaniyan Subrahmaniyan Radhakrishnan A Thesis Presented in Partia Fufiment of the Requirements for the Degree Master of Science Approved

More information

arxiv: v1 [math.ca] 6 Mar 2017

arxiv: v1 [math.ca] 6 Mar 2017 Indefinite Integras of Spherica Besse Functions MIT-CTP/487 arxiv:703.0648v [math.ca] 6 Mar 07 Joyon K. Boomfied,, Stephen H. P. Face,, and Zander Moss, Center for Theoretica Physics, Laboratory for Nucear

More information

Incremental Reformulated Automatic Relevance Determination

Incremental Reformulated Automatic Relevance Determination IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 60, NO. 9, SEPTEMBER 22 4977 Incrementa Reformuated Automatic Reevance Determination Dmitriy Shutin, Sanjeev R. Kukarni, and H. Vincent Poor Abstract In this

More information

The EM Algorithm applied to determining new limit points of Mahler measures

The EM Algorithm applied to determining new limit points of Mahler measures Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,

More information

https://doi.org/ /epjconf/

https://doi.org/ /epjconf/ HOW TO APPLY THE OPTIMAL ESTIMATION METHOD TO YOUR LIDAR MEASUREMENTS FOR IMPROVED RETRIEVALS OF TEMPERATURE AND COMPOSITION R. J. Sica 1,2,*, A. Haefee 2,1, A. Jaai 1, S. Gamage 1 and G. Farhani 1 1 Department

More information

Computing Spherical Transform and Convolution on the 2-Sphere

Computing Spherical Transform and Convolution on the 2-Sphere Computing Spherica Transform and Convoution on the 2-Sphere Boon Thye Thomas Yeo ythomas@mit.edu May, 25 Abstract We propose a simpe extension to the Least-Squares method of projecting sampes of an unknown

More information

Moreau-Yosida Regularization for Grouped Tree Structure Learning

Moreau-Yosida Regularization for Grouped Tree Structure Learning Moreau-Yosida Reguarization for Grouped Tree Structure Learning Jun Liu Computer Science and Engineering Arizona State University J.Liu@asu.edu Jieping Ye Computer Science and Engineering Arizona State

More information

FOURIER SERIES ON ANY INTERVAL

FOURIER SERIES ON ANY INTERVAL FOURIER SERIES ON ANY INTERVAL Overview We have spent considerabe time earning how to compute Fourier series for functions that have a period of 2p on the interva (-p,p). We have aso seen how Fourier series

More information

Information-Based Adaptive Sensor Management for Sensor Networks

Information-Based Adaptive Sensor Management for Sensor Networks 2011 American Contro Conference on O'Farre Street, San Francisco, CA, USA June 29 - Juy 01, 2011 Information-Based Adaptive Sensor Management for Sensor Networks Karen L. Jenkins and David A. Castañón

More information

DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM

DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM DIGITAL FILTER DESIGN OF IIR FILTERS USING REAL VALUED GENETIC ALGORITHM MIKAEL NILSSON, MATTIAS DAHL AND INGVAR CLAESSON Bekinge Institute of Technoogy Department of Teecommunications and Signa Processing

More information

Recursive Bayesian Initialization of Localization Based on Ranging and Dead Reckoning

Recursive Bayesian Initialization of Localization Based on Ranging and Dead Reckoning Recursive Bayesian Initiaization of Locaization Based on Ranging and Dead Reckoning John-Oof Nisson and Peter Hände Signa Processing Lab, ACCESS Linnaeus Centre KTH Roya Institute of Technoogy Osqudas

More information

Appendix for Stochastic Gradient Monomial Gamma Sampler

Appendix for Stochastic Gradient Monomial Gamma Sampler Appendix for Stochastic Gradient Monomia Gamma Samper A The Main Theorem We provide the foowing theorem to characterize the stationary distribution of the stochastic process with SDEs in (3) Theorem 3

More information

A Ridgelet Kernel Regression Model using Genetic Algorithm

A Ridgelet Kernel Regression Model using Genetic Algorithm A Ridgeet Kerne Regression Mode using Genetic Agorithm Shuyuan Yang, Min Wang, Licheng Jiao * Institute of Inteigence Information Processing, Department of Eectrica Engineering Xidian University Xi an,

More information

MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES

MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES Separation of variabes is a method to sove certain PDEs which have a warped product structure. First, on R n, a inear PDE of order m is

More information

The influence of temperature of photovoltaic modules on performance of solar power plant

The influence of temperature of photovoltaic modules on performance of solar power plant IOSR Journa of Engineering (IOSRJEN) ISSN (e): 2250-3021, ISSN (p): 2278-8719 Vo. 05, Issue 04 (Apri. 2015), V1 PP 09-15 www.iosrjen.org The infuence of temperature of photovotaic modues on performance

More information

SVM: Terminology 1(6) SVM: Terminology 2(6)

SVM: Terminology 1(6) SVM: Terminology 2(6) Andrew Kusiak Inteigent Systems Laboratory 39 Seamans Center he University of Iowa Iowa City, IA 54-57 SVM he maxima margin cassifier is simiar to the perceptron: It aso assumes that the data points are

More information

Random maps and attractors in random Boolean networks

Random maps and attractors in random Boolean networks LU TP 04-43 Rom maps attractors in rom Booean networks Björn Samuesson Car Troein Compex Systems Division, Department of Theoretica Physics Lund University, Sövegatan 4A, S-3 6 Lund, Sweden Dated: 005-05-07)

More information

STABILITY OF A PARAMETRICALLY EXCITED DAMPED INVERTED PENDULUM 1. INTRODUCTION

STABILITY OF A PARAMETRICALLY EXCITED DAMPED INVERTED PENDULUM 1. INTRODUCTION Journa of Sound and Vibration (996) 98(5), 643 65 STABILITY OF A PARAMETRICALLY EXCITED DAMPED INVERTED PENDULUM G. ERDOS AND T. SINGH Department of Mechanica and Aerospace Engineering, SUNY at Buffao,

More information

Introduction. Figure 1 W8LC Line Array, box and horn element. Highlighted section modelled.

Introduction. Figure 1 W8LC Line Array, box and horn element. Highlighted section modelled. imuation of the acoustic fied produced by cavities using the Boundary Eement Rayeigh Integra Method () and its appication to a horn oudspeaer. tephen Kirup East Lancashire Institute, Due treet, Bacburn,

More information

A Solution to the 4-bit Parity Problem with a Single Quaternary Neuron

A Solution to the 4-bit Parity Problem with a Single Quaternary Neuron Neura Information Processing - Letters and Reviews Vo. 5, No. 2, November 2004 LETTER A Soution to the 4-bit Parity Probem with a Singe Quaternary Neuron Tohru Nitta Nationa Institute of Advanced Industria

More information

Fitting Algorithms for MMPP ATM Traffic Models

Fitting Algorithms for MMPP ATM Traffic Models Fitting Agorithms for PP AT Traffic odes A. Nogueira, P. Savador, R. Vaadas University of Aveiro / Institute of Teecommunications, 38-93 Aveiro, Portuga; e-mai: (nogueira, savador, rv)@av.it.pt ABSTRACT

More information

Discrete Techniques. Chapter Introduction

Discrete Techniques. Chapter Introduction Chapter 3 Discrete Techniques 3. Introduction In the previous two chapters we introduced Fourier transforms of continuous functions of the periodic and non-periodic (finite energy) type, as we as various

More information

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries

First-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische

More information

AST 418/518 Instrumentation and Statistics

AST 418/518 Instrumentation and Statistics AST 418/518 Instrumentation and Statistics Cass Website: http://ircamera.as.arizona.edu/astr_518 Cass Texts: Practica Statistics for Astronomers, J.V. Wa, and C.R. Jenkins, Second Edition. Measuring the

More information

Inductive Bias: How to generalize on novel data. CS Inductive Bias 1

Inductive Bias: How to generalize on novel data. CS Inductive Bias 1 Inductive Bias: How to generaize on nove data CS 478 - Inductive Bias 1 Overfitting Noise vs. Exceptions CS 478 - Inductive Bias 2 Non-Linear Tasks Linear Regression wi not generaize we to the task beow

More information

Turbo Codes. Coding and Communication Laboratory. Dept. of Electrical Engineering, National Chung Hsing University

Turbo Codes. Coding and Communication Laboratory. Dept. of Electrical Engineering, National Chung Hsing University Turbo Codes Coding and Communication Laboratory Dept. of Eectrica Engineering, Nationa Chung Hsing University Turbo codes 1 Chapter 12: Turbo Codes 1. Introduction 2. Turbo code encoder 3. Design of intereaver

More information

Effective Appearance Model and Similarity Measure for Particle Filtering and Visual Tracking

Effective Appearance Model and Similarity Measure for Particle Filtering and Visual Tracking Effective Appearance Mode and Simiarity Measure for Partice Fitering and Visua Tracking Hanzi Wang David Suter and Konrad Schinder Institute for Vision Systems Engineering Department of Eectrica and Computer

More information

c 2016 Georgios Rovatsos

c 2016 Georgios Rovatsos c 2016 Georgios Rovatsos QUICKEST CHANGE DETECTION WITH APPLICATIONS TO LINE OUTAGE DETECTION BY GEORGIOS ROVATSOS THESIS Submitted in partia fufiment of the requirements for the degree of Master of Science

More information

More Scattering: the Partial Wave Expansion

More Scattering: the Partial Wave Expansion More Scattering: the Partia Wave Expansion Michae Fower /7/8 Pane Waves and Partia Waves We are considering the soution to Schrödinger s equation for scattering of an incoming pane wave in the z-direction

More information

Statistics for Applications. Chapter 7: Regression 1/43

Statistics for Applications. Chapter 7: Regression 1/43 Statistics for Appications Chapter 7: Regression 1/43 Heuristics of the inear regression (1) Consider a coud of i.i.d. random points (X i,y i ),i =1,...,n : 2/43 Heuristics of the inear regression (2)

More information

Appendix of the Paper The Role of No-Arbitrage on Forecasting: Lessons from a Parametric Term Structure Model

Appendix of the Paper The Role of No-Arbitrage on Forecasting: Lessons from a Parametric Term Structure Model Appendix of the Paper The Roe of No-Arbitrage on Forecasting: Lessons from a Parametric Term Structure Mode Caio Ameida cameida@fgv.br José Vicente jose.vaentim@bcb.gov.br June 008 1 Introduction In this

More information

Some Measures for Asymmetry of Distributions

Some Measures for Asymmetry of Distributions Some Measures for Asymmetry of Distributions Georgi N. Boshnakov First version: 31 January 2006 Research Report No. 5, 2006, Probabiity and Statistics Group Schoo of Mathematics, The University of Manchester

More information

BDD-Based Analysis of Gapped q-gram Filters

BDD-Based Analysis of Gapped q-gram Filters BDD-Based Anaysis of Gapped q-gram Fiters Marc Fontaine, Stefan Burkhardt 2 and Juha Kärkkäinen 2 Max-Panck-Institut für Informatik Stuhsatzenhausweg 85, 6623 Saarbrücken, Germany e-mai: stburk@mpi-sb.mpg.de

More information

Gauss Law. 2. Gauss s Law: connects charge and field 3. Applications of Gauss s Law

Gauss Law. 2. Gauss s Law: connects charge and field 3. Applications of Gauss s Law Gauss Law 1. Review on 1) Couomb s Law (charge and force) 2) Eectric Fied (fied and force) 2. Gauss s Law: connects charge and fied 3. Appications of Gauss s Law Couomb s Law and Eectric Fied Couomb s

More information

Physics 127c: Statistical Mechanics. Fermi Liquid Theory: Collective Modes. Boltzmann Equation. The quasiparticle energy including interactions

Physics 127c: Statistical Mechanics. Fermi Liquid Theory: Collective Modes. Boltzmann Equation. The quasiparticle energy including interactions Physics 27c: Statistica Mechanics Fermi Liquid Theory: Coective Modes Botzmann Equation The quasipartice energy incuding interactions ε p,σ = ε p + f(p, p ; σ, σ )δn p,σ, () p,σ with ε p ε F + v F (p p

More information

A Novel Learning Method for Elman Neural Network Using Local Search

A Novel Learning Method for Elman Neural Network Using Local Search Neura Information Processing Letters and Reviews Vo. 11, No. 8, August 2007 LETTER A Nove Learning Method for Eman Neura Networ Using Loca Search Facuty of Engineering, Toyama University, Gofuu 3190 Toyama

More information

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization

Scalable Spectrum Allocation for Large Networks Based on Sparse Optimization Scaabe Spectrum ocation for Large Networks ased on Sparse Optimization innan Zhuang Modem R&D Lab Samsung Semiconductor, Inc. San Diego, C Dongning Guo, Ermin Wei, and Michae L. Honig Department of Eectrica

More information

A Statistical Framework for Real-time Event Detection in Power Systems

A Statistical Framework for Real-time Event Detection in Power Systems 1 A Statistica Framework for Rea-time Event Detection in Power Systems Noan Uhrich, Tim Christman, Phiip Swisher, and Xichen Jiang Abstract A quickest change detection (QCD) agorithm is appied to the probem

More information

LINK BETWEEN THE JOINT DIAGONALISATION OF SYMMETRICAL CUBES AND PARAFAC: AN APPLICATION TO SECONDARY SURVEILLANCE RADAR

LINK BETWEEN THE JOINT DIAGONALISATION OF SYMMETRICAL CUBES AND PARAFAC: AN APPLICATION TO SECONDARY SURVEILLANCE RADAR LINK BETWEEN THE JOINT DIAGONALISATION OF SYMMETRICAL CUBES AND PARAFAC: AN APPLICATION TO SECONDARY SURVEILLANCE RADAR Nicoas PETROCHILOS CReSTIC, University of Reims Mouins de a Housse, BP 1039 51687

More information

Haar Decomposition and Reconstruction Algorithms

Haar Decomposition and Reconstruction Algorithms Jim Lambers MAT 773 Fa Semester 018-19 Lecture 15 and 16 Notes These notes correspond to Sections 4.3 and 4.4 in the text. Haar Decomposition and Reconstruction Agorithms Decomposition Suppose we approximate

More information

C. Fourier Sine Series Overview

C. Fourier Sine Series Overview 12 PHILIP D. LOEWEN C. Fourier Sine Series Overview Let some constant > be given. The symboic form of the FSS Eigenvaue probem combines an ordinary differentia equation (ODE) on the interva (, ) with a

More information

Control Chart For Monitoring Nonparametric Profiles With Arbitrary Design

Control Chart For Monitoring Nonparametric Profiles With Arbitrary Design Contro Chart For Monitoring Nonparametric Profies With Arbitrary Design Peihua Qiu 1 and Changiang Zou 2 1 Schoo of Statistics, University of Minnesota, USA 2 LPMC and Department of Statistics, Nankai

More information

Fast Blind Recognition of Channel Codes

Fast Blind Recognition of Channel Codes Fast Bind Recognition of Channe Codes Reza Moosavi and Erik G. Larsson Linköping University Post Print N.B.: When citing this work, cite the origina artice. 213 IEEE. Persona use of this materia is permitted.

More information

Lecture Note 3: Stationary Iterative Methods

Lecture Note 3: Stationary Iterative Methods MATH 5330: Computationa Methods of Linear Agebra Lecture Note 3: Stationary Iterative Methods Xianyi Zeng Department of Mathematica Sciences, UTEP Stationary Iterative Methods The Gaussian eimination (or

More information

A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes

A Fundamental Storage-Communication Tradeoff in Distributed Computing with Straggling Nodes A Fundamenta Storage-Communication Tradeoff in Distributed Computing with Stragging odes ifa Yan, Michèe Wigger LTCI, Téécom ParisTech 75013 Paris, France Emai: {qifa.yan, michee.wigger} @teecom-paristech.fr

More information

Algorithms to solve massively under-defined systems of multivariate quadratic equations

Algorithms to solve massively under-defined systems of multivariate quadratic equations Agorithms to sove massivey under-defined systems of mutivariate quadratic equations Yasufumi Hashimoto Abstract It is we known that the probem to sove a set of randomy chosen mutivariate quadratic equations

More information

A Comparison Study of the Test for Right Censored and Grouped Data

A Comparison Study of the Test for Right Censored and Grouped Data Communications for Statistica Appications and Methods 2015, Vo. 22, No. 4, 313 320 DOI: http://dx.doi.org/10.5351/csam.2015.22.4.313 Print ISSN 2287-7843 / Onine ISSN 2383-4757 A Comparison Study of the

More information

THE OUT-OF-PLANE BEHAVIOUR OF SPREAD-TOW FABRICS

THE OUT-OF-PLANE BEHAVIOUR OF SPREAD-TOW FABRICS ECCM6-6 TH EUROPEAN CONFERENCE ON COMPOSITE MATERIALS, Sevie, Spain, -6 June 04 THE OUT-OF-PLANE BEHAVIOUR OF SPREAD-TOW FABRICS M. Wysocki a,b*, M. Szpieg a, P. Heström a and F. Ohsson c a Swerea SICOMP

More information

Sequential Decoding of Polar Codes with Arbitrary Binary Kernel

Sequential Decoding of Polar Codes with Arbitrary Binary Kernel Sequentia Decoding of Poar Codes with Arbitrary Binary Kerne Vera Miosavskaya, Peter Trifonov Saint-Petersburg State Poytechnic University Emai: veram,petert}@dcn.icc.spbstu.ru Abstract The probem of efficient

More information

Substructuring Preconditioners for the Bidomain Extracellular Potential Problem

Substructuring Preconditioners for the Bidomain Extracellular Potential Problem Substructuring Preconditioners for the Bidomain Extraceuar Potentia Probem Mico Pennacchio 1 and Vaeria Simoncini 2,1 1 IMATI - CNR, via Ferrata, 1, 27100 Pavia, Itay mico@imaticnrit 2 Dipartimento di

More information