FastSLAM 2.0: An Improved Particle Filtering Algorithm for Simultaneous Localization and Mapping that Provably Converges

Size: px
Start display at page:

Download "FastSLAM 2.0: An Improved Particle Filtering Algorithm for Simultaneous Localization and Mapping that Provably Converges"

Transcription

1 Proceedings of IJCAI 2003 FasSLAM 2.0: An Improved Paricle Filering Algorihm for Simulaneous Localizaion and Mapping ha Provably Converges Michael Monemerlo and Sebasian Thrun School of Compuer Science Carnegie Mellon Universiy Pisburgh, PA Absrac In [15], Monemerlo e al. proposed an algorihm called FasSLAM as an efficien and robus soluion o he simulaneous localizaion and mapping problem. This paper describes a modified version of FasSLAM which overcomes imporan deficiencies of he original algorihm. We prove convergence of his new algorihm for linear SLAM problems and provide real-world experimenal resuls ha illusrae an order of magniude improvemen in accuracy over he original FasSLAM algorihm. 1 Inroducion Simulaneous localizaion and mapping (SLAM) is a highly acive research area in roboics and AI. The SLAM problem arises when a moving vehicle (e.g. a mobile robo, submarine, or drone) simulaneously esimaes a map of is environmen and is pose relaive o ha map. In he absence of global posiion informaion, he vehicle s pose esimae will become increasingly inaccurae, as will is map. Since maps may conain housands of eniies, acquiring large, accurae maps is a challenging saisical esimaion problem, especially when performed in real-ime. Mos presen-day research on SLAM originaes from a seminal paper by Smih and Cheeseman [21], which proposed he use of he exended Kalman filer (EKF) for solving SLAM. This paper is based on he insighs ha errors in he map and pose errors are naurally correlaed, and ha he covariance marix mainained by he EKF expresses such correlaions. Newmann [18] recenly proved ha he EKF converges for linear SLAM problems, where he moion model and observaion model are linear funcions wih Gaussian noise (see below). Unforunaely, EKF covariance marices are quadraic in he size of he map, and updaing hem requires ime quadraic in he number of landmarks N. This quadraic complexiy has long been recognized o be a major obsacle in scaling SLAM algorihms o maps wih more han a few hundred feaures. I also limis he applicabiliy of SLAM algorihms o problems wih ambiguous landmarks, which induces a daa associaion problem [2; 22]. Today s mos robus algorihms for SLAM wih unknown daa associaion mainain muliple hypoheses (racks), which increase heir compuaional complexiy. Consequenly, here has been a flurry on research on more efficien SLAM echniques (see e.g., [11]). One group of researchers has developed echniques ha recursively divide maps ino submaps, hereby confining mos compuaion o small regions. Some of hese approaches sill mainain global correlaions among hose submaps, hence are quadraic bu Daphne Koller and Ben Wegbrei Compuer Science Deparmen Sanford Universiy Sanford, CA wih a much reduced consan facor [1; 7; 23; 26]. Ohers resric he updae exclusively o local maps [12], hence operae in consan ime (assuming known daa associaion). A second group of researchers has developed echniques ha represen maps hrough poenial funcions beween adjacen landmarks, similar o Markov random fields. The resuling represenaions require memory linear in he number of landmarks [19; 24]. Under appropriae approximaions, such echniques have been shown o provide consan ime updaing (again for known daa associaion). Unforunaely, no convergence proof exiss for any of hese exensions of he EKF, even for he generic case of linear SLAM. Furhermore, if landmarks are ambiguous, all of hese approaches have o perform search o find appropriae daa associaion hypoheses, adding a logarihmic facor o heir updae complexiy. The FasSLAM algorihm, proposed in [15] as an efficien approach o SLAM based on paricle filering [6], does no fall ino eiher of he caegories above. FasSLAM akes advanage of an imporan characerisic of he SLAM problem (wih known daa associaion): landmark esimaes are condiionally independen given he robo s pah [17]. FasSLAM uses a paricle filer o sample over robo pahs. Each paricle possesses N low-dimensional EKFs, one for each of he N landmarks. This represenaion requires O(NM) memory, where M is he number of paricles in he paricle filer. Updaing his filer requires O(M log N) ime, wih or wihou knowledge of he daa associaions. However, he number of paricles M needed for convergence is unknown and has been suspeced o be exponenial in he size of he map, in he wors-case. This paper proposes an improved version of he FasSLAM algorihm. The modificaion is concepually simple: When proposing a new robo pose an essenial sep in FasSLAM s paricle filer our proposal disribuion relies no only on he moion esimae (as is he case in FasSLAM), bu also on he mos recen sensor measuremen. Such an approach is less waseful wih is samples han he original FasSLAM algorihm, especially in siuaions where he noise in moion is high relaive o he measuremen noise. To obain a suiable proposal disribuion, our algorihm linearizes he moion and he measuremen model in he same manner as he EKF. As a resul, he proposal disribuion can be calculaed in closed form. This exension parallels prior work by Douce and colleagues, who proposed a similar modificaion for general paricle filers [6] and MCMC echniques for neural neworks [4]. I is similar o he arc reversal echnique proposed for paricle filers applied o Bayes neworks [10], and i is similar o recen work by van der Merwe [25], who uses an unscened filering sep [9] for generaing proposal disribuions ha accommodae he measuremen.

2 While his modificaion is concepually simple, i has imporan ramificaions. A key conribuion of his paper is a convergence proof for linear SLAM problems using a single paricle. The resuling algorihm requires consan updaing ime. To our knowledge, he bes previous SLAM algorihm for which convergence was shown requires quadraic updae ime. Furhermore, we observe experimenally ha our new FasSLAM algorihm, even wih a single paricle, yields significanly more accurae resuls on a challenging real-world benchmark [7] han he previous version of he algorihm. These findings are of significance, as many mobile robo sysems are plagued by conrol noise, bu possess relaively accurae sensors. Moreover, hey conradic a common belief ha mainaining he enire covariance marix is required for convergence [5]. 2 Simulaneous Localizaion and Mapping Simulaneous localizaion and mapping (SLAM) addresses he problem of simulaneously recovering a map and a vehicle pose from sensor daa. The map conains N feaures (landmarks) and shall be denoed Θ = θ 1,..., θ N. The pah of he vehicle will be denoed s = s 1,..., s, where is a ime index and s is he pose of he vehicle a ime. Mos sae-of-he-ar SLAM algorihms calculae (or approximae) varians of he following poserior disribuion: p(θ, s z, u, n ) (1) where z = z 1,..., z is a sequence of measuremens (e.g., range and bearing o nearby landmarks), and u = u 1,..., u is a sequence of robo conrols (e.g., velociies for robo wheels). (As usual, we assume wihou loss of generaliy ha only a single landmark is observed a each ime.) The variables n = n 1,..., n are daa associaion variables each n specifies he ideniy of he landmark observed a ime. Iniially, we assume n is known; we relax his assumpion below. To calculae he poserior (1), he vehicle is given a probabilisic moion model, in he form of he condiional probabiliy disribuion p(s u, s 1 ). This disribuion describes how a conrol u, assered in he ime inerval [ 1; ), affecs he resuling pose. Addiionally, he vehicle is given a probabilisic measuremen model, denoed p(z s, Θ, n ), describing how measuremens evolve from sae. In accordance o he rich SLAM lieraure, we will model boh models by nonlinear funcions wih independen Gaussian noise: p(z s, Θ, n ) = g(s, θ n ) + ε (2) p(s u, s 1) = h(u, s 1) + δ (3) Here g and h are nonlinear funcions, and ε and δ are Gaussian noise variables wih covariance R and P, respecively. 3 FasSLAM FasSLAM [15] is based on he imporan observaion [17] ha he poserior can be facored p(θ, s z, u, n ) = p(s z, u, n ) n p(θ n s, z, u, n ) (4) This facorizaion is exac and universal in SLAM problems. I saes ha if one (hypoheically) knew he pah of he vehicle, he landmark posiions could be esimaed independenly of each oher (hence he produc over n). In pracice, of course, one does no know he vehicle s pah. Neverheless, he independence makes i possible o facor he poserior ino a erm ha esimaes he probabiliy of each pah, and N erms ha esimae he posiion of he landmarks, condiioned on each (hypoheical) pah. FasSLAM samples he pah using a paricle filer. Each paricle has aached is own map, consising of N exended Kalman filers. Formally, he m-h paricle S conains a pah s, along wih Gaussian N landmark esimaes, described by he mean n, and covariance Σ n, : = s,, 1,, Σ 1,,..., µ N,, Σ N, (5) landmark θ 1 landmark θ N S We briefly reviews he key equaions of he regular Fas- SLAM algorihm, and refer he reader o [15]. Each updae in FasSLAM begins wih sampling new poses based on he mos recen moion command u : p(s s, u). (6) s Noe ha his proposal disribuion only uses he moion command u, bu ignores he measuremen z. Nex, FasSLAM updaes he esimae of he observed landmark(s), according o he following poserior. This poserior akes he measuremen z ino consideraion: 1 p(θ n s,, n, z ) (7) = η p(z θ n, s, n ) N (z ;g(θ n,s ),R ) p(θ n s 1,, z 1, n 1 ) N (θ n ; n, 1,Σ n, 1 ) Here η is a consan. This poserior is he normalized produc of wo Gaussians as indicaed. However, if g is non-linear, he produc will no be Gaussian in general. To make he resul Gaussian, FasSLAM employs he sandard EKF rick [13]: g is approximaed by a linear funcion (see below). Under his approximaion, (7) is equivalen o he measuremen updae equaion familiar from he EKF lieraure [13]. In a final sep, FasSLAM correcs for he fac ha he pose sample s has been generaed wihou consideraion of he mos recen measuremen. I does so by resampling he paricles [20]. The probabiliy for he m-h paricle o be sampled (wih replacemen) is given by he following variable w, commonly referred o as imporance facor: w = η p(z θ n, s, n ) N (z ;g(θ n,s ),R ) p(θ n s 1,, z 1, n 1 ) N ( n, 1,Σ n, 1 ) dθ n As shown in [15], he resampling operaion can be implemened in O(M log N) ime using rees, where M is he number of samples and N he number of landmarks in he map. However, he number of paricles M needed for convergence remains an open quesion. FasSLAM has been exended o SLAM wih unknown daa associaions [14]. If he daa associaion is unknown, each paricle m in FasSLAM makes is own local daa associaion decision ˆn, by maximizing he measuremen likelihood. The formula for finding he mos likely daa associaion maximizes he resuling imporance weigh: ˆn = argmax n w (n ) (8)

3 Here w (n ) makes he dependence of he facor w on he variable n explici. A key characerisic of FasSLAM is ha each paricle makes is own local daa associaion. In conras, EKF echniques mus commi o a single daa associaion hypohesis for he enire filer. Resuls in [14] show empirically ha his difference renders FasSLAM significanly more robus o noise han EKF-syle algorihms. 4 FasSLAM 2.0 Our new FasSLAM algorihm is based on an obvious inefficiency arising from he proposal disribuion of regular Fas- SLAM. In regular FasSLAM, he pose s is sampled in accordance o he predicion arising from he moion command u, as specified in (6). I does no consider he measuremen z acquired a ime ; insead, he measuremen is incorporaed hrough resampling. This approach is paricularly roublesome if he noise in he vehicle moion is large relaive o he measuremen noise. In such siuaions, sampled poses will mosly fall ino areas of low measuremen likelihood, and will subsequenly be erminaed in he resampling phase wih high probabiliy. Unforunaely, many real-world robo sysems are characerized by relaively high moion noise. As illusraed in he experimenal resuls secion of his paper, he wase incurred by his inefficien sampling scheme can be significan. 4.1 Sampling The Pose FasSLAM 2.0 implemens a single new idea: Poses are sampled under consideraion of boh he moion u and he measuremen z. This is formally denoed by he following sampling disribuion, which now akes he measuremen z ino consideraion: s p(s s 1,, u, z, n ) (9) In comparison o (6), incorporaing he measuremen only makes sense if we incorporae our curren esimae of he observed landmark obained from he variables s 1,, u 1, z 1, n 1 (which are included of he condiioning variables above). So in essence, he difference o Fas- SLAM is ha he measuremen z is incorporaed. However, his change has imporan ramificaions. The proposal disribuion (9) can be reformulaed as follows: p(s s 1,, u, z, n ) = η p(z θ n, s, n ) N (z ;g(θn,s ),R ) p(s s 1, u) N (s ;h(s 1,u ),P ) p(θ n s 1,, z 1, n 1 ) N (θn ; n, 1,Σ n, 1 ) dθ n Tha is, he proposal disribuion is he produc of wo facors: he familiar nex sae disribuion p(s s 1, u ), and he probabiliy of he measuremen z. Calculaing he laer involves an inegraion over possible landmark locaions θ n. Unforunaely, sampling direcly from his disribuion is impossible in he general case; i does no even possess a closed form. Luckily, a closed form soluion can be aained if g is approximaed by a linear funcion (h may remain non-linear!): g(θ n, s ) ẑ + G θ (θ n n, 1) + Gs (s ŝ ) (10) where ẑ, ŝ ) denoes he prediced measure- = h(s 1, u ) he prediced robo pose, and ˆθ n = men, ŝ = g(ˆθ n n, 1 he prediced landmark locaion. The marices G θ and G s are he Jacobians (firs derivaives) of g wih respec o θ and s, respecively: G θ = θn g(θ n, s ) s =ŝ ;θ n =ˆθ (11) n G s = s g(θ n, s ) s =ŝ ;θ n =ˆθ n (12) Under his EKF-syle approximaion, he proposal disribuion (9) is Gaussian wih he following parameers: [ ] 1 Σ s = G T s Q 1 G s + P 1 (13) s = Σ G T s Q 1 (z ẑ ) + ŝ (14) where he marix Q Q s is defined as follows: = R + G θ Σ n, 1 GT θ (15) 4.2 Updaing The Observed Landmark Esimae The updaing sep remains he same as in FasSLAM (see (7)). As saed in he previous secion, g is linearized o reain Gaussianiy of he poserior. This leads o he following updae equaions, whose derivaion is equivalen o ha of he sandard EKF measuremen updae [13]: K = Σ n, 1 GT θ Q 1 (16) n, = Σ n, 1 + K (z ẑ ) (17) n, = (I K G θ )Σ n, 1 (18) 4.3 The Imporance Weighs Resampling is necessary even in our new version of Fas- SLAM, since he paricles generaed do no ye mach he desired poserior. The culpri is he normalizer η in (10), which may be differen for differen paricles m. This normalizer is he inverse of he probabiliy of he measuremen under he m-h paricle: η = p(z s 1,, u, z 1, n ) 1. To accoun for his mismach, our algorihm resamples in proporion o he following imporance facor: w p(z s 1,, u, z 1, n ) = p(z θ n, s, n ) N (z ;g(θn,s ),R ) p(θ n s 1,, u 1, z 1, n 1 ) N (θn ; n, 1,Σ n, 1 ) dθ n p(s s 1 }{{, u) ds } N (s ;ŝ 1,P ) This expression can once again be approximaed as a Gaussian by linearizing g. The mean of his Gaussian is ẑ, and is covariance is G sp G T s + G θ Σ n, 1 GT θ + R (19) 4.4 Unknown Daa Associaions The approach for handling daa associaion is similar o he one in regular FasSLAM: Again, we selec he daa associaion n ha maximizes he probabiliy of he measuremen z for he m-h paricle: ˆn = argmax n p(z n, ˆn 1,, s,, z 1, u ) (20)

4 (a) Raw vehicle odomery (b) FasSLAM 2.0, M=1 paricle (c) Same w. dynamic feaure managemen Figure 1: FasSLAM 2.0 applied o he Vicoria Park benchmark daa se using only M=1 paricle. The accuracy of he recovered pah and he resuling map is indisinguishable from ha he bes EKF-syle mehods and he original FasSLAM algorihm wih M=100 paricles. A firs glance, one may be emped o subsiue w for he probabiliy on he righ-hand side, as in regular Fas- SLAM. However, w does no consider he sampled pose s, whereas he expression here does. This leads o a slighly differen probabiliy, which is calculaed as follows. p(z n, ˆn 1,, s,, z 1, u ) = p(z θ n, n, s ) N (z ;g(θn,s ),R ) p(θ n ˆn 1,, s 1,, z 1 ) N ( n, 1,Σ n, 1 ) dθ(21) n Linearizaion of g leads o a Gaussian over z wih mean g( n,, 1 s ) and covariance Q. Boh are funcions of he daa associaion variable n. 4.5 Feaure Managemen Finally, in cases wih unknown daa associaions, feaures have o creaed dynamically. As is common for SLAM algorihms [5], our approach creaes new feaures when he measuremen probabiliy in (20) is below a hreshold. However, real-world daa wih frequen ouliers will generae spurious landmarks using his rule. Following [5], our approach removes such spurious landmarks by keeping rack of heir poserior probabiliy of exisence. Our mechanism analyzes measuremen o he presence and absence of feaures. Observing a landmark provides posiive evidence for is exisence, whereas no observing i when n falls wihin he robo s percepual range provides negaive evidence. The poserior probabiliy of landmark exisence is accumulaed by he following Bayes filer, whose log-odds form is familiar from he lieraure on occupancy grid maps [16]: τ n = ln p(i n 1 p(i n s, z, ˆn ) s, z, ˆn ) (22) Here τ n are he log-odds of he physical exisence of landmark θ n in map m, and p(i n s, z, ˆn ) is he probabilisic evidence provided by a measuremen. Under appropriae definiion of he laer, his rule provides for a simple evidence couning rule. If he log odds drops below a predefined hreshold, he corresponding landmark is removed from he map. This mechanism enables paricles o free hemselves of spurious feaures. 5 Convergence A key resul in his paper is he fac ha our new version of FasSLAM converges for M =1 paricle, for a resriced class of linear Gaussian problems (he same for which KFs converge [5; 18]). Specifically, our resul applies o SLAM problems characerized by he following linear form: g(s, θ n ) = θ n s (23) h(u, s 1) = u + s 1 (24) Linear SLAM can be hough of as a robo operaing in a Caresian space equipped wih a noise-free compass, and sensors ha measure disances o feaures along he coordinae axes. The following heorem, whose proof can be found in he appendix, saes he convergence of our new FasSLAM varian: Theorem. For linear SLAM, FasSLAM wih M =1 paricles converges in expecaion o he correc map if all feaures are observed infiniely ofen, and if he locaion of one feaure is known in advance. This heorem parallels a similar resul previously published for he Kalman filer [5; 18]. However, his resul applies o he Kalman filer, whose updae requires ime quadraic in he number of landmarks N. Wih M=1, he resampling sep becomes obsolee and each updae akes consan ime. To our knowledge, our resul is he firs convergence resul for a consan-ime SLAM algorihm. I even holds if all feaures are arranged in a large loop, a siuaion ofen hough of as he wors case for SLAM problems [8]. 6 Experimenal Resuls Sysemaic experimens showed ha FasSLAM 2.0 provides excellen resuls wih surprisingly few paricles, including M=1. Mos of our experimens were carried ou using a benchmark daa se colleced wih an oudoor vehicle in Vicoria Park, Sydney [7]. The vehicle pah is 3.5km long, and he map is 320 meers wide. The vehicle is equipped wih differenial GPS ha is used for evaluaion only. Fig. 1a shows he map of he errain, along wih he pah obained by raw odomery (which is very poor, he average RMS error is 93.6 meers). This daa se is presenly he mos popular benchmark in he SLAM research communiy [3]. Figs. 1b&c show he resul of applying FasSLAM wih M=1 paricle o he daa se, wihou (Fig. 1b) and wih

5 (a) (b) RMS Pose Error (meers) RMS Pose Error (meers) Accuracy of FasSLAM on Vicoria Park Daase Number of Paricles Accuracy of FasSLAM Algorihms On Simulaed Daa FasSLAM 1.0 FasSLAM 2.0 FasSLAM 1.0 FasSLAM Number of Paricles Figure 2: RMS map error for regular FasSLAM (dashed line) versus FasSLAM 2.0 (solid line) on (a) he Vicoria Park daa (b) simulaed daa. FasSLAM 2.0 s resuls even wih a single paricle are excellen. (Fig. 1c) he feaure managemen approach described in Secion 4.5. In boh cases, he esimaed vehicle pah is shown in yellow, and he GPS informaion is shown in blue. Resuls of he same accuracy were previously achieved only wih O(N 2 ) EKF-syle mehods [7] and wih FasSLAM using M=50 paricles. The feaure managemen rule reduces he number of landmarks in he map from 768 (Fig. 1b) o 343 (Fig. 1c). Fig. 2 plos he RMS error of he vehicle posiion esimae as funcion of he number of paricles for he Vicoria daa se (panel a) and for synheic simulaion daa (panel b) aken from [15]. While our new algorihm does approximaely equally well for any number of paricles, regular FasSLAM performs poorly for very small paricle ses. We suspec ha he poor performance of regular FasSLAM is due o he fac ha he vehicle possesses relaively inaccurae odomery (see Fig. 1a), ye uses a low-noise range finder for landmark deecion (a common configuraion in oudoor roboics), leading o he generaion of many paricles of low likelihood. The small number of examples needed o obain sae-ofhe-ar esimaion ranslaes o unprecedened efficiency of he new filer. The following able shows he resuls required o process he Vicoria Park daa se on a 1GHz Penium PC: EKF 7,807 sec regular FasSLAM, M=50 paricles 403 sec FasSLAM 2.0, M=1 paricle 140 sec In comparison, he daa acquisiion required 1,550 seconds. Thus, while EKFs canno be run in real-ime, our new algorihm requires less han 10% of he vehicle s rajecory ime. 7 Discussion This paper describes a modified FasSLAM algorihm ha is uniformly superior o he FasSLAM algorihms proposed in [15]. The new FasSLAM algorihm uilizes a differen proposal disribuion which incorporaes he mos recen measuremen in he pose predicion process. In doing so, i makes more efficien use of he paricles, paricularly in siuaions in which he moion noise is high in relaion o he measuremen noise. A main conribuion of his paper is a convergence proof for FasSLAM wih a single paricle. This proof is an improvemen over previous formal resuls, which applied o algorihms much less efficien han he curren one. In fac, his resul is a firs convergence resul for a consan ime SLAM algorihm. The heoreical finding is complemened by experimenal resuls using a sandard benchmark daa se. The new algorihm is found o ouperform he previous FasSLAM algorihm and he EKF approach o SLAM by a large margin. In fac, a single paricle suffices o generae an accurae map of a challenging benchmark daa se. Despie his surprising resul, he use of muliple paricles is clearly warraned in siuaions wih ambiguous daa associaion. We believe ha our resuls illusrae ha SLAM can be solved robusly by algorihms ha are significanly more efficien han EKF-based algorihms. References [1] T. Bailey. Mobile Robo Localisaion and Mapping in Exensive Oudoor Environmens. PhD hesis, Univ. of Sydney, [2] Y. Bar-Shalom and T. E. Formann. Tracking and Daa Associaion. Academic Press, [3] SLAM summer school See hp:// [4] N. de Freias, M. Niranjan, A. Gee, and A. Douce. Sequenial mone carlo mehods o rain neural nework models. Neural Compuaion, 12(4), [5] G. Dissanayake, P. Newman, S. Clark, H.F. Durran-Whye, and M. Csorba. A soluion o he simulaneous localisaion and map building (SLAM) problem. IEEE Trans. Roboics and Auomaion, [6] A. Douce, J.F.G. de Freias, and N.J. Gordon, ediors. Sequenial Mone Carlo Mehods In Pracice. Springer, [7] J. Guivan and E. Nebo. Opimizaion of he simulaneous localizaion and map building algorihm for real ime implemenaion. Trans. of Roboics and Auomaion, [8] J.-S. Gumann and K. Konolige. Incremenal mapping of large cyclic environmens. Proc. CIRA, [9] S. J. Julier and J. K. Uhlmann. A new exension of he Kalman filer o nonlinear sysems. Proc. AeroSense, [10] K. Kanazawa, D. Koller, and S.J. Russell. Sochasic simulaion algorihms for dynamic probabilisic neworks. UAI-95. [11] Noes ICRA Workshop Concurren Mapping and Localizaion for Auonomous Mobile Robos, 2002 [12] J.J. Leonard and H.J.S. Feder. A compuaionally efficien mehod for large-scale concurren mapping and localizaion. Proc. IRSS, [13] P. Maybeck. Sochasic Models, Esimaion, and Conrol, Volume 1. Academic Press, [14] M. Monemerlo and S. Thrun. Simulaneous localizaion and mapping wih unknown daa associaion using FasSLAM. A hp:// hrun/papers/ monemerlo.fasslam-daaassoc03.hml [15] M. Monemerlo, S. Thrun, D. Koller, and B. Wegbrei. Fas- SLAM: A facored soluion o he simulaneous localizaion and mapping problem. Proc. AAAI, [16] H. P. Moravec. Sensor fusion in cerainy grids for mobile robos. AI Magazine, 9(2), [17] K. Murphy. Bayesian map learning in dynamic environmens. Proc. NIPS, 1999.

6 [18] P. Newman. On he Srucure and Soluion of he Simulaneous Localisaion and Map Building Problem. PhD hesis, Univ. of Sydney, [19] M.A. Paskin. Thin juncion ree filers for simulaneous localizaion and mapping. TR UCB/CSD , UC Berkeley, [20] D.B. Rubin. Using he SIR algorihm o simulae poserior disribuions. In Bayesian Saisics 3. Oxford Univ. Press, [21] Randall C. Smih and Peer Cheeseman. On he represenaion and esimaion of spaial uncerainy. In. J. Roboics Research, 5(4), [22] J.D. Tardós, J. Neira, P. Newman, and J. Leonard. Robus mapping and localizaion in indoor environmens using sonar daa. TR TM , MIT, [23] J.D. Tardós, J. Neira, P.M. Newman, and J.J. Leonard. Robus mapping and localizaion in indoor environmens using sonar daa. In. J. Roboics Research, 21(4), [24] S. Thrun, D. Koller, Z. Ghahramani, H. Durran-Whye, and A.Y. Ng. Simulaneous mapping and localizaion wih sparse exended informaion filers. Proc. WAFR, [25] R. van der Merwe, N. de Freias, A. Douce, and E. Wan. The unscened paricle filer. Proc. NIPS, [26] S.B. Williams, G. Dissanayake, and H. Durran-Whye. An efficien approach o he simulaneous localisaion and mapping problem. Proc. ICRA, Appendix The linear form (23) and (24) implies ŝ n, 1 s 1 u, G θ = I, G s = I, and Q = s 1 + u, ẑ = = R + Σ n, 1. From ha we obain for he mean and covariance (13) and (14) of he proposal disribuion: Σ s = s = Σ [ ] 1 (R + Σ n, 1 ) 1 + P 1 (25) s (R + Σ n, 1 ) 1 (z n, 1 + s 1 + u) +s 1 + u (26) The updae of he landmark mean (Eq. (16) and (17)) resolves o: n, = n, 1 + Σ n, 1 (R + Σ n, 1 ) 1 (z n, 1 + s 1 + u)(27) We define he error in he robo pose and landmark locaions as: α = s s and β n, = n, θ n (28) We firs characerize he effec of map errors β on he pose error α: Lemma 1. If he error β n, of he observed landmark z a ime is smaller in magniude han he robo pose error α, α shrinks in expecaion as a resul of his measuremen. Conversely, if β n, is larger han he pose error α, he laer may increase, bu in expecaion will no exceed β n,. Proof. The expeced error of he robo pose a ime is given by E[α ] = E[s s ] = E[s ] E[s ] (29) The firs erm is obained via he sampling disribuion (26), and he second erm is obained from he linear moion model (24), giving: E[α ] = Σ (R + Σ n, 1 ) 1 (E[z ] s n, 1 + s 1 + u) + α 1 (30) For linear SLAM, he expecaion E[z ] = θ n E[s ] = θ n u s 1. Wih ha, he expression in he brackes becomes E[z ] n, 1 + s 1 + u = θ n u s 1 n, 1 + s 1 + u = α 1 β n, 1 (31) Subsiuing his back ino (30) and subsequenly subsiuing Σ s according o (25) gives us: E[α ] (32) = α 1 + Σ s (R + Σ = α 1 + [ I + (R + Σ n, 1 n, 1 ) 1 (β n, 1 α 1 ) )P 1 ] 1 (β n, 1 α 1 ) The lemma follows from he fac ha R, Σ 1 n, 1, and P are posiive semidefinie, hence he inverse of I + (R + Σ 1 n, 1)P is a conracion marix. E[α depends on he sign of β n, 1 exceed β in his case. qed. n, 1 ] is larger in magniude if and only if α > α 1 1 ; however, E[α ] canno Of paricular ineres is he resul of observing he anchoring landmark, by which we mean he landmark whose locaion is known. Wihou loss of generaliy, we assume ha his landmark is θ 1. Lemma 2. If he robo observes he anchoring landmark θ 1, is pose error will shrink in expecaion. Proof. The anchoring landmark has zero error: β 1, = 0, and is covariance is also zero: Σ 1, = 0. Plugging his ino (32), we ge: 1 + [ ] I + (R + 0)P 1 1 (0 α 1 ) = α 1 [ ] I + R P 1 1 α 1 (33) E[α ] = α qed. Finally, a lemma similar o Lemma 1 can be saed on he effec of pose errors α on map errors β. Is proof is analogous ha of Lemma 1, wih reverse roles of α and β. Lemma 3. If he pose error α 1 is smaller han he error β n, of he observed landmark z in magniude, observing z shrinks he landmark error β n, in expecaion. Conversely, if α 1 is larger han he landmark error β n,, he laer may increase, bu in expecaion will no exceed α 1. Proof of Theorem. Le ˆβ denoe landmark error ha is larges in magniude among all landmark errors a ime. ˆβ = argmax β n, (34) β n, Lemma 3 suggess ha his error may increase in expecaion, bu only if he absolue robo pose error α 1 exceeds his error in magniude. However, in expecaion his will only be he case for a limied number of ieraions. In paricular, Lemma 1 guaranees ha α 1 may only shrink in expecaion. Furhermore, Lemma 2 saes ha every ime he anchoring landmark is observed, his error will shrink by a finie amoun, regardless of he magniude of ˆβ. Hence, α 1 will ulimaely become smaller in magniude (and in expecaion) han he larges landmark error. Once his has happened, Lemma 3 saes ha he laer will shrink in expecaion every ime he landmark is observed whose error is larges. I is now easy o see ha boh ˆβ and α 1 converge o zero: Observing he anchoring landmark induces a finie reducion as saed in (33). To increase α 1 o is old value in expecaion, he oal landmark error mus shrink in expecaion (Lemma 3). This leads o an eernal shrinkage of he oal landmark error down o zero. Since his error is an upper bound for he expeced pose error (see Lemma 1), we also have convergence in expecaion for he robo pose error. qed.

Probabilistic Robotics SLAM

Probabilistic Robotics SLAM Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map

More information

Probabilistic Robotics SLAM

Probabilistic Robotics SLAM Probabilisic Roboics SLAM The SLAM Problem SLAM is he process by which a robo builds a map of he environmen and, a he same ime, uses his map o compue is locaion Localizaion: inferring locaion given a map

More information

EKF SLAM vs. FastSLAM A Comparison

EKF SLAM vs. FastSLAM A Comparison vs. A Comparison Michael Calonder, Compuer Vision Lab Swiss Federal Insiue of Technology, Lausanne EPFL) michael.calonder@epfl.ch The wo algorihms are described wih a planar robo applicaion in mind. Generalizaion

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

SEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS

SEIF, EnKF, EKF SLAM. Pieter Abbeel UC Berkeley EECS SEIF, EnKF, EKF SLAM Pieer Abbeel UC Berkeley EECS Informaion Filer From an analyical poin of view == Kalman filer Difference: keep rack of he inverse covariance raher han he covariance marix [maer of

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

Introduction to Mobile Robotics SLAM: Simultaneous Localization and Mapping

Introduction to Mobile Robotics SLAM: Simultaneous Localization and Mapping Inroducion o Mobile Roboics SLAM: Simulaneous Localizaion and Mapping Wolfram Burgard, Maren Bennewiz, Diego Tipaldi, Luciano Spinello Wha is SLAM? Esimae he pose of a robo and he map of he environmen

More information

Simultaneous Localization and Mapping with Unknown Data Association Using FastSLAM

Simultaneous Localization and Mapping with Unknown Data Association Using FastSLAM Simulaneous Localizaion and Mapping wih Unknown Daa Associaion Using FasSLAM Michael Monemerlo, Sebasian Thrun Absrac The Exended Kalman Filer (EKF has been he de faco approach o he Simulaneous Localizaion

More information

Probabilistic Robotics

Probabilistic Robotics Probabilisic Roboics Bayes Filer Implemenaions Gaussian filers Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel Gaussians : ~ π e p N p - Univariae / / : ~ μ μ μ e p Ν p d π Mulivariae

More information

Estimation of Poses with Particle Filters

Estimation of Poses with Particle Filters Esimaion of Poses wih Paricle Filers Dr.-Ing. Bernd Ludwig Chair for Arificial Inelligence Deparmen of Compuer Science Friedrich-Alexander-Universiä Erlangen-Nürnberg 12/05/2008 Dr.-Ing. Bernd Ludwig (FAU

More information

FastSLAM: An Efficient Solution to the Simultaneous Localization And Mapping Problem with Unknown Data Association

FastSLAM: An Efficient Solution to the Simultaneous Localization And Mapping Problem with Unknown Data Association FasSLAM: An Efficien Soluion o he Simulaneous Localizaion And Mapping Problem wih Unknown Daa Associaion Sebasian Thrun 1, Michael Monemerlo 1, Daphne Koller 1, Ben Wegbrei 1 Juan Nieo 2, and Eduardo Nebo

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Introduction to Mobile Robotics

Introduction to Mobile Robotics Inroducion o Mobile Roboics Bayes Filer Kalman Filer Wolfram Burgard Cyrill Sachniss Giorgio Grisei Maren Bennewiz Chrisian Plagemann Bayes Filer Reminder Predicion bel p u bel d Correcion bel η p z bel

More information

FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem

FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem asslam: A acored Soluion o he Simulaneous Localizaion and Mapping Problem Michael Monemerlo and Sebasian hrun School of Compuer Science Carnegie Mellon Universiy Pisburgh, PA 15213 mmde@cs.cmu.edu, hrun@cs.cmu.edu

More information

Robot Motion Model EKF based Localization EKF SLAM Graph SLAM

Robot Motion Model EKF based Localization EKF SLAM Graph SLAM Robo Moion Model EKF based Localizaion EKF SLAM Graph SLAM General Robo Moion Model Robo sae v r Conrol a ime Sae updae model Noise model of robo conrol Noise model of conrol Robo moion model

More information

2016 Possible Examination Questions. Robotics CSCE 574

2016 Possible Examination Questions. Robotics CSCE 574 206 Possible Examinaion Quesions Roboics CSCE 574 ) Wha are he differences beween Hydraulic drive and Shape Memory Alloy drive? Name one applicaion in which each one of hem is appropriae. 2) Wha are he

More information

Probabilistic Robotics The Sparse Extended Information Filter

Probabilistic Robotics The Sparse Extended Information Filter Probabilisic Roboics The Sparse Exended Informaion Filer MSc course Arificial Inelligence 2018 hps://saff.fnwi.uva.nl/a.visser/educaion/probabilisicroboics/ Arnoud Visser Inelligen Roboics Lab Informaics

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem

FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem rom: AAAI-02 Proceedings. Copyrigh 2002, AAAI (www.aaai.org). All righs reserved. asslam: A acored Soluion o he Simulaneous Localizaion and Mapping Problem Michael Monemerlo and Sebasian hrun School of

More information

Using the Kalman filter Extended Kalman filter

Using the Kalman filter Extended Kalman filter Using he Kalman filer Eended Kalman filer Doz. G. Bleser Prof. Sricker Compuer Vision: Objec and People Tracking SA- Ouline Recap: Kalman filer algorihm Using Kalman filers Eended Kalman filer algorihm

More information

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering

Announcements. Recap: Filtering. Recap: Reasoning Over Time. Example: State Representations for Robot Localization. Particle Filtering Inroducion o Arificial Inelligence V22.0472-001 Fall 2009 Lecure 18: aricle & Kalman Filering Announcemens Final exam will be a 7pm on Wednesday December 14 h Dae of las class 1.5 hrs long I won ask anyhing

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

Fixed-lag Sampling Strategies for Particle Filtering SLAM

Fixed-lag Sampling Strategies for Particle Filtering SLAM To appear in he 7 IEEE Inernaional Conference on Roboics & Auomaion (ICRA 7) Fixed-lag Sampling Sraegies for Paricle Filering SLAM Krisopher R. Beevers and Wesley H. Huang Absrac We describe wo new sampling

More information

Monte Carlo Sampling of Non-Gaussian Proposal Distribution in Feature-Based RBPF-SLAM

Monte Carlo Sampling of Non-Gaussian Proposal Distribution in Feature-Based RBPF-SLAM Proceedings of Ausralasian Conference on Roboics and Auomaion, 3-5 Dec 2012, Vicoria Universiy of Wellingon, New Zealand. Mone Carlo Sampling of Non-Gaussian Proposal Disribuion in Feaure-Based RBPF-SLAM

More information

Simultaneous Localization and Mapping With Sparse Extended Information Filters

Simultaneous Localization and Mapping With Sparse Extended Information Filters Sebasian Thrun Yufeng Liu Carnegie Mellon Universiy Pisburgh, PA, USA Daphne Koller Andrew Y. Ng Sanford Universiy Sanford, CA, USA Zoubin Ghahramani Gasby Compuaional Neuroscience Uni Universiy College

More information

CSE-571 Robotics. Sample-based Localization (sonar) Motivation. Bayes Filter Implementations. Particle filters. Density Approximation

CSE-571 Robotics. Sample-based Localization (sonar) Motivation. Bayes Filter Implementations. Particle filters. Density Approximation Moivaion CSE57 Roboics Bayes Filer Implemenaions Paricle filers So far, we discussed he Kalman filer: Gaussian, linearizaion problems Paricle filers are a way o efficienly represen nongaussian disribuions

More information

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19

m = 41 members n = 27 (nonfounders), f = 14 (founders) 8 markers from chromosome 19 Sequenial Imporance Sampling (SIS) AKA Paricle Filering, Sequenial Impuaion (Kong, Liu, Wong, 994) For many problems, sampling direcly from he arge disribuion is difficul or impossible. One reason possible

More information

7630 Autonomous Robotics Probabilistic Localisation

7630 Autonomous Robotics Probabilistic Localisation 7630 Auonomous Roboics Probabilisic Localisaion Principles of Probabilisic Localisaion Paricle Filers for Localisaion Kalman Filer for Localisaion Based on maerial from R. Triebel, R. Käsner, R. Siegwar,

More information

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004

Augmented Reality II - Kalman Filters - Gudrun Klinker May 25, 2004 Augmened Realiy II Kalman Filers Gudrun Klinker May 25, 2004 Ouline Moivaion Discree Kalman Filer Modeled Process Compuing Model Parameers Algorihm Exended Kalman Filer Kalman Filer for Sensor Fusion Lieraure

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Look-ahead Proposals for Robust Grid-based SLAM

Look-ahead Proposals for Robust Grid-based SLAM Look-ahead Proposals for Robus Grid-based SLAM Slawomir Grzonka, Chrisian Plagemann, Giorgio Grisei, Wolfram Burgard To cie his version: Slawomir Grzonka, Chrisian Plagemann, Giorgio Grisei, Wolfram Burgard.

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Monocular SLAM Using a Rao-Blackwellised Particle Filter with Exhaustive Pose Space Search

Monocular SLAM Using a Rao-Blackwellised Particle Filter with Exhaustive Pose Space Search 2007 IEEE Inernaional Conference on Roboics and Auomaion Roma, Ialy, 10-14 April 2007 Monocular SLAM Using a Rao-Blackwellised Paricle Filer wih Exhausive Pose Space Search Masahiro Tomono Absrac This

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB

T L. t=1. Proof of Lemma 1. Using the marginal cost accounting in Equation(4) and standard arguments. t )+Π RB. t )+K 1(Q RB Elecronic Companion EC.1. Proofs of Technical Lemmas and Theorems LEMMA 1. Le C(RB) be he oal cos incurred by he RB policy. Then we have, T L E[C(RB)] 3 E[Z RB ]. (EC.1) Proof of Lemma 1. Using he marginal

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Probabilistic Fundamentals in Robotics

Probabilistic Fundamentals in Robotics Probabilisic Fundamenals in Roboics Probabilisic Models of Mobile Robos Robo localizaion Basilio Bona DAUIN Poliecnico di Torino Course Ouline Basic mahemaical framework Probabilisic models of mobile robos

More information

A PROBABILISTIC MULTIMODAL ALGORITHM FOR TRACKING MULTIPLE AND DYNAMIC OBJECTS

A PROBABILISTIC MULTIMODAL ALGORITHM FOR TRACKING MULTIPLE AND DYNAMIC OBJECTS A PROBABILISTIC MULTIMODAL ALGORITHM FOR TRACKING MULTIPLE AND DYNAMIC OBJECTS MARTA MARRÓN, ELECTRONICS. ALCALÁ UNIV. SPAIN mara@depeca.uah.es MIGUEL A. SOTELO, ELECTRONICS. ALCALÁ UNIV. SPAIN soelo@depeca.uah.es

More information

CSE-473. A Gentle Introduction to Particle Filters

CSE-473. A Gentle Introduction to Particle Filters CSE-473 A Genle Inroducion o Paricle Filers Bayes Filers for Robo Localizaion Dieer Fo 2 Bayes Filers: Framework Given: Sream of observaions z and acion daa u: d Sensor model Pz. = { u, z2, u 1, z 1 Dynamics

More information

Multi-Robot Simultaneous Localization and Mapping (Multi-SLAM)

Multi-Robot Simultaneous Localization and Mapping (Multi-SLAM) Muli-Robo Simulaneous Localizaion and Mapping (Muli-SLAM) Kai-Chieh Ma, Zhibei Ma Absrac In his projec, we are ineresed in he exension of Simulaneous Localizaion and Mapping (SLAM) o muliple robos. By

More information

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006

2.160 System Identification, Estimation, and Learning. Lecture Notes No. 8. March 6, 2006 2.160 Sysem Idenificaion, Esimaion, and Learning Lecure Noes No. 8 March 6, 2006 4.9 Eended Kalman Filer In many pracical problems, he process dynamics are nonlinear. w Process Dynamics v y u Model (Linearized)

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

Anno accademico 2006/2007. Davide Migliore

Anno accademico 2006/2007. Davide Migliore Roboica Anno accademico 2006/2007 Davide Migliore migliore@ele.polimi.i Today Eercise session: An Off-side roblem Robo Vision Task Measuring NBA layers erformance robabilisic Roboics Inroducion The Bayesian

More information

Optimal Path Planning for Flexible Redundant Robot Manipulators

Optimal Path Planning for Flexible Redundant Robot Manipulators 25 WSEAS In. Conf. on DYNAMICAL SYSEMS and CONROL, Venice, Ialy, November 2-4, 25 (pp363-368) Opimal Pah Planning for Flexible Redundan Robo Manipulaors H. HOMAEI, M. KESHMIRI Deparmen of Mechanical Engineering

More information

Tracking. Announcements

Tracking. Announcements Tracking Tuesday, Nov 24 Krisen Grauman UT Ausin Announcemens Pse 5 ou onigh, due 12/4 Shorer assignmen Auo exension il 12/8 I will no hold office hours omorrow 5 6 pm due o Thanksgiving 1 Las ime: Moion

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010

Simulation-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Simulaion-Solving Dynamic Models ABE 5646 Week 2, Spring 2010 Week Descripion Reading Maerial 2 Compuer Simulaion of Dynamic Models Finie Difference, coninuous saes, discree ime Simple Mehods Euler Trapezoid

More information

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time.

Nature Neuroscience: doi: /nn Supplementary Figure 1. Spike-count autocorrelations in time. Supplemenary Figure 1 Spike-coun auocorrelaions in ime. Normalized auocorrelaion marices are shown for each area in a daase. The marix shows he mean correlaion of he spike coun in each ime bin wih he spike

More information

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3

d 1 = c 1 b 2 - b 1 c 2 d 2 = c 1 b 3 - b 1 c 3 and d = c b - b c c d = c b - b c c This process is coninued unil he nh row has been compleed. The complee array of coefficiens is riangular. Noe ha in developing he array an enire row may be divided or

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

Pose Uncertainty in Occupancy Grids through Monte Carlo Integration

Pose Uncertainty in Occupancy Grids through Monte Carlo Integration Pose Uncerainy in Occupancy Grids hrough Mone Carlo Inegraion Daniek Jouber Elecronic Sysems Lab Elecrical and Elecronic Engineering Sellenbosch Universiy, Souh Africa Email: daniekj@sun.ac.za Willie Brink

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

FastSLAM with Stereo Vision

FastSLAM with Stereo Vision FasSLAM wih Sereo Vision Wikus Brink Elecronic Sysems Lab Elecrical and Elecronic Engineering Sellenbosch Universiy Email: wikusbrink@ieee.org Corné E. van Daalen Elecronic Sysems Lab Elecrical and Elecronic

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

Introduction to Mobile Robotics Summary

Introduction to Mobile Robotics Summary Inroducion o Mobile Roboics Summary Wolfram Burgard Cyrill Sachniss Maren Bennewiz Diego Tipaldi Luciano Spinello Probabilisic Roboics 2 Probabilisic Roboics Key idea: Eplici represenaion of uncerainy

More information

Comparing Means: t-tests for One Sample & Two Related Samples

Comparing Means: t-tests for One Sample & Two Related Samples Comparing Means: -Tess for One Sample & Two Relaed Samples Using he z-tes: Assumpions -Tess for One Sample & Two Relaed Samples The z-es (of a sample mean agains a populaion mean) is based on he assumpion

More information

Assisted Teleoperation of Quadcopters Using Obstacle Avoidance

Assisted Teleoperation of Quadcopters Using Obstacle Avoidance Assised Teleoperaion of Quadcopers Using Obsacle Avoidance Received 0 h Ocober 202; acceped 22 nd November 202. João Mendes, Rodrigo Venura Absrac: Teleoperaion of unmanned aerial vehicles ofen demands

More information

Tracking. Many slides adapted from Kristen Grauman, Deva Ramanan

Tracking. Many slides adapted from Kristen Grauman, Deva Ramanan Tracking Man slides adaped from Krisen Grauman Deva Ramanan Coures G. Hager Coures G. Hager J. Kosecka cs3b Adapive Human-Moion Tracking Acquisiion Decimaion b facor 5 Moion deecor Grascale convers. Image

More information

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions

More information

Improved Rao-Blackwellized H filter based mobile robot SLAM

Improved Rao-Blackwellized H filter based mobile robot SLAM Ocober 216, 23(5): 47 55 www.sciencedirec.com/science/journal/158885 The Journal of China Universiies of Poss and Telecommunicaions hp://jcup.bup.edu.cn Improved Rao-Blackwellized H filer based mobile

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

Tom Heskes and Onno Zoeter. Presented by Mark Buller

Tom Heskes and Onno Zoeter. Presented by Mark Buller Tom Heskes and Onno Zoeer Presened by Mark Buller Dynamic Bayesian Neworks Direced graphical models of sochasic processes Represen hidden and observed variables wih differen dependencies Generalize Hidden

More information

Testing for a Single Factor Model in the Multivariate State Space Framework

Testing for a Single Factor Model in the Multivariate State Space Framework esing for a Single Facor Model in he Mulivariae Sae Space Framework Chen C.-Y. M. Chiba and M. Kobayashi Inernaional Graduae School of Social Sciences Yokohama Naional Universiy Japan Faculy of Economics

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

Rapid Termination Evaluation for Recursive Subdivision of Bezier Curves

Rapid Termination Evaluation for Recursive Subdivision of Bezier Curves Rapid Terminaion Evaluaion for Recursive Subdivision of Bezier Curves Thomas F. Hain School of Compuer and Informaion Sciences, Universiy of Souh Alabama, Mobile, AL, U.S.A. Absrac Bézier curve flaening

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

Maximum Likelihood Parameter Estimation in State-Space Models

Maximum Likelihood Parameter Estimation in State-Space Models Maximum Likelihood Parameer Esimaion in Sae-Space Models Arnaud Douce Deparmen of Saisics, Oxford Universiy Universiy College London 4 h Ocober 212 A. Douce (UCL Maserclass Oc. 212 4 h Ocober 212 1 / 32

More information

Monte Carlo Filter Particle Filter

Monte Carlo Filter Particle Filter 205 European Conrol Conference (ECC) July 5-7, 205. Linz, Ausria Mone Carlo Filer Paricle Filer Masaya Muraa, Hidehisa Nagano and Kunio Kashino Absrac We propose a new realizaion mehod of he sequenial

More information

Class Meeting # 10: Introduction to the Wave Equation

Class Meeting # 10: Introduction to the Wave Equation MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion

More information

Expert Advice for Amateurs

Expert Advice for Amateurs Exper Advice for Amaeurs Ernes K. Lai Online Appendix - Exisence of Equilibria The analysis in his secion is performed under more general payoff funcions. Wihou aking an explici form, he payoffs of he

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

!!"#"$%&#'()!"#&'(*%)+,&',-)./0)1-*23)

!!#$%&#'()!#&'(*%)+,&',-)./0)1-*23) "#"$%&#'()"#&'(*%)+,&',-)./)1-*) #$%&'()*+,&',-.%,/)*+,-&1*#$)()5*6$+$%*,7&*-'-&1*(,-&*6&,7.$%$+*&%'(*8$&',-,%'-&1*(,-&*6&,79*(&,%: ;..,*&1$&$.$%&'()*1$$.,'&',-9*(&,%)?%*,('&5

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

Recursive Bayes Filtering Advanced AI

Recursive Bayes Filtering Advanced AI Recursive Bayes Filering Advanced AI Wolfram Burgard Tuorial Goal To familiarie you wih probabilisic paradigm in roboics! Basic echniques Advanages ifalls and limiaions! Successful Applicaions! Open research

More information

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

Notes for Lecture 17-18

Notes for Lecture 17-18 U.C. Berkeley CS278: Compuaional Complexiy Handou N7-8 Professor Luca Trevisan April 3-8, 2008 Noes for Lecure 7-8 In hese wo lecures we prove he firs half of he PCP Theorem, he Amplificaion Lemma, up

More information

Monte Carlo data association for multiple target tracking

Monte Carlo data association for multiple target tracking Mone Carlo daa associaion for muliple arge racking Rickard Karlsson Dep. of Elecrical Engineering Linköping Universiy SE-58183 Linköping, Sweden E-mail: rickard@isy.liu.se Fredrik Gusafsson Dep. of Elecrical

More information

Lecture Notes 2. The Hilbert Space Approach to Time Series

Lecture Notes 2. The Hilbert Space Approach to Time Series Time Series Seven N. Durlauf Universiy of Wisconsin. Basic ideas Lecure Noes. The Hilber Space Approach o Time Series The Hilber space framework provides a very powerful language for discussing he relaionship

More information

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models.

Technical Report Doc ID: TR March-2013 (Last revision: 23-February-2016) On formulating quadratic functions in optimization models. Technical Repor Doc ID: TR--203 06-March-203 (Las revision: 23-Februar-206) On formulaing quadraic funcions in opimizaion models. Auhor: Erling D. Andersen Convex quadraic consrains quie frequenl appear

More information

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi

Navneet Saini, Mayank Goyal, Vishal Bansal (2013); Term Project AML310; Indian Institute of Technology Delhi Creep in Viscoelasic Subsances Numerical mehods o calculae he coefficiens of he Prony equaion using creep es daa and Herediary Inegrals Mehod Navnee Saini, Mayank Goyal, Vishal Bansal (23); Term Projec

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

WEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x

WEEK-3 Recitation PHYS 131. of the projectile s velocity remains constant throughout the motion, since the acceleration a x WEEK-3 Reciaion PHYS 131 Ch. 3: FOC 1, 3, 4, 6, 14. Problems 9, 37, 41 & 71 and Ch. 4: FOC 1, 3, 5, 8. Problems 3, 5 & 16. Feb 8, 018 Ch. 3: FOC 1, 3, 4, 6, 14. 1. (a) The horizonal componen of he projecile

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Robert Kollmann. 6 September 2017

Robert Kollmann. 6 September 2017 Appendix: Supplemenary maerial for Tracable Likelihood-Based Esimaion of Non- Linear DSGE Models Economics Leers (available online 6 Sepember 207) hp://dx.doi.org/0.06/j.econle.207.08.027 Rober Kollmann

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

Stability and Bifurcation in a Neural Network Model with Two Delays

Stability and Bifurcation in a Neural Network Model with Two Delays Inernaional Mahemaical Forum, Vol. 6, 11, no. 35, 175-1731 Sabiliy and Bifurcaion in a Neural Nework Model wih Two Delays GuangPing Hu and XiaoLing Li School of Mahemaics and Physics, Nanjing Universiy

More information

EXERCISES FOR SECTION 1.5

EXERCISES FOR SECTION 1.5 1.5 Exisence and Uniqueness of Soluions 43 20. 1 v c 21. 1 v c 1 2 4 6 8 10 1 2 2 4 6 8 10 Graph of approximae soluion obained using Euler s mehod wih = 0.1. Graph of approximae soluion obained using Euler

More information

Temporal probability models

Temporal probability models Temporal probabiliy models CS194-10 Fall 2011 Lecure 25 CS194-10 Fall 2011 Lecure 25 1 Ouline Hidden variables Inerence: ilering, predicion, smoohing Hidden Markov models Kalman ilers (a brie menion) Dynamic

More information

Overview. COMP14112: Artificial Intelligence Fundamentals. Lecture 0 Very Brief Overview. Structure of this course

Overview. COMP14112: Artificial Intelligence Fundamentals. Lecture 0 Very Brief Overview. Structure of this course OMP: Arificial Inelligence Fundamenals Lecure 0 Very Brief Overview Lecurer: Email: Xiao-Jun Zeng x.zeng@mancheser.ac.uk Overview This course will focus mainly on probabilisic mehods in AI We shall presen

More information