Minimizing Algebraic Error in Geometric Estimation Problems

Size: px
Start display at page:

Download "Minimizing Algebraic Error in Geometric Estimation Problems"

Transcription

1 Mnmzng Algebrac n Geometrc Estmaton Problems Rchard I. Hartley G.E. Corporate Research and Development PO Box 8, Schenectady, NY 39 Emal : hartley@crd.ge.com Abstract Ths paper gves a wdely applcable technque for solvng many of the parameter estmaton problems encountered n geometrc computer vson. A commonly used approach s to mnmze an algebrac error functon nstead of a possbly preferable geometrc error functon. It s clamed n ths paper that mnmzng algebrac error wll usually gve excellent results, and n fact the man problem wth most algorthms mnmzng algebrac dstance s that they do not take account of mathematcal constrants that should be mposed on the quantty beng estmated. Ths paper gves an effcent method of mnmzng algebrac dstance whle takng account of the constrants. Ths provdes new algorthms for the problems of resectonng a pnhole camera, computng the fundamental matrx, and computng the tr-focal tensor. Evaluaton results are gven for the resectonng and tr-focal tensor estmaton algorthms. Introducton For many problems related to camera calbraton and scene reconstructon, lnear algorthms are known for solvng for the entty requred. In the sort of problem that wll be addressed n ths paper, a set of data (such as pont correspondences) s used to construct a set of lnear equatons, and soluton of these equatons, usually n the least-squares sense, provdes an estmate of the entty beng computed. As examples of such problems we have :. The DLT algorthm for computng a camera matrxgven a set of ponts n space, and correspondng ponts n the mage. Provded at least correspondences are gve (more precsely 5 correspondences), one can solve for the camera matrx.. Computaton of the Fundamental Matrx. From 8 pont correspondences u u between two mages one can construct the fundamental matrx usng equatons u Fu =. 3. Computaton of the trfocal tensor gven a set of feature correspondences across three vews. These lnear algorthms have been found to gve poor qualty results on occasons and much research has been expended n seekng more relable, but complexmethods. A prevous paper ([]) showed that normalzaton of the data n a systematc manner wll mprove the results mmeasurably, and such normalzaton must be routnely carred out. Nevertheless, a common crtcsm of such lnear algorthms s that they do not mnmze the rght thng, and we really should be mnmzng geometrc error, whch s related to the actual means of error occurrence. Although ths crtcsm s correct, t s the thess of ths paper that t really does not matter very sgnfcantly whether we mnmze algebrac or geometrc error. Usually, one may be content wth mnmzng algebrac error, as long as one enforces the constrants. Ths leads to smpler and more effcent algorthms than are possble mnmzng geometrc error. In these three examples, and many others, the lnear algorthm wll lead to a soluton that does not satsfy certan constrants that the estmated quantty must satsfy. In the cases consdered here, the constrants are. The skew parameter of a camera matrxestmated usng the DLT method wll not generally be zero. Ths constrant, meanng the pxels are rectangular, should be enforced n cases where t s known to hold.. The fundamental matrxmust satsfy a constrant det F =. 3. The trfocal tensor must satsfy 8 non-lnear constrants. The form of these constrants s not easly determned, but t s essental to constran the tensor to correspond to a vald set of camera matrces. These constrants are not n general lnear constrants, and t wll be necessary to resort to teratve

2 technques to enforce them. Snce teratve technques are slow and potentally unstable, t s mportant to use them sparngly. Further, the smaller the dmenson of the mnmzaton problem, the faster and generally more stable the soluton wll be. In ths paper an teratve algorthm s used to solve the three problems posed above. In each case the algorthms are based on a common technque of data reducton, whereby the nput data s condensed nto a reduced measurement matrx. The sze of the teraton problem s then ndependent of the sze of the nput set. In the case of estmaton of the fundamental matrx, only three homogeneous parameters are used to parametrze the mnmzaton problem, whereas for the trfocal tensor, just sxparameters are used. The problem of camera calbraton solved usng the DLT algorthm wll be treated frst. It wll be used to llustrate the technques that apply to the other problems. Detals of the applcaton of ths technque to the computaton of the fundamental matrxwere gven n [], and are not repeated here. New evaluaton results for trfocal tensor estmaton are gven n ths paper. Computng the Camera Matrx We consder a set of pont correspondences x u between 3D ponts x and mage ponts u. Our problem s to compute a 3 matrxp such that Px = u for each.. The Drect Lnear Transformaton (DLT) algorthm We begn wth a smple lnear algorthm for determnng P gven a set of 3D to D pont correspondences, x u. The correspondence s gven by the equaton u = Px. Note that ths s an equaton nvolvng homogeneous vectors, thus u and Px may dffer by a non-zero scale factor. One may, however wrte the equaton n terms of the vector cross product as u Px =. If the j-th row of the matrx P s denoted by p j, then we may wrte Px = (p x, p x, p 3 x ). Wrtng u =(u,v,w ), the cross product may be gven explctly as u Px = v p 3 x w p x w p x u p 3 x. u p x v p x Snce p j x = x p j for j =,...,3, ths gves a set of three equatons, n the entres of P, whchmaybe wrttenntheform w x v x w x u x v x u x p p p 3 =. () Note that (p, p, p 3 ) whch appears n () s a - vector made up of the entres of the matrx P. Although there are three equatons, only two of them are lnearly ndependent. Thus each pont correspondence gves two equatons n the entres of P. One may choose to omt the thrd equaton, or else nclude all three equatons, whch may sometmes gve a better condtoned set of equatons. In future, we wll assume that only the frst two equatons are used, namely [ w x v x w x u x ] p p p 3 =. () Solvng the Equatons. The equatons () may be denoted by M p =. where the vector p s a - vector, correspondng to the entres of P. The set of all equatons derved from several pont correspondences may be wrtten Mp = where M s the matrx of equaton coeffcents. Ths matrx M wll be called the measurement matrx. The obvous soluton p = s of no nterest to us, so we seek a non-zero soluton.. Data Normalzaton One of the most mportant thngs to do n mplementng an algorthm of ths sort s to prenormalze the data. Ths type of data normalzaton was dscussed n the paper []. Wthout ths normalzaton, all these algorthms are guaranteed to perform extremely poorly. The approprate transformaton s to translate all data ponts so that ther centrod s at the orgn. Then the data should be scaled so that the average dstance of any data pont from the orgn s equal to for mage ponts and 3 for 3D ponts. The algorthms are then carred out wth the normalzed data, and fnal transformatons are appled to the result to compensate for the normalzng transforms..3 Algebrac In the presence of nose, one can not expect to obtan an exact soluton to an overconstraned set of equatons of the form Mp = such as those that arse n the DLT method. The DLT algorthm nstead fnds the unt-norm vector p that mnmzes Mp. The vector ɛ = Mp s the error vector and t s ths error vector that s mnmzed. The soluton s the unt sngular vector correspondng to the smallest sngular value of M. Defne a vector (û, ˆv, ŵ ) = û = Px. Usngths notaton, we may wrte ( ) v ŵ M p = ɛ = w ˆv =. (3) w û u ŵ

3 Ths vector s the algebrac error vector assocated wth the pont correspondence u x and the camera mappng P. Thus, d alg (u, û ) =(v ŵ w ˆv ) +(w û u ŵ ). () Gven several pont correspondences, the quantty ɛ = Mp s the algebrac error vector for the complete set, and one sees that d alg (u, û ) = Mp = ɛ (5) The man lesson that we want to keep from ths dscusson s : Proposton.. Gven any set of 3D to mage correspondences u x,letm be the measurement matrx as n (). For any camera matrx P the vector Mp s the algebrac error vector, where p s the vector of entres of P.. Geometrc Dstance Under the assumpton that measurement error s confned to mage measurements, and an assumpton of a Gaussan error model for the measurement of D mage coordnates, the optmal estmate for the camera matrx P s the one that mnmzes the error functon d(u, û ) () where d(, ) represents Eucldean dstance n the mage. The quantty d(u, û )sknownasthegeometrc dstance between u and û. Thus the error to be mnmzed s the sum of squares of geometrc dstances between measured and projected ponts. For ponts u =(u,v,w ) and û =(û, ˆv, ŵ ), the geometrc dstance s d(u, û ) = ( (u /w û /ŵ ) +(v /w û /ŵ ) ) / = d alg (u, û )/w ŵ (7) Thus, geometrc dstance s related to, but not qute the same as algebrac dstance..5 The Reduced Measurement Matrx Let u x be a set of correspondences, and let M be the correspondng measurement matrx. Let P be any camera matrx, and let p be the vector contanng ts entres. The algebrac error vector correspondng to P s Mp, and ts norm satsfes Mp = p M Mp. In general, the matrx M may have a very large number of rows. It s possble to replace M by a square matrx ˆM such that Mp = ˆMp for any vector p. Such a matrx ˆM s called a reduced measurement matrx. One way to do ths s usng the Sngular Value Decomposton (SVD). Let M = UDV be the SVD of M, and defne ˆM = DV.Then M M =(VDU )(UDV )=(VD)(DV )=ˆM ˆM as requred. Another (faster) way of obtanng ˆM s to use the QR decomposton M = QˆM, where Q has orthogonal columns and ˆM s upper-trangular and square. Ths shows the followng result. Theorem.. Let u x be a set of n worldtomage correspondences. Let M be the measurement matrx derved from the pont correspondences. Let ˆM be a reduced measurement matrx. Then, for any 3D to D projectve transform P and correspondng 3-vector p, one has d alg (u, Px ) = ˆMp In ths way, all the nformaton we need to keep about the set of matched ponts u x s contaned n the sngle matrx ˆM. If we wsh to mnmze algebrac error as P vares over some restrcted set of transforms, then ths s equvalent to mnmzng the norm of the -vector ˆMp.. Restrcted Camera Mappngs The camera mappng expressed by a general 3D projectve transformaton s n some respects too general. A non-sngular 3 matrxp wth center at a fnte pont may be decomposed as P = K[R Rt] where R s a 3 3 rotaton matrxand K = α u s u α v v. (8) The non-zero entres of K are geometrcally meanngful quanttes, the nternal calbraton parameters of P. A common assumpton s that s =, whle for a true pnhole camera, α u = α v. Gven a set of world to mage correspondences, one may wsh to fnd a matrx P that mnmzes algebrac error, subject to a set of constrants on P. Usually, ths wll requre an teratve soluton. For nstance, suppose we wsh to enforce the constrants s =and α u = α v. One can parametrze the camera matrxusng the remanng 9 parameters ( p u, p v, α plus parameters representng the orentaton R and locaton t of the camera). Let ths set of parameters be denoted collectvely by q. Then, one has a map p = g(q), where p s as before the vector of entres of the matrx P. Accordng to Theorem., mnmzng algebrac

4 error over all pont matches s equvalent to mnmzng Mg(q). Note that the mappng q Mg(q) s a mappng from R 9 to R. Thssasmpleparametermnmzaton problem that may be solved usng the Levenberg-Marquardt method. The mportant pont to note s the followng : Gven a set of n world-to-mage correspondences, x u, the problem of fndng a constraned camera matrx P that mnmzes the sum of algebrac dstances d alg (u, Px ) reduces to the mnmzaton of a functon R 9 R, ndependent of the number n of correspondences. If ths problem s solved usng the Levenberg- Marquardt (LM) method, then an ntal estmate of the parameters may be obtaned by decomposng a camera matrx P found usng the DLT algorthm. A central step n the LM method s the computaton of the dervatve matrx(jacoban matrx) of the functon beng mnmzed, n ths case Mg(q). Note that Mg/ q = M g/ q. Thus, computaton of the Jacoban reduces to computaton of the Jacoban matrx of g, and subsequent multplcaton by M. Mnmzaton of Mg(q) takes place over all values of the parameters q. Note, however, that f P = K[R Rt]wthKas n (8) then P satsfes the condton p 3+ p 3 +p 3 =, snce these entres are the same as the last row of the rotaton matrx R. Thus, mnmzng Mg(q) wll lead to a matrx P satsfyng the constrants s = and k u = k v andscaledsuchthatp 3 + p 3 + p 3 =, and whch n addton mnmzes the algebrac error for all pont correspondences..7 Expermental Evaluaton Experments were carred out wth synthetc data to evaluate the performance of ths algorthm. The data were created to smulate a standard 35mm camera wth a 35mm focal length lens. A set of ponts were syntheszed nsde a sphere of radus m, and the camera was located at a dstance of about.5m from the center of the sphere. The mage s sampled so that the magnfcaton factors are α u = α v =., the same n each drecton. Ths corresponds to a pxel sze of 35µm for a 35mm camera. Experments were carred out to fnd the camera matrxwth four dfferent assumptons on known camera parameters.. There s no skew : s =. Thenumberofremanng degrees of freedom d for the camera matrxs equal to.. There s no skew and the pxels are square : s = and α u = α v. Ths corresponds to the stuaton for a true pnhole camera where mage coordnates are measured n a Eucldean coordnate frame. In ths case, d =9. 3. In addton to the above assumptons, the prncpal pont (u,v ) s assumed to be known. There reman d = 7 degrees of freedom.. The complete nternal calbraton matrx K n (8) s assumed to be known. However, the pose of the camera s unknown. Thus d =. To evaluate the performance of the algorthm, the result was compared wth the optmal estmate wth dfferent degrees of nose. Thus, Gaussan nose wth a gven varance was added to the mage coordnates of each pont, and the camera matrxwas estmated. The resdual error was then computed, that s the dfference between the measured and projected pxel. It s known (see [5]) that the expected lower bound on the root mean squared resdual error s equal to ɛ opt = σ( d/n) / (9) where σ s the standard devaton of the nput nose, N s the number of measurements (n ths case number of ponts), and d s the number of degrees of freedom of the object beng estmated. Ths represents the performance of an optmal estmaton technque, and we can not do better. Snce the resdual error appeared to grow proportonally to njected nose (at least for nose levels less than about pxels), a value of v =pxelwasusedntheexperments.for each level of nose σ, the camera matrxwas estmated tmes wth dfferent nose. The resdual error was RMS-averaged over all runs and compared to the optmal value. Results of the experments are shown n Fg. The results show that mnmzng algebrac error gves an almost optmal estmate of the camera matrx. In fact, the resdual error s scarcely dstngushable from the optmal value. Ths s true n each of the four calbraton problem types tred. 3 Computaton of the Trfocal Tensor The trfocal tensor ([3, ]), relates the coordnates of ponts or lnes seen n three vews n a smlar way to that n whch the fundamental matrxrelates ponts n two vews. The basc formula relates a pont u n one mage and a par of lnes λ and λ n the other two mages. Provded there s a pont x n space that maps to u n the frst mage and a pont on the lnes λ and λ n

5 .5 no skew.5 no skew/square pxels Number of ponts Number of ponts 8 8 no skew/square pxels/ known prncpal pont known nternal calbraton Number of ponts Number of ponts Fgure : The resdual error was RMS-averaged over runs for each n =,...,5, wheren s the number of ponts used to estmate the camera matrx. Four dfferent levels of knowledge of the nternal camera matrx were tred, correspondng to the four dfferent graphs. In each of the graphs, the sold lne represents the result of our teratve DLT algorthm, and the almost dentcal dotted lne s the optmal estmate. In all four graphs, these two lnes are barely dstngushable. For comparson, the results of a further method are also plotted. In ths method, the complete calbraton matrx K n (8) s estmated usng the QR decomposton, and the known nternal parameters are subsequently set to ther known values. Ths method performs very poorly for small numbers of ponts, lyng well off the graph, and s markedly nferor to the optmal estmaton method even for larger numbers of ponts.

6 the other two mages, the followng dentty s satsfed : u λ j λ k T jk =. () Here we are usng tensor notaton, n whch a repeated ndexappearng n covarant (lower) and contravarant (upper) postons mples summaton over the range of ndces ( namely,,...,3). Ths equaton may be used to generate equatons gven ether pont or lne correspondences across three mages. In the case of a lne correspondence, λ λ λ one selects two ponts u and u on the lne λ, and for each of these ponts one obtans an equaton of the form (). In the case of a pont correspondence u u u one selects any lnes λ and λ passng through u and u respectvely. Then () provdes one equaton. Four equatons are generated from a sngle 3-vew pont correspondence by choosng two lnes through each of u and u, each par of lnes gvng rse to a sngle equaton. The equatons () gve rse to a set of equatons of the form Mt = n the 7 entres of the trfocal tensor. From these equatons, one may solve for the entres of the tensor. As before, for any tensor T jk the value of Mt s the algebrac error vector assocated wth the nput data. Consder the analogy wth the 8-pont algorthm for computng the fundamental matrxn the twovew case. The fundamental matrxhas a constrant det F = that s not n general precsely satsfed by the soluton found from lnear algorthm. In the case of the trfocal tensor, there are 7 entres n the tensor, but the camera geometry that t encodes has only 8 degrees of freedom. Ths means that the trfocal tensor must satsfy 8 constrants, apart from scale ambguty to make up the 7 degrees of freedom of a general tensor. The exact form of these constrants s not known precsely. Nevertheless, they must be enforced n order that the trfocal tensor should be well behaved. It wll now be shown how ths can be done, whle mnmzng algebrac error. Formula for the Trfocal Tensor. We denote the three camera matrces P and P by a j and b j respectvely, nstead of by p j and p j. Thus, the three camera matrces P, P and P may be wrtten n the form P =[I ], P =[a j ]andp =[b j ]. In ths notaton, the formula for the entres of the trfocal tensor s : T jk = a j bk a j bk. () Our task wll be to compute a trfocal tensor T jk of ths form from a set of mage correspondences. The tensor computed wll mnmze the algebrac error assocated wth the nput data. The algorthm s smlar to the one gven n [] for computaton of the fundamental matrx. As wth the fundamental matrx, the frst step s the computaton of the eppoles. 3. Retrevng the eppoles We consder the task of retrevng the eppoles from the trfocal tensor. If the frst camera has matrx P =[I ], then the eppoles e and e 3 are the last columns a and b of the two camera matrces P =[a j ] and P =[b j ] respectvely. These two eppoles may easly be computed from the tensor T jk accordng to the followng proposton. Proposton 3.3. For each =,...,3, the matrx T s sngular. Furthermore, the generators of the three left null-spaces have a common perpendcular, the eppole e. Smlarly eppole e 3 s the common perpendcular of the rght null-spaces of the three matrces T. Ths proposton translates easly nto an algorthm for computng the eppoles ([3, ]). Ths algorthm may be appled to the tensor T jk obtaned from the lnear algorthm to obtan a reasonable approxmaton for the eppoles. 3. Constraned Estmaton of the Trfocal Tensor From the form () of the trfocal tensor, t may be seen that once the eppoles e = a j and e 3 = b k are known, the trfocal tensor may be expressed lnearly n terms of the remanng entres of the matrces [a j ] and [b k ]. Assumng the eppoles a j and bk to be known, we may wrte t = Ha where a s the vector of the remanng entres a j and b j, t s the vector of entres of the trfocal tensor, and H s the lnear relatonshp expressed by (). We wsh to mnmze the algebrac error Mt = MHa over all choces of a constraned such that t = Ha =. Wrtng ˆt = Ha where a s the soluton vector, we see that ˆt mnmzes algebrac error Mˆt subject to the condton that T jk s of the correct form (), for the gven choce of eppoles. Thus, fndng the best T jk s reduced to the soluton of a smple mnmzaton problem. Detals of how to solve ths problem are contaned n the next secton. It does not do to mnmze MHa subject to the condton a =, snce a soluton to ths occurs when a s a unt vector n the rght null-space of H. In ths case, Ha =, and hence MHt =.

7 3.3 A Constraned Mnmzaton Problem We consder the mnmzaton problem : gven matrces M and H, mnmze Mt subject to t =and the addtonal constrant t = Ha for some vector a. Ths problem may be posed n terms of fndng the vector a, n whch case t becomes : mnmze MHa subject to the condton Ha =.Ths problem s solved as follows. Let the Sngular Value Decomposton of H be H = UDV.Letnbetherank of matrx H n the tensor estmaton problem beng consdered, rankh = 5. Then D has n non-zero dagonal entres. We assume that the non-zero entres of D precede the zero entres along the dagonal. Let U be the matrx consstng of the frst n columns of U, letv consst of the frst n columns of V and let D be the top-left n n mnor of D, contanng the non-zero dagonal entres. The mnmzaton problem them becomes : mnmze MU D V a subject to U D V a =. Ths last condton s equvalent to D V a =,snceu has orthogonal columns. Now wrtng t = D V a, the problem becomes : mnmze MU t subject to t =. whch s a standard mnmzaton problem. The soluton t s the sngular vector correspondng to the smallest sngular value of MU. Next, one computes a by solvng t = D V a. A crucal pont here s that D V has rank equal to ts row dmenson, n and t s an n-vector. Therefore, there exsts a soluton to the equatons t = D V a.ifhdoes not have full columnrank, then the soluton for a s not unque. However, one soluton s gven by a = V D t. To see ths, one verfes D V a = D V V D t = D D t = t as requred. Fnally, t = Ha. Note that f the value of a s not specfcally requred, then t may be computed wthout explctly computng a, as follows : Ha = U D V a = U t. The complete algorthm s follows. Algorthm : Gven matrces M and H, fnd the vector t that mnmzes Mt subject to t =and the addtonal condton t = Ha for some vector a. Soluton :. Compute the SVD H = UDV such that the nonzero values of D appear frst down the dagonal.. Let U be the matrxcomprsng the frst n columns of U, wheren s the rank of H. Further, let V consst of the frst n columns of V and D consst of the n frst rows and columns of D. 3. Fnd the unt vector t that mnmzes MU t. Ths s the sngular vector correspondng to the smallest sngular value of MU.. The requred vector t s gven by t = U t, A vector a such that t = Ha s gven by a = V D t. 3. Iteratve Soluton. We have just seen how n terms of algebrac error, the optmal T jk may be computed f the two eppoles are known. The two eppoles used to compute a correct constraned tensor T jk are computed usng the estmate of T jk obtaned from the lnear algorthm. Analogous to the case of the fundamental matrx descrbed n [], the mappng (e, e 3 ) MHa s a mappng R R 7. An applcaton of the Levenberg- Marquardt algorthm to optmze the choce of the eppoles wll result n an optmal (n terms of algebrac error) estmate of the trfocal tensor. Note that the teraton problem s of modest sze, snce only parameters, the homogeneous coordnates of the eppoles, are nvolved n the teraton problem. Snce the functon beng mnmzed s qute complex, dervatves are computed numercally. In general terms, the steps of the estmaton problem are. Compute the reduced measurement matrx M from the gven data.. Obtan an ntal estmate of the eppoles e and e 3 from an ntal estmate of T jk. 3. Compute the matrx H expressng the trfocal tensor (represented by vector t) n terms of the eppoles.. Use the constraned mnmzaton method of secton 3.3 to fnd the best value of t = Ha and compute the algebrac error vector Mt. 5. Iterate these last two steps wth dfferent values of the eppoles, so as to mnmze the error vector. The sze of the teraton problem contrasts wth an teratve estmaton of the optmal trfocal tensor n terms of geometrc error. Ths latter problem would requre estmatng the camera parameters of the three cameras, plus the coordnates of all the ponts a large estmaton problem. 3.5 Expermental Results Once more, the teratve algorthm for computng the trfocal tensor was tested wth synthetc data. The confguraton of the ponts and cameras was smlar to that used for the DLT algorthm, but n ths case there were three cameras amed at the pont set from random angles. Data sets of, 5 and ponts were used to test the algorthm. Resdual errors were compared wth the optmal values of the resdual errors,

8 5 3 ponts ponts ponts 8 Nose 8 Nose 8 Nose Fgure : The resdual error RMS-averaged over runs s plotted aganst the number of ponts. Note that these plots are dfferent from the plots for the DLT algorthm n that the horzontal axs represents the nose level, not the number of ponts as n the DLT case. The three plots are for, 5 and ponts. Each graph contans three curves. The top curve s the result of the algebrac error mnmzaton, whereas the lower two curves, actually ndstngushable n the graphs, represent the theoretcal mnmum error, and the error obtaned by teraton to mnmze geometrc error, usng the algebrac mnmzaton as a startng pont ([3, ]). Note that the resdual errors are almost exactly proportonal to added nose. We learn two thngs from ths. Mnmzaton of the algebrac error acheves resdual errors wthn about 5% of the optmal and usng ths estmate as a startng pont for mnmzng geometrc error acheves a vrtually optmal estmate. These results are notably better than results obtaned prevously n []. gven by the formula (9). In ths case, f n s the number of ponts, then the number of measurements s N =n, and the number of degrees of freedom n the fttng s d =8+3n, where 8 represents the number of degrees of freedom of the three cameras (less 5 to account for projectve ambguty) and 3n represents the number of degrees of freedom of n ponts n space. TheresultsareshownnFg. Concluson Expermental evdence backs up the asserton that mnmzng algebrac dstance can usually gve good results at a fracton of the computaton cost assocated wth mnmzng geometrc dstance. The great advantage of the method for mnmzng algebrac error gven n ths paper s that even for problems that need an teratve soluton the sze of the teraton problem s very small. Consequently, the teraton s very rapd and there s reduced rsk of fallng nto a local mnmum, or otherwse falng to converge. The method has been llustrated by applyng t to three problems. For the computaton of the fundamental matrx, teraton s over only three homogeneous parameters. (For detals see [].) For the trfocal tensor, teraton s over parameters. Ths leads to more effcent methods than have been prevously known. The general technque s applcable to problems other than those treated here. It may be appled n a straght-forward manner to estmaton of projectve transformatons between or 3-dmensonal pont sets. In these problems, teraton s necessary f one restrcts the class of avalable transformatons to a subgroup of the projectve group, such as planar homologes conjugates of rotatons. References [] R. I. Hartley. In defence of the 8-pont algorthm. In Proc. Internatonal Conference on Computer Vson, pages 7, 995. [] R. I. Hartley. A lnear method for reconstructon from les and ponts. In Proc. Internatonal Conference on Computer Vson, pages , 995. [3] Rchard I. Hartley. Lnes and ponts n three vews and the trfocal tensor. Internatonal Journal of Computer Vson, ():5, March 997. [] Rchard I. Hartley. Mnmzng algebrac dstance. In Proc. DARPA Image Understandng Workshop, pages 3 37, 997. [5] K. Kanatan. Statstcal Optmzaton for Geometrc Computaton : Theory and Practce. North Holland, Amsterdam, 99.

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

CS4495/6495 Introduction to Computer Vision. 3C-L3 Calibrating cameras

CS4495/6495 Introduction to Computer Vision. 3C-L3 Calibrating cameras CS4495/6495 Introducton to Computer Vson 3C-L3 Calbratng cameras Fnally (last tme): Camera parameters Projecton equaton the cumulatve effect of all parameters: M (3x4) f s x ' 1 0 0 0 c R 0 I T 3 3 3 x1

More information

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1

Estimating the Fundamental Matrix by Transforming Image Points in Projective Space 1 Estmatng the Fundamental Matrx by Transformng Image Ponts n Projectve Space 1 Zhengyou Zhang and Charles Loop Mcrosoft Research, One Mcrosoft Way, Redmond, WA 98052, USA E-mal: fzhang,cloopg@mcrosoft.com

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

Structure from Motion. Forsyth&Ponce: Chap. 12 and 13 Szeliski: Chap. 7

Structure from Motion. Forsyth&Ponce: Chap. 12 and 13 Szeliski: Chap. 7 Structure from Moton Forsyth&once: Chap. 2 and 3 Szelsk: Chap. 7 Introducton to Structure from Moton Forsyth&once: Chap. 2 Szelsk: Chap. 7 Structure from Moton Intro he Reconstructon roblem p 3?? p p 2

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS)

Some Comments on Accelerating Convergence of Iterative Sequences Using Direct Inversion of the Iterative Subspace (DIIS) Some Comments on Acceleratng Convergence of Iteratve Sequences Usng Drect Inverson of the Iteratve Subspace (DIIS) C. Davd Sherrll School of Chemstry and Bochemstry Georga Insttute of Technology May 1998

More information

15.1 The geometric basis for the trifocal tensor Incidence relations for lines.

15.1 The geometric basis for the trifocal tensor Incidence relations for lines. 15 The Trfocal Tensor The trfocal tensor plays an analogous role n three vews to that played by the fundamental matrx n two. It encapsulates all the (projectve) geometrc relatons between three vews that

More information

Difference Equations

Difference Equations Dfference Equatons c Jan Vrbk 1 Bascs Suppose a sequence of numbers, say a 0,a 1,a,a 3,... s defned by a certan general relatonshp between, say, three consecutve values of the sequence, e.g. a + +3a +1

More information

Generalized Linear Methods

Generalized Linear Methods Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

Linear Approximation with Regularization and Moving Least Squares

Linear Approximation with Regularization and Moving Least Squares Lnear Approxmaton wth Regularzaton and Movng Least Squares Igor Grešovn May 007 Revson 4.6 (Revson : March 004). 5 4 3 0.5 3 3.5 4 Contents: Lnear Fttng...4. Weghted Least Squares n Functon Approxmaton...

More information

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity

LINEAR REGRESSION ANALYSIS. MODULE IX Lecture Multicollinearity LINEAR REGRESSION ANALYSIS MODULE IX Lecture - 30 Multcollnearty Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur 2 Remedes for multcollnearty Varous technques have

More information

Lecture 3. Ax x i a i. i i

Lecture 3. Ax x i a i. i i 18.409 The Behavor of Algorthms n Practce 2/14/2 Lecturer: Dan Spelman Lecture 3 Scrbe: Arvnd Sankar 1 Largest sngular value In order to bound the condton number, we need an upper bound on the largest

More information

Parameter estimation class 5

Parameter estimation class 5 Parameter estmaton class 5 Multple Ve Geometr Comp 9-89 Marc Pollefes Content Background: Projectve geometr (D, 3D), Parameter estmaton, Algortm evaluaton. Sngle Ve: Camera model, Calbraton, Sngle Ve Geometr.

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

NUMERICAL DIFFERENTIATION

NUMERICAL DIFFERENTIATION NUMERICAL DIFFERENTIATION 1 Introducton Dfferentaton s a method to compute the rate at whch a dependent output y changes wth respect to the change n the ndependent nput x. Ths rate of change s called the

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

1 Matrix representations of canonical matrices

1 Matrix representations of canonical matrices 1 Matrx representatons of canoncal matrces 2-d rotaton around the orgn: ( ) cos θ sn θ R 0 = sn θ cos θ 3-d rotaton around the x-axs: R x = 1 0 0 0 cos θ sn θ 0 sn θ cos θ 3-d rotaton around the y-axs:

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence.

Vector Norms. Chapter 7 Iterative Techniques in Matrix Algebra. Cauchy-Bunyakovsky-Schwarz Inequality for Sums. Distances. Convergence. Vector Norms Chapter 7 Iteratve Technques n Matrx Algebra Per-Olof Persson persson@berkeley.edu Department of Mathematcs Unversty of Calforna, Berkeley Math 128B Numercal Analyss Defnton A vector norm

More information

Tracking with Kalman Filter

Tracking with Kalman Filter Trackng wth Kalman Flter Scott T. Acton Vrgna Image and Vdeo Analyss (VIVA), Charles L. Brown Department of Electrcal and Computer Engneerng Department of Bomedcal Engneerng Unversty of Vrgna, Charlottesvlle,

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2

Salmon: Lectures on partial differential equations. Consider the general linear, second-order PDE in the form. ,x 2 Salmon: Lectures on partal dfferental equatons 5. Classfcaton of second-order equatons There are general methods for classfyng hgher-order partal dfferental equatons. One s very general (applyng even to

More information

The Trifocal Tensor The geometric basis for the trifocal tensor

The Trifocal Tensor The geometric basis for the trifocal tensor 14 The Trfocal Tensor The trfocal tensor plays an analogous role n three vews to that played by the fundamental matrx n two. It encapsulates all the (projectve) geometrc relatons between three vews that

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Global Sensitivity. Tuesday 20 th February, 2018

Global Sensitivity. Tuesday 20 th February, 2018 Global Senstvty Tuesday 2 th February, 28 ) Local Senstvty Most senstvty analyses [] are based on local estmates of senstvty, typcally by expandng the response n a Taylor seres about some specfc values

More information

where λ = Z/f. where a 3 4 projection matrix represents a map from 3D to 2D. Part I: Single and Two View Geometry Internal camera parameters

where λ = Z/f. where a 3 4 projection matrix represents a map from 3D to 2D. Part I: Single and Two View Geometry Internal camera parameters Imagng Geometry Multple Vew Geometry Perspectve projecton Y Rchard Hartley and Andrew Zsserman X λ y = Y f Z O X p y Z X where λ = Z/f. mage plane CVPR June 1999 Ths can be wrtten as a lnear mappng between

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Laboratory 1c: Method of Least Squares

Laboratory 1c: Method of Least Squares Lab 1c, Least Squares Laboratory 1c: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly

More information

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD

Matrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo

More information

Module 9. Lecture 6. Duality in Assignment Problems

Module 9. Lecture 6. Duality in Assignment Problems Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept

More information

EEE 241: Linear Systems

EEE 241: Linear Systems EEE : Lnear Systems Summary #: Backpropagaton BACKPROPAGATION The perceptron rule as well as the Wdrow Hoff learnng were desgned to tran sngle layer networks. They suffer from the same dsadvantage: they

More information

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013

ISSN: ISO 9001:2008 Certified International Journal of Engineering and Innovative Technology (IJEIT) Volume 3, Issue 1, July 2013 ISSN: 2277-375 Constructon of Trend Free Run Orders for Orthogonal rrays Usng Codes bstract: Sometmes when the expermental runs are carred out n a tme order sequence, the response can depend on the run

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

Formulas for the Determinant

Formulas for the Determinant page 224 224 CHAPTER 3 Determnants e t te t e 2t 38 A = e t 2te t e 2t e t te t 2e 2t 39 If 123 A = 345, 456 compute the matrx product A adj(a) What can you conclude about det(a)? For Problems 40 43, use

More information

Coordinate-Free Projective Geometry for Computer Vision

Coordinate-Free Projective Geometry for Computer Vision MM Research Preprnts,131 165 No. 18, Dec. 1999. Beng 131 Coordnate-Free Proectve Geometry for Computer Vson Hongbo L, Gerald Sommer 1. Introducton How to represent an mage pont algebracally? Gven a Cartesan

More information

Laboratory 3: Method of Least Squares

Laboratory 3: Method of Least Squares Laboratory 3: Method of Least Squares Introducton Consder the graph of expermental data n Fgure 1. In ths experment x s the ndependent varable and y the dependent varable. Clearly they are correlated wth

More information

Structure and Drive Paul A. Jensen Copyright July 20, 2003

Structure and Drive Paul A. Jensen Copyright July 20, 2003 Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

Polynomial Regression Models

Polynomial Regression Models LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance

More information

Approximate Smallest Enclosing Balls

Approximate Smallest Enclosing Balls Chapter 5 Approxmate Smallest Enclosng Balls 5. Boundng Volumes A boundng volume for a set S R d s a superset of S wth a smple shape, for example a box, a ball, or an ellpsod. Fgure 5.: Boundng boxes Q(P

More information

APPENDIX 2 FITTING A STRAIGHT LINE TO OBSERVATIONS

APPENDIX 2 FITTING A STRAIGHT LINE TO OBSERVATIONS Unversty of Oulu Student Laboratory n Physcs Laboratory Exercses n Physcs 1 1 APPEDIX FITTIG A STRAIGHT LIE TO OBSERVATIOS In the physcal measurements we often make a seres of measurements of the dependent

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

Time-Varying Systems and Computations Lecture 6

Time-Varying Systems and Computations Lecture 6 Tme-Varyng Systems and Computatons Lecture 6 Klaus Depold 14. Januar 2014 The Kalman Flter The Kalman estmaton flter attempts to estmate the actual state of an unknown dscrete dynamcal system, gven nosy

More information

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16

STAT 309: MATHEMATICAL COMPUTATIONS I FALL 2018 LECTURE 16 STAT 39: MATHEMATICAL COMPUTATIONS I FALL 218 LECTURE 16 1 why teratve methods f we have a lnear system Ax = b where A s very, very large but s ether sparse or structured (eg, banded, Toepltz, banded plus

More information

The Geometry of Logit and Probit

The Geometry of Logit and Probit The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.

More information

1 GSW Iterative Techniques for y = Ax

1 GSW Iterative Techniques for y = Ax 1 for y = A I m gong to cheat here. here are a lot of teratve technques that can be used to solve the general case of a set of smultaneous equatons (wrtten n the matr form as y = A), but ths chapter sn

More information

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE

CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE CHAPTER 5 NUMERICAL EVALUATION OF DYNAMIC RESPONSE Analytcal soluton s usually not possble when exctaton vares arbtrarly wth tme or f the system s nonlnear. Such problems can be solved by numercal tmesteppng

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13

CME 302: NUMERICAL LINEAR ALGEBRA FALL 2005/06 LECTURE 13 CME 30: NUMERICAL LINEAR ALGEBRA FALL 005/06 LECTURE 13 GENE H GOLUB 1 Iteratve Methods Very large problems (naturally sparse, from applcatons): teratve methods Structured matrces (even sometmes dense,

More information

x = , so that calculated

x = , so that calculated Stat 4, secton Sngle Factor ANOVA notes by Tm Plachowsk n chapter 8 we conducted hypothess tests n whch we compared a sngle sample s mean or proporton to some hypotheszed value Chapter 9 expanded ths to

More information

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system.

= = = (a) Use the MATLAB command rref to solve the system. (b) Let A be the coefficient matrix and B be the right-hand side of the system. Chapter Matlab Exercses Chapter Matlab Exercses. Consder the lnear system of Example n Secton.. x x x y z y y z (a) Use the MATLAB command rref to solve the system. (b) Let A be the coeffcent matrx and

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1

Physics 5153 Classical Mechanics. D Alembert s Principle and The Lagrangian-1 P. Guterrez Physcs 5153 Classcal Mechancs D Alembert s Prncple and The Lagrangan 1 Introducton The prncple of vrtual work provdes a method of solvng problems of statc equlbrum wthout havng to consder the

More information

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede

Fall 2012 Analysis of Experimental Measurements B. Eisenstein/rev. S. Errede Fall 0 Analyss of Expermental easurements B. Esensten/rev. S. Errede We now reformulate the lnear Least Squares ethod n more general terms, sutable for (eventually extendng to the non-lnear case, and also

More information

Composite Hypotheses testing

Composite Hypotheses testing Composte ypotheses testng In many hypothess testng problems there are many possble dstrbutons that can occur under each of the hypotheses. The output of the source s a set of parameters (ponts n a parameter

More information

Chapter 11: Simple Linear Regression and Correlation

Chapter 11: Simple Linear Regression and Correlation Chapter 11: Smple Lnear Regresson and Correlaton 11-1 Emprcal Models 11-2 Smple Lnear Regresson 11-3 Propertes of the Least Squares Estmators 11-4 Hypothess Test n Smple Lnear Regresson 11-4.1 Use of t-tests

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

Solution Thermodynamics

Solution Thermodynamics Soluton hermodynamcs usng Wagner Notaton by Stanley. Howard Department of aterals and etallurgcal Engneerng South Dakota School of nes and echnology Rapd Cty, SD 57701 January 7, 001 Soluton hermodynamcs

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0

n α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0 MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4)

Econ107 Applied Econometrics Topic 3: Classical Model (Studenmund, Chapter 4) I. Classcal Assumptons Econ7 Appled Econometrcs Topc 3: Classcal Model (Studenmund, Chapter 4) We have defned OLS and studed some algebrac propertes of OLS. In ths topc we wll study statstcal propertes

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

Inductance Calculation for Conductors of Arbitrary Shape

Inductance Calculation for Conductors of Arbitrary Shape CRYO/02/028 Aprl 5, 2002 Inductance Calculaton for Conductors of Arbtrary Shape L. Bottura Dstrbuton: Internal Summary In ths note we descrbe a method for the numercal calculaton of nductances among conductors

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

17. Coordinate-Free Projective Geometry for Computer Vision

17. Coordinate-Free Projective Geometry for Computer Vision 17. Coordnate-Free Projectve Geometry for Computer Vson Hongbo L and Gerald Sommer Insttute of Computer Scence and Appled Mathematcs, Chrstan-Albrechts-Unversty of Kel 17.1 Introducton How to represent

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

An Interactive Optimisation Tool for Allocation Problems

An Interactive Optimisation Tool for Allocation Problems An Interactve Optmsaton ool for Allocaton Problems Fredr Bonäs, Joam Westerlund and apo Westerlund Process Desgn Laboratory, Faculty of echnology, Åbo Aadem Unversty, uru 20500, Fnland hs paper presents

More information

FINITELY-GENERATED MODULES OVER A PRINCIPAL IDEAL DOMAIN

FINITELY-GENERATED MODULES OVER A PRINCIPAL IDEAL DOMAIN FINITELY-GENERTED MODULES OVER PRINCIPL IDEL DOMIN EMMNUEL KOWLSKI Throughout ths note, s a prncpal deal doman. We recall the classfcaton theorem: Theorem 1. Let M be a fntely-generated -module. (1) There

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification

2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton

More information

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M

CIS526: Machine Learning Lecture 3 (Sept 16, 2003) Linear Regression. Preparation help: Xiaoying Huang. x 1 θ 1 output... θ M x M CIS56: achne Learnng Lecture 3 (Sept 6, 003) Preparaton help: Xaoyng Huang Lnear Regresson Lnear regresson can be represented by a functonal form: f(; θ) = θ 0 0 +θ + + θ = θ = 0 ote: 0 s a dummy attrbute

More information

= z 20 z n. (k 20) + 4 z k = 4

= z 20 z n. (k 20) + 4 z k = 4 Problem Set #7 solutons 7.2.. (a Fnd the coeffcent of z k n (z + z 5 + z 6 + z 7 + 5, k 20. We use the known seres expanson ( n+l ( z l l z n below: (z + z 5 + z 6 + z 7 + 5 (z 5 ( + z + z 2 + z + 5 5

More information

Joint Statistical Meetings - Biopharmaceutical Section

Joint Statistical Meetings - Biopharmaceutical Section Iteratve Ch-Square Test for Equvalence of Multple Treatment Groups Te-Hua Ng*, U.S. Food and Drug Admnstraton 1401 Rockvlle Pke, #200S, HFM-217, Rockvlle, MD 20852-1448 Key Words: Equvalence Testng; Actve

More information

Lossy Compression. Compromise accuracy of reconstruction for increased compression.

Lossy Compression. Compromise accuracy of reconstruction for increased compression. Lossy Compresson Compromse accuracy of reconstructon for ncreased compresson. The reconstructon s usually vsbly ndstngushable from the orgnal mage. Typcally, one can get up to 0:1 compresson wth almost

More information

Grover s Algorithm + Quantum Zeno Effect + Vaidman

Grover s Algorithm + Quantum Zeno Effect + Vaidman Grover s Algorthm + Quantum Zeno Effect + Vadman CS 294-2 Bomb 10/12/04 Fall 2004 Lecture 11 Grover s algorthm Recall that Grover s algorthm for searchng over a space of sze wors as follows: consder the

More information

Comparison of Regression Lines

Comparison of Regression Lines STATGRAPHICS Rev. 9/13/2013 Comparson of Regresson Lnes Summary... 1 Data Input... 3 Analyss Summary... 4 Plot of Ftted Model... 6 Condtonal Sums of Squares... 6 Analyss Optons... 7 Forecasts... 8 Confdence

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1

C/CS/Phy191 Problem Set 3 Solutions Out: Oct 1, 2008., where ( 00. ), so the overall state of the system is ) ( ( ( ( 00 ± 11 ), Φ ± = 1 C/CS/Phy9 Problem Set 3 Solutons Out: Oct, 8 Suppose you have two qubts n some arbtrary entangled state ψ You apply the teleportaton protocol to each of the qubts separately What s the resultng state obtaned

More information

10. Canonical Transformations Michael Fowler

10. Canonical Transformations Michael Fowler 10. Canoncal Transformatons Mchael Fowler Pont Transformatons It s clear that Lagrange s equatons are correct for any reasonable choce of parameters labelng the system confguraton. Let s call our frst

More information

Large-scale packing of ellipsoids

Large-scale packing of ellipsoids Large-scale packng of ellpsods E. G. Brgn R. D. Lobato September 7, 017 Abstract The problem of packng ellpsods n the n-dmensonal space s consdered n the present work. The proposed approach combnes heurstc

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

Games of Threats. Elon Kohlberg Abraham Neyman. Working Paper

Games of Threats. Elon Kohlberg Abraham Neyman. Working Paper Games of Threats Elon Kohlberg Abraham Neyman Workng Paper 18-023 Games of Threats Elon Kohlberg Harvard Busness School Abraham Neyman The Hebrew Unversty of Jerusalem Workng Paper 18-023 Copyrght 2017

More information

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise.

Chapter 2 - The Simple Linear Regression Model S =0. e i is a random error. S β2 β. This is a minimization problem. Solution is a calculus exercise. Chapter - The Smple Lnear Regresson Model The lnear regresson equaton s: where y + = β + β e for =,..., y and are observable varables e s a random error How can an estmaton rule be constructed for the

More information

Linear Regression Analysis: Terminology and Notation

Linear Regression Analysis: Terminology and Notation ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented

More information

Finite Element Modelling of truss/cable structures

Finite Element Modelling of truss/cable structures Pet Schreurs Endhoven Unversty of echnology Department of Mechancal Engneerng Materals echnology November 3, 214 Fnte Element Modellng of truss/cable structures 1 Fnte Element Analyss of prestressed structures

More information