LAPLACIAN MATRIX IN ALGEBRAIC GRAPH THEORY

Size: px
Start display at page:

Download "LAPLACIAN MATRIX IN ALGEBRAIC GRAPH THEORY"

Transcription

1 Aryabhatta Joural of Mathematcs & Iformatcs Vol 6, No, Ja-July, 04 ISSN : Joural Impact Factor (03) : 0489 LAPLACIAN MARIX IN ALGEBRAIC GRAPH HEORY ARameshkumar *, RPalakumar ** ad SDeepa *** * Head, Departmet of Mathematcs, Srmad Adava Arts ad Scece College, VKovl, rchy ** Asst Professor, Departmet of Mathematcs, Srmad Adava Arts ad Scece College, VKovl, rchy *** AsstProfessor, Sr Saratha Arts ad Scece College for wome, Perambalur *Emal Id: rameshmaths@ymalcom, palarkumar@yahooco, sdeepamathematcs@yahoocom ABSRAC: I ths paper we tur to the spectral decomposto of the Laplaca matrx We show how the elemets of the spectral matrx for the Laplaca ca be used to costruct symmetrc polyomals that are permutato varats he coeffcets of these polyomals ca be used as graph features whch ca be ecoded a vectoral maer We exted ths represetato to graphs whch there are uary attrbutes o the odes ad bary attrbutes o the edges by usg the spectral decomposto of a Hermta property matrx that ca be vewed as a complex aalogue of the Laplaca Key words: Laplaca Matrx, Spectral Matrx, Hermta Property Matrx, Permutato matrx, symmetrc polyomals MSC 0: 05CXX INRODUCION Graph structures have proved computatoally cumbersome for patter aalyss he reaso for ths s that before graphs ca be coverted to patter vectors, correspodeces must be establshed betwee the odes of structures whch are potetally of dfferet sze o embed the graphs a patter space, we explore whether the vectors of varats ca be embedded a low dmesoal space usg a umber of alteratve strateges cludg prcpal compoets aalyss (PCA), multdmesoal scalg (MDS) ad localty preservg projecto (LPP) Expermetally, we demostrate the embeddgs result well defed graph clusters he aalyss of relatoal patters, or graphs, has prove to be cosderably more elusve tha the aalyss of vectoral patters Relatoal patters arse aturally the represetato of data whch there s a structural arragemet, ad are ecoutered computer vso, geomcs ad etwork aalyss Oe of the challeges that arse these domas s that of kowledge dscovery from large graph datasets he tools that are requred ths edeavour are robust algorthms that ca be used to orgase, query ad avgate large sets of graphs I partcular, the graphs eed to be embedded a patter space so that smlar structures are close together ad dssmlar oes are far apart Moreover, f the graphs ca be embedded o a mafold a patter space, the the modes of shape varato ca be explored by traversg the mafold a systematc way he process of costructg low dmesoal spaces or mafolds s a route procedure wth patter-vectors A varety of well establshed techques such as prcpal compoets aalyss [], multdmesoal scalg [7] ad depedet compoets aalyss, together wth more recetly developed oes such as locally lear embeddg, so-map ad the Laplaca egemap [] exst for solvg the problem -65-

2 ARameshkumar, RPalakumar ad SDeepa I addto to provdg geerc data aalyss tools, these methods have bee extesvely exploted computer vso to costruct shape-spaces for D or 3D objects, ad partcular faces, represeted usg coordate ad testy data Collectvely these methods are sometmes referred to as mafold learg theory However, there are few aalogous methods whch ca be used to costruct low dmesoal patter spaces or mafolds for sets of graphs NOAIONS PCA Prcpal Compoet Aalyss MDS Mult Dmesoal Scalg LPP Localty Preservg Projecto LDA Lear Dscrmat Aalyss P U Permutato Matrx L Laplaca Matrx H Hermta Matrx B K symmetrc Polyomals U s Orthogoal Matrces s Dagoal Matrces dagger operator 3 SPECRAL GRAPH REPRESENAIONS Cosder the udrected graph G = (V, E,W) wth ode-set V = {v, v,,v }, edgeset E = {e, e,, e m } V V ad weght fucto W : E (0, ] he adjacecy matrx A for the graph G s the symmetrc matrx wth elemets A ab, f ( va, vb ) 0, otherwse I other words, the matrx represets the edge structure of the graph Clearly f the graph s udrected, the matrx A s symmetrc If the graph edges are weghted, the adjacecy matrx s defed to be w( va, vb ), f ( va, vb ) Aab 0, otherwse he Laplaca of the graph s gve by L = D A where D s the dagoal ode degree matrx whose elemets D aa =b Aab are the umber of edges whch ext the dvdual odes he Laplaca s more sutable for spectral aalyss tha the adjacecy matrx sce t s postve semdefte I geeral the task of comparg two such graphs G ad G volves fdg a correspodece mappg betwee the odes of the two graphs, f : v v he recovery of the correspodece map f ca be posed as that of mmsg a error crtero -66-

3 Laplaca Matrx I Algebrac Graph heory he mmum value of the crtero ca be take as a measure of the smlarty of the two graphs he addtoal ode represets a ull match or dummy ode Extraeous or addtoal odes are matched to the dummy ode A umber of search ad optmsato methods have bee developed to solve ths problem [5, 9] We may also cosder the correspodece mappg problem as oe of fdg the permutato of odes the secod graph whch places them the same order as that of the frst graph hs permutato ca be used to map the Laplaca matrx of the secod graph oto that of the frst If the graphs are somorphc the ths permutato matrx satsfes the codto L =PL P Whe the graphs are ot exactly somorphc, the ths codto o loger holds However, the Frobeus dstace L = PL P betwee the matrces ca be used to gauge the degree of smlarty betwee the two graphs Spectral techques have bee used to solve ths problem For stace, workg wth adjacecy matrces the permutato matrx P U that mmses the Frobeus orm J(PU ) = PUAP U - A he method performs the sgular value decompostos A = UU ad A = U U, where the U s are orthogoal matrces ad the s are dagoal matrces [] Oce these factorzatos have bee performed, the requred permutato matrx s approxmated by U U I some applcatos, especally structural chemstry, egevalues have also bee used to compare the structural smlarty of dfferet graphs However, although the egevalue spectrum s a permutato varat, t represets oly a fracto of the formato resdg the ege system of the adjacecy matrx Sce the matrx L s postve semdefte, t has egevalues whch are all ether postve or zero he spectral matrx s foud by performg the egevector expaso for the Laplaca matrx L, e L e e where λ ad e are the egevectors ad egevalues of the symmetrc matrx L he spectral matrx the has the scaled egevectors as colums ad s gve by e e (), he matrx Φ s a complete represetato of the graph the sese that we ca use t to recostruct the orgal Laplaca matrx usg the relato L = ΦΦ he matrx Φ s a uque represetato of L ff all egevalues are dstct or zero hs follows drectly from the fact that there are dstct egevectors whe the egevalues are also all dstct Whe a egevalue s repeated, the there exsts a subspace spaed by the egevectors of the degeerate egevalues whch all vectors are also egevectors of L I ths stuato, f the repeated egevalue s o-zero there s cotuum of spectral matrces represetg the same graph However, ths s rare for moderately large graphs hose graphs for whch the egevalues are dstct or zero are referred to as smple e 4 NODE PERMUAIONS AND INVARIANS he topology of a graph s varat uder permutatos of the ode labels However, the adjacecy matrx, ad hece the Laplaca matrx, s modfed by the ode order sce the rows ad colums are dexed by the ode order If we relabel the odes, the Laplaca matrx udergoes a permutato of both rows ad colums Let the matrx P be the permutato matrx represetg the chage ode order he permuted matrx s L = PLP here -67-

4 ARameshkumar, RPalakumar ad SDeepa s a famly of Laplaca matrces whch are ca be trasformed to oe aother usg a permutato matrx he spectral matrx s also modfed by permutatos, but the permutato oly reorders the rows of the matrx Φo show ths, let L be the Laplaca matrx of a graph G ad let L = PLP be the Laplaca matrx obtaed by relabellg the odes usg the permutato P Further, let e be a ormalzed egevector of L wth assocated egevalue λ, ad let e = Pe Wth these gredets, we have that Le PLP Pe = PLe = e Hece, e s a egevector of L wth assocated egevalue λ As a result, we ca wrte the spectral matrxφ of the permuted Laplaca matrx L =Φ Φ as Φ = PΦ Drect comparso of the spectral matrces for dfferet graphs s hece ot possble because of the ukow permutato he egevalues of the adjacecy matrx have bee used as a compact spectral represetato for comparg graphs because they are ot chaged by the applcato of a permutato matrx he egevalues ca be recovered from the spectral matrx usg the detty j he expresso j s fact a symmetrc polyomal the compoets of egevector e A symmetrc polyomal s varat uder permutato of the varable dces [3] I ths case, the polyomal s varat uder permutato of the row dex I fact the egevalue s just oe example of a famly of symmetrc polyomals whch ca be defed o the compoets of the spectral matrx However, there s a specal set of these polyomals, referred to as the elemetary symmetrc polyomals (S) that form a bass set for symmetrc polyomals I other words, ay symmetrc polyomal ca tself be expressed as a polyomal fucto of the elemetary symmetrc polyomals belogg to the set S We therefore tur our atteto to the set of elemetary symmetrc polyomals [4] For a set of varables {v, v v } they ca be defed as j S ( v, v, v ) v S ( v, v, v ) v v v j ( r v, v, v ) v v S v r j r -68-

5 he power symmetrc polyomal fuctos S ( v, v, v ) has roots v, v,, v Multplyg out Equato (3) gves -69- v P ( v, v, v ) v P ( v, v, v ) v P ( v r P ( v, v, v ), v, v) v v r Laplaca Matrx I Algebrac Graph heory also form a bass set over the set of symmetrc polyomals As a cosequece, ay fucto whch s varat to permutato of the varable dces ad that ca be expaded as a aylor seres, ca be expressed terms of oe of these sets of polyomals he two sets of polyomals are related to oe aother by the Newto-Grard formula: r r ( ) k Sr Pk Srk r ( ) () where we have used the shorthad S r for S r(v,, v ) ad Pr for P r(v,, v ) As a cosequece, the elemetary symmetrc polyomals ca be effcetly computed usg the power symmetrc polyomals I ths paper, we ted to use the polyomals to costruct varats from the elemets of the spectral matrx he polyomals ca provde spectral features whch are varat uder ode permutatos of the odes a graph ad utlse the full spectral matrx hese features are costructed as follows; each colum of the spectral matrx Φ forms the put to the set of spectral polyomals For example the colum {Φ,, Φ,,, Φ, } produces the polyomals S (Φ,,Φ,,,Φ, ), S (Φ,, Φ,,, Φ, ),, S (Φ,, Φ,,, Φ, ) he values of each of these polyomals are varat to the ode order of the Laplaca We ca costruct a set of spectral features usg the colums of the spectral matrx combato wth the symmetrc polyomals Each set of features for each spectral mode cotas all the formato about that mode up to a permutato of compoets hs meas that t s possble to recostruct the orgal compoets of the mode gve the values of the features oly hs s acheved usg the relatoshp betwee the roots of a polyomal x ad the elemetary symmetrc polyomals he polyomal k ( x ) 0 (3) v

6 ARameshkumar, RPalakumar ad SDeepa x -S x - - S x (-) S 0 (4) where we have aga used the shorthad S r for S r(v,, v ) By substtutg the feature values to Equato (4) ad fdg the roots, we ca recover the values of the orgal compoets he root order s udetermed, so as expected the values are recovered up to a permutato 5 UNARY AND BINARY ARIBUES Attrbuted graphs are a mportat class of represetatos ad eed to be accommodated graph matchg We have suggested the use of a augmeted matrx to capture addtoal measuremet formato Whle t s possble to make use of a such a approach cojucto wth symmetrc polyomals, aother approach from the spectral theory of Hermta matrces suggests tself A Hermta matrx H s a square matrx wth complex elemets that remas uchaged uder the jot operato of trasposto ad complex cojugato of the elemets, e H = H Hermta matrces ca be vewed as the complex umber couterpart of the symmetrc matrx for real umbers Each off-dagoal elemet s a complex umber whch has two compoets, ad ca therefore represet a -compoet measuremet vector o a graph edge he o-dagoal elemets are ecessarly real quattes, so the ode measuremets are restrcted to be scalar quattes here are some costrats o how the measuremets may be represeted order to produce a postve semdefte Hermta matrx Let {x, x,,x } be a set of measuremets for the ode-set V Further, let {y,, y,3,, y, } be the set of measuremets assocated wth the edges of the graph, addto to the graph weghts [6] Each edge the has a par of observatos (W a,b, y a,b) assocated wth t here are a umber of ways whch the complex umber H a,b could represet ths formato, for example wth the real part as W ad the magary part as y However, we would lke our complex property matrx to reflect the Laplaca As a result the off-dagoal elemets of H are chose to be H a,b = W a,be yab (5) I other words, the coecto weghts are ecoded by the magtude of the complex umber H a,b ad the addtoal measuremet by ts phase By usg ths ecodg, the magtude of the umbers s the same as the orgal Laplaca matrx Clearly ths ecodg s most sutable whe the measuremets are agles If the measuremets are easly bouded, they ca be mapped oto a agular terval ad phase wrappg ca be avoded If the measuremets are ot easly bouded the ths ecodg s ot sutable he measuremets must satsfy the codtos π y a,b < π ad y a,b = y b,a to produce a Hermta matrx o esure a postve defte matrx, we requre H aa > H hs codto s satsfed f b a ab Whe defed ths way the property matrx s a complex aalogue of the weghted Laplaca for the graph For a Hermta matrx there s a orthogoal complete bass set of egevectors ad egevalues obeyg the egevalue equato He = λe I the Hermta case, the egevalues λ are real ad the compoets of the egevectors e are complex here s a potetal ambguty the egevectors, that ay multple of a -70- H x W, ad x a 0 (6) aa a ba a b

7 Laplaca Matrx I Algebrac Graph heory egevector s also a soluto, e Hαe = λαe I the real case, we choose α such that e s of ut legth I the complex case, α tself may be complex, ad eeds to determe by two costrats We set the vector legth to e = ad addto we mpose the codto arg e 0, whch specfes both real ad magary parts hs represetato ca be exteded further by usg the four-compoet complex umbers kow as quateros As wth real ad complex umbers, there s a approprate ege decomposto whch allows the spectral matrx to be foud I ths case, a edge weght ad three addtoal bary measuremets may be ecoded o a edge It s ot possble to ecode more tha oe uary measuremet usg ths approach However, for the expermets ths paper, we have cocetrated o the complex represetato Whe the egevectors are costructed ths way the spectral matrx s foud by performg the egevector expaso H e e where λ ad e are the egevectors ad egevalues of the Hermta matrx H [8] We costruct the complex spectral matrx for the graph G usg the egevectors as colums, e e e e (7), We ca aga recostruct the orgal Hermta property matrx usg the relato H = ΦΦ Sce the compoets of the egevectors are complex umbers ad therefore each symmetrc polyomal s complex Hece, the symmetrc polyomals must be evaluated wth complex arthmetc ad also evaluate to complex umbers Each S r therefore has both real ad magary compoets he real ad magary compoets of the symmetrc polyomals are terleaved ad stacked to form a feature-vector B for the graph hs featurevector s real 6 GRAPH EMBEDDING MEHODS We explore three dfferet methods for embeddg the graph feature vectors a patter space wo of these are classcal methods Prcpal compoets aalyss (PCA) fds the projecto that accouts for the varace or scatter of the data Multdmesoal scalg (MDS), o the other had, preserves the relatve dstaces betwee objects he remag method s a ewly reported oe that offers a compromse betwee preservg varace ad the relatoal arragemet of the data, ad s referred to as localty preservg projecto [0] I ths paper we are cocered wth the set of graphs G, G,, G k,, G N he k th graph s deoted by G k = (V k, E k) ad the assocated vector of symmetrc polyomals s deoted by B k 6 Prcpal compoet aalyss We commece by costructg the matrx X = [B B B B B k B B N B ], wth the graph feature vectors as colums Here B s the mea feature vector for the dataset Next, we compute the covarace matrx for the elemets of the feature vectors by takg the matrx product C = XX We extract the prcpal compoets drectos by performg the egedecomposto C N l u u o the covarace matrx C, where the l are the egevalues ad the u are the egevectors We use the frst s leadg egevectors to represet the graphs extracted -7-

8 ARameshkumar, RPalakumar ad SDeepa from the mages he coordate system of the egespace s spaed by the s orthogoal vectors U = (u, u,, u s ) he dvdual graphs represeted by the log vectors B k, k=,,, N ca be projected oto ths egespace usg the formula y k = U (B k B ) Hece each graph G k s represeted by a s-compoet vector y k the egespace Lear dscrmat aalyss (LDA) s a exteso of PCA to the multclass problem We commece by costructg separate data matrces X,X, X Nc for each of the N c classes hese may be used to compute the ~ Nc correspodg class covarace matrces C X X he average class covarace matrx C C N s foud hs matrx s used as a spherg trasform We commece by computg the egedecomposto N ~ C luu UU where U s the matrx wth the egevectors of C ~ as colums ad Λ= dag(l, l,, l ) s the dagoal egevalue matrx he sphered represetato of the data s X = Λ / U X Stadard PCA s the appled to the resultg data matrx X he purpose of ths techque s to fd a lear projecto whch descrbes the class dffereces rather tha the overall varace of the data 6 Multdmesoal scalg Multdmesoal scalg (MDS) s a procedure whch allows data specfed terms of a matrx of parwse dstaces to be embedded a Eucldea space Here we ted to use the method to embed the graphs extracted from dfferet vewpots a lowdmesoal space o commece we requre parwse dstaces betwee graphs We do ths by computg the orms betwee the spectral patter vectors for the graphs For the graphs dexed ad, the dstace s d = (B B ) (B B ) he parwse dstaces d, are used as the elemets of a, N N dssmlarty matrx R, whose elemets are defed as follows d, f R, (8) 0 f I ths paper, we use the classcal multdmesoal scalg method [7] to embed the graphs a Eucldea space usg the matrx of parwse dssmlartes R he frst step of MDS s to calculate a matrx whose elemet wth row r ad colum c s gve by ˆ N ˆ ˆ rc drc dr d c d where dˆ r c d rc s the average dssmlarty N value over the r th row, d ˆ c s the dssmlarty average value over the c th N N colum ad dˆ r c d r, c s the N average dssmlarty value over all rows ad colums of the dssmlarty matrx R 63 Localty preservg projecto he LPP s a lear dmesoalty reducto method whch attempts to project hgh dmesoal data to a low dmesoal mafold, whle preservg the eghbourhood structure of the data set he method s relatvely sestve to outlers ad ose hs s a mportat feature our graph clusterg task sce the outlers are usually troduced by mperfect segmetato processes he learty of the method makes t computatoally effcet -7- c

9 Laplaca Matrx I Algebrac Graph heory he graph feature vectors are used as the colums of a data matrx X = ( B B B N ) he relatoal structure of the data s represeted by a proxmty weght matrx W wth elemets W, = exp[ kd, ], where k s a costat If Q s the dagoal degree matrx wth the row weghts N Q k k j W k, j as elemets, the the relatoal structure of the data s represeted usg the Laplaca matrx J = Q W he dea behd LPP s to aalyse the structure of the weghted covarace matrx XWX he optmal projecto of the data s foud by solvg the geeralsed egevector problem XJX u = lxqx u (9) We project the data oto the space spaed by the egevectors correspodg to the s smallest egevalues Let U = (u, u,, u s ) be the matrx wth the correspodg egevectors as colums, the projecto of the kth feature vector s y k = U B k 7 SHOCK GRAPHS 7 ree Attrbutes Before processg, the shapes are frstly ormalsed area ad alged alog the axs of largest momet After performg these trasforms, the dstaces ad agles assocated wth the dfferet shapes ca be drectly compared, ad ca therefore be used as attrbutes o abstract the shape skeleto usg a tree, we place a ode at each jucto pot the skeleto he edges of the tree represet the exstece of a coectg skeletal brach betwee pars of juctos he odes of the tree are charactersed usg the radus r(a) of the smallest btaget crcle from the jucto to the boudary Hece, for the ode a, x a = r(a) he edges are charactersed by two measuremets For the edge (a, b) the frst of these, y a,b s the agle betwee the odes a ad b, e y a,b = θ(a, b) Sce most skeleto braches are relatvely straght, ths s a approxmato to the agle of the correspodg skeletal brach Furthermore, sce π θ(a, b) < π ad θ(a, b) = θ(b, a), the measuremet s already sutable for use the Hermta property matrx I order to compute edge weghts, we ote that the mportace of a skeletal brach may be determed by the rate of chage of boudary legth l wth skeleto legth s, whch we deote by dl/ds hs quatty s related to the rate of chage of the btaget crcle radus alog the skeleto, e dr/ds, by the formula dr ds he edge weght W a,b s gve by the average value of dl/ds alog the relevat skeletal brach dl ds -73-

10 ARameshkumar, RPalakumar ad SDeepa Fgure A: Examples from the shape database wth ther assocated skeletos We extract the skeleto from each bary shape ad attrbute the resultg tree the maer outled Fgure A shows some examples of the types of shape preset the database alog wth ther skeletos We commece by showg some results for the three shapes show Fgure A he objects studed are a had, some puppes ad some cars he dog ad car shapes cosst of a umber of dfferet objects ad dfferet vews of each object he had category cotas dfferet had cofguratos We apply the three embeddg strateges outle to the vectors of permutato varats extracted from the Hermta varat of the Laplaca 7 Expermets wth shock trees Our expermets are performed usg a database of 4 bary shapes Each bary shape s extracted from a D vew of a 3D object here are 3 classes the database, ad for each object there are a umber of vews acqured from dfferet vewg drectos ad a umber of dfferet examples of the class Fgure B: MDS (left), PCA (mddle) ad LPP (rght) appled to the shock graphs We commece the left had pael of Fgure B by showg the result of applyg the MDS procedure to the three shape categores he had shapes form a compact cluster the MDS space here are other local clusters cosstg of three or four members of the remag two classes hs reflects the fact that whle the had shapes -74-

11 Laplaca Matrx I Algebrac Graph heory have very smlar shock graphs, the remag two categores have rather varable shock graphs because of the dfferet objects he mddle pael of Fgure B shows the result of usg PCA Here the dstrbutos of shapes are much less compact Whle a dstct cluster of had shapes stll occurs, they are geerally more dspersed over the feature space here are some dstct clusters of the car shape, but the dstrbutos overlap more the PCA projecto whe compared to the MDS space he rght-had pael of Fgure B shows the result of the LPP procedure o the dataset he results are smlar to the PCA method Oe of the motvatos for the work preseted here was the potetal ambgutes that are ecoutered whe usg the spectral features of trees o demostrate the effect of usg attrbuted trees rather tha smply weghtg the edges, we have compared the LDA projectos usg both types of data Fgure C : A comparso of attrbuted trees wth weghted trees Left : trees wth edge weghts based o boudary legths Rght : Attrbuted trees wth addtoal edge agle formato I Fgure C the rght-had plot shows the result obtaed usg the symmetrc polyomals from the egevectors of the Laplaca matrx L=D W, assocated wth the edge weght matrx he left-had plot shows the result of usg the Hermta property matrx he Hermta property matrx for the attrbuted trees produces a better class separato tha the Laplaca matrx for the weghted trees he separato ca be measured by the Fsher dscrmat betwee the classes, whch s the squared dstace betwee class cetres dvded by the varace alog the le jog the cetres able I Separatos Classes Hermta property matrx Weghted matrx Car/dog 077 Car/had Dog/had

12 ARameshkumar, RPalakumar ad SDeepa 8 CONCLUSIONS We have show how graphs ca be coverted to patter vectors by utlzg the spectral decomposto of the Laplaca matrx ad bass sets of symmetrc polyomals hese feature vectors are complete, uque ad cotuous However, ad most mportat of all, they are permutato varats We vestgate how to embed the vectors a patter space, sutable for clusterg the graphs Here we explore a umber of alteratves cludg PCA, MDS ad LPP I a expermetal study we show that the feature vectors derved from the symmetrc polyomals of the Laplaca spectral decomposto yeld good clusters whe MDS or LPP are used here are clearly a umber of ways whch the work preseted ths paper ca be developed For stace, sce the represetato based o the symmetrc polyomals s complete, they may form the meas by whch a geeratve model of varatos graph structure ca be developed hs model could be leared the space spaed by the permutato varats, ad the mea graph ad ts modes of varato recostructed by vertg the system of equatos assocated wth the symmetrc polyomals REFERENCES ) AD Bagdaov ad M Worrg, Frst Order Gaussa Graphs for Effcet Structure Classfcato, Patter Recogto, 36, pp 3-34, 003 ) MBelk ad P Nyog, Laplaca Egemaps for Dmesoalty Reducto ad Data Represetato, Neural Computato, 5(6), pp , 003 3) N Bggs, Algebrac Graph heory, CUP 4) P Bott ad R Morrs, Almost all trees share a complete set of maatal polyomals, Joural of Graph heory, 7, pp , 993 5) W J Chrstmas, J Kttler ad M Petrou, Structural Matchg ComputerVso usg Probablstc Relaxato, IEEE rasactos o Patter Aalyss ad Mache Itellgece, 7, pp , 995 6) FRK Chug, Spectral Graph heory, Amerca Mathmatcal Socety Ed,CBMS seres 9, 997 7) Cox ad M Cox, Multdmesoal Scalg, Chapma-Hall, 994 8) D Cvetkovc, P Rowlso ad S Smc, Egespaces of graphs, Cambrdge Uversty Press, 997 9) S Gold ad A Ragaraja, A Graduated Assgmet Algorthm for Graph Matchg, IEEE rasactos o Patter Aalyss ad Mache Itellgece, 8, pp , 996 0) XHe ad P Nyog, Localty preservg projectos, Advaces Neural IformatoProcessg Systems 6, MI Press, 003 ) D Heckerma, D Geger ad DM Chckerg, Learg Bayesa Networks: hecombato of kowledge ad statstcal data, Mache Learg, 0, pp 97-43, 995 ) G Nrmala ad M Vjya Strog Fuzzy Graphs o Composto, esor Ad Normal Products Aryabhatta J Maths & Ifo Vol 4 () 0, pp ) K hlakam & A Sumath Weer Idex of Cha Graphs Aryabhatta J Maths & Ifo Vol 5 () 03, pp

Chapter 9 Jordan Block Matrices

Chapter 9 Jordan Block Matrices Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.

More information

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class) Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form

More information

MOLECULAR VIBRATIONS

MOLECULAR VIBRATIONS MOLECULAR VIBRATIONS Here we wsh to vestgate molecular vbratos ad draw a smlarty betwee the theory of molecular vbratos ad Hückel theory. 1. Smple Harmoc Oscllator Recall that the eergy of a oe-dmesoal

More information

3D Geometry for Computer Graphics. Lesson 2: PCA & SVD

3D Geometry for Computer Graphics. Lesson 2: PCA & SVD 3D Geometry for Computer Graphcs Lesso 2: PCA & SVD Last week - egedecomposto We wat to lear how the matrx A works: A 2 Last week - egedecomposto If we look at arbtrary vectors, t does t tell us much.

More information

QR Factorization and Singular Value Decomposition COS 323

QR Factorization and Singular Value Decomposition COS 323 QR Factorzato ad Sgular Value Decomposto COS 33 Why Yet Aother Method? How do we solve least-squares wthout currg codto-squarg effect of ormal equatos (A T A A T b) whe A s sgular, fat, or otherwse poorly-specfed?

More information

MATH 247/Winter Notes on the adjoint and on normal operators.

MATH 247/Winter Notes on the adjoint and on normal operators. MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

4 Inner Product Spaces

4 Inner Product Spaces 11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

An Introduction to. Support Vector Machine

An Introduction to. Support Vector Machine A Itroducto to Support Vector Mache Support Vector Mache (SVM) A classfer derved from statstcal learg theory by Vapk, et al. 99 SVM became famous whe, usg mages as put, t gave accuracy comparable to eural-etwork

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

On the construction of symmetric nonnegative matrix with prescribed Ritz values

On the construction of symmetric nonnegative matrix with prescribed Ritz values Joural of Lear ad Topologcal Algebra Vol. 3, No., 14, 61-66 O the costructo of symmetrc oegatve matrx wth prescrbed Rtz values A. M. Nazar a, E. Afshar b a Departmet of Mathematcs, Arak Uversty, P.O. Box

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

Numerical Analysis Formulae Booklet

Numerical Analysis Formulae Booklet Numercal Aalyss Formulae Booklet. Iteratve Scemes for Systems of Lear Algebrac Equatos:.... Taylor Seres... 3. Fte Dfferece Approxmatos... 3 4. Egevalues ad Egevectors of Matrces.... 3 5. Vector ad Matrx

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory ROAD MAP... AE301 Aerodyamcs I UNIT C: 2-D Arfols C-1: Aerodyamcs of Arfols 1 C-2: Aerodyamcs of Arfols 2 C-3: Pael Methods C-4: Th Arfol Theory AE301 Aerodyamcs I Ut C-3: Lst of Subects Problem Solutos?

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

AN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET

AN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET AN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET Abstract. The Permaet versus Determat problem s the followg: Gve a matrx X of determates over a feld of characterstc dfferet from

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

13. Parametric and Non-Parametric Uncertainties, Radial Basis Functions and Neural Network Approximations

13. Parametric and Non-Parametric Uncertainties, Radial Basis Functions and Neural Network Approximations Lecture 7 3. Parametrc ad No-Parametrc Ucertates, Radal Bass Fuctos ad Neural Network Approxmatos he parameter estmato algorthms descrbed prevous sectos were based o the assumpto that the system ucertates

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

ENGI 4421 Propagation of Error Page 8-01

ENGI 4421 Propagation of Error Page 8-01 ENGI 441 Propagato of Error Page 8-01 Propagato of Error [Navd Chapter 3; ot Devore] Ay realstc measuremet procedure cotas error. Ay calculatos based o that measuremet wll therefore also cota a error.

More information

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem

Cubic Nonpolynomial Spline Approach to the Solution of a Second Order Two-Point Boundary Value Problem Joural of Amerca Scece ;6( Cubc Nopolyomal Sple Approach to the Soluto of a Secod Order Two-Pot Boudary Value Problem W.K. Zahra, F.A. Abd El-Salam, A.A. El-Sabbagh ad Z.A. ZAk * Departmet of Egeerg athematcs

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Simple Linear Regression

Simple Linear Regression Correlato ad Smple Lear Regresso Berl Che Departmet of Computer Scece & Iformato Egeerg Natoal Tawa Normal Uversty Referece:. W. Navd. Statstcs for Egeerg ad Scetsts. Chapter 7 (7.-7.3) & Teachg Materal

More information

Principal Components. Analysis. Basic Intuition. A Method of Self Organized Learning

Principal Components. Analysis. Basic Intuition. A Method of Self Organized Learning Prcpal Compoets Aalss A Method of Self Orgazed Learg Prcpal Compoets Aalss Stadard techque for data reducto statstcal patter matchg ad sgal processg Usupervsed learg: lear from examples wthout a teacher

More information

PTAS for Bin-Packing

PTAS for Bin-Packing CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,

More information

ANALYSIS ON THE NATURE OF THE BASIC EQUATIONS IN SYNERGETIC INTER-REPRESENTATION NETWORK

ANALYSIS ON THE NATURE OF THE BASIC EQUATIONS IN SYNERGETIC INTER-REPRESENTATION NETWORK Far East Joural of Appled Mathematcs Volume, Number, 2008, Pages Ths paper s avalable ole at http://www.pphm.com 2008 Pushpa Publshg House ANALYSIS ON THE NATURE OF THE ASI EQUATIONS IN SYNERGETI INTER-REPRESENTATION

More information

Lecture 07: Poles and Zeros

Lecture 07: Poles and Zeros Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

1 Convergence of the Arnoldi method for eigenvalue problems

1 Convergence of the Arnoldi method for eigenvalue problems Lecture otes umercal lear algebra Arold method covergece Covergece of the Arold method for egevalue problems Recall that, uless t breaks dow, k steps of the Arold method geerates a orthogoal bass of a

More information

PROJECTION PROBLEM FOR REGULAR POLYGONS

PROJECTION PROBLEM FOR REGULAR POLYGONS Joural of Mathematcal Sceces: Advaces ad Applcatos Volume, Number, 008, Pages 95-50 PROJECTION PROBLEM FOR REGULAR POLYGONS College of Scece Bejg Forestry Uversty Bejg 0008 P. R. Cha e-mal: sl@bjfu.edu.c

More information

Dimensionality reduction Feature selection

Dimensionality reduction Feature selection CS 750 Mache Learg Lecture 3 Dmesoalty reducto Feature selecto Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 750 Mache Learg Dmesoalty reducto. Motvato. Classfcato problem eample: We have a put data

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

ESS Line Fitting

ESS Line Fitting ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here

More information

Dimensionality Reduction

Dimensionality Reduction Dmesoalty Reducto Sav Kumar, Google Research, NY EECS-6898, Columba Uversty - Fall, 010 Sav Kumar 11/16/010 EECS6898 Large Scale Mache Learg 1 Curse of Dmesoalty May learg techques scale poorly wth data

More information

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model Chapter 3 Asmptotc Theor ad Stochastc Regressors The ature of eplaator varable s assumed to be o-stochastc or fed repeated samples a regresso aalss Such a assumpto s approprate for those epermets whch

More information

Assignment 7/MATH 247/Winter, 2010 Due: Friday, March 19. Powers of a square matrix

Assignment 7/MATH 247/Winter, 2010 Due: Friday, March 19. Powers of a square matrix Assgmet 7/MATH 47/Wter, 00 Due: Frday, March 9 Powers o a square matrx Gve a square matrx A, ts powers A or large, or eve arbtrary, teger expoets ca be calculated by dagoalzg A -- that s possble (!) Namely,

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen.

2.28 The Wall Street Journal is probably referring to the average number of cubes used per glass measured for some population that they have chosen. .5 x 54.5 a. x 7. 786 7 b. The raked observatos are: 7.4, 7.5, 7.7, 7.8, 7.9, 8.0, 8.. Sce the sample sze 7 s odd, the meda s the (+)/ 4 th raked observato, or meda 7.8 c. The cosumer would more lkely

More information

Investigating Cellular Automata

Investigating Cellular Automata Researcher: Taylor Dupuy Advsor: Aaro Wootto Semester: Fall 4 Ivestgatg Cellular Automata A Overvew of Cellular Automata: Cellular Automata are smple computer programs that geerate rows of black ad whte

More information

MULTIDIMENSIONAL HETEROGENEOUS VARIABLE PREDICTION BASED ON EXPERTS STATEMENTS. Gennadiy Lbov, Maxim Gerasimov

MULTIDIMENSIONAL HETEROGENEOUS VARIABLE PREDICTION BASED ON EXPERTS STATEMENTS. Gennadiy Lbov, Maxim Gerasimov Iteratoal Boo Seres "Iformato Scece ad Computg" 97 MULTIIMNSIONAL HTROGNOUS VARIABL PRICTION BAS ON PRTS STATMNTS Geady Lbov Maxm Gerasmov Abstract: I the wors [ ] we proposed a approach of formg a cosesus

More information

MEASURES OF DISPERSION

MEASURES OF DISPERSION MEASURES OF DISPERSION Measure of Cetral Tedecy: Measures of Cetral Tedecy ad Dsperso ) Mathematcal Average: a) Arthmetc mea (A.M.) b) Geometrc mea (G.M.) c) Harmoc mea (H.M.) ) Averages of Posto: a) Meda

More information

h-analogue of Fibonacci Numbers

h-analogue of Fibonacci Numbers h-aalogue of Fboacc Numbers arxv:090.0038v [math-ph 30 Sep 009 H.B. Beaoum Prce Mohammad Uversty, Al-Khobar 395, Saud Araba Abstract I ths paper, we troduce the h-aalogue of Fboacc umbers for o-commutatve

More information

Announcements. Recognition II. Computer Vision I. Example: Face Detection. Evaluating a binary classifier

Announcements. Recognition II. Computer Vision I. Example: Face Detection. Evaluating a binary classifier Aoucemets Recogto II H3 exteded to toght H4 to be aouced today. Due Frday 2/8. Note wll take a whle to ru some thgs. Fal Exam: hursday 2/4 at 7pm-0pm CSE252A Lecture 7 Example: Face Detecto Evaluatg a

More information

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i. CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

DIFFERENTIAL GEOMETRIC APPROACH TO HAMILTONIAN MECHANICS

DIFFERENTIAL GEOMETRIC APPROACH TO HAMILTONIAN MECHANICS DIFFERENTIAL GEOMETRIC APPROACH TO HAMILTONIAN MECHANICS Course Project: Classcal Mechacs (PHY 40) Suja Dabholkar (Y430) Sul Yeshwath (Y444). Itroducto Hamltoa mechacs s geometry phase space. It deals

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use.

The equation is sometimes presented in form Y = a + b x. This is reasonable, but it s not the notation we use. INTRODUCTORY NOTE ON LINEAR REGREION We have data of the form (x y ) (x y ) (x y ) These wll most ofte be preseted to us as two colum of a spreadsheet As the topc develops we wll see both upper case ad

More information

18.413: Error Correcting Codes Lab March 2, Lecture 8

18.413: Error Correcting Codes Lab March 2, Lecture 8 18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse

More information

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler

BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS. Aysegul Akyuz Dascioglu and Nese Isler Mathematcal ad Computatoal Applcatos, Vol. 8, No. 3, pp. 293-300, 203 BERNSTEIN COLLOCATION METHOD FOR SOLVING NONLINEAR DIFFERENTIAL EQUATIONS Aysegul Ayuz Dascoglu ad Nese Isler Departmet of Mathematcs,

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Arithmetic Mean and Geometric Mean

Arithmetic Mean and Geometric Mean Acta Mathematca Ntresa Vol, No, p 43 48 ISSN 453-6083 Arthmetc Mea ad Geometrc Mea Mare Varga a * Peter Mchalča b a Departmet of Mathematcs, Faculty of Natural Sceces, Costate the Phlosopher Uversty Ntra,

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

III-16 G. Brief Review of Grand Orthogonality Theorem and impact on Representations (Γ i ) l i = h n = number of irreducible representations.

III-16 G. Brief Review of Grand Orthogonality Theorem and impact on Representations (Γ i ) l i = h n = number of irreducible representations. III- G. Bref evew of Grad Orthogoalty Theorem ad mpact o epresetatos ( ) GOT: h [ () m ] [ () m ] δδ δmm ll GOT puts great restrcto o form of rreducble represetato also o umber: l h umber of rreducble

More information

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations Dervato of -Pot Block Method Formula for Solvg Frst Order Stff Ordary Dfferetal Equatos Kharul Hamd Kharul Auar, Kharl Iskadar Othma, Zara Bb Ibrahm Abstract Dervato of pot block method formula wth costat

More information

Kernel-based Methods and Support Vector Machines

Kernel-based Methods and Support Vector Machines Kerel-based Methods ad Support Vector Maches Larr Holder CptS 570 Mache Learg School of Electrcal Egeerg ad Computer Scece Washgto State Uverst Refereces Muller et al. A Itroducto to Kerel-Based Learg

More information

Exercises for Square-Congruence Modulo n ver 11

Exercises for Square-Congruence Modulo n ver 11 Exercses for Square-Cogruece Modulo ver Let ad ab,.. Mark True or False. a. 3S 30 b. 3S 90 c. 3S 3 d. 3S 4 e. 4S f. 5S g. 0S 55 h. 8S 57. 9S 58 j. S 76 k. 6S 304 l. 47S 5347. Fd the equvalece classes duced

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

Application of Legendre Bernstein basis transformations to degree elevation and degree reduction

Application of Legendre Bernstein basis transformations to degree elevation and degree reduction Computer Aded Geometrc Desg 9 79 78 www.elsever.com/locate/cagd Applcato of Legedre Berste bass trasformatos to degree elevato ad degree reducto Byug-Gook Lee a Yubeom Park b Jaechl Yoo c a Dvso of Iteret

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Numercal Computg -I UNIT SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Structure Page Nos..0 Itroducto 6. Objectves 7. Ital Approxmato to a Root 7. Bsecto Method 8.. Error Aalyss 9.4 Regula Fals Method

More information

LINEAR REGRESSION ANALYSIS

LINEAR REGRESSION ANALYSIS LINEAR REGRESSION ANALYSIS MODULE V Lecture - Correctg Model Iadequaces Through Trasformato ad Weghtg Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Aalytcal methods for

More information

13. Artificial Neural Networks for Function Approximation

13. Artificial Neural Networks for Function Approximation Lecture 7 3. Artfcal eural etworks for Fucto Approxmato Motvato. A typcal cotrol desg process starts wth modelg, whch s bascally the process of costructg a mathematcal descrpto (such as a set of ODE-s)

More information

Chapter 8. Inferences about More Than Two Population Central Values

Chapter 8. Inferences about More Than Two Population Central Values Chapter 8. Ifereces about More Tha Two Populato Cetral Values Case tudy: Effect of Tmg of the Treatmet of Port-We tas wth Lasers ) To vestgate whether treatmet at a youg age would yeld better results tha

More information

Lecture Note to Rice Chapter 8

Lecture Note to Rice Chapter 8 ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,

More information

Singular Value Decomposition. Linear Algebra (3) Singular Value Decomposition. SVD and Eigenvectors. Solving LEs with SVD

Singular Value Decomposition. Linear Algebra (3) Singular Value Decomposition. SVD and Eigenvectors. Solving LEs with SVD Sgular Value Decomosto Lear Algera (3) m Cootes Ay m x matrx wth m ca e decomosed as follows Dagoal matrx A UWV m x x Orthogoal colums U U I w1 0 0 w W M M 0 0 x Orthoormal (Pure rotato) VV V V L 0 L 0

More information

Can we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?

Can we take the Mysticism Out of the Pearson Coefficient of Linear Correlation? Ca we tae the Mstcsm Out of the Pearso Coeffcet of Lear Correlato? Itroducto As the ttle of ths tutoral dcates, our purpose s to egeder a clear uderstadg of the Pearso coeffcet of lear correlato studets

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

Mean is only appropriate for interval or ratio scales, not ordinal or nominal.

Mean is only appropriate for interval or ratio scales, not ordinal or nominal. Mea Same as ordary average Sum all the data values ad dvde by the sample sze. x = ( x + x +... + x Usg summato otato, we wrte ths as x = x = x = = ) x Mea s oly approprate for terval or rato scales, ot

More information

We have already referred to a certain reaction, which takes place at high temperature after rich combustion.

We have already referred to a certain reaction, which takes place at high temperature after rich combustion. ME 41 Day 13 Topcs Chemcal Equlbrum - Theory Chemcal Equlbrum Example #1 Equlbrum Costats Chemcal Equlbrum Example #2 Chemcal Equlbrum of Hot Bured Gas 1. Chemcal Equlbrum We have already referred to a

More information

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

Chapter 3 Sampling For Proportions and Percentages

Chapter 3 Sampling For Proportions and Percentages Chapter 3 Samplg For Proportos ad Percetages I may stuatos, the characterstc uder study o whch the observatos are collected are qualtatve ature For example, the resposes of customers may marketg surveys

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

GG313 GEOLOGICAL DATA ANALYSIS

GG313 GEOLOGICAL DATA ANALYSIS GG33 GEOLOGICAL DATA ANALYSIS 3 GG33 GEOLOGICAL DATA ANALYSIS LECTURE NOTES PAUL WESSEL SECTION 3 LINEAR (MATRIX ALGEBRA OVERVIEW OF MATRIX ALGEBRA (or All you ever wated to kow about Lear Algebra but

More information

Taylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific

Taylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific CIS 54 - Iterpolato Roger Crawfs Basc Scearo We are able to prod some fucto, but do ot kow what t really s. Ths gves us a lst of data pots: [x,f ] f(x) f f + x x + August 2, 25 OSU/CIS 54 3 Taylor s Seres

More information

Some properties of symmetry classes of tensors

Some properties of symmetry classes of tensors The d Aual Meetg Mathematcs (AMM 07) Departmet of Mathematcs, Faculty of Scece Chag Ma Uversty, Chag Ma Thalad Some propertes of symmetry classes of tesors Kulathda Chmla, ad Kjt Rodtes Departmet of Mathematcs,

More information

Maps on Triangular Matrix Algebras

Maps on Triangular Matrix Algebras Maps o ragular Matrx lgebras HMED RMZI SOUROUR Departmet of Mathematcs ad Statstcs Uversty of Vctora Vctora, BC V8W 3P4 CND sourour@mathuvcca bstract We surveys results about somorphsms, Jorda somorphsms,

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

Entropies & Information Theory

Entropies & Information Theory Etropes & Iformato Theory LECTURE II Nlajaa Datta Uversty of Cambrdge,U.K. See lecture otes o: http://www.q.damtp.cam.ac.uk/ode/223 quatum system States (of a physcal system): Hlbert space (fte-dmesoal)

More information

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA

THE ROYAL STATISTICAL SOCIETY GRADUATE DIPLOMA THE ROYAL STATISTICAL SOCIETY EXAMINATIONS SOLUTIONS GRADUATE DIPLOMA PAPER II STATISTICAL THEORY & METHODS The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for

More information

Generalization of the Dissimilarity Measure of Fuzzy Sets

Generalization of the Dissimilarity Measure of Fuzzy Sets Iteratoal Mathematcal Forum 2 2007 o. 68 3395-3400 Geeralzato of the Dssmlarty Measure of Fuzzy Sets Faramarz Faghh Boformatcs Laboratory Naobotechology Research Ceter vesa Research Isttute CECR Tehra

More information

Linear Regression Linear Regression with Shrinkage. Some slides are due to Tommi Jaakkola, MIT AI Lab

Linear Regression Linear Regression with Shrinkage. Some slides are due to Tommi Jaakkola, MIT AI Lab Lear Regresso Lear Regresso th Shrkage Some sldes are due to Tomm Jaakkola, MIT AI Lab Itroducto The goal of regresso s to make quattatve real valued predctos o the bass of a vector of features or attrbutes.

More information

A conic cutting surface method for linear-quadraticsemidefinite

A conic cutting surface method for linear-quadraticsemidefinite A coc cuttg surface method for lear-quadratcsemdefte programmg Mohammad R. Osoorouch Calfora State Uversty Sa Marcos Sa Marcos, CA Jot wor wth Joh E. Mtchell RPI July 3, 2008 Outle: Secod-order coe: defto

More information

CS 1675 Introduction to Machine Learning Lecture 12 Support vector machines

CS 1675 Introduction to Machine Learning Lecture 12 Support vector machines CS 675 Itroducto to Mache Learg Lecture Support vector maches Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Mdterm eam October 9, 7 I-class eam Closed book Stud materal: Lecture otes Correspodg chapters

More information

d dt d d dt dt Also recall that by Taylor series, / 2 (enables use of sin instead of cos-see p.27 of A&F) dsin

d dt d d dt dt Also recall that by Taylor series, / 2 (enables use of sin instead of cos-see p.27 of A&F) dsin Learzato of the Swg Equato We wll cover sectos.5.-.6 ad begg of Secto 3.3 these otes. 1. Sgle mache-fte bus case Cosder a sgle mache coected to a fte bus, as show Fg. 1 below. E y1 V=1./_ Fg. 1 The admttace

More information