2. Higher Order Consensus
|
|
- Baldric Golden
- 5 years ago
- Views:
Transcription
1 Prepared by F.L. Lews Updated: Wedesday, February 3, 0. Hgher Order Cosesus I Seto we dsussed ooperatve otrol o graphs for dyamal systems that have frstorder dyams, that s, a sgle tegrator or shft regster at eah ode. ow we dsuss ooperatve otrol for etworked systems wth hgher-order dyams. Frst we osder lear systems, the systems havg seod-order posto/veloty type dyams the form of ewto s thrd law. I ths seto we use A to deote the ode dyams system matrx, ad a j to deote the graph edge weghts. hese should ot be ofused. Lear Systems o Graphs Cosder the systems dstrbuted o ommuato graph G wth detal lear tmevarat ode dyams x Ax Bu (. R m where x ( t s the state of ode ad u ( t R ts otrol put. Selet the ode otrols as the loal state varable feedbak u K aj( xj x (. j wth salar ouplg ga 0 ad feedbak otrol matrx K m R. Here, a j are the elemets of the graph adjaey matrx, ot the ode system matrx. hat s, they are the edge weghts of graph G. hese otrols are based o the loal votg protool struture where the otrol put of eah ode depeds o the dfferee betwee ts state ad those of all ts eghbors. he ouplg gas ad feedbak gas K of all odes are the same. he ode losed-loop dyams are x Ax Bu Ax BK a ( x x (.3 j j j he overall losed-loop graph dyams s x ( I A LBK x (.4 where the overall (global state vetor s x x x x R, L s the graph Laplaa matrx, ad s the Kroeker produt (Appedx A. We use the Kroeker produt heavly ths seto, maly the property ( M ( PQ MP Q for ommesurate matres M,,P,Q. Defe the ooperatve feedbak losed-loop system matrx o ommuato graph G as A ( I A L BK (.5
2 hs matrx reflets the loal losed-loop system matrx ( A BK as modfed by dstrbuted otrol o the graph struture L. Its stablty depeds o both the stablty propertes of ( A BK ad the graph topology propertes. he ext key result from [Fax ad Murray 004] provdes a method for aalyss of the dyams (.3/(.4 ad relates ther stablty propertes to the graph egevalues. Lemma. Let,, be the egevalues of the graph Laplaa matrx L. he the stablty propertes of dyams (.3/(.4 are equvalet to the stablty propertes of the systems A BK,, (.6 that they have the same egevalues. Proof: Defe a trasformato M suh that J M LM s upper tragular wth the egevalues,, of L o the dagoal. Apply the state-spae trasformato ( M I ( I A LBK( M I (.7 ( I A J BK ad defe ew state ( M I. he the trasformed system s blok tragular form wth dagoal bloks of the form ( A BK (.8 Hee, stablty of (.3/(.4 s equvalet to stablty of all of these systems, se a state spae trasformato does ot hage the egevalues.. hs proof shows that A ( I A L BK s equvalet to the system dag{( A BK, ( A BK, ( A BK} (.9 wth,, the egevalues of the graph Laplaa matrx L, the sese that they have the same egevalues. Seod-Order Cosesus Oe applato of osesus ooperatve otrol s the otrol of formatos of vehles. herefore, we ow wsh to study osesus for oupled systems that satsfy ewto s law x u, whh yelds the seod-order ode dyams x v (.0 v u wth posto x R, veloty v R, ad aelerato put u R. Cosder the dstrbuted posto/veloty feedbak at eah ode gve by the seod-order loal eghborhood protools u a ( x x a ( v v a ( x x ( v v (. j j j j j j j j j j where 0 s a stffess ga ad 0 s a dampg ga. hs s based o loal votg protools both posto ad veloty, so that eah ode seeks to math all ts eghbors
3 postos as well as ther velotes. We would lke to determe whe ths protool delvers osesus, ad to fd the osesus values of posto ad veloty. We aalyze ths protool by two methods. Aalyss of Seod-Order Cosesus Usg Posto/Veloty Loal ode States he frst method for aalyzg seod-order osesus follows [Xe ad Wag 007]. Defe the ode states as z x v ad wrte the posto/veloty ode dyams ad protool at eah ode as 0 0 z z u Az Bu 0 0 (. xj x u aj K aj( zj z j v j v (.3 j K. ow detfy ths wth (.3, defe where the feedbak ga matrx s z z z z R, ad wrte the global losed-loop dyams (.4 as z ( I A LBK z A z (.4 for the spef A,B,K gve. Assume the graph has a spag tree. he, L has a smple egevalue at 0, ad hee has rak -, ad the rest of ts egevalues are strtly the rght-half of the s-plae. Uder these odtos we wat to study osesus propertes of the protool (.. Frst, we eed to look at the stablty propertes of (.4, ad seod to fd the posto ad veloty osesus values. Stablty of Seod-Order Cosesus Protool. o exame stablty of the protool, aordg to the proof of Lemma, A (.4 s equvalet to dag{ A,( A BK, ( A BK} (.5 wth Re{ } 0,,,. Matrx A has two egevalues at 0 wth geometr multplty equal to oe ad a Jorda blok of order two (Appedx A. he haraterst polyomals of the other bloks are si ( A BK s s (.6 he the haraterst polyomal of ( A s si A s s (.7 herefore, the egevalues of A are gve by ( 4 s (.8 3
4 here are two egevalues of A for eah egevalue of L. he stablty of the egevalues of A a easly be studed usg the Routh test. Suppose s real. he the Routh test shows that (.6 s asymptotally stable (AS for all 0. Suppose s omplex. he * * ( s s( s s ( s s ( s s where * deotes omplex ojugate, Re{ },. Performg the Routh test shows that ths s AS f ad oly f ( / (.0 where Im{ }. herefore, all the systems (.5 for,, are AS f ad oly f Im { } Re { } max,,, Re{ } (. Cosesus Values for Posto ad Veloty. he ext result tells whe the odes reah osesus uder the seod-order protool (., ad spefes the osesus values reahed. heorem. Cosesus of Seod-Order Dyams Cosder the ewto s law systems at eah ode gve by (.0 wth the loal eghborhood protools (.. he odes reah osesus both posto ad veloty f ad oly f the graph has a spag tree ad the gas, are seleted to satsfy odto (., wth the egevalues of the graph Laplaa L. he, the posto ad veloty osesus values are gve respetvely by pv (0 (. x p x (0 t pv (0 v (.3 Proof: Frst we eed to fd the left ad rght egevetors of matrx A (.4, whh s equvalet to (.5 the sese that they have the same egevalues. Matrx A (. has a egevalue at 0 of geometr multplty oe ad algebra multplty. he rak- rght egevetor s 0 se A 0 0. he rak- rght egevetor s 0 se 0 A 0. he rak- left egevetor s 0 se 0 A 0. he rak- left egevetor s 0 se 0 A 0. he rght egevetor of L for 0 s w p p be R. Let the orrespodg left egevetor, ormalzed so that w. he we lam a rak- rght egevetor 4
5 of A (.4 for 0 y 0. hs s easly verfed by hekg that Ay 0. It s easy to verfy that a rak- rght egevetor of A s y 0 by hekg that Ay y s. Smlarly, t s foud that a rak- left egevetor of A for 0 s gve by w ad a rak- left egevetor by w w w 0 0. ow we wll study the Jorda ormal form of A ad perform a modal deomposto o (.4 to fd the steady-state osesus values for posto ad veloty. Brg A to Jorda ormal form 0 0 ( w A MJM y y ( w 0 0 stable (.4 where M s the matrx havg rght egevetors as olums, ad M s the matrx havg left egevetors as rows. he t 0 ( w At Jt zt ( e z(0 Me M z(0 y y 0 0 ( w z(0 0 0 stable (.5 yelds the modal deomposto ( w z(0 t( w z(0 zt ( y y ( w z(0 (.6 ( w z(0 t( w z(0 y ( w z(0 y stable terms ote ow that 0 zt ( xt ( vt ( 0 (.7 wth global posto ad veloty vetors x x x x R, v v v v R. Aordg to the deftos of the left ad rght egevetors of A for 0, oe sees that the posto ad veloty osesus values dued by the protool (. are (., (.3. If the graph s strogly oeted the t has a spag tree ad the theorem holds. Moreover, f the tal velotes are all equal to zero, the the osesus veloty s equal to zero ad all odes ed up at rest at the weghted eter of gravty of the tal postos, that s, the frst term (.. he ext result has also bee establshed. Corollary. Let the graph have a spag tree ad all egevalues of the Laplaa L be real. he the osesus values (., (.3.are reahed for ay postve otrol gas, (.. 5
6 Proof: he Routh test reveals that (.6 s asymptotally stable uder the hypotheses. If the graph s udreted, the the Laplaa egevalues are real ad ths orollary holds. Aalyss of Seod-Order Cosesus Usg Posto/Veloty Global State he seod method for aalyzg seod-order osesus follows [Re ad Atks 007], [Re ad Beard 008]. It hges o aother way to wrte the global dyams tha (.4. ake ewto s law ode dyams (.0 ad the seod-order protools (.. Defe the global posto ad veloty vetors as x x x x R, v v v v R. Defe the global state vetor posto/veloty form as z x v R. he the global dyams a be wrtte as 0 I z z A z L L (.8 hs s posto/veloty form, whereas (.4 has the global state defed terms of the terleaved ode postos ad velotes aordg to the loal state deftos (.. he haraterst polyomal of ths system s si I si A s I Ls L (.9 L si L As the proof of Lemma, defe a trasformato M suh that J M LM s upper tragular wth the egevalues,, of L o the dagoal. Wrte si Ls L M M si Ls L M ( si Ls LM si Js J (.30 Matrx ( sijs J s blok tragular form wth the egevalues of L o the dagoal. Cosequetly silsl ( s s (.3 herefore, the egevalues of A are gve by ( 4 s (.3 ad there are two egevalues of A for eah egevalue of L. hese results are the same as (.7. herefore all the subsequet developmet there follows here, evetually provdg aother path to heorem. Example : Seod-Order Cosesus 6
7 Example : Destruto of Cosesus By Ireasg Iformato Exhage I ths example we show that gve a ommuato graph topology ad a seod-order protool that yelds osesus, t s possble to destroy the osesus behavor by addg extra lks betwee them. hus, addg formato exhage may be detrmetal to the performae of etworked teams. Formato Cotrol Seod-Order Protool I the otrol of formatos t s desred for all vehles to reah the same osesus veloty, but also for the steady-state postos to be some presrbed formato relatve to eah other. he protool just gve auses all odes to move to the same fal posto. Moreover, formato otrol the postos are -D or 3-D. herefore, let the formato move a -dmesoal spae ad osder the ode dyams x v (.33 v u wth vetor posto x R, veloty v R, ad aelerato put u R. For moto the -D plae, for stae, oe would take x [ p q ] where ( p ( t, q ( t s the posto of ode the (x,y-plae. he ode states are z x v R ad the loal ode dyams are gve by 0 I 0 z z u Az Bu 0 0 I (.34 Defe the ostat desred posto of ode relatve to the movg formato eter x 0 as R. Suppose t s desred for the odes to follow a leader or otrol ode wth posto ad veloty gve by x 0 v0. Cosder the dstrbuted seod-order leader-followg protools at eah ode gve by u v 0 kv( v0 v kp ( x0 x aj ( xj j ( x aj ( vj v j j (.35 v k ( v v k ( x x a ( x ( x ( v v 0 v 0 p 0 j j j j j where 0 s a stffess ga ad 0 s a dampg ga. hs protool ludes leader s veloty feedbak wth ga of kv 0, leader s posto feedbak wth ga of k p 0, ad leader s aelerato feedforward. he am of ths protool s to esure that all odes reah osesus posto ad veloty ad that x( t x0 ( t, v ( t v0 (, t asymptotally. Defe the moto errors x x x0, v v v0. he the losed-loop ode dyams are 0 I 0 z z aj( xj j ( x ( vj v ki p ki v I (.36 j 7
8 whh yelds the global error dyams z ( I A LBK z Az (.37 wth z z z z R A ki, K I I 0 I ki p v, ad (.38 Cosesus Stablty of the Formato Protool. We wat to exame stablty of the protool ad determe whe x( t x0( t, v( t v0(, t. Assume the graph has a spag tree. o exame stablty, aordg to the proof of Lemma, A (.37 s equvalet to dag{ A,( A BK, ( A BK} (.39 wth the egevalues of Laplaa matrx L ad Re{ } 0,,,. Wthout loss of geeralty, assume moto -D ad set. Moto other oordate dretos wll be the same as the moto alog a le as aalyzed here. Matrx A has the haraterst polyomal s kvs kp, whh s stable for all kp, kv 0. he haraterst polyomals of the other bloks are si ( A BK s ( k s ( k (.40 v p he the haraterst polyomal of A s ( ( v ( v si A s k s k (.4 herefore, the egevalues of A are gve by ( ( v 4( p s k k k (.4 here are two egevalues of A ( eah dmeso of moto for eah egevalue of L. Se the graph has a spag tree we have 0 ad 0,,. For real the Routh test shows that (.40 s asymptotally stable (AS for all 0, 0. If s omplex t s dffult to get a odto for stablzg gas. Routh test reveals that all the systems (.39 are AS f 0 ad * * ( s s( s s ( s s ( s s where * deotes omplex ojugate, Re{ },. Performg the Routh test shows that ths s AS f ad oly f ( / (.44 where Im{ }. herefore, all the systems (.5 for,, are AS f ad oly f 8
9 Im { } Re { } max,,, Re{ } (.45 heorem. Cosesus of Formato Protool Cosder the ewto s law moto dyams at eah ode gve by (.33. he leader-followg protools (.35 guaratee that x( t x0( t, v( t v0(, t asymptotally f the graph has a spag tree ad the gas, are seleted to satsfy odto (., wth the egevalues of the graph Laplaa L. Proof: Uder the hypotheses, the polyomals (.4 are asymptotally stable so that the error dyams (.37 are AS. herefore, x x x0 ad v v v0 go to zero ad the theorem follows. he followg result has also bee establshed. Corollary. Let the graph have a spag tree ad all egevalues of the Laplaa L be real. he x( t x0( t, v( t v0(, t asymptotally for ay gas, 0 kp, kv 0. Proof: he Routh test reveals that (.40 s asymptotally stable uder the hypotheses. If the graph s udreted, the the Laplaa egevalues are real ad ths orollary holds. A dsadvatage of protool (.35 s that all odes must kow the leader ode s posto x ( t ad veloty 0 v ( 0 t. I realst formatos, eah ode oly kows posto ad veloty formato about a few eghbors. Oly a few mmedate followers of the leader, hs wgme, a sese ts moto, ad other odes follow these wgme, ad so o. We shall show how to orret ths defey later whe we dsuss the ooperatve trakg problem, also kow as pg otrol. Example : Formato Cotrol Protool 9
10 Referees J.A. Fax ad R. M. Murray. 004, Iformato Flow ad Cooperatve Cotrol of Vehle Formatos, IEEE ras. Automat Cotrol 49, o. 9: W. Re, Cosesus strateges for ooperatve otrol of vehle formatos, IE Cotrol heory ad Applatos, vo., o., pp , 007. W. Re ad E. Atks, Dstrbuted mult-vehle oordated otrol va loal formato exhage, It. J. Robust ad olear Cotrol, vol. 7, pp , 007. W. Re ad R.W. Beard, Dstrbuted Cosesus Mult-Vehle Cooperatve Cotrol, Sprger- Verlag, Lodo, 008. G. Xe ad L. Wag, Cosesus otrol for a lass of etworks of dyam agets, It. J. Robust ad olear Cotrol, vol. 7, pp ,
Analyzing Control Structures
Aalyzg Cotrol Strutures sequeg P, P : two fragmets of a algo. t, t : the tme they tae the tme requred to ompute P ;P s t t Θmaxt,t For loops for to m do P t: the tme requred to ompute P total tme requred
More informationSection 2:00 ~ 2:50 pm Thursday in Maryland 202 Sep. 29, 2005
Seto 2:00 ~ 2:50 pm Thursday Marylad 202 Sep. 29, 2005. Homework assgmets set ad 2 revews: Set : P. A box otas 3 marbles, red, gree, ad blue. Cosder a expermet that ossts of takg marble from the box, the
More information1 Lyapunov Stability Theory
Lyapuov Stablty heory I ths secto we cosder proofs of stablty of equlbra of autoomous systems. hs s stadard theory for olear systems, ad oe of the most mportat tools the aalyss of olear systems. It may
More information18.413: Error Correcting Codes Lab March 2, Lecture 8
18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse
More informationA Mean- maximum Deviation Portfolio Optimization Model
A Mea- mamum Devato Portfolo Optmzato Model Wu Jwe Shool of Eoom ad Maagemet, South Cha Normal Uversty Guagzhou 56, Cha Tel: 86-8-99-6 E-mal: wujwe@9om Abstrat The essay maes a thorough ad systemat study
More informationChapter 9 Jordan Block Matrices
Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.
More informationMATH 247/Winter Notes on the adjoint and on normal operators.
MATH 47/Wter 00 Notes o the adjot ad o ormal operators I these otes, V s a fte dmesoal er product space over, wth gve er * product uv, T, S, T, are lear operators o V U, W are subspaces of V Whe we say
More informationMOLECULAR VIBRATIONS
MOLECULAR VIBRATIONS Here we wsh to vestgate molecular vbratos ad draw a smlarty betwee the theory of molecular vbratos ad Hückel theory. 1. Smple Harmoc Oscllator Recall that the eergy of a oe-dmesoal
More informationLecture 07: Poles and Zeros
Lecture 07: Poles ad Zeros Defto of poles ad zeros The trasfer fucto provdes a bass for determg mportat system respose characterstcs wthout solvg the complete dfferetal equato. As defed, the trasfer fucto
More informationChapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II
CEE49b Chapter - Free Vbrato of Mult-Degree-of-Freedom Systems - II We ca obta a approxmate soluto to the fudametal atural frequecy through a approxmate formula developed usg eergy prcples by Lord Raylegh
More informationSpring Ammar Abu-Hudrouss Islamic University Gaza
١ ١ Chapter Chapter 4 Cyl Blo Cyl Blo Codes Codes Ammar Abu-Hudrouss Islam Uversty Gaza Spr 9 Slde ٢ Chael Cod Theory Cyl Blo Codes A yl ode s haraterzed as a lear blo ode B( d wth the addtoal property
More informationAssignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)
Assgmet 5/MATH 7/Wter 00 Due: Frday, February 9 class (!) (aswers wll be posted rght after class) As usual, there are peces of text, before the questos [], [], themselves. Recall: For the quadratc form
More informationConsensus Control for a Class of High Order System via Sliding Mode Control
Cosesus Cotrol for a Class of Hgh Order System va Sldg Mode Cotrol Chagb L, Y He, ad Aguo Wu School of Electrcal ad Automato Egeerg, Taj Uversty, Taj, Cha, 300072 Abstract. I ths paper, cosesus problem
More informationRuin Probability-Based Initial Capital of the Discrete-Time Surplus Process
Ru Probablty-Based Ital Captal of the Dsrete-Tme Surplus Proess by Parote Sattayatham, Kat Sagaroo, ad Wathar Klogdee AbSTRACT Ths paper studes a surae model uder the regulato that the surae ompay has
More informationEECE 301 Signals & Systems
EECE 01 Sgals & Systems Prof. Mark Fowler Note Set #9 Computg D-T Covoluto Readg Assgmet: Secto. of Kame ad Heck 1/ Course Flow Dagram The arrows here show coceptual flow betwee deas. Note the parallel
More informationL5 Polynomial / Spline Curves
L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a
More information( q Modal Analysis. Eigenvectors = Mode Shapes? Eigenproblem (cont) = x x 2 u 2. u 1. x 1 (4.55) vector and M and K are matrices.
4.3 - Modal Aalyss Physcal coordates are ot always the easest to work Egevectors provde a coveet trasformato to modal coordates Modal coordates are lear combato of physcal coordates Say we have physcal
More informationChapter Gauss-Seidel Method
Chpter 04.08 Guss-Sedel Method After redg ths hpter, you should be ble to:. solve set of equtos usg the Guss-Sedel method,. reogze the dvtges d ptflls of the Guss-Sedel method, d. determe uder wht odtos
More informationThe number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter
LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s
More informationUlam stability for fractional differential equations in the sense of Caputo operator
Sogklaakar J. S. Tehol. 4 (6) 71-75 Nov. - De. 212 http://www.sjst.psu.a.th Orgal Artle Ulam stablty for fratoal dfferetal equatos the sese of Caputo operator Rabha W. Ibrahm* Isttute of Mathematal Sees
More informationUNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS
UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:
More information(This summarizes what you basically need to know about joint distributions in this course.)
HG Ot. ECON 430 H Extra exerses for o-semar week 4 (Solutos wll be put o the et at the ed of the week) Itroduto: Revew of multdmesoal dstrbutos (Ths summarzes what you basally eed to kow about jot dstrbutos
More informationd dt d d dt dt Also recall that by Taylor series, / 2 (enables use of sin instead of cos-see p.27 of A&F) dsin
Learzato of the Swg Equato We wll cover sectos.5.-.6 ad begg of Secto 3.3 these otes. 1. Sgle mache-fte bus case Cosder a sgle mache coected to a fte bus, as show Fg. 1 below. E y1 V=1./_ Fg. 1 The admttace
More informationSummary of the lecture in Biostatistics
Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the
More informationON THE LAWS OF LARGE NUMBERS FOR DEPENDENT RANDOM VARIABLES
Joural of Sees Islam Republ of Ira 4(3): 7-75 (003) Uversty of Tehra ISSN 06-04 ON THE LAWS OF LARGE NUMBERS FOR DEPENDENT RANDOM VARIABLES HR Nl Sa * ad A Bozorga Departmet of Mathemats Brjad Uversty
More informationLecture 3 Probability review (cont d)
STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto
More informationExercises for Square-Congruence Modulo n ver 11
Exercses for Square-Cogruece Modulo ver Let ad ab,.. Mark True or False. a. 3S 30 b. 3S 90 c. 3S 3 d. 3S 4 e. 4S f. 5S g. 0S 55 h. 8S 57. 9S 58 j. S 76 k. 6S 304 l. 47S 5347. Fd the equvalece classes duced
More informationCHAPTER 4 RADICAL EXPRESSIONS
6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube
More informationα1 α2 Simplex and Rectangle Elements Multi-index Notation of polynomials of degree Definition: The set P k will be the set of all functions:
Smplex ad Rectagle Elemets Mult-dex Notato = (,..., ), o-egatve tegers = = β = ( β,..., β ) the + β = ( + β,..., + β ) + x = x x x x = x x β β + D = D = D D x x x β β Defto: The set P of polyomals of degree
More informationFeature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)
CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.
More informationIntroduction to local (nonparametric) density estimation. methods
Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest
More informationρ < 1 be five real numbers. The
Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace
More informationCIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights
CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:
More informationAssignment 7/MATH 247/Winter, 2010 Due: Friday, March 19. Powers of a square matrix
Assgmet 7/MATH 47/Wter, 00 Due: Frday, March 9 Powers o a square matrx Gve a square matrx A, ts powers A or large, or eve arbtrary, teger expoets ca be calculated by dagoalzg A -- that s possble (!) Namely,
More informationDerivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations
Dervato of -Pot Block Method Formula for Solvg Frst Order Stff Ordary Dfferetal Equatos Kharul Hamd Kharul Auar, Kharl Iskadar Othma, Zara Bb Ibrahm Abstract Dervato of pot block method formula wth costat
More informationON THE LOGARITHMIC INTEGRAL
Hacettepe Joural of Mathematcs ad Statstcs Volume 39(3) (21), 393 41 ON THE LOGARITHMIC INTEGRAL Bra Fsher ad Bljaa Jolevska-Tueska Receved 29:9 :29 : Accepted 2 :3 :21 Abstract The logarthmc tegral l(x)
More informationEntropy ISSN by MDPI
Etropy 2003, 5, 233-238 Etropy ISSN 1099-4300 2003 by MDPI www.mdp.org/etropy O the Measure Etropy of Addtve Cellular Automata Hasa Aı Arts ad Sceces Faculty, Departmet of Mathematcs, Harra Uversty; 63100,
More informationLecture Notes 2. The ability to manipulate matrices is critical in economics.
Lecture Notes. Revew of Matrces he ablt to mapulate matrces s crtcal ecoomcs.. Matr a rectagular arra of umbers, parameters, or varables placed rows ad colums. Matrces are assocated wth lear equatos. lemets
More informationInvestigating Cellular Automata
Researcher: Taylor Dupuy Advsor: Aaro Wootto Semester: Fall 4 Ivestgatg Cellular Automata A Overvew of Cellular Automata: Cellular Automata are smple computer programs that geerate rows of black ad whte
More informationMaps on Triangular Matrix Algebras
Maps o ragular Matrx lgebras HMED RMZI SOUROUR Departmet of Mathematcs ad Statstcs Uversty of Vctora Vctora, BC V8W 3P4 CND sourour@mathuvcca bstract We surveys results about somorphsms, Jorda somorphsms,
More informationThird handout: On the Gini Index
Thrd hadout: O the dex Corrado, a tala statstca, proposed (, 9, 96) to measure absolute equalt va the mea dfferece whch s defed as ( / ) where refers to the total umber of dvduals socet. Assume that. The
More information2006 Jamie Trahan, Autar Kaw, Kevin Martin University of South Florida United States of America
SOLUTION OF SYSTEMS OF SIMULTANEOUS LINEAR EQUATIONS Gauss-Sedel Method 006 Jame Traha, Autar Kaw, Kev Mart Uversty of South Florda Uted States of Amerca kaw@eg.usf.edu Itroducto Ths worksheet demostrates
More informationIdeal multigrades with trigonometric coefficients
Ideal multgrades wth trgoometrc coeffcets Zarathustra Brady December 13, 010 1 The problem A (, k) multgrade s defed as a par of dstct sets of tegers such that (a 1,..., a ; b 1,..., b ) a j = =1 for all
More informationCS286.2 Lecture 4: Dinur s Proof of the PCP Theorem
CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat
More informationMath 10 Discrete Mathematics
Math 0 Dsrete Mathemats T. Heso REVIEW EXERCISES FOR EXM II Whle these problems are represetatve of the types of problems that I mght put o a exam, they are ot lusve. You should be prepared to work ay
More informationDesign maintenanceand reliability of engineering systems: a probability based approach
Desg mateaead relablty of egeerg systems: a probablty based approah CHPTER 2. BSIC SET THEORY 2.1 Bas deftos Sets are the bass o whh moder probablty theory s defed. set s a well-defed olleto of objets.
More information8.1 Hashing Algorithms
CS787: Advaced Algorthms Scrbe: Mayak Maheshwar, Chrs Hrchs Lecturer: Shuch Chawla Topc: Hashg ad NP-Completeess Date: September 21 2007 Prevously we looked at applcatos of radomzed algorthms, ad bega
More informationX X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then
Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers
More informationOn the Nonlinear Difference Equation
Joural of Appled Mathemats ad Phss 6 4-9 Pulshed Ole Jauar 6 SRes http://wwwsrporg/joural/jamp http://ddoorg/436/jamp644 O the Nolear Dfferee Equato Elmetwall M Elaas Adulmuhaem A El-Bat Departmet of Mathemats
More informationTESTS BASED ON MAXIMUM LIKELIHOOD
ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal
More informationTHE COMPLETE ENUMERATION OF FINITE GROUPS OF THE FORM R 2 i ={R i R j ) k -i=i
ENUMERATON OF FNTE GROUPS OF THE FORM R ( 2 = (RfR^'u =1. 21 THE COMPLETE ENUMERATON OF FNTE GROUPS OF THE FORM R 2 ={R R j ) k -= H. S. M. COXETER*. ths paper, we vestgate the abstract group defed by
More informationMultiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades
STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos
More informationmeans the first term, a2 means the term, etc. Infinite Sequences: follow the same pattern forever.
9.4 Sequeces ad Seres Pre Calculus 9.4 SEQUENCES AND SERIES Learg Targets:. Wrte the terms of a explctly defed sequece.. Wrte the terms of a recursvely defed sequece. 3. Determe whether a sequece s arthmetc,
More informationn -dimensional vectors follow naturally from the one
B. Vectors ad sets B. Vectors Ecoomsts study ecoomc pheomea by buldg hghly stylzed models. Uderstadg ad makg use of almost all such models requres a hgh comfort level wth some key mathematcal sklls. I
More informationANALYSIS ON THE NATURE OF THE BASIC EQUATIONS IN SYNERGETIC INTER-REPRESENTATION NETWORK
Far East Joural of Appled Mathematcs Volume, Number, 2008, Pages Ths paper s avalable ole at http://www.pphm.com 2008 Pushpa Publshg House ANALYSIS ON THE NATURE OF THE ASI EQUATIONS IN SYNERGETI INTER-REPRESENTATION
More informationChapter 14 Logistic Regression Models
Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as
More informationfor each of its columns. A quick calculation will verify that: thus m < dim(v). Then a basis of V with respect to which T has the form: A
Desty of dagoalzable square atrces Studet: Dael Cervoe; Metor: Saravaa Thyagaraa Uversty of Chcago VIGRE REU, Suer 7. For ths etre aer, we wll refer to V as a vector sace over ad L(V) as the set of lear
More informationNP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Prelmary theorem 3. Proof 4. Expla 5. Cocluso. Itroduce The P versus NP problem s a major usolved problem computer scece. Iformally, t asks whether a computer
More informationFunctions of Random Variables
Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,
More informationPart 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))
art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the
More informationbest estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best
Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg
More informationChapter 4 Multiple Random Variables
Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:
More informationThe Mathematical Appendix
The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.
More informationLecture 9: Tolerant Testing
Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have
More informationON A NEUMANN EQUILIBRIUM STATES IN ONE MODEL OF ECONOMIC DYNAMICS
oral of re ad Appled Mathemats: Advaes ad Applatos Volme 8 Nmber 2 207 ages 87-95 Avalable at http://setfadvaes.o. DO: http://d.do.org/0.8642/pamaa_7002866 ON A NEUMANN EQULBRUM STATES N ONE MODEL OF ECONOMC
More informationLecture 2 - What are component and system reliability and how it can be improved?
Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected
More informationSimulation Output Analysis
Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5
More informationInternational Journal of Mathematical Archive-3(12), 2012, Available online through ISSN
teratoal Joural of Matheatal Arhve-3(2) 22 4789-4796 Avalable ole through www.ja.fo SSN 2229 546 g-quas FH-losed spaes ad g-quas CH-losed spaes Sr. Paule Mary Hele Assoate Professor Nrala College Cobatore
More informationLecture Notes Types of economic variables
Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte
More informationAhmed Elgamal. MDOF Systems & Modal Analysis
DOF Systems & odal Aalyss odal Aalyss (hese otes cover sectos from Ch. 0, Dyamcs of Structures, Al Chopra, Pretce Hall, 995). Refereces Dyamcs of Structures, Al K. Chopra, Pretce Hall, New Jersey, ISBN
More informationDecomposition of Hadamard Matrices
Chapter 7 Decomposto of Hadamard Matrces We hae see Chapter that Hadamard s orgal costructo of Hadamard matrces states that the Kroecer product of Hadamard matrces of orders m ad s a Hadamard matrx of
More informationLecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model
Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The
More informationPTAS for Bin-Packing
CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,
More information1 4 6 is symmetric 3 SPECIAL MATRICES 3.1 SYMMETRIC MATRICES. Defn: A matrix A is symmetric if and only if A = A, i.e., a ij =a ji i, j. Example 3.1.
SPECIAL MATRICES SYMMETRIC MATRICES Def: A mtr A s symmetr f d oly f A A, e,, Emple A s symmetr Def: A mtr A s skew symmetr f d oly f A A, e,, Emple A s skew symmetr Remrks: If A s symmetr or skew symmetr,
More informationNP!= P. By Liu Ran. Table of Contents. The P vs. NP problem is a major unsolved problem in computer
NP!= P By Lu Ra Table of Cotets. Itroduce 2. Strategy 3. Prelmary theorem 4. Proof 5. Expla 6. Cocluso. Itroduce The P vs. NP problem s a major usolved problem computer scece. Iformally, t asks whether
More informationLecture Note to Rice Chapter 8
ECON 430 HG revsed Nov 06 Lecture Note to Rce Chapter 8 Radom matrces Let Y, =,,, m, =,,, be radom varables (r.v. s). The matrx Y Y Y Y Y Y Y Y Y Y = m m m s called a radom matrx ( wth a ot m-dmesoal dstrbuto,
More informationBeam Warming Second-Order Upwind Method
Beam Warmg Secod-Order Upwd Method Petr Valeta Jauary 6, 015 Ths documet s a part of the assessmet work for the subject 1DRP Dfferetal Equatos o Computer lectured o FNSPE CTU Prague. Abstract Ths documet
More informationStrong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity
BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout
More informationQR Factorization and Singular Value Decomposition COS 323
QR Factorzato ad Sgular Value Decomposto COS 33 Why Yet Aother Method? How do we solve least-squares wthout currg codto-squarg effect of ormal equatos (A T A A T b) whe A s sgular, fat, or otherwse poorly-specfed?
More informationIII-16 G. Brief Review of Grand Orthogonality Theorem and impact on Representations (Γ i ) l i = h n = number of irreducible representations.
III- G. Bref evew of Grad Orthogoalty Theorem ad mpact o epresetatos ( ) GOT: h [ () m ] [ () m ] δδ δmm ll GOT puts great restrcto o form of rreducble represetato also o umber: l h umber of rreducble
More informationMu Sequences/Series Solutions National Convention 2014
Mu Sequeces/Seres Solutos Natoal Coveto 04 C 6 E A 6C A 6 B B 7 A D 7 D C 7 A B 8 A B 8 A C 8 E 4 B 9 B 4 E 9 B 4 C 9 E C 0 A A 0 D B 0 C C Usg basc propertes of arthmetc sequeces, we fd a ad bm m We eed
More informationTHE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE
THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the
More informationMultivariate Transformation of Variables and Maximum Likelihood Estimation
Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty
More information3D Geometry for Computer Graphics. Lesson 2: PCA & SVD
3D Geometry for Computer Graphcs Lesso 2: PCA & SVD Last week - egedecomposto We wat to lear how the matrx A works: A 2 Last week - egedecomposto If we look at arbtrary vectors, t does t tell us much.
More informationChapter 5 Properties of a Random Sample
Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample
More informationOrdinary Least Squares Regression. Simple Regression. Algebra and Assumptions.
Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos
More informationCHAPTER VI Statistical Analysis of Experimental Data
Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca
More informationRademacher Complexity. Examples
Algorthmc Foudatos of Learg Lecture 3 Rademacher Complexty. Examples Lecturer: Patrck Rebesch Verso: October 16th 018 3.1 Itroducto I the last lecture we troduced the oto of Rademacher complexty ad showed
More informationSPECIAL CONSIDERATIONS FOR VOLUMETRIC Z-TEST FOR PROPORTIONS
SPECIAL CONSIDERAIONS FOR VOLUMERIC Z-ES FOR PROPORIONS Oe s stctve reacto to the questo of whether two percetages are sgfcatly dfferet from each other s to treat them as f they were proportos whch the
More informationQ-analogue of a Linear Transformation Preserving Log-concavity
Iteratoal Joural of Algebra, Vol. 1, 2007, o. 2, 87-94 Q-aalogue of a Lear Trasformato Preservg Log-cocavty Daozhog Luo Departmet of Mathematcs, Huaqao Uversty Quazhou, Fua 362021, P. R. Cha ldzblue@163.com
More informationSTK3100 and STK4100 Autumn 2017
SK3 ad SK4 Autum 7 Geeralzed lear models Part III Covers the followg materal from chaters 4 ad 5: Sectos 4..5, 4.3.5, 4.3.6, 4.4., 4.4., ad 4.4.3 Sectos 5.., 5.., ad 5.5. Ørulf Borga Deartmet of Mathematcs
More informationAll-Pairs shortest paths via fast matrix multiplication
All-Pars shortest paths va fast matrx multplato Ur Zw Tel Avv Uversty Summer Shool o Shortest Paths (PATH0) DIKU, Uversty of Copehage 1. Algebra matrx multplato a. Strasse s algorthm b. Retagular matrx
More informationSolving Constrained Flow-Shop Scheduling. Problems with Three Machines
It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632
More informationå 1 13 Practice Final Examination Solutions - = CS109 Dec 5, 2018
Chrs Pech Fal Practce CS09 Dec 5, 08 Practce Fal Examato Solutos. Aswer: 4/5 8/7. There are multle ways to obta ths aswer; here are two: The frst commo method s to sum over all ossbltes for the rak of
More informationOn the construction of symmetric nonnegative matrix with prescribed Ritz values
Joural of Lear ad Topologcal Algebra Vol. 3, No., 14, 61-66 O the costructo of symmetrc oegatve matrx wth prescrbed Rtz values A. M. Nazar a, E. Afshar b a Departmet of Mathematcs, Arak Uversty, P.O. Box
More informationDynamic Systems on Graphs
Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,
More informationInvestigation of Partially Conditional RP Model with Response Error. Ed Stanek
Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a
More informationA Study on Generalized Generalized Quasi hyperbolic Kac Moody algebra QHGGH of rank 10
Global Joural of Mathematcal Sceces: Theory ad Practcal. ISSN 974-3 Volume 9, Number 3 (7), pp. 43-4 Iteratoal Research Publcato House http://www.rphouse.com A Study o Geeralzed Geeralzed Quas (9) hyperbolc
More informationLOAD-FLOW CALCULATIONS IN MESHED SYSTEMS Node voltage method A system part with the node k and its direct neighbour m
LOAD-FLOW CALCLATIONS IN MESHED SYSTEMS Node oltage method A system part wth the ode ad ts dret eghbor m Î Îm Î m m Crrets Î m m m Î Î m m m m Î m m m m m m m Let s dee the ode sel-admttae (adm. matr dagoal
More information4 Inner Product Spaces
11.MH1 LINEAR ALGEBRA Summary Notes 4 Ier Product Spaces Ier product s the abstracto to geeral vector spaces of the famlar dea of the scalar product of two vectors or 3. I what follows, keep these key
More information