A LINEAR PROGRAMMING APPROACH FOR REGIONAL POLE PLACEMENT UNDER POINTWISE CONSTRAINTS

Size: px
Start display at page:

Download "A LINEAR PROGRAMMING APPROACH FOR REGIONAL POLE PLACEMENT UNDER POINTWISE CONSTRAINTS"

Transcription

1 A LINEAR PROGRAMMING APPROACH FOR REGIONAL POLE PLACEMENT UNDER POINTWISE CONSTRAINTS Max M.D. SANTOS, Eugêno B. CASTELAN, Jean-Claude HENNET Abstract Ths paper consders the problem of control of dscrete-tme lnear systems under several complcatng features frequently encountered n practce : uncertan parameters n the model, addtve nose, lnear symmetrcal state and nput constrants. The man control desgn objectve, beyond local stablzaton, s to locate the closed-loop poles n a good regon of the unt dsc of the complex plane. The orgnalty of the proposed approach s to use Lnear Programmng as the basc desgn tool. It s shown that the matrx condtons derved from postve nvarance relatons and from desgn constrants can be formulated as lnear matrx equaltes and scalar nequaltes. The control desgn problem can then be solved by Lnear Programmng, wth an objectve functon descrbng the search for a trade-off between several desgn objectves. Keywords State Feedback, Dsturbance Rejecton, Lnear systems, Invarance, Uncertan systems. 1 Introducton Many practcal control problems are characterzed by several complcatng features n the system model, such as persstent dsturbances, parameters uncertanty, pontwse constrants on nput and output varables. Moreover, the control objectves often go beyond stablzaton or dsturbance attenuaton, seekng for a satsfactory trade-off between performance and robustness. When the system model admts a lnear descrpton n a lmted doman of the state space, most of these features and requrements can be translated nto lnear matrx condtons. Usng the approach by postve nvarance of polyhedral domans, only lnear matrx equaltes and scalar nequaltes are nvolved. The use of Lnear Programmng algorthm s then possble, wth the advantage of a great computatonal effcency. Ths paper descrbes ths approach n the case of a dscrete-tme lnear model wth addtve dsturbances and convex parameters uncertantes, subject to symmetrcal lnear constrants on ts nput vector. The addressed control problem s of the l 1 -type wth addtonal constrants and pole locaton requrements for the closed-loop state matrx. Classcally 13, the effects of the addtve dsturbance on the system output are measured n terms of the l -nduced norm. Here, they wll be represented Laboratóro de Controle e Mcronformátca (LCMI / EEL / UFSC), Floranópols, S.C., Brazl, E-mal eugeno@lcm.ufsc.br Contact Author, Laboratore d Analyse et d Archtecture des Systèmes du C.N.R.S, 7, Avenue du Colonel Roche, Toulouse Cédex, FRANCE, E-mal hennet@laas.fr, Fax (+33)

2 by pontwse symmetrcal constrants on the output vector. Addtonnally, a major concern for the consdered control problem s to locate the closed-loop poles n a partcular regon of the unt dsc of the complex plane. Lnear formulatons of ths problem are provded n the cases of pole regons made of the ntersecton of the unt dsc wth a vertcal strp and of centered rngs n the unt dsc. Notatons. The followng notatons are used throughout the paper. Matrx I n s the dentty t matrx n R n n ; vector 1 n s defned as 1 n = R n. For any matrx M R n n, M denotes { the matrx of the absolute values of ts components: M j = M j. ˆM s defned ˆM = M by :. The nfnty norm of M s classcally defned by: M = ˆM j = M j for j. n m max M j. The nfnty matrx measure of M s defned by : µ (M) = max M + M j. =1,..,n j=1 2 Problem statement 2.1 Lnear control under output and nput constrants Consder the lnear dscrete-tme system represented by the followng tme-nvarant equatons: x k+1 = Ax k + Bu k + Dd k, k N (1) y k = Gx k (2) where A R n n, B R n m, wth rank(b) = m, D R n l, G R g n, rank(g) = n. Vectors x k R n, u k R m d k R l and y k R g are, respectvely, the current state, control, dsturbance and output vectors, at tme k. As n most practcal cases, all the varables of ths model are subject to constrants. In the proposed model, all the constrants are assumed to be lnear and symmetrcal : - the dsturbance vector, d k, s assumed to belong to a closed convex set : j=1 d k S(P, ξ) R l ; k N S(P, ξ) = {d R l ; ξ P d ξ} (3) wth: P R p l, ξ R p, ξ > 0 ; - the control nputs are assumed to be symmetrcally bounded : u k U R m ; k N U = {u R m ; ρ u k ρ}. (4) wth: ρ R m and ρ > 0 ; - the dsturbance rejecton requrement mposes that the states of the system should reman n a compact symmetrcal polyhedron, denoted S(G, γ) : x k S(G, γ) R n ; k N S(G, γ) = {x R n ; γ Gx k γ} (5) wth γ R g, γ > 0. 2

3 A class of canddate solutons of ths problem s constructed wth a lnear state feedback control law u k = F x k (6) such that the dsturbed lnear closed-loop model x k+1 = (A + BF )x k + De k (7) admts a set Ω that s S(P, ξ)-nvarant n the state space and satsfes 14) : { Ω S(G, γ) Ω S(F, ρ) = {x R n ; ρ F x k ρ}. Defnton 1 3 A set Ω R n s S(P, ξ)-nvarant, f for any ntal condton belongng to Ω the correspondng trajectory remans n Ω for any sequence of dsturbances d S(P, ξ). The partcular choce of S(G, γ) as the canddate set Ω corresponds to the followng condtons : H R g g, K R g p, M R m g such that : HG = GA + GBMG (8) KP = GD (9) M γ ρ (10) H γ + K ξ γ (11) If these condtons are satsfed, the closed-loop system trajectory satsfes constrants (4), (5) from any ntal state x 0 S(G, γ) and for any sequence of dsturbances d k S(P, ξ), under the control law (6) wth F = MG. 2.2 Constrants on the closed-loop pole locaton Clearly, S(P, ξ)-nvarance of a set Ω wth respect to system (7) s a suffcent condton for postve nvarance of Ω wth respect to the assocated determnstc system (12) defned by : x k+1 = (A + BF )x k. (12) Then, classcally 1, 7, postve nvarance of a compact doman n the state space havng the zero state n ts nteror s a suffcent condton for local stablty of the constraned determnstc system around the zero state. Ths property mples, n partcular that, under condtons (8), (9), (10), (11), the closed-loop state matrx (A+BF ) has ts poles located n the unt crcle of the complex plane. Ths elementary stablty condton may not be suffcent for the desgner. In many practcal applcatons, t s desrable to locate the closed-loop poles n a partcular regon, Σ, of the unt crcle, and thus to mpose the addtonal spectral constrants : σ(a + BF ) Σ (13) Two types of spectral regons Σ wll be consdered n the sequel. The assocated regonal pole locaton condtons wll be characterzed and ncorporated n the control desgn problem, ether as hard constrants or as desgn objectves. 3

4 2.3 Model uncertantes If some of the model parameters n (1) are uncertan, the system dynamcs can be represented by a famly of models (1): A A ; B B (14) A general representaton of uncertantes (see e.g. 6, 10) s obtaned when assumng that the sets A and B are convex and compact polyhedral domans defned by ther vertces (A R n n, B j R n m ), through the followng relatons : N A A = {A : A = ζ A, ζ 0, ζ = 1} (15) =1 N B B = {B : B = κ j B j, κ j 0, j=1 N A =1 N B j=1 κ j = 1} (16) If na and nb denote the numbers of uncertan entres n A and B, the number of vertces defnng the convex polyhedral doman of uncertantes for the par (A, B) has the order of magntude 2 na+nb. Therefore, t s manly for small values of na + nb that such a representaton of uncertantes may be consdered. It has been shown by B.E.A.Mlan, A.N.Carvalho 10 (see also 11) that due to the convexty and compactness of the doman of uncertantes, a necessary and suffcent condton for relatons (8), (9), (11) to be satsfed by any possble par of matrces (A, B) n the doman of uncertantes s that for any par of vertces (A, B j ) : H j R g g, K R g p such that : H j G = GA + GB j F (17) KP = GD (18) H j γ + K ξ γ (19) It s not dffcult to show a smlar result for the pole placement relaton (13) : σ(a + BF ) Σ for any possble par of matrces (A, B) f and only f for any par of vertces (A, B j ), the followng relaton s verfed : σ(a + B j F ) Σ. (20) 3 Some lnear representatons of regonal pole placement The basc technque whch wll be used for obtanng suffcent pole placement condtons s derved from the two followng stablty theorems due to A.P. Molchanov, V.S. Pyatnsky 12. In the sequel, λ (H) denotes the th egenvalue of a matrx H and λ (H) the correspondng modulus Theorem 1 12 : The lnear tme-nvarant dscrete-tme system x k+1 = Hx k s asymptotcally stable, that s, λ (H) < 1 for = 1,..., n, f and only f there exst a matrx Q R q n wth rank(q) = n and a matrx Γ R q q, such that : ΓQ = QH (21) Γ < 1 (22) 4

5 Theorem 2 12 : The lnear tme-nvarant contnuous-tme system ẋ(t) = Hx(t) s asymptotcally stable, that s, R(λ (H)) < 0 for = 1,..., n, f and only f there exst a matrx Q R q n wth rank(q) = n and a matrx Γ R q q, such that : ΓQ = QH (23) µ (Γ) < 0 (24) The followng remarks can be made about the above theorems : Equatons (21) and (23) can be seen as generalzed smlarty relatons. In partcular, snce rank(q) = n, we have: σ(h) σ(γ)) (25) Furthermore, from basc propertes of matrx norms and matrx measures, nequaltes (22) and (24) guarantee the asymptotc stablty of the egenvalues of Γ (respectvely n the dscrete-tme and the contnuous-tme cases) and, n consequence of (25)), the asymptotc stablty of the egenvalues of H. For computatonal purposes, equatons (22) and (24) can be respectvely replaced by : Canddate Lyapunov functons are descrbed by: Γ 1 q 1 q and ˆΓ 1 q 0 q. V (x) = max (Qx) The correspondng domans of stablty and nvarance are convex and polyhedral. 3.1 Pole locaton n a vertcal strp Let F(α, β) represent a vertcal strp n the complex plane, where α and β are real numbers satsfyng α > β : λ (H) F(α, β) β < Rλ (H) < α (26) The objectve s to obtan algebrac condtons whch quarantee that the egenvalues of a matrx H belong to F(α, β). The followng proposton gves necessary and suffcent condtons for (26) to be verfed. Proposton 1 The egenvalues of a matrx H R n n verfy λ (H) F(α, β), f and only f there exst matrces Q 1 R m 1 n and Q 2 R m 2 n wth rank(q 1 ) = rank(q 2 ) = n and matrces Γ 1 R m 1 m 1 e Γ 2 R m 2 m 2 such that: Γ 1 Q 1 = Q 1 H (27) µ (Γ 1 ) < α (28) Γ 2 Q 2 = Q 2 H (29) µ ( Γ 2 ) < β (30) Proof : It wll frst be shown that the exstence of matrces Q 1 and Γ 1 satsfyng (27) and (28) s a necessary and suffcent condton for verfyng Rλ (H) < α. To ths end, consder the matrx H α = H αi n, whose egenvalues verfy λ (H α ) = λ (H) α. Then, Rλ (H) < α f and only f 5

6 Rλ (H α ) < 0. From Theorem 2, ths s verfed f and only f there exst Q 1 R m1 n of rank n, and Γ 1 R m 1 m 1 such that Γ 1 Q 1 = Q 1 H α (31) µ Γ 1 < 1 (32) Thus, equatons (27) and (28) are obtaned from (31) and (32) by defnng Γ 1 = Γ 1 +αi n and by usng the fact that µ (Γ 1 ) = µ (Γ 1 ) + α. To complete the proof, t must be shown that the verfcaton of (29) and (30) s a necessary and suffcent condton for Rλ (H) > β to be satsfed. Ths can be done by remarkng that Rλ (H) > β s equvalent to Rλ ( H) < β, whch s verfed f and only f there exst m 2 > n, Q 2 R m2 n of full rank, and Γ 2 R m 2 m 2 such that Γ 2 Q 2 = Q 2 ( H) (33) µ ( Γ 2 ) < β (34) Thus, (33) and (34) can be equvalently replaced by (29) and (30) when settng Γ 2 = Γ 2. Notce that even for a gven H, relatons (27) and (29) are non-lnear and cannot be used as constrants n lnear programmng. The result that wll be used n the sequel for characterzng the locaton of the egenvalues of H n F(α, β) s the followng one : Property 1 If µ (H) < α and µ ( H) < β then λ (H) F(α, β). 3.2 Pole locaton n a centered rng Let A(δ, τ) defne a centered rng n the complex plane, where δ and τ are real numbers satsfyng δ > τ > 0 : { ρ(h) < δ λ (H) A(δ, τ) (35) ϱ(h) > τ where: ρ(h) = max λ (H) e ϱ(h) = mn λ (H). Smlarly to the prevous case, the objectve s to derve algebrac condtons whch guarantee that the egenvalues of a matrx H belong to A(δ, τ). Snce τ > 0 guarantees the exstence of H 1, we have: λ (H 1 ) = 1 1 λ (H), whch mples ϱ(h) =. Thus, (35) can be replaced by : ρ(h 1 ) λ (H) A(δ, τ) { ρ(h) < δ ρ(h 1 ) < 1 τ (36) The followng result gves a necessary and suffcent condton for (36) to be verfed : Proposton 2 The egenvalues of a matrx H R n n verfy λ (H) A(δ, τ), f and only f there exst matrces Q 1 R m 1 n and Q 2 R m 2 n, wth rank(q 1 ) = rank(q 2 ) = n and matrces Γ 1 R m 1 m 1 and Γ 2 R m 2 m 2 such that : Γ 1 Q 1 = Q 1 H (37) Γ 1 < δ (38) Γ 2 Q 2 = Q 2 H 1 (39) Γ 2 < 1 τ (40) 6

7 Proof : Consder the matrx H δ = 1 δ H, wth δ > 0, whose egenvalues satsfy λ (H δ ) = 1 δ λ (H). Then, ρ(h δ ) < 1 f and only f ρ(h) < δ, whch s verfed f and only f there exst Q 1 R m1 n of rank n, and Γ 1 R m 1 m 1 such that: Γ 1 Q 1 = Q 1 H δ (41) Γ 1 < 1 (42) Relatons (37) and (38) are obtaned from (41) and (42) by defnng Γ 1 = 1 δ Γ 1 and by usng the fact that Γ 1 = 1 δ Γ 1, because δ s postve. To complete the proof, t suffces to apply (41) and (42) to obtan ρ(h 1 ) < 1 τ. As n the case of vertcal strps, t s possble to derve suffcent condtons for characterzng the locaton of egenvalues n A(δ, τ). In addton, the followng result (see 8, page 167) can be used : Lemma 1 : If Z R w w satsfy: w 0 < z Zz j = α j 1 = 1,..., w (that s, Z s strctly dagonally domnant by rows), then ρ(z 1 ) Z 1 1 mn α Thus, the followng characterzaton s obtaned for the locaton of the egenvalues of H n A(δ, τ) Property 2 : If H < δ and mn H H j > τ then λ (H) A(δ, τ). j 4 A Lnear Programmng Formulaton of the Control Problem 4.1 An LP formulaton to satsfy state and nput constrants The basc constraned control problem whch has been stated n secton 2.1 may be solved by fndng matrces (H, K, M) whch satsfy relatons (8), (9), (10), (11). The two frst relatons are lnear matrx equaltes. The thrd one and the fourth one nvolve the absolute values of matrces H, K and M. A classcal way to lnearly reformulate relaton (11) s through the decomposton of these matrces nto ther postve and negatve elements (see e.g. 7). Any matrx L and, n consequence, the matrx L, can be decomposed nto: L = L + L and L = L + + L (43) wth:l + j = max(l j, 0) and L j = max( L j, 0). Usng matrces H +, H, K +, K,M +, M, relatons (10), (11) are then formulated as lnear relatons, and the satsfacton of the second relaton n (43) s forced by the choce of the objectve functon. 7

8 The LP formulaton of the constraned dsturbance rejecton problem takes the followng form, wth the components of matrces H +, H, K +, K, M +, M as unknown varables : Mnmze under p 1 ɛ + p 2 ζ (H + H )G GB(M + M )G = GA (K + K )P = GD (M + + M )γ ζρ 0 (H + + H )γ + (K + K )ξ ɛγ 0 0 ɛ 1 ; 0 ζ 1 H +, H, K +, K, M +, M 0 (44) If ths problem has no soluton, then the choce Ω = S(G, γ) s not admssble. Ths does not always mean that the performance bound vector γ s mpossble to acheve. To be sure that ths bound s not achevable, one has to show that the maxmal controlled nvarant set ncluded n S(G, γ) s empty (see 13). The study of the maxmal controlled nvarant set ncluded n a gven compact polyhedron has been made by several authors 9, 2, and numercal technques have been proposed for computng ths doman 4, 5. If the model s uncertan, as descrbed by (14), (15) and (16), unknown matrces H j +, H j, correspondng to each par of vertces (A, B j ), must be computed to verfy equatons (17) to (19). 4.2 An LP formulaton ntegratng spectral specfcatons In order to ntegrate spectral specfcatons (pole locaton n vertcal strps, F(α, β), or n centered rngs, A(δ, τ)) n the desgn procedure, we propose to add the condtons stablshd n propertes 2 and 1 to the LP desgn procedure. It s worth notcng that the desgn methodology s based on the search of a constant state feedback control law whch should leave a gven polyhedral set nvarant wth respect to the dsturbed system (7). Furthermore, the condtons that wll be used for guaranteeng the regonal pole locaton are only suffcent condtons. Thus, n order to provde some addtonal degrees of freedom n the desgn technque, we shall consder that : 1) the lmts that descrbe the regons of pole locaton (α and β for vertcal strps, F(α, β), and δ and τ for centered rngs, A(δ, τ) ) can be used as varables n the LP formulatons 2) the lnear objectve functons constructed from these varables descrbe dfferent possbltes of locatng the poles wthn regons wth the desred shape. From the above dscusson, we propose the followng two LP formulatons for regonal pole locaton 8

9 - Locaton n vertcal strps F(α, β) : Mnmze subject to J = p 1 α + p 2 β (H + H )G GB(M + M )G = GA (K + K )P = GD (M + + M )γ ρ (H + + H )γ + (K + K )ξ γ n H + H + (H j + + Hj ) < α j n H + + H + (H j + + H j ) < β j α > β H +, H, K +, K, M +, M 0 (45) - Locaton n centered rngs A(δ, τ) : Mnmze subject to J = p 1 δ + p 2 τ (H + H )G GB(M + M )G = GA (K + K )P = GD (M + + M )γ ρ (H + + H )γ + (K + K )ξ γ (H + + H )γ δγ n (H + + H ) + (H j + + H j )1 n < τ1 n j δ > τ H +, H, K +, K, M +, M 0 (46) In both LP formulatons gven above, the weghts p 1 and p 2 should be used by the desgner n order to fnd a soluton that approprately locates the closed-loop poles n the complex plane A numercal Example Consder the followng matrces descrbng the model of a DC motor 3 11: A l = B = A u = The elements of matrces A l and A u descrbe, respectvely, the lower and upper bounds of each element of the system matrx A. Matrx B s supposed perfectly known. For the sake of smplcty, t s assumed that the control nput varables are not constraned. Only the dsturbance rejecton specfcaton s mposed, under the form of a doman of state constrants S(G, γ) gven by: G = γ =

10 The spectral control objectve s to locate the poles of the uncertan closed-loop n a regon of type F(α, β), and a constant state feedback soluton s nvestgated. Usng frst the lnear program (45) wth the weghts p 1 = 1 and p 2 = 1, both α and β tend to be mnmzed. The followng values of F, α, β have been computed : F = ; α = ; β = The egenvalues correspondng to each corner A o = A + BF, for = 1,..., 8 are the followng ones : λ (A o1 ) = (A o2 ) = λ (A o3 ) = (A o4 ) = λ (A o5 ) = (A o6 ) = λ (A o7 ) = ± j λ (A o8 ) = ± j Now, usng the weghts p 1 = 1 and p 2 = 1, α tends to be maxmzed whle β tends to be mnmzed. The followng values of F, α, β have been obtaned for ths case : F = ; α = ; β = The egenvalues correspondng to each corner A o = A + BF, for = 1,..., 8 are the followng ones : λ (A o1 ) = (A o2 ) = Concluson λ (A o3 ) = (A o4 ) = λ (A o5 ) = (A o6 ) = λ (A o7 ) = ± j (A o8 ) = ± j The approach by controlled nvarance of polyhedral sets seems to be partcularly well ftted to the resoluton of some dsturbance rejecton problems havng complcatng features such as control nput constrants, and addtonal pole placement requrements. The man advantage of ths approach s ts computatonal effcency whch derves from the use of standard Lnear Programmng as the basc computatonal tool. Some extensons of the work presented n ths study are currently under study, wth the objectve of decreasng the performance gap between smple solutons nvolvng constant lnear state feedback laws and dynamc or nonlnear l 1 -optmal solutons. 10

11 References 1 G.Btsors : Postvely nvarant polyhedral sets of dscrete-tme lnear systems Int. Journal of Control, vol 47 (1988), pp F.Blanchn : Ultmate Boundedness Control for Uncertan Dscrete-Tme Systems va Set- Induced Lyapunov Functons IEEE Trans. Aut. Control, vol.39, No.2, 1994, pp F. Blanchn : Feedback control for lnear tme-nvarant systems wth state and control bounds n presence of dsturbances. IEEE Transactons on Automatc Control, vol.35, 1991, pp E. de Sants : On Maxmal Invarant Sets for Dscrete-tme Lnear Systems wth Dsturbances. Proc. of 3rd IEEE Med. Sympos. New Drectons n Contr. Autom., Lmassol, Cyprus, July 1995, pp C. E. T. Dórea and J. C. Hennet, Computaton of maxmal admssble sets of constraned lnear systems, n Proceedngs of the 4th IEEE Medterranean Symposum on New Drectons n Control and Automaton, Maleme, Greece, 1996, pp J.C.Geromel, P.L.D.Peres, J.Bernussou : On a convex parameter space method for lnear control desgn of uncertan systems SIAM J. Contr. and Optmzaton, Vol.29, No 2, pp , J.C.Hennet : Dscrete-tme Lnear Systems Control and Dynamc Systems, vol.71, C.T.Leondes Ed., Academc Press, pp , N. J. Hgham : Accuracy and Stablty of Numercal Algorthms. SIAM, Phladlpha, S.S.Keerth, E.G.Glbert : Computaton of Mnmum-Tme Feedback Control Laws for Dscrete- Tme Systems wth State-Control Constrants IEEE Trans. Aut. Control, vol.32, No.5, 1987, pp B.E.A.Mlan, A.N.Carvalho : Robust Optmal Lnear Regulator desgn for dscrete-tme systems under state and control constrants IFAC Symposum on Robust Control Desgn, IFAC Ro, 1994,pp B. E. A. Mlan, E. B. Castelan and S. Tarbourech : Lnear regulator desgn for bounded uncertan dscrete-tme systems wth addtve dsturbances IFAC Internatonal Federaton of Automatc Control, vol G, A. P. Molchanov and Ye. S. Pyatntsky : Crtera of asymptotc stablty of dfferental and dference nclusons encountered n control theory. Systems and Control Letters, vol.13, 1989, pp J. S. Shamma, Optmzaton of the l -nduced norm under full state feedback, IEEE Trans. Automat. Contr., vol. 41. no. 4, pp , M.Vasslak, J.C.Hennet, G.Btsors : Feedback Control of Lnear Dscrete-tme Systems under State and Control Constrants Int. J. of Control, vol. 47, No. 6, 1988, pp

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:

More information

The Minimum Universal Cost Flow in an Infeasible Flow Network

The Minimum Universal Cost Flow in an Infeasible Flow Network Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran

More information

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 )

Yong Joon Ryang. 1. Introduction Consider the multicommodity transportation problem with convex quadratic cost function. 1 2 (x x0 ) T Q(x x 0 ) Kangweon-Kyungk Math. Jour. 4 1996), No. 1, pp. 7 16 AN ITERATIVE ROW-ACTION METHOD FOR MULTICOMMODITY TRANSPORTATION PROBLEMS Yong Joon Ryang Abstract. The optmzaton problems wth quadratc constrants often

More information

Introduction. - The Second Lyapunov Method. - The First Lyapunov Method

Introduction. - The Second Lyapunov Method. - The First Lyapunov Method Stablty Analyss A. Khak Sedgh Control Systems Group Faculty of Electrcal and Computer Engneerng K. N. Toos Unversty of Technology February 2009 1 Introducton Stablty s the most promnent characterstc of

More information

Control of Uncertain Bilinear Systems using Linear Controllers: Stability Region Estimation and Controller Design

Control of Uncertain Bilinear Systems using Linear Controllers: Stability Region Estimation and Controller Design Control of Uncertan Blnear Systems usng Lnear Controllers: Stablty Regon Estmaton Controller Desgn Shoudong Huang Department of Engneerng Australan Natonal Unversty Canberra, ACT 2, Australa shoudong.huang@anu.edu.au

More information

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017

U.C. Berkeley CS294: Beyond Worst-Case Analysis Luca Trevisan September 5, 2017 U.C. Berkeley CS94: Beyond Worst-Case Analyss Handout 4s Luca Trevsan September 5, 07 Summary of Lecture 4 In whch we ntroduce semdefnte programmng and apply t to Max Cut. Semdefnte Programmng Recall that

More information

THE GUARANTEED COST CONTROL FOR UNCERTAIN LARGE SCALE INTERCONNECTED SYSTEMS

THE GUARANTEED COST CONTROL FOR UNCERTAIN LARGE SCALE INTERCONNECTED SYSTEMS Copyrght 22 IFAC 5th rennal World Congress, Barcelona, Span HE GUARANEED COS CONROL FOR UNCERAIN LARGE SCALE INERCONNECED SYSEMS Hroak Mukadan Yasuyuk akato Yoshyuk anaka Koch Mzukam Faculty of Informaton

More information

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg

princeton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there

More information

Lecture 12: Discrete Laplacian

Lecture 12: Discrete Laplacian Lecture 12: Dscrete Laplacan Scrbe: Tanye Lu Our goal s to come up wth a dscrete verson of Laplacan operator for trangulated surfaces, so that we can use t n practce to solve related problems We are mostly

More information

Solutions to exam in SF1811 Optimization, Jan 14, 2015

Solutions to exam in SF1811 Optimization, Jan 14, 2015 Solutons to exam n SF8 Optmzaton, Jan 4, 25 3 3 O------O -4 \ / \ / The network: \/ where all lnks go from left to rght. /\ / \ / \ 6 O------O -5 2 4.(a) Let x = ( x 3, x 4, x 23, x 24 ) T, where the varable

More information

More metrics on cartesian products

More metrics on cartesian products More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of

More information

Kernel Methods and SVMs Extension

Kernel Methods and SVMs Extension Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general

More information

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS

8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 493 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces you have studed thus far n the text are real vector spaces because the scalars

More information

MMA and GCMMA two methods for nonlinear optimization

MMA and GCMMA two methods for nonlinear optimization MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons

More information

Singular Value Decomposition: Theory and Applications

Singular Value Decomposition: Theory and Applications Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real

More information

Computing Correlated Equilibria in Multi-Player Games

Computing Correlated Equilibria in Multi-Player Games Computng Correlated Equlbra n Mult-Player Games Chrstos H. Papadmtrou Presented by Zhanxang Huang December 7th, 2005 1 The Author Dr. Chrstos H. Papadmtrou CS professor at UC Berkley (taught at Harvard,

More information

Convexity preserving interpolation by splines of arbitrary degree

Convexity preserving interpolation by splines of arbitrary degree Computer Scence Journal of Moldova, vol.18, no.1(52), 2010 Convexty preservng nterpolaton by splnes of arbtrary degree Igor Verlan Abstract In the present paper an algorthm of C 2 nterpolaton of dscrete

More information

Robust observed-state feedback design. for discrete-time systems rational in the uncertainties

Robust observed-state feedback design. for discrete-time systems rational in the uncertainties Robust observed-state feedback desgn for dscrete-tme systems ratonal n the uncertantes Dmtr Peaucelle Yosho Ebhara & Yohe Hosoe Semnar at Kolloquum Technsche Kybernetk, May 10, 016 Unversty of Stuttgart

More information

2.3 Nilpotent endomorphisms

2.3 Nilpotent endomorphisms s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms

More information

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014)

10-801: Advanced Optimization and Randomized Methods Lecture 2: Convex functions (Jan 15, 2014) 0-80: Advanced Optmzaton and Randomzed Methods Lecture : Convex functons (Jan 5, 04) Lecturer: Suvrt Sra Addr: Carnege Mellon Unversty, Sprng 04 Scrbes: Avnava Dubey, Ahmed Hefny Dsclamer: These notes

More information

The Second Anti-Mathima on Game Theory

The Second Anti-Mathima on Game Theory The Second Ant-Mathma on Game Theory Ath. Kehagas December 1 2006 1 Introducton In ths note we wll examne the noton of game equlbrum for three types of games 1. 2-player 2-acton zero-sum games 2. 2-player

More information

Numerical Heat and Mass Transfer

Numerical Heat and Mass Transfer Master degree n Mechancal Engneerng Numercal Heat and Mass Transfer 06-Fnte-Dfference Method (One-dmensonal, steady state heat conducton) Fausto Arpno f.arpno@uncas.t Introducton Why we use models and

More information

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems

Chapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons

More information

Perron Vectors of an Irreducible Nonnegative Interval Matrix

Perron Vectors of an Irreducible Nonnegative Interval Matrix Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of

More information

SL n (F ) Equals its Own Derived Group

SL n (F ) Equals its Own Derived Group Internatonal Journal of Algebra, Vol. 2, 2008, no. 12, 585-594 SL n (F ) Equals ts Own Derved Group Jorge Macel BMCC-The Cty Unversty of New York, CUNY 199 Chambers street, New York, NY 10007, USA macel@cms.nyu.edu

More information

The Order Relation and Trace Inequalities for. Hermitian Operators

The Order Relation and Trace Inequalities for. Hermitian Operators Internatonal Mathematcal Forum, Vol 3, 08, no, 507-57 HIKARI Ltd, wwwm-hkarcom https://doorg/0988/mf088055 The Order Relaton and Trace Inequaltes for Hermtan Operators Y Huang School of Informaton Scence

More information

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix

Lectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could

More information

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS

BOUNDEDNESS OF THE RIESZ TRANSFORM WITH MATRIX A 2 WEIGHTS BOUNDEDNESS OF THE IESZ TANSFOM WITH MATIX A WEIGHTS Introducton Let L = L ( n, be the functon space wth norm (ˆ f L = f(x C dx d < For a d d matrx valued functon W : wth W (x postve sem-defnte for all

More information

Affine transformations and convexity

Affine transformations and convexity Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/

More information

Problem Set 9 Solutions

Problem Set 9 Solutions Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem

More information

APPENDIX A Some Linear Algebra

APPENDIX A Some Linear Algebra APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,

More information

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal

Inner Product. Euclidean Space. Orthonormal Basis. Orthogonal Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,

More information

Appendix B. The Finite Difference Scheme

Appendix B. The Finite Difference Scheme 140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton

More information

Random Walks on Digraphs

Random Walks on Digraphs Random Walks on Dgraphs J. J. P. Veerman October 23, 27 Introducton Let V = {, n} be a vertex set and S a non-negatve row-stochastc matrx (.e. rows sum to ). V and S defne a dgraph G = G(V, S) and a drected

More information

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system

Transfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng

More information

Dynamic Systems on Graphs

Dynamic Systems on Graphs Prepared by F.L. Lews Updated: Saturday, February 06, 200 Dynamc Systems on Graphs Control Graphs and Consensus A network s a set of nodes that collaborates to acheve what each cannot acheve alone. A network,

More information

Solving the Quadratic Eigenvalue Complementarity Problem by DC Programming

Solving the Quadratic Eigenvalue Complementarity Problem by DC Programming Solvng the Quadratc Egenvalue Complementarty Problem by DC Programmng Y-Shua Nu 1, Joaqum Júdce, Le Th Hoa An 3 and Pham Dnh Tao 4 1 Shangha JaoTong Unversty, Maths Departement and SJTU-Parstech, Chna

More information

Errors for Linear Systems

Errors for Linear Systems Errors for Lnear Systems When we solve a lnear system Ax b we often do not know A and b exactly, but have only approxmatons  and ˆb avalable. Then the best thng we can do s to solve ˆx ˆb exactly whch

More information

A 2D Bounded Linear Program (H,c) 2D Linear Programming

A 2D Bounded Linear Program (H,c) 2D Linear Programming A 2D Bounded Lnear Program (H,c) h 3 v h 8 h 5 c h 4 h h 6 h 7 h 2 2D Lnear Programmng C s a polygonal regon, the ntersecton of n halfplanes. (H, c) s nfeasble, as C s empty. Feasble regon C s unbounded

More information

Spectral Graph Theory and its Applications September 16, Lecture 5

Spectral Graph Theory and its Applications September 16, Lecture 5 Spectral Graph Theory and ts Applcatons September 16, 2004 Lecturer: Danel A. Spelman Lecture 5 5.1 Introducton In ths lecture, we wll prove the followng theorem: Theorem 5.1.1. Let G be a planar graph

More information

Zeros and Zero Dynamics for Linear, Time-delay System

Zeros and Zero Dynamics for Linear, Time-delay System UNIVERSITA POLITECNICA DELLE MARCHE - FACOLTA DI INGEGNERIA Dpartmento d Ingegnerua Informatca, Gestonale e dell Automazone LabMACS Laboratory of Modelng, Analyss and Control of Dynamcal System Zeros and

More information

( ) 2 ( ) ( ) Problem Set 4 Suggested Solutions. Problem 1

( ) 2 ( ) ( ) Problem Set 4 Suggested Solutions. Problem 1 Problem Set 4 Suggested Solutons Problem (A) The market demand functon s the soluton to the followng utlty-maxmzaton roblem (UMP): The Lagrangean: ( x, x, x ) = + max U x, x, x x x x st.. x + x + x y x,

More information

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin

LOW BIAS INTEGRATED PATH ESTIMATORS. James M. Calvin Proceedngs of the 007 Wnter Smulaton Conference S G Henderson, B Bller, M-H Hseh, J Shortle, J D Tew, and R R Barton, eds LOW BIAS INTEGRATED PATH ESTIMATORS James M Calvn Department of Computer Scence

More information

On a direct solver for linear least squares problems

On a direct solver for linear least squares problems ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear

More information

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography

CSci 6974 and ECSE 6966 Math. Tech. for Vision, Graphics and Robotics Lecture 21, April 17, 2006 Estimating A Plane Homography CSc 6974 and ECSE 6966 Math. Tech. for Vson, Graphcs and Robotcs Lecture 21, Aprl 17, 2006 Estmatng A Plane Homography Overvew We contnue wth a dscusson of the major ssues, usng estmaton of plane projectve

More information

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis

Appendix for Causal Interaction in Factorial Experiments: Application to Conjoint Analysis A Appendx for Causal Interacton n Factoral Experments: Applcaton to Conjont Analyss Mathematcal Appendx: Proofs of Theorems A. Lemmas Below, we descrbe all the lemmas, whch are used to prove the man theorems

More information

First day August 1, Problems and Solutions

First day August 1, Problems and Solutions FOURTH INTERNATIONAL COMPETITION FOR UNIVERSITY STUDENTS IN MATHEMATICS July 30 August 4, 997, Plovdv, BULGARIA Frst day August, 997 Problems and Solutons Problem. Let {ε n } n= be a sequence of postve

More information

A NOVEL DESIGN APPROACH FOR MULTIVARIABLE QUANTITATIVE FEEDBACK DESIGN WITH TRACKING ERROR SPECIFICATIONS

A NOVEL DESIGN APPROACH FOR MULTIVARIABLE QUANTITATIVE FEEDBACK DESIGN WITH TRACKING ERROR SPECIFICATIONS A OVEL DESIG APPROACH FOR MULTIVARIABLE QUATITATIVE FEEDBACK DESIG WITH TRACKIG ERROR SPECIFICATIOS Seyyed Mohammad Mahd Alav, Al Khak-Sedgh, Batool Labb Department of Electronc and Computer Engneerng,

More information

CHAPTER III Neural Networks as Associative Memory

CHAPTER III Neural Networks as Associative Memory CHAPTER III Neural Networs as Assocatve Memory Introducton One of the prmary functons of the bran s assocatve memory. We assocate the faces wth names, letters wth sounds, or we can recognze the people

More information

Non-negative Matrices and Distributed Control

Non-negative Matrices and Distributed Control Non-negatve Matrces an Dstrbute Control Yln Mo July 2, 2015 We moel a network compose of m agents as a graph G = {V, E}. V = {1, 2,..., m} s the set of vertces representng the agents. E V V s the set of

More information

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty

Additional Codes using Finite Difference Method. 1 HJB Equation for Consumption-Saving Problem Without Uncertainty Addtonal Codes usng Fnte Dfference Method Benamn Moll 1 HJB Equaton for Consumpton-Savng Problem Wthout Uncertanty Before consderng the case wth stochastc ncome n http://www.prnceton.edu/~moll/ HACTproect/HACT_Numercal_Appendx.pdf,

More information

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem.

Lecture 20: Lift and Project, SDP Duality. Today we will study the Lift and Project method. Then we will prove the SDP duality theorem. prnceton u. sp 02 cos 598B: algorthms and complexty Lecture 20: Lft and Project, SDP Dualty Lecturer: Sanjeev Arora Scrbe:Yury Makarychev Today we wll study the Lft and Project method. Then we wll prove

More information

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b

A New Refinement of Jacobi Method for Solution of Linear System Equations AX=b Int J Contemp Math Scences, Vol 3, 28, no 17, 819-827 A New Refnement of Jacob Method for Soluton of Lnear System Equatons AX=b F Naem Dafchah Department of Mathematcs, Faculty of Scences Unversty of Gulan,

More information

COS 521: Advanced Algorithms Game Theory and Linear Programming

COS 521: Advanced Algorithms Game Theory and Linear Programming COS 521: Advanced Algorthms Game Theory and Lnear Programmng Moses Charkar February 27, 2013 In these notes, we ntroduce some basc concepts n game theory and lnear programmng (LP). We show a connecton

More information

Lecture Notes on Linear Regression

Lecture Notes on Linear Regression Lecture Notes on Lnear Regresson Feng L fl@sdueducn Shandong Unversty, Chna Lnear Regresson Problem In regresson problem, we am at predct a contnuous target value gven an nput feature vector We assume

More information

Perfect Competition and the Nash Bargaining Solution

Perfect Competition and the Nash Bargaining Solution Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange

More information

The equation of motion of a dynamical system is given by a set of differential equations. That is (1)

The equation of motion of a dynamical system is given by a set of differential equations. That is (1) Dynamcal Systems Many engneerng and natural systems are dynamcal systems. For example a pendulum s a dynamcal system. State l The state of the dynamcal system specfes t condtons. For a pendulum n the absence

More information

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009

College of Computer & Information Science Fall 2009 Northeastern University 20 October 2009 College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:

More information

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X

3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number

More information

MEM Chapter 4b. LMI Lab commands

MEM Chapter 4b. LMI Lab commands 1 MEM8-7 Chapter 4b LMI Lab commands setlms lmvar lmterm getlms lmedt lmnbr matnbr lmnfo feasp dec2mat evallm showlm setmvar mat2dec mncx dellm delmvar gevp 2 Intalzng the LMI System he descrpton of an

More information

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION

ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EQUATION Advanced Mathematcal Models & Applcatons Vol.3, No.3, 2018, pp.215-222 ON A DETERMINATION OF THE INITIAL FUNCTIONS FROM THE OBSERVED VALUES OF THE BOUNDARY FUNCTIONS FOR THE SECOND-ORDER HYPERBOLIC EUATION

More information

Finding Dense Subgraphs in G(n, 1/2)

Finding Dense Subgraphs in G(n, 1/2) Fndng Dense Subgraphs n Gn, 1/ Atsh Das Sarma 1, Amt Deshpande, and Rav Kannan 1 Georga Insttute of Technology,atsh@cc.gatech.edu Mcrosoft Research-Bangalore,amtdesh,annan@mcrosoft.com Abstract. Fndng

More information

COMPLEX NUMBERS AND QUADRATIC EQUATIONS

COMPLEX NUMBERS AND QUADRATIC EQUATIONS COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not

More information

VQ widely used in coding speech, image, and video

VQ widely used in coding speech, image, and video at Scalar quantzers are specal cases of vector quantzers (VQ): they are constraned to look at one sample at a tme (memoryless) VQ does not have such constrant better RD perfomance expected Source codng

More information

Decentralized robust control design using LMI

Decentralized robust control design using LMI Acta Montanstca Slovaca Ročník 3 (28) číslo -4 Decentralzed robust control desgn usng LMI Anna Flasová and Dušan Krokavec ávrh robustného decentralzovaného radena pomocou LMI he paper deals wth applcaton

More information

e - c o m p a n i o n

e - c o m p a n i o n OPERATIONS RESEARCH http://dxdoorg/0287/opre007ec e - c o m p a n o n ONLY AVAILABLE IN ELECTRONIC FORM 202 INFORMS Electronc Companon Generalzed Quantty Competton for Multple Products and Loss of Effcency

More information

Feature Selection: Part 1

Feature Selection: Part 1 CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?

More information

5 The Rational Canonical Form

5 The Rational Canonical Form 5 The Ratonal Canoncal Form Here p s a monc rreducble factor of the mnmum polynomal m T and s not necessarly of degree one Let F p denote the feld constructed earler n the course, consstng of all matrces

More information

6.854J / J Advanced Algorithms Fall 2008

6.854J / J Advanced Algorithms Fall 2008 MIT OpenCourseWare http://ocw.mt.edu 6.854J / 18.415J Advanced Algorthms Fall 2008 For nformaton about ctng these materals or our Terms of Use, vst: http://ocw.mt.edu/terms. 18.415/6.854 Advanced Algorthms

More information

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique

Outline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng

More information

LECTURE 9 CANONICAL CORRELATION ANALYSIS

LECTURE 9 CANONICAL CORRELATION ANALYSIS LECURE 9 CANONICAL CORRELAION ANALYSIS Introducton he concept of canoncal correlaton arses when we want to quantfy the assocatons between two sets of varables. For example, suppose that the frst set of

More information

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016

U.C. Berkeley CS294: Spectral Methods and Expanders Handout 8 Luca Trevisan February 17, 2016 U.C. Berkeley CS94: Spectral Methods and Expanders Handout 8 Luca Trevsan February 7, 06 Lecture 8: Spectral Algorthms Wrap-up In whch we talk about even more generalzatons of Cheeger s nequaltes, and

More information

Some modelling aspects for the Matlab implementation of MMA

Some modelling aspects for the Matlab implementation of MMA Some modellng aspects for the Matlab mplementaton of MMA Krster Svanberg krlle@math.kth.se Optmzaton and Systems Theory Department of Mathematcs KTH, SE 10044 Stockholm September 2004 1. Consdered optmzaton

More information

Maximizing the number of nonnegative subsets

Maximizing the number of nonnegative subsets Maxmzng the number of nonnegatve subsets Noga Alon Hao Huang December 1, 213 Abstract Gven a set of n real numbers, f the sum of elements of every subset of sze larger than k s negatve, what s the maxmum

More information

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41,

Example: (13320, 22140) =? Solution #1: The divisors of are 1, 2, 3, 4, 5, 6, 9, 10, 12, 15, 18, 20, 27, 30, 36, 41, The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no confuson

More information

Approximate D-optimal designs of experiments on the convex hull of a finite set of information matrices

Approximate D-optimal designs of experiments on the convex hull of a finite set of information matrices Approxmate D-optmal desgns of experments on the convex hull of a fnte set of nformaton matrces Radoslav Harman, Mára Trnovská Department of Appled Mathematcs and Statstcs Faculty of Mathematcs, Physcs

More information

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso

Supplement: Proofs and Technical Details for The Solution Path of the Generalized Lasso Supplement: Proofs and Techncal Detals for The Soluton Path of the Generalzed Lasso Ryan J. Tbshran Jonathan Taylor In ths document we gve supplementary detals to the paper The Soluton Path of the Generalzed

More information

Minimax Optimal Control of Stochastic Uncertain Systems with Relative Entropy Constraints

Minimax Optimal Control of Stochastic Uncertain Systems with Relative Entropy Constraints [IEEE Trans. Aut. Control, 45, 398-412, 2000] Mnmax Optmal Control of Stochastc Uncertan Systems wth Relatve Entropy Constrants Ian R. Petersen Matthew R. James Paul Dupus Abstract Ths paper consders a

More information

On the Multicriteria Integer Network Flow Problem

On the Multicriteria Integer Network Flow Problem BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of

More information

NP-Completeness : Proofs

NP-Completeness : Proofs NP-Completeness : Proofs Proof Methods A method to show a decson problem Π NP-complete s as follows. (1) Show Π NP. (2) Choose an NP-complete problem Π. (3) Show Π Π. A method to show an optmzaton problem

More information

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence)

Dynamic Programming. Preview. Dynamic Programming. Dynamic Programming. Dynamic Programming (Example: Fibonacci Sequence) /24/27 Prevew Fbonacc Sequence Longest Common Subsequence Dynamc programmng s a method for solvng complex problems by breakng them down nto smpler sub-problems. It s applcable to problems exhbtng the propertes

More information

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS

MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS MATH 241B FUNCTIONAL ANALYSIS - NOTES EXAMPLES OF C ALGEBRAS These are nformal notes whch cover some of the materal whch s not n the course book. The man purpose s to gve a number of nontrval examples

More information

Calculation of time complexity (3%)

Calculation of time complexity (3%) Problem 1. (30%) Calculaton of tme complexty (3%) Gven n ctes, usng exhaust search to see every result takes O(n!). Calculaton of tme needed to solve the problem (2%) 40 ctes:40! dfferent tours 40 add

More information

Robust control for uncertain linear systems with State and Control Constraints

Robust control for uncertain linear systems with State and Control Constraints Proceedngs of the 17th World Congress The Internatonal Federaton of Automatc Control Robust control for uncertan lnear systems wth State and Control Constrants Hassan AYAD Fouad MESUINE Mustapha AIT RAMI

More information

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction

The Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also

More information

Foundations of Arithmetic

Foundations of Arithmetic Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an

More information

The Second Eigenvalue of Planar Graphs

The Second Eigenvalue of Planar Graphs Spectral Graph Theory Lecture 20 The Second Egenvalue of Planar Graphs Danel A. Spelman November 11, 2015 Dsclamer These notes are not necessarly an accurate representaton of what happened n class. The

More information

SINGLE OUTPUT DEPENDENT QUADRATIC OBSERVABILITY NORMAL FORM

SINGLE OUTPUT DEPENDENT QUADRATIC OBSERVABILITY NORMAL FORM SINGLE OUTPUT DEPENDENT QUADRATIC OBSERVABILITY NORMAL FORM G Zheng D Boutat JP Barbot INRIA Rhône-Alpes, Inovallée, 655 avenue de l Europe, Montbonnot Sant Martn, 38334 St Ismer Cedex, France LVR/ENSI,

More information

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution.

Solutions HW #2. minimize. Ax = b. Give the dual problem, and make the implicit equality constraints explicit. Solution. Solutons HW #2 Dual of general LP. Fnd the dual functon of the LP mnmze subject to c T x Gx h Ax = b. Gve the dual problem, and make the mplct equalty constrants explct. Soluton. 1. The Lagrangan s L(x,

More information

Lyapunov-Razumikhin and Lyapunov-Krasovskii theorems for interconnected ISS time-delay systems

Lyapunov-Razumikhin and Lyapunov-Krasovskii theorems for interconnected ISS time-delay systems Proceedngs of the 19th Internatonal Symposum on Mathematcal Theory of Networks and Systems MTNS 2010 5 9 July 2010 Budapest Hungary Lyapunov-Razumkhn and Lyapunov-Krasovsk theorems for nterconnected ISS

More information

Communication Complexity 16:198: February Lecture 4. x ij y ij

Communication Complexity 16:198: February Lecture 4. x ij y ij Communcaton Complexty 16:198:671 09 February 2010 Lecture 4 Lecturer: Troy Lee Scrbe: Rajat Mttal 1 Homework problem : Trbes We wll solve the thrd queston n the homework. The goal s to show that the nondetermnstc

More information

Inexact Newton Methods for Inverse Eigenvalue Problems

Inexact Newton Methods for Inverse Eigenvalue Problems Inexact Newton Methods for Inverse Egenvalue Problems Zheng-jan Ba Abstract In ths paper, we survey some of the latest development n usng nexact Newton-lke methods for solvng nverse egenvalue problems.

More information

Report on Image warping

Report on Image warping Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.

More information

Hidden Markov Models

Hidden Markov Models Hdden Markov Models Namrata Vaswan, Iowa State Unversty Aprl 24, 204 Hdden Markov Model Defntons and Examples Defntons:. A hdden Markov model (HMM) refers to a set of hdden states X 0, X,..., X t,...,

More information

A property of the elementary symmetric functions

A property of the elementary symmetric functions Calcolo manuscrpt No. (wll be nserted by the edtor) A property of the elementary symmetrc functons A. Esnberg, G. Fedele Dp. Elettronca Informatca e Sstemstca, Unverstà degl Stud della Calabra, 87036,

More information

Google PageRank with Stochastic Matrix

Google PageRank with Stochastic Matrix Google PageRank wth Stochastc Matrx Md. Sharq, Puranjt Sanyal, Samk Mtra (M.Sc. Applcatons of Mathematcs) Dscrete Tme Markov Chan Let S be a countable set (usually S s a subset of Z or Z d or R or R d

More information

Lecture 17: Lee-Sidford Barrier

Lecture 17: Lee-Sidford Barrier CSE 599: Interplay between Convex Optmzaton and Geometry Wnter 2018 Lecturer: Yn Tat Lee Lecture 17: Lee-Sdford Barrer Dsclamer: Please tell me any mstake you notced. In ths lecture, we talk about the

More information

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011

Stanford University CS359G: Graph Partitioning and Expanders Handout 4 Luca Trevisan January 13, 2011 Stanford Unversty CS359G: Graph Parttonng and Expanders Handout 4 Luca Trevsan January 3, 0 Lecture 4 In whch we prove the dffcult drecton of Cheeger s nequalty. As n the past lectures, consder an undrected

More information

A new Approach for Solving Linear Ordinary Differential Equations

A new Approach for Solving Linear Ordinary Differential Equations , ISSN 974-57X (Onlne), ISSN 974-5718 (Prnt), Vol. ; Issue No. 1; Year 14, Copyrght 13-14 by CESER PUBLICATIONS A new Approach for Solvng Lnear Ordnary Dfferental Equatons Fawz Abdelwahd Department of

More information

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming

EEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-

More information