Institute for Software Technology
|
|
- Claude Knight
- 5 years ago
- Views:
Transcription
1 - Dagnoss I - Insttute for Software Technology Inffeldgasse 16b/2 A-8010 Graz Austra 1
2 References Skrptum (TU Wen, Insttut für Informatonssysteme, Thomas Eter et al.) ÖH-Copyshop, Studenzentrum Stuart t Russell und Peter Norvg. Artfcal Intellgence - A Modern Approach. Prentce Hall
3 Motvatng Example MBD a b c d M1 * M2 * M3 A1 + A2 + f g f * 3
4 Motvatng Example MBD M1 a 3 6 * A1 10 b 2 12 c 2 d f 3 M2 * 6 + A M3 * 6 + f g 4
5 Motvatng Example MBD M1 a 3 6 * A1 10 b 2 12 M2 4 + c 2 6 * A2 10 d 3 12 f 3 M3 * 6 + f g 5
6 Omn-drectonal Robot 6
7 Applcaton Domans 7
8 Prncples MBD System Descrpton (Model) Dagnoss Physcal System Desered Behavor Dscrepancy Observed Behavor 8
9 Requrements Prncples MBD Model (Component-Connecton-Behavor Model) Powerful Computer Benefts General Methodology Easy to mantan Easy adaptable to other problems Cost reducton 9
10 Defntons 1. Dagnoss System: A dagnoss system (SD,COMP) conssts of a system descrpton SD,.e., a set of FOL sentences descrbng the components behavor and the system structure, and a set of dagnoss components COMP. Alexander - Felferng and Gerald Stenbauer
11 Example: AND gates Defntons and(c) ( ab(c) out(c)=n 1 (C) n 2 (C)) and(a 1 ) and(a 2 ) out(a 1 )=n 1 (a 2 ) n 1 out n 1 & & n 2 n 2 out a 1 a 2 11
12 Defntons 2. Dagnoss: Let (SD,COMP) be a dagnoss system and OBS a set of observatons. A set COMP s a dagnoss ff SDUOBSU{ ab(c) CCOMP\ }U{ab(C) C } s consstent. 12
13 Example: AND gates Defntons OBS={n 1 (a 1 )=true n 2 (a 1 )=true n 2 (a 2 )=true out(a 2 )=false} true true n 1 n 2 & a 1 out true n 1 n 2 & out false a 2 13
14 Proposton 1. A dagnoss exsts for (SD,COMP,OBS) OBS) ff SDUOBS s consstent. Proof: If SDUOBS s nconsstent, then obvously t s mpossble for all COMP to fulfll the dagnoss condton. So there exsts no dagnoss. On the other hand f SDUOBS s consstent at least COMP s a dagnoss. 14
15 Proposton 2. {} s a dagnoss for (SD,COMP,OBS) OBS) ff SDUOBSU{ ab(c) CCOMP} s consstent. 3. Every superset of a dagnoss s a dagnoss. 4. If s a dagnoss for (SD,COMP,OBS), then for each C, SDUOBSU{ ab(c) CCOMP\ } ab(c ) 15
16 Proposton Proof: If ={} the result s vacuously. Suppose then that ={C 1,,C k } and that the proposton p s false. Then there exsts a C such that SDUOBSU{ ab(c) CCOMP\ } ab(c ). From the defnton of follows that there must be a logcal Model M L wth the property M L SDUOBSU{ ab(c) CCOMP\ } ab(c ). M L Now we can conclude ab(c ) whch s n M contradcton wth our ntal L assumpton C. 16
17 Proposton 5. s a dagnoss for (SD,COMP,OBS) ff SDUOBSU{ ab(c) CCOMP\ } { ( } s consstent. 17
18 Defnton 3. A conflct set for (SD,COMP,OBS) s a set COCOMP such that SDUOBSU{ ab(c) CCO} s nconsstent. A conflct set s mnmal f no proper subset s a conflct set. 18
19 Proposton 6. COMP s a dagnoss for (SD,COMP,OBS) ff s a mnmal set such that COMP/ s not a conflct set. 19
20 Defnton 4. Suppose C s a collecton of sets. A httng set for C s a set HU SCS such that H SØ for each SC. A httng set s mnmal f no proper subset s a httng set. 20
21 Theorem 7. COMP s a (mnmal) dagnoss for (SD,COMP,OBS) ff s a (mnmal) httng set for the collecton of conflcts set. Proof: (1) By proposton 6 COMP\ s not a conflct set for (SD,COMP,OBS). Hence, every conflct set contans an element of, so that s a httng set for the collecton of conflct sets. (2) We now show that COMP\ s no conflct. If t s a conflct set would not ht t, contradctng the fact that s a httng set. 21
22 Computng Httng Sets F collecton of conflcts 1.Let D represent a growng dag. Generate a node whch wll be the root of the dag. 2.Process the nodes n D n breath-frst order. To process a node n: a. Defne H(n) ) to be the set of edge labels l on the path n D from root to node n. b. If for all xf, x H(n)Ø then label n by. Otherwse, label n by where s the frst member of F whch x H(n)=Ø. c. If n s labeled by a set F, for each σ, generate a new downward arc labeled wth σ. Ths arc leads to a new node m wth H(m)=H(n)U{σ}. The new node m wll be processed after all nodes n the same generaton as n have been processed. 3.Return the resultng dag D. 22
23 Prunng Rules Reusng nodes: Ths algorthm wll not generate a new m as a descendant of node n. There are two cases to consder: 1. If there s a node n n D such that H(n )=H(n) U{σ}, then let the σ-arc under n pont to ths extng node n. Hence, n wll have more than one parent. 2. Otherwse, generate a new node m at the end of ths σ-arc as descrbed n the basc HS-DAG algorthm. Closng: If there s a node n n D whch s labeled by and H(n )H(n) then close the node n. A label s not computed for n nor any successor nodes are generated. 23
24 Prunng Rules Prunng: If the set s to label a node n and t has been used prevously, then attempt to prune D as descrbed n the followng: 1. If there s a node n whch has been labeled by the set S of F where S, then relabel n wth. For any n S \, the edge under n s no longer allowed. The node connected by ths edge and all ts descendants are removed, except those nodes wth another ancestor whch s not beng removed. Note that t ths step may elmnate the node whch h s currently processed. 2. Interchange the sets S and n the collecton. Note that ths has the same effect as elmnatng S from F. 24
25 Example HS-DAG F={{a,b},{b,c},{a,c},{b,d},{b}} {b {a {b {b}} n0: {},{a,b} b n2: {b},{a,c} a c n3: {a,b}, n5: {b,c}, Alexander -- Felferng and Gerald Stenbauer 25
26 Drawback HS-DAG Need to know or compute conflct sets n advance Idea: Compute conflct set ncrementally when they are requred by the HS-DAG algorthm Theorem Prover: TP(SD,CH,OBS) denotes a theorem prover call returnng a (not necessarly mnmal) conflct set f one exsts,.e., SDUOBSU{ ab(c) CCH} s nconsstent, and otherwse. 26
27 Computng Dagnoses Dagnose(SD,COMP,OBS) OBS) 1.Generate a pruned hs-dag D for the collecton F of conflct sets for (SD,COMP;OBS) as descrbed prevously, except that whenever, n the process of generatng D a node n of D needs access to F to compute ts label, label that node by TP(SD,COMP\H(n),OBS). 2.Return {H(n) n s a node of D labeled by }. 27
28 Example 1 Bt Full Adder X1 X2 A1 O1 A2 OBS: A=1, B=0, C n =1, S=1, C out =0 28
29 Example Dagnose n0: {}, TP(SD,COMP,OBS) OBS) {X1,A1,A2,O1} X1 A1 A2 O1 n1: {X1}, TP(SD,COMP/{X1},OBS) n4: {O1}, TP(SD,COMP/{O1},OBS) {X1,X2} X1 X2 n2: {A1}, TP(SD,COMP/{A1},OBS) {X1,X2} X1 n5: {A1,X1}, TP(SD,COMP/{A1,X1},OBS) X2 n3: {A2}, TP(SD,COMP/{A2},OBS) {X1,X2} n6: {A1,X2}, TP(SD,COMP/{A1,X2},OBS) {X1,A2,O1} X1 X2 n7: {A2,X1}, TP(SD,COMP/{A2,X1},OBS) n9: {O1,X1}, TP(SD,COMP/{O1,X1},OBS) OBS) n10: {O1,X2}, TP(SD,COMP/{O1,X2},OBS) n8: {A2,X2}, TP(SD,COMP/{A2,X2},OBS) OBS) 29
30 Conflcts 1 Bt Full Adder X1 X2 C 2 C 1 A1 O1 A2 C 3 30
31 Multple Dagnoss Canddates Problem: How to dstngush between several dagnoses canddates (dscrmnaton)? Idea: Use addtonal measurements? Addtonal measurements e e s are.e. costly. How to select the most valuable addtonal measurement? 31
32 Measurement Selecton Defnton 5: A dagnoss for (SD,COMP,OBS) OBS) predcts ff SDUOBSU{ab(C) C }U{ ab(c) CCOMP\ }.e., on the assumpton that the components of are all faulty, and the remanng components are all functonng normally, the system behavor must hold. Proposton 8: A dagnoss for (SD,COMP,OBS) predcts ff SDUOBSU{ ab(c) CCOMP\ } 32
33 Measurement Selecton Theorem 9: Suppose every dagnoss of (SD,COMP,OBS) predcts one of,. Then: 1. Every dagnoss whch predcts s a dagnoss for (SD,COMP,OBSU{}). 2. No dagnoss whch predcts s a dagnoss for (SD,COMP,OBSU{}). 3. Any dagnoss for (SD,COMP,OBSU{}) whch s not a dagnoss for (SD,COMP,OBS) OBS) s a strct t t superset of some dagnoss for (SD,COMP,OBS) whch predcts. Any new dagnoss resultng from the new measurement wll be a strct superset of some old dagnoss whch predcted. 33
34 Measurement Selecton Corollary 10: Suppose that {} s not a dagnoss for (SD,COMP,OBS). Then under the assumpton of theorem 9, any new dagnoss arsng from the new measurement wll be a multple fault dagnoss. Corollary 11: Suppose that {} s not a dagnoss for (SD,COMP,OBS). OBS) Then under the assumpton of theorem 9, the sngle fault dagnoses for (SD,COMP,OBSU{}) OBSU{ are precsely those of (SD,COMP,OBS) whch predct. 34
35 Example Measurement Selecton a 3 b c d M1 * A f 3 M2 * 5 + A M3 * + f g ={{M1},{A1},{M2,A2},{M2,M3}} {A1} {M2 A2} {M2 M3}} ={{M1M2A2}{M2M3A1}{M2A1A2}} {{M1,M2,A2},{M2,M3,A1},{M2,A1,A2}} 35
36 Next Measurement Pont Gven: dagnoss canddates (mnmal dagnoses and ther superset), fault probabltes for each component p(c), possble measurements x =v k where x denotes the quantty and v k a value. R k canddates whch reman f x s measured to be v be v k S k canddates whch x must be v k U canddates whch do not predct a value for x R k =S k UU and S k U =Ø 36
37 Next Measurement Pont The best measurement s one whch mnmzes the expected entropy of canddate probabltes resultng form measurement: H e ( x ) m k1 p( x v k ) H ( x v k ) where v 1,.,v m are possble values. 1 m p 37
38 Next Measurement Pont p ( x v ) p ( S ),0 p ( U ) m k1 p d k ( ) k p( U C k ), p( S p( C) k ) k S k p (1 C COMP\ d k ( ), p( C)) p( U ) U k p d ( ) Assume: Each v k s equal lkely ff a canddate does not predct a value x,.e., k =p(u )/m 38
39 Next Measurement Pont ) ( ) ( ) / ( ) ( ) ( e e k k x H H x H m U p S p v x p )) ( ln( ) ( ) ( ) ( ) ( k k n e e e v x p v x p x H ) ( ln ) ( )) ( ln( ) ( 1 k k k e U p U p n U p U p values predcted of number ln )) ( ln( ) ( S n m m U p U p )) ( ( mn )) ( ( mn values predcted number of, e e k x H x H S n 39
40 a b c d f 3 Example Measur. Select. M1 * M2 x 1 A * M3 * x 2 x 3 + A f g p(m1)=p(m2)=p(m3)=p(a1)=p(a2)=0.1 (M2) (M3) (A1) (A2) 1 40
41 Dagnoss p( ) x 1 x 2 x 3 M M1,M M1,M2,M3M2 M M1,M2,M3,A M1,M2,M3,A1,A M1,M2,M3,A M1,M2,A M1,M2,A1,A2M2 A M1,M2,A M1,M M1,M3,A M1,M3,A1,A M1,M3,A M1,A M1,A1,A M1,A
42 Dagnoss p( ) x 1 x 2 x 3 A A1,M A1,M2,M A1,M2,M3,A A1,M2,A A1,M A1,M3,A A1,A M2,M M2,M3,A M2,A
43 Lne X p(x) X 1 S 1[4] S 1[6] U X 1 = X 1 = X 2 S 2[4] S 2[6] U X 2 = X 2 = X 3 S 3[6] S 3[8] U X 3 = X 3 =
44 Example Measurement Selecton X 1 X 2 X 3 Entropy
45 Problem Computng Measurements Prevous algorthm fts not for large systems, use of supersets Practcal Soluton Use only computed dagnose canddates, no subersets 45
46 Revsed Algorthm D set of dagnoses for (SD,COMP,OBS) p( x v k where v k ) p d D cond ( ) ( ) SD OBS v,, v undef 1 k ab( C) C COMP H ( x ) p( x vk ) ln( p( x vk )) v k \ ( x v k ) cond( ) Search for mn H(x ) 46
47 Example Measurment Selecton Lne X p(x) X 1 X 1 = X 1 = X 2 X 2 = X 2 = X 3 X 3 = X 3 = X 1 X 2 X 3 Entropy
48 Thank You! Alexander -- Felferng and Gerald Stenbauer 48
On the Multicriteria Integer Network Flow Problem
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 5, No 2 Sofa 2005 On the Multcrtera Integer Network Flow Problem Vassl Vasslev, Marana Nkolova, Maryana Vassleva Insttute of
More informationMath 261 Exercise sheet 2
Math 261 Exercse sheet 2 http://staff.aub.edu.lb/~nm116/teachng/2017/math261/ndex.html Verson: September 25, 2017 Answers are due for Monday 25 September, 11AM. The use of calculators s allowed. Exercse
More informationCollege of Computer & Information Science Fall 2009 Northeastern University 20 October 2009
College of Computer & Informaton Scence Fall 2009 Northeastern Unversty 20 October 2009 CS7880: Algorthmc Power Tools Scrbe: Jan Wen and Laura Poplawsk Lecture Outlne: Prmal-dual schema Network Desgn:
More informationFundamental loop-current method using virtual voltage sources technique for special cases
Fundamental loop-current method usng vrtual voltage sources technque for specal cases George E. Chatzaraks, 1 Marna D. Tortorel 1 and Anastasos D. Tzolas 1 Electrcal and Electroncs Engneerng Departments,
More information6. Stochastic processes (2)
Contents Markov processes Brth-death processes Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 Markov process Consder a contnuous-tme and dscrete-state stochastc process X(t) wth state space
More information6. Stochastic processes (2)
6. Stochastc processes () Lect6.ppt S-38.45 - Introducton to Teletraffc Theory Sprng 5 6. Stochastc processes () Contents Markov processes Brth-death processes 6. Stochastc processes () Markov process
More informationLinear, affine, and convex sets and hulls In the sequel, unless otherwise specified, X will denote a real vector space.
Lnear, affne, and convex sets and hulls In the sequel, unless otherwse specfed, X wll denote a real vector space. Lnes and segments. Gven two ponts x, y X, we defne xy = {x + t(y x) : t R} = {(1 t)x +
More informationHMMT February 2016 February 20, 2016
HMMT February 016 February 0, 016 Combnatorcs 1. For postve ntegers n, let S n be the set of ntegers x such that n dstnct lnes, no three concurrent, can dvde a plane nto x regons (for example, S = {3,
More informationREDUCTION MODULO p. We will prove the reduction modulo p theorem in the general form as given by exercise 4.12, p. 143, of [1].
REDUCTION MODULO p. IAN KIMING We wll prove the reducton modulo p theorem n the general form as gven by exercse 4.12, p. 143, of [1]. We consder an ellptc curve E defned over Q and gven by a Weerstraß
More informationSingular Value Decomposition: Theory and Applications
Sngular Value Decomposton: Theory and Applcatons Danel Khashab Sprng 2015 Last Update: March 2, 2015 1 Introducton A = UDV where columns of U and V are orthonormal and matrx D s dagonal wth postve real
More informationLine Drawing and Clipping Week 1, Lecture 2
CS 43 Computer Graphcs I Lne Drawng and Clppng Week, Lecture 2 Davd Breen, Wllam Regl and Maxm Peysakhov Geometrc and Intellgent Computng Laboratory Department of Computer Scence Drexel Unversty http://gcl.mcs.drexel.edu
More information2.3 Nilpotent endomorphisms
s a block dagonal matrx, wth A Mat dm U (C) In fact, we can assume that B = B 1 B k, wth B an ordered bass of U, and that A = [f U ] B, where f U : U U s the restrcton of f to U 40 23 Nlpotent endomorphsms
More information2E Pattern Recognition Solutions to Introduction to Pattern Recognition, Chapter 2: Bayesian pattern classification
E395 - Pattern Recognton Solutons to Introducton to Pattern Recognton, Chapter : Bayesan pattern classfcaton Preface Ths document s a soluton manual for selected exercses from Introducton to Pattern Recognton
More informationFACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP
C O L L O Q U I U M M A T H E M A T I C U M VOL. 80 1999 NO. 1 FACTORIZATION IN KRULL MONOIDS WITH INFINITE CLASS GROUP BY FLORIAN K A I N R A T H (GRAZ) Abstract. Let H be a Krull monod wth nfnte class
More informationEconomics 101. Lecture 4 - Equilibrium and Efficiency
Economcs 0 Lecture 4 - Equlbrum and Effcency Intro As dscussed n the prevous lecture, we wll now move from an envronment where we looed at consumers mang decsons n solaton to analyzng economes full of
More informationLectures - Week 4 Matrix norms, Conditioning, Vector Spaces, Linear Independence, Spanning sets and Basis, Null space and Range of a Matrix
Lectures - Week 4 Matrx norms, Condtonng, Vector Spaces, Lnear Independence, Spannng sets and Bass, Null space and Range of a Matrx Matrx Norms Now we turn to assocatng a number to each matrx. We could
More information20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The first idea is connectedness.
20. Mon, Oct. 13 What we have done so far corresponds roughly to Chapters 2 & 3 of Lee. Now we turn to Chapter 4. The frst dea s connectedness. Essentally, we want to say that a space cannot be decomposed
More informationPerron Vectors of an Irreducible Nonnegative Interval Matrix
Perron Vectors of an Irreducble Nonnegatve Interval Matrx Jr Rohn August 4 2005 Abstract As s well known an rreducble nonnegatve matrx possesses a unquely determned Perron vector. As the man result of
More informationPerfect Competition and the Nash Bargaining Solution
Perfect Competton and the Nash Barganng Soluton Renhard John Department of Economcs Unversty of Bonn Adenauerallee 24-42 53113 Bonn, Germany emal: rohn@un-bonn.de May 2005 Abstract For a lnear exchange
More informationEEL 6266 Power System Operation and Control. Chapter 3 Economic Dispatch Using Dynamic Programming
EEL 6266 Power System Operaton and Control Chapter 3 Economc Dspatch Usng Dynamc Programmng Pecewse Lnear Cost Functons Common practce many utltes prefer to represent ther generator cost functons as sngle-
More informationChapter 5. Solution of System of Linear Equations. Module No. 6. Solution of Inconsistent and Ill Conditioned Systems
Numercal Analyss by Dr. Anta Pal Assstant Professor Department of Mathematcs Natonal Insttute of Technology Durgapur Durgapur-713209 emal: anta.bue@gmal.com 1 . Chapter 5 Soluton of System of Lnear Equatons
More informationStanford University CS254: Computational Complexity Notes 7 Luca Trevisan January 29, Notes for Lecture 7
Stanford Unversty CS54: Computatonal Complexty Notes 7 Luca Trevsan January 9, 014 Notes for Lecture 7 1 Approxmate Countng wt an N oracle We complete te proof of te followng result: Teorem 1 For every
More informationCombining Constraint Programming and Integer Programming
Combnng Constrant Programmng and Integer Programmng GLOBAL CONSTRAINT OPTIMIZATION COMPONENT Specal Purpose Algorthm mn c T x +(x- 0 ) x( + ()) =1 x( - ()) =1 FILTERING ALGORITHM COST-BASED FILTERING ALGORITHM
More informationExpected Value and Variance
MATH 38 Expected Value and Varance Dr. Neal, WKU We now shall dscuss how to fnd the average and standard devaton of a random varable X. Expected Value Defnton. The expected value (or average value, or
More informationCOMPLEX NUMBERS AND QUADRATIC EQUATIONS
COMPLEX NUMBERS AND QUADRATIC EQUATIONS INTRODUCTION We know that x 0 for all x R e the square of a real number (whether postve, negatve or ero) s non-negatve Hence the equatons x, x, x + 7 0 etc are not
More informationIntroductory Cardinality Theory Alan Kaylor Cline
Introductory Cardnalty Theory lan Kaylor Clne lthough by name the theory of set cardnalty may seem to be an offshoot of combnatorcs, the central nterest s actually nfnte sets. Combnatorcs deals wth fnte
More informationGraph Reconstruction by Permutations
Graph Reconstructon by Permutatons Perre Ille and Wllam Kocay* Insttut de Mathémathques de Lumny CNRS UMR 6206 163 avenue de Lumny, Case 907 13288 Marselle Cedex 9, France e-mal: lle@ml.unv-mrs.fr Computer
More informationEngineering Risk Benefit Analysis
Engneerng Rsk Beneft Analyss.55, 2.943, 3.577, 6.938, 0.86, 3.62, 6.862, 22.82, ESD.72, ESD.72 RPRA 2. Elements of Probablty Theory George E. Apostolaks Massachusetts Insttute of Technology Sprng 2007
More informationThe Geometry of Logit and Probit
The Geometry of Logt and Probt Ths short note s meant as a supplement to Chapters and 3 of Spatal Models of Parlamentary Votng and the notaton and reference to fgures n the text below s to those two chapters.
More information10.34 Numerical Methods Applied to Chemical Engineering Fall Homework #3: Systems of Nonlinear Equations and Optimization
10.34 Numercal Methods Appled to Chemcal Engneerng Fall 2015 Homework #3: Systems of Nonlnear Equatons and Optmzaton Problem 1 (30 ponts). A (homogeneous) azeotrope s a composton of a multcomponent mxture
More informationAPPENDIX A Some Linear Algebra
APPENDIX A Some Lnear Algebra The collecton of m, n matrces A.1 Matrces a 1,1,..., a 1,n A = a m,1,..., a m,n wth real elements a,j s denoted by R m,n. If n = 1 then A s called a column vector. Smlarly,
More informationLecture 17 : Stochastic Processes II
: Stochastc Processes II 1 Contnuous-tme stochastc process So far we have studed dscrete-tme stochastc processes. We studed the concept of Makov chans and martngales, tme seres analyss, and regresson analyss
More informationOn a direct solver for linear least squares problems
ISSN 2066-6594 Ann. Acad. Rom. Sc. Ser. Math. Appl. Vol. 8, No. 2/2016 On a drect solver for lnear least squares problems Constantn Popa Abstract The Null Space (NS) algorthm s a drect solver for lnear
More informationSociété de Calcul Mathématique SA
Socété de Calcul Mathématque SA Outls d'ade à la décson Tools for decson help Probablstc Studes: Normalzng the Hstograms Bernard Beauzamy December, 202 I. General constructon of the hstogram Any probablstc
More informationEvery planar graph is 4-colourable a proof without computer
Peter Dörre Department of Informatcs and Natural Scences Fachhochschule Südwestfalen (Unversty of Appled Scences) Frauenstuhlweg 31, D-58644 Iserlohn, Germany Emal: doerre(at)fh-swf.de Mathematcs Subject
More informationFeature Selection: Part 1
CSE 546: Machne Learnng Lecture 5 Feature Selecton: Part 1 Instructor: Sham Kakade 1 Regresson n the hgh dmensonal settng How do we learn when the number of features d s greater than the sample sze n?
More informationMore metrics on cartesian products
More metrcs on cartesan products If (X, d ) are metrc spaces for 1 n, then n Secton II4 of the lecture notes we defned three metrcs on X whose underlyng topologes are the product topology The purpose of
More informationGeneralized Linear Methods
Generalzed Lnear Methods 1 Introducton In the Ensemble Methods the general dea s that usng a combnaton of several weak learner one could make a better learner. More formally, assume that we have a set
More informationVolume 18 Figure 1. Notation 1. Notation 2. Observation 1. Remark 1. Remark 2. Remark 3. Remark 4. Remark 5. Remark 6. Theorem A [2]. Theorem B [2].
Bulletn of Mathematcal Scences and Applcatons Submtted: 016-04-07 ISSN: 78-9634, Vol. 18, pp 1-10 Revsed: 016-09-08 do:10.1805/www.scpress.com/bmsa.18.1 Accepted: 016-10-13 017 ScPress Ltd., Swtzerland
More informationLinear Regression Analysis: Terminology and Notation
ECON 35* -- Secton : Basc Concepts of Regresson Analyss (Page ) Lnear Regresson Analyss: Termnology and Notaton Consder the generc verson of the smple (two-varable) lnear regresson model. It s represented
More informationa b a In case b 0, a being divisible by b is the same as to say that
Secton 6.2 Dvsblty among the ntegers An nteger a ε s dvsble by b ε f there s an nteger c ε such that a = bc. Note that s dvsble by any nteger b, snce = b. On the other hand, a s dvsble by only f a = :
More informationMMA and GCMMA two methods for nonlinear optimization
MMA and GCMMA two methods for nonlnear optmzaton Krster Svanberg Optmzaton and Systems Theory, KTH, Stockholm, Sweden. krlle@math.kth.se Ths note descrbes the algorthms used n the author s 2007 mplementatons
More informationfind (x): given element x, return the canonical element of the set containing x;
COS 43 Sprng, 009 Dsjont Set Unon Problem: Mantan a collecton of dsjont sets. Two operatons: fnd the set contanng a gven element; unte two sets nto one (destructvely). Approach: Canoncal element method:
More informationHomework Assignment 3 Due in class, Thursday October 15
Homework Assgnment 3 Due n class, Thursday October 15 SDS 383C Statstcal Modelng I 1 Rdge regresson and Lasso 1. Get the Prostrate cancer data from http://statweb.stanford.edu/~tbs/elemstatlearn/ datasets/prostate.data.
More informationLecture 5 Decoding Binary BCH Codes
Lecture 5 Decodng Bnary BCH Codes In ths class, we wll ntroduce dfferent methods for decodng BCH codes 51 Decodng the [15, 7, 5] 2 -BCH Code Consder the [15, 7, 5] 2 -code C we ntroduced n the last lecture
More informationAppendix B. The Finite Difference Scheme
140 APPENDIXES Appendx B. The Fnte Dfference Scheme In ths appendx we present numercal technques whch are used to approxmate solutons of system 3.1 3.3. A comprehensve treatment of theoretcal and mplementaton
More informationn α j x j = 0 j=1 has a nontrivial solution. Here A is the n k matrix whose jth column is the vector for all t j=0
MODULE 2 Topcs: Lnear ndependence, bass and dmenson We have seen that f n a set of vectors one vector s a lnear combnaton of the remanng vectors n the set then the span of the set s unchanged f that vector
More informationChapter 1. Probability
Chapter. Probablty Mcroscopc propertes of matter: quantum mechancs, atomc and molecular propertes Macroscopc propertes of matter: thermodynamcs, E, H, C V, C p, S, A, G How do we relate these two propertes?
More information8.1 Arc Length. What is the length of a curve? How can we approximate it? We could do it following the pattern we ve used before
.1 Arc Length hat s the length of a curve? How can we approxmate t? e could do t followng the pattern we ve used before Use a sequence of ncreasngly short segments to approxmate the curve: As the segments
More informationThe Minimum Universal Cost Flow in an Infeasible Flow Network
Journal of Scences, Islamc Republc of Iran 17(2): 175-180 (2006) Unversty of Tehran, ISSN 1016-1104 http://jscencesutacr The Mnmum Unversal Cost Flow n an Infeasble Flow Network H Saleh Fathabad * M Bagheran
More informationProblem Set 9 Solutions
Desgn and Analyss of Algorthms May 4, 2015 Massachusetts Insttute of Technology 6.046J/18.410J Profs. Erk Demane, Srn Devadas, and Nancy Lynch Problem Set 9 Solutons Problem Set 9 Solutons Ths problem
More informationLECTURE V. 1. More on the Chinese Remainder Theorem We begin by recalling this theorem, proven in the preceeding lecture.
LECTURE V EDWIN SPARK 1. More on the Chnese Remander Theorem We begn by recallng ths theorem, proven n the preceedng lecture. Theorem 1.1 (Chnese Remander Theorem). Let R be a rng wth deals I 1, I 2,...,
More informationStatistical pattern recognition
Statstcal pattern recognton Bayes theorem Problem: decdng f a patent has a partcular condton based on a partcular test However, the test s mperfect Someone wth the condton may go undetected (false negatve
More informationMAT 578 Functional Analysis
MAT 578 Functonal Analyss John Qugg Fall 2008 Locally convex spaces revsed September 6, 2008 Ths secton establshes the fundamental propertes of locally convex spaces. Acknowledgment: although I wrote these
More informationInner Product. Euclidean Space. Orthonormal Basis. Orthogonal
Inner Product Defnton 1 () A Eucldean space s a fnte-dmensonal vector space over the reals R, wth an nner product,. Defnton 2 (Inner Product) An nner product, on a real vector space X s a symmetrc, blnear,
More information763622S ADVANCED QUANTUM MECHANICS Solution Set 1 Spring c n a n. c n 2 = 1.
7636S ADVANCED QUANTUM MECHANICS Soluton Set 1 Sprng 013 1 Warm-up Show that the egenvalues of a Hermtan operator  are real and that the egenkets correspondng to dfferent egenvalues are orthogonal (b)
More informationThe Expectation-Maximization Algorithm
The Expectaton-Maxmaton Algorthm Charles Elan elan@cs.ucsd.edu November 16, 2007 Ths chapter explans the EM algorthm at multple levels of generalty. Secton 1 gves the standard hgh-level verson of the algorthm.
More informationLecture 3: Probability Distributions
Lecture 3: Probablty Dstrbutons Random Varables Let us begn by defnng a sample space as a set of outcomes from an experment. We denote ths by S. A random varable s a functon whch maps outcomes nto the
More informationOn the Operation A in Analysis Situs. by Kazimierz Kuratowski
v1.3 10/17 On the Operaton A n Analyss Stus by Kazmerz Kuratowsk Author s note. Ths paper s the frst part slghtly modfed of my thess presented May 12, 1920 at the Unversty of Warsaw for the degree of Doctor
More informationModule 3 LOSSY IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module 3 LOSSY IMAGE COMPRESSION SYSTEMS Verson ECE IIT, Kharagpur Lesson 6 Theory of Quantzaton Verson ECE IIT, Kharagpur Instructonal Objectves At the end of ths lesson, the students should be able to:
More informationMatrix Approximation via Sampling, Subspace Embedding. 1 Solving Linear Systems Using SVD
Matrx Approxmaton va Samplng, Subspace Embeddng Lecturer: Anup Rao Scrbe: Rashth Sharma, Peng Zhang 0/01/016 1 Solvng Lnear Systems Usng SVD Two applcatons of SVD have been covered so far. Today we loo
More informationBayesian predictive Configural Frequency Analysis
Psychologcal Test and Assessment Modelng, Volume 54, 2012 (3), 285-292 Bayesan predctve Confgural Frequency Analyss Eduardo Gutérrez-Peña 1 Abstract Confgural Frequency Analyss s a method for cell-wse
More informationNotes on Frequency Estimation in Data Streams
Notes on Frequency Estmaton n Data Streams In (one of) the data streamng model(s), the data s a sequence of arrvals a 1, a 2,..., a m of the form a j = (, v) where s the dentty of the tem and belongs to
More informationFoundations of Arithmetic
Foundatons of Arthmetc Notaton We shall denote the sum and product of numbers n the usual notaton as a 2 + a 2 + a 3 + + a = a, a 1 a 2 a 3 a = a The notaton a b means a dvdes b,.e. ac = b where c s an
More informationProblem Do any of the following determine homomorphisms from GL n (C) to GL n (C)?
Homework 8 solutons. Problem 16.1. Whch of the followng defne homomomorphsms from C\{0} to C\{0}? Answer. a) f 1 : z z Yes, f 1 s a homomorphsm. We have that z s the complex conjugate of z. If z 1,z 2
More informationG4023 Mid-Term Exam #1 Solutions
Exam1Solutons.nb 1 G03 Md-Term Exam #1 Solutons 1-Oct-0, 1:10 p.m to :5 p.m n 1 Pupn Ths exam s open-book, open-notes. You may also use prnt-outs of the homework solutons and a calculator. 1 (30 ponts,
More informationCHAPTER 4 MAX-MIN AVERAGE COMPOSITION METHOD FOR DECISION MAKING USING INTUITIONISTIC FUZZY SETS
56 CHAPER 4 MAX-MIN AVERAGE COMPOSIION MEHOD FOR DECISION MAKING USING INUIIONISIC FUZZY SES 4.1 INRODUCION Intutonstc fuzz max-mn average composton method s proposed to construct the decson makng for
More informationprinceton univ. F 17 cos 521: Advanced Algorithm Design Lecture 7: LP Duality Lecturer: Matt Weinberg
prnceton unv. F 17 cos 521: Advanced Algorthm Desgn Lecture 7: LP Dualty Lecturer: Matt Wenberg Scrbe: LP Dualty s an extremely useful tool for analyzng structural propertes of lnear programs. Whle there
More informationOutline and Reading. Dynamic Programming. Dynamic Programming revealed. Computing Fibonacci. The General Dynamic Programming Technique
Outlne and Readng Dynamc Programmng The General Technque ( 5.3.2) -1 Knapsac Problem ( 5.3.3) Matrx Chan-Product ( 5.3.1) Dynamc Programmng verson 1.4 1 Dynamc Programmng verson 1.4 2 Dynamc Programmng
More informationLearning Theory: Lecture Notes
Learnng Theory: Lecture Notes Lecturer: Kamalka Chaudhur Scrbe: Qush Wang October 27, 2012 1 The Agnostc PAC Model Recall that one of the constrants of the PAC model s that the data dstrbuton has to be
More informationCS 331 DESIGN AND ANALYSIS OF ALGORITHMS DYNAMIC PROGRAMMING. Dr. Daisy Tang
CS DESIGN ND NLYSIS OF LGORITHMS DYNMIC PROGRMMING Dr. Dasy Tang Dynamc Programmng Idea: Problems can be dvded nto stages Soluton s a sequence o decsons and the decson at the current stage s based on the
More informationLecture 4: November 17, Part 1 Single Buffer Management
Lecturer: Ad Rosén Algorthms for the anagement of Networs Fall 2003-2004 Lecture 4: November 7, 2003 Scrbe: Guy Grebla Part Sngle Buffer anagement In the prevous lecture we taled about the Combned Input
More information3.1 Expectation of Functions of Several Random Variables. )' be a k-dimensional discrete or continuous random vector, with joint PMF p (, E X E X1 E X
Statstcs 1: Probablty Theory II 37 3 EPECTATION OF SEVERAL RANDOM VARIABLES As n Probablty Theory I, the nterest n most stuatons les not on the actual dstrbuton of a random vector, but rather on a number
More informationGravitational Acceleration: A case of constant acceleration (approx. 2 hr.) (6/7/11)
Gravtatonal Acceleraton: A case of constant acceleraton (approx. hr.) (6/7/11) Introducton The gravtatonal force s one of the fundamental forces of nature. Under the nfluence of ths force all objects havng
More informationCS286r Assign One. Answer Key
CS286r Assgn One Answer Key 1 Game theory 1.1 1.1.1 Let off-equlbrum strateges also be that people contnue to play n Nash equlbrum. Devatng from any Nash equlbrum s a weakly domnated strategy. That s,
More informationComplete subgraphs in multipartite graphs
Complete subgraphs n multpartte graphs FLORIAN PFENDER Unverstät Rostock, Insttut für Mathematk D-18057 Rostock, Germany Floran.Pfender@un-rostock.de Abstract Turán s Theorem states that every graph G
More informationDrago{ CVETKOVI] Mirjana ^ANGALOVI] 1. INTRODUCTION
Yugoslav Journal of Operatons Research 12 (2002), Number 1, 1-10 FINDING MINIMAL BRANCHINGS WITH A GIVEN NUMBER OF ARCS Drago{ CVETKOVI] Faculty of Electrcal Engneerng Unversty of Belgrade, Belgrade, Yugoslava
More informationReport on Image warping
Report on Image warpng Xuan Ne, Dec. 20, 2004 Ths document summarzed the algorthms of our mage warpng soluton for further study, and there s a detaled descrpton about the mplementaton of these algorthms.
More informationA new construction of 3-separable matrices via an improved decoding of Macula s construction
Dscrete Optmzaton 5 008 700 704 Contents lsts avalable at ScenceDrect Dscrete Optmzaton journal homepage: wwwelsevercom/locate/dsopt A new constructon of 3-separable matrces va an mproved decodng of Macula
More informationSome Consequences. Example of Extended Euclidean Algorithm. The Fundamental Theorem of Arithmetic, II. Characterizing the GCD and LCM
Example of Extended Eucldean Algorthm Recall that gcd(84, 33) = gcd(33, 18) = gcd(18, 15) = gcd(15, 3) = gcd(3, 0) = 3 We work backwards to wrte 3 as a lnear combnaton of 84 and 33: 3 = 18 15 [Now 3 s
More informationPolynomial Regression Models
LINEAR REGRESSION ANALYSIS MODULE XII Lecture - 6 Polynomal Regresson Models Dr. Shalabh Department of Mathematcs and Statstcs Indan Insttute of Technology Kanpur Test of sgnfcance To test the sgnfcance
More informationBe true to your work, your word, and your friend.
Chemstry 13 NT Be true to your work, your word, and your frend. Henry Davd Thoreau 1 Chem 13 NT Chemcal Equlbrum Module Usng the Equlbrum Constant Interpretng the Equlbrum Constant Predctng the Drecton
More informationModule 9. Lecture 6. Duality in Assignment Problems
Module 9 1 Lecture 6 Dualty n Assgnment Problems In ths lecture we attempt to answer few other mportant questons posed n earler lecture for (AP) and see how some of them can be explaned through the concept
More informationTransfer Functions. Convenient representation of a linear, dynamic model. A transfer function (TF) relates one input and one output: ( ) system
Transfer Functons Convenent representaton of a lnear, dynamc model. A transfer functon (TF) relates one nput and one output: x t X s y t system Y s The followng termnology s used: x y nput output forcng
More informationA 2D Bounded Linear Program (H,c) 2D Linear Programming
A 2D Bounded Lnear Program (H,c) h 3 v h 8 h 5 c h 4 h h 6 h 7 h 2 2D Lnear Programmng C s a polygonal regon, the ntersecton of n halfplanes. (H, c) s nfeasble, as C s empty. Feasble regon C s unbounded
More informationLecture 7: Gluing prevarieties; products
Lecture 7: Glung prevaretes; products 1 The category of algebrac prevaretes Proposton 1. Let (f,ϕ) : (X,O X ) (Y,O Y ) be a morphsm of algebrac prevaretes. If U X and V Y are affne open subvaretes wth
More informationDIFFERENTIAL FORMS BRIAN OSSERMAN
DIFFERENTIAL FORMS BRIAN OSSERMAN Dfferentals are an mportant topc n algebrac geometry, allowng the use of some classcal geometrc arguments n the context of varetes over any feld. We wll use them to defne
More informationWeek3, Chapter 4. Position and Displacement. Motion in Two Dimensions. Instantaneous Velocity. Average Velocity
Week3, Chapter 4 Moton n Two Dmensons Lecture Quz A partcle confned to moton along the x axs moves wth constant acceleraton from x =.0 m to x = 8.0 m durng a 1-s tme nterval. The velocty of the partcle
More information10-701/ Machine Learning, Fall 2005 Homework 3
10-701/15-781 Machne Learnng, Fall 2005 Homework 3 Out: 10/20/05 Due: begnnng of the class 11/01/05 Instructons Contact questons-10701@autonlaborg for queston Problem 1 Regresson and Cross-valdaton [40
More informationCHAPTER 17 Amortized Analysis
CHAPTER 7 Amortzed Analyss In an amortzed analyss, the tme requred to perform a sequence of data structure operatons s averaged over all the operatons performed. It can be used to show that the average
More informationThe Multiple Classical Linear Regression Model (CLRM): Specification and Assumptions. 1. Introduction
ECONOMICS 5* -- NOTE (Summary) ECON 5* -- NOTE The Multple Classcal Lnear Regresson Model (CLRM): Specfcaton and Assumptons. Introducton CLRM stands for the Classcal Lnear Regresson Model. The CLRM s also
More informationLecture 16 Statistical Analysis in Biomaterials Research (Part II)
3.051J/0.340J 1 Lecture 16 Statstcal Analyss n Bomaterals Research (Part II) C. F Dstrbuton Allows comparson of varablty of behavor between populatons usng test of hypothess: σ x = σ x amed for Brtsh statstcan
More informationand problem sheet 2
-8 and 5-5 problem sheet Solutons to the followng seven exercses and optonal bonus problem are to be submtted through gradescope by :0PM on Wednesday th September 08. There are also some practce problems,
More informationA TRACTABLE APPROACH TO PROBABILISTICALLY ACCURATE MODE ESTIMATION
1 A TRACTABLE APPROACH TO PROBABILISTICALLY ACCURATE MODE ESTIMATION Olver B. Martn, Seung H. Chung, and Bran C. Wllams Computer Scence and Artfcal Intellgence Laboratory Massachusetts Insttute of Technology
More informationAffine transformations and convexity
Affne transformatons and convexty The purpose of ths document s to prove some basc propertes of affne transformatons nvolvng convex sets. Here are a few onlne references for background nformaton: http://math.ucr.edu/
More informationÉCOLE POLYTECHNIQUE FÉDÉRALE DE LAUSANNE
ÉCOLE POLYTECHNIQUE FÉDÉRALE DE LAUSANNE School of Computer and Communcaton Scences Handout 0 Prncples of Dgtal Communcatons Solutons to Problem Set 4 Mar. 6, 08 Soluton. If H = 0, we have Y = Z Z = Y
More informationPhysics 5153 Classical Mechanics. Principle of Virtual Work-1
P. Guterrez 1 Introducton Physcs 5153 Classcal Mechancs Prncple of Vrtual Work The frst varatonal prncple we encounter n mechancs s the prncple of vrtual work. It establshes the equlbrum condton of a mechancal
More informationKernel Methods and SVMs Extension
Kernel Methods and SVMs Extenson The purpose of ths document s to revew materal covered n Machne Learnng 1 Supervsed Learnng regardng support vector machnes (SVMs). Ths document also provdes a general
More informationStructure and Drive Paul A. Jensen Copyright July 20, 2003
Structure and Drve Paul A. Jensen Copyrght July 20, 2003 A system s made up of several operatons wth flow passng between them. The structure of the system descrbes the flow paths from nputs to outputs.
More informationOn the set of natural numbers
On the set of natural numbers by Jalton C. Ferrera Copyrght 2001 Jalton da Costa Ferrera Introducton The natural numbers have been understood as fnte numbers, ths wor tres to show that the natural numbers
More information