The Coin Algebra and Conditional Independence

Size: px
Start display at page:

Download "The Coin Algebra and Conditional Independence"

Transcription

1 The Coin lgebra and Conditional Independence Jinfang Wang Graduate School of Science and Technology, Chiba University conditional in dependence Kyoto University, p.1/81

2 Multidisciplinary Field Statisticians:.P. Dawid (1979, 1980, 2001), S.L. Lauritzen (1996), etc. rtificial intelligence: J. Pearl and. Paz (1987), J. Pearl (1988, 2000), etc. nalytic philosophers: W. Spohn (1980, 1988), etc. nd more... Kyoto University, p.2/81

3 ! Dd 1 = f! 1; ;! d 1 g What Is a Statistical Model? Random vector:! D = (! 1 ;! 2 ; ;! d ) Joint pdf: f (! D ) = f (! 1 ) f (! 2 j! D1 ) f (! 3 j! D2 ) f (! d j! Dd 1 ) (1) where D1 =! 1! D2 = f! 1 ;! 2 g!. Kyoto University, p.3/81

4 >< >:! 2! 1 Independent Model Joint pdf: f (! D ) = f (! 1 ) f (! 2 ) f (! d ) (2) Underlying assumption: f (! i j! Di 1 ) = f (! i), i.e. 3 (! 1 ;! 2 )!. (3) 8! d (! 1 ;! 2 ; ;! d 1 ) Equivalent condition Kyoto University, p.4/81!! B (4)

5 ! d (! 1 ; ;! d 2 )j! d 1 Markov Chain Joint pdf: f (! D ) = f (! 1 ) f (! 2 j! 1 ) f (! 3 j! 2 ) f (! d j! d 1 ) (5) Markov property: f (! i j! Di 1 ) = f (! ij! i 1 ), i.e. 3 (! 1 ;! 2 )j! 2!. Kyoto University, p.5/81

6 >< >:! 2! 1 j! 0! d (! 1 ;! 2 ; ;! d 1 )j! 0 Bayesian Model Joint pdf: f (! D ) = f (! 0 ) f (! 1 j! 0 ) f (! 2 j! 0 ) f (! d j! 0 ) (6) Underlying assumption: 3 (! 1 ;! 2 )j! 0!. (7) 8 Equivalent conditions:!! B j! 0 (8) Kyoto University, p.6/81

7 1 Φ Ω ff! Ω Ωffi Ψ Ω 3 ff! Φ Ψ Ω JJ] ff! 2 ny 4 Φ Ω ff! Ω Ωffi Ψ Ω 6 ff! Φ Ψ Ω JJ] ff! 5 3n ff! Φ Ψ Ω Ω Ω Ωffi JJ] Regression model Regression model: Joint pdf: y i = fi x i + ffl i ; i = 1; ; n f (! D ) = ff (! 3i 1 )f (! 3i 2 )f (! 3n j! 3i 1 ;! 3i 2 )g i=1 Graphical representation: J J J Kyoto University, p.7/81 3n 1 ff! ff!3n 2 Ω Φ Ψ Ω Φ Ψ Φ ΨΩ Φ Ψ Ω

8 ff! 1 Φ Ψ -! 3 ff Ω Φ Ψ ff! Ω 2 Φ Ψ Ω ny -!5 ff Φ Ψ - ff! Ω 4 -!2n 1 ff R(1) Model R(1) model: Joint pdf: y t = y t 1 + ffl t ; i = 2; ; n f (! D ) = f (! 1 ) Φ f (!2(i 1) )f (! 2i 1 j! 2i 3 ;! 2(i 1) )Ψ i=1 Graphical representation: 6 6 Φ Ψ 6 Ω Ω Φ Ψ 2(n 1)! Kyoto University, p.8/81

9 ny State Space Model Random walk plus noise model: Joint pdf: t + t = ffl t y t 1; = ; n (9) t + t 1 = t f (! D ) = f (! 4t 3 )f (! 4t 2 )f (! 4t 1 j! 4t 5 ;! 4t 3 )f (! 4t j! 4t 2 ;! t=1 f (! 0 ) Kyoto University, p.9/81

10 0 ff! Φ Ψ - Ω 2 ff! Φ Ψ Ω ff! 4 ff! 3 1 ff! Φ Ψ Ω 6 ff! Φ Ψ Ω ff! 8 7 ff! Φ Ψ Ω 5 ff! Φ Ψ Ω 4n 2 ff! Φ Ψ Ω 4n ff! Ω 4n 1 ff! Ω 4n 3 ff! Φ Ψ Ω State Space Model Graphical representation:??? Φ Ψ Ω Φ Ψ - Φ Ψ Ω Φ Ψ 6 Ω Φ Ψ 6 6 ff - - Ω Φ Ψ Kyoto University, p.10/81

11 RM Model The reticular action model (Mcrdle 1980) : v = v + μ (10) where = (a ij ) is a p p matrix of coefficients Notation: i = fj j 8j; a ij 6= 0g Note that by i 62 definition, i. Join pdf: py f (! i j! i )f (! p+i ) (11) f (! D ) = i=1 Kyoto University, p.11/81

12 The Coin conditional in dependence Kyoto University, p.12/81

13 Notations Reference set: D = f1; 2; ; dg, d 1 = (! i1 ; ;! ir ) for any = fi 1 ; ; i r g ρ D.In!! particular, =! i fig! and = (! 1 ; ;! d D ). (! ), f (! B ), f (! j! B ), f (! B j! ) are well defined for f any ; B ρ D disjoint. D = fdjd ρ D g: power set of D D Ω D: exclusive direct product of D and D, that is D Ω D = f(r; L) j R; L 2 D and R L = ;g Kyoto University, p.13/81

14 The Coin Operator DEFINITION 1(COIN OPERTOR). The coin operator, denoted by, is a binary operator defined on the exclusive direct product D Ω D space to the posive real : D Ω D! R line,.for + L) 2 D Ω D, we shall write R L (reads as coin-r-l) instead (R; (R; L) of to denote the image (R; L) of by. The coin operator satisfies the following axioms. ; Normalization xiom: (12) 1 = ; R L Coditionality xiom: L R 6= ; (13) Inversion xiom: = RL = 1 (14) L L where R R ; and L ; L Note that ; = ; = 1 : and RL = R [ L. Kyoto University, p.14/81

15 tom Coins DEFINITION 2(TOM COINS). For (R; L) 2 D Ω any D, we shall R L call (reads as coin-r-l) the atom coin with raising R index and lowering index L. DEFINITION 3(RISING, LOWERING, MIXED COINS). We classify the atom coins into three types. (i) Raising coin: is called a raising coin with raising index R R. (ii) L Lowering coin: is called a lowering coin with lowering index L. R (iii) L Mixed coin: is called a mixed coin with R raising index and lowering index L. Kyoto University, p.15/81

16 1 ; 2 ; 12 ; 1; 2; 12; 1 ; Example EXMPLE 1. d = 2 Let D so They are = f1; 2g. There are 9 atom coins. where we have used the shorthand notations 1 ; f1g ; f1;2g ; 1;, etc. f1g f2g 12 ; 1 for 2 Kyoto University, p.16/81

17 L R R L = R = L L R = RL = RL L R R = R L : Kyoto University, p.17/81 Bayes Theorem In terms of pdf: f (! R j! L ) = f (! L j! R )f (! R )f 1 (! L ) In terms of coins: If R 6= ;; L 6= ; and R L = ;, then R L (15) Proof. RL R R L L

18 R R 2 1 = 2 L L 1 Definition of Coin DEFINITION 4(COIN). coin,, is a product of an arbitrary finite sequence of the atom coins. That is, there exist i ; L i ) 2 D Ω D; i = 1; ; r such that (R r R r (16) L (D) D The set of all coins will be denoted by or simply by when is clear from the context. Kyoto University, p.18/81

19 Coin Group D = f1; = R n ( ) n n.ifn ( ) n jnj n n = = THEOREM 1(COIN GROUP). The set of all coins forms a commutative (belian) group with respect to the usual multiplication of real numbers. We call the coin group. EXMPLE 2. Let 2g. Let be the set of all coins. Let be a raising coin. If is a positive integer then we denote by the product of copies of is a negative integer then we denote by the product of copies of 0, welet 1. Then can be written as R. When Φ( 1 ) n1 ( 2 ) n2 ( 12 ) n 3 j n 1 ; n 2 ; n 3 = 0; ±1; ±2; Ψ = Kyoto University, p.19/81

20 B = BC C R L The Raising-up Law (L-Law) THEOREM 2(RISING-UP LW). (i) For (R; L) 2 D Ω any D, we have 6= ;) (17) (R RL = L (ii) If ; B; C are mutually exclusive then we have B, BC = B C ( 6= ;) (18) Kyoto University, p.20/81

21 The Lowering-down law (L-Law) THEOREM 3(LOWERING-DOWN LW). (i) For any (R; L) 2 D Ω D, we have R = RL L (R 6= ;) (19) L (ii) If ; B; C are mutually exclusive then we have = BC B B, BC = B C ( 6= ;) (20) C Kyoto University, p.21/81

22 Valley Change Lemma LEMM 1(VLLEY CHNGE). Let ; B; C; D be mutually disjoint subsets of D, then BC = BD [D ] () C B = D B [D ] (21) where [D ] is an arbitrary coin. Kyoto University, p.22/81

23 1 B = = = B B B B B 1 B 3 = 2 = B 1 B 2 B 2 B 2 B 1 B 1 Expressions Expression: For any 2 there exists ( i ; B i ) 2 D Ω D; i = 1; ; r so that r r (22) B Nonuniqueness of expression: suppose that D = 1 t 2 = B 1 t B 2 t B 3. Then we can write D in many different ways such as D D Kyoto University, p.23/81

24 D ; Mutually Prime Coins DEFINITION 5(MUTULLY PRIME COINS). Two raising coins and with 6= ;; B 6= ; are said to be mutually prime,if B 6= B. EXMPLE 3. D Let Then = t B t C and none of ; B; C is empty. are mutually prime coins. ; B ; C ; C Kyoto University, p.24/81

25 Prime Coin and the Null Model THEOREM 4. Let 1 6= 2 be an arbitrary coin. Then there exists nonzero integers n 1 ; ; n r and mutually prime coins i ; i = 1; ; r such that the following holds = ( 1 ) n 1 ( r ) n r (23) DEFINITION 6(PRIME COIN). raising coin prime coin if there does not exist an expression is called a = ( 1 ) n 1 ( r ) n r so that each ; i = 1; ; r i is a proper subset of. DEFINITION 7(NULL MODEL). coin = (D ) group is called a null model if every raising coin is a prime coin. Kyoto University, p.25/81

26 Canonical Expression THEOREM 5. Every coin 2 has a unique expression = ( 1 ) n 1 ( r ) n r (24) where n 1 ; ; n r are nonzero integers and (i) 1 ; r are prime coins; and ; (ii) 1 r ; are mutually prime. ; DEFINITION 8(CNONICL EXPRESSION). The unique expression of a coin given above is called a canonical expression of. nd we call (i) the order of, j j = and write r; r and (ii) [ [ r 1 the index set, or simply the index,of, = ) = and I( write. Kyoto University, p.26/81

27 Property of Index THEOREM 6. The index I( ) has the following properties. (i) I( ) = I( 1 ); (ii) sub-additivity: I( ^) ρ I( ) [ I(^). Kyoto University, p.27/81

28 3 2 1 = Example Let D = 1 t 2 t t w, where i 6= ;; i = 1; ; w. (i) By applying the R-Law sequentially to the right hand side of w 1 w 1 we can see that = D.Soj j = 1 and I( ) = D. (ii) = 1 Similarly, if 2 = 1 1 then 2 j = 1 and,soj 1 t 2. = ) I( Kyoto University, p.28/81

29 = = 1 2 ( 2 ) = 2 ) j j = Example, ctd. (iii) The = 1 mixed coin 2, by the C-xiom, can be expressed as where 1 2 and 2 are mutually prime. So j j = 2 and I( ) = 1 t 2. = have (iv) Let, then by the Bayes theorem we (v) In general, while raising and lowering coins have order 1, mixed coins have order 2. Kyoto University, p.29/81

30 Coin Integration {, B} d Kyoto University, p.30/81

31 Notation NOTTION 1. Let be a subset of D. [] (i) denotes the raising coin in with raising index. (ii) denotes an arbitrary coin restricted to, the coin group with respect to. (iii) fg denotes an arbitrary coin in with index I( fg) equal to. Note that I( ) = I( fg) = and I( []) ρ. Kyoto University, p.31/81

32 1 ; ( 1 ) 2 ; 2; 2 = f1g 1 ; 12 2 Example Let D = f1; 2; 3g ; = f1; 2g. (i) = 12, where 12 = f1;2g. (ii) is the collection of []. Examples of [] include where 1 = f1g ; 1; proper subset of appears in 1; 1 f2g, etc. Note that only a 1 ; 2 Kyoto University, p.32/81

33 1 2 ; 12 2 Example, ctd. (iii) The following coins ; 12 ; 1 are examples of fg. ll these coins have as their index set. For example, if we = let 1 2 1, then 2 = 12 ( 2 ) 1 12 ( 1 ) 1 = ( 12 ) 2 ( 1 ) 1 ( 2 ) 1 so j j = 3, and I( ) = f1; 2g =. Kyoto University, p.33/81

34 Integrand DEFINITION 9(INTEGRND). Let D be the power set of D. Let 2 D. We denote by () the set of all coins fbg of such that is a subset of B, that is = f fbg j ρ B 2 Dg () We shall call fbg 2 () any an integrand with respect to, or simply an -integrand. The set of () coins will be referred to as the -integrand set. Kyoto University, p.34/81

35 Definition of Integration D Let () and be the -integrand set. We define the 2 -integration, or simply integration, as a function, denoted by, from () into, R Z : ()! so that for any -integrand fbg 2 (), there is a unique coin fb n g 2 such that Z ( fbg) = fb n g (25) The following properties hold for the integration. Kyoto University, p.35/81

36 Definition of Integration, ctd. (i) If B is an -integrand then B Z = Bn (26) (ii) Let = 1 t 2. Let fbg = fb 1 g fb 2 g be an -integrand, fb 1 g be an 1 -integrand, fb 2 g be an 2 -integrand, and 1 B 2 = 2 B 1 = ;. Z Z ( fbg) = 1 t 2 ( fb 1 g fb 2 g) = 1 ( fb 1 g) Z 2 ( fb 2 g) (27) Z (iii) Finally, for any coin 2 : R ; ( ) = Kyoto University, p.36/81

37 d; = fb 1 gd 1 Z fb 2 gd 2 Notation Coin integration: Z Z d ( ) = Properties of the coin integration: Z B d = Bn Z Z ( fb 1 g fb 2 g) d 1 t 2 = Z Kyoto University, p.37/81

38 Property of Integration THEOREM 7. fbg Let be an -integrand. Suppose that C = ;. The we have Z fbg d (28) Z [C] fbg d = [C] Proof. Since C = B ; = ;, so Z Z [C] fbg d = [C] fbg d t ; Z Z = [C] d; fbg d Z = [C] fbg d Kyoto University, p.38/81

39 R L Property of Integration THEOREM 8. For any R ρ D we have Z R dr = 1 (29) THEOREM 9. For any (R; L) 2 D Ω D with R 6= ; we have Z dr = 1 (R 6= ;) (30) Kyoto University, p.39/81

40 Property of Integration THEOREM 10. If ; B; C; D are exclusive subsets of D, then we have Z B db = [] (31) [] Z BC dc = [] B (32) [] BC dc = [D] B (33) Z [D] B db = C ( 6= ;) (34) C Z Kyoto University, p.40/81

41 B = [ μ B] [ μ ] ) B = B : Law of Normalization (N-Law) THEOREM 11. (i) Let μ B = D n B and [ μ B] 2 μb, then = [ μ B] ) B = ( 6= ;) (35) B (ii) Let 6= ;, and ; B; C be mutually exclusive, then = [ μ C] ) BC = B ( 6= ;) (36) BC (iii) If ; B; C are mutually exclusive then BC [ μ B] [ μ ] ) B C = C = B (37) C In particular, Kyoto University, p.41/81

42 B = C C B ) ab C = a C C b C j C Law of Marginalization (M-Law) THEOREM 12. If ; B; C are exclusive subsets of D. Then we have In particular, we have ; 8a ρ ; 8b ρ B (38) B = B ) ab = a b ; 8a ρ ; 8b ρ B (39) B = C C B ) ij C = i C C ; 8i 2 ; 8j 2 B (40) THEOREM 13. ; B; C If are mutually exclusive, [ and C] denote a coin independent of C, then μ BC = [ μ C] BC ) B = [ μ C] B (41) Kyoto University, p.42/81

43 Independence B / B B B / Kyoto University, p.43/81

44 Marginal Coin Group R DEFINITION 10 (MRGINL COINS). L We call a marginal atom coin R ρ ; L ρ of if. coin is said a marginal coin of if is the product of some finite sequence of marginal atom coins of. The set of all marginal coins of is denoted by. THEOREM 14 (MRGINL COIN GROUP). ρ D Let. Then is a subgroup of. We shall refer to as the marginal group of. Kyoto University, p.44/81

45 ^, ^ 1 2 ο ^, = []^ ο Equivalent Coins DEFINITION 11 (EQUIVLENT COINS). If coin group of, then is the marginal, ^ f []^ j [] 2 The set of all coins equivalent to with respect to is called, the coset of with respect to, which is given by g. The coset is also called the orbit of caused by group. Kyoto University, p.45/81

46 Independenc DEFINITION 12 (INDEPENDENCE). Let B = ; and 6= ;; B 6= ;. We say that is independent of B if and only if B ο B,or B B ο. That is, using Dawid s notation B, B ο B (42), B B ο (43) Kyoto University, p.46/81

47 Geometry of Independence B / B B B / Figure 1: Independence as coin equivalence Kyoto University, p.47/81

48 Independence DEFINITION 13 (INDEPENDENCE). Let B = ; and 6= B ;; 6= B B = ;. We say that is independent of if and only if, that is B, B = B (44) Kyoto University, p.48/81

49 Properties of independence THEOREM 15. Let R and L be exclusive nonempty subsets of D. The following equations are equivalent to one another. RL = R L (45) R (46) R = L L (47) L = R Kyoto University, p.49/81

50 R L, R L Properties of independence THEOREM 16. Let R and L be exclusive nonempty subsets of D. Then = [R] (48) = [L] (49) where [R] 2 R and [L] 2 L denote some coins depending only on R and L respectively., L R Kyoto University, p.50/81

51 Marginalization (M-Law) THEOREM 17 (MRGINLIZTION). If B = ;, then B ) 1 B 1 (8 1 ρ ; 8B 1 ρ B) (50) In particular, B ) a b (8a 2 ; 8b 2 B) (51) Kyoto University, p.51/81

52 Conditional Independence B / B B B / Kyoto University, p.52/81

53 B j C, B C B C Conditional independence ; B; C D ; B C C DEFINITION 14 (CONDITIONL INDEPENDENCE). Let be mutually disjoint subsets of. Let be nonempty. Then is said conditionally independent of given if and only if is equivalent to with respect to C, that is B C ο B C (52) THEOREM 18. Let ; B; C be mutually disjoint nonempty subsets of D. Let ; B be nonempty. Then B j C, ο (53) BC C Kyoto University, p.53/81

54 B, B j Independence as CI ; B D B B DEFINITION 15 (INDEPENDENCE). Let be mutually disjoint nonempty subsets of. Then is said to be independent of, written as, if and only if is conditionally independent of given 1. That is, ; (54) Kyoto University, p.54/81

55 Properties THEOREM 19. Let ; B; C be disjoint subsets of D. Then the following coin equations are equivalent to one another. B = C C B (55) C BC C B C = (56) BC BC C = (57) = C (58) BC B = B C (59) C Kyoto University, p.55/81

56 12 = = = = = Example If D = f1; 2; 3g, then 1 2 j 3 holds if and only if Kyoto University, p.56/81

57 Example, ctd. Using usual notations, f (! 1 ;! 2 j! 3 ) = f (! 1 j! 3 )f (! 2 j! 3 ) f (! 1 ;! 2 ;! 3 ) = f (! 1 ;! 3 )f (! 2 j! 3 ) f (! 1 ;! 2 ;! 3 ) = f (! 2 ;! 3 )f (! 1 j! 3 ) f (! 1 j! 2 ;! 3 ) = f (! 1 j! 3 ) f (! 2 j! 1 ;! 3 ) = f (! 2 j! 3 ) Kyoto University, p.57/81

58 B j Factorization Theorem THEOREM 20. Let 6= ;; B 6= ;; C be disjoint subsets of D, then B j C, B = [ μ B] [ μ ] (60) C C, BC = [ μ B] [ μ ] (61) where [ μ B] 2 μ B ; [ μ ] 2 μ. Kyoto University, p.58/81

59 Marginalization THEOREM 21. Let 6= ;; B 6= ;; C be disjoint subset of D, then C B j C ) 1 B 1 j (8 1 ρ ; 8B 1 ρ B) (62) In particular, C B j C ) a b j (8a 2 ; 8b 2 B) (63) Kyoto University, p.59/81

60 B j C 6() B j Simpson s Paradox If ; B; C; D are disjoint, then CD (64) or, in terms of random vectors!! B j! C 6()!! B j(! C ;! D ) (65) Note that as a special case we have C where 6, means 6( and 6). B 6, B j or!! B 6,!! B j! C Kyoto University, p.60/81

61 B j C j,! (! B ;! C )j! D Intersection Theorem THEOREM 22. If ; B; C; D are exclusive, then we have ) CD D (66), BC j BD or, in terms of random variables, )! B j (! C ;! D )!! C j (! B ;! D )! Kyoto University, p.61/81

62 C j,! (! B ;! C ) Intersection Theorem, ctd. COROLLRY 1. If ; B; C are mutually exclusive and nonempty, then we have ) B j C, BC (67) B or, in terms of random vectors, )! B j! C!! C j! B! Kyoto University, p.62/81

63 j B j C Contraction Theorem THEOREM 23 (CONTRCTION). If ; B; C; D are mutually exclusive and nonempty, then we have ) CD D (68), BC j D In terms of random vectors, the contraction theorem can be expressed as )! B j (! C ;! D )!! C j! D! ()! (! B ;! C ) j! D (69) Kyoto University, p.63/81

64 Contraction Theorem, ctd. COROLLRY 2. If ; B; C are mutually exclusive and nonempty, then we have ) B j C, BC (70) C or, in terms of random vectors, )! B j! C!! C! ()! (! B ;! C ) (71) Kyoto University, p.64/81

65 BC j BCD = BC j C j D ) B j D, BCD = D CD BCD, B j Weak Union Theorem THEOREM 24 (WEK UNION). If ; B; C; D are mutually exclusive, then CD (72) Proof. The M-Law implies that D, CD = D (73) which, when putted into BCD (74) gives CD Kyoto University, p.65/81

66 C j C j Graphoid xioms Pearl and Paz (1987), Geiger, et al. (1990), Pear (2000, p.11) Symmetry: j C B B j =) Decomposition: j D BC B j =) Weak Union: BC j D =) B j C D CD Contraction: B j CD D ) =) BC j D Intersection: B j CD D ), BC j BD Kyoto University, p.66/81

67 D j Mixing Rule The following property, due to Dawid (1979), is known as the mixing rule. THEOREM 25 (MIXING). If ; B; C; D are mutually exclusive, then ( BD j C C (75) B =) D B j C Kyoto University, p.67/81

68 ( BD j D j D j Strong Mixing THEOREM 26 (STRONG-MIXING). If ; B; C; D are mutually exclusive, then C D B j C (76) C ( C () B Kyoto University, p.68/81

69 ( B j D j Chaining Rule The following property is known as the chaining rule (Lauritzen, 1982). THEOREM 27 (CHINING RULE). If ; B; C; D are mutually exclusive, then C C (77) C B =) D j Kyoto University, p.69/81

70 C j j C j D 9 >= >; Seperation Theorem THEOREM 28. If ; B; C; D; S are mutually exclusive, then BDS D j BCS S (78), B CD j B DS CS B B S C D Kyoto University, p.70/81

71 C j j C j D 9 >= >; 9 >= Seperation Theorem, ctd. COROLLRY 3. If ; B; C; D are exclusive, then we have BD D j BC, B CD (79) B D B C >; Using the symbols of random variables we can write! C j (! B ;! D )!! D j (! B ;! C )!, (! ;! B ) (! C ;! D ) (80) B! C j (! ;! D )! B! D j (! ;! C )! Kyoto University, p.71/81

72 C j S ; D j C j j C j D F j S ; B C j S ; B D j Properties COROLLRY 4. If ; B; C; D; S are mutually exclusive and BDS D j BCS (81) B DS B CS Then for any subsets E ρ [ B; F ρ C [ D, we have S (82) E In particular, we have S Kyoto University, p.72/81

73 1 n = 1 B C, C j j C j B Mutual Independence DEFINITION 16 (MUTUL INDEPENDENCE). ; ; Let 1 n be mutually exclusive nonempty D subsets of. Then coins 1 ; n are said mutually independent of each other, ; written as 1 n,if n (83) THEOREM 29. If ; B; C are mutually exclusive nonempty subsetd of D, then B B (84) C Kyoto University, p.73/81

74 12 d = 1 2 Independent Model DEFINITION 17 (INDEPENDENT MODEL). D = f1; 2; ; Let dg. The coin (D ) group is called an independent model if d (85) The following theorem gives an important characterization of the independent model. THEOREM 30 (CHRCTERIZTION OF INDEPENDENT MODEL). coin group is an independent model if and only if there exists no prime coin. Kyoto University, p.74/81

75 Saparoid The coin algebra satisfies the axioms of a strong saparoid of Dawid (2001) Kyoto University, p.75/81

76 Meet-semilattice DEFINITION 18. The pair (L; ^), where L is a set and ^ is a binary operation on L, is called a meet-semilattice if the following identities hold for all x; y; z 2 L: associativity: commutativity: idempotency: x ^ (y ^ z) = (x ^ y) ^ z x ^ y = y ^ x x ^ x = x Kyoto University, p.76/81

77 Homomorphisms of Semilattices DEFINITION 19. Let (L 1 ; _) and (L 2 ; _ 0 ) be two join-semilattices. homomorphism between (L 1 ; _) and (L 2 ; _ 0 ) is a function f : L 1! L 2 so that (x _ y) = f (x) _ 0 f (y) f hold for x; y 2 L all 1. Homomorphisms between join-semilattices can be defined similarly. Kyoto University, p.77/81

78 Lattice DEFINITION 20. n algebraic structure (L; _; ^), where L is a (possibly infinite) set and _ and ^ are two binary operations, is a lattice if the following identities hold for all elements x; y and z in L: Commutativity (L1): x _ y = y _ x ; x ^ y = y ^ x ssociativity (L2): x _ (y _ z) = (x _ y) _ z ; x ^ (y ^ z) = (x ^ y) bsorption (L3): x _ (x ^ y) = x ; x ^ (x _ y) = x Kyoto University, p.78/81

79 The Separoids DEFINITION 21. (S;») Let be a join-semilattice. Let ternary relation on S. (S;»; ) Then is a separoid if j be a P1: x y j x P2: x y j z =) y x j z P3: x y j z & w» y =) x w j z P4: x y j z & w» y =) x y j (z _ w) P5: x y j z & x w j (y _ z) =) x (y _ w) j z Kyoto University, p.79/81

80 Strong Separoid DEFINITION 22. (S;»; ) separoid is said to be a strong separoid (S;») if is a lattice and the following additional property holds P6: If z» y & w» y then x y j z & x y j w =) x y j (z ^ w) Kyoto University, p.80/81

81 Coin lgebra Implies Separoid THEOREM 31. (D;») Let be the Boolean lattice. Define the (partial) ternary x yjz relation D in if the coin equation xy = x z z separoid, that is, P1-P6 hold. y holds, where x ^ y = ;. Then (D;»; z ) is a strong Kyoto University, p.81/81

STAT 598L Probabilistic Graphical Models. Instructor: Sergey Kirshner. Probability Review

STAT 598L Probabilistic Graphical Models. Instructor: Sergey Kirshner. Probability Review STAT 598L Probabilistic Graphical Models Instructor: Sergey Kirshner Probability Review Some slides are taken (or modified) from Carlos Guestrin s 10-708 Probabilistic Graphical Models Fall 2008 at CMU

More information

0 Sets and Induction. Sets

0 Sets and Induction. Sets 0 Sets and Induction Sets A set is an unordered collection of objects, called elements or members of the set. A set is said to contain its elements. We write a A to denote that a is an element of the set

More information

Markov properties for undirected graphs

Markov properties for undirected graphs Graphical Models, Lecture 2, Michaelmas Term 2011 October 12, 2011 Formal definition Fundamental properties Random variables X and Y are conditionally independent given the random variable Z if L(X Y,

More information

Sets and Motivation for Boolean algebra

Sets and Motivation for Boolean algebra SET THEORY Basic concepts Notations Subset Algebra of sets The power set Ordered pairs and Cartesian product Relations on sets Types of relations and their properties Relational matrix and the graph of

More information

Lattices, closure operators, and Galois connections.

Lattices, closure operators, and Galois connections. 125 Chapter 5. Lattices, closure operators, and Galois connections. 5.1. Semilattices and lattices. Many of the partially ordered sets P we have seen have a further valuable property: that for any two

More information

ANNIHILATOR IDEALS IN ALMOST SEMILATTICE

ANNIHILATOR IDEALS IN ALMOST SEMILATTICE BULLETIN OF THE INTERNATIONAL MATHEMATICAL VIRTUAL INSTITUTE ISSN (p) 2303-4874, ISSN (o) 2303-4955 www.imvibl.org /JOURNALS / BULLETIN Vol. 7(2017), 339-352 DOI: 10.7251/BIMVI1702339R Former BULLETIN

More information

Goal. Partially-ordered set. Game plan 2/2/2013. Solving fixpoint equations

Goal. Partially-ordered set. Game plan 2/2/2013. Solving fixpoint equations Goal Solving fixpoint equations Many problems in programming languages can be formulated as the solution of a set of mutually recursive equations: D: set, f,g:dxd D x = f(x,y) y = g(x,y) Examples Parsing:

More information

CHAPTER 1 SETS AND EVENTS

CHAPTER 1 SETS AND EVENTS CHPTER 1 SETS ND EVENTS 1.1 Universal Set and Subsets DEFINITION: set is a well-defined collection of distinct elements in the universal set. This is denoted by capital latin letters, B, C, If an element

More information

Equational Logic. Chapter Syntax Terms and Term Algebras

Equational Logic. Chapter Syntax Terms and Term Algebras Chapter 2 Equational Logic 2.1 Syntax 2.1.1 Terms and Term Algebras The natural logic of algebra is equational logic, whose propositions are universally quantified identities between terms built up from

More information

Lecture 4 October 18th

Lecture 4 October 18th Directed and undirected graphical models Fall 2017 Lecture 4 October 18th Lecturer: Guillaume Obozinski Scribe: In this lecture, we will assume that all random variables are discrete, to keep notations

More information

Algebraic structures I

Algebraic structures I MTH5100 Assignment 1-10 Algebraic structures I For handing in on various dates January March 2011 1 FUNCTIONS. Say which of the following rules successfully define functions, giving reasons. For each one

More information

GROUPS. Chapter-1 EXAMPLES 1.1. INTRODUCTION 1.2. BINARY OPERATION

GROUPS. Chapter-1 EXAMPLES 1.1. INTRODUCTION 1.2. BINARY OPERATION Chapter-1 GROUPS 1.1. INTRODUCTION The theory of groups arose from the theory of equations, during the nineteenth century. Originally, groups consisted only of transformations. The group of transformations

More information

DEPARTMENT OF MATHEMATIC EDUCATION MATHEMATIC AND NATURAL SCIENCE FACULTY

DEPARTMENT OF MATHEMATIC EDUCATION MATHEMATIC AND NATURAL SCIENCE FACULTY HANDOUT ABSTRACT ALGEBRA MUSTHOFA DEPARTMENT OF MATHEMATIC EDUCATION MATHEMATIC AND NATURAL SCIENCE FACULTY 2012 BINARY OPERATION We are all familiar with addition and multiplication of two numbers. Both

More information

Received: 1 September 2018; Accepted: 10 October 2018; Published: 12 October 2018

Received: 1 September 2018; Accepted: 10 October 2018; Published: 12 October 2018 entropy Article Entropy Inequalities for Lattices Peter Harremoës Copenhagen Business College, Nørre Voldgade 34, 1358 Copenhagen K, Denmark; harremoes@ieee.org; Tel.: +45-39-56-41-71 Current address:

More information

MATH 3030, Abstract Algebra FALL 2012 Toby Kenney Midyear Examination Friday 7th December: 7:00-10:00 PM

MATH 3030, Abstract Algebra FALL 2012 Toby Kenney Midyear Examination Friday 7th December: 7:00-10:00 PM MATH 3030, Abstract Algebra FALL 2012 Toby Kenney Midyear Examination Friday 7th December: 7:00-10:00 PM Basic Questions 1. Compute the factor group Z 3 Z 9 / (1, 6). The subgroup generated by (1, 6) is

More information

Stat 451: Solutions to Assignment #1

Stat 451: Solutions to Assignment #1 Stat 451: Solutions to Assignment #1 2.1) By definition, 2 Ω is the set of all subsets of Ω. Therefore, to show that 2 Ω is a σ-algebra we must show that the conditions of the definition σ-algebra are

More information

= ϕ r cos θ. 0 cos ξ sin ξ and sin ξ cos ξ. sin ξ 0 cos ξ

= ϕ r cos θ. 0 cos ξ sin ξ and sin ξ cos ξ. sin ξ 0 cos ξ 8. The Banach-Tarski paradox May, 2012 The Banach-Tarski paradox is that a unit ball in Euclidean -space can be decomposed into finitely many parts which can then be reassembled to form two unit balls

More information

Algebra Homework, Edition 2 9 September 2010

Algebra Homework, Edition 2 9 September 2010 Algebra Homework, Edition 2 9 September 2010 Problem 6. (1) Let I and J be ideals of a commutative ring R with I + J = R. Prove that IJ = I J. (2) Let I, J, and K be ideals of a principal ideal domain.

More information

Algebraic Structures Exam File Fall 2013 Exam #1

Algebraic Structures Exam File Fall 2013 Exam #1 Algebraic Structures Exam File Fall 2013 Exam #1 1.) Find all four solutions to the equation x 4 + 16 = 0. Give your answers as complex numbers in standard form, a + bi. 2.) Do the following. a.) Write

More information

Chapter 0. Introduction: Prerequisites and Preliminaries

Chapter 0. Introduction: Prerequisites and Preliminaries Chapter 0. Sections 0.1 to 0.5 1 Chapter 0. Introduction: Prerequisites and Preliminaries Note. The content of Sections 0.1 through 0.6 should be very familiar to you. However, in order to keep these notes

More information

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability

Lecture Notes 1 Basic Probability. Elements of Probability. Conditional probability. Sequential Calculation of Probability Lecture Notes 1 Basic Probability Set Theory Elements of Probability Conditional probability Sequential Calculation of Probability Total Probability and Bayes Rule Independence Counting EE 178/278A: Basic

More information

Independence for Full Conditional Measures, Graphoids and Bayesian Networks

Independence for Full Conditional Measures, Graphoids and Bayesian Networks Independence for Full Conditional Measures, Graphoids and Bayesian Networks Fabio G. Cozman Universidade de Sao Paulo Teddy Seidenfeld Carnegie Mellon University February 28, 2007 Abstract This paper examines

More information

CHAPTEER - TWO SUBGROUPS. ( Z, + ) is subgroup of ( R, + ). 1) Find all subgroups of the group ( Z 8, + 8 ).

CHAPTEER - TWO SUBGROUPS. ( Z, + ) is subgroup of ( R, + ). 1) Find all subgroups of the group ( Z 8, + 8 ). CHAPTEER - TWO SUBGROUPS Definition 2-1. Let (G, ) be a group and H G be a nonempty subset of G. The pair ( H, ) is said to be a SUBGROUP of (G, ) if ( H, ) is group. Example. ( Z, + ) is subgroup of (

More information

Prof. Dr. Lars Schmidt-Thieme, L. B. Marinho, K. Buza Information Systems and Machine Learning Lab (ISMLL), University of Hildesheim, Germany, Course

Prof. Dr. Lars Schmidt-Thieme, L. B. Marinho, K. Buza Information Systems and Machine Learning Lab (ISMLL), University of Hildesheim, Germany, Course Course on Bayesian Networks, winter term 2007 0/31 Bayesian Networks Bayesian Networks I. Bayesian Networks / 1. Probabilistic Independence and Separation in Graphs Prof. Dr. Lars Schmidt-Thieme, L. B.

More information

Boolean Algebra CHAPTER 15

Boolean Algebra CHAPTER 15 CHAPTER 15 Boolean Algebra 15.1 INTRODUCTION Both sets and propositions satisfy similar laws, which are listed in Tables 1-1 and 4-1 (in Chapters 1 and 4, respectively). These laws are used to define an

More information

MATH 556: PROBABILITY PRIMER

MATH 556: PROBABILITY PRIMER MATH 6: PROBABILITY PRIMER 1 DEFINITIONS, TERMINOLOGY, NOTATION 1.1 EVENTS AND THE SAMPLE SPACE Definition 1.1 An experiment is a one-off or repeatable process or procedure for which (a there is a well-defined

More information

Statistical Inference

Statistical Inference Statistical Inference Lecture 1: Probability Theory MING GAO DASE @ ECNU (for course related communications) mgao@dase.ecnu.edu.cn Sep. 11, 2018 Outline Introduction Set Theory Basics of Probability Theory

More information

Lecture 4: Probability and Discrete Random Variables

Lecture 4: Probability and Discrete Random Variables Error Correcting Codes: Combinatorics, Algorithms and Applications (Fall 2007) Lecture 4: Probability and Discrete Random Variables Wednesday, January 21, 2009 Lecturer: Atri Rudra Scribe: Anonymous 1

More information

An Introduction to the Theory of Lattice

An Introduction to the Theory of Lattice An Introduction to the Theory of Lattice Jinfang Wang Λy Graduate School of Science and Technology, Chiba University 1-33 Yayoi-cho, Inage-ku, Chiba 263-8522, Japan May 11, 2006 Λ Fax: 81-43-290-3663.

More information

Number Axioms. P. Danziger. A Group is a set S together with a binary operation (*) on S, denoted a b such that for all a, b. a b S.

Number Axioms. P. Danziger. A Group is a set S together with a binary operation (*) on S, denoted a b such that for all a, b. a b S. Appendix A Number Axioms P. Danziger 1 Number Axioms 1.1 Groups Definition 1 A Group is a set S together with a binary operation (*) on S, denoted a b such that for all a, b and c S 0. (Closure) 1. (Associativity)

More information

V7 Foundations of Probability Theory

V7 Foundations of Probability Theory V7 Foundations of Probability Theory Probability : degree of confidence that an event of an uncertain nature will occur. Events : we will assume that there is an agreed upon space of possible outcomes

More information

Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition:

Chapter Learning Objectives. Random Experiments Dfiii Definition: Dfiii Definition: Chapter 2: Probability 2-1 Sample Spaces & Events 2-1.1 Random Experiments 2-1.2 Sample Spaces 2-1.3 Events 2-1 1.4 Counting Techniques 2-2 Interpretations & Axioms of Probability 2-3 Addition Rules 2-4

More information

Statistical Theory 1

Statistical Theory 1 Statistical Theory 1 Set Theory and Probability Paolo Bautista September 12, 2017 Set Theory We start by defining terms in Set Theory which will be used in the following sections. Definition 1 A set is

More information

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016

Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 8. For any two events E and F, P (E) = P (E F ) + P (E F c ). Summary of basic probability theory Math 218, Mathematical Statistics D Joyce, Spring 2016 Sample space. A sample space consists of a underlying

More information

Section 2: Classes of Sets

Section 2: Classes of Sets Section 2: Classes of Sets Notation: If A, B are subsets of X, then A \ B denotes the set difference, A \ B = {x A : x B}. A B denotes the symmetric difference. A B = (A \ B) (B \ A) = (A B) \ (A B). Remarks

More information

Model Complexity of Pseudo-independent Models

Model Complexity of Pseudo-independent Models Model Complexity of Pseudo-independent Models Jae-Hyuck Lee and Yang Xiang Department of Computing and Information Science University of Guelph, Guelph, Canada {jaehyuck, yxiang}@cis.uoguelph,ca Abstract

More information

Logic Synthesis and Verification

Logic Synthesis and Verification Logic Synthesis and Verification Boolean Algebra Jie-Hong Roland Jiang 江介宏 Department of Electrical Engineering National Taiwan University Fall 2014 1 2 Boolean Algebra Reading F. M. Brown. Boolean Reasoning:

More information

Recitation 2: Probability

Recitation 2: Probability Recitation 2: Probability Colin White, Kenny Marino January 23, 2018 Outline Facts about sets Definitions and facts about probability Random Variables and Joint Distributions Characteristics of distributions

More information

Conditional Independence and Markov Properties

Conditional Independence and Markov Properties Conditional Independence and Markov Properties Lecture 1 Saint Flour Summerschool, July 5, 2006 Steffen L. Lauritzen, University of Oxford Overview of lectures 1. Conditional independence and Markov properties

More information

Exercises on chapter 1

Exercises on chapter 1 Exercises on chapter 1 1. Let G be a group and H and K be subgroups. Let HK = {hk h H, k K}. (i) Prove that HK is a subgroup of G if and only if HK = KH. (ii) If either H or K is a normal subgroup of G

More information

Identifying the irreducible disjoint factors of a multivariate probability distribution

Identifying the irreducible disjoint factors of a multivariate probability distribution JMLR: Workshop and Conference Proceedings vol 52, 183-194, 2016 PGM 2016 Identifying the irreducible disjoint factors of a multivariate probability distribution Maxime Gasse Alex Aussem University of Lyon,

More information

Subrings and Ideals 2.1 INTRODUCTION 2.2 SUBRING

Subrings and Ideals 2.1 INTRODUCTION 2.2 SUBRING Subrings and Ideals Chapter 2 2.1 INTRODUCTION In this chapter, we discuss, subrings, sub fields. Ideals and quotient ring. We begin our study by defining a subring. If (R, +, ) is a ring and S is a non-empty

More information

BOOLEAN ALGEBRA INTRODUCTION SUBSETS

BOOLEAN ALGEBRA INTRODUCTION SUBSETS BOOLEAN ALGEBRA M. Ragheb 1/294/2018 INTRODUCTION Modern algebra is centered around the concept of an algebraic system: A, consisting of a set of elements: ai, i=1, 2,, which are combined by a set of operations

More information

With Question/Answer Animations. Chapter 2

With Question/Answer Animations. Chapter 2 With Question/Answer Animations Chapter 2 Chapter Summary Sets The Language of Sets Set Operations Set Identities Functions Types of Functions Operations on Functions Sequences and Summations Types of

More information

2.2 Lowenheim-Skolem-Tarski theorems

2.2 Lowenheim-Skolem-Tarski theorems Logic SEP: Day 1 July 15, 2013 1 Some references Syllabus: http://www.math.wisc.edu/graduate/guide-qe Previous years qualifying exams: http://www.math.wisc.edu/ miller/old/qual/index.html Miller s Moore

More information

A Little Beyond: Linear Algebra

A Little Beyond: Linear Algebra A Little Beyond: Linear Algebra Akshay Tiwary March 6, 2016 Any suggestions, questions and remarks are welcome! 1 A little extra Linear Algebra 1. Show that any set of non-zero polynomials in [x], no two

More information

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables

Why study probability? Set theory. ECE 6010 Lecture 1 Introduction; Review of Random Variables ECE 6010 Lecture 1 Introduction; Review of Random Variables Readings from G&S: Chapter 1. Section 2.1, Section 2.3, Section 2.4, Section 3.1, Section 3.2, Section 3.5, Section 4.1, Section 4.2, Section

More information

Chapter 4. Measure Theory. 1. Measure Spaces

Chapter 4. Measure Theory. 1. Measure Spaces Chapter 4. Measure Theory 1. Measure Spaces Let X be a nonempty set. A collection S of subsets of X is said to be an algebra on X if S has the following properties: 1. X S; 2. if A S, then A c S; 3. if

More information

Algebra: Groups. Group Theory a. Examples of Groups. groups. The inverse of a is simply a, which exists.

Algebra: Groups. Group Theory a. Examples of Groups. groups. The inverse of a is simply a, which exists. Group Theory a Let G be a set and be a binary operation on G. (G, ) is called a group if it satisfies the following. 1. For all a, b G, a b G (closure). 2. For all a, b, c G, a (b c) = (a b) c (associativity).

More information

Definitions. Notations. Injective, Surjective and Bijective. Divides. Cartesian Product. Relations. Equivalence Relations

Definitions. Notations. Injective, Surjective and Bijective. Divides. Cartesian Product. Relations. Equivalence Relations Page 1 Definitions Tuesday, May 8, 2018 12:23 AM Notations " " means "equals, by definition" the set of all real numbers the set of integers Denote a function from a set to a set by Denote the image of

More information

INTRODUCTION TO THE GROUP THEORY

INTRODUCTION TO THE GROUP THEORY Lecture Notes on Structure of Algebra INTRODUCTION TO THE GROUP THEORY By : Drs. Antonius Cahya Prihandoko, M.App.Sc e-mail: antoniuscp.fkip@unej.ac.id Mathematics Education Study Program Faculty of Teacher

More information

Partial cubes: structures, characterizations, and constructions

Partial cubes: structures, characterizations, and constructions Partial cubes: structures, characterizations, and constructions Sergei Ovchinnikov San Francisco State University, Mathematics Department, 1600 Holloway Ave., San Francisco, CA 94132 Abstract Partial cubes

More information

Chapter 1. Sets and Mappings

Chapter 1. Sets and Mappings Chapter 1. Sets and Mappings 1. Sets A set is considered to be a collection of objects (elements). If A is a set and x is an element of the set A, we say x is a member of A or x belongs to A, and we write

More information

Conditional Independence

Conditional Independence H. Nooitgedagt Conditional Independence Bachelorscriptie, 18 augustus 2008 Scriptiebegeleider: prof.dr. R. Gill Mathematisch Instituut, Universiteit Leiden Preface In this thesis I ll discuss Conditional

More information

Definition List Modern Algebra, Fall 2011 Anders O.F. Hendrickson

Definition List Modern Algebra, Fall 2011 Anders O.F. Hendrickson Definition List Modern Algebra, Fall 2011 Anders O.F. Hendrickson On almost every Friday of the semester, we will have a brief quiz to make sure you have memorized the definitions encountered in our studies.

More information

3.3 Equivalence Relations and Partitions on Groups

3.3 Equivalence Relations and Partitions on Groups 84 Chapter 3. Groups 3.3 Equivalence Relations and Partitions on Groups Definition 3.3.1. Let (G, ) be a group and let H be a subgroup of G. Let H be the relation on G defined by a H b if and only if ab

More information

Derivations and differentials

Derivations and differentials Derivations and differentials Johan Commelin April 24, 2012 In the following text all rings are commutative with 1, unless otherwise specified. 1 Modules of derivations Let A be a ring, α : A B an A algebra,

More information

Universal Algebra for Logics

Universal Algebra for Logics Universal Algebra for Logics Joanna GRYGIEL University of Czestochowa Poland j.grygiel@ajd.czest.pl 2005 These notes form Lecture Notes of a short course which I will give at 1st School on Universal Logic

More information

Algebraic Structure of Information

Algebraic Structure of Information Algebraic Structure of Information Jürg Kohlas Departement of Informatics University of Fribourg CH 1700 Fribourg (Switzerland) E-mail: juerg.kohlas@unifr.ch http://diuf.unifr.ch/drupal/tns/juerg kohlas

More information

Rings and groups. Ya. Sysak

Rings and groups. Ya. Sysak Rings and groups. Ya. Sysak 1 Noetherian rings Let R be a ring. A (right) R -module M is called noetherian if it satisfies the maximum condition for its submodules. In other words, if M 1... M i M i+1...

More information

Properties of Probability

Properties of Probability Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.

More information

Sets and Functions. MATH 464/506, Real Analysis. J. Robert Buchanan. Summer Department of Mathematics. J. Robert Buchanan Sets and Functions

Sets and Functions. MATH 464/506, Real Analysis. J. Robert Buchanan. Summer Department of Mathematics. J. Robert Buchanan Sets and Functions Sets and Functions MATH 464/506, Real Analysis J. Robert Buchanan Department of Mathematics Summer 2007 Notation x A means that element x is a member of set A. x / A means that x is not a member of A.

More information

Category Theory. Categories. Definition.

Category Theory. Categories. Definition. Category Theory Category theory is a general mathematical theory of structures, systems of structures and relationships between systems of structures. It provides a unifying and economic mathematical modeling

More information

Faithfulness of Probability Distributions and Graphs

Faithfulness of Probability Distributions and Graphs Journal of Machine Learning Research 18 (2017) 1-29 Submitted 5/17; Revised 11/17; Published 12/17 Faithfulness of Probability Distributions and Graphs Kayvan Sadeghi Statistical Laboratory University

More information

Learning from Sensor Data: Set II. Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University

Learning from Sensor Data: Set II. Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University Learning from Sensor Data: Set II Behnaam Aazhang J.S. Abercombie Professor Electrical and Computer Engineering Rice University 1 6. Data Representation The approach for learning from data Probabilistic

More information

Relational-Database Design

Relational-Database Design C H A P T E R 7 Relational-Database Design Exercises 7.2 Answer: A decomposition {R 1, R 2 } is a lossless-join decomposition if R 1 R 2 R 1 or R 1 R 2 R 2. Let R 1 =(A, B, C), R 2 =(A, D, E), and R 1

More information

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed

More information

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable

Lecture Notes 1 Probability and Random Variables. Conditional Probability and Independence. Functions of a Random Variable Lecture Notes 1 Probability and Random Variables Probability Spaces Conditional Probability and Independence Random Variables Functions of a Random Variable Generation of a Random Variable Jointly Distributed

More information

Maximum exponent of boolean circulant matrices with constant number of nonzero entries in its generating vector

Maximum exponent of boolean circulant matrices with constant number of nonzero entries in its generating vector Maximum exponent of boolean circulant matrices with constant number of nonzero entries in its generating vector MI Bueno, Department of Mathematics and The College of Creative Studies University of California,

More information

Markov properties for undirected graphs

Markov properties for undirected graphs Graphical Models, Lecture 2, Michaelmas Term 2009 October 15, 2009 Formal definition Fundamental properties Random variables X and Y are conditionally independent given the random variable Z if L(X Y,

More information

Permutation groups/1. 1 Automorphism groups, permutation groups, abstract

Permutation groups/1. 1 Automorphism groups, permutation groups, abstract Permutation groups Whatever you have to do with a structure-endowed entity Σ try to determine its group of automorphisms... You can expect to gain a deep insight into the constitution of Σ in this way.

More information

GENERALIZED DIFFERENCE POSETS AND ORTHOALGEBRAS. 0. Introduction

GENERALIZED DIFFERENCE POSETS AND ORTHOALGEBRAS. 0. Introduction Acta Math. Univ. Comenianae Vol. LXV, 2(1996), pp. 247 279 247 GENERALIZED DIFFERENCE POSETS AND ORTHOALGEBRAS J. HEDLÍKOVÁ and S. PULMANNOVÁ Abstract. A difference on a poset (P, ) is a partial binary

More information

Algebraic Classification of Small Bayesian Networks

Algebraic Classification of Small Bayesian Networks GROSTAT VI, Menton IUT STID p. 1 Algebraic Classification of Small Bayesian Networks Luis David Garcia, Michael Stillman, and Bernd Sturmfels lgarcia@math.vt.edu Virginia Tech GROSTAT VI, Menton IUT STID

More information

Theorems and Definitions in Group Theory

Theorems and Definitions in Group Theory Theorems and Definitions in Group Theory Shunan Zhao Contents 1 Basics of a group 3 1.1 Basic Properties of Groups.......................... 3 1.2 Properties of Inverses............................. 3

More information

STAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed.

STAT 302 Introduction to Probability Learning Outcomes. Textbook: A First Course in Probability by Sheldon Ross, 8 th ed. STAT 302 Introduction to Probability Learning Outcomes Textbook: A First Course in Probability by Sheldon Ross, 8 th ed. Chapter 1: Combinatorial Analysis Demonstrate the ability to solve combinatorial

More information

3. Abstract Boolean Algebras

3. Abstract Boolean Algebras 3. ABSTRACT BOOLEAN ALGEBRAS 123 3. Abstract Boolean Algebras 3.1. Abstract Boolean Algebra. Definition 3.1.1. An abstract Boolean algebra is defined as a set B containing two distinct elements 0 and 1,

More information

MATH HL OPTION - REVISION SETS, RELATIONS AND GROUPS Compiled by: Christos Nikolaidis

MATH HL OPTION - REVISION SETS, RELATIONS AND GROUPS Compiled by: Christos Nikolaidis MATH HL OPTION - REVISION SETS, RELATIONS AND GROUPS Compiled by: Christos Nikolaidis PART B: GROUPS GROUPS 1. ab The binary operation a * b is defined by a * b = a+ b +. (a) Prove that * is associative.

More information

Exercises for Unit I (Topics from linear algebra)

Exercises for Unit I (Topics from linear algebra) Exercises for Unit I (Topics from linear algebra) I.0 : Background Note. There is no corresponding section in the course notes, but as noted at the beginning of Unit I these are a few exercises which involve

More information

Stats Probability Theory

Stats Probability Theory Stats 241.3 Probability Theory Instructor: Office: W.H.Laverty 235 McLean Hall Phone: 966-6096 Lectures: Evaluation: M T W Th F 1:30pm - 2:50pm Thorv 105 Lab: T W Th 3:00-3:50 Thorv 105 Assignments, Labs,

More information

Groups of Prime Power Order with Derived Subgroup of Prime Order

Groups of Prime Power Order with Derived Subgroup of Prime Order Journal of Algebra 219, 625 657 (1999) Article ID jabr.1998.7909, available online at http://www.idealibrary.com on Groups of Prime Power Order with Derived Subgroup of Prime Order Simon R. Blackburn*

More information

MV-algebras and fuzzy topologies: Stone duality extended

MV-algebras and fuzzy topologies: Stone duality extended MV-algebras and fuzzy topologies: Stone duality extended Dipartimento di Matematica Università di Salerno, Italy Algebra and Coalgebra meet Proof Theory Universität Bern April 27 29, 2011 Outline 1 MV-algebras

More information

MATH 8253 ALGEBRAIC GEOMETRY WEEK 12

MATH 8253 ALGEBRAIC GEOMETRY WEEK 12 MATH 8253 ALGEBRAIC GEOMETRY WEEK 2 CİHAN BAHRAN 3.2.. Let Y be a Noetherian scheme. Show that any Y -scheme X of finite type is Noetherian. Moreover, if Y is of finite dimension, then so is X. Write f

More information

On minimal models of the Region Connection Calculus

On minimal models of the Region Connection Calculus Fundamenta Informaticae 69 (2006) 1 20 1 IOS Press On minimal models of the Region Connection Calculus Lirong Xia State Key Laboratory of Intelligent Technology and Systems Department of Computer Science

More information

SUBLATTICES OF LATTICES OF ORDER-CONVEX SETS, III. THE CASE OF TOTALLY ORDERED SETS

SUBLATTICES OF LATTICES OF ORDER-CONVEX SETS, III. THE CASE OF TOTALLY ORDERED SETS SUBLATTICES OF LATTICES OF ORDER-CONVEX SETS, III. THE CASE OF TOTALLY ORDERED SETS MARINA SEMENOVA AND FRIEDRICH WEHRUNG Abstract. For a partially ordered set P, let Co(P) denote the lattice of all order-convex

More information

RINGS: SUMMARY OF MATERIAL

RINGS: SUMMARY OF MATERIAL RINGS: SUMMARY OF MATERIAL BRIAN OSSERMAN This is a summary of terms used and main results proved in the subject of rings, from Chapters 11-13 of Artin. Definitions not included here may be considered

More information

CHAPTER III BOOLEAN ALGEBRA

CHAPTER III BOOLEAN ALGEBRA CHAPTER III- CHAPTER III CHAPTER III R.M. Dansereau; v.. CHAPTER III-2 BOOLEAN VALUES INTRODUCTION BOOLEAN VALUES Boolean algebra is a form of algebra that deals with single digit binary values and variables.

More information

Independence, Decomposability and functions which take values into an Abelian Group

Independence, Decomposability and functions which take values into an Abelian Group Independence, Decomposability and functions which take values into an Abelian Group Adrian Silvescu Department of Computer Science Iowa State University Ames, IA 50010, USA silvescu@cs.iastate.edu Abstract

More information

Chapter 1 : The language of mathematics.

Chapter 1 : The language of mathematics. MAT 200, Logic, Language and Proof, Fall 2015 Summary Chapter 1 : The language of mathematics. Definition. A proposition is a sentence which is either true or false. Truth table for the connective or :

More information

Chapter 5: The Integers

Chapter 5: The Integers c Dr Oksana Shatalov, Fall 2014 1 Chapter 5: The Integers 5.1: Axioms and Basic Properties Operations on the set of integers, Z: addition and multiplication with the following properties: A1. Addition

More information

Locally Complete Path Independent Choice Functions and Their Lattices Mark R. Johnson and Richard A. Dean Addresses: Abstract

Locally Complete Path Independent Choice Functions and Their Lattices Mark R. Johnson and Richard A. Dean Addresses: Abstract Locally Complete Path Independent Choice Functions and Their Lattices Mark R. Johnson and Richard A. Dean Addresses: Mark R. Johnson Richard A. Dean A. B. Freeman School of Business Department of Mathematics

More information

MAXIMAL ORDERS IN COMPLETELY 0-SIMPLE SEMIGROUPS

MAXIMAL ORDERS IN COMPLETELY 0-SIMPLE SEMIGROUPS MAXIMAL ORDERS IN COMPLETELY 0-SIMPLE SEMIGROUPS John Fountain and Victoria Gould Department of Mathematics University of York Heslington York YO1 5DD, UK e-mail: jbf1@york.ac.uk varg1@york.ac.uk Abstract

More information

Rings and Fields Theorems

Rings and Fields Theorems Rings and Fields Theorems Rajesh Kumar PMATH 334 Intro to Rings and Fields Fall 2009 October 25, 2009 12 Rings and Fields 12.1 Definition Groups and Abelian Groups Let R be a non-empty set. Let + and (multiplication)

More information

PROBABILITY THEORY 1. Basics

PROBABILITY THEORY 1. Basics PROILITY THEORY. asics Probability theory deals with the study of random phenomena, which under repeated experiments yield different outcomes that have certain underlying patterns about them. The notion

More information

Chapter Summary. Sets The Language of Sets Set Operations Set Identities Functions Types of Functions Operations on Functions Computability

Chapter Summary. Sets The Language of Sets Set Operations Set Identities Functions Types of Functions Operations on Functions Computability Chapter 2 1 Chapter Summary Sets The Language of Sets Set Operations Set Identities Functions Types of Functions Operations on Functions Computability Sequences and Summations Types of Sequences Summation

More information

LATTICE AND BOOLEAN ALGEBRA

LATTICE AND BOOLEAN ALGEBRA 2 LATTICE AND BOOLEAN ALGEBRA This chapter presents, lattice and Boolean algebra, which are basis of switching theory. Also presented are some algebraic systems such as groups, rings, and fields. 2.1 ALGEBRA

More information

CLASSIFYING THE COMPLEXITY OF CONSTRAINTS USING FINITE ALGEBRAS

CLASSIFYING THE COMPLEXITY OF CONSTRAINTS USING FINITE ALGEBRAS CLASSIFYING THE COMPLEXITY OF CONSTRAINTS USING FINITE ALGEBRAS ANDREI BULATOV, PETER JEAVONS, AND ANDREI KROKHIN Abstract. Many natural combinatorial problems can be expressed as constraint satisfaction

More information

Chapter 2 - Basics Structures MATH 213. Chapter 2: Basic Structures. Dr. Eric Bancroft. Fall Dr. Eric Bancroft MATH 213 Fall / 60

Chapter 2 - Basics Structures MATH 213. Chapter 2: Basic Structures. Dr. Eric Bancroft. Fall Dr. Eric Bancroft MATH 213 Fall / 60 MATH 213 Chapter 2: Basic Structures Dr. Eric Bancroft Fall 2013 Dr. Eric Bancroft MATH 213 Fall 2013 1 / 60 Chapter 2 - Basics Structures 2.1 - Sets 2.2 - Set Operations 2.3 - Functions 2.4 - Sequences

More information

THE REAL NUMBERS Chapter #4

THE REAL NUMBERS Chapter #4 FOUNDATIONS OF ANALYSIS FALL 2008 TRUE/FALSE QUESTIONS THE REAL NUMBERS Chapter #4 (1) Every element in a field has a multiplicative inverse. (2) In a field the additive inverse of 1 is 0. (3) In a field

More information

Chapter 3. Rings. The basic commutative rings in mathematics are the integers Z, the. Examples

Chapter 3. Rings. The basic commutative rings in mathematics are the integers Z, the. Examples Chapter 3 Rings Rings are additive abelian groups with a second operation called multiplication. The connection between the two operations is provided by the distributive law. Assuming the results of Chapter

More information

Abstract Algebra II Groups ( )

Abstract Algebra II Groups ( ) Abstract Algebra II Groups ( ) Melchior Grützmann / melchiorgfreehostingcom/algebra October 15, 2012 Outline Group homomorphisms Free groups, free products, and presentations Free products ( ) Definition

More information