Rough Set Theory. Andrew Kusiak Intelligent Systems Laboratory 2139 Seamans Center The University of Iowa Iowa City, Iowa
|
|
- Edwina Miller
- 5 years ago
- Views:
Transcription
1 Rough Set Theory Andrew Kusiak 139 Seamans Center Iowa City, Iowa Iowa City Tel: Fa: Benefits Evaluation of the importance of features Reduction of redundant objects and features Determination of minimal subsets of features ensuring satisfactory classification of objects Creation of models for objects in various decision classes Results in the form close to natural language (decision rules) 1
2 Definition Information system is a 4-tuple S = U, Q, V, ρ, where U is a finite set of objects, Q is a finite set of features, V= UVq, where Vq is a domain of feature q, q Q and ρ: U Q V is a function such that ρ(, q) V for every q Q, U, called information function. q Definition The information system is a finite data table, columns of which are features, rows are objects and each entry in column q and row has a value. Each row in the table represents the information about an object in S.
3 Indiscernibility Relation Let S = U, Q, V, ρ be an information system and let P Q,, y U. We say that and y are indiscernible by the set of features P in S (notation Py ~ ) if r (, q) = r( y, q) for every q P. ~ P Equivalence classes of relation are called P-elementary sets in S. Q-elementary sets are called atoms in S. Eample Q U p Q r s
4 Eample Atoms and {p}-elementary sets in the information system from the table are as follows: Q A = {p}-elementary sets U = {3, 5, 6, 9, 1} 1 X = {1, 8} = {, 4, 7} 3 Atoms (Q-elementary sets) Z 1 ={1, 8} Z 5 ={4} Z ={, 7} Z 6 ={1} Z 3 ={3, 6} Z 4 ={5, 9} p q r s Approimation of Sets Let P Q and Y U. The P - lower approimation of Y, denoted by PY, and the P - upper approimation of Y, denoted by PY, are defined as: PY * = UX{ X P and X Y} * PY = U X{ X P andx Y } The P - boundary (P doubtful region of classification) is defined as Bn p ( Y ) = PY PY 4
5 Approimation of Sets Lower Approimation: For a given concept, its lower approimation refers to the set of observations that can all be classified into this concept. Upper Approimation: For a given concept, its upper approimation refers to the set of observations that can be possibly classified into this concept. Approimation Accuracy With every subset Y U, we can associate an accuracy of approimation of set Y by P in S, or in short, accuracy of Y, defined as card( PY ) μ p ( Y ) = card( PY ) 5
6 Eample Revisited Table 1 Q U p q r s Consider the information system of Table 1. Let Y = {1, 4, 5, 7, 9} and P = Q = {p, q, r, s}. The approimations are: QY = Z4 + Z5 = ={5, 9}+ {4} = {4, 5, 9} Q Y = Z1 + Z + Z4 + Z5 = {1,, 4, 5, 7, 8, 9} Bn Q (Y ) Z 1 ={1, 8} Z ={, 7} = Z1 + Z ={1, 8} + {, 7} and the accuracy is μ Q (Y) = 3/7 =.49 Definition The basic construct in rough set theory is called a reduct It is defined as a minimal sufficient subset of features RED A such that: Relation R(RED) = R(A), i.e., RED produces the same categorization of objects as the collection A of all features, and For any g RED, R (RED - {g})r(a), i.e., a reduct is a minimal subset of features with respect to the first property 6
7 Core Core (A) = Red(A) The intersection of all reducts of A is a core Eight Objects Eample F1 F F3 F4 D
8 Reducts and Core F1 F F3 F4 D Reducts: F1, F3, F4 CORE = Empty set Feature Classification Quality F1 F F3 F4 D CQ (F1) = 1% CQ (F3) = 1% CQ (F4) = 1% CQ (F) = % 8
9 Question What is the classification quality of a reduct? 1% by the definition Eample Object No. F1 F F3 F4 D Data set Object No. o-reduct No. F1 F F3 F4 D Minimum number of features representation (Min length rules) 9
10 Eample Object No. F1 F F3 F4 D Data set Object No. o-reduct-no. F1 F F3 F4 D ,5 3,5 8 1 Min number of rules representation Sample Decision Rules Data set F1 F F3 F Rule 1. IF (F1 = ) THEN (D = 1); [4, 1.%][, 5, 6, 8] Rule. IF (F1 = 1) THEN (D = ); [4, 1.%] [1, 3, 4, 7] 1
11 Eample Continuous feature value data set F1 F F3 F4 O Reducts and Core Continuous feature value data set After discretization F1 F F3 F4 D Reducts F1, F, F3 F, F3, F4 Core: F, F3 11
12 Decision Rules 1 F1 F F3 F4 D Rule 1. (IF F1 in [.35,.515]) THEN (D = 1); [1, 5%][6] Rule. (IF F1 in [.3,.35]) THEN (D = 1); [1, 5%][5] Rule 3. (IF F in [.96, 1.47]) THEN (D = 1); [1, 5%][8] Rule 4. (IF F4 in [.5,.5]) AND (A3 in [1,.1]) THEN (D = 1); [1, 5%][] Rule 5. (IF F1 in [.515, 1.5]) THEN (D = ); [, 5%][3,7] Rule 6. (IF F in [.1,.545]) THEN (D = ); [1, 5%][4] Rule 7. (IF F3 in [.1, 3.1]) THEN (D = ); [1, 5%][1] Decision Rules F1 F F3 F4 D Rule 1. IF (F <=.55) AND(F3 <=.1) THEN (D = 1); [3, 75%][5, 6, 8] Rule. IF (F1 >= 1.55) AND (F3 <=.75) THEN (D = 1); [1, 5%][] Rule 3. IF (F1 in [.515, 1.5]) THEN (D = ); [, 5%] [3, 7] Rule 4. IF (F3 >=.1) THEN (D = ); [3, 75%] [1, 3, 4] 1
13 Types of Rules Eact One set of conditions implies one outcome Approimate One set conditions implies more than one outcome Question Are the two rule eact or approimate? Rule 1. IF (F <=.55) AND (F3 <=.1) THEN (D = 1) Rule. IF (F1 >= 1.55) AND (F3 <=.75) THEN (D = 1) Eact! 13
14 Rule Accuracy - Coverage Relationship Coverage Accuracy Rule antecedent length Eample Eight objects, each with four features and outcome D Object No. F 1 F F 3 F 4 D
15 More about Reducts Single feature reducts for objects 1 and Object No. F 1 F F 3 F 4 D Object 1 1 Object Reduct Generation Algorithm (Based on Pawlak 1991) Step. Initialize object number i = 1. Step 1.Select object i and find a set of reducts with one feature only. If found, go to Step 3, otherwise go to Step. Step. For object i, find an reduct with m - 1 features, where m is the number of input features. This step is accomplished by deleting one feature at a time. Step 3. Set i = i + 1. If all objects have been considered, Stop; otherwise go to Step 1. 15
16 RG Algorithm The reduct generation algorithm enumerates reducts with one or m - 1 features only Considering k out of m features would result in m!/k!(m - k)! reducts Eample Object No. F 1 F F 3 F 4 O
17 All reducts for object 1 Object No. F 1 F F 3 F 4 D Reduct No F 1 F F 3 F 4 D All reducts for object Object F 1 F F 3 F 4 O Reduct F 1 F F 3 F 4 O No. No
18 Eample: Decision Table Object Condition Features Decision Features X Color Windows Pentium Ecellent Color Windows 486 Ecellent Information system: Definition S = < U, Q, V, f > Information System Components Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Information System S = < U, Q, V, f > Universe U = { 1,,..., 8 } Set of features Q = {q 1, q, q 3, q 4 } = {MONITOR, OS, CPU, d} Domain of the features V = U q Q Vq Decision function f : U Q V 18
19 Attribute Domain Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Domain of the features V = U q Q Vq Vq = {Color, Monochrome}; Vq = {DOS, Windows}; 1 Vq 3 = {386, 486, Pentium} ; Vq 4 = {Poor, Good, Ecellent}; Eample Concepts Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent X = {Inefficient PCs configuration} = {, } X = {PCs with good price/performance relationship} = {, 4 } X = {Obsolete PCs} = { 3 5, 8 } 19
20 Eample Classification Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent A*= {CPU, d} = { = { 1, 6 }, X = { }, = { 3 }, = { 4 }, = { 5 }, = { 7 }, = { 8 }} ; The following partitions of U grouped in the equivalence classes: {, X,..., } have been obtained Eample: Equivalence Class Description Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Des A ( ) = {(q 1, Color), (q, DOS), (q 3, 486), (q 4, Good)} = {(q 1 = Color), (q = DOS), (q 3 = 486), (q 4 = Good)}
21 Indiscernibility Relation 1 Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Given A = {MONITOR}, the indiscernibility relation IND (A), is determined as follows: f ( 1, q 1 ) = f (, q 1 ) = f ( 4, q 1 ) = f ( 5, q 1 ) = f ( 8, q 1 ) = {Color}; f ( 3, q 1 ) = f ( 6, q 1 ) = f ( 7, q 1 ) = {Monochrome}; The above relation generates the following equivalence classes: XThe 1 = University { 1,, of Iowa 4, 5, 8 }, X = { 3, 6, 7 } Equivalence Class Description 1 Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent The description of each equivalence class is as follows: Des A( ) = {( q 1, Color)} = {( q 1 = Color)}; Des A(X ) = {( q 1, Monochrome)} = {( q 1 = Monochrome)}; 1
22 Classification 1 Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent The family of equivalence classes {, X } partitions the objects universe into two disjoint groups: PCs having Color Monitors and PCs having Monochrome Monitors, forming the following classification U/IND (A) = A * = { = { 1,, 4, 5, 8}, X = { 3, 6, 7}}. Indiscernibility relation Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Given the feature set A = {MONITOR, CPU}, the following objects form indiscernibility relation IND (A): f {( 1, q 1 ), ( 1, q 3 )} = f {( 4, q 1 ), ( 4, q 3 )} = {Color, 486}; f {(, q 1 ), (, q 3 )} = {Color, Pentium}; f {( 3, q 1 ), ( 3, q 3 )} = f {( 7, q 1 ), ( 7, q 3 )} = {Monochrome, Pentium}; f {( 5, q 1 ), ( 5, q 3 )} = f {( 8, q 1 ), ( 8, q 3 )} = {Color, 386}; f {( 6, q 1 ), ( 6, q 3 )} = {Monochrome, 486};
23 Equivalence Class Description Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent Des A( ) = {(q 1, Color), (q 3, 486)} = {(q 1 = Color), (q 3 = 486)}; Des A(X ) = {(q 1, Color), (q 3, Pentium)} = {(q 1 = Color), (q 3 = Pentium)}; Des A( ) = {(q 1, Monochrome), (q 3, Pentium)} = {(q 1 = Monochrome), (q 3 = Pentium)}; Des A( ) = {(q 1, Color), (q 3, 386)} = {(q 1 = Color), (q 3 = 386)}; Des A( ) = {(q 1, Monochrome), (q 3, 486)} = {(q 1 = Monochrome), (q 3 = 486)}; Classification Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent The family of equivalence classes {, X,,, } partitions the objects universe into five disjoint groups, for the considered feature set A = {MONITOR, CPU}: {Color, 486}, {Color, Pentium}, {Monochrome, Pentium}, {Color, 386 }and {Monochrome, 486}, forming the following classification U/IND(A) = A * = { = { 1, 4}, X = { }, = { 3, 7}, = { 5, 8}, = { 6}}. 3
24 Approimations: Eample 1 Object Condition Features Decision X Color Windows Pentium Ecellent Color Windows 486 Ecellent For the set of features A = {MONITOR}, and objects X = { 1,, 3, 4 } determine A-lower, A-upper approimations and A-boundary region Eample 1 A = {MONITOR} X = { 1,, 3, 4 } The following equivalence classes are defined for the set of features A = {MONITOR}: [ 1 ] A = { 1,, 4, 5, 8 }, [ ] A = { 3, 6, 7 }. The A-lower approimation is given by: AX = { U: [] A X}, the A-upper approimation is given by: À X = { U: [] A X } and the A-boundary region is given by: BN A (X) = À X - AX, then: Union A-lower approimation = AX = (empty set). A-upper approimation = À X = [ 1 ] A [ ] A = { 1,, 3, 4, 5, 6, 7, 8 } = U. A-boundaryregion = BN A (X) = U - = U. 4
25 Eample 1 X = { 1,, 3, 4 } Object Condition Features Decision Attribute X Color Windows Pentium Ecellent Color Windows 486 Ecellent Card (AX) = Card BNA(X) = 8 - = 8 Card (AX) = 8 Accuracy μq (X) = /8 = Eample Object Condition Features Decision Attribute X Color Windows Pentium Ecellent Color Windows 486 Ecellent For the set of features A = {MONITOR, OS}, and objects X = { 1,, 3, 6 } determine A-lower, A-upper approimations and A-boundary region 5
26 AX = { U: [] A X} À X = { U: [] A X } Eample A = {MONITOR, OS}, X = { 1,, 3, 6 } The following equivalence classes are determined for this particular set of features A: [ 1 ] A = { 1, 5 }, [ ] A = {, 4, 8 }, [ 3 ] A = { 3 }, [ 4 ] A = { 6, 7 }, then: A-lower approimation = AX = { 3 }; A-upper approimation = À X = [ 1 ] A [ ] A [ 3 ] A [ 4 ] A = { 1,, 3, 4, 5, 6, 7, 8 } = U. A-boundaryregion = BN A (X ) = U -{ 3 } = { 1,, 4, 5, 6, 7, 8 }. L Appro Eample Object Condition Features Decision Attribute X Color Windows Pentium Ecellent Color Windows 486 Ecellent Card (AX) = 1 Card BNA(X) = 8-1 = 7 Card (AX) = 8 Accuracy μq (X) = 1/8 =.15 6
27 Eample 3 Object Condition Features Decision Attribute X Color Windows Pentium Ecellent Color Windows 486 Ecellent For the set of features A= {MONITOR, OS, CPU}, and objects X = { 1,, 4, 6 } A-lower, A-upper approimation and A-boundary region AX = { U: [] A X} Eample 3 À X = { U: [] A X A = {MONITOR, OS, CPU}, X = { 1,, 4, 6 }. The following equivalence classes are determined for this particular set of features A: [1]A = {1}, []A = {}, [3]A = {3}, [4]A = {4}, [5]A = {5}, [6]A = {6}, [7]A = {7}, [8]A = {8} so: A-lower approimation = AX = {1,, 4, 6} A-upper approimation = À X = [ 1]A []A [4]A [6]A = { 1,, 4, 6} A-boundary region = BNA(X) = {1,, 4, 6} - {1,, 4, 6} =. 7
28 Eample 3 L Appro Object Condition Features Decision Attribute X Color Windows Pentium Ecellent Color Windows 486 Ecellent Card (AX) = 4 Card BNA(X) = 4-4 = Card (AX) = 4 Accuracy μq (X) = 4/4 = 1 Classification Accuracy Revisited Accuracy μa (X) = Card (AX) Card (AX) Given the set of objects X = {X1, X, X4, X6} and the subset of features A = {Monitor, OS, CPU} The accuracy of approimation of set X by the set of features A is μa (X) = 4/4 = 1 (for short the accuracy of X) ρa (X) = 1 - μa (X) is called the A-roughness of the set A (A-roughness for short) 8
29 U Q Eample c1 c d Classification Accuracy Consider equivalence classes created on basis of (c1, c) The A ={c1, c}-elementary sets are as follows: { Q 1, }, { 3, 4 }, { 5 }, { 6 }, { 7, 8 }, { 9, 1 }. U Set of objects { 3, 5, 6, 8 } X = with d = 1 AX = { 5 } { 6 } AX={ 5 } { 6 } { 3, 4 } { 7, 8 } μa( X)= /6 =.33 c 1 c d
30 Classification Quality Classification Quality = Lower approimation/ Number of eamples in a given decision class Entire Data Set Classification accuracy = Number of objects in all lower approimations / Number of objects in all upper approimations Classification quality = Number of objects in all lower approimations/ Number of all objects in the data set 3
31 Quality Loss Assume the set of features P = {a, b, c}, and Feature a is removed from P Quality Loss = Classification Quality (P) - Classification Quality (P -{ a }) Quality Gain Assume the set of features P = {a, b, c}, and Feature d is added to P Quality Gain = Classification Quality (P + {d }) - Classification Quality (P) 31
Outline. Introduction, or what is fuzzy thinking? Fuzzy sets Linguistic variables and hedges Operations of fuzzy sets Fuzzy rules Summary.
Fuzzy Logic Part ndrew Kusiak Intelligent Systems Laboratory 239 Seamans Center The University of Iowa Iowa City, Iowa 52242-527 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak Tel: 39-335
More informationData Mining. Preamble: Control Application. Industrial Researcher s Approach. Practitioner s Approach. Example. Example. Goal: Maintain T ~Td
Data Mining Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Preamble: Control Application Goal: Maintain T ~Td Tel: 319-335 5934 Fax: 319-335 5669 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak
More informationA new Approach to Drawing Conclusions from Data A Rough Set Perspective
Motto: Let the data speak for themselves R.A. Fisher A new Approach to Drawing Conclusions from Data A Rough et Perspective Zdzisław Pawlak Institute for Theoretical and Applied Informatics Polish Academy
More informationDrawing Conclusions from Data The Rough Set Way
Drawing Conclusions from Data The Rough et Way Zdzisław Pawlak Institute of Theoretical and Applied Informatics, Polish Academy of ciences, ul Bałtycka 5, 44 000 Gliwice, Poland In the rough set theory
More informationThe University of Iowa Intelligent Systems Laboratory The University of Iowa. f1 f2 f k-1 f k,f k+1 f m-1 f m f m- 1 D. Data set 1 Data set 2
Decomposition in Data Mining Basic Approaches Andrew Kusiak 4312 Seamans Center Iowa City, Iowa 52242 1527 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak Direct mining of data sets Mining
More informationAn algorithm for induction of decision rules consistent with the dominance principle
An algorithm for induction of decision rules consistent with the dominance principle Salvatore Greco 1, Benedetto Matarazzo 1, Roman Slowinski 2, Jerzy Stefanowski 2 1 Faculty of Economics, University
More informationCMPSCI 240: Reasoning about Uncertainty
CMPSCI 240: Reasoning about Uncertainty Lecture 2: Sets and Events Andrew McGregor University of Massachusetts Last Compiled: January 27, 2017 Outline 1 Recap 2 Experiments and Events 3 Probabilistic Models
More information1.4 Outer measures 10 CHAPTER 1. MEASURE
10 CHAPTER 1. MEASURE 1.3.6. ( Almost everywhere and null sets If (X, A, µ is a measure space, then a set in A is called a null set (or µ-null if its measure is 0. Clearly a countable union of null sets
More informationHence C has VC-dimension d iff. π C (d) = 2 d. (4) C has VC-density l if there exists K R such that, for all
1. Computational Learning Abstract. I discuss the basics of computational learning theory, including concept classes, VC-dimension, and VC-density. Next, I touch on the VC-Theorem, ɛ-nets, and the (p,
More informationNotes on Discriminant Functions and Optimal Classification
Notes on Discriminant Functions and Optimal Classification Padhraic Smyth, Department of Computer Science University of California, Irvine c 2017 1 Discriminant Functions Consider a classification problem
More informationEcon 6900: Statistical Problems. Instructor: Yogesh Uppal
Econ 6900: Statistical Problems Instructor: Yogesh Uppal Email: yuppal@ysu.edu Chapter 7, Part A Sampling and Sampling Distributions Simple Random Sampling Point Estimation Introduction to Sampling Distributions
More informationOn Rough Set Modelling for Data Mining
On Rough Set Modelling for Data Mining V S Jeyalakshmi, Centre for Information Technology and Engineering, M. S. University, Abhisekapatti. Email: vsjeyalakshmi@yahoo.com G Ariprasad 2, Fatima Michael
More informationData mining using Rough Sets
Data mining using Rough Sets Alber Sánchez 1 alber.ipia@inpe.br 1 Instituto Nacional de Pesquisas Espaciais, São José dos Campos, SP, Brazil Referata Geoinformatica, 2015 1 / 44 Table of Contents Rough
More information1 Chapter 1: SETS. 1.1 Describing a set
1 Chapter 1: SETS set is a collection of objects The objects of the set are called elements or members Use capital letters :, B, C, S, X, Y to denote the sets Use lower case letters to denote the elements:
More informationHierarchical Structures on Multigranulation Spaces
Yang XB, Qian YH, Yang JY. Hierarchical structures on multigranulation spaces. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY 27(6): 1169 1183 Nov. 2012. DOI 10.1007/s11390-012-1294-0 Hierarchical Structures
More informationREDUCTS AND ROUGH SET ANALYSIS
REDUCTS AND ROUGH SET ANALYSIS A THESIS SUBMITTED TO THE FACULTY OF GRADUATE STUDIES AND RESEARCH IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE IN COMPUTER SCIENCE UNIVERSITY
More informationAny Wizard of Oz fans? Discrete Math Basics. Outline. Sets. Set Operations. Sets. Dorothy: How does one get to the Emerald City?
Any Wizard of Oz fans? Discrete Math Basics Dorothy: How does one get to the Emerald City? Glynda: It is always best to start at the beginning Outline Sets Relations Proofs Sets A set is a collection of
More informationProbabilistic Systems Analysis Spring 2018 Lecture 6. Random Variables: Probability Mass Function and Expectation
EE 178 Probabilistic Systems Analysis Spring 2018 Lecture 6 Random Variables: Probability Mass Function and Expectation Probability Mass Function When we introduce the basic probability model in Note 1,
More informationRough Set Theory Fundamental Assumption Approximation Space Information Systems Decision Tables (Data Tables)
Rough Set Theory Fundamental Assumption Objects from the domain are perceived only through the values of attributes that can be evaluated on these objects. Objects with the same information are indiscernible.
More informationSection 2: Classes of Sets
Section 2: Classes of Sets Notation: If A, B are subsets of X, then A \ B denotes the set difference, A \ B = {x A : x B}. A B denotes the symmetric difference. A B = (A \ B) (B \ A) = (A B) \ (A B). Remarks
More informationFuzzy and Rough Sets Part I
Fuzzy and Rough Sets Part I Decision Systems Group Brigham and Women s Hospital, Harvard Medical School Harvard-MIT Division of Health Sciences and Technology Aim Present aspects of fuzzy and rough sets.
More informationBanacha Warszawa Poland s:
Chapter 12 Rough Sets and Rough Logic: A KDD Perspective Zdzis law Pawlak 1, Lech Polkowski 2, and Andrzej Skowron 3 1 Institute of Theoretical and Applied Informatics Polish Academy of Sciences Ba ltycka
More informationNotes for Math 324, Part 12
72 Notes for Math 324, Part 12 Chapter 12 Definition and main properties of probability 12.1 Sample space, events We run an experiment which can have several outcomes. The set consisting by all possible
More informationSolving Systems of Linear Equations
LECTURE 5 Solving Systems of Linear Equations Recall that we introduced the notion of matrices as a way of standardizing the expression of systems of linear equations In today s lecture I shall show how
More informationROUGH SETS THEORY AND DATA REDUCTION IN INFORMATION SYSTEMS AND DATA MINING
ROUGH SETS THEORY AND DATA REDUCTION IN INFORMATION SYSTEMS AND DATA MINING Mofreh Hogo, Miroslav Šnorek CTU in Prague, Departement Of Computer Sciences And Engineering Karlovo Náměstí 13, 121 35 Prague
More information2.1 Sets. Definition 1 A set is an unordered collection of objects. Important sets: N, Z, Z +, Q, R.
2. Basic Structures 2.1 Sets Definition 1 A set is an unordered collection of objects. Important sets: N, Z, Z +, Q, R. Definition 2 Objects in a set are called elements or members of the set. A set is
More informationRough Sets, Rough Relations and Rough Functions. Zdzislaw Pawlak. Warsaw University of Technology. ul. Nowowiejska 15/19, Warsaw, Poland.
Rough Sets, Rough Relations and Rough Functions Zdzislaw Pawlak Institute of Computer Science Warsaw University of Technology ul. Nowowiejska 15/19, 00 665 Warsaw, Poland and Institute of Theoretical and
More informationClassification Based on Logical Concept Analysis
Classification Based on Logical Concept Analysis Yan Zhao and Yiyu Yao Department of Computer Science, University of Regina, Regina, Saskatchewan, Canada S4S 0A2 E-mail: {yanzhao, yyao}@cs.uregina.ca Abstract.
More informationThe Scott Isomorphism Theorem
The Scott Isomorphism Theorem Julia F. Knight University of Notre Dame Outline 1. L ω1 ω formulas 2. Computable infinitary formulas 3. Scott sentences 4. Scott rank, result of Montalbán 5. Scott ranks
More informationAPPLICATION FOR LOGICAL EXPRESSION PROCESSING
APPLICATION FOR LOGICAL EXPRESSION PROCESSING Marcin Michalak, Michał Dubiel, Jolanta Urbanek Institute of Informatics, Silesian University of Technology, Gliwice, Poland Marcin.Michalak@polsl.pl ABSTRACT
More informationGeneral Scheduling Model and
General Scheduling Model and Algorithm Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Tel: 319-335 5934 Fax: 319-335 5669 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak MANUFACTURING
More information9/19/2018. Cartesian Product. Cartesian Product. Partitions
Cartesian Product The ordered n-tuple (a 1, a 2, a 3,, a n ) is an ordered collection of objects. Two ordered n-tuples (a 1, a 2, a 3,, a n ) and (b 1, b 2, b 3,, b n ) are equal if and only if they contain
More informationResearch Article Special Approach to Near Set Theory
Mathematical Problems in Engineering Volume 2011, Article ID 168501, 10 pages doi:10.1155/2011/168501 Research Article Special Approach to Near Set Theory M. E. Abd El-Monsef, 1 H. M. Abu-Donia, 2 and
More informationProperties of Probability
Econ 325 Notes on Probability 1 By Hiro Kasahara Properties of Probability In statistics, we consider random experiments, experiments for which the outcome is random, i.e., cannot be predicted with certainty.
More informationNEAR GROUPS ON NEARNESS APPROXIMATION SPACES
Hacettepe Journal of Mathematics and Statistics Volume 414) 2012), 545 558 NEAR GROUPS ON NEARNESS APPROXIMATION SPACES Ebubekir İnan and Mehmet Ali Öztürk Received 26:08:2011 : Accepted 29:11:2011 Abstract
More informationMathematical Approach to Vagueness
International Mathematical Forum, 2, 2007, no. 33, 1617-1623 Mathematical Approach to Vagueness Angel Garrido Departamento de Matematicas Fundamentales Facultad de Ciencias de la UNED Senda del Rey, 9,
More informationProbability. 25 th September lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.)
Probability 25 th September 2017 lecture based on Hogg Tanis Zimmerman: Probability and Statistical Inference (9th ed.) Properties of Probability Methods of Enumeration Conditional Probability Independent
More informationStatistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006
Statistics for Financial Engineering Session 2: Basic Set Theory March 19 th, 2006 Topics What is a set? Notations for sets Empty set Inclusion/containment and subsets Sample spaces and events Operations
More informationARPN Journal of Science and Technology All rights reserved.
Rule Induction Based On Boundary Region Partition Reduction with Stards Comparisons Du Weifeng Min Xiao School of Mathematics Physics Information Engineering Jiaxing University Jiaxing 34 China ABSTRACT
More informationA Well-Balanced Menu Planning with Fuzzy Weight
A Well-Balanced Menu Planning with Fuzzy Weight Tomoo Kashima, Shimpei Matsumoto and Hiroai Ishii Abstract For lifestyle-related disease caused by recent change of eating habits in Japan, this paper proposes
More informationAndrzej Skowron, Zbigniew Suraj (Eds.) To the Memory of Professor Zdzisław Pawlak
Andrzej Skowron, Zbigniew Suraj (Eds.) ROUGH SETS AND INTELLIGENT SYSTEMS To the Memory of Professor Zdzisław Pawlak Vol. 1 SPIN Springer s internal project number, if known Springer Berlin Heidelberg
More informationLecture 1. Chapter 1. (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 ( ). 1. What is Statistics?
Lecture 1 (Part I) Material Covered in This Lecture: Chapter 1, Chapter 2 (2.1 --- 2.6). Chapter 1 1. What is Statistics? 2. Two definitions. (1). Population (2). Sample 3. The objective of statistics.
More informationEasy Categorization of Attributes in Decision Tables Based on Basic Binary Discernibility Matrix
Easy Categorization of Attributes in Decision Tables Based on Basic Binary Discernibility Matrix Manuel S. Lazo-Cortés 1, José Francisco Martínez-Trinidad 1, Jesús Ariel Carrasco-Ochoa 1, and Guillermo
More informationData Analysis - the Rough Sets Perspective
Data Analysis - the Rough ets Perspective Zdzisław Pawlak Institute of Computer cience Warsaw University of Technology 00-665 Warsaw, Nowowiejska 15/19 Abstract: Rough set theory is a new mathematical
More informationcse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska
cse303 ELEMENTS OF THE THEORY OF COMPUTATION Professor Anita Wasilewska LECTURE 1 Course Web Page www3.cs.stonybrook.edu/ cse303 The webpage contains: lectures notes slides; very detailed solutions to
More informationFundamentals of Probability CE 311S
Fundamentals of Probability CE 311S OUTLINE Review Elementary set theory Probability fundamentals: outcomes, sample spaces, events Outline ELEMENTARY SET THEORY Basic probability concepts can be cast in
More informationIntroduction to Decision Sciences Lecture 11
Introduction to Decision Sciences Lecture 11 Andrew Nobel October 24, 2017 Basics of Counting Product Rule Product Rule: Suppose that the elements of a collection S can be specified by a sequence of k
More informationAxioms of Probability. Set Theory. M. Bremer. Math Spring 2018
Math 163 - pring 2018 Axioms of Probability Definition: The set of all possible outcomes of an experiment is called the sample space. The possible outcomes themselves are called elementary events. Any
More informationLearning Rules from Very Large Databases Using Rough Multisets
Learning Rules from Very Large Databases Using Rough Multisets Chien-Chung Chan Department of Computer Science University of Akron Akron, OH 44325-4003 chan@cs.uakron.edu Abstract. This paper presents
More informationRough Sets and Conflict Analysis
Rough Sets and Conflict Analysis Zdzis law Pawlak and Andrzej Skowron 1 Institute of Mathematics, Warsaw University Banacha 2, 02-097 Warsaw, Poland skowron@mimuw.edu.pl Commemorating the life and work
More informationApplication of Rough Set Theory in Performance Analysis
Australian Journal of Basic and Applied Sciences, 6(): 158-16, 1 SSN 1991-818 Application of Rough Set Theory in erformance Analysis 1 Mahnaz Mirbolouki, Mohammad Hassan Behzadi, 1 Leila Karamali 1 Department
More informationEXACT EQUATIONS AND INTEGRATING FACTORS
MAP- EXACT EQUATIONS AND INTEGRATING FACTORS First-order Differential Equations for Which We Can Find Eact Solutions Stu the patterns carefully. The first step of any solution is correct identification
More informationSection 1.1: Systems of Linear Equations
Section 1.1: Systems of Linear Equations Two Linear Equations in Two Unknowns Recall that the equation of a line in 2D can be written in standard form: a 1 x 1 + a 2 x 2 = b. Definition. A 2 2 system of
More informationFoundations of Classification
Foundations of Classification J. T. Yao Y. Y. Yao and Y. Zhao Department of Computer Science, University of Regina Regina, Saskatchewan, Canada S4S 0A2 {jtyao, yyao, yanzhao}@cs.uregina.ca Summary. Classification
More informationLECTURE 1. 1 Introduction. 1.1 Sample spaces and events
LECTURE 1 1 Introduction The first part of our adventure is a highly selective review of probability theory, focusing especially on things that are most useful in statistics. 1.1 Sample spaces and events
More informationQualifying Exam Logic August 2005
Instructions: Qualifying Exam Logic August 2005 If you signed up for Computability Theory, do two E and two C problems. If you signed up for Model Theory, do two E and two M problems. If you signed up
More informationProbability Review I
Probability Review I Harvard Math Camp - Econometrics Ashesh Rambachan Summer 2018 Outline Random Experiments The sample space and events σ-algebra and measures Basic probability rules Conditional Probability
More informationECE353: Probability and Random Processes. Lecture 2 - Set Theory
ECE353: Probability and Random Processes Lecture 2 - Set Theory Xiao Fu School of Electrical Engineering and Computer Science Oregon State University E-mail: xiao.fu@oregonstate.edu January 10, 2018 Set
More informationA Rough Set Interpretation of User s Web Behavior: A Comparison with Information Theoretic Measure
A Rough et Interpretation of User s Web Behavior: A Comparison with Information Theoretic easure George V. eghabghab Roane tate Dept of Computer cience Technology Oak Ridge, TN, 37830 gmeghab@hotmail.com
More informationClassification of Voice Signals through Mining Unique Episodes in Temporal Information Systems: A Rough Set Approach
Classification of Voice Signals through Mining Unique Episodes in Temporal Information Systems: A Rough Set Approach Krzysztof Pancerz, Wies law Paja, Mariusz Wrzesień, and Jan Warcho l 1 University of
More informationMATH 225 Summer 2005 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 2005
MATH 225 Summer 25 Linear Algebra II Solutions to Assignment 1 Due: Wednesday July 13, 25 Department of Mathematical and Statistical Sciences University of Alberta Question 1. [p 224. #2] The set of all
More informationAMS regional meeting Bloomington, IN April 1, 2017
Joint work with: W. Boney, S. Friedman, C. Laskowski, M. Koerwien, S. Shelah, I. Souldatos University of Illinois at Chicago AMS regional meeting Bloomington, IN April 1, 2017 Cantor s Middle Attic Uncountable
More informationAutomata and Languages
Automata and Languages Prof. Mohamed Hamada Software Engineering Lab. The University of Aizu Japan Mathematical Background Mathematical Background Sets Relations Functions Graphs Proof techniques Sets
More informationInstance Selection. Motivation. Sample Selection (1) Sample Selection (2) Sample Selection (3) Sample Size (1)
Instance Selection Andrew Kusiak 2139 Seamans Center Iowa City, Iowa 52242-1527 Motivation The need for preprocessing of data for effective data mining is important. Tel: 319-335 5934 Fax: 319-335 5669
More informationIsomorphisms between pattern classes
Journal of Combinatorics olume 0, Number 0, 1 8, 0000 Isomorphisms between pattern classes M. H. Albert, M. D. Atkinson and Anders Claesson Isomorphisms φ : A B between pattern classes are considered.
More informationChapter 2 Rough Set Theory
Chapter 2 Rough Set Theory Abstract This chapter describes the foundations for rough set theory. We outline Pawlak s motivating idea and give a technical exposition. Basics of Pawlak s rough set theory
More informationStatistics for Linguists. Don t pannic
Statistics for Linguists Don t pannic Basic Statistics The main reason that statistics has grown as popular as it has is something that is known as The stability of the relative frequency. This is the
More information3 Hausdorff and Connected Spaces
3 Hausdorff and Connected Spaces In this chapter we address the question of when two spaces are homeomorphic. This is done by examining two properties that are shared by any pair of homeomorphic spaces.
More informationA Logical Formulation of the Granular Data Model
2008 IEEE International Conference on Data Mining Workshops A Logical Formulation of the Granular Data Model Tuan-Fang Fan Department of Computer Science and Information Engineering National Penghu University
More informationSome remarks on conflict analysis
European Journal of Operational Research 166 (2005) 649 654 www.elsevier.com/locate/dsw Some remarks on conflict analysis Zdzisław Pawlak Warsaw School of Information Technology, ul. Newelska 6, 01 447
More informationDeep Learning for Computer Vision
Deep Learning for Computer Vision Lecture 3: Probability, Bayes Theorem, and Bayes Classification Peter Belhumeur Computer Science Columbia University Probability Should you play this game? Game: A fair
More informationLecture 8: Probability
Lecture 8: Probability The idea of probability is well-known The flipping of a balanced coin can produce one of two outcomes: T (tail) and H (head) and the symmetry between the two outcomes means, of course,
More informationContent. Learning. Regression vs Classification. Regression a.k.a. function approximation and Classification a.k.a. pattern recognition
Content Andrew Kusiak Intelligent Systems Laboratory 239 Seamans Center The University of Iowa Iowa City, IA 52242-527 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak Introduction to learning
More informationContent. Learning Goal. Regression vs Classification. Support Vector Machines. SVM Context
Content Andrew Kusiak 39 Seamans Center Iowa City, IA 5-57 andrew-kusiak@uiowa.edu http://www.icaen.uiowa.edu/~ankusiak (Based on the material provided by Professor. Kecman) Introduction to learning from
More informationMachine Learning. Probability Theory. WS2013/2014 Dmitrij Schlesinger, Carsten Rother
Machine Learning Probability Theory WS2013/2014 Dmitrij Schlesinger, Carsten Rother Probability space is a three-tuple (Ω, σ, P) with: Ω the set of elementary events σ algebra P probability measure σ-algebra
More informationDecision tables and decision spaces
Abstract Decision tables and decision spaces Z. Pawlak 1 Abstract. In this paper an Euclidean space, called a decision space is associated with ever decision table. This can be viewed as a generalization
More informationDRAFT CONCEPTUAL SOLUTION REPORT DRAFT
BASIC STRUCTURAL MODELING PROJECT Joseph J. Simpson Mary J. Simpson 08-12-2013 DRAFT CONCEPTUAL SOLUTION REPORT DRAFT Version 0.11 Page 1 of 18 Table of Contents Introduction Conceptual Solution Context
More information1 Introduction. Σ 0 1 and Π 0 1 equivalence structures
Σ 0 1 and Π 0 1 equivalence structures Douglas Cenzer, Department of Mathematics University of Florida, Gainesville, FL 32611 email: cenzer@math.ufl.edu Valentina Harizanov, Department of Mathematics George
More informationChapter 4. Probability-The Study of Randomness
Chapter 4. Probability-The Study of Randomness 4.1.Randomness Random: A phenomenon- individual outcomes are uncertain but there is nonetheless a regular distribution of outcomes in a large number of repetitions.
More informationBulletin of the Transilvania University of Braşov Vol 10(59), No Series III: Mathematics, Informatics, Physics, 67-82
Bulletin of the Transilvania University of Braşov Vol 10(59), No. 1-2017 Series III: Mathematics, Informatics, Physics, 67-82 IDEALS OF A COMMUTATIVE ROUGH SEMIRING V. M. CHANDRASEKARAN 3, A. MANIMARAN
More informationSection Partitioned Matrices and LU Factorization
Section 2.4 2.5 Partitioned Matrices and LU Factorization Gexin Yu gyu@wm.edu College of William and Mary partition matrices into blocks In real world problems, systems can have huge numbers of equations
More informationTree Decompositions and Tree-Width
Tree Decompositions and Tree-Width CS 511 Iowa State University December 6, 2010 CS 511 (Iowa State University) Tree Decompositions and Tree-Width December 6, 2010 1 / 15 Tree Decompositions Definition
More informationIndex. Cambridge University Press Relational Knowledge Discovery M E Müller. Index. More information
s/r. See quotient, 93 R, 122 [x] R. See class, equivalence [[P Q]]s, 142 =, 173, 164 A α, 162, 178, 179 =, 163, 193 σ RES, 166, 22, 174 Ɣ, 178, 179, 175, 176, 179 i, 191, 172, 21, 26, 29 χ R. See rough
More informationSemantic Rendering of Data Tables: Multivalued Information Systems Revisited
Semantic Rendering of Data Tables: Multivalued Information Systems Revisited Marcin Wolski 1 and Anna Gomolińska 2 1 Maria Curie-Skłodowska University, Department of Logic and Cognitive Science, Pl. Marii
More informationMining Approximative Descriptions of Sets Using Rough Sets
Mining Approximative Descriptions of Sets Using Rough Sets Dan A. Simovici University of Massachusetts Boston, Dept. of Computer Science, 100 Morrissey Blvd. Boston, Massachusetts, 02125 USA dsim@cs.umb.edu
More informationPermutation groups/1. 1 Automorphism groups, permutation groups, abstract
Permutation groups Whatever you have to do with a structure-endowed entity Σ try to determine its group of automorphisms... You can expect to gain a deep insight into the constitution of Σ in this way.
More informationFinal Exam, Machine Learning, Spring 2009
Name: Andrew ID: Final Exam, 10701 Machine Learning, Spring 2009 - The exam is open-book, open-notes, no electronics other than calculators. - The maximum possible score on this exam is 100. You have 3
More informationAlgebra 2 Mississippi College- and Career- Readiness Standards for Mathematics RCSD Unit 1 Data Relationships 1st Nine Weeks
1 st Nine Weeks Algebra 2 Mississippi College- and Career- Readiness Standards for Mathematics Unit 1 Data Relationships Level 4: I can interpret key features of graphs and tables in terms of the quantities.
More informationReview CHAPTER. 2.1 Definitions in Chapter Sample Exam Questions. 2.1 Set; Element; Member; Universal Set Partition. 2.
CHAPTER 2 Review 2.1 Definitions in Chapter 2 2.1 Set; Element; Member; Universal Set 2.2 Subset 2.3 Proper Subset 2.4 The Empty Set, 2.5 Set Equality 2.6 Cardinality; Infinite Set 2.7 Complement 2.8 Intersection
More informationA B is shaded A B A B
NION: Let and be subsets of a universal set. The union of sets and is the set of all elements in that belong to or to or to both, and is denoted. Symbolically: = {x x or x } EMMPLE: Let = {a, b, c, d,
More informationStat 225 Week 1, 8/20/12-8/24/12, Notes: Set Theory
Stat 225 Week 1, 8/20/12-8/24/12, Notes: Set Theory The Fall 2012 Stat 225 T.A.s September 7, 2012 The material in this handout is intended to cover general set theory topics. Information includes (but
More informationRelations. Relations of Sets N-ary Relations Relational Databases Binary Relation Properties Equivalence Relations. Reading (Epp s textbook)
Relations Relations of Sets N-ary Relations Relational Databases Binary Relation Properties Equivalence Relations Reading (Epp s textbook) 8.-8.3. Cartesian Products The symbol (a, b) denotes the ordered
More informationRecap. The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY INFERENTIAL STATISTICS
Recap. Probability (section 1.1) The study of randomness and uncertainty Chances, odds, likelihood, expected, probably, on average,... PROBABILITY Population Sample INFERENTIAL STATISTICS Today. Formulation
More informationPOISSON RANDOM VARIABLES
POISSON RANDOM VARIABLES Suppose a random phenomenon occurs with a mean rate of occurrences or happenings per unit of time or length or area or volume, etc. Note: >. Eamples: 1. Cars passing through an
More informationElementary maths for GMT
Elementary maths for GMT Linear Algebra Part 2: Matrices, Elimination and Determinant m n matrices The system of m linear equations in n variables x 1, x 2,, x n a 11 x 1 + a 12 x 2 + + a 1n x n = b 1
More informationSets and Functions. MATH 464/506, Real Analysis. J. Robert Buchanan. Summer Department of Mathematics. J. Robert Buchanan Sets and Functions
Sets and Functions MATH 464/506, Real Analysis J. Robert Buchanan Department of Mathematics Summer 2007 Notation x A means that element x is a member of set A. x / A means that x is not a member of A.
More information7 RC Simulates RA. Lemma: For every RA expression E(A 1... A k ) there exists a DRC formula F with F V (F ) = {A 1,..., A k } and
7 RC Simulates RA. We now show that DRC (and hence TRC) is at least as expressive as RA. That is, given an RA expression E that mentions at most C, there is an equivalent DRC expression E that mentions
More informationFARMER: Finding Interesting Rule Groups in Microarray Datasets
FARMER: Finding Interesting Rule Groups in Microarray Datasets Gao Cong, Anthony K. H. Tung, Xin Xu, Feng Pan Dept. of Computer Science Natl. University of Singapore {conggao,atung,xuxin,panfeng}@comp.nus.edu.sg
More informationLecture Lecture 5
Lecture 4 --- Lecture 5 A. Basic Concepts (4.1-4.2) 1. Experiment: A process of observing a phenomenon that has variation in its outcome. Examples: (E1). Rolling a die, (E2). Drawing a card form a shuffled
More informationDatabases 2011 The Relational Algebra
Databases 2011 Christian S. Jensen Computer Science, Aarhus University What is an Algebra? An algebra consists of values operators rules Closure: operations yield values Examples integers with +,, sets
More information