MULTIDIMENSIONAL HETEROGENEOUS VARIABLE PREDICTION BASED ON EXPERTS STATEMENTS. Gennadiy Lbov, Maxim Gerasimov

Similar documents
CHAPTER VI Statistical Analysis of Experimental Data

Generalization of the Dissimilarity Measure of Fuzzy Sets

Summary of the lecture in Biostatistics

PROJECTION PROBLEM FOR REGULAR POLYGONS

Econometric Methods. Review of Estimation

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

Assignment 5/MATH 247/Winter Due: Friday, February 19 in class (!) (answers will be posted right after class)

Functions of Random Variables

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Non-uniform Turán-type problems

Chapter 11 The Analysis of Variance

Unsupervised Learning and Other Neural Networks

Lecture 9: Tolerant Testing

MATH 247/Winter Notes on the adjoint and on normal operators.

Ideal multigrades with trigonometric coefficients

A Study of the Reproducibility of Measurements with HUR Leg Extension/Curl Research Line

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Rademacher Complexity. Examples

TESTS BASED ON MAXIMUM LIKELIHOOD

Dr. Shalabh Department of Mathematics and Statistics Indian Institute of Technology Kanpur

2. Independence and Bernoulli Trials

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

1 Onto functions and bijections Applications to Counting

DKA method for single variable holomorphic functions

Analysis of Lagrange Interpolation Formula

On Fuzzy Arithmetic, Possibility Theory and Theory of Evidence

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Analyzing Fuzzy System Reliability Using Vague Set Theory

Some Notes on the Probability Space of Statistical Surveys

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Chapter 11 Systematic Sampling

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance

Third handout: On the Gini Index

Chapter 5 Properties of a Random Sample

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

MMJ 1113 FINITE ELEMENT METHOD Introduction to PART I

Point Estimation: definition of estimators

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

Machine Learning. knowledge acquisition skill refinement. Relation between machine learning and data mining. P. Berka, /18

Chapter 2 - Free Vibration of Multi-Degree-of-Freedom Systems - II

Galois and Post Algebras of Compositions (Superpositions)

Entropy ISSN by MDPI

ESS Line Fitting

18.413: Error Correcting Codes Lab March 2, Lecture 8

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

(b) By independence, the probability that the string 1011 is received correctly is

PROPERTIES OF GOOD ESTIMATORS

The Mathematical Appendix

STA302/1001-Fall 2008 Midterm Test October 21, 2008

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory

COMPROMISE HYPERSPHERE FOR STOCHASTIC DOMINANCE MODEL

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

A tighter lower bound on the circuit size of the hardest Boolean functions

Q-analogue of a Linear Transformation Preserving Log-concavity

Simulation Output Analysis

NP!= P. By Liu Ran. Table of Contents. The P versus NP problem is a major unsolved problem in computer

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

4 Inner Product Spaces

PTAS for Bin-Packing

STK4011 and STK9011 Autumn 2016

arxiv:math/ v1 [math.gm] 8 Dec 2005

An Introduction to. Support Vector Machine

1 Lyapunov Stability Theory

Arithmetic Mean and Geometric Mean

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study

An Indian Journal FULL PAPER ABSTRACT KEYWORDS. Trade Science Inc. Research on scheme evaluation method of automation mechatronic systems

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

On the Interval Zoro Symmetric Single Step. Procedure IZSS1-5D for the Simultaneous. Bounding of Real Polynomial Zeros

To use adaptive cluster sampling we must first make some definitions of the sampling universe:

Multiple Linear Regression Analysis

Simple Linear Regression

The Primitive Idempotents in

Lecture 3 Probability review (cont d)

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods

About a Fuzzy Distance between Two Fuzzy Partitions and Application in Attribute Reduction Problem

AN UPPER BOUND FOR THE PERMANENT VERSUS DETERMINANT PROBLEM BRUNO GRENET

Lebesgue Measure of Generalized Cantor Set

A Markov Chain Competition Model

Introduction to local (nonparametric) density estimation. methods

X ε ) = 0, or equivalently, lim

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Solving Interval and Fuzzy Multi Objective. Linear Programming Problem. by Necessarily Efficiency Points

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

f f... f 1 n n (ii) Median : It is the value of the middle-most observation(s).

Lecture 8: Linear Regression

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

A Remark on the Uniform Convergence of Some Sequences of Functions

GENERALIZATIONS OF CEVA S THEOREM AND APPLICATIONS

Module 7: Probability and Statistics

NP!= P. By Liu Ran. Table of Contents. The P vs. NP problem is a major unsolved problem in computer

Can we take the Mysticism Out of the Pearson Coefficient of Linear Correlation?

Kernel-based Methods and Support Vector Machines

On Modified Interval Symmetric Single-Step Procedure ISS2-5D for the Simultaneous Inclusion of Polynomial Zeros

STA 108 Applied Linear Models: Regression Analysis Spring Solution for Homework #1

( ) = ( ) ( ) Chapter 13 Asymptotic Theory and Stochastic Regressors. Stochastic regressors model

Transcription:

Iteratoal Boo Seres "Iformato Scece ad Computg" 97 MULTIIMNSIONAL HTROGNOUS VARIABL PRICTION BAS ON PRTS STATMNTS Geady Lbov Maxm Gerasmov Abstract: I the wors [ ] we proposed a approach of formg a cosesus of experts statemets for the case of forecastg of ualtatve ad uattatve varable I ths paper we preset a method of aggregatg sets of dvdual statemets to a collectve oe for the geeral case of forecastg of multdmesoal heterogeeous varable Keywords: multdmesoal varable expert statemets coordato ACM Classfcato Keywords: I6 Artfcal Itellgece - owledge acusto Coferece: The paper s selected from IV th Iteratoal Coferece "Kowledge-alogue-Soluto" KS 008 Vara Bulgara ue-uly 008 Itroducto Let Γ be a populato of elemets or obects uder vestgato By assumpto L experts gve predctos of values of uow m-dmesoal heterogeeous feature for obects a Γ beg already aware of ther descrpto (a) We assume that ( a) = ( ( a) ( a) ( a)) ( a) = ( ( a) ( a) m ( a)) where the sets ad may smultaeously cota ualtatve ad uattatve features = ; or doma of the feature = m ; respectvely Let be the doma of the feature = = m The feature spaces are gve by the product sets: = = be the m = = By assumpto exactly combato of values ( a) ( a) m ( a) s mportat so we have to estmate the whole set smultaeously We shall say that a set s a rectagular set f = = a uattatve feature s a fte subset of feature values f rectagular sets are defed ad = [ α β ] f s s a omal feature I the same way G Fg The wor was supported by the RFBR uder Grat N07-0-0033a

98 Algorthmc ad Mathematcal Foudatos of the Artfcal Itellgece I ths paper we cosder statemets ( a) G where S s a rectagular set each statemet S has ts ow weght measure of cofdece = M ; represeted as seteces of type f G s a rectagular set ( a) the (see Fg ) By assumpto w ( 0 < w for dvdual statemets) Such a value s le a Let us remar that the statemet f ( a) the ( a) s eual to the statemet I ow othg about (a) f ( a) Wthout loss of geeralty we may assume that experts themselves have eual weghts Settg of a Problem We beg wth some deftos eote by : = = = ( ) where s the Cartesa o of feature values ad for feature ad s defed as follows Whe s a omal feature s the uo: = Whe s a uattatve feature s a mmal closed terval such that (see Fg ) Fg I the wor [3] we proposed a method to measure the dstaces betwee sets (eg ad ) heterogeeous feature space Cosder some modfcato of ths method By defto put ρ ( ) = = ρ ( ) or ρ ( ) = = ( ρ ( )) where 0 = = Values ρ ( ) are gve by: Δ ρ ( ) = f s a omal feature r + θ Δ α + β α + β ρ ( ) = f s a uattatve feature where r = It ca be proved that the tragle eualty s fulflled f ad oly f 0 θ The proposed measure ρ satsfes the reuremets of dstace there may be Note that we ca use aother measure of dffereces (for example see [4]) I ths paper we assume that dstace betwee rectagular sets s ow Cosder some atural algorthm of formg a cosesus of experts statemets (deote t by A )

Iteratoal Boo Seres "Iformato Scece ad Computg" 99 Let for some pot x we have two statemets S ad S wth the weghts w ad w Suppose G ad G are the mages prescrbed by these statemets to the pot x If ρ ( G G ) < ε where ε s a threshold the t may be assumed that the set G G s aturally prescrbed to the pot x Note that f these statemets are gve by dfferet experts the we more cofdece resulted statemet so the weght of ths statemet s hgher tha w ad w (t may be eve more tha ) Otherwse f ρ( G G ) ε the t may be assumed that oly oe statemet wth hgher weght s remaed ad our cofdece t (ad the weght of t) s decreased If for some pot x we have more tha two statemets the algorthm A coordates them the same way M Sce there are M statemets we have up to sets wth dfferet prescrbed mages These sets are the form of or \ ( 3 ) where are rectagular sets Cosder algorthms B of formg a cosesus of experts statemets uder restrctos o amout of resulted statemets The value F( B) ( ρ ( G ( x) G ( x)) dx estmates a ualty of the algorthm B Here = A B G A (x) G B (x) are the mages prescrbed to the pot x by algorthms A ad B respectvely I the * geeral case the best algorthm B = arg m B F( B) s uow Further o the heurstc algorthm of formg a cosesus of experts statemets s cosdered Prelmary Aalyss We frst treat each expert s statemets separately for rough aalyss Let us cosder some specal cases Case ( cocdece ): max max( ρ ( ) ρ ( )) < δ ad ρ ( G G ) < ε where δ ε are thresholds decded by the user { M} I ths case we ute statemets S ad S to resultg oe: f ( a) the ( a) G G Case ( cluso ): m( max( ρ ( )) max( ρ ( ))) < δ ad ρ ( G G ) < ε where { M} I ths case we ute statemets S ad S too: f ( a) the ( a) G G Case 3 ( cotradcto ): max max( ρ ( ) ρ ( )) < δ ad ρ ( G G ) > ε where ε s a threshold decded by the user { M} I ths case we exclude both statemets S ad S from the lst of statemets Coordato of Smlar Statemets ml Cosder the lst of l -th expert s statemets after prelmary aalyss Ω ( l) = { S ( l) S ( )} eote by Ω = L l = Ω( l) M = Ω eterme ow dstace betwee rectagular sets ad G correspods to far sets ad the the feature eterme values l from ths reaso: f far sets G s more valuable tha aother features

00 Algorthmc ad Mathematcal Foudatos of the Artfcal Itellgece hece value M M u = v = s hgher We ca use for example these values: u v u v τ = ρ( G G ) ρ ( ) = eote by : ( r = d ) The value d ( F) s defed as follows: d( F) = max (see Fg 3) dam( ) = max ρ( x y) xy ' \ F ' m dam( ) τ = τ = where where ' s ay rectagular set (') 3 (') (') Fg 3 By defto put { }{ } v I = I = {{ r u } δ ad { M v ρ ( G G u ) < ε u v = } where δ ε are thresholds decded by the user = Q ; Q M Let us remar that the reuremet u v uv u v r δ s le a crtero of sgfcace of the set \( ) Notce that someoe ca use aother value d to determe value r for example: m( dam( F ') dam( F) dam( G ') dam( G)) d( F G) = max ' \( F G) dam( ) Further tae ay set = { } of dces such that I ad Δ= Q +Δ I+Δ Now we ca aggregate the statemets S +Δ S = f ( a) the ( a) G where By defto put to the statemet S the weght S to the statemet = G S : = G G c w w = where c = ρ( ) c The procedure of formg a cosesus of sgle expert s statemets cossts aggregatg to statemets for all uder prevous codtos = Q Let us remar that f for example < the the sets ad (see Fg 4) are more sutable to be uted (to be precse the relatve statemets) tha the sets F ad F uder the same aother codtos Note that we ca cosder aother crtero of ufcato (stead of S to the statemet u v S r δ ): aggregate statemets S S oly f w > ε ' where ε ' s a threshold decded by the user

Iteratoal Boo Seres "Iformato Scece ad Computg" 0 After coordatg each expert s statemets separately we ca costruct a agreemet of several depedet experts The procedure s as above except the weghts: statemets the more we trust resulted statemet) eote the lst of statemets after coordato by Ω M : = Ω w = c w (the more experts gve smlar F F Fg 4 Coordato of No-smlar Statemets After costructg of a cosesus of smlar statemets we must form decso rule the case of tersected o-smlar statemets The procedure such cases s as follows () ( h) To each h = M cosder statemets S S Ω such that ~ h () ( ) : = h where () are related sets to statemets () S ~ h eote I l) = { S ( l) Ω ( l) ( l) } ( where (l) are related sets to statemets S (l) Cosder related sets G (l) where l = L ; I(l) eote by w (l) the weghts of statemets S (l) ( ) ( ) As above ute sets G ( l ) G ( l ) f ρ ( u v G G ) < ε u v = eote by G G ~ G ~ Λ the sets after procedure of ufcato of the sets G (l) Cosder the statemets S ~ ~ h : f ( a) the ~ ( a) G I order to choose the best statemet we tae to cosderato these reasos: ) smlartes betwee sets (l ; h ~ ad ) ) smlartes betwee sets G ~ ad G (l) ; 3) weghts of statemets S (l) ; 4) we must dstgush cases whe smlar / cotradctory statemets produced by oe or several experts ( ) ~ ( ) ( ) ~ h L ( ρ( G ( l) G ))( ρ( ( l) ) w ( l) I ( l) We ca use for example such values: w = ( ) ~ h ( ρ( ( l) ) eote by * : = arg max w l= h Thus we ca mae decso statemet: S ~ = f * ~ w h : = w max w * eote the lst of such statemets by Ω 3 a ~ I ( l) h ( ) the ~ ~ * ( a) G wth the weght

0 Algorthmc ad Mathematcal Foudatos of the Artfcal Itellgece Fal decso rule s formed from statemets Ω ad Ω 3 Cocluso Suggested method of formg of uted decso rule ca be used for coordato of several experts statemets ad dfferet decso rules obtaed from learg samples ad/or tme seres Notce that we ca rage resulted statemets by ther weghts ad the exclude gorable statemets from decso rule or ure for more formato for correspodg sets from experts Bblography [] GLbov MGerasmov Costructg of a Cosesus of Several xperts Statemets I: Proc of II It Cof Kowledge-alogue-Soluto 006 pp 93-95 [] GLbov MGerasmov Iterval Predcto Based o xperts Statemets I: Proc of III It Cof Kowledge-alogue- Soluto 007 Vol pp 474-478 [3] GSLbov MKGerasmov etermg of stace Betwee Logcal Statemets Forecastg Problems I: Artfcal Itellgece 004 [ Russa] Isttute of Artfcal Itellgece Urae [4] AVet ev Measure of Refutato ad Metrcs o Statemets of xperts (Logcal Formulas) the Models for Some Theory I: It oural Iformato Theores & Applcatos 007 Vol 4 No pp 9-95 Authors' Iformato Geady Lbov - Isttute of Mathematcs SB RAS Koptyug St bl4 Novosbrs Russa; e-mal: lbov@mathscru Maxm Gerasmov - Isttute of Mathematcs SB RAS Koptyug St bl4 Novosbrs Russa e-mal: max_post@gsru