An Evaluation Framework for the Comparison of Fine-Grained Predictive Models in Health Care
|
|
- Candice Welch
- 6 years ago
- Views:
Transcription
1 An Evaluation Framework for the Comparison of Fine-Grained Predictive Models in Health Care Ward R.J. van Breda 1 ), Mark Hoogendoorn 1,A.E.Eiben 1, and Matthias Berking 2 1 VU University Amsterdam, Department of Computer Science De Boelelaan 1081, 1081 HV Amsterdam, The Netherlands, {w.r.j.van.breda,m.hoogendoorn,a.e.eiben}@vu.nl 2 Friedrich-Alexander University Erlangen-Nuremberg, Germany matthias.berking@fau.de Abstract. Within the domain of health care, more and more fine-grained models are observed that predict the development of specific health or disease-related) states over time. This is due to the increased use of sensors, allowing for continuous assessment, leading to a sharp increase of data. These specific models are often much more complex than high-level predictive models that e.g. give a general risk score for a disease, making the evaluation of these models far from trivial. In this paper, we present an evaluation framework which is able to score fine-grained temporal models that aim at predicting multiple health states, considering their capability to describe data, their capability to predict, the quality of the models parameters, and the model complexity. 1 Introduction Predictive modeling is of utmost importance in health care and has potential to be the basis for prevention strategies, especially, early and highly personalized interventions. Predictive models can vary greatly in their level of granularity, ranging from relatively coarse-grained models, that e.g. provide a general risk disease score, to highly fine-grained ones that predict detailed developments of disease and/or disease-relevant states over time. The latter is received more and more attention due to the improvements in measurement capabilities. The evaluation of fine-grained models is unfortunately far from trivial as they often are of a temporal nature, predict multiple states, have parameters with which the model can be personalized, et cetera. In order to make informed decisions during model development, or when comparing models, there is a need to understand how model quality can be evaluated in a rigorous way. In this paper, we present an evaluation framework for fine-grained predictive models. The framework considers the following aspects: 1) the descriptive capability; 2) predictive capability; 3) parameter sensitivity, and 4) model complexity. The weight of each of these criteria can be set according to the characteristics of the specific disease or health aspects under consideration. c Springer International Publishing Switzerland 2015 J.H. Holmes et al. Eds.): AIME 2015, LNAI 9105, pp , DOI: / _18
2 Evaluation Framework for Fine-Grained Predictive Models Evaluation Framework Scope of Framework. The framework we describe is meant for domains with temporal data over a number of attributes a 1,...,a m for a number of patients b 1,...,b n. Attributes represent an aspect of the health state of a patient, and we denote the domain of a i by A i.atanygivetimet, the state of a patient b is a vector sb, t) A 1... A m. To designate the specific value of an attribute we use the notation sb, t, i) A i. We assume a dataset that contains a state for each patient for a number of time instances t 1,...,t end. These measured data are contained in the matrix Z, where at any give time t j j =1,...,end) the observed state of patient b is a vector zb, t j ) A 1... A m. Furthermore, we consider models composed from rules for state transition and assume one rule for each of the given attributes that describes the value of a i t + 1) based on a i t) and possibly some other attributes. Formally, we have r i : A 1... A m A i. Obviously, a transition rule for attribute i may not need all other attributes, only a few of them; in the extreme case only a i itself. AmodelM is then a composed entity that can predict the consecutive states of any give patient. Thus, M : A 1... A m A 1... A m and given a state sb, t) ofpatientb at time t we can denote the predicted state at time t +1by Msb, t)). Each model is equipped with parameters, a model instance is a model for which a value has been assigned to each parameter denoted as M p where p P and P is the set of possible parameter value vectors. To employ a model M for predicting a full sequence of states for a patient b it needs to be applied to the first observed state zb, t 1 ) and then iteratively to the outcomes. To avoid an unnecessarily heavy notation, we define these predicted states interactively as follows. Given a patient b and a model instance M p, the predicted state at the start is the observed state s Mp b, 1) = zb, 1) and for all t =1,..., end 1 s Mp b, t +1)=M p s Mp b, t)) The goal of the model instance is to minimize the difference between the predicted and observed states. The error of a model M for a patient b over the full observation period is then eb, M p )= t end Dzb, t),s Mp b, t)) t=t 1 where D is some application specific measure of difference between two states. Furthermore, we define eb, M p,i) defines the error the model makes on an attribute i. Throughout this paper, the Mean Squared Error MSE) is assumed to be the error measure. Descriptive Capability. To express the quality of a model M for a given patient b we consider the error eb, M, a i ) on each attribute a i.thisimpliesa multi-objective optimization MOO) problem, where each objective corresponds to one attribute. In the sequel we assume that we have and use a multi-objective
3 150 W.R.J. van Breda et al. optimization algorithm that searches in the space of model instances M p based on a training set. For examples of MOO algorithms, see [2], [3]. Given a patient b, the output of one run of the algorithm is a set of non dominated model instances, where dominance is defined in the usual manner: M p dominates M p,ifforeach attribute a i the error eb, M p,i) is lower or equal than eb, M p,i)andthereis at least one attribute a j where the error eb, M p,j)islowerthaneb, M p,j). Because each model instance corresponds to one point in the space of model parameter vectors, the set non-dominated model instances forms a Pareto front in this vector space. 1 Due to the typical stochastic nature of the algorithms to find such assignments it is assumed that multiple runs of the algorithm are performed per patient. Each run r delivers a Pareto front of q non-dominated model instances {M p1,r,..., M pq,r } and each model instance M pi,r has a corresponding m-dimensional error vector eb, M pi,r, 1),..., eb, M pi,r,m), where m is the number of attributes. Each of these q vectors can be plotted using an attainment surface [1].Givensuchanattainmentsurfaceitsdominatedhypervolumecanbecalculated, which is the volume above each attainment surface, related to an error reference point, set to 1 for each objective, based on the assumption that all error values are scaled to an interval of [0,1]. For more details, see [1]. We use the notation nh M b, r) to denote the dominated hypervolume for run r of the MOO algorithm to optimize model M for patient b. Executing r max runs of the MOO algorithm, we obtain r max attainment surfaces and r max values of nh M b, r). Taken all runs into account we now can define model quality by averaging the values of the non-dominated hypervolumes: nh M b) = rmax r=1 nh M b,r) r max Each patient has its own unique value, and we therefore end up with a vector of n values: nh M b 1 ),..., nh M b n ). The final score of the criterion is then defined as multiplication of the mean μ nhm with 1 minus the standard deviation σ nhm of the values in this vector since a high mean is good in combination with a small standard deviation: descriptive score M = μ nhm 1 σ nhm ) Predictive Capability. Next to a good descriptive capability, we also want the model to perform well on the test set, i.e. have a good predictive capability. Hereto, we define two measurements: 1) we define the absolute predictive performance on the test set, and 2) we quantify the relationship between how well the model performs on the training and test set, we would prefer these to go hand-in-hand and call this the relative predictive performance. Concerning absolute predictive performance, for a model M we calculate the mean μ em j) and the standard deviation σ em j) over the set of errors belonging to attribute j for the q model instances per run and r max runs, for all patients i.e. 1 to n), resulting in a set size of q r max n errors. We then take the average of the mean 1 The dimensionality of this vector space depends on the number of model parameters.
4 Evaluation Framework for Fine-Grained Predictive Models 151 and standard deviation over all m attributes: μ em and σ em. Then, the absolute predictive performance score becomes: absolute pred score M =1 μ em )1 σ em ) To measure the relation between the errors on training and test set, for the q model instances per run and r max runsweendupwithatotalofq r max model instances with specific parameter vectors per patient b. For each attribute j we determine the correlation between the error of each of the q r max model instances on the training and the test set for each individual patient whereby the training set is the first period of data and the test set the second, later, period): e train b, M pi,r,j)ande test b, M p1,r,j). Hereto, we use the correlation note training and test to tr and te respectively) for a specific model M: cor Mb, j)= q rmax e tr b,m pi,r,j) e tr b,m pi,j) e tr b,m pi,r,j) e tr b,m pi,j) ) 2 q ) ) e teb,m pi,r,j) e teb,m pi,j) rmax ) 2 e teb,m pi,r,j) e teb,m pi,j) Then, we calculate the average μ corm across the set of all correlations of all patients i.e. 1 to n) and criteria i.e. 1 to m): cor M b 1,a 1 ),..., cor M b n,a 1 ),..., cor M b n,a m ) as well as the standard deviation σ corm ) 2 : relative pred score M = maxμ corm, 0)1 σ corm ) Given weights w 1 and w 2 a final evaluation score for model M is calculated: predictive score M = w 1 absolute pred score M + w 2 relative pred score M Parameter Sensitivity. The parameter sensitivity is the most complex metric. In the current version we keep it as simple as possible. We want to avoid meaningless parameters, that do not have any influence on the performance of the model. Therefore we look at the relationship between parameters and the various evaluation objectives. Assuming we define p i,r,b u) as the value for parameter u for model instance i from during run r of patient b, we define correlation between a parameter and the resulting error on an attribute j for model M as follows: cor M b, j, k) = e trb,m pi,r,b,j) e tr b,m p,j))p i,r,b k)) p b k)) e trb,m pi,r,b,j) e tr b,m p,j)) 2 p i,r,b k)) p b k)) 2 If a parameter always has a correlation close to zero for different evaluation criteria and patients) this is considered bad. Thus, we look for the maximum of the absolute value of the correlation found in the set of all patients and criteria, which gives an indication whether a parameter has a use i.e correlation) in at least one patient/model instance combination. We define a correlation as useless or weak) if it falls under a boundary of 0.35 [4]. { 1 maxb [1,n],j [1,m] cor useful M,pk) = M b, j, k) ) otherwise 2 Note that with respect to the mean a cutoff point of 0 is used via the max operator) as we consider all correlations below 0 equally bad.
5 152 W.R.J. van Breda et al. Finally, we calculate the fraction of useless parameters in a model as its score for the parameter sensitivity where P is the number of elements in the parameter vector and is the highest parameter number of the model): sensitivity score M = P useful M,pk)) k=1 P Model Complexity. The model complexity counts the number of states and parameters: A complexity score M =1 M + P M ) max mo Models A mo + P mo ) The score is scaled according to the maximum complexity of the models that are subject to evaluation. 3 Discussion This paper has introduced a framework which is able to evaluate fine-grained temporal predictive models for health care. Hereto, several criteria have been introduced which can be combined by taking a weighted sum of the different scores, thereby selecting weights depending on the importance of the criterion for the case at hand. Initial experiments suggest that the framework is able to generate important insights in the properties of the models. For future work we want to test and refine the framework by further investigating the usefulness and performance of the different criteria and related metrics. Furthermore, we want to use the framework as a fitness function for automatically generating predictive dynamic models using genetic programming techniques. Acknowledgements. This research has been performed in the context of the EU FP7 project E-COMPARED project number ). References 1. Deb, K.: Multi-objective optimization using evolutionary algorithms, vol. 16. John Wiley & Sons 2001) 2. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: Nsga-ii. IEEE Transactions on Evolutionary Computation 62), ) 3. Mlakar, M., Petelin, D., Tušar, T., Filipič, B.: Gp-demo: Differential evolution for multiobjective optimization based on gaussian process models. European Journal of Operational Research 2014) 4. Taylor, R.: Interpretation of the correlation coefficient: a basic review. Journal of Diagnostic Medical Sonography 61), )
Robust Multi-Objective Optimization in High Dimensional Spaces
Robust Multi-Objective Optimization in High Dimensional Spaces André Sülflow, Nicole Drechsler, and Rolf Drechsler Institute of Computer Science University of Bremen 28359 Bremen, Germany {suelflow,nd,drechsle}@informatik.uni-bremen.de
More informationMultiobjective Optimization
Multiobjective Optimization MTH6418 S Le Digabel, École Polytechnique de Montréal Fall 2015 (v2) MTH6418: Multiobjective 1/36 Plan Introduction Metrics BiMADS Other methods References MTH6418: Multiobjective
More informationResearch Article A Novel Ranking Method Based on Subjective Probability Theory for Evolutionary Multiobjective Optimization
Mathematical Problems in Engineering Volume 2011, Article ID 695087, 10 pages doi:10.1155/2011/695087 Research Article A Novel Ranking Method Based on Subjective Probability Theory for Evolutionary Multiobjective
More informationBehavior of EMO Algorithms on Many-Objective Optimization Problems with Correlated Objectives
H. Ishibuchi N. Akedo H. Ohyanagi and Y. Nojima Behavior of EMO algorithms on many-objective optimization problems with correlated objectives Proc. of 211 IEEE Congress on Evolutionary Computation pp.
More informationQuad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism
Quad-trees: A Data Structure for Storing Pareto-sets in Multi-objective Evolutionary Algorithms with Elitism Sanaz Mostaghim 1 and Jürgen Teich 2 1 Electrical Engineering Department University of Paderborn,
More informationMonotonicity Analysis, Evolutionary Multi-Objective Optimization, and Discovery of Design Principles
Monotonicity Analysis, Evolutionary Multi-Objective Optimization, and Discovery of Design Principles Kalyanmoy Deb and Aravind Srinivasan Kanpur Genetic Algorithms Laboratory (KanGAL) Indian Institute
More informationGeneralization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms
Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms Tadahiko Murata 1, Shiori Kaige 2, and Hisao Ishibuchi 2 1 Department of Informatics, Kansai University 2-1-1 Ryozenji-cho,
More informationTIES598 Nonlinear Multiobjective Optimization A priori and a posteriori methods spring 2017
TIES598 Nonlinear Multiobjective Optimization A priori and a posteriori methods spring 2017 Jussi Hakanen jussi.hakanen@jyu.fi Contents A priori methods A posteriori methods Some example methods Learning
More informationA Non-Parametric Statistical Dominance Operator for Noisy Multiobjective Optimization
A Non-Parametric Statistical Dominance Operator for Noisy Multiobjective Optimization Dung H. Phan and Junichi Suzuki Deptartment of Computer Science University of Massachusetts, Boston, USA {phdung, jxs}@cs.umb.edu
More informationA Multiobjective GO based Approach to Protein Complex Detection
Available online at www.sciencedirect.com Procedia Technology 4 (2012 ) 555 560 C3IT-2012 A Multiobjective GO based Approach to Protein Complex Detection Sumanta Ray a, Moumita De b, Anirban Mukhopadhyay
More informationMULTIOBJECTIVE EVOLUTIONARY ALGORITHM FOR INTEGRATED TIMETABLE OPTIMIZATION WITH VEHICLE SCHEDULING ASPECTS
MULTIOBJECTIVE EVOLUTIONARY ALGORITHM FOR INTEGRATED TIMETABLE OPTIMIZATION WITH VEHICLE SCHEDULING ASPECTS Michal Weiszer 1, Gabriel Fedoro 2, Zdene Čujan 3 Summary:This paper describes the implementation
More informationRuntime Analyses for Using Fairness in Evolutionary Multi-Objective Optimization
Runtime Analyses for Using Fairness in Evolutionary Multi-Objective Optimization Tobias Friedrich 1, Christian Horoba 2, and Frank Neumann 1 1 Max-Planck-Institut für Informatik, Saarbrücken, Germany 2
More informationComparative Study of Basic Constellation Models for Regional Satellite Constellation Design
2016 Sixth International Conference on Instrumentation & Measurement, Computer, Communication and Control Comparative Study of Basic Constellation Models for Regional Satellite Constellation Design Yu
More informationA Brief Introduction to Multiobjective Optimization Techniques
Università di Catania Dipartimento di Ingegneria Informatica e delle Telecomunicazioni A Brief Introduction to Multiobjective Optimization Techniques Maurizio Palesi Maurizio Palesi [mpalesi@diit.unict.it]
More informationRelation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets
Relation between Pareto-Optimal Fuzzy Rules and Pareto-Optimal Fuzzy Rule Sets Hisao Ishibuchi, Isao Kuwajima, and Yusuke Nojima Department of Computer Science and Intelligent Systems, Osaka Prefecture
More informationDESIGN OF OPTIMUM CROSS-SECTIONS FOR LOAD-CARRYING MEMBERS USING MULTI-OBJECTIVE EVOLUTIONARY ALGORITHMS
DESIGN OF OPTIMUM CROSS-SECTIONS FOR LOAD-CARRING MEMBERS USING MULTI-OBJECTIVE EVOLUTIONAR ALGORITHMS Dilip Datta Kanpur Genetic Algorithms Laboratory (KanGAL) Deptt. of Mechanical Engg. IIT Kanpur, Kanpur,
More informationSolving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17) Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions Hong Qian, Yang Yu National
More informationComparison of Multi-Objective Genetic Algorithms in Optimizing Q-Law Low-Thrust Orbit Transfers
Comparison of Multi-Objective Genetic Algorithms in Optimizing Q-Law Low-Thrust Orbit Transfers Seungwon Lee, Paul v on Allmen, Wolfgang Fink, Anastassios E. Petropoulos, and Richard J. Terrile Jet Propulsion
More informationEffects of the Use of Non-Geometric Binary Crossover on Evolutionary Multiobjective Optimization
Effects of the Use of Non-Geometric Binary Crossover on Evolutionary Multiobjective Optimization Hisao Ishibuchi, Yusuke Nojima, Noritaka Tsukamoto, and Ken Ohara Graduate School of Engineering, Osaka
More informationA Posteriori Corrections to Classification Methods.
A Posteriori Corrections to Classification Methods. Włodzisław Duch and Łukasz Itert Department of Informatics, Nicholas Copernicus University, Grudziądzka 5, 87-100 Toruń, Poland; http://www.phys.uni.torun.pl/kmk
More informationOn cone based decompositions of proper Pareto optimality
Noname manuscript No. (will be inserted by the editor) On cone based decompositions of proper Pareto optimality Marlon A. Braun Pradyumn K. Shukla Hartmut Schmeck Received: date / Accepted: date Abstract
More informationExam Machine Learning for the Quantified Self with answers :00-14:45
Exam Machine Learning for the Quantified Self with answers 21. 06. 2017 12:00-14:45 NOTES: 1. YOUR NAME MUST BE WRITTEN ON EACH SHEET IN CAPITALS. 2. Answer the questions in Dutch or English. 3. Points
More informationCovariance Matrix Adaptation in Multiobjective Optimization
Covariance Matrix Adaptation in Multiobjective Optimization Dimo Brockhoff INRIA Lille Nord Europe October 30, 2014 PGMO-COPI 2014, Ecole Polytechnique, France Mastertitelformat Scenario: Multiobjective
More informationResampling techniques for statistical modeling
Resampling techniques for statistical modeling Gianluca Bontempi Département d Informatique Boulevard de Triomphe - CP 212 http://www.ulb.ac.be/di Resampling techniques p.1/33 Beyond the empirical error
More informationQUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS
QUANTIZATION FOR DISTRIBUTED ESTIMATION IN LARGE SCALE SENSOR NETWORKS Parvathinathan Venkitasubramaniam, Gökhan Mergen, Lang Tong and Ananthram Swami ABSTRACT We study the problem of quantization for
More informationMultiobjective Optimization of Cement-bonded Sand Mould System with Differential Evolution
DOI: 10.7763/IPEDR. 013. V63. 0 Multiobjective Optimization of Cement-bonded Sand Mould System with Differential Evolution T. Ganesan 1, I. Elamvazuthi, Ku Zilati Ku Shaari 3, and P. Vasant + 1, 3 Department
More informationInteractive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method
Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method Kalyanmoy Deb Department of Mechanical Engineering Indian Institute of Technology Kanpur Kanpur,
More informationMulti-objective approaches in a single-objective optimization environment
Multi-objective approaches in a single-objective optimization environment Shinya Watanabe College of Information Science & Engineering, Ritsumeikan Univ. -- Nojihigashi, Kusatsu Shiga 55-8577, Japan sin@sys.ci.ritsumei.ac.jp
More informationMeasuring and Optimizing Behavioral Complexity for Evolutionary Reinforcement Learning
Measuring and Optimizing Behavioral Complexity for Evolutionary Reinforcement Learning Faustino J. Gomez, Julian Togelius, and Juergen Schmidhuber IDSIA, Galleria 2 6928 Manno-Lugano Switzerland Abstract.
More informationTECHNISCHE UNIVERSITÄT DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531
TECHNISCHE UNIVERSITÄT DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence
More informationWłodzimierz Ogryczak. Warsaw University of Technology, ICCE ON ROBUST SOLUTIONS TO MULTI-OBJECTIVE LINEAR PROGRAMS. Introduction. Abstract.
Włodzimierz Ogryczak Warsaw University of Technology, ICCE ON ROBUST SOLUTIONS TO MULTI-OBJECTIVE LINEAR PROGRAMS Abstract In multiple criteria linear programming (MOLP) any efficient solution can be found
More informationIEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, VOL. XX, NO.X, XXXX 1
This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. Citation information: DOI.9/TEVC.27.273778,
More informationEfficiently merging symbolic rules into integrated rules
Efficiently merging symbolic rules into integrated rules Jim Prentzas a, Ioannis Hatzilygeroudis b a Democritus University of Thrace, School of Education Sciences Department of Education Sciences in Pre-School
More informationPIBEA: Prospect Indicator Based Evolutionary Algorithm for Multiobjective Optimization Problems
PIBEA: Prospect Indicator Based Evolutionary Algorithm for Multiobjective Optimization Problems Pruet Boonma Department of Computer Engineering Chiang Mai University Chiang Mai, 52, Thailand Email: pruet@eng.cmu.ac.th
More informationRobustness criterion for the optimization scheme based on kriging metamodel
Robustness criterion for the optimization scheme based on kriging metamodel Melina Ribaud a,b, Frederic Gillot a, Celine Helbert b, Christophette Blanchet-Scalliet b and Celine Vial c,d a. Laboratoire
More informationMULTIOBJECTIVE DESIGN OF VACCINATION CAMPAIGNS WITH A STOCHASTIC VALIDATION
MULTIOBJECTIVE DESIGN OF VACCINATION CAMPAIGNS WITH A STOCHASTIC VALIDATION André Rodrigues da Cruz Universidade Federal de Minas Gerais Master Student in Electrical Engineering andrercruz@cpdee.ufmg.br
More informationMaximum Likelihood Diffusive Source Localization Based on Binary Observations
Maximum Lielihood Diffusive Source Localization Based on Binary Observations Yoav Levinboo and an F. Wong Wireless Information Networing Group, University of Florida Gainesville, Florida 32611-6130, USA
More informationMultiobjective Optimisation An Overview
ITNPD8/CSCU9YO Multiobjective Optimisation An Overview Nadarajen Veerapen (nve@cs.stir.ac.uk) University of Stirling Why? Classic optimisation: 1 objective Example: Minimise cost Reality is often more
More informationDeposited on: 1 April 2009
Schütze, O. and Vasile, M. and Coello, C.A. (2008) Approximate solutions in space mission design. Lecture Notes in Computer Science, 5199. pp. 805-814. ISSN 0302-9743 http://eprints.gla.ac.uk/5049/ Deposited
More informationAnomaly Detection for the CERN Large Hadron Collider injection magnets
Anomaly Detection for the CERN Large Hadron Collider injection magnets Armin Halilovic KU Leuven - Department of Computer Science In cooperation with CERN 2018-07-27 0 Outline 1 Context 2 Data 3 Preprocessing
More informationAnalyses of Guide Update Approaches for Vector Evaluated Particle Swarm Optimisation on Dynamic Multi-Objective Optimisation Problems
WCCI 22 IEEE World Congress on Computational Intelligence June, -5, 22 - Brisbane, Australia IEEE CEC Analyses of Guide Update Approaches for Vector Evaluated Particle Swarm Optimisation on Dynamic Multi-Objective
More informationPrediction-based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization
Prediction-based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization Aimin Zhou 1, Yaochu Jin 2, Qingfu Zhang 1, Bernhard Sendhoff 2, and Edward Tsang 1 1 Department of Computer
More informationAnalysing repeated measurements whilst accounting for derivative tracking, varying within-subject variance and autocorrelation: the xtiou command
Analysing repeated measurements whilst accounting for derivative tracking, varying within-subject variance and autocorrelation: the xtiou command R.A. Hughes* 1, M.G. Kenward 2, J.A.C. Sterne 1, K. Tilling
More informationPlateaus Can Be Harder in Multi-Objective Optimization
Plateaus Can Be Harder in Multi-Objective Optimization Tobias Friedrich and Nils Hebbinghaus and Frank Neumann Max-Planck-Institut für Informatik, Campus E1 4, 66123 Saarbrücken, Germany Abstract In recent
More informationVECTOR REPETITION AND MODIFICATION FOR PEAK POWER REDUCTION IN VLSI TESTING
th 8 IEEE Workshop on Design and Diagnostics of Electronic Circuits and Systems Sopron, Hungary, April 13-16, 2005 VECTOR REPETITION AND MODIFICATION FOR PEAK POWER REDUCTION IN VLSI TESTING M. Bellos
More informationAutomated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling
Automated Segmentation of Low Light Level Imagery using Poisson MAP- MRF Labelling Abstract An automated unsupervised technique, based upon a Bayesian framework, for the segmentation of low light level
More informationNumerical Methods. King Saud University
Numerical Methods King Saud University Aims In this lecture, we will... Introduce the topic of numerical methods Consider the Error analysis and sources of errors Introduction A numerical method which
More informationAn Introduction to GLIF
An Introduction to GLIF Mor Peleg, Ph.D. Post-doctoral Fellow, SMI, Stanford Medical School, Stanford University, Stanford, CA Aziz A. Boxwala, M.B.B.S, Ph.D. Research Scientist and Instructor DSG, Harvard
More informationOPTIMIZING BUILDING DESIGNS USING A ROBUSTNESS INDICATOR WITH RESPECT TO USER BEHAVIOR
Proceedings of Building Simulation : th Conference of International Building Performance Simulation Association, Sydney, 4-6 November. OPTIMIZING BUILDING DESIGNS USING A ROBUSTNESS INDICATOR WITH RESPECT
More informationAgent-Based and Population-Based Modeling of Trust Dynamics 1
Agent-Based and Population-Based Modeling of Trust Dynamics 1 Syed Waqar Jaffry [1,2] and Jan Treur [1] [1] Vrije Universiteit Amsterdam, Department of Artificial Intelligence, De Boelelaan 1081a, 1081
More informationMulti-Objective evolutionary algorithm for modeling of site suitability for health-care facilities
RESEARCH ARTICLE Multi-Objective evolutionary algorithm for modeling of site suitability for health-care facilities Sara Beheshtifar 1, Abbas Alimohammadi 2 1. PhD Student of GIS engineering, Faculty of
More informationAlgorithmic Probability
Algorithmic Probability From Scholarpedia From Scholarpedia, the free peer-reviewed encyclopedia p.19046 Curator: Marcus Hutter, Australian National University Curator: Shane Legg, Dalle Molle Institute
More informationPaCcET: An Objective Space Transformation to Shape the Pareto Front and Eliminate Concavity
PaCcET: An Objective Space Transformation to Shape the Pareto Front and Eliminate Concavity Logan Yliniemi and Kagan Tumer Oregon State University Corvallis, Oregon, USA logan.yliniemi@engr.orst.edu kagan.tumer@oregonstate.edu
More informationARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES
International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1455 1475 ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC
More informationQ-Matrix Development. NCME 2009 Workshop
Q-Matrix Development NCME 2009 Workshop Introduction We will define the Q-matrix Then we will discuss method of developing your own Q-matrix Talk about possible problems of the Q-matrix to avoid The Q-matrix
More informationPaCcET: An Objective Space Transformation to Iteratively Convexify the Pareto Front
PaCcET: An Objective Space Transformation to Iteratively Convexify the Pareto Front Logan Yliniemi and Kagan Tumer Oregon State University Corvallis, Oregon, USA logan.yliniemi@engr.orst.edu kagan.tumer@oregonstate.edu
More informationSolving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions
Solving High-Dimensional Multi-Objective Optimization Problems with Low Effective Dimensions Hong Qian and Yang Yu National Key Laboratory for Novel Software Technology, Nanjing University, Nanjing, 210023,
More informationOn the static assignment to parallel servers
On the static assignment to parallel servers Ger Koole Vrije Universiteit Faculty of Mathematics and Computer Science De Boelelaan 1081a, 1081 HV Amsterdam The Netherlands Email: koole@cs.vu.nl, Url: www.cs.vu.nl/
More informationBasic Verification Concepts
Basic Verification Concepts Barbara Brown National Center for Atmospheric Research Boulder Colorado USA bgb@ucar.edu May 2017 Berlin, Germany Basic concepts - outline What is verification? Why verify?
More informationTECHNISCHE UNIVERSITÄT DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531
TECHNISCHE UNIVERSITÄT DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence
More informationOptimization of Feeding Source for an Electromagnetic Shooter
Australian Journal of Basic and Applied Sciences, 6(8): 187-191, 2012 ISSN 1991-8178 Optimization of Feeding Source for an Electromagnetic Shooter 1 Mr Mahdi Moradpour, 2 Dr Abbas ramezani, 3 Dr Shahriar
More informationMultiobjective Optimization of an Extremal Evolution Model
Multiobjective Optimization of an Extremal Evolution Model Mohamed Fathey Elettreby Mathematics Department, Faculty of Science, Mansoura University, Mansoura 35516, Egypt Reprint requests to M. F. E.;
More informationSample Size Calculations for Group Randomized Trials with Unequal Sample Sizes through Monte Carlo Simulations
Sample Size Calculations for Group Randomized Trials with Unequal Sample Sizes through Monte Carlo Simulations Ben Brewer Duke University March 10, 2017 Introduction Group randomized trials (GRTs) are
More informationGDE3: The third Evolution Step of Generalized Differential Evolution
GDE3: The third Evolution Step of Generalized Differential Evolution Saku Kukkonen Kanpur Genetic Algorithms Laboratory (KanGAL) Indian Institute of Technology Kanpur Kanpur, PIN 28 16, India saku@iitk.ac.in,
More informationComputationally Expensive Multi-objective Optimization. Juliane Müller
Computationally Expensive Multi-objective Optimization Juliane Müller Lawrence Berkeley National Lab IMA Research Collaboration Workshop University of Minnesota, February 23, 2016 J. Müller (julianemueller@lbl.gov)
More informationShift Scheduling in Pediatric Emergency Medicine
Shift Scheduling in Pediatric Emergency Medicine Presenter : Young-Chae Hong M.S.E. Co-Authors : Amy Cohn, Ph.D. & Ed O'Brien M.D. University of Michigan INFOMS at San Francisco 11 / 10 / 2014 Collaborators
More informationECLT 5810 Linear Regression and Logistic Regression for Classification. Prof. Wai Lam
ECLT 5810 Linear Regression and Logistic Regression for Classification Prof. Wai Lam Linear Regression Models Least Squares Input vectors is an attribute / feature / predictor (independent variable) The
More informationUpper bound for optimal value of risk averse multistage problems
Upper bound for optimal value of risk averse multistage problems Lingquan Ding School of Industrial and Systems Engineering Georgia Institute of Technology Atlanta, GA 30332-0205 Alexander Shapiro School
More informationFundamentals of Similarity Search
Chapter 2 Fundamentals of Similarity Search We will now look at the fundamentals of similarity search systems, providing the background for a detailed discussion on similarity search operators in the subsequent
More informationMultiobjective Evolutionary Algorithms. Pareto Rankings
Monografías del Semin. Matem. García de Galdeano. 7: 7 3, (3). Multiobjective Evolutionary Algorithms. Pareto Rankings Alberto, I.; Azcarate, C.; Mallor, F. & Mateo, P.M. Abstract In this work we present
More informationClinical Trials. Olli Saarela. September 18, Dalla Lana School of Public Health University of Toronto.
Introduction to Dalla Lana School of Public Health University of Toronto olli.saarela@utoronto.ca September 18, 2014 38-1 : a review 38-2 Evidence Ideal: to advance the knowledge-base of clinical medicine,
More informationExpected Running Time Analysis of a Multiobjective Evolutionary Algorithm on Pseudo-boolean Functions
Expected Running Time Analysis of a Multiobjective Evolutionary Algorithm on Pseudo-boolean Functions Nilanjan Banerjee and Rajeev Kumar Department of Computer Science and Engineering Indian Institute
More informationHeuristics for The Whitehead Minimization Problem
Heuristics for The Whitehead Minimization Problem R.M. Haralick, A.D. Miasnikov and A.G. Myasnikov November 11, 2004 Abstract In this paper we discuss several heuristic strategies which allow one to solve
More informationMulti-Objective Optimization of Two Dynamic Systems
Multi-Objective Optimization of Two Dynamic Systems Joseph M. Mahoney The Pennsylvania State University 204 EES Building University Park, PA 16802 jmm694@psu.edu Abstract This paper details two problems
More informationFast and Accurate HARDI and its Application to Neurological Diagnosis
Fast and Accurate HARDI and its Application to Neurological Diagnosis Dr. Oleg Michailovich Department of Electrical and Computer Engineering University of Waterloo June 21, 2011 Outline 1 Diffusion imaging
More informationBi-objective Portfolio Optimization Using a Customized Hybrid NSGA-II Procedure
Bi-objective Portfolio Optimization Using a Customized Hybrid NSGA-II Procedure Kalyanmoy Deb 1, Ralph E. Steuer 2, Rajat Tewari 3, and Rahul Tewari 4 1 Department of Mechanical Engineering, Indian Institute
More informationQuantifying uncertainty on Pareto fronts with Gaussian Process conditional simulations
Quantifying uncertainty on Pareto fronts with Gaussian Process conditional simulations Mickaël Binois, David Ginsbourger, Olivier Roustant To cite this version: Mickaël Binois, David Ginsbourger, Olivier
More informationNew Reference-Neighbourhood Scalarization Problem for Multiobjective Integer Programming
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 3 No Sofia 3 Print ISSN: 3-97; Online ISSN: 34-48 DOI:.478/cait-3- New Reference-Neighbourhood Scalariation Problem for Multiobjective
More informationDynamic Time Series Regression: A Panacea for Spurious Correlations
International Journal of Scientific and Research Publications, Volume 6, Issue 10, October 2016 337 Dynamic Time Series Regression: A Panacea for Spurious Correlations Emmanuel Alphonsus Akpan *, Imoh
More informationGamma process model for time-dependent structural reliability analysis
Gamma process model for time-dependent structural reliability analysis M.D. Pandey Department of Civil Engineering, University of Waterloo, Waterloo, Ontario, Canada J.M. van Noortwijk HKV Consultants,
More informationarxiv: v1 [math.st] 1 Dec 2014
HOW TO MONITOR AND MITIGATE STAIR-CASING IN L TREND FILTERING Cristian R. Rojas and Bo Wahlberg Department of Automatic Control and ACCESS Linnaeus Centre School of Electrical Engineering, KTH Royal Institute
More information3.1 Arrow s Theorem. We study now the general case in which the society has to choose among a number of alternatives
3.- Social Choice and Welfare Economics 3.1 Arrow s Theorem We study now the general case in which the society has to choose among a number of alternatives Let R denote the set of all preference relations
More informationRunning time analysis of a multi-objective evolutionary algorithm on a simple discrete optimization problem
Research Collection Working Paper Running time analysis of a multi-objective evolutionary algorithm on a simple discrete optimization problem Author(s): Laumanns, Marco; Thiele, Lothar; Zitzler, Eckart;
More informationNecessary Corrections in Intransitive Likelihood-Ratio Classifiers
Necessary Corrections in Intransitive Likelihood-Ratio Classifiers Gang Ji and Jeff Bilmes SSLI-Lab, Department of Electrical Engineering University of Washington Seattle, WA 9895-500 {gang,bilmes}@ee.washington.edu
More informationInteractive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method
Interactive Evolutionary Multi-Objective Optimization and Decision-Making using Reference Direction Method ABSTRACT Kalyanmoy Deb Department of Mechanical Engineering Indian Institute of Technology Kanpur
More informationAn Evolutionary Strategy for. Decremental Multi-Objective Optimization Problems
An Evolutionary Strategy or Decremental Multi-Objective Optimization Problems Sheng-Uei Guan *, Qian Chen and Wenting Mo School o Engineering and Design, Brunel University, UK Department o Electrical and
More informationForecasting Wind Ramps
Forecasting Wind Ramps Erin Summers and Anand Subramanian Jan 5, 20 Introduction The recent increase in the number of wind power producers has necessitated changes in the methods power system operators
More informationMulti Objective Optimization
Multi Objective Optimization Handout November 4, 2011 (A good reference for this material is the book multi-objective optimization by K. Deb) 1 Multiple Objective Optimization So far we have dealt with
More informationSTATISTICS Relationships between variables: Correlation
STATISTICS 16 Relationships between variables: Correlation The gentleman pictured above is Sir Francis Galton. Galton invented the statistical concept of correlation and the use of the regression line.
More informationMultiobjective Optimization of the Production Process for Ground Granulated Blast Furnace Slags
Noname manuscript No (will be inserted by the editor) Multiobjective Optimization of the Production Process for Ground Granulated Blast Furnace Slags Kang Wang Xiaoli Li Chao Jia Shengxiang Yang Miqing
More informationResearch Article Optimal Solutions of Multiproduct Batch Chemical Process Using Multiobjective Genetic Algorithm with Expert Decision System
Hindawi Publishing Corporation Journal of Automated Methods and Management in Chemistry Volume 2009, Article ID 927426, 9 pages doi:10.1155/2009/927426 Research Article Optimal Solutions of Multiproduct
More informationStochastic processes and
Stochastic processes and Markov chains (part I) Wessel van Wieringen w.n.van.wieringen@vu.nl wieringen@vu nl Department of Epidemiology and Biostatistics, VUmc & Department of Mathematics, VU University
More informationDynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement
Dynamic Call Center Routing Policies Using Call Waiting and Agent Idle Times Online Supplement Wyean Chan DIRO, Université de Montréal, C.P. 6128, Succ. Centre-Ville, Montréal (Québec), H3C 3J7, CANADA,
More informationOn Constrained Boolean Pareto Optimization
On Constrained Boolean Pareto Optimization Chao Qian and Yang Yu and Zhi-Hua Zhou National Key Laboratory for Novel Software Technology, Nanjing University Collaborative Innovation Center of Novel Software
More informationAppendix: Simple Methods for Shift Scheduling in Multi-Skill Call Centers
Appendix: Simple Methods for Shift Scheduling in Multi-Skill Call Centers Sandjai Bhulai, Ger Koole & Auke Pot Vrije Universiteit, De Boelelaan 1081a, 1081 HV Amsterdam, The Netherlands Supplementary Material
More informationFACTOR ANALYSIS AND MULTIDIMENSIONAL SCALING
FACTOR ANALYSIS AND MULTIDIMENSIONAL SCALING Vishwanath Mantha Department for Electrical and Computer Engineering Mississippi State University, Mississippi State, MS 39762 mantha@isip.msstate.edu ABSTRACT
More informationThe RMS US inland flood model
The RMS US inland flood model Sonja Jankowfsky 1,2,a, Arno Hilberts 2, Christian Mortgat 1, Shuangcai Li 1, Na Xu 1, Yi Mei 1, Stephan Tillmanns 3, Ye Tian 1, Yang Yang 1 1 Risk Management Solutions, Inc.,
More informationBayesian Reasoning and Recognition
Intelligent Systems: Reasoning and Recognition James L. Crowley ENSIAG 2 / osig 1 Second Semester 2013/2014 Lesson 12 28 arch 2014 Bayesian Reasoning and Recognition Notation...2 Pattern Recognition...3
More informationMinimizing response times and queue lengths in systems of parallel queues
Minimizing response times and queue lengths in systems of parallel queues Ger Koole Department of Mathematics and Computer Science, Vrije Universiteit, De Boelelaan 1081a, 1081 HV Amsterdam, The Netherlands
More informationA.I. in health informatics lecture 2 clinical reasoning & probabilistic inference, I. kevin small & byron wallace
A.I. in health informatics lecture 2 clinical reasoning & probabilistic inference, I kevin small & byron wallace today a review of probability random variables, maximum likelihood, etc. crucial for clinical
More information