Cost optimisation by using DoE

Size: px
Start display at page:

Download "Cost optimisation by using DoE"

Transcription

1 Cost optimisation by using DoE The work of a paint formulator is strongly dependent of personal experience, since most properties cannot be predicted from mathematical equations The use of a Design of Experiments methodology and the selection of the right constrains aiming to optimise paint properties could be helpful This methodology can be used in the context of product's development final optimisation or for tune existing ones Result could be cost reduction of a product, within keeping or improving the original characteristics and properties Hugo Machado, Vasco Coelho, Inês Feyo, Filomena Braga, Fernanda Oliveira, José Nogueira, Adélio Mendes Paints are complex multicomponent systems The paint formulation process is complex and will determine the characteristics of the product A systematic approach is desirable allowing to investigate the effect of different variables and their relationship in the product's final attributes Usually a product born from the formulator's experience and inspiration and can depend of his/her state of mind and humour This is hard to co-ordinate and a lot of important combinations and interactions can be lost with high costs Formulators should use a methodical approach that allows getting the greatest desirability at the lowest cost Optimise design of experiments Design of Experiments (DoE) is used to identify or screen the important factors affecting a process or product and to develop empirical models These techniques enable to get a maximum amount of information from a minimum number of runs There are different kinds of designs, such as: Latin Square, Factorial Design, Taguchi Methods or Mixture Design, among others Previously, other works were published applying a DoE methodology to paint formulations optimisation [1, 2] However, little emphasis was given on how to choose variable limits, restrictions and how to perform the tests This paper aims to treat these issues more deeply and to provide another example of the use of DoE methodology for paint formulation optimisation Mixture design and analysis In many designs the range of variable such as temperature is limited only by physical constrains within the system When dealing with mixtures there also is a mathematical constrain for the mixture variables - the component proportions must sum to unity Thus, for example, with a three-variable mix it is impossible to vary all the three variables independently of each other and the mathematical constrain must be taken into consideration in both design and analysis A one at a time variable study is not an efficient approach for mixtures because can require a lot of human effort and is inefficient capturing subtleties In mixture experiments, the measured response is assumed to depend only on the relative proportions of the ingredients or components in the mixture and not on the amount of the mixture Factorial Design and Taguchi Methods are not appropriate for mixtures since do not take into account the dependence of response on proportionality of variables [3] When the mixture components are only subject to the constrain that they must some one, standard mixture designs, such as "Simplex Lattice" or "Simplex Centroid" can be used When mixture components are subject to additional constrains, such as maximum and/or minimum value for each component, designs other than the standard mixture designs, such as D-Optimal or Extreme Vertices designs are appropriate [4] In mixture problems, the purpose of the experiments is to model the design space with some form of mathematical equation or using other appropriate method D-optimal point selection This optimality criterion results in minimising the generalised variance of the parameters estimates for a pre-specified model As a result, the "optimality" of a given D-optimal design is model dependent That is, the experimenter must specify a model for the design before generate the specific treatment combinations for the design Given the total number of treatment runs for an experiment and a specified model, the algorithm chooses the optimal set of design runs from a candidate set of possible treatment runs In other words, the candidate set is a collection of treatment combinations from which the D-optimal algorithm chooses the treatment combinations to include in the design This candidate set of treatment points usually consists of all possible combinations of various factor levels that one wishes to use in the experiment D-optimal point selection maximises the determinant of the Fisher information matrix [5] The optimisation is performed to minimise the general variance of the coefficients in the model Scheffe's method a classical approach When the number of parameters of interest is extremely large, such as in the case of quantifying the uncertainty in the estimate of a regression curve or a response surface, the standard multiple comparisons methods for a finite number of parameters often lead to an infinite confidence bound or a test too conservative to be useful In these cases, the methods designed for a continuos domain must be used The Scheffe's methods is a classical approach for such purpose [6] It provides a simultaneous confidence bound for a regression function when errors are Gaussian, independents, homoscedastic and the predictor space is unconstrained, ie, the domain of interest is the whole dimensional Euclidean space Software with human intelligence Intelligent software gets this name because it's based on artificial intelligence technology, a prosper field which aims at having the computers mimic the human intelligence Specifically, "Artificial Neural Networks" (ANN) has been used successfully to discover hidden cause and effect relationships within data ANN can be considered "universal approximation machines" The application in the resolution of complex regression or classification problems is nowadays a reality in many areas of knowledge and in the technological development of intelligent systems [7] The scheme of multi-layer perceptron, one of the most used ANN architectures, is shown in Figure 1 It's a very appropriate architecture for regression problems, like in design of experiments It was decided to add two more constrains, based on the same benchmarking results: PVC and Volume of solids (VS) Variability of test methods has to be screen out The next step was to select the response properties or characteristics After a brainstorming session the contrast ratio, viscosity and cost were chosen Special care should be take when measuring the contrast

2 ratio It's a test method with low repeatability and with a lot of uncertainty Trying to reduce the measurement errors, 5 cards have been applied for each of the 30 design formulations For each card, 5 readings were performed, in a total of 25 readings for each design formulation (5 cards x 5 readings) This represents a lot of extra effort, but there is need to be sure that the differences in the contrast ratio result only from the differences in the formulation, instead of differences due to the test method variability Using all this information, the "Design Expert" (version 606) software and choosing the D-optimal mixture design, a design matrix with 5 replicate runs was obtained see Table 3 These replicate runs were made to estimate the method repeatability (it considers variability in product making and the analysis method) Find a formulation with lower cost The next step is the truly optimisation one A formulation that meets the standard formulation properties with lower cost must be found The following parameters have been established see Table 4 Setting these targets, the following possibilities were obtained from a second degree interpolator polynomial (Table 5) Since some of the formulations obtained were similar, four were selected to be experimentally formulated and evaluated to be compared with the standard formulation The formulations chosen were No 1, 4, 5 and 6 A comparison of composition of the four formulations and the standard can be found in Figure 2 The experimental values obtained for formulations No 1, 4, 5 and 6 can be observed in Table 6 The formulation chosen was No 4 An exhaustive comparison against the standard was performed and can be observed in Table 7 Using the design matrix, neural networks have been trained to predict the contrast ratio The architecture used was (4-8-1): 4 inputs (raw materials), 4 hidden nodes (logistic = 1/ 1 + e -x ) and 1 output (linear), the contrast ratio The software package used was "Statistica Neural Networks" (Release 40 F), from Statsoft The suggestions obtained after the optimisation step have been used to test the neural networks model see Table 5 The predictions obtained for contrast ratio by the second order polynomial have been compared with the ones obtained from the neural network model As can be seen from Figure 3, neural networks fits better the experimental data The same conclusion can be obtained from Figure 4 Acknowledgements The authors wish to thank to José Alves and all the analysts from CIN research lab References [1] M J Anderson, P J Whitcomb, Optimization of Paint Formulations Made Easy with Computer-Aided Design of Experiments for Mixtures, Journal of Coatings Technology, Vol 68, No 858, July (1996) [2] K W Chau, WR Kelley, Formulation of Printable Coatings via D-Optimality, Journal of Coatings Technology, Vol 65, No 821, June (1993) [3] M J Anderson, P J Whitcomb, Find the Optimal Formulation for Mixtures, April (1998) [4] m [5] m [6] D C Montgomery, Design and Analysis of Experiments, John Wiley & Sons, New York (2001) [7] J Dayhoff, Neural Network Architectures: An Introduction, Van Nostrand Reinhold, New York (1990) Experimental The major contributor for a paint formulation cost is usually titanium dioxide For the formulation studied it represents approximately 47% of the formulation cost and contributes only with 14% for the mass To reduce the amount of titanium dioxide, keeping the original characteristics of a product, the extenders and the opacifying agents amounts must be changed This is the first important step of a design of experiments, choosing the important variables To vary the amount of titanium dioxide, calcium carbonate slurry, emulsion and organic opacifier was chosen by keeping the other raw materials amounts unchangeable The next thing to do is to set limits for each variable This means that the design can be made within the range specified for each raw material This is probably the most important step in the optimisation process, since a bad choice of the variables limits can ruin the project Nevertheless this can be made without any theoretical or empirical knowledge, using benchmarking results for similar products For this project all high pigment volume concentration (PVC) with medium titanium dioxide content products, produced at CIN - Portugal, were compared From these results the following limits were set (see Table 1 and 2) Results at a glance A reduction of 76% in product's cost (by volume) has been achieved keeping or improving most of the original waterborne paint properties The design of experiments methodology is very easy to use and should be applied in product's fine tuning or in the reformulation of products, namely to replace raw materials in formulation The optimisation can be performed by a non-expert technician, using benchmarking results Extra care should be taken when performing the analysis, specially for contrast ratio, due to uncertainty linked with the measurement method The optimisation using neural networks instead of the interpolator 2nd order polynomial showed to fit better the experimental data and will be object of further investigation LIFELINE -> Hugo Machado is a Quality Engineer at CIN He graduated in Chemical Engineering from the Faculty of Engineering at the University of Porto in 2000 and works for CIN since then He is currently managing Six Sigma projects His areas of interest are continuos improvement, products and processes optimisation and paint properties prediction -> Vasco Coelho is a first-degree engineering at Megadur (CIN's Powder Coatings) He graduated in Chemical Engineering from the Faculty of Engineering at the University of Porto in 2002 His main interests include Process Control Technologies -> Inês Feyo de Azevedo is graduated in Chemical Engineering from the Faculty of Engineering at the University of Porto in 2002 She is currently attending to a training course on Promoting of Company Innovation and Internationalisation -> FILOMENA BRAGA works in Research and Development of Decorative products at CIN She is also Decorative products direction assistant She graduated in Chemical

3 Engineering from the Faculty of Engineering at the University of Porto in 1980 and works in the paint industry since > FERNANDA OLIVEIRA studied Chemical Engineering at the University of Porto, Portugal She has joined CIN SA in 1990, where she is working on the application of new technologies to the coatings industry In 2000, she has received a master degree in Paint Technology from the University of Barcelona -> JOSÉ NOGUEIRA is the CIN's Technical Director He graduated in Chemical Engineering from the Faculty of Engineering at the University of Porto in 1969 and he works for CIN since then -> ADÉLIO M MENDES is Associate Professor of Chemical Engineering at the Faculty of Engineering at the University of Porto, Portugal He graduated in Chemical Engineering (1987) and earned his PhD (1993) from the same school He teaches Chemical Engineering Laboratories, Separation Processes, Numerical Methods and Statistics His main research interests include membrane and sorption gas separations, catalytic membrane reactors and fuel cells

4 Figure 1: Multi - layer perceptron Figure 2: Selected formulations composition

5 Figure 3: Real values and predicted values for Contrast Ratio Figure 4: Errors obtained for contrast ratio prediction

6

7

8

9

10

11

12

Response Surface Methodology

Response Surface Methodology Response Surface Methodology Process and Product Optimization Using Designed Experiments Second Edition RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona

More information

Sizing Mixture (RSM) Designs for Adequate Precision via Fraction of Design Space (FDS)

Sizing Mixture (RSM) Designs for Adequate Precision via Fraction of Design Space (FDS) for Adequate Precision via Fraction of Design Space (FDS) Pat Whitcomb Stat-Ease, Inc. 61.746.036 036 fax 61.746.056 pat@statease.com Gary W. Oehlert School of Statistics University it of Minnesota 61.65.1557

More information

State University of Santa Catarina, Centre of Technology Sciences (UDESC/CCT), Joinville-SC, Brazil

State University of Santa Catarina, Centre of Technology Sciences (UDESC/CCT), Joinville-SC, Brazil Using experiments design to model linear firing shrinkage of triaxial ceramic bodies S.L. Correia a,b, K.A.S., Curto b, D. Hotza b,c, A. M. Segadães d* a State University of Santa Catarina, Centre of Technology

More information

Response Surface Methodology:

Response Surface Methodology: Response Surface Methodology: Process and Product Optimization Using Designed Experiments RAYMOND H. MYERS Virginia Polytechnic Institute and State University DOUGLAS C. MONTGOMERY Arizona State University

More information

Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr. Harit K. Raval 3

Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr. Harit K. Raval 3 Investigations on Prediction of MRR and Surface Roughness on Electro Discharge Machine Using Regression Analysis and Artificial Neural Network Programming Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr.

More information

RESPONSE SURFACE METHODOLOGY

RESPONSE SURFACE METHODOLOGY RESPONSE SURFACE METHODOLOGY WILEY SERIES IN PROBABILITY AND STATISTICS Established by WALTER A. SHEWHART and SAMUEL S. WILKS Editors: David J. Balding, Noel A. C. Cressie, Garrett M. Fitzmaurice, Iain

More information

CHEMICAL ENGINEERING (CHE)

CHEMICAL ENGINEERING (CHE) Chemical Engineering (CHE) 1 CHEMICAL ENGINEERING (CHE) CHE 2033 Introduction to Chemical Process Engineering Prerequisites: CHEM 1515 and ENSC 2213 Description: Concurrent enrollment in MATH 2233 or 3263,

More information

Artificial Neural Networks. MGS Lecture 2

Artificial Neural Networks. MGS Lecture 2 Artificial Neural Networks MGS 2018 - Lecture 2 OVERVIEW Biological Neural Networks Cell Topology: Input, Output, and Hidden Layers Functional description Cost functions Training ANNs Back-Propagation

More information

Portugaliae Electrochimica Acta 26/4 (2008)

Portugaliae Electrochimica Acta 26/4 (2008) Portugaliae Electrochimica Acta 6/4 (008) 6-68 PORTUGALIAE ELECTROCHIMICA ACTA Comparison of Regression Model and Artificial Neural Network Model for the Prediction of Volume Percent of Diamond Deposition

More information

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition

DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition DESIGN AND ANALYSIS OF EXPERIMENTS Third Edition Douglas C. Montgomery ARIZONA STATE UNIVERSITY JOHN WILEY & SONS New York Chichester Brisbane Toronto Singapore Contents Chapter 1. Introduction 1-1 What

More information

Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland

Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland EnviroInfo 2004 (Geneva) Sh@ring EnviroInfo 2004 Advanced analysis and modelling tools for spatial environmental data. Case study: indoor radon data in Switzerland Mikhail Kanevski 1, Michel Maignan 1

More information

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition

Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Brochure More information from http://www.researchandmarkets.com/reports/705963/ Response Surface Methodology: Process and Product Optimization Using Designed Experiments, 3rd Edition Description: Identifying

More information

OPTIMIZATION ON SURFACE ROUGHNESS OF BORING PROCESS BY VARYING DAMPER POSITION

OPTIMIZATION ON SURFACE ROUGHNESS OF BORING PROCESS BY VARYING DAMPER POSITION OPTIMIZATION ON SURFACE ROUGHNESS OF BORING PROCESS BY VARYING DAMPER POSITION Wasis Nugroho, Nor Bahiyah Baba and Adi Saptari Faculty of Manufacturing Engineering Technology, TATI University College,

More information

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University

Experimental design. Matti Hotokka Department of Physical Chemistry Åbo Akademi University Experimental design Matti Hotokka Department of Physical Chemistry Åbo Akademi University Contents Elementary concepts Regression Validation Design of Experiments Definitions Random sampling Factorial

More information

1 History of statistical/machine learning. 2 Supervised learning. 3 Two approaches to supervised learning. 4 The general learning procedure

1 History of statistical/machine learning. 2 Supervised learning. 3 Two approaches to supervised learning. 4 The general learning procedure Overview Breiman L (2001). Statistical modeling: The two cultures Statistical learning reading group Aleander L 1 Histor of statistical/machine learning 2 Supervised learning 3 Two approaches to supervised

More information

DEPARTMENT OF POLYMER AND PROCESS ENGINEERING (http://www.uet.edu.pk/polymer.htm)

DEPARTMENT OF POLYMER AND PROCESS ENGINEERING (http://www.uet.edu.pk/polymer.htm) DEPARTMENT OF POLYMER AND PROCESS ENGINEERING (http://www.uet.edu.pk/polymer.htm) Programs Offered The Department offers the following degree programmes a) M.Sc. Polymer and Process Engineering b) Ph.D.

More information

Introduction to the Design and Analysis of Experiments

Introduction to the Design and Analysis of Experiments Introduction to the Design and Analysis of Experiments Geoffrey M. Clarke, MA,Dip.stats.,c.stat. Honorary Reader in Applied Statistics, University of Kent at Canterbury and Consultant to the Applied Statistics

More information

Modeling and Optimization of Milling Process by using RSM and ANN Methods

Modeling and Optimization of Milling Process by using RSM and ANN Methods Modeling and Optimization of Milling Process by using RSM and ANN Methods M.R. SOLEYMANI YAZDI, A. KHORRAM Abstract Nowadays numerical and Artificial Neural Networks (ANN) methods are widely used for both

More information

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso

Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso Artificial Neural Networks (ANN) Xiaogang Su, Ph.D. Department of Mathematical Science University of Texas at El Paso xsu@utep.edu Fall, 2018 Outline Introduction A Brief History ANN Architecture Terminology

More information

FORECASTING OF ECONOMIC QUANTITIES USING FUZZY AUTOREGRESSIVE MODEL AND FUZZY NEURAL NETWORK

FORECASTING OF ECONOMIC QUANTITIES USING FUZZY AUTOREGRESSIVE MODEL AND FUZZY NEURAL NETWORK FORECASTING OF ECONOMIC QUANTITIES USING FUZZY AUTOREGRESSIVE MODEL AND FUZZY NEURAL NETWORK Dusan Marcek Silesian University, Institute of Computer Science Opava Research Institute of the IT4Innovations

More information

The application of neural networks to the paper-making industry

The application of neural networks to the paper-making industry The application of neural networks to the paper-making industry P. J. Edwards y, A.F. Murray y, G. Papadopoulos y, A.R. Wallace y and J. Barnard x y Dept. of Electronics and Electrical Eng., Edinburgh

More information

Bagging During Markov Chain Monte Carlo for Smoother Predictions

Bagging During Markov Chain Monte Carlo for Smoother Predictions Bagging During Markov Chain Monte Carlo for Smoother Predictions Herbert K. H. Lee University of California, Santa Cruz Abstract: Making good predictions from noisy data is a challenging problem. Methods

More information

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann Neural Networks with Applications to Vision and Language Feedforward Networks Marco Kuhlmann Feedforward networks Linear separability x 2 x 2 0 1 0 1 0 0 x 1 1 0 x 1 linearly separable not linearly separable

More information

10/05/2016. Computational Methods for Data Analysis. Massimo Poesio SUPPORT VECTOR MACHINES. Support Vector Machines Linear classifiers

10/05/2016. Computational Methods for Data Analysis. Massimo Poesio SUPPORT VECTOR MACHINES. Support Vector Machines Linear classifiers Computational Methods for Data Analysis Massimo Poesio SUPPORT VECTOR MACHINES Support Vector Machines Linear classifiers 1 Linear Classifiers denotes +1 denotes -1 w x + b>0 f(x,w,b) = sign(w x + b) How

More information

The Lady Tasting Tea. How to deal with multiple testing. Need to explore many models. More Predictive Modeling

The Lady Tasting Tea. How to deal with multiple testing. Need to explore many models. More Predictive Modeling The Lady Tasting Tea More Predictive Modeling R. A. Fisher & the Lady B. Muriel Bristol claimed she prefers tea added to milk rather than milk added to tea Fisher was skeptical that she could distinguish

More information

CS 4700: Artificial Intelligence

CS 4700: Artificial Intelligence CS 4700: Foundations of Artificial Intelligence Fall 2017 Instructor: Prof. Haym Hirsh Lecture 18 Prelim Grade Distribution Homework 3: Out Today Extra Credit Opportunity: 4:15pm Today, Gates G01 Relaxing

More information

MLPR: Logistic Regression and Neural Networks

MLPR: Logistic Regression and Neural Networks MLPR: Logistic Regression and Neural Networks Machine Learning and Pattern Recognition Amos Storkey Amos Storkey MLPR: Logistic Regression and Neural Networks 1/28 Outline 1 Logistic Regression 2 Multi-layer

More information

Neural Networks. Nethra Sambamoorthi, Ph.D. Jan CRMportals Inc., Nethra Sambamoorthi, Ph.D. Phone:

Neural Networks. Nethra Sambamoorthi, Ph.D. Jan CRMportals Inc., Nethra Sambamoorthi, Ph.D. Phone: Neural Networks Nethra Sambamoorthi, Ph.D Jan 2003 CRMportals Inc., Nethra Sambamoorthi, Ph.D Phone: 732-972-8969 Nethra@crmportals.com What? Saying it Again in Different ways Artificial neural network

More information

Outline. MLPR: Logistic Regression and Neural Networks Machine Learning and Pattern Recognition. Which is the correct model? Recap.

Outline. MLPR: Logistic Regression and Neural Networks Machine Learning and Pattern Recognition. Which is the correct model? Recap. Outline MLPR: and Neural Networks Machine Learning and Pattern Recognition 2 Amos Storkey Amos Storkey MLPR: and Neural Networks /28 Recap Amos Storkey MLPR: and Neural Networks 2/28 Which is the correct

More information

ECE-271B. Nuno Vasconcelos ECE Department, UCSD

ECE-271B. Nuno Vasconcelos ECE Department, UCSD ECE-271B Statistical ti ti Learning II Nuno Vasconcelos ECE Department, UCSD The course the course is a graduate level course in statistical learning in SLI we covered the foundations of Bayesian or generative

More information

Artificial Intelligence

Artificial Intelligence Artificial Intelligence Jeff Clune Assistant Professor Evolving Artificial Intelligence Laboratory Announcements Be making progress on your projects! Three Types of Learning Unsupervised Supervised Reinforcement

More information

Response Surface Models for Optimization of Wheat Straw- Polypropylene Composite Formulations

Response Surface Models for Optimization of Wheat Straw- Polypropylene Composite Formulations Proceedings of the 014 International Conference on Industrial Engineering and Operations Management Bali, Indonesia, January 7 9, 014 Response Surface Models for Optimization of Wheat Straw- Polypropylene

More information

ENGRG Introduction to GIS

ENGRG Introduction to GIS ENGRG 59910 Introduction to GIS Michael Piasecki October 13, 2017 Lecture 06: Spatial Analysis Outline Today Concepts What is spatial interpolation Why is necessary Sample of interpolation (size and pattern)

More information

LEARNING & LINEAR CLASSIFIERS

LEARNING & LINEAR CLASSIFIERS LEARNING & LINEAR CLASSIFIERS 1/26 J. Matas Czech Technical University, Faculty of Electrical Engineering Department of Cybernetics, Center for Machine Perception 121 35 Praha 2, Karlovo nám. 13, Czech

More information

Negatively Correlated Echo State Networks

Negatively Correlated Echo State Networks Negatively Correlated Echo State Networks Ali Rodan and Peter Tiňo School of Computer Science, The University of Birmingham Birmingham B15 2TT, United Kingdom E-mail: {a.a.rodan, P.Tino}@cs.bham.ac.uk

More information

CSE 417T: Introduction to Machine Learning. Lecture 11: Review. Henry Chai 10/02/18

CSE 417T: Introduction to Machine Learning. Lecture 11: Review. Henry Chai 10/02/18 CSE 417T: Introduction to Machine Learning Lecture 11: Review Henry Chai 10/02/18 Unknown Target Function!: # % Training data Formal Setup & = ( ), + ),, ( -, + - Learning Algorithm 2 Hypothesis Set H

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Article from Predictive Analytics and Futurism July 2016 Issue 13 Regression and Classification: A Deeper Look By Jeff Heaton Classification and regression are the two most common forms of models fitted

More information

Software Sleuth Solves Engineering Problems

Software Sleuth Solves Engineering Problems 1 Software Sleuth Solves Engineering Problems Mark J. Anderson and Patrick J. Whitcomb Stat-Ease, Inc. 2021 East Hennepin Ave, Suite 191, Minneapolis, MN 55413 Telephone: 612/378-9449, Fax: 612/378-2152

More information

On the convergence speed of artificial neural networks in the solving of linear systems

On the convergence speed of artificial neural networks in the solving of linear systems Available online at http://ijimsrbiauacir/ Int J Industrial Mathematics (ISSN 8-56) Vol 7, No, 5 Article ID IJIM-479, 9 pages Research Article On the convergence speed of artificial neural networks in

More information

Sparse vectors recap. ANLP Lecture 22 Lexical Semantics with Dense Vectors. Before density, another approach to normalisation.

Sparse vectors recap. ANLP Lecture 22 Lexical Semantics with Dense Vectors. Before density, another approach to normalisation. ANLP Lecture 22 Lexical Semantics with Dense Vectors Henry S. Thompson Based on slides by Jurafsky & Martin, some via Dorota Glowacka 5 November 2018 Previous lectures: Sparse vectors recap How to represent

More information

ANLP Lecture 22 Lexical Semantics with Dense Vectors

ANLP Lecture 22 Lexical Semantics with Dense Vectors ANLP Lecture 22 Lexical Semantics with Dense Vectors Henry S. Thompson Based on slides by Jurafsky & Martin, some via Dorota Glowacka 5 November 2018 Henry S. Thompson ANLP Lecture 22 5 November 2018 Previous

More information

Development of Stochastic Artificial Neural Networks for Hydrological Prediction

Development of Stochastic Artificial Neural Networks for Hydrological Prediction Development of Stochastic Artificial Neural Networks for Hydrological Prediction G. B. Kingston, M. F. Lambert and H. R. Maier Centre for Applied Modelling in Water Engineering, School of Civil and Environmental

More information

Optimisation of multi-parameter empirical fitting functions By David Knight

Optimisation of multi-parameter empirical fitting functions By David Knight 1 Optimisation of multi-parameter empirical fitting functions By David Knight Version 1.02, 1 st April 2013. D. W. Knight, 2010-2013. Check the author's website to ensure that you have the most recent

More information

COMPARING THE EFFECTS OF APPLICATION OF THE SMART AND TRADITIONAL DESIGNS OF EXPERIMENT

COMPARING THE EFFECTS OF APPLICATION OF THE SMART AND TRADITIONAL DESIGNS OF EXPERIMENT ANDRZEJ SKOWRONEK * COMPARING THE EFFECTS OF APPLICATION OF THE SMART AND TRADITIONAL DESIGNS OF EXPERIMENT PORÓWNANIE EFEKTÓW ZASTOSOWANIA ELASTYCZNYCH I TRADYCYJNYCH PLANÓW EKSPERYMENTU Abstract This

More information

Process Characterization Using Response Surface Methodology

Process Characterization Using Response Surface Methodology Process Characterization Using Response Surface Methodology A Senior Project Presented to The Faculty of the Statistics Department California Polytechnic State University, San Luis Obispo In Partial Fulfillment

More information

A FERTILIZER-RATE EXPERIMENT INVOLVING YOUNG CITRUS TREES: DOES MORE FERTILIZER MEAN HIGHER PRODUCING TREES?

A FERTILIZER-RATE EXPERIMENT INVOLVING YOUNG CITRUS TREES: DOES MORE FERTILIZER MEAN HIGHER PRODUCING TREES? Libraries Conference on Applied Statistics in Agriculture 2000-12th Annual Conference Proceedings A FERTLZER-RATE EXPERMENT NVOLVNG YOUNG CTRUS TREES: DOES MORE FERTLZER MEAN HGHER PRODUCNG TREES? John

More information

GeoHealth Applications Platform ESRI Health GIS Conference 2013

GeoHealth Applications Platform ESRI Health GIS Conference 2013 GeoHealth Applications Platform ESRI Health GIS Conference 2013 Authors Thomas A. Horan, Ph.D. Professor, CISAT Director April Moreno Health GeoInformatics Ph.D. Student Brian N. Hilton, Ph.D. Clinical

More information

CS 570: Machine Learning Seminar. Fall 2016

CS 570: Machine Learning Seminar. Fall 2016 CS 570: Machine Learning Seminar Fall 2016 Class Information Class web page: http://web.cecs.pdx.edu/~mm/mlseminar2016-2017/fall2016/ Class mailing list: cs570@cs.pdx.edu My office hours: T,Th, 2-3pm or

More information

!"#$ Reservoir Fluid Properties. State of the Art and Outlook for Future Development. Dr. Muhammad Al-Marhoun

!#$ Reservoir Fluid Properties. State of the Art and Outlook for Future Development. Dr. Muhammad Al-Marhoun Society of Petroleum Engineers SPE 2001 2002 Distinguished Lecturer Program 4 July 2002 Reservoir Fluid Properties State of the Art and Outlook for Future Development Dr. Muhammad Al-Marhoun King Fahd

More information

Artificial Neural Networks

Artificial Neural Networks Introduction ANN in Action Final Observations Application: Poverty Detection Artificial Neural Networks Alvaro J. Riascos Villegas University of los Andes and Quantil July 6 2018 Artificial Neural Networks

More information

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others) Machine Learning Neural Networks (slides from Domingos, Pardo, others) Human Brain Neurons Input-Output Transformation Input Spikes Output Spike Spike (= a brief pulse) (Excitatory Post-Synaptic Potential)

More information

The Model Building Process Part I: Checking Model Assumptions Best Practice (Version 1.1)

The Model Building Process Part I: Checking Model Assumptions Best Practice (Version 1.1) The Model Building Process Part I: Checking Model Assumptions Best Practice (Version 1.1) Authored by: Sarah Burke, PhD Version 1: 31 July 2017 Version 1.1: 24 October 2017 The goal of the STAT T&E COE

More information

Probability and Information Theory. Sargur N. Srihari

Probability and Information Theory. Sargur N. Srihari Probability and Information Theory Sargur N. srihari@cedar.buffalo.edu 1 Topics in Probability and Information Theory Overview 1. Why Probability? 2. Random Variables 3. Probability Distributions 4. Marginal

More information

Positive and Nondestructive Identification of Acrylic-Based Coatings

Positive and Nondestructive Identification of Acrylic-Based Coatings Positive and Nondestructive Identification of Acrylic-Based Coatings Using Partial Least Squares Discriminant Analysis with the Agilent 4300 Handheld FTIR Application Note Materials Testing and Research

More information

Lecture - 24 Radial Basis Function Networks: Cover s Theorem

Lecture - 24 Radial Basis Function Networks: Cover s Theorem Neural Network and Applications Prof. S. Sengupta Department of Electronic and Electrical Communication Engineering Indian Institute of Technology, Kharagpur Lecture - 24 Radial Basis Function Networks:

More information

Intelligent System for the Architectural Coatings Production

Intelligent System for the Architectural Coatings Production Intelligent System for the Architectural Coatings Production Aragón Candelaria Pablo René 1 y Vargas Soto José Emilio 2 DuPont Tecnologías de Titanio 1 Universidad Anáhuac México Sur, Facultad de Ingeniería

More information

A Fractal-ANN approach for quality control

A Fractal-ANN approach for quality control A Fractal-ANN approach for quality control Kesheng Wang Department of Production and Quality Engineering, University of Science and Technology, N-7491 Trondheim, Norway Abstract The main problem with modern

More information

Environmental Data Mining and Modelling Based on Machine Learning Algorithms and Geostatistics

Environmental Data Mining and Modelling Based on Machine Learning Algorithms and Geostatistics Environmental Data Mining and Modelling Based on Machine Learning Algorithms and Geostatistics M. Kanevski a, R. Parkin b, A. Pozdnukhov b, V. Timonin b, M. Maignan c, B. Yatsalo d, S. Canu e a IDIAP Dalle

More information

Deep Learning Architecture for Univariate Time Series Forecasting

Deep Learning Architecture for Univariate Time Series Forecasting CS229,Technical Report, 2014 Deep Learning Architecture for Univariate Time Series Forecasting Dmitry Vengertsev 1 Abstract This paper studies the problem of applying machine learning with deep architecture

More information

Introduction to Machine Learning (Pattern recognition and model fitting) for Master students

Introduction to Machine Learning (Pattern recognition and model fitting) for Master students Introduction to Machine Learning (Pattern recognition and model fitting) for Master students Spring 007, ÖU/RAP Thorsteinn Rögnvaldsson thorsteinn.rognvaldsson@tech.oru.se Contents Machine learning algorithms

More information

ECE662: Pattern Recognition and Decision Making Processes: HW TWO

ECE662: Pattern Recognition and Decision Making Processes: HW TWO ECE662: Pattern Recognition and Decision Making Processes: HW TWO Purdue University Department of Electrical and Computer Engineering West Lafayette, INDIANA, USA Abstract. In this report experiments are

More information

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan Linear Regression CSL603 - Fall 2017 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis Regularization

More information

PERFORMANCE SCREENING OF A LOUVERED FIN AND VORTEX GENERATOR COMBINATION

PERFORMANCE SCREENING OF A LOUVERED FIN AND VORTEX GENERATOR COMBINATION HEFAT2014 10 th International Conference on Heat Transfer, Fluid Mechanics and Thermodynamics 14 26 July 2014 Orlando, Florida PERFORMANCE SCREENING OF A LOUVERED FIN AND VORTEX GENERATOR COMBINATION Bernd

More information

By choosing to view this document, you agree to all provisions of the copyright laws protecting it.

By choosing to view this document, you agree to all provisions of the copyright laws protecting it. Copyright 2017 IEEE. Reprinted, with permission, from Sharon L. Honecker and Umur Yenal, Quantifying the Effect of a Potential Corrective Action on Product Life, 2017 Reliability and Maintainability Symposium,

More information

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan Linear Regression CSL465/603 - Fall 2016 Narayanan C Krishnan ckn@iitrpr.ac.in Outline Univariate regression Multivariate regression Probabilistic view of regression Loss functions Bias-Variance analysis

More information

Analysis of Multilayer Neural Network Modeling and Long Short-Term Memory

Analysis of Multilayer Neural Network Modeling and Long Short-Term Memory Analysis of Multilayer Neural Network Modeling and Long Short-Term Memory Danilo López, Nelson Vera, Luis Pedraza International Science Index, Mathematical and Computational Sciences waset.org/publication/10006216

More information

Sample questions for Fundamentals of Machine Learning 2018

Sample questions for Fundamentals of Machine Learning 2018 Sample questions for Fundamentals of Machine Learning 2018 Teacher: Mohammad Emtiyaz Khan A few important informations: In the final exam, no electronic devices are allowed except a calculator. Make sure

More information

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009 AN INTRODUCTION TO NEURAL NETWORKS Scott Kuindersma November 12, 2009 SUPERVISED LEARNING We are given some training data: We must learn a function If y is discrete, we call it classification If it is

More information

Artificial Neural Networks

Artificial Neural Networks Artificial Neural Networks Stephan Dreiseitl University of Applied Sciences Upper Austria at Hagenberg Harvard-MIT Division of Health Sciences and Technology HST.951J: Medical Decision Support Knowledge

More information

I D I A P. Online Policy Adaptation for Ensemble Classifiers R E S E A R C H R E P O R T. Samy Bengio b. Christos Dimitrakakis a IDIAP RR 03-69

I D I A P. Online Policy Adaptation for Ensemble Classifiers R E S E A R C H R E P O R T. Samy Bengio b. Christos Dimitrakakis a IDIAP RR 03-69 R E S E A R C H R E P O R T Online Policy Adaptation for Ensemble Classifiers Christos Dimitrakakis a IDIAP RR 03-69 Samy Bengio b I D I A P December 2003 D a l l e M o l l e I n s t i t u t e for Perceptual

More information

CS 188: Artificial Intelligence Spring Announcements

CS 188: Artificial Intelligence Spring Announcements CS 188: Artificial Intelligence Spring 2010 Lecture 22: Nearest Neighbors, Kernels 4/18/2011 Pieter Abbeel UC Berkeley Slides adapted from Dan Klein Announcements On-going: contest (optional and FUN!)

More information

Confidence Estimation Methods for Neural Networks: A Practical Comparison

Confidence Estimation Methods for Neural Networks: A Practical Comparison , 6-8 000, Confidence Estimation Methods for : A Practical Comparison G. Papadopoulos, P.J. Edwards, A.F. Murray Department of Electronics and Electrical Engineering, University of Edinburgh Abstract.

More information

A Novel Activity Detection Method

A Novel Activity Detection Method A Novel Activity Detection Method Gismy George P.G. Student, Department of ECE, Ilahia College of,muvattupuzha, Kerala, India ABSTRACT: This paper presents an approach for activity state recognition of

More information

High-throughput Agrochemical Formulation: Easing the Route to Commercial Manufacture

High-throughput Agrochemical Formulation: Easing the Route to Commercial Manufacture High-throughput Agrochemical Formulation: Easing the Route to Commercial Manufacture Ian Tovey, Syngenta HTFS III 26-APRIL-2017 Agribusiness an essential industry By 2050, global population will rise by

More information

Neural Networks: Introduction

Neural Networks: Introduction Neural Networks: Introduction Machine Learning Fall 2017 Based on slides and material from Geoffrey Hinton, Richard Socher, Dan Roth, Yoav Goldberg, Shai Shalev-Shwartz and Shai Ben-David, and others 1

More information

International Journal of Scientific & Engineering Research, Volume 5, Issue 1, January ISSN

International Journal of Scientific & Engineering Research, Volume 5, Issue 1, January ISSN International Journal of Scientific & Engineering Research, Volume 5, Issue 1, January-2014 2026 Modelling of Process Parameters on D2 Steel using Wire Electrical Discharge Machining with combined approach

More information

b) (1) Using the results of part (a), let Q be the matrix with column vectors b j and A be the matrix with column vectors v j :

b) (1) Using the results of part (a), let Q be the matrix with column vectors b j and A be the matrix with column vectors v j : Exercise assignment 2 Each exercise assignment has two parts. The first part consists of 3 5 elementary problems for a maximum of 10 points from each assignment. For the second part consisting of problems

More information

UNIVERSITY OF THE PHILIPPINES LOS BAÑOS INSTITUTE OF STATISTICS BS Statistics - Course Description

UNIVERSITY OF THE PHILIPPINES LOS BAÑOS INSTITUTE OF STATISTICS BS Statistics - Course Description UNIVERSITY OF THE PHILIPPINES LOS BAÑOS INSTITUTE OF STATISTICS BS Statistics - Course Description COURSE COURSE TITLE UNITS NO. OF HOURS PREREQUISITES DESCRIPTION Elementary Statistics STATISTICS 3 1,2,s

More information

Decision-Oriented Environmental Mapping with Radial Basis Function Neural Networks

Decision-Oriented Environmental Mapping with Radial Basis Function Neural Networks Decision-Oriented Environmental Mapping with Radial Basis Function Neural Networks V. Demyanov (1), N. Gilardi (2), M. Kanevski (1,2), M. Maignan (3), V. Polishchuk (1) (1) Institute of Nuclear Safety

More information

Lecture 6. Notes on Linear Algebra. Perceptron

Lecture 6. Notes on Linear Algebra. Perceptron Lecture 6. Notes on Linear Algebra. Perceptron COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Notes on linear algebra Vectors

More information

Practical Statistics for the Analytical Scientist Table of Contents

Practical Statistics for the Analytical Scientist Table of Contents Practical Statistics for the Analytical Scientist Table of Contents Chapter 1 Introduction - Choosing the Correct Statistics 1.1 Introduction 1.2 Choosing the Right Statistical Procedures 1.2.1 Planning

More information

Course in Data Science

Course in Data Science Course in Data Science About the Course: In this course you will get an introduction to the main tools and ideas which are required for Data Scientist/Business Analyst/Data Analyst. The course gives an

More information

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others)

Machine Learning. Neural Networks. (slides from Domingos, Pardo, others) Machine Learning Neural Networks (slides from Domingos, Pardo, others) For this week, Reading Chapter 4: Neural Networks (Mitchell, 1997) See Canvas For subsequent weeks: Scaling Learning Algorithms toward

More information

Reading Group on Deep Learning Session 1

Reading Group on Deep Learning Session 1 Reading Group on Deep Learning Session 1 Stephane Lathuiliere & Pablo Mesejo 2 June 2016 1/31 Contents Introduction to Artificial Neural Networks to understand, and to be able to efficiently use, the popular

More information

Exploiting Machine Learning Techniques for the Enhancement of Acceptance Sampling

Exploiting Machine Learning Techniques for the Enhancement of Acceptance Sampling Exploiting Machine Learning Techniques for the Enhancement of Acceptance Sampling Aikaterini Fountoulaki, Nikos Karacapilidis, and Manolis Manatakis International Science Index, Industrial and Manufacturing

More information

EXPERIMENTAL DESIGN TECHNIQUES APPLIED TO STUDY OF OXYGEN CONSUMPTION IN A FERMENTER 1

EXPERIMENTAL DESIGN TECHNIQUES APPLIED TO STUDY OF OXYGEN CONSUMPTION IN A FERMENTER 1 EXPERIMENTAL DESIGN TECHNIQUES APPLIED TO STUDY OF OXYGEN CONSUMPTION IN A FERMENTER 1 Blanca VELÁZQUEZ MSc, Department of Biotechnology Development Institute of Hygiene, Faculty of Medicine, University

More information

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann

(Feed-Forward) Neural Networks Dr. Hajira Jabeen, Prof. Jens Lehmann (Feed-Forward) Neural Networks 2016-12-06 Dr. Hajira Jabeen, Prof. Jens Lehmann Outline In the previous lectures we have learned about tensors and factorization methods. RESCAL is a bilinear model for

More information

Liang Li, PhD. MD Anderson

Liang Li, PhD. MD Anderson Liang Li, PhD Biostatistics @ MD Anderson Behavioral Science Workshop, October 13, 2014 The Multiphase Optimization Strategy (MOST) An increasingly popular research strategy to develop behavioral interventions

More information

The Model Building Process Part I: Checking Model Assumptions Best Practice

The Model Building Process Part I: Checking Model Assumptions Best Practice The Model Building Process Part I: Checking Model Assumptions Best Practice Authored by: Sarah Burke, PhD 31 July 2017 The goal of the STAT T&E COE is to assist in developing rigorous, defensible test

More information

Solutions to Exercises

Solutions to Exercises 1 c Atkinson et al 2007, Optimum Experimental Designs, with SAS Solutions to Exercises 1. and 2. Certainly, the solutions to these questions will be different for every reader. Examples of the techniques

More information

Using statistical techniques to model the flexural strength of dried triaxial ceramic bodies

Using statistical techniques to model the flexural strength of dried triaxial ceramic bodies Journal of the European Ceramic Society 24 (2004) 2813 2818 www.elsevier.com/locate/jeurceramsoc Using statistical techniques to model the flexural strength of dried triaxial ceramic bodies S.L. Correia

More information

How Accurate is My Forecast?

How Accurate is My Forecast? How Accurate is My Forecast? Tao Hong, PhD Utilities Business Unit, SAS 15 May 2012 PLEASE STAND BY Today s event will begin at 11:00am EDT The audio portion of the presentation will be heard through your

More information

Biocides, additives and chemical solutions. Company introduction, 2013

Biocides, additives and chemical solutions. Company introduction, 2013 Biocides, additives and chemical solutions Company introduction, 2013 Company Incorporated in year 1979 by a group of professionals with more than 50 years of experience in the chemical industry. ACTIVITY

More information

A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling

A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling A Statistical Input Pruning Method for Artificial Neural Networks Used in Environmental Modelling G. B. Kingston, H. R. Maier and M. F. Lambert Centre for Applied Modelling in Water Engineering, School

More information

Pattern Recognition Prof. P. S. Sastry Department of Electronics and Communication Engineering Indian Institute of Science, Bangalore

Pattern Recognition Prof. P. S. Sastry Department of Electronics and Communication Engineering Indian Institute of Science, Bangalore Pattern Recognition Prof. P. S. Sastry Department of Electronics and Communication Engineering Indian Institute of Science, Bangalore Lecture - 27 Multilayer Feedforward Neural networks with Sigmoidal

More information

Single Home Electricity Power Consumption Forecast Using Neural Networks Model

Single Home Electricity Power Consumption Forecast Using Neural Networks Model Single Home Electricity Power Consumption Forecast Using Neural Networks Model Naser Farag Abed 1 and Milan M.Milosavljevic 1,2 1 Singidunum University Belgrade, 11000, Serbia 2 School of Electrical Engineering,

More information

PAC-learning, VC Dimension and Margin-based Bounds

PAC-learning, VC Dimension and Margin-based Bounds More details: General: http://www.learning-with-kernels.org/ Example of more complex bounds: http://www.research.ibm.com/people/t/tzhang/papers/jmlr02_cover.ps.gz PAC-learning, VC Dimension and Margin-based

More information

9/26/17. Ridge regression. What our model needs to do. Ridge Regression: L2 penalty. Ridge coefficients. Ridge coefficients

9/26/17. Ridge regression. What our model needs to do. Ridge Regression: L2 penalty. Ridge coefficients. Ridge coefficients What our model needs to do regression Usually, we are not just trying to explain observed data We want to uncover meaningful trends And predict future observations Our questions then are Is β" a good estimate

More information

Part I. Sampling design. Overview. INFOWO Lecture M6: Sampling design and Experiments. Outline. Sampling design Experiments.

Part I. Sampling design. Overview. INFOWO Lecture M6: Sampling design and Experiments. Outline. Sampling design Experiments. Overview INFOWO Lecture M6: Sampling design and Experiments Peter de Waal Sampling design Experiments Department of Information and Computing Sciences Faculty of Science, Universiteit Utrecht Lecture 4:

More information

Support Vector Machine For Functional Data Classification

Support Vector Machine For Functional Data Classification Support Vector Machine For Functional Data Classification Nathalie Villa 1 and Fabrice Rossi 2 1- Université Toulouse Le Mirail - Equipe GRIMM 5allées A. Machado, 31058 Toulouse cedex 1 - FRANCE 2- Projet

More information