Analysis of NIR spectroscopy data for blend uniformity using semi-nonnegative Matrix Factorization

Size: px
Start display at page:

Download "Analysis of NIR spectroscopy data for blend uniformity using semi-nonnegative Matrix Factorization"

Transcription

1 Analysis of NIR spectroscopy data for blend uniformity using seminonnegative Matrix Factorization Nicolas Sauwen 1, Adriaan Blommaert 1, Tatsiana Khamiakova 2, Michel Thiel 2, Jan Dijkmans 2, Ana Tavares da Silva 2 1 OpenAnalytics, 2 Janssen October 4, 2018 NCS Paris

2 Outline Blending NIR spectroscopy Nonnegative Matrix Factorization (NMF) SemiNMF Blend uniformity 2/17

3 Blending Powder blending pharmaceuticals production of solid Goal = blend uniformity: consistent and correct API proportion per dose Assessment blend uniformity: Traditional approach: repetitive sampling PAT approach: NIR spectroscopy 3/17

4 NIR spectroscopy Sample illumination by NIR electromagnetic waves ( nm) Molecules absorb photon energy corresponding to difference in discrete vibrational energy states peaks in absorption spectrum NIR is fast, online, requires minimal sample preparation and has higher sample penetration than (mid)ir 4/17

5 Blend uniformity based on NIR: methods Qualitative methods: directly consider variability of spectra Moving Block Standard Deviation (MBSD) Principal Component Analysis (PCA) Quantitative methods: express concentration variations Partial Least Squares (PLS) 5/17

6 Blend uniformity based on NIR: methods Qualitative methods: directly consider variability of spectra Moving Block Standard Deviation (MBSD) Principal Component Analysis (PCA) Quantitative methods: express concentration variations Partial Least Squares (PLS) Nonnegative Matrix Factorization: semiquantitative method 6/17

7 Nonnegative Matrix Factorization (NMF) User input: rank r initial factor matrices W 0 and/or H 0 Semiquantitative because NMF solution is not unique: nonconvex problem scaling scores and loadings 7/17

8 Nonnegative Matrix Factorization (NMF) Partsbased representation interpretable factors NIR spectral decomposition: Columns of W: pure compound spectra Rows of H: relative proportion of pure compounds 8/17

9 NIR preprocessing Baseline shifts and nonlinearities introduced by light scatter Scatter correction (MSC, SNV) Spectral derivatives (SavitzkyGolay) Input data are no longer nonnegative 9/17

10 SemiNonnegative Matrix Factorization Nonnegativity constraint is only imposed on scores matrix H: X WH such that i, j : 0 H i,j NMF W k+1 f (X, W k, H k ) H k+1 f (X, W k+1, H k ) Updating function f (X, W, H) incorporates nonnegativity constraint SemiNMF 1 (X,, ) (X,, ) W k+1 f 1 W k H k H k+1 f 2 W k+1 H k Only updating function f 2 (X, W, H) incorporates nonnegativity constraint 1 Multiplicative update rules, see Ding et al., IEEE Trans Pattern Anal Mach Intell, /17

11 SemiNMF: example Blending process 4 compounds: API + 3 excipients NMF rank = 4 Initialization: measured pure compound spectra in W 0 H 0 through nonnegative least squares 11/17

12 Blend uniformity: methodology Traditional methodology: global variability statistic such as the Hotellings T 2 monitored over a moving time window. We use: SemiNMF trends associated with compounds focus on API Location and scale modeling in function of blending rotation (GAMLSS) Endpoint detection: relative difference with predicted endvariation 12/17

13 Model for location and scale Normal locationscale model fitted with the gamlsspackage Mean structure Penalized spline or parametric regression model Variance structure: parametric model Exponential decay with offset: σ = A e kt + b Mixing and demixing model (Bauman and Futac, 1996): e k t 1 A 2 e k t 2 σ = A1 + (1 ) 13/17

14 GAMLSS model prediction Model prediction seminmftrend Model prediction standard deviation 14/17

15 Blend uniformity: endpoint prediction Endpoint = difference from end standard deviation (e.g. 3%) Confidence intervals for uncertainty estimate Based on covariance matrix of the parameter estimates Repeated simulation 15/17

16 R packages on CRAN spectralanalysis: preprocessing, visualization and analysis of spectral data (NIR, IR, Raman) hnmf: NMF algorithms, postprocessing and visualization of NMF results gamlss: functions for fitting Generalized Additive Models for Location, Scale and Shape 16/17

17 17/17

Putting Near-Infrared Spectroscopy (NIR) in the spotlight. 13. May 2006

Putting Near-Infrared Spectroscopy (NIR) in the spotlight. 13. May 2006 Putting Near-Infrared Spectroscopy (NIR) in the spotlight 13. May 2006 0 Outline What is NIR good for? A bit of history and basic theory Applications in Pharmaceutical industry Development Quantitative

More information

Inkjet printing of pharmaceuticals

Inkjet printing of pharmaceuticals Inkjet printing of pharmaceuticals And the use of Raman spectroscopy for visualization and quality control Magnus Edinger, PhD fellow Department of Pharmacy Magnus.edinger@sund.ku.dk 01/03/2017 2 Agenda

More information

Analysis of heterogeneity distribution in powder blends using hyperspectral imaging

Analysis of heterogeneity distribution in powder blends using hyperspectral imaging Analysis of heterogeneity distribution in powder blends using hyperspectral imaging Dr Juan Antonio Fernández Dr Vincent Baeten Guanghui Shen Dr Anna de Juan Rodrigo R. de Oliveira Walloon Agricultural

More information

The Role of a Center of Excellence in Developing PAT Applications

The Role of a Center of Excellence in Developing PAT Applications The Role of a Center of Excellence in Developing PAT Applications! Pittcon 2005 Orlando FL, March 2 nd 2005! Nils-Erik Andersson AstraZeneca R&D, Mölndal Sweden 1 Outline! Business needs and New ways of

More information

PAT: THE EXTRACTION OF MAXIMUM INFORMATION FROM MESSY SPECTRAL DATA. Zeng-Ping Chen and Julian Morris

PAT: THE EXTRACTION OF MAXIMUM INFORMATION FROM MESSY SPECTRAL DATA. Zeng-Ping Chen and Julian Morris 10th International IFAC Symposium on Computer Applications in Biotechnology Preprints Vol.1, une 4-6, 2007, Cancún, Mexico PAT: THE EXTRACTION OF MAXIMUM INFORMATION FROM MESSY SPECTRAL DATA Zeng-Ping

More information

Snowy Range Instruments

Snowy Range Instruments Snowy Range Instruments Cary 81 2000 W Hg Arc JY U-1000 5 W Ar + Laser DL Solution 852 200 mw SnRI CBEx 785 100 mw What is Raman Spectroscopy? Raman spectroscopy is a form of molecular spectroscopy. It

More information

Mixed Hierarchical Models for the Process Environment

Mixed Hierarchical Models for the Process Environment Mixed Hierarchical Models for the Process Environment Barry M. Wise, Robert T. Roginski, Neal B. Gallagher and Jeremy M. Shaver Eigenvector Research Inc., Wenatchee, WA, USA Abstract EffecFve monitoring

More information

Cross model validation and multiple testing in latent variable models

Cross model validation and multiple testing in latent variable models Cross model validation and multiple testing in latent variable models Frank Westad GE Healthcare Oslo, Norway 2nd European User Meeting on Multivariate Analysis Como, June 22, 2006 Outline Introduction

More information

MULTIVARIATE STATISTICAL ANALYSIS OF SPECTROSCOPIC DATA. Haisheng Lin, Ognjen Marjanovic, Barry Lennox

MULTIVARIATE STATISTICAL ANALYSIS OF SPECTROSCOPIC DATA. Haisheng Lin, Ognjen Marjanovic, Barry Lennox MULTIVARIATE STATISTICAL ANALYSIS OF SPECTROSCOPIC DATA Haisheng Lin, Ognjen Marjanovic, Barry Lennox Control Systems Centre, School of Electrical and Electronic Engineering, University of Manchester Abstract:

More information

Application of near-infrared (NIR) spectroscopy to sensor based sorting of an epithermal Au-Ag ore

Application of near-infrared (NIR) spectroscopy to sensor based sorting of an epithermal Au-Ag ore Application of near-infrared (NIR) spectroscopy to sensor based sorting of an epithermal Au-Ag ore OCM conference presentation 19-03-2015 TU Delft, Resource Engineering M.Dalm MSc. 1 Contents of the presentation

More information

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17 Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into

More information

Linear regression methods

Linear regression methods Linear regression methods Most of our intuition about statistical methods stem from linear regression. For observations i = 1,..., n, the model is Y i = p X ij β j + ε i, j=1 where Y i is the response

More information

Chemometrics. Matti Hotokka Physical chemistry Åbo Akademi University

Chemometrics. Matti Hotokka Physical chemistry Åbo Akademi University Chemometrics Matti Hotokka Physical chemistry Åbo Akademi University Linear regression Experiment Consider spectrophotometry as an example Beer-Lamberts law: A = cå Experiment Make three known references

More information

Monitoring Granulation Drying Using Near-Infrared Spectroscopy

Monitoring Granulation Drying Using Near-Infrared Spectroscopy Monitoring Granulation Drying Using Near-Infrared Spectroscopy A novel probe design that reduces the variation in powder-sample density also allows moisture and solvent levels to be accurately modelled

More information

Portable Raman Spectroscopy for the Study of Polymorphs and Monitoring Polymorphic Transitions

Portable Raman Spectroscopy for the Study of Polymorphs and Monitoring Polymorphic Transitions Introduction Portable Raman Spectroscopy for the Study of Polymorphs and Monitoring Polymorphic Transitions Philip Zhou and Katherine A. Bakeev, B&W Tek, Inc., Newark, DE Materials can exist in different

More information

To Hy-Ternity and beyond. Boris Larchevêque, INDATECH

To Hy-Ternity and beyond. Boris Larchevêque, INDATECH To Hy-Ternity and beyond Boris Larchevêque, INDATECH Hello! Are you still thinking that a lonely spectrum can make you see how beautiful we are? A 25 minutes talk Introduction to SRS Industrial point of

More information

Dimension reduction, PCA & eigenanalysis Based in part on slides from textbook, slides of Susan Holmes. October 3, Statistics 202: Data Mining

Dimension reduction, PCA & eigenanalysis Based in part on slides from textbook, slides of Susan Holmes. October 3, Statistics 202: Data Mining Dimension reduction, PCA & eigenanalysis Based in part on slides from textbook, slides of Susan Holmes October 3, 2012 1 / 1 Combinations of features Given a data matrix X n p with p fairly large, it can

More information

DOWNLOAD OR READ : INFRARED AND RAMAN SPECTROSCOPY CONCEPTS AND APPLICATIONS PDF EBOOK EPUB MOBI

DOWNLOAD OR READ : INFRARED AND RAMAN SPECTROSCOPY CONCEPTS AND APPLICATIONS PDF EBOOK EPUB MOBI DOWNLOAD OR READ : INFRARED AND RAMAN SPECTROSCOPY CONCEPTS AND APPLICATIONS PDF EBOOK EPUB MOBI Page 1 Page 2 infrared and raman spectroscopy concepts and applications infrared and raman spectroscopy

More information

Supporting Information

Supporting Information Supporting Information Localized Nanoscale Heating Leads to Ultrafast Hydrogel Volume-Phase Transition Jing Zhao, Hanquan Su, Gregory E. Vansuch, Zheng Liu, Khalid Salaita, * R. Brian Dyer * Department

More information

Chemometrics. 1. Find an important subset of the original variables.

Chemometrics. 1. Find an important subset of the original variables. Chemistry 311 2003-01-13 1 Chemometrics Chemometrics: Mathematical, statistical, graphical or symbolic methods to improve the understanding of chemical information. or The science of relating measurements

More information

Study on the Concentration Inversion of NO & NO2 Gas from the Vehicle Exhaust Based on Weighted PLS

Study on the Concentration Inversion of NO & NO2 Gas from the Vehicle Exhaust Based on Weighted PLS Optics and Photonics Journal, 217, 7, 16-115 http://www.scirp.org/journal/opj ISSN Online: 216-889X ISSN Print: 216-8881 Study on the Concentration Inversion of NO & NO2 Gas from the Vehicle Exhaust Based

More information

Semidefinite Programming Based Preconditioning for More Robust Near-Separable Nonnegative Matrix Factorization

Semidefinite Programming Based Preconditioning for More Robust Near-Separable Nonnegative Matrix Factorization Semidefinite Programming Based Preconditioning for More Robust Near-Separable Nonnegative Matrix Factorization Nicolas Gillis nicolas.gillis@umons.ac.be https://sites.google.com/site/nicolasgillis/ Department

More information

Statistics 202: Data Mining. c Jonathan Taylor. Week 2 Based in part on slides from textbook, slides of Susan Holmes. October 3, / 1

Statistics 202: Data Mining. c Jonathan Taylor. Week 2 Based in part on slides from textbook, slides of Susan Holmes. October 3, / 1 Week 2 Based in part on slides from textbook, slides of Susan Holmes October 3, 2012 1 / 1 Part I Other datatypes, preprocessing 2 / 1 Other datatypes Document data You might start with a collection of

More information

Part I. Other datatypes, preprocessing. Other datatypes. Other datatypes. Week 2 Based in part on slides from textbook, slides of Susan Holmes

Part I. Other datatypes, preprocessing. Other datatypes. Other datatypes. Week 2 Based in part on slides from textbook, slides of Susan Holmes Week 2 Based in part on slides from textbook, slides of Susan Holmes Part I Other datatypes, preprocessing October 3, 2012 1 / 1 2 / 1 Other datatypes Other datatypes Document data You might start with

More information

The Future of Spectroscopy

The Future of Spectroscopy The Future of Spectroscopy M. Darby Dyar Dept. of Astronomy Mount Holyoke College Senior Scientist Planetary Science Institute The Holy Grail: Accurate Mineralogy Derived from Spectroscopy http://www.movie-roulette.com/photos_big/monty-python-and-the-holy-grail-4-1.jpeg

More information

Online NIR-Spectroscopy for the Live Monitoring of Hydrocarbon Index (HI) in Contaminated Soil Material

Online NIR-Spectroscopy for the Live Monitoring of Hydrocarbon Index (HI) in Contaminated Soil Material Online NIR-Spectroscopy for the Live Monitoring of Hydrocarbon Index (HI) in Contaminated Soil Material 20.12.2016 1 The Hydrocarbon Index (HI) Definition It is a cumulative parameter no absolute method

More information

2 D wavelet analysis , 487

2 D wavelet analysis , 487 Index 2 2 D wavelet analysis... 263, 487 A Absolute distance to the model... 452 Aligned Vectors... 446 All data are needed... 19, 32 Alternating conditional expectations (ACE)... 375 Alternative to block

More information

Lecture 13. Principal Component Analysis. Brett Bernstein. April 25, CDS at NYU. Brett Bernstein (CDS at NYU) Lecture 13 April 25, / 26

Lecture 13. Principal Component Analysis. Brett Bernstein. April 25, CDS at NYU. Brett Bernstein (CDS at NYU) Lecture 13 April 25, / 26 Principal Component Analysis Brett Bernstein CDS at NYU April 25, 2017 Brett Bernstein (CDS at NYU) Lecture 13 April 25, 2017 1 / 26 Initial Question Intro Question Question Let S R n n be symmetric. 1

More information

Unsupervised Learning: Dimensionality Reduction

Unsupervised Learning: Dimensionality Reduction Unsupervised Learning: Dimensionality Reduction CMPSCI 689 Fall 2015 Sridhar Mahadevan Lecture 3 Outline In this lecture, we set about to solve the problem posed in the previous lecture Given a dataset,

More information

Binary Principal Component Analysis in the Netflix Collaborative Filtering Task

Binary Principal Component Analysis in the Netflix Collaborative Filtering Task Binary Principal Component Analysis in the Netflix Collaborative Filtering Task László Kozma, Alexander Ilin, Tapani Raiko first.last@tkk.fi Helsinki University of Technology Adaptive Informatics Research

More information

Snowy Range Instruments

Snowy Range Instruments Overcoming Optical Focus Issues in Portable Raman Systems for Analysis of Pharmaceutical Drug Formulations Snowy Range Instruments, 628 Plaza Lane, Laramie, WY, 82070, ph: 307-460-2089, sales@wysri.com

More information

Some Statistical Aspects of Photometric Redshift Estimation

Some Statistical Aspects of Photometric Redshift Estimation Some Statistical Aspects of Photometric Redshift Estimation James Long November 9, 2016 1 / 32 Photometric Redshift Estimation Background Non Negative Least Squares Non Negative Matrix Factorization EAZY

More information

Positive and Nondestructive Identification of Acrylic-Based Coatings

Positive and Nondestructive Identification of Acrylic-Based Coatings Positive and Nondestructive Identification of Acrylic-Based Coatings Using Partial Least Squares Discriminant Analysis with the Agilent 4300 Handheld FTIR Application Note Materials Testing and Research

More information

Multivariate data-modelling to separate light scattering from light absorbance: The Optimized Extended Multiplicative Signal Correction OEMSC

Multivariate data-modelling to separate light scattering from light absorbance: The Optimized Extended Multiplicative Signal Correction OEMSC Multivariate data-modelling to separate light scattering from light absorbance: The Optimized Extended Multiplicative Signal Correction OEMSC The importance of spectral preprocessing in data analysis for

More information

Functional SVD for Big Data

Functional SVD for Big Data Functional SVD for Big Data Pan Chao April 23, 2014 Pan Chao Functional SVD for Big Data April 23, 2014 1 / 24 Outline 1 One-Way Functional SVD a) Interpretation b) Robustness c) CV/GCV 2 Two-Way Problem

More information

Multivariate calibration

Multivariate calibration Multivariate calibration What is calibration? Problems with traditional calibration - selectivity - precision 35 - diagnosis Multivariate calibration - many signals - multivariate space How to do it? observed

More information

Plant-wide Root Cause Identification of Transient Disturbances with Application to a Board Machine

Plant-wide Root Cause Identification of Transient Disturbances with Application to a Board Machine Moncef Chioua, Margret Bauer, Su-Liang Chen, Jan C. Schlake, Guido Sand, Werner Schmidt and Nina F. Thornhill Plant-wide Root Cause Identification of Transient Disturbances with Application to a Board

More information

Robert P. Cogdill, Carl A. Anderson, and James K. Drennen, III

Robert P. Cogdill, Carl A. Anderson, and James K. Drennen, III Using NIR Spectroscopy as an Integrated PAT Tool This article summarizes recent efforts by the Duquesne University Center for Pharmaceutical Technology to develop and validate a PAT method using NIR spectroscopy

More information

Spectroscopy tools for PAT applications in the Pharmaceutical Industry

Spectroscopy tools for PAT applications in the Pharmaceutical Industry Spectroscopy tools for PAT applications in the Pharmaceutical Industry Claude Didierjean Sr. Technology and Applications Consultant Real Time Analytics Mettler Toledo AutoChem, Inc. claude.didierjean@mt.com

More information

Spectroscopy in Transmission

Spectroscopy in Transmission Spectroscopy in Transmission + Reflectance UV/VIS - NIR Absorption spectra of solids and liquids can be measured with the desktop spectrograph Lambda 9. Extinctions up to in a wavelength range from UV

More information

FTIR characterization of Mexican honey and its adulteration with sugar syrups by using chemometric methods

FTIR characterization of Mexican honey and its adulteration with sugar syrups by using chemometric methods Journal of Physics: Conference Series FTIR characterization of Mexican honey and its with sugar syrups by using chemometric methods To cite this article: M A Rios-Corripio et al 11 J. Phys.: Conf. Ser.

More information

a Short Introduction

a Short Introduction Collaborative Filtering in Recommender Systems: a Short Introduction Norm Matloff Dept. of Computer Science University of California, Davis matloff@cs.ucdavis.edu December 3, 2016 Abstract There is a strong

More information

http://www.ciessevi.org/news/programma-volontari-padiglione-unioneeuropea-expo Claudia Sorlini Già professore ordinario di Microbiologia Agraria Università degli Studi di Milano Presidente del Comitato

More information

Demonstrating the Value of Data Fusion

Demonstrating the Value of Data Fusion Demonstrating the Value of Data Fusion Thomas I. Dearing 1 Wesley Thompson and Brian Marquardt 1 Carl Rechsteiner Jr. 2 1. Applied Physics Labs, University of Washington 2. Chevron Energy Technology, Richmond

More information

Application of Raman Spectroscopy for Noninvasive Detection of Target Compounds. Kyung-Min Lee

Application of Raman Spectroscopy for Noninvasive Detection of Target Compounds. Kyung-Min Lee Application of Raman Spectroscopy for Noninvasive Detection of Target Compounds Kyung-Min Lee Office of the Texas State Chemist, Texas AgriLife Research January 24, 2012 OTSC Seminar OFFICE OF THE TEXAS

More information

Asymmetry of Peaks in the XPS of Polymers

Asymmetry of Peaks in the XPS of Polymers Asymmetry of Peaks in the XPS of Polymers When a photon is absorbed by a material, the energy transferred may cause the excitation of both the electronic and atomic structure of the compounds on the surface.

More information

Dimension Reduction and Iterative Consensus Clustering

Dimension Reduction and Iterative Consensus Clustering Dimension Reduction and Iterative Consensus Clustering Southeastern Clustering and Ranking Workshop August 24, 2009 Dimension Reduction and Iterative 1 Document Clustering Geometry of the SVD Centered

More information

ECS289: Scalable Machine Learning

ECS289: Scalable Machine Learning ECS289: Scalable Machine Learning Cho-Jui Hsieh UC Davis Oct 11, 2016 Paper presentations and final project proposal Send me the names of your group member (2 or 3 students) before October 15 (this Friday)

More information

Mixture Analysis Made Easier: Trace Impurity Identification in Photoresist Developer Solutions Using ATR-IR Spectroscopy and SIMPLISMA

Mixture Analysis Made Easier: Trace Impurity Identification in Photoresist Developer Solutions Using ATR-IR Spectroscopy and SIMPLISMA Mixture Analysis Made Easier: Trace Impurity Identification in Photoresist Developer Solutions Using ATR-IR Spectroscopy and SIMPLISMA Michel Hachey, Michael Boruta Advanced Chemistry Development, Inc.

More information

What happens when light falls on a material? Transmission Reflection Absorption Luminescence. Elastic Scattering Inelastic Scattering

What happens when light falls on a material? Transmission Reflection Absorption Luminescence. Elastic Scattering Inelastic Scattering Raman Spectroscopy What happens when light falls on a material? Transmission Reflection Absorption Luminescence Elastic Scattering Inelastic Scattering Raman, Fluorescence and IR Scattering Absorption

More information

PTG-NIR Powder Characterisation System (not yet released for selling to end users)

PTG-NIR Powder Characterisation System (not yet released for selling to end users) Powder Characterisation System - PTG-NIR PTG-NIR Powder Characterisation System (not yet released for selling to end users) The PTG-NIR automatic powder and granule inspection system with integrated NIR

More information

Extraction of pure component spectrum from mixture spectra containing a known diluent

Extraction of pure component spectrum from mixture spectra containing a known diluent Preprints of the 0th IFAC International Symposium on Dynamics and Control of Process Systems The International Federation of Automatic Control Extraction of pure component spectrum from mixture spectra

More information

Introduction to Principal Component Analysis (PCA)

Introduction to Principal Component Analysis (PCA) Introduction to Principal Component Analysis (PCA) NESAC/BIO NESAC/BIO Daniel J. Graham PhD University of Washington NESAC/BIO MVSA Website 2010 Multivariate Analysis Multivariate analysis (MVA) methods

More information

MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A

MultiDimensional Signal Processing Master Degree in Ingegneria delle Telecomunicazioni A.A MultiDimensional Signal Processing Master Degree in Ingegneria delle elecomunicazioni A.A. 015-016 Pietro Guccione, PhD DEI - DIPARIMENO DI INGEGNERIA ELERICA E DELL INFORMAZIONE POLIECNICO DI BARI Pietro

More information

New method for the determination of benzoic and. sorbic acids in commercial orange juices based on

New method for the determination of benzoic and. sorbic acids in commercial orange juices based on New method for the determination of benzoic and sorbic acids in commercial orange juices based on second-order spectrophotometric data generated by a ph gradient flow injection technique (Supporting Information)

More information

Robustness of Principal Components

Robustness of Principal Components PCA for Clustering An objective of principal components analysis is to identify linear combinations of the original variables that are useful in accounting for the variation in those original variables.

More information

Distillation Monitoring with NIR Spectroscopy From Laboratory Experiments to Manufacturing

Distillation Monitoring with NIR Spectroscopy From Laboratory Experiments to Manufacturing Distillation Monitoring with NIR Spectroscopy From Laboratory Experiments to Manufacturing Dr. Christian Lautz, F. Hoffmann-La Roche Ltd, Basel, Switzerland Ammonia in methanol Process: After the conversion

More information

Quality by Design and Analytical Methods

Quality by Design and Analytical Methods Quality by Design and Analytical Methods Isranalytica 2012 Tel Aviv, Israel 25 January 2012 Christine M. V. Moore, Ph.D. Acting Director ONDQA/CDER/FDA 1 Outline Introduction to Quality by Design (QbD)

More information

Multivariate Statistical Analysis

Multivariate Statistical Analysis Multivariate Statistical Analysis Fall 2011 C. L. Williams, Ph.D. Lecture 4 for Applied Multivariate Analysis Outline 1 Eigen values and eigen vectors Characteristic equation Some properties of eigendecompositions

More information

Lecture 16: Small Sample Size Problems (Covariance Estimation) Many thanks to Carlos Thomaz who authored the original version of these slides

Lecture 16: Small Sample Size Problems (Covariance Estimation) Many thanks to Carlos Thomaz who authored the original version of these slides Lecture 16: Small Sample Size Problems (Covariance Estimation) Many thanks to Carlos Thomaz who authored the original version of these slides Intelligent Data Analysis and Probabilistic Inference Lecture

More information

Classification of spectroscopic methods

Classification of spectroscopic methods Introduction Spectroscopy is the study of the interaction between the electromagnetic radiation and the matter. Spectrophotometry is the measurement of these interactions i.e. the measurement of the intensity

More information

PENALIZED LIKELIHOOD PARAMETER ESTIMATION FOR ADDITIVE HAZARD MODELS WITH INTERVAL CENSORED DATA

PENALIZED LIKELIHOOD PARAMETER ESTIMATION FOR ADDITIVE HAZARD MODELS WITH INTERVAL CENSORED DATA PENALIZED LIKELIHOOD PARAMETER ESTIMATION FOR ADDITIVE HAZARD MODELS WITH INTERVAL CENSORED DATA Kasun Rathnayake ; A/Prof Jun Ma Department of Statistics Faculty of Science and Engineering Macquarie University

More information

profileanalysis Innovation with Integrity Quickly pinpointing and identifying potential biomarkers in Proteomics and Metabolomics research

profileanalysis Innovation with Integrity Quickly pinpointing and identifying potential biomarkers in Proteomics and Metabolomics research profileanalysis Quickly pinpointing and identifying potential biomarkers in Proteomics and Metabolomics research Innovation with Integrity Omics Research Biomarker Discovery Made Easy by ProfileAnalysis

More information

One-stage dose-response meta-analysis

One-stage dose-response meta-analysis One-stage dose-response meta-analysis Nicola Orsini, Alessio Crippa Biostatistics Team Department of Public Health Sciences Karolinska Institutet http://ki.se/en/phs/biostatistics-team 2017 Nordic and

More information

Basics of Multivariate Modelling and Data Analysis

Basics of Multivariate Modelling and Data Analysis Basics of Multivariate Modelling and Data Analysis Kurt-Erik Häggblom 6. Principal component analysis (PCA) 6.1 Overview 6.2 Essentials of PCA 6.3 Numerical calculation of PCs 6.4 Effects of data preprocessing

More information

GNR401 Principles of Satellite Image Processing

GNR401 Principles of Satellite Image Processing Principles of Satellite Image Processing Instructor: Prof. CSRE, IIT Bombay bkmohan@csre.iitb.ac.in Slot 5 Guest Lecture PCT and Band Arithmetic November 07, 2012 9.30 AM 10.55 AM IIT Bombay Slide 1 November

More information

Factor Analysis (FA) Non-negative Matrix Factorization (NMF) CSE Artificial Intelligence Grad Project Dr. Debasis Mitra

Factor Analysis (FA) Non-negative Matrix Factorization (NMF) CSE Artificial Intelligence Grad Project Dr. Debasis Mitra Factor Analysis (FA) Non-negative Matrix Factorization (NMF) CSE 5290 - Artificial Intelligence Grad Project Dr. Debasis Mitra Group 6 Taher Patanwala Zubin Kadva Factor Analysis (FA) 1. Introduction Factor

More information

Functional Preprocessing for Multilayer Perceptrons

Functional Preprocessing for Multilayer Perceptrons Functional Preprocessing for Multilayer Perceptrons Fabrice Rossi and Brieuc Conan-Guez Projet AxIS, INRIA, Domaine de Voluceau, Rocquencourt, B.P. 105 78153 Le Chesnay Cedex, France CEREMADE, UMR CNRS

More information

Automatic Rank Determination in Projective Nonnegative Matrix Factorization

Automatic Rank Determination in Projective Nonnegative Matrix Factorization Automatic Rank Determination in Projective Nonnegative Matrix Factorization Zhirong Yang, Zhanxing Zhu, and Erkki Oja Department of Information and Computer Science Aalto University School of Science and

More information

HYPERSPECTRAL IMAGING

HYPERSPECTRAL IMAGING 1 HYPERSPECTRAL IMAGING Lecture 9 Multispectral Vs. Hyperspectral 2 The term hyperspectral usually refers to an instrument whose spectral bands are constrained to the region of solar illumination, i.e.,

More information

STATISTICAL LEARNING SYSTEMS

STATISTICAL LEARNING SYSTEMS STATISTICAL LEARNING SYSTEMS LECTURE 8: UNSUPERVISED LEARNING: FINDING STRUCTURE IN DATA Institute of Computer Science, Polish Academy of Sciences Ph. D. Program 2013/2014 Principal Component Analysis

More information

INFORMATION THEORY AND STATISTICS

INFORMATION THEORY AND STATISTICS INFORMATION THEORY AND STATISTICS Solomon Kullback DOVER PUBLICATIONS, INC. Mineola, New York Contents 1 DEFINITION OF INFORMATION 1 Introduction 1 2 Definition 3 3 Divergence 6 4 Examples 7 5 Problems...''.

More information

Pose estimation from point and line correspondences

Pose estimation from point and line correspondences Pose estimation from point and line correspondences Giorgio Panin October 17, 008 1 Problem formulation Estimate (in a LSE sense) the pose of an object from N correspondences between known object points

More information

Mixing of powders. Wim Oostra

Mixing of powders. Wim Oostra Mixing of powders Wim Oostra Introduction Concepts of mixtures Statistics Mechanisms of mixing Segregation Equipment Practice Scale - up References Content Types of Mixtures Types of Mixtures Ordered Mixture

More information

Lecture 3: Light absorbance

Lecture 3: Light absorbance Lecture 3: Light absorbance Perturbation Response 1 Light in Chemistry Light Response 0-3 Absorbance spectrum of benzene 2 Absorption Visible Light in Chemistry S 2 S 1 Fluorescence http://www.microscopyu.com

More information

IDL Advanced Math & Stats Module

IDL Advanced Math & Stats Module IDL Advanced Math & Stats Module Regression List of Routines and Functions Multiple Linear Regression IMSL_REGRESSORS IMSL_MULTIREGRESS IMSL_MULTIPREDICT Generates regressors for a general linear model.

More information

Application of mathematical, statistical, graphical or symbolic methods to maximize chemical information.

Application of mathematical, statistical, graphical or symbolic methods to maximize chemical information. Application of mathematical, statistical, graphical or symbolic methods to maximize chemical information. -However, this definition can be expanded to include: biology (biometrics), environmental science

More information

Factor Analysis. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA

Factor Analysis. Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA Factor Analysis Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA 1 Factor Models The multivariate regression model Y = XB +U expresses each row Y i R p as a linear combination

More information

Detection and Quantification of Adulteration in Honey through Near Infrared Spectroscopy

Detection and Quantification of Adulteration in Honey through Near Infrared Spectroscopy Proceedings of the 2014 International Conference of Food Properties (ICFP 2014) Kuala Lumpur, Malaysia, January 24-26, 2014 Detection and Quantification of Adulteration in Honey through Near Infrared Spectroscopy

More information

1 Singular Value Decomposition and Principal Component

1 Singular Value Decomposition and Principal Component Singular Value Decomposition and Principal Component Analysis In these lectures we discuss the SVD and the PCA, two of the most widely used tools in machine learning. Principal Component Analysis (PCA)

More information

Chemometrics: Classification of spectra

Chemometrics: Classification of spectra Chemometrics: Classification of spectra Vladimir Bochko Jarmo Alander University of Vaasa November 1, 2010 Vladimir Bochko Chemometrics: Classification 1/36 Contents Terminology Introduction Big picture

More information

EXTENDING PARTIAL LEAST SQUARES REGRESSION

EXTENDING PARTIAL LEAST SQUARES REGRESSION EXTENDING PARTIAL LEAST SQUARES REGRESSION ATHANASSIOS KONDYLIS UNIVERSITY OF NEUCHÂTEL 1 Outline Multivariate Calibration in Chemometrics PLS regression (PLSR) and the PLS1 algorithm PLS1 from a statistical

More information

c Springer, Reprinted with permission.

c Springer, Reprinted with permission. Zhijian Yuan and Erkki Oja. A FastICA Algorithm for Non-negative Independent Component Analysis. In Puntonet, Carlos G.; Prieto, Alberto (Eds.), Proceedings of the Fifth International Symposium on Independent

More information

Module 4 : Third order nonlinear optical processes. Lecture 28 : Inelastic Scattering Processes. Objectives

Module 4 : Third order nonlinear optical processes. Lecture 28 : Inelastic Scattering Processes. Objectives Module 4 : Third order nonlinear optical processes Lecture 28 : Inelastic Scattering Processes Objectives In this lecture you will learn the following Light scattering- elastic and inelastic-processes,

More information

A User's Guide To Principal Components

A User's Guide To Principal Components A User's Guide To Principal Components J. EDWARD JACKSON A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York Chichester Brisbane Toronto Singapore Contents Preface Introduction 1. Getting

More information

Bootstrapping, Randomization, 2B-PLS

Bootstrapping, Randomization, 2B-PLS Bootstrapping, Randomization, 2B-PLS Statistics, Tests, and Bootstrapping Statistic a measure that summarizes some feature of a set of data (e.g., mean, standard deviation, skew, coefficient of variation,

More information

Generalized Least Squares for Calibration Transfer. Barry M. Wise, Harald Martens and Martin Høy Eigenvector Research, Inc.

Generalized Least Squares for Calibration Transfer. Barry M. Wise, Harald Martens and Martin Høy Eigenvector Research, Inc. Generalized Least Squares for Calibration Transfer Barry M. Wise, Harald Martens and Martin Høy Eigenvector Research, Inc. Manson, WA 1 Outline The calibration transfer problem Instrument differences,

More information

ANISOTROPIC POLARIZED LIGHT SCATTER AND MOLECULAR FACTOR COMPUTING IN PHARMACEUTICAL CLEANING VALIDATION AND BIOMEDICAL SPECTROSCOPY

ANISOTROPIC POLARIZED LIGHT SCATTER AND MOLECULAR FACTOR COMPUTING IN PHARMACEUTICAL CLEANING VALIDATION AND BIOMEDICAL SPECTROSCOPY University of Kentucky UKnowledge University of Kentucky Doctoral Dissertations Graduate School 2007 ANISOTROPIC POLARIZED LIGHT SCATTER AND MOLECULAR FACTOR COMPUTING IN PHARMACEUTICAL CLEANING VALIDATION

More information

5/29/2018. A little bit of data. A word on data analysis

5/29/2018. A little bit of data. A word on data analysis A little bit of data A word on data analysis Or Pump-probe dataset Or Merit function Linear least squares D Djk ni () t Ai ( )) F( t, ) jk j k i jk, jk jk, jk Global and local minima Instrument response

More information

Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools:

Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools: CS 322 Final Exam Friday 18 May 2007 150 minutes Problem 1: Toolbox (25 pts) For all of the parts of this problem, you are limited to the following sets of tools: (A) Runge-Kutta 4/5 Method (B) Condition

More information

Expression Data Exploration: Association, Patterns, Factors & Regression Modelling

Expression Data Exploration: Association, Patterns, Factors & Regression Modelling Expression Data Exploration: Association, Patterns, Factors & Regression Modelling Exploring gene expression data Scale factors, median chip correlation on gene subsets for crude data quality investigation

More information

Unsupervised dimensionality reduction

Unsupervised dimensionality reduction Unsupervised dimensionality reduction Guillaume Obozinski Ecole des Ponts - ParisTech SOCN course 2014 Guillaume Obozinski Unsupervised dimensionality reduction 1/30 Outline 1 PCA 2 Kernel PCA 3 Multidimensional

More information

Package sgpca. R topics documented: July 6, Type Package. Title Sparse Generalized Principal Component Analysis. Version 1.0.

Package sgpca. R topics documented: July 6, Type Package. Title Sparse Generalized Principal Component Analysis. Version 1.0. Package sgpca July 6, 2013 Type Package Title Sparse Generalized Principal Component Analysis Version 1.0 Date 2012-07-05 Author Frederick Campbell Maintainer Frederick Campbell

More information

Structure in Data. A major objective in data analysis is to identify interesting features or structure in the data.

Structure in Data. A major objective in data analysis is to identify interesting features or structure in the data. Structure in Data A major objective in data analysis is to identify interesting features or structure in the data. The graphical methods are very useful in discovering structure. There are basically two

More information

P -spline ANOVA-type interaction models for spatio-temporal smoothing

P -spline ANOVA-type interaction models for spatio-temporal smoothing P -spline ANOVA-type interaction models for spatio-temporal smoothing Dae-Jin Lee 1 and María Durbán 1 1 Department of Statistics, Universidad Carlos III de Madrid, SPAIN. e-mail: dae-jin.lee@uc3m.es and

More information

Inferential Analysis with NIR and Chemometrics

Inferential Analysis with NIR and Chemometrics Inferential Analysis with NIR and Chemometrics Santanu Talukdar Manager, Engineering Services Part 2 NIR Spectroscopic Data with Chemometrics A Tutorial Presentation Part 2 Page.2 References This tutorial

More information

BATCH PROCESS MONITORING THROUGH THE INTEGRATION OF SPECTRAL AND PROCESS DATA. Julian Morris, Elaine Martin and David Stewart

BATCH PROCESS MONITORING THROUGH THE INTEGRATION OF SPECTRAL AND PROCESS DATA. Julian Morris, Elaine Martin and David Stewart BATCH PROCESS MONITORING THROUGH THE INTEGRATION OF SPECTRAL AND PROCESS DATA Julian Morris, Elaine Martin and David Stewart Centre for Process Analytics and Control Technology School of Chemical Engineering

More information

Robust estimation of principal components from depth-based multivariate rank covariance matrix

Robust estimation of principal components from depth-based multivariate rank covariance matrix Robust estimation of principal components from depth-based multivariate rank covariance matrix Subho Majumdar Snigdhansu Chatterjee University of Minnesota, School of Statistics Table of contents Summary

More information

Introduction to Machine Learning

Introduction to Machine Learning 10-701 Introduction to Machine Learning PCA Slides based on 18-661 Fall 2018 PCA Raw data can be Complex, High-dimensional To understand a phenomenon we measure various related quantities If we knew what

More information

Infra Red Spectroscopy

Infra Red Spectroscopy CH 2252 Instrumental Methods of Analysis Unit I Infra Red Spectroscopy M. Subramanian Assistant Professor Department of Chemical Engineering Sri Sivasubramaniya Nadar College of Engineering Kalavakkam

More information