FRST Multivariate Statistics. Multivariate Discriminant Analysis (MDA)
|
|
- Marjorie Cordelia Heath
- 5 years ago
- Views:
Transcription
1 1 FRST Mutivariate Statistics Mutivariate Discriminant Anaysis (MDA) Purpose: 1. To predict which group (Y) an observation beongs to based on the characteristics of p predictor (X) variabes, using inear composites of predictor variabes. The criterion for these composites is that the between group variance is maximized subject to the within group variance. Each new inear composite is uncorreated with previous ones (see Figures 1, 3 and 4), but are not necessariy orthogona (not a at 90 degree anges). 2. To minimize miscassification error rates. Once the discriminating functions are found, Fisher s inear discriminating functions (1 per group) can be used to predict group membership of another data set (Figure 2). 3. To determine whether the group centroids are statisticay different. The group centroid is the average vaue (average discriminant score) for the inear composite of the predictor variabes. This can aso be found by inputting the averages of each of the predictor variabes to find the average discriminant score. 4. To determine the number of statisticay significant discriminant axes (see Figures 3 and 4). 5. To determine which of the predictor variabes contributes most to discriminating among groups.
2 2 Reationship of MDA to Other Techniques: Unike Custer Anaysis, the group to which each entity beongs is known. As with Regression Anaysis, a prediction mode is wanted. However, the dependent variabe with MDA is a category (ordina or nomina scae), rather than a continuous variabe as with regression anaysis. MDA is the reverse of Mutivariate Anaysis of Variance (MANOVA); the continuous variabes are dependent variabes in MANOVA and the casses are predictor variabes. PCA can be used as an initia step in discriminant anaysis to reduce the number of predictor variabes. A reated procedure is to fit a series of ogistic modes. These incude Probit and Logit anaysis which predicts the probabiity of a yes or no (2 casses). This can be extended to a mutinomia ogit, by fitting a series of 2 cass modes. Probit and Logit, and mutinomia ogit are not covered in this course. Procedure, Canonica discriminant anaysis: The prediction modes ( inear combinations of predictor variabes) are based on a Learning Data Set. This set is comprised of sampe observations of the X variabes for each of the k groups. X j x11 x12 x13 L x1p x21 x22 x23 L x2 p = x31 x32 x33 L x3p M M M O M xn ( j) 1 xn ( j) 2 xn ( j) 3 L xn ( j) p n = n1 + n2 + n3+ L n k j = 123,,,L k
3 3 The idea is to determine functions of the X variabes that in some way separates the k groups as we as possibe. The simpest is to take a inear combinations of the X variabes. z 1 = b 11 x 1 + b 12 x 2 + b 13 x 3 +L b 1p x p where z 1 is a matrix of discriminant scores, one vaue for each of the n observations, and one for each of the r discriminating functions. There can be z 2, z 3, etc. up to the smaer of p or k-1 different inear functions possibe. In order to obtain the "best" vaues for the coefficients, we want to maximize the ratio of the between group variance over the within group variance. λ = b T B b T b W b where T= the tota variation of a the predictor variabes; and T can be divided into variance between groups (B) and variance within groups (W). The cacuation of these is as foows: (see presentation in cass)
4 4 We want to find a coefficient matrix b, such that this ratio is maximized. We aso have the constraint that the resuting discriminant scores are uncorreated. To begin, we take first derivatives and set equa to zero. Then, using a Lagrangian mutipier as we did in finding principe components of a matrix, we obtain: ( B λw) b= 0 which is equivaent to: 1 ( W B λ I) b= 0 b are the eigenvectors of W 1 λ are the eigenvaues of W B 1 B (discriminant weights); from argest to smaest; 1 W B is nonsymmetric; eigenvectors are uncorreated but wi not be orthogona. The reative weight of the function can be expressed by a ratio of the associated eigenvaue reative to the sum of a eigenvaues combined for a discriminating functions. RW This indicates which axis capture the most variation. The cosine of the ange between two discriminating functions can be found by: = cos( θ v ) r λ = 1 λ T = b b v which is the inner product of the two eigenvectors.
5 5 Assumptions: 1. Mutivariate Normaity of predictor variabes (a continuous and normay distributed). 2. Homogeneity of the variance-covariance matrix over a m groups. Discriminant anaysis is not robust to these assumptions. If these are not met, the resuting tests of significance wi not be reiabe (the package coud report a "p vaue" of and the rea vaue is 0.30). The discriminant anaysis can be used as a descriptive too in this case, but cannot be used to test hypothesis about the discriminant functions. If #1 hods but #2 does not, can use a quadratic discriminating function instead of a inear discriminating function. If #1 does not hod, coud resut in biased estimates of miscassification error rates aso. Miscassification Error Rates Fisher s inear discriminating functions ( one function for each of the k groups) can be used to predict group membership, based on an observation of the predictor variabes. The vaue for each of the k Fisher s inear discriminating functions is determined using the vaues for the predictor variabes. The highest vaue indicates the group membership. Aternativey, the vector of discriminating scores (z) coud be found using the r inear discriminating functions (ess than k), by inputting the set of vaues for the predictor variabes. Then, the vector of average discriminating scores using the
6 6 average vaues for the predictor variabes in the earning data set coud be found for each group. For each group, using the vector of averages ( z m ), the Mahaanobis distance woud then be cacuated: 2 T 1 D = ( z z ) C ( z z ) m m where C is the covariance matrix for the X variabes. The new data point represented by vector z is then predicted to beong to the group having the owest Mahaanobis distance. Based on the prediction modes obtained using the earning dataset, the number of incorrecty cassified observations (miscassification error rate) can be determined using the earning set data, and Fisher s inear discriminating functions. The error rate wi be underestimated, since these data were used to estabish the prediction modes. There are severa aternatives for estimating the miscassification error rate: 1. Cacuate the error rate using a new data set. 2. Spit the origina data set into two subsets. One part of the data woud be used to fit the discriminating functions, and the other woud be used to cacuate the miscassification error rate. 3. Cross-Vaidation The process for cross-vaidation is to 1) fit the discriminating functions using a but 1 of the observations in the data set; 2) cacuate the error rate for the reserved observation; 3) repeat 1 and 2 by reserving a different observation, unti each observation has been removed (i.e. fit the discriminating functions n times).
7 7 4. n-way vaidation A modification of the cross-vaidation is to divide the data into groups. Discriminant anaysis is performed using a but one of the groups of data. The reserved group of data is then used to test the functions. This is repeated by reserving a different group. The average error rate is then cacuated. Considerations in data spitting incude: 1) random spit? 2) random spit by group? 3) enough data eft to obtain a reasonabe discriminating mode? Which centroids differ? For 2 groups, the difference between group centroids can be tested to see if the group centroids differ ( H0: μ 1 = μ 2). The Mahaanobis distance is defined as: 2 T 1 D = ( z z ) C ( z z ) A transformation of this distance can be used to test for differences between two group centroids: F = n n n + n n1 + n2 p 1 ( n + n 2) p D 2 Under the nu hypothesis that the two group centroids are the same, this is distributed as an F distribution, for the 1 α percentie, and with n + n p 1 degress of freedom. For more than two groups, often this two group test is α performed for every pair of groups; however, the 1 percentie shoud no. pairs be used instead of the 1 α percentie.
8 8 An aternative test, that is reated to this test, is the Hoteing s T squared test. T n n = n + n D 2 2 The test statistic is then cacuated: n1 + n2 p 1 T p ( n + n 2) 2 which is distributed as the F distribution for the 1 α percentie, and with p and n1 + n2 p 1 degress of freedom. Again this can be used for more groups by testing every pair of groups, but using the percentie. 1 α no. pairs instead of the 1 α Both of these tests assume a mutivariate distribution of data, and that the covariance matrix is the same for the two groups. Which inear composites (discriminant functions) shoud be retained? 1. Significance of Eigenvaues as a Group (a r discriminant functions): Cacuate where n, p, k are as defined above. { } V = ( n 1) 1/ 2( p+ k) n( 1+ λ ) r = 1 Compare to Chi Square distribution with p(k-1) degrees of freedom and the 1 α percentie. If V is greater than the critica vaue, the discriminant functions as a group are significant.
9 9 2. Significance of function : Cacuate { } V = ( n 1) 1/ 2( p+ k) n( 1+ λ ) Compare to Chi Square distribution with p+k-2 degrees of freedom. If V greater than critica vaue, discriminant function is significant. is Which X Variabes are most important to the Discriminant Scores? 1. Discriminant weight: probems with these are that they reate to variabe size and reationship among variabes (dependence of predictor variabes). 2. Discriminant oadings: gives simpe correation coefficient of variabe with the discriminant scores. Cacuation of Discriminant oadings: Let C -1/2 be the square root of diagona eements of the variance-covariance matrix of the predictor variabes (standard deviations) and et R be the correation matrix for X (pairwise correations between the origina variabes). Then: 1. b * C = 1/2 b to get scaed weights 2. R b to get scaed weights * correation for X which resuts in = * correations between each X with each discriminating function (discriminant scores). where the are vectors of discriminant oadings for the discriminant function.
10 10 Toos for Interpretation: 1. Pot the group centroids. One centroid for each group, for each discriminant function. (Figure 5) 2. Pot group overaps. (Figure 6). 3. Aso possibe to ater the prior probabiities (equa, sampe based, other). 4. Stepwise discriminant anaysis possibe but based on the mutivariate norma distribution function. References Dion, W.R. and Godstein, M Mutivariate anaysis. Methods and appications. John Wiey and Sons, Toronto. [and textbooks for the course]
General Certificate of Education Advanced Level Examination June 2010
Genera Certificate of Education Advanced Leve Examination June 2010 Human Bioogy HBI6T/Q10/task Unit 6T A2 Investigative Skis Assignment Task Sheet The effect of using one or two eyes on the perception
More informationBALANCING REGULAR MATRIX PENCILS
BALANCING REGULAR MATRIX PENCILS DAMIEN LEMONNIER AND PAUL VAN DOOREN Abstract. In this paper we present a new diagona baancing technique for reguar matrix pencis λb A, which aims at reducing the sensitivity
More informationA Comparison Study of the Test for Right Censored and Grouped Data
Communications for Statistica Appications and Methods 2015, Vo. 22, No. 4, 313 320 DOI: http://dx.doi.org/10.5351/csam.2015.22.4.313 Print ISSN 2287-7843 / Onine ISSN 2383-4757 A Comparison Study of the
More informationA proposed nonparametric mixture density estimation using B-spline functions
A proposed nonparametric mixture density estimation using B-spine functions Atizez Hadrich a,b, Mourad Zribi a, Afif Masmoudi b a Laboratoire d Informatique Signa et Image de a Côte d Opae (LISIC-EA 4491),
More information8 APPENDIX. E[m M] = (n S )(1 exp( exp(s min + c M))) (19) E[m M] n exp(s min + c M) (20) 8.1 EMPIRICAL EVALUATION OF SAMPLING
8 APPENDIX 8.1 EMPIRICAL EVALUATION OF SAMPLING We wish to evauate the empirica accuracy of our samping technique on concrete exampes. We do this in two ways. First, we can sort the eements by probabiity
More informationA Separability Index for Distance-based Clustering and Classification Algorithms
Journa of Machine Learning Research 1 (2000) 1-48 Submitted Apri 30, 2010; Pubished 10/00 A Separabiity Index for Distance-based Custering and Cassification Agorithms Arka P. Ghosh Ranjan Maitra Anna D.
More informationBayesian Learning. You hear a which which could equally be Thanks or Tanks, which would you go with?
Bayesian Learning A powerfu and growing approach in machine earning We use it in our own decision making a the time You hear a which which coud equay be Thanks or Tanks, which woud you go with? Combine
More informationAutomobile Prices in Market Equilibrium. Berry, Pakes and Levinsohn
Automobie Prices in Market Equiibrium Berry, Pakes and Levinsohn Empirica Anaysis of demand and suppy in a differentiated products market: equiibrium in the U.S. automobie market. Oigopoistic Differentiated
More informationAlberto Maydeu Olivares Instituto de Empresa Marketing Dept. C/Maria de Molina Madrid Spain
CORRECTIONS TO CLASSICAL PROCEDURES FOR ESTIMATING THURSTONE S CASE V MODEL FOR RANKING DATA Aberto Maydeu Oivares Instituto de Empresa Marketing Dept. C/Maria de Moina -5 28006 Madrid Spain Aberto.Maydeu@ie.edu
More informationA Separability Index for Distance-based Clustering and Classification Algorithms
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL.?, NO.?, JANUARY 1? 1 A Separabiity Index for Distance-based Custering and Cassification Agorithms Arka P. Ghosh, Ranjan Maitra and Anna
More informationSeparation of Variables and a Spherical Shell with Surface Charge
Separation of Variabes and a Spherica She with Surface Charge In cass we worked out the eectrostatic potentia due to a spherica she of radius R with a surface charge density σθ = σ cos θ. This cacuation
More informationLecture Note 3: Stationary Iterative Methods
MATH 5330: Computationa Methods of Linear Agebra Lecture Note 3: Stationary Iterative Methods Xianyi Zeng Department of Mathematica Sciences, UTEP Stationary Iterative Methods The Gaussian eimination (or
More informationII. PROBLEM. A. Description. For the space of audio signals
CS229 - Fina Report Speech Recording based Language Recognition (Natura Language) Leopod Cambier - cambier; Matan Leibovich - matane; Cindy Orozco Bohorquez - orozcocc ABSTRACT We construct a rea time
More informationGeneral Certificate of Education Advanced Level Examination June 2010
Genera Certificate of Education Advanced Leve Examination June 2010 Human Bioogy HBI6T/P10/task Unit 6T A2 Investigative Skis Assignment Task Sheet The effect of temperature on the rate of photosynthesis
More information(This is a sample cover image for this issue. The actual cover is not yet available at this time.)
(This is a sampe cover image for this issue The actua cover is not yet avaiabe at this time) This artice appeared in a journa pubished by Esevier The attached copy is furnished to the author for interna
More informationSVM: Terminology 1(6) SVM: Terminology 2(6)
Andrew Kusiak Inteigent Systems Laboratory 39 Seamans Center he University of Iowa Iowa City, IA 54-57 SVM he maxima margin cassifier is simiar to the perceptron: It aso assumes that the data points are
More informationAST 418/518 Instrumentation and Statistics
AST 418/518 Instrumentation and Statistics Cass Website: http://ircamera.as.arizona.edu/astr_518 Cass Texts: Practica Statistics for Astronomers, J.V. Wa, and C.R. Jenkins, Second Edition. Measuring the
More informationIE 361 Exam 1. b) Give *&% confidence limits for the bias of this viscometer. (No need to simplify.)
October 9, 00 IE 6 Exam Prof. Vardeman. The viscosity of paint is measured with a "viscometer" in units of "Krebs." First, a standard iquid of "known" viscosity *# Krebs is tested with a company viscometer
More informationStatistical Learning Theory: A Primer
Internationa Journa of Computer Vision 38(), 9 3, 2000 c 2000 uwer Academic Pubishers. Manufactured in The Netherands. Statistica Learning Theory: A Primer THEODOROS EVGENIOU, MASSIMILIANO PONTIL AND TOMASO
More informationA Separability Index for Distance-based Clustering and Classification Algorithms
A Separabiity Index for Distance-based Custering and Cassification Agorithms Arka P. Ghosh, Ranjan Maitra and Anna D. Peterson 1 Department of Statistics, Iowa State University, Ames, IA 50011-1210, USA.
More informationA MODEL FOR ESTIMATING THE LATERAL OVERLAP PROBABILITY OF AIRCRAFT WITH RNP ALERTING CAPABILITY IN PARALLEL RNAV ROUTES
6 TH INTERNATIONAL CONGRESS OF THE AERONAUTICAL SCIENCES A MODEL FOR ESTIMATING THE LATERAL OVERLAP PROBABILITY OF AIRCRAFT WITH RNP ALERTING CAPABILITY IN PARALLEL RNAV ROUTES Sakae NAGAOKA* *Eectronic
More informationhole h vs. e configurations: l l for N > 2 l + 1 J = H as example of localization, delocalization, tunneling ikx k
Infinite 1-D Lattice CTDL, pages 1156-1168 37-1 LAST TIME: ( ) ( ) + N + 1 N hoe h vs. e configurations: for N > + 1 e rij unchanged ζ( NLS) ζ( NLS) [ ζn unchanged ] Hund s 3rd Rue (Lowest L - S term of
More information4 1-D Boundary Value Problems Heat Equation
4 -D Boundary Vaue Probems Heat Equation The main purpose of this chapter is to study boundary vaue probems for the heat equation on a finite rod a x b. u t (x, t = ku xx (x, t, a < x < b, t > u(x, = ϕ(x
More informationTwo-Stage Least Squares as Minimum Distance
Two-Stage Least Squares as Minimum Distance Frank Windmeijer Discussion Paper 17 / 683 7 June 2017 Department of Economics University of Bristo Priory Road Compex Bristo BS8 1TU United Kingdom Two-Stage
More informationMARKOV CHAINS AND MARKOV DECISION THEORY. Contents
MARKOV CHAINS AND MARKOV DECISION THEORY ARINDRIMA DATTA Abstract. In this paper, we begin with a forma introduction to probabiity and expain the concept of random variabes and stochastic processes. After
More informationSTA 216 Project: Spline Approach to Discrete Survival Analysis
: Spine Approach to Discrete Surviva Anaysis November 4, 005 1 Introduction Athough continuous surviva anaysis differs much from the discrete surviva anaysis, there is certain ink between the two modeing
More information4 Separation of Variables
4 Separation of Variabes In this chapter we describe a cassica technique for constructing forma soutions to inear boundary vaue probems. The soution of three cassica (paraboic, hyperboic and eiptic) PDE
More informationSome Measures for Asymmetry of Distributions
Some Measures for Asymmetry of Distributions Georgi N. Boshnakov First version: 31 January 2006 Research Report No. 5, 2006, Probabiity and Statistics Group Schoo of Mathematics, The University of Manchester
More informationWavelet Methods for Time Series Analysis. Wavelet-Based Signal Estimation: I. Part VIII: Wavelet-Based Signal Extraction and Denoising
Waveet Methods for Time Series Anaysis Part VIII: Waveet-Based Signa Extraction and Denoising overview of key ideas behind waveet-based approach description of four basic modes for signa estimation discussion
More informationDistribution free tests for polynomial regression based on simplicial depth
Distribution free tests for poynomia regression based on simpicia depth by Robin Wemann, Peter Harmand, Christine H. Müer University of Kasse, University of Odenburg Juy 30, 007 Abstract A genera approach
More informationA Brief Introduction to Markov Chains and Hidden Markov Models
A Brief Introduction to Markov Chains and Hidden Markov Modes Aen B MacKenzie Notes for December 1, 3, &8, 2015 Discrete-Time Markov Chains You may reca that when we first introduced random processes,
More informationExplicit overall risk minimization transductive bound
1 Expicit overa risk minimization transductive bound Sergio Decherchi, Paoo Gastado, Sandro Ridea, Rodofo Zunino Dept. of Biophysica and Eectronic Engineering (DIBE), Genoa University Via Opera Pia 11a,
More informationAppendix of the Paper The Role of No-Arbitrage on Forecasting: Lessons from a Parametric Term Structure Model
Appendix of the Paper The Roe of No-Arbitrage on Forecasting: Lessons from a Parametric Term Structure Mode Caio Ameida cameida@fgv.br José Vicente jose.vaentim@bcb.gov.br June 008 1 Introduction In this
More informationExpectation-Maximization for Estimating Parameters for a Mixture of Poissons
Expectation-Maximization for Estimating Parameters for a Mixture of Poissons Brandon Maone Department of Computer Science University of Hesini February 18, 2014 Abstract This document derives, in excrutiating
More informationSUPPLEMENTARY MATERIAL TO INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS
ISEE 1 SUPPLEMENTARY MATERIAL TO INNOVATED SCALABLE EFFICIENT ESTIMATION IN ULTRA-LARGE GAUSSIAN GRAPHICAL MODELS By Yingying Fan and Jinchi Lv University of Southern Caifornia This Suppementary Materia
More informationStatistics for Applications. Chapter 7: Regression 1/43
Statistics for Appications Chapter 7: Regression 1/43 Heuristics of the inear regression (1) Consider a coud of i.i.d. random points (X i,y i ),i =1,...,n : 2/43 Heuristics of the inear regression (2)
More informationarxiv: v2 [cond-mat.stat-mech] 14 Nov 2008
Random Booean Networks Barbara Drosse Institute of Condensed Matter Physics, Darmstadt University of Technoogy, Hochschustraße 6, 64289 Darmstadt, Germany (Dated: June 27) arxiv:76.335v2 [cond-mat.stat-mech]
More informationAkaike Information Criterion for ANOVA Model with a Simple Order Restriction
Akaike Information Criterion for ANOVA Mode with a Simpe Order Restriction Yu Inatsu * Department of Mathematics, Graduate Schoo of Science, Hiroshima University ABSTRACT In this paper, we consider Akaike
More informationMATRIX CONDITIONING AND MINIMAX ESTIMATIO~ George Casella Biometrics Unit, Cornell University, Ithaca, N.Y. Abstract
MATRIX CONDITIONING AND MINIMAX ESTIMATIO~ George Casea Biometrics Unit, Corne University, Ithaca, N.Y. BU-732-Mf March 98 Abstract Most of the research concerning ridge regression methods has deat with
More information$, (2.1) n="# #. (2.2)
Chapter. Eectrostatic II Notes: Most of the materia presented in this chapter is taken from Jackson, Chap.,, and 4, and Di Bartoo, Chap... Mathematica Considerations.. The Fourier series and the Fourier
More informationStochastic Variational Inference with Gradient Linearization
Stochastic Variationa Inference with Gradient Linearization Suppementa Materia Tobias Pötz * Anne S Wannenwetsch Stefan Roth Department of Computer Science, TU Darmstadt Preface In this suppementa materia,
More informationAssignment 7 Due Tuessday, March 29, 2016
Math 45 / AMCS 55 Dr. DeTurck Assignment 7 Due Tuessday, March 9, 6 Topics for this week Convergence of Fourier series; Lapace s equation and harmonic functions: basic properties, compuations on rectanges
More informationA. Distribution of the test statistic
A. Distribution of the test statistic In the sequentia test, we first compute the test statistic from a mini-batch of size m. If a decision cannot be made with this statistic, we keep increasing the mini-batch
More informationStatistical Inference, Econometric Analysis and Matrix Algebra
Statistica Inference, Econometric Anaysis and Matrix Agebra Bernhard Schipp Water Krämer Editors Statistica Inference, Econometric Anaysis and Matrix Agebra Festschrift in Honour of Götz Trenker Physica-Verag
More informationTwo view learning: SVM-2K, Theory and Practice
Two view earning: SVM-2K, Theory and Practice Jason D.R. Farquhar jdrf99r@ecs.soton.ac.uk Hongying Meng hongying@cs.york.ac.uk David R. Hardoon drh@ecs.soton.ac.uk John Shawe-Tayor jst@ecs.soton.ac.uk
More informationTesting for the Existence of Clusters
Testing for the Existence of Custers Caudio Fuentes and George Casea University of Forida November 13, 2008 Abstract The detection and determination of custers has been of specia interest, among researchers
More informationInductive Bias: How to generalize on novel data. CS Inductive Bias 1
Inductive Bias: How to generaize on nove data CS 478 - Inductive Bias 1 Overfitting Noise vs. Exceptions CS 478 - Inductive Bias 2 Non-Linear Tasks Linear Regression wi not generaize we to the task beow
More informationMode in Output Participation Factors for Linear Systems
2010 American ontro onference Marriott Waterfront, Batimore, MD, USA June 30-Juy 02, 2010 WeB05.5 Mode in Output Participation Factors for Linear Systems Li Sheng, yad H. Abed, Munther A. Hassouneh, Huizhong
More informationMidterm 2 Review. Drew Rollins
Midterm 2 Review Drew Roins 1 Centra Potentias and Spherica Coordinates 1.1 separation of variabes Soving centra force probems in physics (physica systems described by two objects with a force between
More informationManipulation in Financial Markets and the Implications for Debt Financing
Manipuation in Financia Markets and the Impications for Debt Financing Leonid Spesivtsev This paper studies the situation when the firm is in financia distress and faces bankruptcy or debt restructuring.
More informationFrom Margins to Probabilities in Multiclass Learning Problems
From Margins to Probabiities in Muticass Learning Probems Andrea Passerini and Massimiiano Ponti 2 and Paoo Frasconi 3 Abstract. We study the probem of muticass cassification within the framework of error
More informationOnline Appendices for The Economics of Nationalism (Xiaohuan Lan and Ben Li)
Onine Appendices for The Economics of Nationaism Xiaohuan Lan and Ben Li) A. Derivation of inequaities 9) and 10) Consider Home without oss of generaity. Denote gobaized and ungobaized by g and ng, respectivey.
More informationHigh Spectral Resolution Infrared Radiance Modeling Using Optimal Spectral Sampling (OSS) Method
High Spectra Resoution Infrared Radiance Modeing Using Optima Spectra Samping (OSS) Method J.-L. Moncet and G. Uymin Background Optima Spectra Samping (OSS) method is a fast and accurate monochromatic
More informationStrauss PDEs 2e: Section Exercise 2 Page 1 of 12. For problem (1), complete the calculation of the series in case j(t) = 0 and h(t) = e t.
Strauss PDEs e: Section 5.6 - Exercise Page 1 of 1 Exercise For probem (1, compete the cacuation of the series in case j(t = and h(t = e t. Soution With j(t = and h(t = e t, probem (1 on page 147 becomes
More information14-6 The Equation of Continuity
14-6 The Equation of Continuity 14-6 The Equation of Continuity Motion of rea fuids is compicated and poory understood (e.g., turbuence) We discuss motion of an idea fuid 1. Steady fow: Laminar fow, the
More informationMATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES
MATH 172: MOTIVATION FOR FOURIER SERIES: SEPARATION OF VARIABLES Separation of variabes is a method to sove certain PDEs which have a warped product structure. First, on R n, a inear PDE of order m is
More informationDavid Eigen. MA112 Final Paper. May 10, 2002
David Eigen MA112 Fina Paper May 1, 22 The Schrodinger equation describes the position of an eectron as a wave. The wave function Ψ(t, x is interpreted as a probabiity density for the position of the eectron.
More informationCS229 Lecture notes. Andrew Ng
CS229 Lecture notes Andrew Ng Part IX The EM agorithm In the previous set of notes, we taked about the EM agorithm as appied to fitting a mixture of Gaussians. In this set of notes, we give a broader view
More informationInverse-Variance Weighting PCA-based VRE criterion to select the optimal number of PCs
Preprints of the 18th IFAC Word Congress Miano (Itay) August 28 - September 2, 211 Inverse-Variance Weighting PCA-based VRE criterion to seect the optima number of PCs Baigh Mnassri E Mostafa E Ade Mustapha
More informationC. Fourier Sine Series Overview
12 PHILIP D. LOEWEN C. Fourier Sine Series Overview Let some constant > be given. The symboic form of the FSS Eigenvaue probem combines an ordinary differentia equation (ODE) on the interva (, ) with a
More informationStatistical Astronomy
Lectures for the 7 th IAU ISYA Ifrane, nd 3 rd Juy 4 p ( x y, I) p( y x, I) p( x, I) p( y, I) Statistica Astronomy Martin Hendry, Dept of Physics and Astronomy University of Gasgow, UK http://www.astro.ga.ac.uk/users/martin/isya/
More informationThe EM Algorithm applied to determining new limit points of Mahler measures
Contro and Cybernetics vo. 39 (2010) No. 4 The EM Agorithm appied to determining new imit points of Maher measures by Souad E Otmani, Georges Rhin and Jean-Marc Sac-Épée Université Pau Veraine-Metz, LMAM,
More informationXSAT of linear CNF formulas
XSAT of inear CN formuas Bernd R. Schuh Dr. Bernd Schuh, D-50968 Kön, Germany; bernd.schuh@netcoogne.de eywords: compexity, XSAT, exact inear formua, -reguarity, -uniformity, NPcompeteness Abstract. Open
More informationFirst-Order Corrections to Gutzwiller s Trace Formula for Systems with Discrete Symmetries
c 26 Noninear Phenomena in Compex Systems First-Order Corrections to Gutzwier s Trace Formua for Systems with Discrete Symmetries Hoger Cartarius, Jörg Main, and Günter Wunner Institut für Theoretische
More informationAvailable online at ScienceDirect. Procedia Computer Science 96 (2016 )
Avaiabe onine at www.sciencedirect.com ScienceDirect Procedia Computer Science 96 (206 92 99 20th Internationa Conference on Knowedge Based and Inteigent Information and Engineering Systems Connected categorica
More informationMath 124B January 17, 2012
Math 124B January 17, 212 Viktor Grigoryan 3 Fu Fourier series We saw in previous ectures how the Dirichet and Neumann boundary conditions ead to respectivey sine and cosine Fourier series of the initia
More informationChapter 7 PRODUCTION FUNCTIONS. Copyright 2005 by South-Western, a division of Thomson Learning. All rights reserved.
Chapter 7 PRODUCTION FUNCTIONS Copyright 2005 by South-Western, a division of Thomson Learning. A rights reserved. 1 Production Function The firm s production function for a particuar good (q) shows the
More informationWAVELET FREQUENCY DOMAIN APPROACH FOR TIME-SERIES MODELING
1. Introduction WAVELET FREQUENCY DOMAIN APPROACH FOR TIME-SERIES MODELING Ranit Kumar Pau Indian Agricutura Statistics Research Institute Library Avenue, New Dehi 11001 ranitstat@iasri.res.in Autoregressive
More informationORTHOGONAL MULTI-WAVELETS FROM MATRIX FACTORIZATION
J. Korean Math. Soc. 46 2009, No. 2, pp. 281 294 ORHOGONAL MLI-WAVELES FROM MARIX FACORIZAION Hongying Xiao Abstract. Accuracy of the scaing function is very crucia in waveet theory, or correspondingy,
More informationShort Circuit Detection Utilization Analysis under Uniprocessor EDF Scheduling
Short Circuit Detection Utiization Anaysis under Uniprocessor EDF Scheduing Aaron Wicock Department of Computer Science Wayne State University Detroit, Michigan 48202 aaron.wicock@wayne.edu Abstract Accounting
More informationThe Normalized Singular Value Decomposition of Non-Symmetric Matrices Using Givens fast Rotations
JOURNAL OF L A TEX CLASS FILES, VOL. 3, NO. 9, SEPTEMBER 24 The Normaized Singuar Vaue Decomposition of Non-Symmetric Matrices Using Givens fast Rotations Ehsan Rohani, Gwan S. Choi, Mi Lu arxiv:77.589v
More informationA Robust Voice Activity Detection based on Noise Eigenspace Projection
A Robust Voice Activity Detection based on Noise Eigenspace Projection Dongwen Ying 1, Yu Shi 2, Frank Soong 2, Jianwu Dang 1, and Xugang Lu 1 1 Japan Advanced Institute of Science and Technoogy, Nomi
More informationA sta6s6cal view of entropy
A sta6s6ca view of entropy 20-4 A Sta&s&ca View of Entropy The entropy of a system can be defined in terms of the possibe distribu&ons of its moecues. For iden&ca moecues, each possibe distribu&on of moecues
More informationSTATISTICAL APPROACHES FOR MATCHING THE COMPONENTS OF COMPLEX MICROBIAL COMMUNITIES
STATISTICAL APPROACHES FOR MATCHING THE COMPONENTS OF COMPLEX MICROBIAL COMMUNITIES by Chongci Tang Submitted in partia fufiment of the requirements for the degree of Master of Science at Dahousie University
More informationUI FORMULATION FOR CABLE STATE OF EXISTING CABLE-STAYED BRIDGE
UI FORMULATION FOR CABLE STATE OF EXISTING CABLE-STAYED BRIDGE Juan Huang, Ronghui Wang and Tao Tang Coege of Traffic and Communications, South China University of Technoogy, Guangzhou, Guangdong 51641,
More informationTrainable fusion rules. I. Large sample size case
Neura Networks 19 (2006) 1506 1516 www.esevier.com/ocate/neunet Trainabe fusion rues. I. Large sampe size case Šarūnas Raudys Institute of Mathematics and Informatics, Akademijos 4, Vinius 08633, Lithuania
More informationSupport Vector Machine and Its Application to Regression and Classification
BearWorks Institutiona Repository MSU Graduate Theses Spring 2017 Support Vector Machine and Its Appication to Regression and Cassification Xiaotong Hu As with any inteectua project, the content and views
More informationSolution Set Seven. 1 Goldstein Components of Torque Along Principal Axes Components of Torque Along Cartesian Axes...
: Soution Set Seven Northwestern University, Cassica Mechanics Cassica Mechanics, Third Ed.- Godstein November 8, 25 Contents Godstein 5.8. 2. Components of Torque Aong Principa Axes.......................
More informationCombining reaction kinetics to the multi-phase Gibbs energy calculation
7 th European Symposium on Computer Aided Process Engineering ESCAPE7 V. Pesu and P.S. Agachi (Editors) 2007 Esevier B.V. A rights reserved. Combining reaction inetics to the muti-phase Gibbs energy cacuation
More informationOn the evaluation of saving-consumption plans
On the evauation of saving-consumption pans Steven Vanduffe Jan Dhaene Marc Goovaerts Juy 13, 2004 Abstract Knowedge of the distribution function of the stochasticay compounded vaue of a series of future
More informationMore Scattering: the Partial Wave Expansion
More Scattering: the Partia Wave Expansion Michae Fower /7/8 Pane Waves and Partia Waves We are considering the soution to Schrödinger s equation for scattering of an incoming pane wave in the z-direction
More informationASummaryofGaussianProcesses Coryn A.L. Bailer-Jones
ASummaryofGaussianProcesses Coryn A.L. Baier-Jones Cavendish Laboratory University of Cambridge caj@mrao.cam.ac.uk Introduction A genera prediction probem can be posed as foows. We consider that the variabe
More informationGauss Law. 2. Gauss s Law: connects charge and field 3. Applications of Gauss s Law
Gauss Law 1. Review on 1) Couomb s Law (charge and force) 2) Eectric Fied (fied and force) 2. Gauss s Law: connects charge and fied 3. Appications of Gauss s Law Couomb s Law and Eectric Fied Couomb s
More information14 Separation of Variables Method
14 Separation of Variabes Method Consider, for exampe, the Dirichet probem u t = Du xx < x u(x, ) = f(x) < x < u(, t) = = u(, t) t > Let u(x, t) = T (t)φ(x); now substitute into the equation: dt
More informationStatistical Learning Theory: a Primer
??,??, 1 6 (??) c?? Kuwer Academic Pubishers, Boston. Manufactured in The Netherands. Statistica Learning Theory: a Primer THEODOROS EVGENIOU AND MASSIMILIANO PONTIL Center for Bioogica and Computationa
More informationPhysics 235 Chapter 8. Chapter 8 Central-Force Motion
Physics 35 Chapter 8 Chapter 8 Centra-Force Motion In this Chapter we wi use the theory we have discussed in Chapter 6 and 7 and appy it to very important probems in physics, in which we study the motion
More information[11] J.V. Uspensky, Introduction to Mathematical Probability (McGraw Hill, New
[11] J.V. Uspensky, Introduction to Mathematica Probabiity (McGraw Hi, New York, 1937) 77{84. [12] Wiiam G. Cochran, The 2 Test of Goodness of Fit (John Hopkins University, Department of Biostatistics,
More informationConverting Z-number to Fuzzy Number using. Fuzzy Expected Value
ISSN 1746-7659, Engand, UK Journa of Information and Computing Science Vo. 1, No. 4, 017, pp.91-303 Converting Z-number to Fuzzy Number using Fuzzy Expected Vaue Mahdieh Akhbari * Department of Industria
More informationA unified framework for Regularization Networks and Support Vector Machines. Theodoros Evgeniou, Massimiliano Pontil, Tomaso Poggio
MASSACHUSETTS INSTITUTE OF TECHNOLOGY ARTIFICIAL INTELLIGENCE LABORATORY and CENTER FOR BIOLOGICAL AND COMPUTATIONAL LEARNING DEPARTMENT OF BRAIN AND COGNITIVE SCIENCES A.I. Memo No. 1654 March23, 1999
More informationMath 124B January 31, 2012
Math 124B January 31, 212 Viktor Grigoryan 7 Inhomogeneous boundary vaue probems Having studied the theory of Fourier series, with which we successfuy soved boundary vaue probems for the homogeneous heat
More informationTwo-stage least squares as minimum distance
Econometrics Journa (2018), voume 0, pp. 1 9. doi: 10.1111/ectj.12115 Two-stage east squares as minimum distance FRANK WINDMEIJER Department of Economics and IEU, University of Bristo, Priory Road, Bristo,
More informationCalculation of Aggregate Pavement Condition Indices from Damage Data Using Factor Analysis
214 TRANSPORTATION RESEARCH RECORD 1311 Cacuation of Aggregate Pavement Condition Indices from Damage Data Using Factor Anaysis RoHIT RAMASWAMY AND SuE McNEIL Aggregate pavement condition indices are used
More informationProcess Capability Proposal. with Polynomial Profile
Contemporary Engineering Sciences, Vo. 11, 2018, no. 85, 4227-4236 HIKARI Ltd, www.m-hikari.com https://doi.org/10.12988/ces.2018.88467 Process Capabiity Proposa with Poynomia Profie Roberto José Herrera
More informationNonlinear Analysis of Spatial Trusses
Noninear Anaysis of Spatia Trusses João Barrigó October 14 Abstract The present work addresses the noninear behavior of space trusses A formuation for geometrica noninear anaysis is presented, which incudes
More informationLobontiu: System Dynamics for Engineering Students Website Chapter 3 1. z b z
Chapter W3 Mechanica Systems II Introduction This companion website chapter anayzes the foowing topics in connection to the printed-book Chapter 3: Lumped-parameter inertia fractions of basic compiant
More informationNOISE-INDUCED STABILIZATION OF STOCHASTIC DIFFERENTIAL EQUATIONS
NOISE-INDUCED STABILIZATION OF STOCHASTIC DIFFERENTIAL EQUATIONS TONY ALLEN, EMILY GEBHARDT, AND ADAM KLUBALL 3 ADVISOR: DR. TIFFANY KOLBA 4 Abstract. The phenomenon of noise-induced stabiization occurs
More informationarxiv: v2 [stat.ml] 19 Oct 2016
Sparse Quadratic Discriminant Anaysis and Community Bayes arxiv:1407.4543v2 [stat.ml] 19 Oct 2016 Ya Le Department of Statistics Stanford University ye@stanford.edu Abstract Trevor Hastie Department of
More informationChemical Kinetics Part 2
Integrated Rate Laws Chemica Kinetics Part 2 The rate aw we have discussed thus far is the differentia rate aw. Let us consider the very simpe reaction: a A à products The differentia rate reates the rate
More information6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17. Solution 7
6.434J/16.391J Statistics for Engineers and Scientists May 4 MIT, Spring 2006 Handout #17 Soution 7 Probem 1: Generating Random Variabes Each part of this probem requires impementation in MATLAB. For the
More informationOn colorings of the Boolean lattice avoiding a rainbow copy of a poset arxiv: v1 [math.co] 21 Dec 2018
On coorings of the Booean attice avoiding a rainbow copy of a poset arxiv:1812.09058v1 [math.co] 21 Dec 2018 Baázs Patkós Afréd Rényi Institute of Mathematics, Hungarian Academy of Scinces H-1053, Budapest,
More information