Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform

Size: px
Start display at page:

Download "Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform"

Transcription

1 AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES ISSN: EISSN: Journal home page: Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform T. Christy Bobby Department of Electronics and Communication Engineering,East Point College of Engineering and Technology, Bangalore, , India Address For Correspondence: T.Christy Bobby, Department of Electronics and Communication Engineering, East Point College of Engineering and Technology, Bangalore ; A R T I C L E I N F O Article history: Received 12 January 2016 Accepted 22 February 2016 Available online 1 March 2016 Keywords: Trabecular bone, Human femur, Contourlet, ELM, E-ELM. A B S T R A C T Background: Human femur trabecular bone is a dynamic and highly vascularised tissue which is able to repair and regenerate continuously throughout the life time of an individual. The sub-regions of the trabecular bone are structurally different and heterogeneous in nature. They have different bone strengths as they are subjected to different loading conditions. The variations in trabecular bone density and structure are directly related to bone strength. Thus in addition to bone mineral density, trabecular microarchitecture is considered as an important determinant of bone strength. In radiographic images the trabecular microarchitecture is projected as curves and straight lines oriented at various directions. In this work, femur trabecular microarchitecture variations in two strength regions such as compressive and tensile regions, delineated from the radiographic images of normal and abnormal subjects, are analyzed using multidirectional and multiscale contourlet transform. The contourlet coefficients are derived based on each scale and orientation for trabecular images. The mean and energy of the derived contourlet coefficients associated with each subband are computed. These values are used as the texture feature vector elements to evaluate changes taking place in the trabecular architecture. To automate the analysis, three most significant feature vectors are found using principal component analysis and these values are used as an input to the Evolutionary Extreme Learning Machine (E-ELM) classifier. The results show that it is possible to differentiate normal and abnormal femur trabecular images using contourlet features. Also the architectural variations are more in the tensile region when compared to compressive region. Thus E-ELM classifier performs better in terms of accuracy (98%) for the chosen parameters form tensile region when compared to compressive. INTRODUCTION Femoral fracture due to osteoporosis is a common disease in women and its incidence increases with age. These fractures are a major cause of morbidity and disability in postmenopausal women. Thus, predicting the strength of the bone is an important goal of current research for the diagnosis of osteoporosis. Bone strength is a term used to describe the ability of bone to resist fracture (Valero et al., 2010, Kastner et al., 2011). In clinical medicine Bone Mineral Density (BMD) is used as an indicator of bone strength. Recently, it has been speculated that the bone strength depends on both BMD and (Jaclynn and Steven, 2009) ( Malhotra and Mithal, 2008) trabecular bone architecture, which occupies a place of importance in the prediction of osteoporosis fractures. Hence, evaluation of BMD as well as architectural changes of femur bone is considered to be necessary in the automated diagnosis of osteoporosis (Lespessailles et al., 2006) (Donnelly, 2011). The trabecular structure of the femur bone are divided into principal compressive, secondary compressive, greater trochanter, principal tensile and secondary tensile groups. These sub-regions are structurally different as they are subjected to Open Access Journal Published BY AENSI Publication 2016 AENSI Publisher All rights reserved This work is licensed under the Creative Commons Attribution International License (CC BY). To Cite This Article: T. Christy Bobby., Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform. Aust. J. Basic & Appl. Sci., 10(5): 46-53, 2016

2 47 T. Christy Bobby, 2016 different loading conditions. Also the trabecular pattern change occurring in these sub-regions classifies the bones as normal, osteoporotic and severely osteoporotic bones. In the conventional planar radiographic images, these changes are clearly visible. (Singh et al., 1970) Imaging techniques such as micro-computed tomography and high resolution magnetic resonance imaging, produce three-dimensional (3D) images of trabecular bone, but their usage may be limited by their cost and availability. Digital radiography is a commonly available imaging modality that has the ability to reflect trabecular microarchitecture information that is available in three dimensional images. Thus, there has been considerable interest in using digital radiography combined with texture analysis techniques for assessing trabecular structure (Podsiadlo et al., 2008) (Corroller et al., 2012). The texture features are mainly derived using spatial and spectral methods. Spectral methods have an advantage of being insensitive to noise. Therefore, transforms have been widely used to characterize image textures. Wavelet transforms are very effective in representing images with point singularities. But most of the medical images and trabecular bone images often contain both curves and straight lines oriented at various directions (Ascenzi et al., 2011). Hence multiscale transform called contourlet transform, which can capture the curve and line discontinuity present in the images is used for feature extraction (Do and Vetterli, 2005) (Moayedi et al., 2010). Principal Component Analysis (PCA) is a standard feature selection tool in data analysis. It identifies patterns in data, and to highlight their similarities and differences. In the analysis of multivariate datasets, PCA is used to select the most significant parameters and the parameters are ranked based on their highest magnitudes in the principal components obtained. It has been widely employed in various signal and image processing problems (Samonwoy et al., 2008). Identification of tools for automated classification of medical images is an important step towards clinical decision making. Artificial Neural Networks (ANN) has seen a rapid growth and it has been applied widely in many biomedical applications. The Extreme Learning Machine (ELM) is a neural network algorithm for Singlehidden Layer feed Forward Neural network (SLFN) (Rong et al., 2008). However, ELM uses higher number of hidden neurons due to the random determination of the input weights and hidden biases (Liu and Wang, 2010). To remove redundancy among hidden nodes and to achieve satisfactory performance, a hybrid approach called E-ELM has been proposed by taking advantages of both ELM and Differential Evolution (DE) with more compact networks (Qin-Yu et al., 2005). In this work, radiographic human femur bone images are processed using image processing techniques and the strength regions such as compressive and tensile are delineated from the processed images. The mean feature vectors are calculated from the contourlet coefficients of different sub-bands for the delineated regions of interest. From the derived feature vectors, three most significant feature vectors are chosen using PCA and are used as inputs to the classifier. E-ELM classifier is employed for the classification of normal and abnormal femur bone images. The performances of the classifier are estimated and compared for the two strength regions. Methods: Digitized femur bone images (N = 50) recorded using Genius 100 X-ray generator unit are used for the analysis. The exposures are made with 100 ma at 75 kvp, exposure time is 0.14 s and distance is 100 cm. The standard anterio - posterior view is used to image all subjects and the recorded radiographs are digitized using FCR Prima (CR-IR 391RU) equipment. The acquired digital pelvis images are of size (2140 x 1760 pixels). Despite taken from the same location, the image quality of the radiographs vary. To achieve better image quality, the radiographs are enhanced by subjecting to adaptive histogram equalization (Elisabeta, 2011). From the enhanced bone pelvis image, left femur image of size (650 x 650 pixels) is cropped and considered for the analysis. Regions of Interest (ROI) of radiographic images, compressive region of size (120 x 80 pixels) and tensile region of size (250 x 80 pixels) are delineated, and considered for the analysis. These regions are heterogeneous in nature, have varying bone strength and change most markedly in appearance with bone loss. Compressive and tensile regions are structurally different regions where more mineral loss and architectural variations occurs due different loading conditions and stress distribution (Singh et al., 1970). The two stages of contourlet transform are subband decomposition and the directional transform. At the first stage Laplacian pyramid (LP) decomposes an image into a number of radial subband, and in the second stage directional filter banks (DFB) decompose LP details into a number of directional subband. The LP decomposition at each step generates a sampled low pass version of the original image and the difference between the original and the prediction image, resulting in a band pass image. The band pass images can be fed into a DFB so that directional information can be captured. The scheme can be iterated repeatedly on the coarse image. The end result is decomposition into directional subband at multiple scales. The image is decomposed into four pyramidal levels, resulting in 16 directional sub-bands. Contourlet mean and energy feature vectors are derived for directional sub-bands and are examined (Moayedi et al., 2010). The Principal Component Analysis is performed on the derived feature vectors to select first three significant feature vectors. PCA describe the dominant patterns and the main trends in the data. This is done through an eigenvector decomposition of the covariance matrix of the

3 48 T. Christy Bobby, 2016 original variables. The extracted latent variables are orthogonal and are sorted according to their eigenvalues. The high dimensional space described by matrix X is modeled using PCA as T X = TP + E (1) where T is the score matrix composed by the principal components, P is the loadings composed by the eigenvectors of the covariance matrix and E is the residual matrix (Samonwoy et al., 2008). The first three most significant parameters derived using PCA are used as an input to the E-ELM classifiers. EELM using Differential evolution (DE) and Moore Penrose (MP) generalized inverse parameters are used to classify the normal and abnormal bone images. In E-ELM the population is randomly generated. The population is composed of a set of input weights and hidden biases. θ = w11, w12,..., w1 k, w21, w22,... w2 k,..., wn 1, wn 2,... wnk,... b1, b2,..., bk (2) All w ij and b j are randomly initialized within the range of [ 1, 1]. For each individual the corresponding output weights are analytically computed by using the MP generalized inverse. The fitness of each individual is evaluated using cost function (E) and Root Mean Squared Error (RMSE). E N K 2 β (. ) 1 1 i g W j i i X j bi t = + = j 2 = m N (3) After the fitness, all individuals in the population are calculated using DE mutation, crossover and selection. During selection, the mutated vectors are compared with the original vectors, and the vectors with better fitness values are retained to the next generation. Further, to improve the generalization performance, one more criteria is added into the selection, the norm of output weights β. In this selection strategy, if the difference of the fitness between different individuals is small, smaller β is selected. The determination of new θ, population i G+ 1, is obtained from θ, i G+ 1 µ i, G if f ( θ i, G ) f ( µ i, G ) > ε f ( θi, G ), µ i, G if f ( θ i, G ) f ( µ i, G ) > ε f ( θi, G ) < ε f ( θi, G ) and = µ i, G θ i, G β < β, θi, G else, (4) Where, f ( ) is the fitness function and ε is a preset tolerance rate. Once the new population is generated, the DE process is repeated until the goal is met or when a preset maximum learning epochs is completed (Liu and Wang, 2010). The accuracy of classification models with different type of activation functions such as sigmoidal, sine, hardlim, triangular basis and radial basis functions for varying number of epochs from 10 to100 is estimated and analyzed. Accuracy is ratio of addition of True Positives (TP) and True Negatives (TN) to total number. The TP and TN are the cases where the abnormal is classified as abnormal and normal classified as normal, respectively. RESULTS AND DISCUSSION Typical pre-processed radiographic images of normal and abnormal femur trabecular bones are shown in Figures 1 and respectively. The trabecular patterns are found to be closely arranged in normal images, whereas the trabecular spacing is seen with discontinuities in abnormal cases. The overlap between trabeculae is also found to be less in abnormal images.

4 49 T. Christy Bobby, 2016 Fig. 1: Typical normal abnormal Analysis of Compressive Region using Contourlet Transform: Figure 2 shows the average mean values for compressive region of normal and abnormal images derived at different orientations and scales using contourlet transform co-efficient. In all orientations and scales, the mean values are slightly high for normal images. Figure 2 shows the average energy values for compressive region of normal and abnormal images derived at different orientations and scales using contourlet transform. It shows a discernible difference between normal and abnormal images at all orientations. In normal images, the energy values are high for orientations 3 to 16. These energy values are found to be high for lower and higher orientations of abnormal images. Figures 3, and (c) shows the scattergrams of normalized mean values of compressive region of the individual images for the first three significant orientations(mean1, mean2, mean3) respectively. It is observed that significant variations are not observed between normal and abnormal images. The mean of few abnormal images are found to fall in the same range for all three significant orientations. Hence this feature could be useful in distinguishing a few abnormal images. Average mean (compressive) Average energy (compressive) Orientation Orientation Fig. 2: Average mean and energy values for compressive region of normal and abnormal images at different Orientations. The energy values of the first three significant orientations (energy1, energy2, energy3), obtained for the compressive region of normal and abnormal images are shown in Figure 4, and (c). It is seen that the energy values show better differentiation between normal and abnormal images when compared to the mean feature. Further, the energy1 and energy3 show clear demarcation between normal and abnormal images. This shows that contourlet is able to extract trabecular changes that occur in the compressive region.

5 50 T. Christy Bobby, Mean1 (compressive) Mean2 (compressive) Mean3 (compressive) (c) Fig. 3: Scattergram of mean values of first second and (c) third significant orientations compressive region Analysis of Tensile Region using Contourlet Transform: Figure 5 shows the average values of mean for the tensile regions of normal and abnormal images derived at different orientations and scales using contourlet transform. This feature is found to have distinct separation between normal and abnormal images at all orientations. Also, the mean values are found to be high in all orientations and scales for normal images and low for abnormal images with varying magnitudes. Also in some orientations, the magnitude of the average mean value is very high. This explains the varying anisotropic nature of trabecular architecture and also demonstrates that the homogeneity of the trabecular structure is orientation dependent. Figure 5 shows the average values of energy in the tensile region for different orientations. It is noticed that in the lower and higher scale the energy values are found to be high for normal images whereas they have lower magnitude in other orientations. This again proves the fact that trabecular variation is orientation dependent.

6 51 T. Christy Bobby, 2016 Energy 1 (compressive) Energy2 (compressive) Energy3 (compressive) (c) Fig. 4: Scattergram of energy values first second and (c) third significant orientations in compressive region Average mean (tensile) Average energy (tensile) Orientation Orientation Fig. 5: Average mean and energy values for tensile region of normal and abnormal images at different orientations The scattergrams of the mean values in tensile region for first three significant orientations (first, second and third) are shown in Figure 6, and (c) respectively. Mean values of all the three significant orientations are found to show better demarcation between normal and abnormal images. This shows that trabecular

7 52 T. Christy Bobby, 2016 alteration is present in different degree for all the orientations in tensile region of the abnormal region. The scattergram of energy values of the tensile region of normal and abnormal images for first three significant orientations are shown in Figure 7, and (c) respectively. Energy values of all the three orientations are found to show better demarcation between normal and abnormal images. This also exhibits that trabecular alteration is present with different magnitude for the orientations of tensile region of the abnormal image. When compared to compressive region, tensile region shows better demarcation between normal and abnormal images in all the three orientations. Mean1 (tensile) Mean2 (tensile) Mean3 (tensile) Image Number (c) Fig. 6: Scattergram of mean values first second and (c) third significant orientations in tensile region Energy1 (tensile) Energy2 (tensile) Energy3 (tensile) (c) Fig. 7: Scattergram of energy values of first second and (c) third significant orientations in tensile region Accuracy (%) Compressive region (sigmoidal) Tensile region (sigmoidal) Number of epochs Fig. 8: Classification using EELM compressive and tensile region Figure 8 shows the classification accuracy of the EELM classifier for sigmoidal function for varying epochs. It is observed from the EELM results that the accuracy of the sigmoidal activation function increases steadily and above 70 epochs it reaches a maximum of 93% for compressive and 98% for tensile regions. It then gets saturated beyond 70 epochs and it is also seen that in EELM all the activation functions behave similarly in

8 53 T. Christy Bobby, 2016 achieving the accuracy in classification at higher epochs. EELM uses less number of epochs for classification in tensile region compared to compressive region. This is due to distinct separation between normal and abnormal images exhibited by features derived from tensile region. Hence the accuracy of classifiers for tensile region is high when compared with compressive region. Also EELM has high accuracy and is found to be the optimal classifier in distinguishing normal and abnormal human femur bone images using features obtained from analysis. Conclusions: Analyses of medical images using transform based methods are shown to be effective for various clinical inferences. Especially, they are used to extract variations manifested in images in the form of discontinuities and irregular patterns. In this work, contourlet transform is employed to analyze regional strength variations in trabecular bone structure using radiographic femur images. The results reveal that it is possible to differentiate normal and abnormal images using contourlet transform features derived from tensile and compressive regions. The architectural variations are more in the tensile when compared to compressive trabecular region. The observed changes are attributed to varying degree of trabecular bone loss, homogeneity and discontinuity. Thus it appears that contourlet transform based feature extraction together with EELM classification seems to be useful for regional strength and trabecular architectural analysis. REFERENCES Ascenzi, M.G., N. Hetzer and A. Lomovtsev et al., 2011.Variation of trabecular architecture in proximal femur of postmenopausal women. J.Biomech, 44: Corroller, T.L., J. Halgrin and M. Pithioux, Combination of texture analysis and bone mineral density improves the prediction of fracture load in human femurs. Osteoporosis Int, 23: Do, M.N and M. Vetterli, The contourlet transform: an efficient directional multiresolution image representation. IEEE T. Image Process, 14(12): Donnelly, E., Methods for assessing bone quality: A review. Clin. Orthop. Relat. Res, 469: Elisabeta, E.H., Adaptive histogram equalization in GIS. Annals of the University of Craiova,Mathematics and Computer Science Series, 38(1): Jaclynn, M.K and A.G. Steven, Trabecular bone mechanical properties in patients with fragility fractures. Clinical Orthopaedics and Related Research, 467: Kastner, M., A. Sawka and K. Thorpe et al, Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design. Implement Sci [Online], 6: 77, Available: Lespessailles., E.C., Chappard and N. Bonnet, Imaging techniques for evaluating bone microarchitecture. Joint Bone Spine, 73(3): Liu, N and H. Wang, Ensemble based extreme learning machine, IEEE Signal Proc.Let, 17(8): Malhotra, N and A. Mithal, Osteoporosis in Indians Indian. J.Med.Res, 127: Moayedi, F., Z. Azimifar, R. Boostani and S. Katebi, Contourlet-based mammography mass classification using the SVM family. Computers in Biology and Medicine, 40: Podsiadlo, P., L. Dahl, M. Englund, L.S. Lohmander and G.W. Stachowiak., Differences in trabecular bone texture between knees with and without radiographic osteoarthritis detected by fractal methods. Osteoarthr. Cartilage, 16: Qin-Yu, Z., A. K. Qin, P.N. Suganthan and H. Guang-Bin, Evolutionary extreme learning machine. Pattern Recogn, 38: Rong, H.J., H. Guang-Bin and O. Yew-Soon, Extreme learning machine for multi-categories classification applications. In Proc. of IEEE International Joint Conference on Neural Networks, Hong Kong, pp: Samonwoy, G.D., H. Adeli and N. Dadmehr, Principal component analysis-enhanced cosine radial basis function neural network for robust epilepsy and seizure detection. IEEE T. Biomed. Eng, 55(2): Singh, M., A.R. Nagarath and P.S. Maini, Changes in trabecular pattern of the upper end of the femur as an index of osteoporosis. J. Bone Joint Surg. Am, 52: Valero, M., J.C.F. Garcia and J.C. Catala, Implant treatment in patients with osteoporosis. Medicina Oral Patologia Oral Cirugia Bucal, 1:

Bearing fault diagnosis based on EMD-KPCA and ELM

Bearing fault diagnosis based on EMD-KPCA and ELM Bearing fault diagnosis based on EMD-KPCA and ELM Zihan Chen, Hang Yuan 2 School of Reliability and Systems Engineering, Beihang University, Beijing 9, China Science and Technology on Reliability & Environmental

More information

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES

ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1455 1475 ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC

More information

FEEDBACK GMDH-TYPE NEURAL NETWORK AND ITS APPLICATION TO MEDICAL IMAGE ANALYSIS OF LIVER CANCER. Tadashi Kondo and Junji Ueno

FEEDBACK GMDH-TYPE NEURAL NETWORK AND ITS APPLICATION TO MEDICAL IMAGE ANALYSIS OF LIVER CANCER. Tadashi Kondo and Junji Ueno International Journal of Innovative Computing, Information and Control ICIC International c 2012 ISSN 1349-4198 Volume 8, Number 3(B), March 2012 pp. 2285 2300 FEEDBACK GMDH-TYPE NEURAL NETWORK AND ITS

More information

Comparison of two interpolation methods for empirical mode decomposition based evaluation of radiographic femur bone images

Comparison of two interpolation methods for empirical mode decomposition based evaluation of radiographic femur bone images Acta of Bioengineering and Biomechanics Vol. 15, No. 2, 2013 Original paper DOI: 10.5277/abb130208 Comparison of two interpolation methods for empirical mode decomposition based evaluation of radiographic

More information

Myoelectrical signal classification based on S transform and two-directional 2DPCA

Myoelectrical signal classification based on S transform and two-directional 2DPCA Myoelectrical signal classification based on S transform and two-directional 2DPCA Hong-Bo Xie1 * and Hui Liu2 1 ARC Centre of Excellence for Mathematical and Statistical Frontiers Queensland University

More information

A Novel Activity Detection Method

A Novel Activity Detection Method A Novel Activity Detection Method Gismy George P.G. Student, Department of ECE, Ilahia College of,muvattupuzha, Kerala, India ABSTRACT: This paper presents an approach for activity state recognition of

More information

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine

Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Song Li 1, Peng Wang 1 and Lalit Goel 1 1 School of Electrical and Electronic Engineering Nanyang Technological University

More information

Machine learning for pervasive systems Classification in high-dimensional spaces

Machine learning for pervasive systems Classification in high-dimensional spaces Machine learning for pervasive systems Classification in high-dimensional spaces Department of Communications and Networking Aalto University, School of Electrical Engineering stephan.sigg@aalto.fi Version

More information

Predicting Primary Implant Stability Using the Trabecular Bone Score

Predicting Primary Implant Stability Using the Trabecular Bone Score Predicting Primary Implant Stability Using the Trabecular Bone Score DAVID LONG, DDS LSU SCHOOL OF DENTISTRY DEPARTMENT OF PERIODONTICS What is is? The biomechanical phenomenon of mechanical stability

More information

Introduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin

Introduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin 1 Introduction to Machine Learning PCA and Spectral Clustering Introduction to Machine Learning, 2013-14 Slides: Eran Halperin Singular Value Decomposition (SVD) The singular value decomposition (SVD)

More information

The recognition of substantia nigra in brain stem ultrasound images based on Principal Component Analysis

The recognition of substantia nigra in brain stem ultrasound images based on Principal Component Analysis The recognition of substantia nigra in brain stem ultrasound images based on Principal Component Analysis Jiří Blahuta, Tomáš Soukup and Petr Čermák Abstract. This paper assays the recognition of substantia

More information

Fuzzy quantization of Bandlet coefficients for image compression

Fuzzy quantization of Bandlet coefficients for image compression Available online at www.pelagiaresearchlibrary.com Advances in Applied Science Research, 2013, 4(2):140-146 Fuzzy quantization of Bandlet coefficients for image compression R. Rajeswari and R. Rajesh ISSN:

More information

Distributed Genetic Algorithm for feature selection in Gaia RVS spectra. Application to ANN parameterization

Distributed Genetic Algorithm for feature selection in Gaia RVS spectra. Application to ANN parameterization Distributed Genetic Algorithm for feature selection in Gaia RVS spectra. Application to ANN parameterization Diego Fustes, Diego Ordóñez, Carlos Dafonte, Minia Manteiga and Bernardino Arcay Abstract This

More information

Estimating the Number of Hidden Neurons of the MLP Using Singular Value Decomposition and Principal Components Analysis: A Novel Approach

Estimating the Number of Hidden Neurons of the MLP Using Singular Value Decomposition and Principal Components Analysis: A Novel Approach Estimating the Number of Hidden Neurons of the MLP Using Singular Value Decomposition and Principal Components Analysis: A Novel Approach José Daniel A Santos IFCE - Industry Department Av Contorno Norte,

More information

Advanced Introduction to Machine Learning CMU-10715

Advanced Introduction to Machine Learning CMU-10715 Advanced Introduction to Machine Learning CMU-10715 Principal Component Analysis Barnabás Póczos Contents Motivation PCA algorithms Applications Some of these slides are taken from Karl Booksh Research

More information

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided

More information

Lecture 24: Principal Component Analysis. Aykut Erdem May 2016 Hacettepe University

Lecture 24: Principal Component Analysis. Aykut Erdem May 2016 Hacettepe University Lecture 4: Principal Component Analysis Aykut Erdem May 016 Hacettepe University This week Motivation PCA algorithms Applications PCA shortcomings Autoencoders Kernel PCA PCA Applications Data Visualization

More information

Introduction to Machine Learning

Introduction to Machine Learning 10-701 Introduction to Machine Learning PCA Slides based on 18-661 Fall 2018 PCA Raw data can be Complex, High-dimensional To understand a phenomenon we measure various related quantities If we knew what

More information

Principal Component Analysis

Principal Component Analysis B: Chapter 1 HTF: Chapter 1.5 Principal Component Analysis Barnabás Póczos University of Alberta Nov, 009 Contents Motivation PCA algorithms Applications Face recognition Facial expression recognition

More information

POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH

POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH Abstract POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH A.H.M.A.Rahim S.K.Chakravarthy Department of Electrical Engineering K.F. University of Petroleum and Minerals Dhahran. Dynamic

More information

Invariant Scattering Convolution Networks

Invariant Scattering Convolution Networks Invariant Scattering Convolution Networks Joan Bruna and Stephane Mallat Submitted to PAMI, Feb. 2012 Presented by Bo Chen Other important related papers: [1] S. Mallat, A Theory for Multiresolution Signal

More information

International Journal of Emerging Technologies in Computational and Applied Sciences (IJETCAS)

International Journal of Emerging Technologies in Computational and Applied Sciences (IJETCAS) International Association of Scientific Innovation and Research (IASIR) (An Association Unifying the Sciences, Engineering, and Applied Research) International Journal of Emerging Technologies in Computational

More information

COMP 551 Applied Machine Learning Lecture 13: Dimension reduction and feature selection

COMP 551 Applied Machine Learning Lecture 13: Dimension reduction and feature selection COMP 551 Applied Machine Learning Lecture 13: Dimension reduction and feature selection Instructor: Herke van Hoof (herke.vanhoof@cs.mcgill.ca) Based on slides by:, Jackie Chi Kit Cheung Class web page:

More information

CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS

CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS 46 CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS 3.1 INTRODUCTION Cardiac beat classification is a key process in the detection of myocardial ischemic episodes

More information

ECE521 week 3: 23/26 January 2017

ECE521 week 3: 23/26 January 2017 ECE521 week 3: 23/26 January 2017 Outline Probabilistic interpretation of linear regression - Maximum likelihood estimation (MLE) - Maximum a posteriori (MAP) estimation Bias-variance trade-off Linear

More information

Michael Lee Spring 2015 PHYS570: Introduction to Synchrotron Radiation

Michael Lee Spring 2015 PHYS570: Introduction to Synchrotron Radiation Synchrotron Radiation Micro-CT at the Micrometer Scale for the Analysis of the Three- Dimensional Morphology of Microcracks in Human Larrue A, Rattner A, Trabecular Peter Z-A, Olivier C, Laroche Bone N,

More information

Design Collocation Neural Network to Solve Singular Perturbed Problems with Initial Conditions

Design Collocation Neural Network to Solve Singular Perturbed Problems with Initial Conditions Article International Journal of Modern Engineering Sciences, 204, 3(): 29-38 International Journal of Modern Engineering Sciences Journal homepage:www.modernscientificpress.com/journals/ijmes.aspx ISSN:

More information

Dimensionality Reduction for Exponential Family Data

Dimensionality Reduction for Exponential Family Data Dimensionality Reduction for Exponential Family Data Yoonkyung Lee* Department of Statistics The Ohio State University *joint work with Andrew Landgraf July 2-6, 2018 Computational Strategies for Large-Scale

More information

Stochastic Assessment of Bone Fragility in Human Lumbar Spine

Stochastic Assessment of Bone Fragility in Human Lumbar Spine University of Texas at Tyler Scholar Works at UT Tyler Electrical Engineering Theses Electrical Engineering Spring 3-3-015 Stochastic Assessment of Bone Fragility in Human Lumbar Spine Rajeshwar Rao Pinninti

More information

Wavelets and Multiresolution Processing

Wavelets and Multiresolution Processing Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,

More information

A domain-knowledge-inspired mathematical framework for the description and classification of H&E stained histopathology images

A domain-knowledge-inspired mathematical framework for the description and classification of H&E stained histopathology images A domain-knowledge-inspired mathematical framework for the description and classification of H&E stained histopathology images Melody L. Massar a, Ramamurthy Bhagavatula b, John A. Ozolek c, Carlos A.

More information

Principal Components Analysis (PCA)

Principal Components Analysis (PCA) Principal Components Analysis (PCA) Principal Components Analysis (PCA) a technique for finding patterns in data of high dimension Outline:. Eigenvectors and eigenvalues. PCA: a) Getting the data b) Centering

More information

Group Sequential Tests for Delayed Responses. Christopher Jennison. Lisa Hampson. Workshop on Special Topics on Sequential Methodology

Group Sequential Tests for Delayed Responses. Christopher Jennison. Lisa Hampson. Workshop on Special Topics on Sequential Methodology Group Sequential Tests for Delayed Responses Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj Lisa Hampson Department of Mathematics and Statistics,

More information

MEG Source Localization Using an MLP With Distributed Output Representation

MEG Source Localization Using an MLP With Distributed Output Representation MEG Source Localization Using an MLP With Distributed Output Representation Sung Chan Jun, Barak A. Pearlmutter, Guido Nolte CBLL Meeting October 5, 2005 Source localization Definition: Identification

More information

A Hybrid Time-delay Prediction Method for Networked Control System

A Hybrid Time-delay Prediction Method for Networked Control System International Journal of Automation and Computing 11(1), February 2014, 19-24 DOI: 10.1007/s11633-014-0761-1 A Hybrid Time-delay Prediction Method for Networked Control System Zhong-Da Tian Xian-Wen Gao

More information

Cheng Soon Ong & Christian Walder. Canberra February June 2018

Cheng Soon Ong & Christian Walder. Canberra February June 2018 Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression

More information

CSC411: Final Review. James Lucas & David Madras. December 3, 2018

CSC411: Final Review. James Lucas & David Madras. December 3, 2018 CSC411: Final Review James Lucas & David Madras December 3, 2018 Agenda 1. A brief overview 2. Some sample questions Basic ML Terminology The final exam will be on the entire course; however, it will be

More information

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino Artificial Neural Networks Data Base and Data Mining Group of Politecnico di Torino Elena Baralis Politecnico di Torino Artificial Neural Networks Inspired to the structure of the human brain Neurons as

More information

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17

Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17 Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into

More information

SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal

SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal Volume-03 Issue-07 July-2018 ISSN: 2455-3085 (Online) www.rrjournals.com [UGC Listed Journal] SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal *1 Kadek Jemmy Waciko & 2 Ismail B *1 Research Scholar,

More information

Artificial Neural Networks Examination, March 2004

Artificial Neural Networks Examination, March 2004 Artificial Neural Networks Examination, March 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

Neural Networks and Ensemble Methods for Classification

Neural Networks and Ensemble Methods for Classification Neural Networks and Ensemble Methods for Classification NEURAL NETWORKS 2 Neural Networks A neural network is a set of connected input/output units (neurons) where each connection has a weight associated

More information

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm Volume 4, Issue 5, May 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Huffman Encoding

More information

Ensembles of Extreme Learning Machine Networks for Value Prediction

Ensembles of Extreme Learning Machine Networks for Value Prediction Ensembles of Extreme Learning Machine Networks for Value Prediction Pablo Escandell-Montero, José M. Martínez-Martínez, Emilio Soria-Olivas, Joan Vila-Francés, José D. Martín-Guerrero IDAL, Intelligent

More information

Online Identification And Control of A PV-Supplied DC Motor Using Universal Learning Networks

Online Identification And Control of A PV-Supplied DC Motor Using Universal Learning Networks Online Identification And Control of A PV-Supplied DC Motor Using Universal Learning Networks Ahmed Hussein * Kotaro Hirasawa ** Jinglu Hu ** * Graduate School of Information Science & Electrical Eng.,

More information

Fatigue in osteoporotic human trabecular bone Comparison between genders

Fatigue in osteoporotic human trabecular bone Comparison between genders loading to the load corresponding to a normalized stress level (Δσ/E 0 ). Fatigue in osteoporotic human trabecular bone Comparison between genders André do Carmo Saraiva Abstract In the present work, the

More information

Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor

Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor Rosani M. L. Penha Centro de Energia Nuclear Instituto de Pesquisas Energéticas e Nucleares - Ipen

More information

Choosing Variables with a Genetic Algorithm for Econometric models based on Neural Networks learning and adaptation.

Choosing Variables with a Genetic Algorithm for Econometric models based on Neural Networks learning and adaptation. Choosing Variables with a Genetic Algorithm for Econometric models based on Neural Networks learning and adaptation. Daniel Ramírez A., Israel Truijillo E. LINDA LAB, Computer Department, UNAM Facultad

More information

Artificial Neural Networks Examination, June 2004

Artificial Neural Networks Examination, June 2004 Artificial Neural Networks Examination, June 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum

More information

The Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification

The Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification he Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification Weijie LI, Yi LIN Postgraduate student in College of Survey and Geo-Informatics, tongji university Email: 1633289@tongji.edu.cn

More information

Artificial Neural Networks Examination, June 2005

Artificial Neural Networks Examination, June 2005 Artificial Neural Networks Examination, June 2005 Instructions There are SIXTY questions. (The pass mark is 30 out of 60). For each question, please select a maximum of ONE of the given answers (either

More information

Dimensionality Reduction

Dimensionality Reduction Lecture 5 1 Outline 1. Overview a) What is? b) Why? 2. Principal Component Analysis (PCA) a) Objectives b) Explaining variability c) SVD 3. Related approaches a) ICA b) Autoencoders 2 Example 1: Sportsball

More information

Transactions on Information and Communications Technologies vol 6, 1994 WIT Press, ISSN

Transactions on Information and Communications Technologies vol 6, 1994 WIT Press,   ISSN Prediction of composite laminate residual strength based on a neural network approach R. Teti & G. Caprino Department of Materials and Production Engineering, University of Naples 'Federico II', Abstract

More information

Research Article A PLS-Based Weighted Artificial Neural Network Approach for Alpha Radioactivity Prediction inside Contaminated Pipes

Research Article A PLS-Based Weighted Artificial Neural Network Approach for Alpha Radioactivity Prediction inside Contaminated Pipes Mathematical Problems in Engineering, Article ID 517605, 5 pages http://dxdoiorg/101155/2014/517605 Research Article A PLS-Based Weighted Artificial Neural Network Approach for Alpha Radioactivity Prediction

More information

Role of Assembling Invariant Moments and SVM in Fingerprint Recognition

Role of Assembling Invariant Moments and SVM in Fingerprint Recognition 56 Role of Assembling Invariant Moments SVM in Fingerprint Recognition 1 Supriya Wable, 2 Chaitali Laulkar 1, 2 Department of Computer Engineering, University of Pune Sinhgad College of Engineering, Pune-411

More information

Trabecular Bone Structure of the Calcaneus: : Comparison of high resolution MR Imaging at 1.5T and 3T using MicroCT as a standard of reference

Trabecular Bone Structure of the Calcaneus: : Comparison of high resolution MR Imaging at 1.5T and 3T using MicroCT as a standard of reference Trabecular Bone Structure of the Calcaneus: : Comparison of high resolution MR Imaging at 1.5T and 3T using MicroCT as a standard of reference Catherine Phan 1 Maiko Matsuura 2 Timothy Dunn Jan Bauer 1

More information

CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning

CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS Learning Neural Networks Classifier Short Presentation INPUT: classification data, i.e. it contains an classification (class) attribute.

More information

A Universal Model for Hidden State Observation in Adaptive Process Controls

A Universal Model for Hidden State Observation in Adaptive Process Controls 245 A Universal Model for Hidden State Observation in Adaptive Process Controls Melanie Senn, Norbert Link Institute of Computational Engineering at IAF Karlsruhe University of Applied Sciences Moltkestrasse

More information

Prediction of gas emission quantity using artificial neural networks

Prediction of gas emission quantity using artificial neural networks Available online www.jocpr.com Journal of Chemical and Pharmaceutical Research, 2014, 6(6):1653-165 Research Article ISSN : 095-384 CODEN(USA) : JCPRC5 Prediction of gas emission quantity using artificial

More information

Course 10. Kernel methods. Classical and deep neural networks.

Course 10. Kernel methods. Classical and deep neural networks. Course 10 Kernel methods. Classical and deep neural networks. Kernel methods in similarity-based learning Following (Ionescu, 2018) The Vector Space Model ò The representation of a set of objects as vectors

More information

Dimensionality Reduction

Dimensionality Reduction Dimensionality Reduction Le Song Machine Learning I CSE 674, Fall 23 Unsupervised learning Learning from raw (unlabeled, unannotated, etc) data, as opposed to supervised data where a classification of

More information

Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters

Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters Kyriaki Kitikidou, Elias Milios, Lazaros Iliadis, and Minas Kaymakis Democritus University of Thrace,

More information

Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture

Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture EE 5359 Multimedia Processing Project Report Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture By An Vo ISTRUCTOR: Dr. K. R. Rao Summer 008 Image Denoising using Uniform

More information

Final Examination CS540-2: Introduction to Artificial Intelligence

Final Examination CS540-2: Introduction to Artificial Intelligence Final Examination CS540-2: Introduction to Artificial Intelligence May 9, 2018 LAST NAME: SOLUTIONS FIRST NAME: Directions 1. This exam contains 33 questions worth a total of 100 points 2. Fill in your

More information

Principal Component Analysis, A Powerful Scoring Technique

Principal Component Analysis, A Powerful Scoring Technique Principal Component Analysis, A Powerful Scoring Technique George C. J. Fernandez, University of Nevada - Reno, Reno NV 89557 ABSTRACT Data mining is a collection of analytical techniques to uncover new

More information

A REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES

A REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES A REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES ABSTRACT: Department of Electronics Engineering, G. H. Raisoni College of Engineering, Nagpur, India Vessel

More information

ABSTRACT INTRODUCTION

ABSTRACT INTRODUCTION ABSTRACT Presented in this paper is an approach to fault diagnosis based on a unifying review of linear Gaussian models. The unifying review draws together different algorithms such as PCA, factor analysis,

More information

Intelligent Handwritten Digit Recognition using Artificial Neural Network

Intelligent Handwritten Digit Recognition using Artificial Neural Network RESEARCH ARTICLE OPEN ACCESS Intelligent Handwritten Digit Recognition using Artificial Neural Networ Saeed AL-Mansoori Applications Development and Analysis Center (ADAC), Mohammed Bin Rashid Space Center

More information

size within a local area. Using the image as a matched lter, a nite number of scales are searched within a local window to nd the wavelet coecients th

size within a local area. Using the image as a matched lter, a nite number of scales are searched within a local window to nd the wavelet coecients th In Proceeding of the 3rd International Workshop on Digital Mammography Chicago, U.S.A. 1996, pp. 447-450 Segmentation of Masses Using Continuous Scale Representations Andrew Laine a, Walter Huda b, Dongwei

More information

PCA and admixture models

PCA and admixture models PCA and admixture models CM226: Machine Learning for Bioinformatics. Fall 2016 Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar, Alkes Price PCA and admixture models 1 / 57 Announcements HW1

More information

CITS 4402 Computer Vision

CITS 4402 Computer Vision CITS 4402 Computer Vision A/Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh Lecture 06 Object Recognition Objectives To understand the concept of image based object recognition To learn how to match images

More information

A METHOD OF FINDING IMAGE SIMILAR PATCHES BASED ON GRADIENT-COVARIANCE SIMILARITY

A METHOD OF FINDING IMAGE SIMILAR PATCHES BASED ON GRADIENT-COVARIANCE SIMILARITY IJAMML 3:1 (015) 69-78 September 015 ISSN: 394-58 Available at http://scientificadvances.co.in DOI: http://dx.doi.org/10.1864/ijamml_710011547 A METHOD OF FINDING IMAGE SIMILAR PATCHES BASED ON GRADIENT-COVARIANCE

More information

2.3. Clustering or vector quantization 57

2.3. Clustering or vector quantization 57 Multivariate Statistics non-negative matrix factorisation and sparse dictionary learning The PCA decomposition is by construction optimal solution to argmin A R n q,h R q p X AH 2 2 under constraint :

More information

Study of Wavelet Functions of Discrete Wavelet Transformation in Image Watermarking

Study of Wavelet Functions of Discrete Wavelet Transformation in Image Watermarking Study of Wavelet Functions of Discrete Wavelet Transformation in Image Watermarking Navdeep Goel 1,a, Gurwinder Singh 2,b 1ECE Section, Yadavindra College of Engineering, Talwandi Sabo 2Research Scholar,

More information

Feature gene selection method based on logistic and correlation information entropy

Feature gene selection method based on logistic and correlation information entropy Bio-Medical Materials and Engineering 26 (2015) S1953 S1959 DOI 10.3233/BME-151498 IOS Press S1953 Feature gene selection method based on logistic and correlation information entropy Jiucheng Xu a,b,,

More information

Product Quality Prediction by a Neural Soft-Sensor Based on MSA and PCA

Product Quality Prediction by a Neural Soft-Sensor Based on MSA and PCA International Journal of Automation and Computing 1 (2006) 17-22 Product Quality Prediction by a Neural Soft-Sensor Based on MSA and PCA Jian Shi, Xing-Gao Liu National Laboratory of Industrial Control

More information

Factor Analysis and Kalman Filtering (11/2/04)

Factor Analysis and Kalman Filtering (11/2/04) CS281A/Stat241A: Statistical Learning Theory Factor Analysis and Kalman Filtering (11/2/04) Lecturer: Michael I. Jordan Scribes: Byung-Gon Chun and Sunghoon Kim 1 Factor Analysis Factor analysis is used

More information

Neural Networks biological neuron artificial neuron 1

Neural Networks biological neuron artificial neuron 1 Neural Networks biological neuron artificial neuron 1 A two-layer neural network Output layer (activation represents classification) Weighted connections Hidden layer ( internal representation ) Input

More information

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova

More information

Multiresolution analysis & wavelets (quick tutorial)

Multiresolution analysis & wavelets (quick tutorial) Multiresolution analysis & wavelets (quick tutorial) Application : image modeling André Jalobeanu Multiresolution analysis Set of closed nested subspaces of j = scale, resolution = 2 -j (dyadic wavelets)

More information

1983. Gearbox fault diagnosis based on local mean decomposition, permutation entropy and extreme learning machine

1983. Gearbox fault diagnosis based on local mean decomposition, permutation entropy and extreme learning machine 1983. Gearbox fault diagnosis based on local mean decomposition, permutation entropy and extreme learning machine Yu Wei 1, Minqiang Xu 2, Yongbo Li 3, Wenhu Huang 4 Department of Astronautical Science

More information

The Fault extent recognition method of rolling bearing based on orthogonal matching pursuit and Lempel-Ziv complexity

The Fault extent recognition method of rolling bearing based on orthogonal matching pursuit and Lempel-Ziv complexity The Fault extent recognition method of rolling bearing based on orthogonal matching pursuit and Lempel-Ziv complexity Pengfei Dang 1,2 *, Yufei Guo 2,3, Hongjun Ren 2,4 1 School of Mechanical Engineering,

More information

STA 414/2104: Lecture 8

STA 414/2104: Lecture 8 STA 414/2104: Lecture 8 6-7 March 2017: Continuous Latent Variable Models, Neural networks With thanks to Russ Salakhutdinov, Jimmy Ba and others Outline Continuous latent variable models Background PCA

More information

On a General Two-Sample Test with New Critical Value for Multivariate Feature Selection in Chest X-Ray Image Analysis Problem

On a General Two-Sample Test with New Critical Value for Multivariate Feature Selection in Chest X-Ray Image Analysis Problem Applied Mathematical Sciences, Vol. 9, 2015, no. 147, 7317-7325 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.510687 On a General Two-Sample Test with New Critical Value for Multivariate

More information

Comparing Robustness of Pairwise and Multiclass Neural-Network Systems for Face Recognition

Comparing Robustness of Pairwise and Multiclass Neural-Network Systems for Face Recognition Comparing Robustness of Pairwise and Multiclass Neural-Network Systems for Face Recognition J. Uglov, V. Schetinin, C. Maple Computing and Information System Department, University of Bedfordshire, Luton,

More information

PCA and LDA. Man-Wai MAK

PCA and LDA. Man-Wai MAK PCA and LDA Man-Wai MAK Dept. of Electronic and Information Engineering, The Hong Kong Polytechnic University enmwmak@polyu.edu.hk http://www.eie.polyu.edu.hk/ mwmak References: S.J.D. Prince,Computer

More information

Diagnostic the Heart Valve Diseases using Eigen Vectors

Diagnostic the Heart Valve Diseases using Eigen Vectors Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IMPACT FACTOR: 5.258 IJCSMC,

More information

SHIFT INVARIENT AND EIGEN FEATURE BASED IMAGE FUSION

SHIFT INVARIENT AND EIGEN FEATURE BASED IMAGE FUSION SHIFT INVARIENT AND EIGEN FEATURE BASED IMAGE FUSION S.B.G.Tilak Babu 1, V.Satyanarayana 1 and Ch.Srinivasarao 2 1 Dept. of ECE,AEC, Surampalem,Kakinada, India 2 Dept. of ECE,JNTUK, UCEV,Vizianagaram,

More information

Using a Hopfield Network: A Nuts and Bolts Approach

Using a Hopfield Network: A Nuts and Bolts Approach Using a Hopfield Network: A Nuts and Bolts Approach November 4, 2013 Gershon Wolfe, Ph.D. Hopfield Model as Applied to Classification Hopfield network Training the network Updating nodes Sequencing of

More information

Robust Controller Design for Speed Control of an Indirect Field Oriented Induction Machine Drive

Robust Controller Design for Speed Control of an Indirect Field Oriented Induction Machine Drive Leonardo Electronic Journal of Practices and Technologies ISSN 1583-1078 Issue 6, January-June 2005 p. 1-16 Robust Controller Design for Speed Control of an Indirect Field Oriented Induction Machine Drive

More information

Holdout and Cross-Validation Methods Overfitting Avoidance

Holdout and Cross-Validation Methods Overfitting Avoidance Holdout and Cross-Validation Methods Overfitting Avoidance Decision Trees Reduce error pruning Cost-complexity pruning Neural Networks Early stopping Adjusting Regularizers via Cross-Validation Nearest

More information

The weighted spectral distribution; A graph metric with applications. Dr. Damien Fay. SRG group, Computer Lab, University of Cambridge.

The weighted spectral distribution; A graph metric with applications. Dr. Damien Fay. SRG group, Computer Lab, University of Cambridge. The weighted spectral distribution; A graph metric with applications. Dr. Damien Fay. SRG group, Computer Lab, University of Cambridge. A graph metric: motivation. Graph theory statistical modelling Data

More information

Research Statement on Statistics Jun Zhang

Research Statement on Statistics Jun Zhang Research Statement on Statistics Jun Zhang (junzhang@galton.uchicago.edu) My interest on statistics generally includes machine learning and statistical genetics. My recent work focus on detection and interpretation

More information

Wavelet Decomposition in Laplacian Pyramid for Image Fusion

Wavelet Decomposition in Laplacian Pyramid for Image Fusion International Journal of Signal Processing Systems Vol. 4, No., February 06 Wavelet Decomposition in Laplacian Pyramid for Image Fusion I. S. Wahyuni Laboratory Lei, University of Burgundy, Dijon, France

More information

Invariant Pattern Recognition using Dual-tree Complex Wavelets and Fourier Features

Invariant Pattern Recognition using Dual-tree Complex Wavelets and Fourier Features Invariant Pattern Recognition using Dual-tree Complex Wavelets and Fourier Features G. Y. Chen and B. Kégl Department of Computer Science and Operations Research, University of Montreal, CP 6128 succ.

More information

EE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015

EE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015 EE613 Machine Learning for Engineers Kernel methods Support Vector Machines jean-marc odobez 2015 overview Kernel methods introductions and main elements defining kernels Kernelization of k-nn, K-Means,

More information

Linear Least-Squares Based Methods for Neural Networks Learning

Linear Least-Squares Based Methods for Neural Networks Learning Linear Least-Squares Based Methods for Neural Networks Learning Oscar Fontenla-Romero 1, Deniz Erdogmus 2, JC Principe 2, Amparo Alonso-Betanzos 1, and Enrique Castillo 3 1 Laboratory for Research and

More information

Machine Learning: Basis and Wavelet 김화평 (CSE ) Medical Image computing lab 서진근교수연구실 Haar DWT in 2 levels

Machine Learning: Basis and Wavelet 김화평 (CSE ) Medical Image computing lab 서진근교수연구실 Haar DWT in 2 levels Machine Learning: Basis and Wavelet 32 157 146 204 + + + + + - + - 김화평 (CSE ) Medical Image computing lab 서진근교수연구실 7 22 38 191 17 83 188 211 71 167 194 207 135 46 40-17 18 42 20 44 31 7 13-32 + + - - +

More information

Nonlinearity Error Compensation of Venturi Flow Meter using Evolutionary Optimization Algorithms

Nonlinearity Error Compensation of Venturi Flow Meter using Evolutionary Optimization Algorithms IJIRST International Journal for Innovative Research in Science & Technology Volume 3 Issue 07 December 2016 ISSN (online): 2349-6010 Nonlinearity Error Compensation of Venturi Flow Meter using Evolutionary

More information

Evaluation on mechanical properties of a single trabecular in bovine femur

Evaluation on mechanical properties of a single trabecular in bovine femur High Performance Structure and Materials VI 65 Evaluation on mechanical properties of a single trabecular in bovine femur S. Enoki 1, M. Higashiura 2, M. Sato 2, K. Tanaka 2 & T. Katayama 2 1 Department

More information