Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform
|
|
- Phillip Roberts
- 6 years ago
- Views:
Transcription
1 AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES ISSN: EISSN: Journal home page: Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform T. Christy Bobby Department of Electronics and Communication Engineering,East Point College of Engineering and Technology, Bangalore, , India Address For Correspondence: T.Christy Bobby, Department of Electronics and Communication Engineering, East Point College of Engineering and Technology, Bangalore ; A R T I C L E I N F O Article history: Received 12 January 2016 Accepted 22 February 2016 Available online 1 March 2016 Keywords: Trabecular bone, Human femur, Contourlet, ELM, E-ELM. A B S T R A C T Background: Human femur trabecular bone is a dynamic and highly vascularised tissue which is able to repair and regenerate continuously throughout the life time of an individual. The sub-regions of the trabecular bone are structurally different and heterogeneous in nature. They have different bone strengths as they are subjected to different loading conditions. The variations in trabecular bone density and structure are directly related to bone strength. Thus in addition to bone mineral density, trabecular microarchitecture is considered as an important determinant of bone strength. In radiographic images the trabecular microarchitecture is projected as curves and straight lines oriented at various directions. In this work, femur trabecular microarchitecture variations in two strength regions such as compressive and tensile regions, delineated from the radiographic images of normal and abnormal subjects, are analyzed using multidirectional and multiscale contourlet transform. The contourlet coefficients are derived based on each scale and orientation for trabecular images. The mean and energy of the derived contourlet coefficients associated with each subband are computed. These values are used as the texture feature vector elements to evaluate changes taking place in the trabecular architecture. To automate the analysis, three most significant feature vectors are found using principal component analysis and these values are used as an input to the Evolutionary Extreme Learning Machine (E-ELM) classifier. The results show that it is possible to differentiate normal and abnormal femur trabecular images using contourlet features. Also the architectural variations are more in the tensile region when compared to compressive region. Thus E-ELM classifier performs better in terms of accuracy (98%) for the chosen parameters form tensile region when compared to compressive. INTRODUCTION Femoral fracture due to osteoporosis is a common disease in women and its incidence increases with age. These fractures are a major cause of morbidity and disability in postmenopausal women. Thus, predicting the strength of the bone is an important goal of current research for the diagnosis of osteoporosis. Bone strength is a term used to describe the ability of bone to resist fracture (Valero et al., 2010, Kastner et al., 2011). In clinical medicine Bone Mineral Density (BMD) is used as an indicator of bone strength. Recently, it has been speculated that the bone strength depends on both BMD and (Jaclynn and Steven, 2009) ( Malhotra and Mithal, 2008) trabecular bone architecture, which occupies a place of importance in the prediction of osteoporosis fractures. Hence, evaluation of BMD as well as architectural changes of femur bone is considered to be necessary in the automated diagnosis of osteoporosis (Lespessailles et al., 2006) (Donnelly, 2011). The trabecular structure of the femur bone are divided into principal compressive, secondary compressive, greater trochanter, principal tensile and secondary tensile groups. These sub-regions are structurally different as they are subjected to Open Access Journal Published BY AENSI Publication 2016 AENSI Publisher All rights reserved This work is licensed under the Creative Commons Attribution International License (CC BY). To Cite This Article: T. Christy Bobby., Sub Region Analysis of Human Femur Trabecular Bone Strength Using Radiographic Images and Multidirectional Multiscale Transform. Aust. J. Basic & Appl. Sci., 10(5): 46-53, 2016
2 47 T. Christy Bobby, 2016 different loading conditions. Also the trabecular pattern change occurring in these sub-regions classifies the bones as normal, osteoporotic and severely osteoporotic bones. In the conventional planar radiographic images, these changes are clearly visible. (Singh et al., 1970) Imaging techniques such as micro-computed tomography and high resolution magnetic resonance imaging, produce three-dimensional (3D) images of trabecular bone, but their usage may be limited by their cost and availability. Digital radiography is a commonly available imaging modality that has the ability to reflect trabecular microarchitecture information that is available in three dimensional images. Thus, there has been considerable interest in using digital radiography combined with texture analysis techniques for assessing trabecular structure (Podsiadlo et al., 2008) (Corroller et al., 2012). The texture features are mainly derived using spatial and spectral methods. Spectral methods have an advantage of being insensitive to noise. Therefore, transforms have been widely used to characterize image textures. Wavelet transforms are very effective in representing images with point singularities. But most of the medical images and trabecular bone images often contain both curves and straight lines oriented at various directions (Ascenzi et al., 2011). Hence multiscale transform called contourlet transform, which can capture the curve and line discontinuity present in the images is used for feature extraction (Do and Vetterli, 2005) (Moayedi et al., 2010). Principal Component Analysis (PCA) is a standard feature selection tool in data analysis. It identifies patterns in data, and to highlight their similarities and differences. In the analysis of multivariate datasets, PCA is used to select the most significant parameters and the parameters are ranked based on their highest magnitudes in the principal components obtained. It has been widely employed in various signal and image processing problems (Samonwoy et al., 2008). Identification of tools for automated classification of medical images is an important step towards clinical decision making. Artificial Neural Networks (ANN) has seen a rapid growth and it has been applied widely in many biomedical applications. The Extreme Learning Machine (ELM) is a neural network algorithm for Singlehidden Layer feed Forward Neural network (SLFN) (Rong et al., 2008). However, ELM uses higher number of hidden neurons due to the random determination of the input weights and hidden biases (Liu and Wang, 2010). To remove redundancy among hidden nodes and to achieve satisfactory performance, a hybrid approach called E-ELM has been proposed by taking advantages of both ELM and Differential Evolution (DE) with more compact networks (Qin-Yu et al., 2005). In this work, radiographic human femur bone images are processed using image processing techniques and the strength regions such as compressive and tensile are delineated from the processed images. The mean feature vectors are calculated from the contourlet coefficients of different sub-bands for the delineated regions of interest. From the derived feature vectors, three most significant feature vectors are chosen using PCA and are used as inputs to the classifier. E-ELM classifier is employed for the classification of normal and abnormal femur bone images. The performances of the classifier are estimated and compared for the two strength regions. Methods: Digitized femur bone images (N = 50) recorded using Genius 100 X-ray generator unit are used for the analysis. The exposures are made with 100 ma at 75 kvp, exposure time is 0.14 s and distance is 100 cm. The standard anterio - posterior view is used to image all subjects and the recorded radiographs are digitized using FCR Prima (CR-IR 391RU) equipment. The acquired digital pelvis images are of size (2140 x 1760 pixels). Despite taken from the same location, the image quality of the radiographs vary. To achieve better image quality, the radiographs are enhanced by subjecting to adaptive histogram equalization (Elisabeta, 2011). From the enhanced bone pelvis image, left femur image of size (650 x 650 pixels) is cropped and considered for the analysis. Regions of Interest (ROI) of radiographic images, compressive region of size (120 x 80 pixels) and tensile region of size (250 x 80 pixels) are delineated, and considered for the analysis. These regions are heterogeneous in nature, have varying bone strength and change most markedly in appearance with bone loss. Compressive and tensile regions are structurally different regions where more mineral loss and architectural variations occurs due different loading conditions and stress distribution (Singh et al., 1970). The two stages of contourlet transform are subband decomposition and the directional transform. At the first stage Laplacian pyramid (LP) decomposes an image into a number of radial subband, and in the second stage directional filter banks (DFB) decompose LP details into a number of directional subband. The LP decomposition at each step generates a sampled low pass version of the original image and the difference between the original and the prediction image, resulting in a band pass image. The band pass images can be fed into a DFB so that directional information can be captured. The scheme can be iterated repeatedly on the coarse image. The end result is decomposition into directional subband at multiple scales. The image is decomposed into four pyramidal levels, resulting in 16 directional sub-bands. Contourlet mean and energy feature vectors are derived for directional sub-bands and are examined (Moayedi et al., 2010). The Principal Component Analysis is performed on the derived feature vectors to select first three significant feature vectors. PCA describe the dominant patterns and the main trends in the data. This is done through an eigenvector decomposition of the covariance matrix of the
3 48 T. Christy Bobby, 2016 original variables. The extracted latent variables are orthogonal and are sorted according to their eigenvalues. The high dimensional space described by matrix X is modeled using PCA as T X = TP + E (1) where T is the score matrix composed by the principal components, P is the loadings composed by the eigenvectors of the covariance matrix and E is the residual matrix (Samonwoy et al., 2008). The first three most significant parameters derived using PCA are used as an input to the E-ELM classifiers. EELM using Differential evolution (DE) and Moore Penrose (MP) generalized inverse parameters are used to classify the normal and abnormal bone images. In E-ELM the population is randomly generated. The population is composed of a set of input weights and hidden biases. θ = w11, w12,..., w1 k, w21, w22,... w2 k,..., wn 1, wn 2,... wnk,... b1, b2,..., bk (2) All w ij and b j are randomly initialized within the range of [ 1, 1]. For each individual the corresponding output weights are analytically computed by using the MP generalized inverse. The fitness of each individual is evaluated using cost function (E) and Root Mean Squared Error (RMSE). E N K 2 β (. ) 1 1 i g W j i i X j bi t = + = j 2 = m N (3) After the fitness, all individuals in the population are calculated using DE mutation, crossover and selection. During selection, the mutated vectors are compared with the original vectors, and the vectors with better fitness values are retained to the next generation. Further, to improve the generalization performance, one more criteria is added into the selection, the norm of output weights β. In this selection strategy, if the difference of the fitness between different individuals is small, smaller β is selected. The determination of new θ, population i G+ 1, is obtained from θ, i G+ 1 µ i, G if f ( θ i, G ) f ( µ i, G ) > ε f ( θi, G ), µ i, G if f ( θ i, G ) f ( µ i, G ) > ε f ( θi, G ) < ε f ( θi, G ) and = µ i, G θ i, G β < β, θi, G else, (4) Where, f ( ) is the fitness function and ε is a preset tolerance rate. Once the new population is generated, the DE process is repeated until the goal is met or when a preset maximum learning epochs is completed (Liu and Wang, 2010). The accuracy of classification models with different type of activation functions such as sigmoidal, sine, hardlim, triangular basis and radial basis functions for varying number of epochs from 10 to100 is estimated and analyzed. Accuracy is ratio of addition of True Positives (TP) and True Negatives (TN) to total number. The TP and TN are the cases where the abnormal is classified as abnormal and normal classified as normal, respectively. RESULTS AND DISCUSSION Typical pre-processed radiographic images of normal and abnormal femur trabecular bones are shown in Figures 1 and respectively. The trabecular patterns are found to be closely arranged in normal images, whereas the trabecular spacing is seen with discontinuities in abnormal cases. The overlap between trabeculae is also found to be less in abnormal images.
4 49 T. Christy Bobby, 2016 Fig. 1: Typical normal abnormal Analysis of Compressive Region using Contourlet Transform: Figure 2 shows the average mean values for compressive region of normal and abnormal images derived at different orientations and scales using contourlet transform co-efficient. In all orientations and scales, the mean values are slightly high for normal images. Figure 2 shows the average energy values for compressive region of normal and abnormal images derived at different orientations and scales using contourlet transform. It shows a discernible difference between normal and abnormal images at all orientations. In normal images, the energy values are high for orientations 3 to 16. These energy values are found to be high for lower and higher orientations of abnormal images. Figures 3, and (c) shows the scattergrams of normalized mean values of compressive region of the individual images for the first three significant orientations(mean1, mean2, mean3) respectively. It is observed that significant variations are not observed between normal and abnormal images. The mean of few abnormal images are found to fall in the same range for all three significant orientations. Hence this feature could be useful in distinguishing a few abnormal images. Average mean (compressive) Average energy (compressive) Orientation Orientation Fig. 2: Average mean and energy values for compressive region of normal and abnormal images at different Orientations. The energy values of the first three significant orientations (energy1, energy2, energy3), obtained for the compressive region of normal and abnormal images are shown in Figure 4, and (c). It is seen that the energy values show better differentiation between normal and abnormal images when compared to the mean feature. Further, the energy1 and energy3 show clear demarcation between normal and abnormal images. This shows that contourlet is able to extract trabecular changes that occur in the compressive region.
5 50 T. Christy Bobby, Mean1 (compressive) Mean2 (compressive) Mean3 (compressive) (c) Fig. 3: Scattergram of mean values of first second and (c) third significant orientations compressive region Analysis of Tensile Region using Contourlet Transform: Figure 5 shows the average values of mean for the tensile regions of normal and abnormal images derived at different orientations and scales using contourlet transform. This feature is found to have distinct separation between normal and abnormal images at all orientations. Also, the mean values are found to be high in all orientations and scales for normal images and low for abnormal images with varying magnitudes. Also in some orientations, the magnitude of the average mean value is very high. This explains the varying anisotropic nature of trabecular architecture and also demonstrates that the homogeneity of the trabecular structure is orientation dependent. Figure 5 shows the average values of energy in the tensile region for different orientations. It is noticed that in the lower and higher scale the energy values are found to be high for normal images whereas they have lower magnitude in other orientations. This again proves the fact that trabecular variation is orientation dependent.
6 51 T. Christy Bobby, 2016 Energy 1 (compressive) Energy2 (compressive) Energy3 (compressive) (c) Fig. 4: Scattergram of energy values first second and (c) third significant orientations in compressive region Average mean (tensile) Average energy (tensile) Orientation Orientation Fig. 5: Average mean and energy values for tensile region of normal and abnormal images at different orientations The scattergrams of the mean values in tensile region for first three significant orientations (first, second and third) are shown in Figure 6, and (c) respectively. Mean values of all the three significant orientations are found to show better demarcation between normal and abnormal images. This shows that trabecular
7 52 T. Christy Bobby, 2016 alteration is present in different degree for all the orientations in tensile region of the abnormal region. The scattergram of energy values of the tensile region of normal and abnormal images for first three significant orientations are shown in Figure 7, and (c) respectively. Energy values of all the three orientations are found to show better demarcation between normal and abnormal images. This also exhibits that trabecular alteration is present with different magnitude for the orientations of tensile region of the abnormal image. When compared to compressive region, tensile region shows better demarcation between normal and abnormal images in all the three orientations. Mean1 (tensile) Mean2 (tensile) Mean3 (tensile) Image Number (c) Fig. 6: Scattergram of mean values first second and (c) third significant orientations in tensile region Energy1 (tensile) Energy2 (tensile) Energy3 (tensile) (c) Fig. 7: Scattergram of energy values of first second and (c) third significant orientations in tensile region Accuracy (%) Compressive region (sigmoidal) Tensile region (sigmoidal) Number of epochs Fig. 8: Classification using EELM compressive and tensile region Figure 8 shows the classification accuracy of the EELM classifier for sigmoidal function for varying epochs. It is observed from the EELM results that the accuracy of the sigmoidal activation function increases steadily and above 70 epochs it reaches a maximum of 93% for compressive and 98% for tensile regions. It then gets saturated beyond 70 epochs and it is also seen that in EELM all the activation functions behave similarly in
8 53 T. Christy Bobby, 2016 achieving the accuracy in classification at higher epochs. EELM uses less number of epochs for classification in tensile region compared to compressive region. This is due to distinct separation between normal and abnormal images exhibited by features derived from tensile region. Hence the accuracy of classifiers for tensile region is high when compared with compressive region. Also EELM has high accuracy and is found to be the optimal classifier in distinguishing normal and abnormal human femur bone images using features obtained from analysis. Conclusions: Analyses of medical images using transform based methods are shown to be effective for various clinical inferences. Especially, they are used to extract variations manifested in images in the form of discontinuities and irregular patterns. In this work, contourlet transform is employed to analyze regional strength variations in trabecular bone structure using radiographic femur images. The results reveal that it is possible to differentiate normal and abnormal images using contourlet transform features derived from tensile and compressive regions. The architectural variations are more in the tensile when compared to compressive trabecular region. The observed changes are attributed to varying degree of trabecular bone loss, homogeneity and discontinuity. Thus it appears that contourlet transform based feature extraction together with EELM classification seems to be useful for regional strength and trabecular architectural analysis. REFERENCES Ascenzi, M.G., N. Hetzer and A. Lomovtsev et al., 2011.Variation of trabecular architecture in proximal femur of postmenopausal women. J.Biomech, 44: Corroller, T.L., J. Halgrin and M. Pithioux, Combination of texture analysis and bone mineral density improves the prediction of fracture load in human femurs. Osteoporosis Int, 23: Do, M.N and M. Vetterli, The contourlet transform: an efficient directional multiresolution image representation. IEEE T. Image Process, 14(12): Donnelly, E., Methods for assessing bone quality: A review. Clin. Orthop. Relat. Res, 469: Elisabeta, E.H., Adaptive histogram equalization in GIS. Annals of the University of Craiova,Mathematics and Computer Science Series, 38(1): Jaclynn, M.K and A.G. Steven, Trabecular bone mechanical properties in patients with fragility fractures. Clinical Orthopaedics and Related Research, 467: Kastner, M., A. Sawka and K. Thorpe et al, Evaluation of a clinical decision support tool for osteoporosis disease management: protocol for an interrupted time series design. Implement Sci [Online], 6: 77, Available: Lespessailles., E.C., Chappard and N. Bonnet, Imaging techniques for evaluating bone microarchitecture. Joint Bone Spine, 73(3): Liu, N and H. Wang, Ensemble based extreme learning machine, IEEE Signal Proc.Let, 17(8): Malhotra, N and A. Mithal, Osteoporosis in Indians Indian. J.Med.Res, 127: Moayedi, F., Z. Azimifar, R. Boostani and S. Katebi, Contourlet-based mammography mass classification using the SVM family. Computers in Biology and Medicine, 40: Podsiadlo, P., L. Dahl, M. Englund, L.S. Lohmander and G.W. Stachowiak., Differences in trabecular bone texture between knees with and without radiographic osteoarthritis detected by fractal methods. Osteoarthr. Cartilage, 16: Qin-Yu, Z., A. K. Qin, P.N. Suganthan and H. Guang-Bin, Evolutionary extreme learning machine. Pattern Recogn, 38: Rong, H.J., H. Guang-Bin and O. Yew-Soon, Extreme learning machine for multi-categories classification applications. In Proc. of IEEE International Joint Conference on Neural Networks, Hong Kong, pp: Samonwoy, G.D., H. Adeli and N. Dadmehr, Principal component analysis-enhanced cosine radial basis function neural network for robust epilepsy and seizure detection. IEEE T. Biomed. Eng, 55(2): Singh, M., A.R. Nagarath and P.S. Maini, Changes in trabecular pattern of the upper end of the femur as an index of osteoporosis. J. Bone Joint Surg. Am, 52: Valero, M., J.C.F. Garcia and J.C. Catala, Implant treatment in patients with osteoporosis. Medicina Oral Patologia Oral Cirugia Bucal, 1:
Bearing fault diagnosis based on EMD-KPCA and ELM
Bearing fault diagnosis based on EMD-KPCA and ELM Zihan Chen, Hang Yuan 2 School of Reliability and Systems Engineering, Beihang University, Beijing 9, China Science and Technology on Reliability & Environmental
More informationARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC ALGORITHM FOR NONLINEAR MIMO MODEL OF MACHINING PROCESSES
International Journal of Innovative Computing, Information and Control ICIC International c 2013 ISSN 1349-4198 Volume 9, Number 4, April 2013 pp. 1455 1475 ARTIFICIAL NEURAL NETWORK WITH HYBRID TAGUCHI-GENETIC
More informationFEEDBACK GMDH-TYPE NEURAL NETWORK AND ITS APPLICATION TO MEDICAL IMAGE ANALYSIS OF LIVER CANCER. Tadashi Kondo and Junji Ueno
International Journal of Innovative Computing, Information and Control ICIC International c 2012 ISSN 1349-4198 Volume 8, Number 3(B), March 2012 pp. 2285 2300 FEEDBACK GMDH-TYPE NEURAL NETWORK AND ITS
More informationComparison of two interpolation methods for empirical mode decomposition based evaluation of radiographic femur bone images
Acta of Bioengineering and Biomechanics Vol. 15, No. 2, 2013 Original paper DOI: 10.5277/abb130208 Comparison of two interpolation methods for empirical mode decomposition based evaluation of radiographic
More informationMyoelectrical signal classification based on S transform and two-directional 2DPCA
Myoelectrical signal classification based on S transform and two-directional 2DPCA Hong-Bo Xie1 * and Hui Liu2 1 ARC Centre of Excellence for Mathematical and Statistical Frontiers Queensland University
More informationA Novel Activity Detection Method
A Novel Activity Detection Method Gismy George P.G. Student, Department of ECE, Ilahia College of,muvattupuzha, Kerala, India ABSTRACT: This paper presents an approach for activity state recognition of
More informationElectric Load Forecasting Using Wavelet Transform and Extreme Learning Machine
Electric Load Forecasting Using Wavelet Transform and Extreme Learning Machine Song Li 1, Peng Wang 1 and Lalit Goel 1 1 School of Electrical and Electronic Engineering Nanyang Technological University
More informationMachine learning for pervasive systems Classification in high-dimensional spaces
Machine learning for pervasive systems Classification in high-dimensional spaces Department of Communications and Networking Aalto University, School of Electrical Engineering stephan.sigg@aalto.fi Version
More informationPredicting Primary Implant Stability Using the Trabecular Bone Score
Predicting Primary Implant Stability Using the Trabecular Bone Score DAVID LONG, DDS LSU SCHOOL OF DENTISTRY DEPARTMENT OF PERIODONTICS What is is? The biomechanical phenomenon of mechanical stability
More informationIntroduction to Machine Learning. PCA and Spectral Clustering. Introduction to Machine Learning, Slides: Eran Halperin
1 Introduction to Machine Learning PCA and Spectral Clustering Introduction to Machine Learning, 2013-14 Slides: Eran Halperin Singular Value Decomposition (SVD) The singular value decomposition (SVD)
More informationThe recognition of substantia nigra in brain stem ultrasound images based on Principal Component Analysis
The recognition of substantia nigra in brain stem ultrasound images based on Principal Component Analysis Jiří Blahuta, Tomáš Soukup and Petr Čermák Abstract. This paper assays the recognition of substantia
More informationFuzzy quantization of Bandlet coefficients for image compression
Available online at www.pelagiaresearchlibrary.com Advances in Applied Science Research, 2013, 4(2):140-146 Fuzzy quantization of Bandlet coefficients for image compression R. Rajeswari and R. Rajesh ISSN:
More informationDistributed Genetic Algorithm for feature selection in Gaia RVS spectra. Application to ANN parameterization
Distributed Genetic Algorithm for feature selection in Gaia RVS spectra. Application to ANN parameterization Diego Fustes, Diego Ordóñez, Carlos Dafonte, Minia Manteiga and Bernardino Arcay Abstract This
More informationEstimating the Number of Hidden Neurons of the MLP Using Singular Value Decomposition and Principal Components Analysis: A Novel Approach
Estimating the Number of Hidden Neurons of the MLP Using Singular Value Decomposition and Principal Components Analysis: A Novel Approach José Daniel A Santos IFCE - Industry Department Av Contorno Norte,
More informationAdvanced Introduction to Machine Learning CMU-10715
Advanced Introduction to Machine Learning CMU-10715 Principal Component Analysis Barnabás Póczos Contents Motivation PCA algorithms Applications Some of these slides are taken from Karl Booksh Research
More informationARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD
ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD WHAT IS A NEURAL NETWORK? The simplest definition of a neural network, more properly referred to as an 'artificial' neural network (ANN), is provided
More informationLecture 24: Principal Component Analysis. Aykut Erdem May 2016 Hacettepe University
Lecture 4: Principal Component Analysis Aykut Erdem May 016 Hacettepe University This week Motivation PCA algorithms Applications PCA shortcomings Autoencoders Kernel PCA PCA Applications Data Visualization
More informationIntroduction to Machine Learning
10-701 Introduction to Machine Learning PCA Slides based on 18-661 Fall 2018 PCA Raw data can be Complex, High-dimensional To understand a phenomenon we measure various related quantities If we knew what
More informationPrincipal Component Analysis
B: Chapter 1 HTF: Chapter 1.5 Principal Component Analysis Barnabás Póczos University of Alberta Nov, 009 Contents Motivation PCA algorithms Applications Face recognition Facial expression recognition
More informationPOWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH
Abstract POWER SYSTEM DYNAMIC SECURITY ASSESSMENT CLASSICAL TO MODERN APPROACH A.H.M.A.Rahim S.K.Chakravarthy Department of Electrical Engineering K.F. University of Petroleum and Minerals Dhahran. Dynamic
More informationInvariant Scattering Convolution Networks
Invariant Scattering Convolution Networks Joan Bruna and Stephane Mallat Submitted to PAMI, Feb. 2012 Presented by Bo Chen Other important related papers: [1] S. Mallat, A Theory for Multiresolution Signal
More informationInternational Journal of Emerging Technologies in Computational and Applied Sciences (IJETCAS)
International Association of Scientific Innovation and Research (IASIR) (An Association Unifying the Sciences, Engineering, and Applied Research) International Journal of Emerging Technologies in Computational
More informationCOMP 551 Applied Machine Learning Lecture 13: Dimension reduction and feature selection
COMP 551 Applied Machine Learning Lecture 13: Dimension reduction and feature selection Instructor: Herke van Hoof (herke.vanhoof@cs.mcgill.ca) Based on slides by:, Jackie Chi Kit Cheung Class web page:
More informationCHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS
46 CHAPTER 3 FEATURE EXTRACTION USING GENETIC ALGORITHM BASED PRINCIPAL COMPONENT ANALYSIS 3.1 INTRODUCTION Cardiac beat classification is a key process in the detection of myocardial ischemic episodes
More informationECE521 week 3: 23/26 January 2017
ECE521 week 3: 23/26 January 2017 Outline Probabilistic interpretation of linear regression - Maximum likelihood estimation (MLE) - Maximum a posteriori (MAP) estimation Bias-variance trade-off Linear
More informationMichael Lee Spring 2015 PHYS570: Introduction to Synchrotron Radiation
Synchrotron Radiation Micro-CT at the Micrometer Scale for the Analysis of the Three- Dimensional Morphology of Microcracks in Human Larrue A, Rattner A, Trabecular Peter Z-A, Olivier C, Laroche Bone N,
More informationDesign Collocation Neural Network to Solve Singular Perturbed Problems with Initial Conditions
Article International Journal of Modern Engineering Sciences, 204, 3(): 29-38 International Journal of Modern Engineering Sciences Journal homepage:www.modernscientificpress.com/journals/ijmes.aspx ISSN:
More informationDimensionality Reduction for Exponential Family Data
Dimensionality Reduction for Exponential Family Data Yoonkyung Lee* Department of Statistics The Ohio State University *joint work with Andrew Landgraf July 2-6, 2018 Computational Strategies for Large-Scale
More informationStochastic Assessment of Bone Fragility in Human Lumbar Spine
University of Texas at Tyler Scholar Works at UT Tyler Electrical Engineering Theses Electrical Engineering Spring 3-3-015 Stochastic Assessment of Bone Fragility in Human Lumbar Spine Rajeshwar Rao Pinninti
More informationWavelets and Multiresolution Processing
Wavelets and Multiresolution Processing Wavelets Fourier transform has it basis functions in sinusoids Wavelets based on small waves of varying frequency and limited duration In addition to frequency,
More informationA domain-knowledge-inspired mathematical framework for the description and classification of H&E stained histopathology images
A domain-knowledge-inspired mathematical framework for the description and classification of H&E stained histopathology images Melody L. Massar a, Ramamurthy Bhagavatula b, John A. Ozolek c, Carlos A.
More informationPrincipal Components Analysis (PCA)
Principal Components Analysis (PCA) Principal Components Analysis (PCA) a technique for finding patterns in data of high dimension Outline:. Eigenvectors and eigenvalues. PCA: a) Getting the data b) Centering
More informationGroup Sequential Tests for Delayed Responses. Christopher Jennison. Lisa Hampson. Workshop on Special Topics on Sequential Methodology
Group Sequential Tests for Delayed Responses Christopher Jennison Department of Mathematical Sciences, University of Bath, UK http://people.bath.ac.uk/mascj Lisa Hampson Department of Mathematics and Statistics,
More informationMEG Source Localization Using an MLP With Distributed Output Representation
MEG Source Localization Using an MLP With Distributed Output Representation Sung Chan Jun, Barak A. Pearlmutter, Guido Nolte CBLL Meeting October 5, 2005 Source localization Definition: Identification
More informationA Hybrid Time-delay Prediction Method for Networked Control System
International Journal of Automation and Computing 11(1), February 2014, 19-24 DOI: 10.1007/s11633-014-0761-1 A Hybrid Time-delay Prediction Method for Networked Control System Zhong-Da Tian Xian-Wen Gao
More informationCheng Soon Ong & Christian Walder. Canberra February June 2018
Cheng Soon Ong & Christian Walder Research Group and College of Engineering and Computer Science Canberra February June 2018 Outlines Overview Introduction Linear Algebra Probability Linear Regression
More informationCSC411: Final Review. James Lucas & David Madras. December 3, 2018
CSC411: Final Review James Lucas & David Madras December 3, 2018 Agenda 1. A brief overview 2. Some sample questions Basic ML Terminology The final exam will be on the entire course; however, it will be
More informationArtificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino
Artificial Neural Networks Data Base and Data Mining Group of Politecnico di Torino Elena Baralis Politecnico di Torino Artificial Neural Networks Inspired to the structure of the human brain Neurons as
More informationPrincipal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis. Chris Funk. Lecture 17
Principal Component Analysis-I Geog 210C Introduction to Spatial Data Analysis Chris Funk Lecture 17 Outline Filters and Rotations Generating co-varying random fields Translating co-varying fields into
More informationSARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal
Volume-03 Issue-07 July-2018 ISSN: 2455-3085 (Online) www.rrjournals.com [UGC Listed Journal] SARIMA-ELM Hybrid Model for Forecasting Tourist in Nepal *1 Kadek Jemmy Waciko & 2 Ismail B *1 Research Scholar,
More informationArtificial Neural Networks Examination, March 2004
Artificial Neural Networks Examination, March 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum
More informationNeural Networks and Ensemble Methods for Classification
Neural Networks and Ensemble Methods for Classification NEURAL NETWORKS 2 Neural Networks A neural network is a set of connected input/output units (neurons) where each connection has a weight associated
More informationKeywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm
Volume 4, Issue 5, May 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Huffman Encoding
More informationEnsembles of Extreme Learning Machine Networks for Value Prediction
Ensembles of Extreme Learning Machine Networks for Value Prediction Pablo Escandell-Montero, José M. Martínez-Martínez, Emilio Soria-Olivas, Joan Vila-Francés, José D. Martín-Guerrero IDAL, Intelligent
More informationOnline Identification And Control of A PV-Supplied DC Motor Using Universal Learning Networks
Online Identification And Control of A PV-Supplied DC Motor Using Universal Learning Networks Ahmed Hussein * Kotaro Hirasawa ** Jinglu Hu ** * Graduate School of Information Science & Electrical Eng.,
More informationFatigue in osteoporotic human trabecular bone Comparison between genders
loading to the load corresponding to a normalized stress level (Δσ/E 0 ). Fatigue in osteoporotic human trabecular bone Comparison between genders André do Carmo Saraiva Abstract In the present work, the
More informationUsing Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor
Using Principal Component Analysis Modeling to Monitor Temperature Sensors in a Nuclear Research Reactor Rosani M. L. Penha Centro de Energia Nuclear Instituto de Pesquisas Energéticas e Nucleares - Ipen
More informationChoosing Variables with a Genetic Algorithm for Econometric models based on Neural Networks learning and adaptation.
Choosing Variables with a Genetic Algorithm for Econometric models based on Neural Networks learning and adaptation. Daniel Ramírez A., Israel Truijillo E. LINDA LAB, Computer Department, UNAM Facultad
More informationArtificial Neural Networks Examination, June 2004
Artificial Neural Networks Examination, June 2004 Instructions There are SIXTY questions (worth up to 60 marks). The exam mark (maximum 60) will be added to the mark obtained in the laborations (maximum
More informationThe Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification
he Application of Extreme Learning Machine based on Gaussian Kernel in Image Classification Weijie LI, Yi LIN Postgraduate student in College of Survey and Geo-Informatics, tongji university Email: 1633289@tongji.edu.cn
More informationArtificial Neural Networks Examination, June 2005
Artificial Neural Networks Examination, June 2005 Instructions There are SIXTY questions. (The pass mark is 30 out of 60). For each question, please select a maximum of ONE of the given answers (either
More informationDimensionality Reduction
Lecture 5 1 Outline 1. Overview a) What is? b) Why? 2. Principal Component Analysis (PCA) a) Objectives b) Explaining variability c) SVD 3. Related approaches a) ICA b) Autoencoders 2 Example 1: Sportsball
More informationTransactions on Information and Communications Technologies vol 6, 1994 WIT Press, ISSN
Prediction of composite laminate residual strength based on a neural network approach R. Teti & G. Caprino Department of Materials and Production Engineering, University of Naples 'Federico II', Abstract
More informationResearch Article A PLS-Based Weighted Artificial Neural Network Approach for Alpha Radioactivity Prediction inside Contaminated Pipes
Mathematical Problems in Engineering, Article ID 517605, 5 pages http://dxdoiorg/101155/2014/517605 Research Article A PLS-Based Weighted Artificial Neural Network Approach for Alpha Radioactivity Prediction
More informationRole of Assembling Invariant Moments and SVM in Fingerprint Recognition
56 Role of Assembling Invariant Moments SVM in Fingerprint Recognition 1 Supriya Wable, 2 Chaitali Laulkar 1, 2 Department of Computer Engineering, University of Pune Sinhgad College of Engineering, Pune-411
More informationTrabecular Bone Structure of the Calcaneus: : Comparison of high resolution MR Imaging at 1.5T and 3T using MicroCT as a standard of reference
Trabecular Bone Structure of the Calcaneus: : Comparison of high resolution MR Imaging at 1.5T and 3T using MicroCT as a standard of reference Catherine Phan 1 Maiko Matsuura 2 Timothy Dunn Jan Bauer 1
More informationCSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning
CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska NEURAL NETWORKS Learning Neural Networks Classifier Short Presentation INPUT: classification data, i.e. it contains an classification (class) attribute.
More informationA Universal Model for Hidden State Observation in Adaptive Process Controls
245 A Universal Model for Hidden State Observation in Adaptive Process Controls Melanie Senn, Norbert Link Institute of Computational Engineering at IAF Karlsruhe University of Applied Sciences Moltkestrasse
More informationPrediction of gas emission quantity using artificial neural networks
Available online www.jocpr.com Journal of Chemical and Pharmaceutical Research, 2014, 6(6):1653-165 Research Article ISSN : 095-384 CODEN(USA) : JCPRC5 Prediction of gas emission quantity using artificial
More informationCourse 10. Kernel methods. Classical and deep neural networks.
Course 10 Kernel methods. Classical and deep neural networks. Kernel methods in similarity-based learning Following (Ionescu, 2018) The Vector Space Model ò The representation of a set of objects as vectors
More informationDimensionality Reduction
Dimensionality Reduction Le Song Machine Learning I CSE 674, Fall 23 Unsupervised learning Learning from raw (unlabeled, unannotated, etc) data, as opposed to supervised data where a classification of
More informationCombination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters
Combination of M-Estimators and Neural Network Model to Analyze Inside/Outside Bark Tree Diameters Kyriaki Kitikidou, Elias Milios, Lazaros Iliadis, and Minas Kaymakis Democritus University of Thrace,
More informationImage Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture
EE 5359 Multimedia Processing Project Report Image Denoising using Uniform Curvelet Transform and Complex Gaussian Scale Mixture By An Vo ISTRUCTOR: Dr. K. R. Rao Summer 008 Image Denoising using Uniform
More informationFinal Examination CS540-2: Introduction to Artificial Intelligence
Final Examination CS540-2: Introduction to Artificial Intelligence May 9, 2018 LAST NAME: SOLUTIONS FIRST NAME: Directions 1. This exam contains 33 questions worth a total of 100 points 2. Fill in your
More informationPrincipal Component Analysis, A Powerful Scoring Technique
Principal Component Analysis, A Powerful Scoring Technique George C. J. Fernandez, University of Nevada - Reno, Reno NV 89557 ABSTRACT Data mining is a collection of analytical techniques to uncover new
More informationA REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES
A REVIEW ON DIRECTIONAL FILTER BANK FOR THEIR APPLICATION IN BLOOD VESSEL DETECTION IN IMAGES ABSTRACT: Department of Electronics Engineering, G. H. Raisoni College of Engineering, Nagpur, India Vessel
More informationABSTRACT INTRODUCTION
ABSTRACT Presented in this paper is an approach to fault diagnosis based on a unifying review of linear Gaussian models. The unifying review draws together different algorithms such as PCA, factor analysis,
More informationIntelligent Handwritten Digit Recognition using Artificial Neural Network
RESEARCH ARTICLE OPEN ACCESS Intelligent Handwritten Digit Recognition using Artificial Neural Networ Saeed AL-Mansoori Applications Development and Analysis Center (ADAC), Mohammed Bin Rashid Space Center
More informationsize within a local area. Using the image as a matched lter, a nite number of scales are searched within a local window to nd the wavelet coecients th
In Proceeding of the 3rd International Workshop on Digital Mammography Chicago, U.S.A. 1996, pp. 447-450 Segmentation of Masses Using Continuous Scale Representations Andrew Laine a, Walter Huda b, Dongwei
More informationPCA and admixture models
PCA and admixture models CM226: Machine Learning for Bioinformatics. Fall 2016 Sriram Sankararaman Acknowledgments: Fei Sha, Ameet Talwalkar, Alkes Price PCA and admixture models 1 / 57 Announcements HW1
More informationCITS 4402 Computer Vision
CITS 4402 Computer Vision A/Prof Ajmal Mian Adj/A/Prof Mehdi Ravanbakhsh Lecture 06 Object Recognition Objectives To understand the concept of image based object recognition To learn how to match images
More informationA METHOD OF FINDING IMAGE SIMILAR PATCHES BASED ON GRADIENT-COVARIANCE SIMILARITY
IJAMML 3:1 (015) 69-78 September 015 ISSN: 394-58 Available at http://scientificadvances.co.in DOI: http://dx.doi.org/10.1864/ijamml_710011547 A METHOD OF FINDING IMAGE SIMILAR PATCHES BASED ON GRADIENT-COVARIANCE
More information2.3. Clustering or vector quantization 57
Multivariate Statistics non-negative matrix factorisation and sparse dictionary learning The PCA decomposition is by construction optimal solution to argmin A R n q,h R q p X AH 2 2 under constraint :
More informationStudy of Wavelet Functions of Discrete Wavelet Transformation in Image Watermarking
Study of Wavelet Functions of Discrete Wavelet Transformation in Image Watermarking Navdeep Goel 1,a, Gurwinder Singh 2,b 1ECE Section, Yadavindra College of Engineering, Talwandi Sabo 2Research Scholar,
More informationFeature gene selection method based on logistic and correlation information entropy
Bio-Medical Materials and Engineering 26 (2015) S1953 S1959 DOI 10.3233/BME-151498 IOS Press S1953 Feature gene selection method based on logistic and correlation information entropy Jiucheng Xu a,b,,
More informationProduct Quality Prediction by a Neural Soft-Sensor Based on MSA and PCA
International Journal of Automation and Computing 1 (2006) 17-22 Product Quality Prediction by a Neural Soft-Sensor Based on MSA and PCA Jian Shi, Xing-Gao Liu National Laboratory of Industrial Control
More informationFactor Analysis and Kalman Filtering (11/2/04)
CS281A/Stat241A: Statistical Learning Theory Factor Analysis and Kalman Filtering (11/2/04) Lecturer: Michael I. Jordan Scribes: Byung-Gon Chun and Sunghoon Kim 1 Factor Analysis Factor analysis is used
More informationNeural Networks biological neuron artificial neuron 1
Neural Networks biological neuron artificial neuron 1 A two-layer neural network Output layer (activation represents classification) Weighted connections Hidden layer ( internal representation ) Input
More informationThe ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations
The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova
More informationMultiresolution analysis & wavelets (quick tutorial)
Multiresolution analysis & wavelets (quick tutorial) Application : image modeling André Jalobeanu Multiresolution analysis Set of closed nested subspaces of j = scale, resolution = 2 -j (dyadic wavelets)
More information1983. Gearbox fault diagnosis based on local mean decomposition, permutation entropy and extreme learning machine
1983. Gearbox fault diagnosis based on local mean decomposition, permutation entropy and extreme learning machine Yu Wei 1, Minqiang Xu 2, Yongbo Li 3, Wenhu Huang 4 Department of Astronautical Science
More informationThe Fault extent recognition method of rolling bearing based on orthogonal matching pursuit and Lempel-Ziv complexity
The Fault extent recognition method of rolling bearing based on orthogonal matching pursuit and Lempel-Ziv complexity Pengfei Dang 1,2 *, Yufei Guo 2,3, Hongjun Ren 2,4 1 School of Mechanical Engineering,
More informationSTA 414/2104: Lecture 8
STA 414/2104: Lecture 8 6-7 March 2017: Continuous Latent Variable Models, Neural networks With thanks to Russ Salakhutdinov, Jimmy Ba and others Outline Continuous latent variable models Background PCA
More informationOn a General Two-Sample Test with New Critical Value for Multivariate Feature Selection in Chest X-Ray Image Analysis Problem
Applied Mathematical Sciences, Vol. 9, 2015, no. 147, 7317-7325 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2015.510687 On a General Two-Sample Test with New Critical Value for Multivariate
More informationComparing Robustness of Pairwise and Multiclass Neural-Network Systems for Face Recognition
Comparing Robustness of Pairwise and Multiclass Neural-Network Systems for Face Recognition J. Uglov, V. Schetinin, C. Maple Computing and Information System Department, University of Bedfordshire, Luton,
More informationPCA and LDA. Man-Wai MAK
PCA and LDA Man-Wai MAK Dept. of Electronic and Information Engineering, The Hong Kong Polytechnic University enmwmak@polyu.edu.hk http://www.eie.polyu.edu.hk/ mwmak References: S.J.D. Prince,Computer
More informationDiagnostic the Heart Valve Diseases using Eigen Vectors
Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology ISSN 2320 088X IMPACT FACTOR: 5.258 IJCSMC,
More informationSHIFT INVARIENT AND EIGEN FEATURE BASED IMAGE FUSION
SHIFT INVARIENT AND EIGEN FEATURE BASED IMAGE FUSION S.B.G.Tilak Babu 1, V.Satyanarayana 1 and Ch.Srinivasarao 2 1 Dept. of ECE,AEC, Surampalem,Kakinada, India 2 Dept. of ECE,JNTUK, UCEV,Vizianagaram,
More informationUsing a Hopfield Network: A Nuts and Bolts Approach
Using a Hopfield Network: A Nuts and Bolts Approach November 4, 2013 Gershon Wolfe, Ph.D. Hopfield Model as Applied to Classification Hopfield network Training the network Updating nodes Sequencing of
More informationRobust Controller Design for Speed Control of an Indirect Field Oriented Induction Machine Drive
Leonardo Electronic Journal of Practices and Technologies ISSN 1583-1078 Issue 6, January-June 2005 p. 1-16 Robust Controller Design for Speed Control of an Indirect Field Oriented Induction Machine Drive
More informationHoldout and Cross-Validation Methods Overfitting Avoidance
Holdout and Cross-Validation Methods Overfitting Avoidance Decision Trees Reduce error pruning Cost-complexity pruning Neural Networks Early stopping Adjusting Regularizers via Cross-Validation Nearest
More informationThe weighted spectral distribution; A graph metric with applications. Dr. Damien Fay. SRG group, Computer Lab, University of Cambridge.
The weighted spectral distribution; A graph metric with applications. Dr. Damien Fay. SRG group, Computer Lab, University of Cambridge. A graph metric: motivation. Graph theory statistical modelling Data
More informationResearch Statement on Statistics Jun Zhang
Research Statement on Statistics Jun Zhang (junzhang@galton.uchicago.edu) My interest on statistics generally includes machine learning and statistical genetics. My recent work focus on detection and interpretation
More informationWavelet Decomposition in Laplacian Pyramid for Image Fusion
International Journal of Signal Processing Systems Vol. 4, No., February 06 Wavelet Decomposition in Laplacian Pyramid for Image Fusion I. S. Wahyuni Laboratory Lei, University of Burgundy, Dijon, France
More informationInvariant Pattern Recognition using Dual-tree Complex Wavelets and Fourier Features
Invariant Pattern Recognition using Dual-tree Complex Wavelets and Fourier Features G. Y. Chen and B. Kégl Department of Computer Science and Operations Research, University of Montreal, CP 6128 succ.
More informationEE613 Machine Learning for Engineers. Kernel methods Support Vector Machines. jean-marc odobez 2015
EE613 Machine Learning for Engineers Kernel methods Support Vector Machines jean-marc odobez 2015 overview Kernel methods introductions and main elements defining kernels Kernelization of k-nn, K-Means,
More informationLinear Least-Squares Based Methods for Neural Networks Learning
Linear Least-Squares Based Methods for Neural Networks Learning Oscar Fontenla-Romero 1, Deniz Erdogmus 2, JC Principe 2, Amparo Alonso-Betanzos 1, and Enrique Castillo 3 1 Laboratory for Research and
More informationMachine Learning: Basis and Wavelet 김화평 (CSE ) Medical Image computing lab 서진근교수연구실 Haar DWT in 2 levels
Machine Learning: Basis and Wavelet 32 157 146 204 + + + + + - + - 김화평 (CSE ) Medical Image computing lab 서진근교수연구실 7 22 38 191 17 83 188 211 71 167 194 207 135 46 40-17 18 42 20 44 31 7 13-32 + + - - +
More informationNonlinearity Error Compensation of Venturi Flow Meter using Evolutionary Optimization Algorithms
IJIRST International Journal for Innovative Research in Science & Technology Volume 3 Issue 07 December 2016 ISSN (online): 2349-6010 Nonlinearity Error Compensation of Venturi Flow Meter using Evolutionary
More informationEvaluation on mechanical properties of a single trabecular in bovine femur
High Performance Structure and Materials VI 65 Evaluation on mechanical properties of a single trabecular in bovine femur S. Enoki 1, M. Higashiura 2, M. Sato 2, K. Tanaka 2 & T. Katayama 2 1 Department
More information