Numerical Interpolation of Aircraft Aerodynamic Data through Regression Approach on MLP Network

Similar documents
CSE 352 (AI) LECTURE NOTES Professor Anita Wasilewska. NEURAL NETWORKS Learning

Neural Networks and the Back-propagation Algorithm

Reading, UK 1 2 Abstract

Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses about the label (Top-5 error) No Bounding Box

Speaker Representation and Verification Part II. by Vasileios Vasilakakis

ECLT 5810 Classification Neural Networks. Reference: Data Mining: Concepts and Techniques By J. Hand, M. Kamber, and J. Pei, Morgan Kaufmann

CSC321 Lecture 5: Multilayer Perceptrons

ME 425: Aerodynamics

EPL442: Computational

A Novel Activity Detection Method

Introduction to Neural Networks

Classification of Higgs Boson Tau-Tau decays using GPU accelerated Neural Networks

Introduction to Natural Computation. Lecture 9. Multilayer Perceptrons and Backpropagation. Peter Lewis

CSE446: Neural Networks Spring Many slides are adapted from Carlos Guestrin and Luke Zettlemoyer

Neural Networks biological neuron artificial neuron 1

Neural networks. Chapter 19, Sections 1 5 1

Artificial Neural Networks

What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1

Lecture 4: Perceptrons and Multilayer Perceptrons

Artificial Neural Networks" and Nonparametric Methods" CMPSCI 383 Nov 17, 2011!

Mr. Harshit K. Dave 1, Dr. Keyur P. Desai 2, Dr. Harit K. Raval 3

Materials Science Forum Online: ISSN: , Vols , pp doi: /

Unit III. A Survey of Neural Network Model

EEE 241: Linear Systems

Jakub Hajic Artificial Intelligence Seminar I

Deep Learning: a gentle introduction

Data Mining Part 5. Prediction

Machine Learning for Large-Scale Data Analysis and Decision Making A. Neural Networks Week #6

Maxout Networks. Hien Quoc Dang

Artificial Intelligence

Analytical Solutions of Generalized Triples Algorithm for Flush Air-Data Sensing Systems

Keywords- Source coding, Huffman encoding, Artificial neural network, Multilayer perceptron, Backpropagation algorithm

Engineering Part IIB: Module 4F10 Statistical Pattern Processing Lecture 6: Multi-Layer Perceptrons I

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Neural Networks. Chapter 18, Section 7. TB Artificial Intelligence. Slides from AIMA 1/ 21

Multilayer Neural Networks. (sometimes called Multilayer Perceptrons or MLPs)

Neural Networks. Single-layer neural network. CSE 446: Machine Learning Emily Fox University of Washington March 10, /9/17

A Study on Estimation Technique of Extreme Precipitation Diameter

Analysis of Forward Collision Warning System. Based on Vehicle-mounted Sensors on. Roads with an Up-Down Road gradient

Lecture 17: Neural Networks and Deep Learning

Neural Networks Introduction

ARTIFICIAL NEURAL NETWORKS گروه مطالعاتي 17 بهار 92

Portugaliae Electrochimica Acta 26/4 (2008)

Last update: October 26, Neural networks. CMSC 421: Section Dana Nau

Neural networks. Chapter 20. Chapter 20 1

Learning features by contrasting natural images with noise

CS 4700: Foundations of Artificial Intelligence

ARTIFICIAL NEURAL NETWORK PART I HANIEH BORHANAZAD

Multilayer Neural Networks

Final Examination CS 540-2: Introduction to Artificial Intelligence

Introduction to Deep Learning

Introduction to Aerospace Engineering

Lecture 4: Feed Forward Neural Networks

CSE 190 Fall 2015 Midterm DO NOT TURN THIS PAGE UNTIL YOU ARE TOLD TO START!!!!

Multilayer Perceptron = FeedForward Neural Network

Reentry Air Data System for a Sub-orbital Spacecraft Based on X-34 Design

Deep Feedforward Networks

AAS/AIAA Astrodynamic Specialists Conference 2-5 August 2010, Toronto, Canada

Artificial neural networks

Neural networks. Chapter 20, Section 5 1

COMP-4360 Machine Learning Neural Networks

Short Term Load Forecasting Using Multi Layer Perceptron

Estimation of Wind Velocity on Flexible Unmanned Aerial Vehicle Without Aircraft Parameters

Deep Neural Networks (1) Hidden layers; Back-propagation

Neural Networks. Nicholas Ruozzi University of Texas at Dallas

Multi-wind Field Output Power Prediction Method based on Energy Internet and DBPSO-LSSVM

Unit 8: Introduction to neural networks. Perceptrons

The Perceptron. Volker Tresp Summer 2016

Multilayer Perceptrons and Backpropagation

Artificial Neural Network Approach for Land Cover Classification of Fused Hyperspectral and Lidar Data

Lecture 10. Neural networks and optimization. Machine Learning and Data Mining November Nando de Freitas UBC. Nonlinear Supervised Learning

CS:4420 Artificial Intelligence

AN INTRODUCTION TO NEURAL NETWORKS. Scott Kuindersma November 12, 2009

BACKPROPAGATION. Neural network training optimization problem. Deriving backpropagation

Nonlinear Classification

A Study on Performance Analysis of V2V Communication Based AEB System Considering Road Friction at Slopes

Pattern Classification

An Application of the Improved Models for Risk Assessment of Runway Excursion in Korea

Package NlinTS. September 10, 2018

Module 12. Machine Learning. Version 2 CSE IIT, Kharagpur

Introduction Biologically Motivated Crude Model Backpropagation

Course 395: Machine Learning - Lectures

Rapid Introduction to Machine Learning/ Deep Learning

Deep Learning. Basics and Intuition. Constantin Gonzalez Principal Solutions Architect, Amazon Web Services

Machine Learning. Neural Networks

arxiv: v1 [cs.lg] 10 Aug 2018

Introduction to Flight

Learning and Memory in Neural Networks

for what specific application did Henri Pitot develop the Pitot tube? what was the name of NACA s (now NASA) first research laboratory?

Multilayer Neural Networks

Extracting Provably Correct Rules from Artificial Neural Networks

Prediction of temperature of hot strip in finishing mill

Neural Networks: Introduction

A 68 Parallel Row Access Neuromorphic Core with 22K Multi-Level Synapses Based on Logic- Compatible Embedded Flash Memory Technology

18.6 Regression and Classification with Linear Models

International Journal of Advanced Research in Computer Science and Software Engineering

CSCI 315: Artificial Intelligence through Deep Learning

University of Tennessee, Knoxville

Incremental Stochastic Gradient Descent

Transcription:

, pp.12-17 http://dx.doi.org/10.14257/astl.2018.151.03 Numerical Interpolation of Aircraft Aerodynamic Data through Regression Approach on MLP Network Myeong-Jae Jo 1, In-Kyum Kim 1, Won-Hyuck Choi 2 and Min-Seok Jie 2 1 Dept. Of Aeronautical System Engineering, Hanseo University, 236-49 Gomseom-Ro, 32158 Taean-Gun, Republic of Korea 2 Dept. Of Avionics Engineering, Hanseo University, 236-49 Gomseom-Ro, 32158 Taean-Gun, Republic of Korea Abstract. This work proposes a method using machine learning for aerodynamic data processing and optimization problems of collected aircraft aerodynamic data. For this purpose, input and output of accumulated data are strictly defined, and the original output value of the input is compared with the estimated value of the learned neural network. The neural network structure used is multilayer perceptron (MLP, Multi-Layer Perceptron), which consists of two layers of hidden layers excluding the input layer and the output layer, and estimates the result using linear regression. Through the process of comparing the output value and the estimated value, learning of the artificial neural network proceeds in the direction of minimizing it based on the cost function value capable of quantifying it. In this scenario, ANSYS Fluent, which is a widely used computational fluid analysis software, is used to extract aerodynamic data through shape design and fluid analysis, and then used it. By defining preprocessing and input / output of extracted aerodynamic data, Learning of neural network. All learning data were separated for learning and validation of artificial neural network, and the accuracy of artificial neural network for the input and output of separated data was verified as a progressive measure for numerical interpolation. Keywords: fluid analysis, machine learning, supervised learning, multi-layer perceptron, numerical interpolation 1 Introduction The Flush Air Data Sensing (FADS) system, which collects flight data such as flight speed, angle-of-attack, side-slip angle, and altitude in a high-speed flight such as a space shuttle, or an unmanned combat air vehicle (UCAV) compared to existing pitot tube, it has a buried shape sensor, so it has the advantage of collecting aerodynamic data stably. When estimating the state of the aircraft based on the collected aerodynamic data, it is possible to derive the model equation for the fluid, or to estimate the state of the aircraft by comparing the data conditions based on the accumulated data. However, existing estimation methods were basically a human intuition or logic involved in the verification between all the data, so that there is a ISSN: 2287-1233 ASTL Copyright 2018 SERSC

certain limit due to the difference between the actual flow and the ideal flow as well as the large load. This work conducted using a machine learning method based on artificial neural networks, instead of model formula estimation or data analytical approaches. By using the collected data as learning data of artificial neural networks, it can be estimate the real value. Since machine learning has its own logic through learning after designating data and structure for specified input and output, high automation can be expected compared with the previous method, and the amount of data to be supplied and the size of the structure It is expected that the performance will be improved proportionally. 1.1 Embedded Air Data Sensor For estimating the velocity or altitude of the aircraft, the pitot-tube for measuring and collecting the dynamic pressure of the aircraft should be installed in a position that is not influenced by the boundary layer caused by the shape of the aircraft and that is not influenced by the air turbulence. Measurement error can be minimized [1]. But, by using the FADS system, which has a different shape form compared to legacy pitot-tube that is mounted to protrude out of the aircraft body, in order to overcome the limitation of the mounting position, it is possible to measure the stagnation pressure by measuring at the same time. It is also possible to estimate posture such as angle of attack or side- slip angle of an aircraft including speed and altitude information. 1.2 Numerical Interpolation for Embedded Air Data Sensor For the estimation and correction of the atmospheric conditions required for aircraft operation, the establishment of the database for the pressure measured, atmospheric pressure, and the support angle, etc., is required first. The placement of the hole in a FADS system to measure pressure values is located in the air terminal, as in conventional aircraft, and the measured pressure data is in the digital data form [2]. In the previous methods, the flow around the head of the aircraft was assumed to be an ideal potential flow, and a simple model equation was derived or used. The 'Triples Algorithm' can be applied as an estimation and correction model of the atmospheric state, but the relationship between mach number, angle-of-attack and side-slip angle is nonlinear according to the measured pressure value. Due to the limitations of the difference, this work estimating method using the artificial neural network technique is used to approximate the real model. Predictions on the distribution of nonlinear data using artificial neural networks can be made similar to actual estimates of nonlinear adaptation through the process of learning from collected data as learning data. In this work, we aimed to estimate numerically the output value of the input value by performing the machine learning based on the MLP structure, which is a representative structure of the artificial neural network. Copyright 2018 SERSC 13

2 Conventional Estimation of Embedded Air Data Sensor For the FADS pressure model, the Triples algorithm used in the NASA to space shuttle is a representative example. 2.1 Triples Algorithm The Triples algorithm can be used to estimate the pressure values at three positions in previous FADS system. The pressure estimation formulas from the three positions are as follows. It is possible to remove,, and terms from three points by using the equation obtained from the FPM, and reorganize them using [3]. And, for each of the pressure ports i, j, k By using the Euler method as above equation (2), we can know the relation of each port pressure. (1) (2) 3 Estimation based on MLP Neural Network In the numerical analysis based on the linear regression, the correction was performed using the machine learning based on the MLP Structure. 3.1 Artificial Neural Network based Data Processing If an artificial neural network technique based on nonlinear data processing is applied, it is possible to estimate the output values (Mach number, angle-of-attack, etc.,) according to the pressure data measured through the atmospheric sensor it can be judged that there is. Computational techniques can possible to solve problems that are difficult to apply simple calculation repetition using existing numerical methods, that is, problems due to nonlinear relations without efficient algorithms or optimized equations. MLP, which is the most general structure of the neural network structure, is based on a single layer perceptron structure. The input vector is classified into a plurality of linear types by taking a series of weights and a bias on the input vectors. Based on the single - layer perceptron classification, a neural network learning structure based on learning data can be realized by constructing a network in which propagation occurs in a feed - forward manner by using a plurality of perceptrons acting as input of the next layer. 14 Copyright 2018 SERSC

Here, through the distribution of each layer divided into input / hidden / output layers, the training of the neural network and the weights of the internal nodes are adjusted based on the sample data of the learning. First, weights and biases are initialized for all nodes in each layer, and then the calculation proceeds in the forward direction with respect to the input. (3) Using the above equation (3), it is possible to control the degree of learning (= regularization) of the entire neural network by setting the sensitivity ( ) in each layer of the artificial neural network as a hyper-parameter for the entire neural network structure, that is, a variable that can be arbitrarily adjusted by the user. In the final output layer, and the original result value for the input. In the hidden layer, the weight and sensitivity in the previous layer are summarized and propagated continuously to the next layer. After learning in the forward direction going from the input to the output layer, the learning to the back propagation process can be expressed as follows. For a weight that changes based on the learning rate ( ) and sensitivity ( ), the weight change to the next layer is affected by the previous layer, so adjusting the weight for the previous layer in the reverse direction is called back propagation process [4]. In addition, 'dropout' was introduced to minimize the cost function. This method minimizes the loss function by adding noise intentionally to the neural network. The back propagation process is the same as that of the conventional neural network algorithm, but the forward propagation process is different. (4) (5) If we use equation (3), we apply the probability of p, which is an independent Bernoulli random variable, to be 1 before entering the activation function. By multiplying 0 or 1, the neuron output value of the layer is transferred to the next layer Or not. Since this series of processes is performed for the entire network, it is similar to the method of sampling a subnetwork on a large network [5]. For the change of the pressure data condition for each mesh, the mach number of 0.2 to 0.85 (5 kinds), the angle of attack of -4 to 16 degrees (11 kinds) and the side slip angle of 0 to 8 degrees (5 kinds) The number of combinations was 275(= 5 * 11 * 5) files, and each condition was extracted as a separate file. The number of meshes with respect to the shape of (6) (7) (8) Copyright 2018 SERSC 15

the head of the aircraft in the individual file is 41067, which has a one characteristics that is stagnation pressure. Fig. 1. Feed-forward MLP structure with dropout techniques for data processing In order to evaluate the trained neural network, the accuracy of neural network is evaluated by separating about 30% of the total learning data. However, in this study, only about 10% It can be judged that the evaluation of data interpolation performance for the trained neural network and the accuracy of the neural network can be evaluated at the same time. And also, the percentage of nodes that are dropped out is typically around 60%, which is commonly used, and 40% of nodes are inactive each layers. 3.1 Result of MLP neural network based estimation From the left, the order of each Mach number, Side-Slip Angle, Angle-of-Attack were displayed in that order. In Figure 2, we can see that the artificial neural network-based estimation according to the change of the angle of attack is quite good. However, in the case of Mach number and Side-Slip Angle, the difference in learning level compared to the Angle-of-Attack shows that the learning rate is relatively low. Especially, the mach number that supersonic region of 0.8 or more, it can be considered that the learning is not performed properly because the data is not linear. Fig. 2. Feed-forward MLP structure with dropout techniques for data processing 16 Copyright 2018 SERSC

4 Conclusion As the number of data samples for actual learning decreases through pre-processing of data, learning of nonlinear data relations seems to be incomplete, and efficient learning can proceed through increasing sample data through more dense conditions change. It is conceivable that machine learning, which estimates based on the similarity and relationship of data itself, rather than data estimation through derivation of existing model formulas, may be useful for actual estimation depending on the user's data collection and processing method. Acknowledgment. This study was supported by the Development of the boiler inspection system based-on UAV technology research project of Korea Western Power co., Ltd. This work was supported by the Korea Institute for Advencement of Technology(KIAT) grant funded by the Korean government (Motie: Ministry of Trade, Industry&Energy) (No. N0002431). This study was supported by 2018 research grant funded by the Hanseo University. This research is supported by Ministry of Land, Infrastructure and Transport as Aviation personnel nurturing project References 1. J. C. Choi, K. G. Lee and C. W. Park, Development of the Pitot-Tube to Measure Flight Altitude and Velocity, Journal of the Korean Society of Propulsion Engineers, vol. 4, (2001), pp. 19-24. 2. Y. Liu, D. Xiao and Y. Lu, Comparative Study on a Solving Model and Algorithm for a Flush Air Data Sensing System, Open Access Journal - Sensors, vol. 14, (2014), pp. 9210-9226. 3. B. R. Cobleigh, S. A. Whitmore and E. A. Haering, Flush AIrdata Sensing(FADS) System Calibration Procedures and Results for Blunt Forebodies, American Institute of Aeronautics and Astronautics, NASA / TP 1999-209012, (1999). 4. F. Vargas, D. Lettnin and M. C. Felippetto de Castro, Electrocardiogram Pattern Recognition by Means of MLP Network and PCA: A Case Study on Equal Amount of Input Signal Types, Proceedings of the VII Brazilian Symposium on Neural Networks, International Symposium on High Performance Distributed Computing, IEEE Press, New York, (2002), pp. 181-184. 5. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever and R. Salakhutdinov, Dropout: A Simple Way to Prevent Neural Networks from Overfitting, Journal of machine Learning Research, vol. 15, (2014), pp. 1929-1958. Copyright 2018 SERSC 17