Determination of Linear Force- Free Magnetic Field Constant αα Using Deep Learning

Size: px
Start display at page:

Download "Determination of Linear Force- Free Magnetic Field Constant αα Using Deep Learning"

Transcription

1 Determination of Linear Force- Free Magnetic Field Constant αα Using Deep Learning Bernard Benson, Zhuocheng Jiang, W. David Pan Dept. of Electrical and Computer Engineering (Dept. of ECE) G. Allen Gary and Qiang Hu Center for Space Plasma and Aeronomic Research (CSPAR) University of Alabama in Huntsville (UAH) Huntsville, Alabama 35899

2 Outline Research Background and Motivation Problem Statement Linear Force-Free Magnetic Fields (LFFF) Coronal Loops and Double Dipole Configuration Construction of Image Datasets of Coronal Loops Deep Learning Algorithms and Computational Platforms Simulation Results Conclusions Acknowledgement

3 Magnetic Field of the Sun The Sun is a magnetically driven star. The magnetic field of the Sun is dominant over other forces in the solar corona. Part of free magnetic energy in solar corona is released during solar activity. The magnetic energy can be calculated by obtaining an accurate magnetic field model for an active region. Image courtesy of NASA SDO: AIA

4 Solar Magnetic Activity Impact on Earth Large coronal eruptions like flares and coronal mass ejections can influence Earth s magnetic field. This may trigger magnetic storms. Coronal eruptions also can cause harmful effects: - Disturbances in communications - Damages to satellites - Causing power outages - Causing life-threatening radiation damage to astronauts in space Image courtesy of clean.html.

5 Magnetograms Reliable high accuracy magnetic field measurements are only available in the photosphere (the visible surface of the Sun we are familiar with). These measurements are called vector magnetograms. They provide the magnetic field vector in the photosphere. NASA SDO/AIA 171 Angstroms image and potential field line (Oct. 25, 2010)

6 Research Objectives It is important to determine a high-fidelity magnetic model to understand and predict the dynamics in the corona. As the first step, we used the simplest model with one parameter that is indicative of the non-potential nature of an active region. The model allows us to generate a set of pseudo-coronal loop images, which can be used to derive the model parameter αα. Deep learning algorithms would be applicable due to the difficulty of determining the appropriate image features for pattern classification -- choosing the best αα value from a set of admissible values. To the best of our knowledge, this would be the first attempt to use artificial intelligence to estimate the solar magnetic model parameter directly from pseudo-coronal loop images.

7 Filtergram: A photograph of the sun at a particular frequency range (by means of a variable filter). Problem Statement To investigate the feasibility and effectiveness of Deep Learning Algorithms to solve for magnetic field parameter (αα) using digital images of synthesized EUV (Extreme Ultraviolet) coronal filtergrams. Terminology:

8 Linear Force-Free Magnetic Fields The solar magnetic field above the photosphere has been modeled by using force-free fields (FFF). The fields have been employed since they are the simplest field which are non-potential. Linear force-free fields are characterized by BB = αα BB and. BB = 0 Where B is the magnetic induction field and the force-free parameter αα is a constant.

9 Coronal Loops Simple coronal loops are modelled by using two nearby foot points which represents the outer surface of a coronal loops. These two field lines are projected to the z = 0 surface. The two field lines are made into a polygon and filled. We use 150 such foot points to generate our datasets within a box. The value of αα corresponds to the variation of twists in the loops.

10 LFFF Double Dipole Configuration Negative Dipole Positive Dipole PPPPPPPPPPPPPPPPPPPP: NN xx = NN yy = NN zz = 40, αα = 0.05, dd zz = 5.0, xx oo = 0, yy oo = 20, 150 rrrrrrrrrrrr ffffffff pppppppppppp

11 Image Datasets of Coronal Loops Stationary Dipole Loops with 1000 images per class of αα

12 Datasets of Coronal Loops Images Varying Dipole Loops with 5000 images per αα

13 Deep Learning Algorithms Classify input images into one out of 11 possible αα values. We experimented with the well-known deep learning algorithms: LeNet-5 (about 18 million parameters) AlexNet (about 28 million parameters) Sparse Autoencoders (to extract features automatically) We divided our datasets into: - Training (70%) - Validation (15%) - Testing (15%)

14 LeNet-5 Convolutional Neural Network Architecture C1: feature maps S2: f. maps C3: f. maps S4: f. maps C5: layer 500 F6: layer 500 OUTPUT 11 INPUT Full connection Gaussian connections Full connection Convolutions Subsampling Convolutions Subsampling

15 Figure copyright Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton, 2012 AlexNet Convolutional Neural Network Architecture CONV1 MAX POOL1 NORM1 CONV2 MAX POOL2 NORM2 CONV3 CONV4 CONV5 Max POOL3 FC6 FC7 FC8 11 ReLU (Rectified Linear Unit) activation function reduces compute time compared to sigmoid or tanh activations in LeNet-5. Dropout to avoid overfitting. Training occurs over 30 epochs.

16 Sparse Autoencoders Training occurs in an unsupervised manner using training images of size Two sparse autoencoders used with 100 and 50 hidden units, respectively. Softmax activation was used for classification.

17 Simulation Results: Validation Accuracy and Loss

18 Computational Platform and Efficiencies Computational Platform: Deep Learning DevBox with 4 NVIDIA Titan X GPUs, running Nvidia DIGITS software. Training Times - 2 mins for LetNet-5, 5 mins for AlexNet Testing Times - 8 seconds for LetNet-5, 10 seconds for AlexNet

19 Simulation Results Very high accuracy using AlexNet on both datasets. Top-1 accuracy: 99.6% and 96.4% Top-5 accuracy: 100% Reduced top-1 accuracy (85.49%) on varying dipole dataset due to the absence of dropout in LeNet-5, Top-5 accuracy of 99.88%. High sensitivity, specificity and precision show results are not skewed to uneven test cases.

20 Confusion Matrix Confusion matrix varying dipole loops dataset using 750 images per class of αα. High accuracy demonstrated per each class. Accurate within top-3 guesses.

21 Conclusions We have shown that given sufficient training data deep learning methods can find the magnetic field parameter αα from a set of pseudo-coronal loop images. The challenge is being able to generate high fidelity coronal loop images to test our models on observed EUV filtergrams. We are currently generating more complex coronal loop images using multiple dipole configurations and testing them on deep learning frameworks. As more data are being generated by NASA s SDO mission, sufficient data are available to extract features from AIA (Atmospheric Imaging Assembly) and HMI (Helioseismic and Magnetic Imager) images.

22 Acknowledgement We want to thank the support from the Cross College Faculty Research (CCFR) Program sponsored by The University of Alabama in Huntsville (UAH).

Determination of Linear Force-Free Magnetic Field Constant Alpha Using Deep Learning

Determination of Linear Force-Free Magnetic Field Constant Alpha Using Deep Learning Determination of Linear Force-Free Magnetic Field Constant Alpha Using Deep Learning Bernard Benson, Zhuocheng Jiang and W. David Pan Dept. of Electrical and Computer Engineering The University of Alabama

More information

Using This Flip Chart

Using This Flip Chart Using This Flip Chart Sunspots are the first indicators that a storm from the Sun is a possibility. However, not all sunspots cause problems for Earth. By following the steps in this flip chart you will

More information

michele piana dipartimento di matematica, universita di genova cnr spin, genova

michele piana dipartimento di matematica, universita di genova cnr spin, genova michele piana dipartimento di matematica, universita di genova cnr spin, genova first question why so many space instruments since we may have telescopes on earth? atmospheric blurring if you want to

More information

Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses about the label (Top-5 error) No Bounding Box

Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses about the label (Top-5 error) No Bounding Box ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton Motivation Classification goals: Make 1 guess about the label (Top-1 error) Make 5 guesses

More information

Using Deep Learning to Plug an Observational Gap in EUV Irradiance Observations

Using Deep Learning to Plug an Observational Gap in EUV Irradiance Observations Using Deep Learning to Plug an Observational Gap in EUV Irradiance Observations Andrés Muñoz-Jaramillo www.solardynamo.org David Fouhey, Richard Galvez, Alexander Szenicer, Rajat Thomas, Paul Wright, Jin

More information

Jakub Hajic Artificial Intelligence Seminar I

Jakub Hajic Artificial Intelligence Seminar I Jakub Hajic Artificial Intelligence Seminar I. 11. 11. 2014 Outline Key concepts Deep Belief Networks Convolutional Neural Networks A couple of questions Convolution Perceptron Feedforward Neural Network

More information

AUTOMATIC PREDICTION OF SOLAR FLARES USING A NEURAL NETWORK. James Negus University of Chicago Mentor: Andrew Jones LASP

AUTOMATIC PREDICTION OF SOLAR FLARES USING A NEURAL NETWORK. James Negus University of Chicago Mentor: Andrew Jones LASP AUTOMATIC PREDICTION OF SOLAR FLARES USING A NEURAL NETWORK James Negus University of Chicago Mentor: Andrew Jones LASP SOLAR FLARE A flare is defined as a sudden, rapid, and intense variation in brightness.

More information

Convolutional Neural Networks II. Slides from Dr. Vlad Morariu

Convolutional Neural Networks II. Slides from Dr. Vlad Morariu Convolutional Neural Networks II Slides from Dr. Vlad Morariu 1 Optimization Example of optimization progress while training a neural network. (Loss over mini-batches goes down over time.) 2 Learning rate

More information

Global Optimality in Matrix and Tensor Factorization, Deep Learning & Beyond

Global Optimality in Matrix and Tensor Factorization, Deep Learning & Beyond Global Optimality in Matrix and Tensor Factorization, Deep Learning & Beyond Ben Haeffele and René Vidal Center for Imaging Science Mathematical Institute for Data Science Johns Hopkins University This

More information

Introduction to Convolutional Neural Networks (CNNs)

Introduction to Convolutional Neural Networks (CNNs) Introduction to Convolutional Neural Networks (CNNs) nojunk@snu.ac.kr http://mipal.snu.ac.kr Department of Transdisciplinary Studies Seoul National University, Korea Jan. 2016 Many slides are from Fei-Fei

More information

AIA DATA ANALYSIS OVERVIEW OF THE AIA INSTRUMENT

AIA DATA ANALYSIS OVERVIEW OF THE AIA INSTRUMENT AIA DATA ANALYSIS OVERVIEW OF THE AIA INSTRUMENT SDO SUMMER SCHOOL ~ August 2010 ~ Yunnan, China Marc DeRosa (LMSAL) ~ derosa@lmsal.com WHAT IS SDO? The goal of Solar Dynamics Observatory (SDO) is to understand:

More information

Deep Learning (CNNs)

Deep Learning (CNNs) 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Deep Learning (CNNs) Deep Learning Readings: Murphy 28 Bishop - - HTF - - Mitchell

More information

Maxout Networks. Hien Quoc Dang

Maxout Networks. Hien Quoc Dang Maxout Networks Hien Quoc Dang Outline Introduction Maxout Networks Description A Universal Approximator & Proof Experiments with Maxout Why does Maxout work? Conclusion 10/12/13 Hien Quoc Dang Machine

More information

The Project. National Schools Observatory

The Project. National Schools Observatory Sunspots The Project This project is devised to give students a good understanding of the structure and magnetic field of the Sun and how this effects solar activity. Students will work with sunspot data

More information

Encoder Based Lifelong Learning - Supplementary materials

Encoder Based Lifelong Learning - Supplementary materials Encoder Based Lifelong Learning - Supplementary materials Amal Rannen Rahaf Aljundi Mathew B. Blaschko Tinne Tuytelaars KU Leuven KU Leuven, ESAT-PSI, IMEC, Belgium firstname.lastname@esat.kuleuven.be

More information

Coronal Holes. Detection in STEREO/EUVI and SDO/AIA data and comparison to a PFSS model. Elizabeth M. Dahlburg

Coronal Holes. Detection in STEREO/EUVI and SDO/AIA data and comparison to a PFSS model. Elizabeth M. Dahlburg Coronal Holes Detection in STEREO/EUVI and SDO/AIA data and comparison to a PFSS model Elizabeth M. Dahlburg Montana State University Solar Physics REU 2011 August 3, 2011 Outline Background Coronal Holes

More information

Introduction to Convolutional Neural Networks 2018 / 02 / 23

Introduction to Convolutional Neural Networks 2018 / 02 / 23 Introduction to Convolutional Neural Networks 2018 / 02 / 23 Buzzword: CNN Convolutional neural networks (CNN, ConvNet) is a class of deep, feed-forward (not recurrent) artificial neural networks that

More information

Neural networks and optimization

Neural networks and optimization Neural networks and optimization Nicolas Le Roux Criteo 18/05/15 Nicolas Le Roux (Criteo) Neural networks and optimization 18/05/15 1 / 85 1 Introduction 2 Deep networks 3 Optimization 4 Convolutional

More information

Machine Learning for Signal Processing Neural Networks Continue. Instructor: Bhiksha Raj Slides by Najim Dehak 1 Dec 2016

Machine Learning for Signal Processing Neural Networks Continue. Instructor: Bhiksha Raj Slides by Najim Dehak 1 Dec 2016 Machine Learning for Signal Processing Neural Networks Continue Instructor: Bhiksha Raj Slides by Najim Dehak 1 Dec 2016 1 So what are neural networks?? Voice signal N.Net Transcription Image N.Net Text

More information

8.2 The Sun pg Stars emit electromagnetic radiation, which travels at the speed of light.

8.2 The Sun pg Stars emit electromagnetic radiation, which travels at the speed of light. 8.2 The Sun pg. 309 Key Concepts: 1. Careful observation of the night sky can offer clues about the motion of celestial objects. 2. Celestial objects in the Solar System have unique properties. 3. Some

More information

An Introduction to Space Weather. J. Burkepile High Altitude Observatory / NCAR

An Introduction to Space Weather. J. Burkepile High Altitude Observatory / NCAR An Introduction to Space Weather J. Burkepile High Altitude Observatory / NCAR What is Space Weather? Space Weather refers to conditions in interplanetary space, produced by the Sun, that can disrupt

More information

Lecture 7 Convolutional Neural Networks

Lecture 7 Convolutional Neural Networks Lecture 7 Convolutional Neural Networks CMSC 35246: Deep Learning Shubhendu Trivedi & Risi Kondor University of Chicago April 17, 2017 We saw before: ŷ x 1 x 2 x 3 x 4 A series of matrix multiplications:

More information

Outline. Astronomy: The Big Picture. Earth Sun comparison. Nighttime observing is over, but a makeup observing session may be scheduled. Stay tuned.

Outline. Astronomy: The Big Picture. Earth Sun comparison. Nighttime observing is over, but a makeup observing session may be scheduled. Stay tuned. Nighttime observing is over, but a makeup observing session may be scheduled. Stay tuned. Next homework due Oct 24 th. I will not be here on Wednesday, but Paul Ricker will present the lecture! My Tuesday

More information

Deep Solar Imaging for Geomagnetic Storms Prediction

Deep Solar Imaging for Geomagnetic Storms Prediction Ecole polytechnique Research internship report Deep Solar Imaging for Geomagnetic Storms Prediction Student : Mhamed Hajaiej X2014 Supervisor : Cyril Furtlehner Referent : Yanlei Diao Organism : Inria

More information

Solar EUV Spectral Irradiance: Measurements. Frank Eparvier

Solar EUV Spectral Irradiance: Measurements. Frank Eparvier Solar EUV Spectral Irradiance: Measurements Frank Eparvier eparvier@colorado.edu Outline Introduction to Solar EUV Irradiance TIMED-SEE and SDO-EVE New Insights into EUV Sun from EVE The Future of EUV

More information

Introduction to (Convolutional) Neural Networks

Introduction to (Convolutional) Neural Networks Introduction to (Convolutional) Neural Networks Philipp Grohs Summer School DL and Vis, Sept 2018 Syllabus 1 Motivation and Definition 2 Universal Approximation 3 Backpropagation 4 Stochastic Gradient

More information

<Special Topics in VLSI> Learning for Deep Neural Networks (Back-propagation)

<Special Topics in VLSI> Learning for Deep Neural Networks (Back-propagation) Learning for Deep Neural Networks (Back-propagation) Outline Summary of Previous Standford Lecture Universal Approximation Theorem Inference vs Training Gradient Descent Back-Propagation

More information

Convolutional Neural Network Architecture

Convolutional Neural Network Architecture Convolutional Neural Network Architecture Zhisheng Zhong Feburary 2nd, 2018 Zhisheng Zhong Convolutional Neural Network Architecture Feburary 2nd, 2018 1 / 55 Outline 1 Introduction of Convolution Motivation

More information

Handwritten Indic Character Recognition using Capsule Networks

Handwritten Indic Character Recognition using Capsule Networks Handwritten Indic Character Recognition using Capsule Networks Bodhisatwa Mandal,Suvam Dubey, Swarnendu Ghosh, RiteshSarkhel, Nibaran Das Dept. of CSE, Jadavpur University, Kolkata, 700032, WB, India.

More information

Chapter 14 Lecture. The Cosmic Perspective Seventh Edition. Our Star Pearson Education, Inc.

Chapter 14 Lecture. The Cosmic Perspective Seventh Edition. Our Star Pearson Education, Inc. Chapter 14 Lecture The Cosmic Perspective Seventh Edition Our Star 14.1 A Closer Look at the Sun Our goals for learning: Why does the Sun shine? What is the Sun's structure? Why does the Sun shine? Is

More information

Chapter 14 Our Star A Closer Look at the Sun. Why was the Sun s energy source a major mystery?

Chapter 14 Our Star A Closer Look at the Sun. Why was the Sun s energy source a major mystery? Chapter 14 Our Star 14.1 A Closer Look at the Sun Our goals for learning Why was the Sun s energy source a major mystery? Why does the Sun shine? What is the Sun s structure? Why was the Sun s energy source

More information

Index. Santanu Pattanayak 2017 S. Pattanayak, Pro Deep Learning with TensorFlow,

Index. Santanu Pattanayak 2017 S. Pattanayak, Pro Deep Learning with TensorFlow, Index A Activation functions, neuron/perceptron binary threshold activation function, 102 103 linear activation function, 102 rectified linear unit, 106 sigmoid activation function, 103 104 SoftMax activation

More information

Solar Activity The Solar Wind

Solar Activity The Solar Wind Solar Activity The Solar Wind The solar wind is a flow of particles away from the Sun. They pass Earth at speeds from 400 to 500 km/s. This wind sometimes gusts up to 1000 km/s. Leaves Sun at highest speeds

More information

Solar eruptive phenomena

Solar eruptive phenomena Solar eruptive phenomena Andrei Zhukov Solar-Terrestrial Centre of Excellence SIDC, Royal Observatory of Belgium 26/01/2018 1 Eruptive solar activity Solar activity exerts continous influence on the solar

More information

CSCI 315: Artificial Intelligence through Deep Learning

CSCI 315: Artificial Intelligence through Deep Learning CSCI 35: Artificial Intelligence through Deep Learning W&L Fall Term 27 Prof. Levy Convolutional Networks http://wernerstudio.typepad.com/.a/6ad83549adb53ef53629ccf97c-5wi Convolution: Convolution is

More information

Exploring the Solar Wind with Ultraviolet Light

Exploring the Solar Wind with Ultraviolet Light Timbuktu Academy Seminar, Southern University and A&M College, November 19, 2003 Exploring the Solar Wind with Ultraviolet Light Steven R. Cranmer Harvard-Smithsonian Center for Astrophysics, Cambridge,

More information

Our sun is the star in our solar system, which lies within a galaxy (Milky Way) within the universe. A star is a large glowing ball of gas that

Our sun is the star in our solar system, which lies within a galaxy (Milky Way) within the universe. A star is a large glowing ball of gas that Our sun is the star in our solar system, which lies within a galaxy (Milky Way) within the universe. A star is a large glowing ball of gas that generates energy through nuclear fusion in its core. The

More information

Supervised Deep Learning

Supervised Deep Learning Supervised Deep Learning Joana Frontera-Pons Grigorios Tsagkatakis Dictionary Learning on Manifolds workshop Nice, September 2017 Supervised Learning Data Labels Model Prediction Spiral Exploiting prior

More information

The Sun as Our Star. Properties of the Sun. Solar Composition. Last class we talked about how the Sun compares to other stars in the sky

The Sun as Our Star. Properties of the Sun. Solar Composition. Last class we talked about how the Sun compares to other stars in the sky The Sun as Our Star Last class we talked about how the Sun compares to other stars in the sky Today's lecture will concentrate on the different layers of the Sun's interior and its atmosphere We will also

More information

Why Go To Space? Leon Golub, SAO BACC, 27 March 2006

Why Go To Space? Leon Golub, SAO BACC, 27 March 2006 Why Go To Space? Leon Golub, SAO BACC, 27 March 2006 Solar Observation Observation of the Sun has a long and distinguished history Especially important as calendar where e.g. seasonal monsoons produced

More information

The Magnetic Sun. CESAR s Booklet

The Magnetic Sun. CESAR s Booklet The Magnetic Sun CESAR s Booklet 1 Introduction to planetary magnetospheres and the interplanetary medium Most of the planets in our Solar system are enclosed by huge magnetic structures, named magnetospheres

More information

Learning Objectives. wavelengths of light do we use to see each of them? mass ejections? Which are the most violent?

Learning Objectives. wavelengths of light do we use to see each of them? mass ejections? Which are the most violent? Our Beacon: The Sun Learning Objectives! What are the outer layers of the Sun, in order? What wavelengths of light do we use to see each of them?! Why does limb darkening tell us the inner Sun is hotter?!

More information

SGD and Deep Learning

SGD and Deep Learning SGD and Deep Learning Subgradients Lets make the gradient cheating more formal. Recall that the gradient is the slope of the tangent. f(w 1 )+rf(w 1 ) (w w 1 ) Non differentiable case? w 1 Subgradients

More information

Astronomy 150: Killer Skies. Lecture 18, March 1

Astronomy 150: Killer Skies. Lecture 18, March 1 Assignments: Astronomy 150: Killer Skies HW6 due next Friday at start of class HW5 and Computer Lab 1 due Night Observing continues next week Lecture 18, March 1 Computer Lab 1 due next Friday Guest Lecturer:

More information

Convolutional Neural Networks. Srikumar Ramalingam

Convolutional Neural Networks. Srikumar Ramalingam Convolutional Neural Networks Srikumar Ramalingam Reference Many of the slides are prepared using the following resources: neuralnetworksanddeeplearning.com (mainly Chapter 6) http://cs231n.github.io/convolutional-networks/

More information

Agenda. Digit Classification using CNN Digit Classification using SAE Visualization: Class models, filters and saliency 2 DCT

Agenda. Digit Classification using CNN Digit Classification using SAE Visualization: Class models, filters and saliency 2 DCT versus 1 Agenda Deep Learning: Motivation Learning: Backpropagation Deep architectures I: Convolutional Neural Networks (CNN) Deep architectures II: Stacked Auto Encoders (SAE) Caffe Deep Learning Toolbox:

More information

Introduction to Neural Networks

Introduction to Neural Networks CUONG TUAN NGUYEN SEIJI HOTTA MASAKI NAKAGAWA Tokyo University of Agriculture and Technology Copyright by Nguyen, Hotta and Nakagawa 1 Pattern classification Which category of an input? Example: Character

More information

Deep Feedforward Networks. Han Shao, Hou Pong Chan, and Hongyi Zhang

Deep Feedforward Networks. Han Shao, Hou Pong Chan, and Hongyi Zhang Deep Feedforward Networks Han Shao, Hou Pong Chan, and Hongyi Zhang Deep Feedforward Networks Goal: approximate some function f e.g., a classifier, maps input to a class y = f (x) x y Defines a mapping

More information

Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net

Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net Two at Once: Enhancing Learning and Generalization Capacities via IBN-Net Supplementary Material Xingang Pan 1, Ping Luo 1, Jianping Shi 2, and Xiaoou Tang 1 1 CUHK-SenseTime Joint Lab, The Chinese University

More information

CSC 578 Neural Networks and Deep Learning

CSC 578 Neural Networks and Deep Learning CSC 578 Neural Networks and Deep Learning Fall 2018/19 3. Improving Neural Networks (Some figures adapted from NNDL book) 1 Various Approaches to Improve Neural Networks 1. Cost functions Quadratic Cross

More information

Introduction to Deep Learning

Introduction to Deep Learning Introduction to Deep Learning A. G. Schwing & S. Fidler University of Toronto, 2015 A. G. Schwing & S. Fidler (UofT) CSC420: Intro to Image Understanding 2015 1 / 39 Outline 1 Universality of Neural Networks

More information

Introduction to Deep Learning

Introduction to Deep Learning Introduction to Deep Learning Some slides and images are taken from: David Wolfe Corne Wikipedia Geoffrey A. Hinton https://www.macs.hw.ac.uk/~dwcorne/teaching/introdl.ppt Feedforward networks for function

More information

PLANETARY DEFENSE: RADAR 3D SHAPE MODELING. NASA FDL OVERVIEW- DR LIKA GUHATHAKURTA (on behalf of the FDL team.)

PLANETARY DEFENSE: RADAR 3D SHAPE MODELING. NASA FDL OVERVIEW- DR LIKA GUHATHAKURTA (on behalf of the FDL team.) PLANETARY DEFENSE: RADAR 3D SHAPE MODELING NASA FDL OVERVIEW- DR LIKA GUHATHAKURTA (on behalf of the FDL team.) An AI R&D accelerator that tackles knowledge gaps useful to the space program. The program

More information

Correction to Homework

Correction to Homework Today: Chapter 10 Reading Next Week: Homework Due March 12 Midterm Exam: March 19 Correction to Homework #1: Diameter of eye: 2.5 cm #10: See Ch. 11 Office Hours Monday. 11AM -2 PM Help Sessions Available:

More information

Magnetic twists and energy releases in solar flares

Magnetic twists and energy releases in solar flares Hinode seminar 2 September 2015 Magnetic twists and energy releases in solar flares Toshifumi Shimizu (ISAS/JAXA, Japan) 2015.9.2 Hinode seminar 1 Eruptive solar flares! General scenario Formation of magnetic

More information

Toward Interplanetary Space Weather: Strategies for Manned Missions to Mars

Toward Interplanetary Space Weather: Strategies for Manned Missions to Mars centre for fusion, space and astrophysics Toward Interplanetary Space Weather: Strategies for Manned Missions to Mars Presented by: On behalf of: Jennifer Harris Claire Foullon, E. Verwichte, V. Nakariakov

More information

Chapter 14 Lecture. Chapter 14: Our Star Pearson Education, Inc.

Chapter 14 Lecture. Chapter 14: Our Star Pearson Education, Inc. Chapter 14 Lecture Chapter 14: Our Star 14.1 A Closer Look at the Sun Our goals for learning: Why does the Sun shine? What is the Sun's structure? Why does the Sun shine? Is it on FIRE? Is it on FIRE?

More information

Classification of Higgs Boson Tau-Tau decays using GPU accelerated Neural Networks

Classification of Higgs Boson Tau-Tau decays using GPU accelerated Neural Networks Classification of Higgs Boson Tau-Tau decays using GPU accelerated Neural Networks Mohit Shridhar Stanford University mohits@stanford.edu, mohit@u.nus.edu Abstract In particle physics, Higgs Boson to tau-tau

More information

Solar Flare Durations

Solar Flare Durations Solar Flare Durations Whitham D. Reeve 1. Introduction Scientific investigation of solar flares is an ongoing pursuit by researchers around the world. Flares are described by their intensity, duration

More information

Guidepost. Chapter 08 The Sun 10/12/2015. General Properties. The Photosphere. Granulation. Energy Transport in the Photosphere.

Guidepost. Chapter 08 The Sun 10/12/2015. General Properties. The Photosphere. Granulation. Energy Transport in the Photosphere. Guidepost The Sun is the source of light an warmth in our solar system, so it is a natural object to human curiosity. It is also the star most easily visible from Earth, and therefore the most studied.

More information

ECE G: Special Topics in Signal Processing: Sparsity, Structure, and Inference

ECE G: Special Topics in Signal Processing: Sparsity, Structure, and Inference ECE 18-898G: Special Topics in Signal Processing: Sparsity, Structure, and Inference Neural Networks: A brief touch Yuejie Chi Department of Electrical and Computer Engineering Spring 2018 1/41 Outline

More information

Deep Learning: a gentle introduction

Deep Learning: a gentle introduction Deep Learning: a gentle introduction Jamal Atif jamal.atif@dauphine.fr PSL, Université Paris-Dauphine, LAMSADE February 8, 206 Jamal Atif (Université Paris-Dauphine) Deep Learning February 8, 206 / Why

More information

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann

Neural Networks with Applications to Vision and Language. Feedforward Networks. Marco Kuhlmann Neural Networks with Applications to Vision and Language Feedforward Networks Marco Kuhlmann Feedforward networks Linear separability x 2 x 2 0 1 0 1 0 0 x 1 1 0 x 1 linearly separable not linearly separable

More information

What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1

What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1 What Do Neural Networks Do? MLP Lecture 3 Multi-layer networks 1 Multi-layer networks Steve Renals Machine Learning Practical MLP Lecture 3 7 October 2015 MLP Lecture 3 Multi-layer networks 2 What Do Single

More information

Radiation Zone. AST 100 General Astronomy: Stars & Galaxies. 5. What s inside the Sun? From the Center Outwards. Meanderings of outbound photons

Radiation Zone. AST 100 General Astronomy: Stars & Galaxies. 5. What s inside the Sun? From the Center Outwards. Meanderings of outbound photons AST 100 General Astronomy: Stars & Galaxies 5. What s inside the Sun? From the Center Outwards Core: Hydrogen ANNOUNCEMENTS Midterm I on Tue, Sept. 29 it will cover class material up to today (included)

More information

10/17/ A Closer Look at the Sun. Chapter 11: Our Star. Why does the Sun shine? Lecture Outline

10/17/ A Closer Look at the Sun. Chapter 11: Our Star. Why does the Sun shine? Lecture Outline Lecture Outline 11.1 A Closer Look at the Sun Chapter 11: Our Star Our goals for learning: Why does the Sun shine? What is the Sun's structure? Why does the Sun shine? Is it on FIRE? Is it on FIRE? Chemical

More information

Sun Earth Connection Missions

Sun Earth Connection Missions Sun Earth Connection Missions ACE Advanced Composition Explorer The Earth is constantly bombarded with a stream of accelerated particles arriving not only from the Sun, but also from interstellar and galactic

More information

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino

Artificial Neural Networks D B M G. Data Base and Data Mining Group of Politecnico di Torino. Elena Baralis. Politecnico di Torino Artificial Neural Networks Data Base and Data Mining Group of Politecnico di Torino Elena Baralis Politecnico di Torino Artificial Neural Networks Inspired to the structure of the human brain Neurons as

More information

Introduction to Deep Learning CMPT 733. Steven Bergner

Introduction to Deep Learning CMPT 733. Steven Bergner Introduction to Deep Learning CMPT 733 Steven Bergner Overview Renaissance of artificial neural networks Representation learning vs feature engineering Background Linear Algebra, Optimization Regularization

More information

Space Weather. S. Abe and A. Ikeda [1] ICSWSE [2] KNCT

Space Weather. S. Abe and A. Ikeda [1] ICSWSE [2] KNCT Space Weather S. Abe and A. Ikeda [1] ICSWSE [2] KNCT Outline Overview of Space Weather I. Space disasters II. Space weather III. Sun IV. Solar wind (interplanetary space) V. Magnetosphere VI. Recent Space

More information

The General Properties of the Sun

The General Properties of the Sun Notes: The General Properties of the Sun The sun is an average star with average brightness. It only looks bright because it s so close. It contains 99% of the mass of the solar system. It is made of entirely

More information

Space Physics: Recent Advances and Near-term Challenge. Chi Wang. National Space Science Center, CAS

Space Physics: Recent Advances and Near-term Challenge. Chi Wang. National Space Science Center, CAS Space Physics: Recent Advances and Near-term Challenge Chi Wang National Space Science Center, CAS Feb.25, 2014 Contents Significant advances from the past decade Key scientific challenges Future missions

More information

Keywords: Sun: radio magnetic fields Sun: chromosphere Sun: corona Sun: active regions

Keywords: Sun: radio magnetic fields Sun: chromosphere Sun: corona Sun: active regions Estimating the coronal and chromospheric magnetic fields of solar active regions as observed with the Nobeyama Radioheliograph Compared with the Extrapolated Linear Force-Free Field A. Mouner, Abdelrazek

More information

Towards understanding feedback from supermassive black holes using convolutional neural networks

Towards understanding feedback from supermassive black holes using convolutional neural networks Towards understanding feedback from supermassive black holes using convolutional neural networks Stanislav Fort Stanford University Stanford, CA 94305, USA sfort1@stanford.edu Abstract Supermassive black

More information

Feature Design. Feature Design. Feature Design. & Deep Learning

Feature Design. Feature Design. Feature Design. & Deep Learning Artificial Intelligence and its applications Lecture 9 & Deep Learning Professor Daniel Yeung danyeung@ieee.org Dr. Patrick Chan patrickchan@ieee.org South China University of Technology, China Appropriately

More information

ECE521 Lectures 9 Fully Connected Neural Networks

ECE521 Lectures 9 Fully Connected Neural Networks ECE521 Lectures 9 Fully Connected Neural Networks Outline Multi-class classification Learning multi-layer neural networks 2 Measuring distance in probability space We learnt that the squared L2 distance

More information

CS60010: Deep Learning

CS60010: Deep Learning CS60010: Deep Learning Sudeshna Sarkar Spring 2018 16 Jan 2018 FFN Goal: Approximate some unknown ideal function f : X! Y Ideal classifier: y = f*(x) with x and category y Feedforward Network: Define parametric

More information

Teacher Background: The Dancing Lights Program

Teacher Background: The Dancing Lights Program Teacher Background: The Dancing Lights Program The Sun Many people think the Sun is just a fiery yellow ball. The Sun isn t actually burning because fire requires oxygen. Really, the Sun a giant ball of

More information

19 The Sun Introduction. Name: Date:

19 The Sun Introduction. Name: Date: Name: Date: 19 The Sun 19.1 Introduction The Sun is a very important object for all life on Earth. The nuclear reactions that occur in its core produce the energy required by plants and animals for survival.

More information

Need for Deep Networks Perceptron. Can only model linear functions. Kernel Machines. Non-linearity provided by kernels

Need for Deep Networks Perceptron. Can only model linear functions. Kernel Machines. Non-linearity provided by kernels Need for Deep Networks Perceptron Can only model linear functions Kernel Machines Non-linearity provided by kernels Need to design appropriate kernels (possibly selecting from a set, i.e. kernel learning)

More information

The Sun ASTR /17/2014

The Sun ASTR /17/2014 The Sun ASTR 101 11/17/2014 1 Radius: 700,000 km (110 R ) Mass: 2.0 10 30 kg (330,000 M ) Density: 1400 kg/m 3 Rotation: Differential, about 25 days at equator, 30 days at poles. Surface temperature: 5800

More information

Convolutional neural networks

Convolutional neural networks 11-1: Convolutional neural networks Prof. J.C. Kao, UCLA Convolutional neural networks Motivation Biological inspiration Convolution operation Convolutional layer Padding and stride CNN architecture 11-2:

More information

COMPARING FIXED AND ADAPTIVE COMPUTATION TIME FOR RE-

COMPARING FIXED AND ADAPTIVE COMPUTATION TIME FOR RE- Workshop track - ICLR COMPARING FIXED AND ADAPTIVE COMPUTATION TIME FOR RE- CURRENT NEURAL NETWORKS Daniel Fojo, Víctor Campos, Xavier Giró-i-Nieto Universitat Politècnica de Catalunya, Barcelona Supercomputing

More information

1.3j describe how astronomers observe the Sun at different wavelengths

1.3j describe how astronomers observe the Sun at different wavelengths 1.3j describe how astronomers observe the Sun at different wavelengths 1.3k demonstrate an understanding of the appearance of the Sun at different wavelengths of the electromagnetic spectrum, including

More information

Bayesian Networks (Part I)

Bayesian Networks (Part I) 10-601 Introduction to Machine Learning Machine Learning Department School of Computer Science Carnegie Mellon University Bayesian Networks (Part I) Graphical Model Readings: Murphy 10 10.2.1 Bishop 8.1,

More information

The Sun sends the Earth:

The Sun sends the Earth: The Sun sends the Earth: Solar Radiation - peak wavelength.visible light - Travels at the speed of light..takes 8 minutes to reach Earth Solar Wind, Solar flares, and Coronal Mass Ejections of Plasma (ionized

More information

EUHFORIA: Modeling the dangers of the sun.

EUHFORIA: Modeling the dangers of the sun. EUHFORIA: Modeling the dangers of the sun. 1 Introduction When we look at the Sun in visible light, it looks rather boring. However, when we observe the Sun at other wavelengths, it gets very interesting!

More information

Predicting Solar Flares by Converting GOES X-ray Data to Gramian Angular Fields (GAF) Images

Predicting Solar Flares by Converting GOES X-ray Data to Gramian Angular Fields (GAF) Images , July 4-6, 2018, London, U.K. Predicting Solar Flares by Converting GOES X-ray Data to Gramian Angular Fields (GAF) Images Tarek Nagem, Rami Qahwaji, Stanley Ipson, Amro Alasta Abstract: Predicting solar

More information

Solar Flares and CMEs. Solar Physics 1

Solar Flares and CMEs. Solar Physics 1 Solar Flares and CMEs Solar Physics 1 What is a solar flare? What is a CME? A solar flare is a sudden eruption of energetic charged particles from the Sun s corona. A coronal mass ejection (CME) is, by

More information

Fast Learning with Noise in Deep Neural Nets

Fast Learning with Noise in Deep Neural Nets Fast Learning with Noise in Deep Neural Nets Zhiyun Lu U. of Southern California Los Angeles, CA 90089 zhiyunlu@usc.edu Zi Wang Massachusetts Institute of Technology Cambridge, MA 02139 ziwang.thu@gmail.com

More information

The model of solar wind polytropic flow patterns

The model of solar wind polytropic flow patterns The model of solar wind polytropic flow patterns work in progress B.M. Shergelashvili in collaboration with V. N. Melnik, G. Dididze, H. Fichtner, S. Poedts, T. V. Zaqarashvili, M. L. Khodachenko Our Mysterious

More information

Large-Scale Feature Learning with Spike-and-Slab Sparse Coding

Large-Scale Feature Learning with Spike-and-Slab Sparse Coding Large-Scale Feature Learning with Spike-and-Slab Sparse Coding Ian J. Goodfellow, Aaron Courville, Yoshua Bengio ICML 2012 Presented by Xin Yuan January 17, 2013 1 Outline Contributions Spike-and-Slab

More information

1 A= one Angstrom = 1 10 cm

1 A= one Angstrom = 1 10 cm Our Star : The Sun )Chapter 10) The sun is hot fireball of gas. We observe its outer surface called the photosphere: We determine the temperature of the photosphere by measuring its spectrum: The peak

More information

Solar Observation Class Project

Solar Observation Class Project Name: School: Grade or Level: Lesson Plan #: Date: Object Solar Observation Class Project The object of this classroom exercise to involve as individuals or as teams, students in the actual astronomical

More information

CESAR BOOKLET General Understanding of the Sun: Magnetic field, Structure and Sunspot cycle

CESAR BOOKLET General Understanding of the Sun: Magnetic field, Structure and Sunspot cycle CESAR BOOKLET General Understanding of the Sun: Magnetic field, Structure and Sunspot cycle 1 Table of contents Introduction to planetary magnetospheres and the interplanetary medium... 3 A short introduction

More information

arxiv: v1 [cs.cv] 11 May 2015 Abstract

arxiv: v1 [cs.cv] 11 May 2015 Abstract Training Deeper Convolutional Networks with Deep Supervision Liwei Wang Computer Science Dept UIUC lwang97@illinois.edu Chen-Yu Lee ECE Dept UCSD chl260@ucsd.edu Zhuowen Tu CogSci Dept UCSD ztu0@ucsd.edu

More information

10/18/ A Closer Look at the Sun. Chapter 11: Our Star. Why does the Sun shine? Lecture Outline

10/18/ A Closer Look at the Sun. Chapter 11: Our Star. Why does the Sun shine? Lecture Outline 10/18/17 Lecture Outline 11.1 A Closer Look at the Sun Chapter 11: Our Star Our goals for learning: Why does the Sun shine? What is the Sun's structure? Why does the Sun shine? Is it on FIRE? Is it on

More information

PATTERN RECOGNITION AND MACHINE LEARNING

PATTERN RECOGNITION AND MACHINE LEARNING PATTERN RECOGNITION AND MACHINE LEARNING Slide Set 6: Neural Networks and Deep Learning January 2018 Heikki Huttunen heikki.huttunen@tut.fi Department of Signal Processing Tampere University of Technology

More information

The Dancing Lights Program

The Dancing Lights Program The Sun Teacher Background: The Dancing Lights Program Margaux Krahe Many people think the Sun is just a fiery yellow ball. The Sun is not actually burning because fire requires oxygen. Really, the Sun

More information

Deep Neural Networks (1) Hidden layers; Back-propagation

Deep Neural Networks (1) Hidden layers; Back-propagation Deep Neural Networs (1) Hidden layers; Bac-propagation Steve Renals Machine Learning Practical MLP Lecture 3 4 October 2017 / 9 October 2017 MLP Lecture 3 Deep Neural Networs (1) 1 Recap: Softmax single

More information