MULTILAYER PERCEPTRONS
|
|
- Iris Blake
- 6 years ago
- Views:
Transcription
1 Last updated: Nov 26, 2012 MULTILAYER PERCEPTRONS
2 Outline 2 Combining Linea Classifies Leaning Paametes
3 Outline 3 Combining Linea Classifies Leaning Paametes
4 Implementing Logical Relations 4 AND and OR opeations ae linealy sepaable poblems
5 The XOR Poblem 5 XOR is not linealy sepaable. x 1 x 2 XOR Class B A A B How can we use linea classifies to solve this poblem?
6 Combining two linea classifies 6 Idea: use a logical combination of two linea classifies. g 2 (x) = x 1 + x g 1 (x) = x 1 + x 2 1 2
7 Combining two linea classifies 7 Let f (x) be the unit step activation function: f (x) = 0, x < 0 f (x) = 1, x 0 Obseve that the classification poblem is then solved by f y 1 y whee y 1 = f g 1 (x) ( ) and y 2 = f ( g 2 (x)) g 2 (x) = x 1 + x g 1 (x) = x 1 + x 2 1 2
8 Combining two linea classifies 8 This calculation can be implemented sequentially: 1. Compute y 1 and y 2 fom x 1 and x Compute the decision fom y 1 and y 2. Each laye in the sequence consists of one o moe linea classifications. This is theefoe a two-laye pecepton. f y 1 y whee y 1 = f g 1 (x) ( ) and y 2 = f ( g 2 (x)) g 2 (x) = x 1 + x g 1 (x) = x 1 + x 2 1 2
9 The Two-Laye Pecepton 9 Laye 1 Laye 2 x 1 x 2 y 1 y (-) 0(-) B(0) 0 1 1(+) 0(-) A(1) 1 0 1(+) 0(-) A(1) 1 1 1(+) 1(+) B(0) f y 1 y whee y 1 = f g 1 (x) ( ) and y 2 = f ( g 2 (x)) g 2 (x) = x 1 + x Laye 1 Laye 2 y 1 y g 1 (x) = x 1 + x 2 1 2
10 The Two-Laye Pecepton 10 The fist laye pefoms a nonlinea mapping that makes the data linealy sepaable. y 1 = f ( g 1 (x)) and y 2 = f ( g 2 (x)) g 2 (x) = x 1 + x Laye 1 Laye 2 y 1 y g 1 (x) = x 1 + x 2 1 2
11 The Two-Laye Pecepton Achitectue 11 Input Laye Hidden Laye Output Laye g 1 (x) = x 1 + x y 1 y g 2 (x) = x 1 + x
12 The Two-Laye Pecepton 12 Note that the hidden laye maps the plane onto the vetices of a unit squae. y 1 = f ( g 1 (x)) and y 2 = f ( g 2 (x)) g 2 (x) = x 1 + x Laye 1 Laye 2 y 1 y g 1 (x) = x 1 + x 2 1 2
13 Highe Dimensions 13 Each hidden unit ealizes a hypeplane disciminant function. The output of each hidden unit is 0 o 1 depending upon the location of the input vecto elative to the hypeplane. l x R x { 0,1} i 1, 2 p T y = [ y 1,... yp ], yi =,...
14 Highe Dimensions 14 Togethe, the hidden units map the input onto the vetices of a p-dimensional unit hypecube. l x R x y { 0,1} i 1, 2 p T = [ y 1,... yp ], yi =,...
15 Two-Laye Pecepton 15 These p hypeplanes patition the l-dimensional input space into polyhedal egions Each egion coesponds to a diffeent vetex of the p- dimensional hypecube epesented by the outputs of the hidden laye.
16 Two-Laye Pecepton 16 In this example, the vetex (0, 0, 1) coesponds to the egion of the input space whee: g 1 (x) < 0 g 2 (x) < 0 g 3 (x) > 0
17 Limitations of a Two-Laye Pecepton 17 The output neuon ealizes a hypeplane in the tansfomed space that patitions the p vetices into two sets. Thus, the two laye pecepton has the capability to classify vectos into classes that consist of unions of polyhedal egions. But NOT ANY union. It depends on the elative position of the coesponding vetices. How can we solve this poblem?
18 The Thee-Laye Pecepton 18 Suppose that Class A consists of the union of K polyheda in the input space. Use K neuons in the 2 nd hidden laye. Tain each to classify one Class A vetex as positive, the est negative. Now use an output neuon that implements the OR function.
19 The Thee-Laye Pecepton 19 Thus the thee-laye pecepton can sepaate classes esulting fom any union of polyhedal egions in the input space.
20 The Thee-Laye Pecepton 20 The fist laye of the netwok foms the hypeplanes in the input space. The second laye of the netwok foms the polyhedal egions of the input space The thid laye foms the appopiate unions of these egions and maps each to the appopiate class.
21 Outline 21 Combining Linea Classifies Leaning Paametes
22 Taining Data 22 The taining data consist of N input-output pais: ( y(i), x(i) ), i 1, N whee y(i) = and x(i) = y 1 (i),, y kl (i) x 1 (i),, x k0 (i) t t
23 Choosing an Activation Function 23 The unit step activation function means that the eo ate of the netwok is a discontinuous function of the weights. This makes it difficult to lean optimal weights by minimizing the eo. To fix this poblem, we need to use a smooth activation function. A popula choice is the sigmoid function we used fo logistic egession:
24 Smooth Activation Function 24 f (a) = 1 1+ exp( a) w t φ x 1
25 Output: Two Classes 25 Fo a binay classification poblem, thee is a single output node with activation function given by f (a) = 1 1+ exp( a) Since the output is constained to lie between 0 and 1, it can be intepeted as the pobability of the input vecto belonging to Class 1.
26 Output: K > 2 Classes 26 Fo a K-class poblem, we use K outputs, and the softmax function given by y k = j ( ) exp a k ( ) exp a j Since the outputs ae constained to lie between 0 and 1, and sum to 1, y k can be intepeted as the pobability that the input vecto belongs to Class K.
27 Non-Convex 27 Now each laye of ou multi-laye pecepton is a logistic egesso. Recall that optimizing the weights in logistic egession esults in a convex optimization poblem. Unfotunately the cascading of logistic egessos in the multi-laye pecepton makes the poblem non-convex. This makes it difficult to detemine an exact solution. Instead, we typically use gadient descent to find a locally optimal solution to the weights. The specific leaning algoithm is called the backpopagation algoithm.
28 Nonlinea Classification and Regession: Outline 28 Multi-Laye Peceptons The Back-Popagation Leaning Algoithm Genealized Linea Models Radial Basis Function Netwoks Spase Kenel Machines n Nonlinea SVMs and the Kenel Tick n Relevance Vecto Machines
29 The Backpopagation Algoithm Paul J. Webos. Beyond Regession: New Tools fo Pediction and Analysis in the Behavioal Sciences. PhD thesis, Havad Univesity, 1974 Rumelhat, David E.; Hinton, Geoffey E., Williams, Ronald J. (8 Octobe 1986). "Leaning epesentations by back-popagating eos". Natue 323 (6088): Webos Rumelhat Hinton
30 Notation 30 Assume a netwok with L layes k 0 nodes in the input laye. k nodes in the th laye.
31 Notation 31 Let y k 1 be the output of the kth neuon of laye 1. Let w jk be the weight of the synapse on the jth neuon of laye fom the kth neuon of laye 1.
32 Input 32 y k 0 (i) = x k (i), k = 1,,k 0
33 Notation 33 Let v j v j (i) = w j be the total input to the jth neuon of laye : ( ) t k 1 y 1 (i) = w jk Then y j (i) = f v j (i) k =0 y k 1 (i) whee we define y 0 (i) = +1 to incopoate the bias tem. k 1 ( ) = f w jk k =0 y 1 k (i)
34 Cost Function 34 A common cost function is the squaed eo: J = N i =1 ε(i) whee ε(i) 1 2 and k L ( e m (i)) 2 = 1 2 m =1 k L ( y m (i) ŷ m (i)) 2 m =1 ŷ m (i) = y k (i) is the output of the netwok.
35 Cost Function 35 To summaize, the eo fo input i is given by ε(i) = 1 2 whee ŷ m (i) = y k (i) is the output of the output laye and each laye is elated to the pevious laye though and k L ( e m (i)) 2 = 1 2 m =1 ( ) y j (i) = f v j (i) v j (i) = ( w ) t j y 1 (i) k L ( ŷ m (i) y m (i)) 2 m =1
36 Gadient Descent 36 Gadient descent stats with an initial guess at the weights ove all layes of the netwok. We then use these weights to compute the netwok output ŷ(i) fo each input vecto x(i) in the taining data. ε(i) = 1 2 k L ( e m (i)) 2 = 1 2 m =1 k L ( ŷ m (i) y m (i)) 2 m =1 This allows us to calculate the eoε(i) fo each of these inputs. Then, in ode to minimize this eo, we incementally update the weights in the negative gadient diection: w j (new) = w j (old) - µ J w j = w j (old) - µ N i =1 ε(i) w j
37 Gadient Descent 37 ( ) t y 1 (i) Since v j (i) = w j, the influence of the jth weight of the th laye on the eo can be expessed as: ε(i) w j = ε(i) v j (i) v j (i) w j = δ j (i)y 1 (i) whee δ j (i) ε(i) v j (i)
38 Gadient Descent 38 ε(i) w j = δ j (i)y 1 (i), whee δ j (i) ε(i) v j (i) Fo an intemediate laye, we cannot compute δ j (i) diectly. Howeve, δ j (i) can be computed inductively, stating fom the output laye.
39 Backpopagation: The Output Laye 39 ε(i) w j = δ j (i)y 1 (i), whee δ j (i) ε(i) v j (i) and ε(i) = 1 2 k L ( e m (i)) 2 = 1 2 m =1 k L m =1 Recall that ŷ m (i) = y L j (i) = f ( v L j (i)) Thus at the output laye we have δ j L (i) = ε(i) v j L (i) = ε(i) e j L (i) ( ŷ m (i) y m (i)) 2 ( ) e L j (i) v L j (i) = e L (i) f v L j j (i) 1 f (a) = 1+ exp( a) f (a) = f (a) 1 f (a) δ j L (i) = e j L (i)f v j L (i) ( ) ( ) ( ) 1 f ( v L j (i))
40 Backpopagation: Hidden Layes 40 Obseve that the dependence of the eo on the total input to a neuon in a pevious laye can be expessed in tems of the dependence on the total input of neuons in the following laye: δ j 1 (i) = ε(i) v j 1 (i) = k ε(i) v k k (i) = δ v k (i) v 1 j (i) k (i) v (i) k v 1 j (i) k =1 k =1 whee v k (i) = k 1 k 1 w km y 1 m (i) = w km m =0 m =0 ( ) Thus we have v (i) k v 1 j (i) = w f v 1 kj j (i) and so δ j 1 (i) = ε(i) v 1 j (i) = f ( ) f v m 1 (i) k v ( 1 (i) j ) δ k (i)w kj ( ) 1 f ( v L j (i)) = f v j L (i) k ( ) δ k (i)w kj Thus once the δ k (i) ae detemined they can be popagated backwad to calculate δ j 1 (i) using this inductive fomula. k =1 k =1
41 41 Repeat until convegence Backpopagation: Summay of Algoithm 1. Initialization Initialize all weights with small andom values 2. Fowad Pass Fo each input vecto, un the netwok in the fowad diection, calculating: 3. Backwad Pass Stating with the output laye, use ou inductive fomula to compute the δ 1 j (i) : n n v j (i) = w j ( ) t y 1 (i); and finally ε(i) = 1 2 Output Laye (Base Case): 4. Update Weights Hidden Layes (Inductive Case): w j (new) = w j (old) - µ y j (i) = f v j (i) k L ( e m (i)) 2 = 1 2 m =1 N i =1 δ L j (i) = e L j (i) f ε(i) w j ( ) k L ( ŷ m (i) y m (i)) 2 m =1 δ 1 j (i) = f ( v L j (i)) whee ε(i) w j k ( v 1 j (i)) δ k (i)w kj k =1 = δ j (i)y 1 (i)
42 Batch vs Online Leaning 42 As descibed, on each iteation backpop updates the weights based upon all of the taining data. This is called batch leaning. w j (new) = w j (old) - µ N i =1 ε(i) w j whee ε(i) w j = δ j (i)y 1 (i) An altenative is to update the weights afte each taining input has been pocessed by the netwok, based only upon the eo fo that input. This is called online leaning. w j (new) = w j (old) - µ ε(i) w j whee ε(i) w j = δ j (i)y 1 (i)
43 Batch vs Online Leaning 43 One advantage of batch leaning is that aveaging ove all inputs when updating the weights should lead to smoothe convegence. On the othe hand, the andomness associated with online leaning might help to pevent convegence towad a local minimum. Changing the ode of pesentation of the inputs fom epoch to epoch may also impove esults.
44 Remaks 44 Local Minima The objective function is in geneal non-convex, and so the solution may not be globally optimal. Stopping Citeion Typically stop when the change in weights o the change in the eo function falls below a theshold. Leaning Rate The speed and eliability of convegence depends on the leaning ate μ.
NONLINEAR CLASSIFICATION AND REGRESSION. J. Elder CSE 4404/5327 Introduction to Machine Learning and Pattern Recognition
NONLINEAR CLASSIFICATION AND REGRESSION Nonlinear Classification and Regression: Outline 2 Multi-Layer Perceptrons The Back-Propagation Learning Algorithm Generalized Linear Models Radial Basis Function
More informationTemporal-Difference Learning
.997 Decision-Making in Lage-Scale Systems Mach 17 MIT, Sping 004 Handout #17 Lectue Note 13 1 Tempoal-Diffeence Leaning We now conside the poblem of computing an appopiate paamete, so that, given an appoximation
More information4/18/2005. Statistical Learning Theory
Statistical Leaning Theoy Statistical Leaning Theoy A model of supevised leaning consists of: a Envionment - Supplying a vecto x with a fixed but unknown pdf F x (x b Teache. It povides a desied esponse
More informationValue Prediction with FA. Chapter 8: Generalization and Function Approximation. Adapt Supervised Learning Algorithms. Backups as Training Examples [ ]
Chapte 8: Genealization and Function Appoximation Objectives of this chapte:! Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat.! Oveview of function
More informationResearch Design - - Topic 17 Multiple Regression & Multiple Correlation: Two Predictors 2009 R.C. Gardner, Ph.D.
Reseach Design - - Topic 7 Multiple Regession & Multiple Coelation: Two Pedictos 009 R.C. Gadne, Ph.D. Geneal Rationale and Basic Aithmetic fo two pedictos Patial and semipatial coelation Regession coefficients
More informationChapter 8: Generalization and Function Approximation
Chapte 8: Genealization and Function Appoximation Objectives of this chapte: Look at how expeience with a limited pat of the state set be used to poduce good behavio ove a much lage pat. Oveview of function
More informationRegularization. Stephen Scott and Vinod Variyam. Introduction. Outline. Machine. Learning. Problems. Measuring. Performance.
leaning can geneally be distilled to an optimization poblem Choose a classifie (function, hypothesis) fom a set of functions that minimizes an objective function Clealy we want pat of this function to
More informationThe Substring Search Problem
The Substing Seach Poblem One algoithm which is used in a vaiety of applications is the family of substing seach algoithms. These algoithms allow a use to detemine if, given two chaacte stings, one is
More informationFE FORMULATIONS FOR PLASTICITY
G These slides ae designed based on the book: Finite Elements in Plasticity Theoy and Pactice, D.R.J. Owen and E. Hinton, 970, Pineidge Pess Ltd., Swansea, UK. Couse Content: A INTRODUCTION AND OVERVIEW
More informationConjugate Gradient Methods. Michael Bader. Summer term 2012
Gadient Methods Outlines Pat I: Quadatic Foms and Steepest Descent Pat II: Gadients Pat III: Summe tem 2012 Pat I: Quadatic Foms and Steepest Descent Outlines Pat I: Quadatic Foms and Steepest Descent
More informationReliability analysis examples
Reliability analysis examples Engineeing Risk Analysis Goup, Technische Univesität München. Acisst., 80 Munich, Gemany. May 8, 08 Intoduction In the context of eliability analysis and ae event estimation,
More informationA Deep Convolutional Neural Network Based on Nested Residue Number System
A Deep Convolutional Neual Netwok Based on Nested Residue Numbe System Hioki Nakahaa Ehime Univesity, Japan Tsutomu Sasao Meiji Univesity, Japan Abstact A pe-tained deep convolutional neual netwok (DCNN)
More informationNew problems in universal algebraic geometry illustrated by boolean equations
New poblems in univesal algebaic geomety illustated by boolean equations axiv:1611.00152v2 [math.ra] 25 Nov 2016 Atem N. Shevlyakov Novembe 28, 2016 Abstact We discuss new poblems in univesal algebaic
More informationAs is natural, our Aerospace Structures will be described in a Euclidean three-dimensional space R 3.
Appendix A Vecto Algeba As is natual, ou Aeospace Stuctues will be descibed in a Euclidean thee-dimensional space R 3. A.1 Vectos A vecto is used to epesent quantities that have both magnitude and diection.
More informationCSCE 478/878 Lecture 4: Experimental Design and Analysis. Stephen Scott. 3 Building a tree on the training set Introduction. Outline.
In Homewok, you ae (supposedly) Choosing a data set 2 Extacting a test set of size > 3 3 Building a tee on the taining set 4 Testing on the test set 5 Repoting the accuacy (Adapted fom Ethem Alpaydin and
More informationInternet Appendix for A Bayesian Approach to Real Options: The Case of Distinguishing Between Temporary and Permanent Shocks
Intenet Appendix fo A Bayesian Appoach to Real Options: The Case of Distinguishing Between Tempoay and Pemanent Shocks Steven R. Genadie Gaduate School of Business, Stanfod Univesity Andey Malenko Gaduate
More informationInformation Retrieval Advanced IR models. Luca Bondi
Advanced IR models Luca Bondi Advanced IR models 2 (LSI) Pobabilistic Latent Semantic Analysis (plsa) Vecto Space Model 3 Stating point: Vecto Space Model Documents and queies epesented as vectos in the
More informationCompactly Supported Radial Basis Functions
Chapte 4 Compactly Suppoted Radial Basis Functions As we saw ealie, compactly suppoted functions Φ that ae tuly stictly conditionally positive definite of ode m > do not exist The compact suppot automatically
More informationNumerical Integration
MCEN 473/573 Chapte 0 Numeical Integation Fall, 2006 Textbook, 0.4 and 0.5 Isopaametic Fomula Numeical Integation [] e [ ] T k = h B [ D][ B] e B Jdsdt In pactice, the element stiffness is calculated numeically.
More informationMultiple Experts with Binary Features
Multiple Expets with Binay Featues Ye Jin & Lingen Zhang Decembe 9, 2010 1 Intoduction Ou intuition fo the poect comes fom the pape Supevised Leaning fom Multiple Expets: Whom to tust when eveyone lies
More informationLight Time Delay and Apparent Position
Light Time Delay and ppaent Position nalytical Gaphics, Inc. www.agi.com info@agi.com 610.981.8000 800.220.4785 Contents Intoduction... 3 Computing Light Time Delay... 3 Tansmission fom to... 4 Reception
More informationAbsorption Rate into a Small Sphere for a Diffusing Particle Confined in a Large Sphere
Applied Mathematics, 06, 7, 709-70 Published Online Apil 06 in SciRes. http://www.scip.og/jounal/am http://dx.doi.og/0.46/am.06.77065 Absoption Rate into a Small Sphee fo a Diffusing Paticle Confined in
More informationScientific Computing II
Scientific Computing II Conjugate Gadient Methods Michael Bade Summe 2014 Conjugate Gadient Methods, Summe 2014 1 Families of Iteative Solves elaxation methods: Jacobi-, Gauss-Seidel-Relaxation,... Ove-Relaxation-Methods
More informationINTRODUCTION. 2. Vectors in Physics 1
INTRODUCTION Vectos ae used in physics to extend the study of motion fom one dimension to two dimensions Vectos ae indispensable when a physical quantity has a diection associated with it As an example,
More informationx 1 b 1 Consider the midpoint x 0 = 1 2
1 chapte 2 : oot-finding def : Given a function f(), a oot is a numbe satisfying f() = 0. e : f() = 2 3 = ± 3 question : How can we find the oots of a geneal function f()? 2.1 bisection method idea : Find
More informationQuantum theory of angular momentum
Quantum theoy of angula momentum Igo Mazets igo.mazets+e141@tuwien.ac.at (Atominstitut TU Wien, Stadionallee 2, 1020 Wien Time: Fiday, 13:00 14:30 Place: Feihaus, Sem.R. DA gün 06B (exception date 18 Nov.:
More informationA Bijective Approach to the Permutational Power of a Priority Queue
A Bijective Appoach to the Pemutational Powe of a Pioity Queue Ia M. Gessel Kuang-Yeh Wang Depatment of Mathematics Bandeis Univesity Waltham, MA 02254-9110 Abstact A pioity queue tansfoms an input pemutation
More informationRANSAC for (Quasi-)Degenerate data (QDEGSAC)
RANSAC fo (Quasi-)Degeneate data (QDEGSAC) Jan-Michael Fahm and Mac Pollefeys Depatment of Compute Science, Univesity of Noth Caolina at Chapel Hill, Chapel Hill, NC 27599 {jmf, mac}@cs.unc.edu Abstact
More informationDo Managers Do Good With Other People s Money? Online Appendix
Do Manages Do Good With Othe People s Money? Online Appendix Ing-Haw Cheng Haison Hong Kelly Shue Abstact This is the Online Appendix fo Cheng, Hong and Shue 2013) containing details of the model. Datmouth
More informationGraphs of Sine and Cosine Functions
Gaphs of Sine and Cosine Functions In pevious sections, we defined the tigonometic o cicula functions in tems of the movement of a point aound the cicumfeence of a unit cicle, o the angle fomed by the
More informationStanford University CS259Q: Quantum Computing Handout 8 Luca Trevisan October 18, 2012
Stanfod Univesity CS59Q: Quantum Computing Handout 8 Luca Tevisan Octobe 8, 0 Lectue 8 In which we use the quantum Fouie tansfom to solve the peiod-finding poblem. The Peiod Finding Poblem Let f : {0,...,
More informationEM Boundary Value Problems
EM Bounday Value Poblems 10/ 9 11/ By Ilekta chistidi & Lee, Seung-Hyun A. Geneal Desciption : Maxwell Equations & Loentz Foce We want to find the equations of motion of chaged paticles. The way to do
More informationRelating Branching Program Size and. Formula Size over the Full Binary Basis. FB Informatik, LS II, Univ. Dortmund, Dortmund, Germany
Relating Banching Pogam Size and omula Size ove the ull Binay Basis Matin Saueho y Ingo Wegene y Ralph Wechne z y B Infomatik, LS II, Univ. Dotmund, 44 Dotmund, Gemany z ankfut, Gemany sauehof/wegene@ls.cs.uni-dotmund.de
More informationSchool of Electrical and Computer Engineering, Cornell University. ECE 303: Electromagnetic Fields and Waves. Fall 2007
School of Electical and Compute Engineeing, Conell Univesity ECE 303: Electomagnetic Fields and Waves Fall 007 Homewok 8 Due on Oct. 19, 007 by 5:00 PM Reading Assignments: i) Review the lectue notes.
More informationAP-C WEP. h. Students should be able to recognize and solve problems that call for application both of conservation of energy and Newton s Laws.
AP-C WEP 1. Wok a. Calculate the wok done by a specified constant foce on an object that undegoes a specified displacement. b. Relate the wok done by a foce to the aea unde a gaph of foce as a function
More informationGeometry of the homogeneous and isotropic spaces
Geomety of the homogeneous and isotopic spaces H. Sonoda Septembe 2000; last evised Octobe 2009 Abstact We summaize the aspects of the geomety of the homogeneous and isotopic spaces which ae most elevant
More informationTopic 4a Introduction to Root Finding & Bracketing Methods
/8/18 Couse Instucto D. Raymond C. Rumpf Office: A 337 Phone: (915) 747 6958 E Mail: cumpf@utep.edu Topic 4a Intoduction to Root Finding & Backeting Methods EE 4386/531 Computational Methods in EE Outline
More informationNumerical solution of diffusion mass transfer model in adsorption systems. Prof. Nina Paula Gonçalves Salau, D.Sc.
Numeical solution of diffusion mass tansfe model in adsoption systems Pof., D.Sc. Agenda Mass Tansfe Mechanisms Diffusion Mass Tansfe Models Solving Diffusion Mass Tansfe Models Paamete Estimation 2 Mass
More informationTransfer Matrix Method
9/6/17 Instucto D. Ramond Rumpf (915) 747 6958 cumpf@utep.edu 5337 Computational lectomagnetics Lectue #4 Tansfe Mati Method Lectue 4These notes ma contain copighted mateial obtained unde fai use ules.
More informationA Relativistic Electron in a Coulomb Potential
A Relativistic Electon in a Coulomb Potential Alfed Whitehead Physics 518, Fall 009 The Poblem Solve the Diac Equation fo an electon in a Coulomb potential. Identify the conseved quantum numbes. Specify
More informationGoodness-of-fit for composite hypotheses.
Section 11 Goodness-of-fit fo composite hypotheses. Example. Let us conside a Matlab example. Let us geneate 50 obsevations fom N(1, 2): X=nomnd(1,2,50,1); Then, unning a chi-squaed goodness-of-fit test
More informationPROBLEM SET #1 SOLUTIONS by Robert A. DiStasio Jr.
POBLM S # SOLUIONS by obet A. DiStasio J. Q. he Bon-Oppenheime appoximation is the standad way of appoximating the gound state of a molecula system. Wite down the conditions that detemine the tonic and
More information4. Some Applications of first order linear differential
August 30, 2011 4-1 4. Some Applications of fist ode linea diffeential Equations The modeling poblem Thee ae seveal steps equied fo modeling scientific phenomena 1. Data collection (expeimentation) Given
More informationPart V: Closed-form solutions to Loop Closure Equations
Pat V: Closed-fom solutions to Loop Closue Equations This section will eview the closed-fom solutions techniques fo loop closue equations. The following thee cases will be consideed. ) Two unknown angles
More informationLecture 04: HFK Propagation Physical Optics II (Optical Sciences 330) (Updated: Friday, April 29, 2005, 8:05 PM) W.J. Dallas
C:\Dallas\0_Couses\0_OpSci_330\0 Lectue Notes\04 HfkPopagation.doc: Page of 9 Lectue 04: HFK Popagation Physical Optics II (Optical Sciences 330) (Updated: Fiday, Apil 9, 005, 8:05 PM) W.J. Dallas The
More informationMathematical Model of Magnetometric Resistivity. Sounding for a Conductive Host. with a Bulge Overburden
Applied Mathematical Sciences, Vol. 7, 13, no. 7, 335-348 Mathematical Model of Magnetometic Resistivity Sounding fo a Conductive Host with a Bulge Ovebuden Teeasak Chaladgan Depatment of Mathematics Faculty
More informationQuantum Fourier Transform
Chapte 5 Quantum Fouie Tansfom Many poblems in physics and mathematics ae solved by tansfoming a poblem into some othe poblem with a known solution. Some notable examples ae Laplace tansfom, Legende tansfom,
More informationTeachers notes. Beyond the Thrills excursions. Worksheets in this book. Completing the worksheets
Beyond the Thills excusions Teaches notes Physics is the science of how the wold (and Univese) woks. Luna Pak Sydney is a lage hands-on physics laboatoy full of fee falling objects, otating systems and
More informationEasy. r p 2 f : r p 2i. r p 1i. r p 1 f. m blood g kg. P8.2 (a) The momentum is p = mv, so v = p/m and the kinetic energy is
Chapte 8 Homewok Solutions Easy P8. Assume the velocity of the blood is constant ove the 0.60 s. Then the patient s body and pallet will have a constant velocity of 6 0 5 m 3.75 0 4 m/ s 0.60 s in the
More informationRecent Advances in Chemical Engineering, Biochemistry and Computational Chemistry
Themal Conductivity of Oganic Liquids: a New Equation DI NICOLA GIOVANNI*, CIARROCCHI ELEONORA, PIERANTOZZI ARIANO, STRYJEK ROAN 1 DIIS, Univesità Politecnica delle ache, 60131 Ancona, ITALY *coesponding
More informationLimited Feedback Scheme for Device to Device Communications in 5G Cellular Networks with Reliability and Cellular Secrecy Outage Constraints
Limited Feedback Scheme fo Device to Device Communications in 5G Cellula Netwoks with Reliability and Cellula Sececy Outage Constaints Faezeh Alavi, Nade Mokai, Mohammad R. Javan, and Kanapathippillai
More informationDirected Regression. Benjamin Van Roy Stanford University Stanford, CA Abstract
Diected Regession Yi-hao Kao Stanfod Univesity Stanfod, CA 94305 yihaoao@stanfod.edu Benjamin Van Roy Stanfod Univesity Stanfod, CA 94305 bv@stanfod.edu Xiang Yan Stanfod Univesity Stanfod, CA 94305 xyan@stanfod.edu
More informationExplosive Contagion in Networks (Supplementary Information)
Eplosive Contagion in Netwoks (Supplementay Infomation) Jesús Gómez-Gadeñes,, Laua Loteo, Segei N. Taaskin, and Fancisco J. Péez-Reche Institute fo Biocomputation and Physics of Comple Systems (BIFI),
More informationPearson s Chi-Square Test Modifications for Comparison of Unweighted and Weighted Histograms and Two Weighted Histograms
Peason s Chi-Squae Test Modifications fo Compaison of Unweighted and Weighted Histogams and Two Weighted Histogams Univesity of Akueyi, Bogi, v/noduslód, IS-6 Akueyi, Iceland E-mail: nikolai@unak.is Two
More informationA Machine Learned Model of a Hybrid Aircraft
1 A Machine Leaned Model of a Hybid Aicaft Bandon Jones, Kevin Jenkins CS229 Machine Leaning, Fall 2016, Stanfod Univesity I. INTRODUCTION Aicaft development pogams ely on aicaft dynamic models fo flight
More informationMath 301: The Erdős-Stone-Simonovitz Theorem and Extremal Numbers for Bipartite Graphs
Math 30: The Edős-Stone-Simonovitz Theoem and Extemal Numbes fo Bipatite Gaphs May Radcliffe The Edős-Stone-Simonovitz Theoem Recall, in class we poved Tuán s Gaph Theoem, namely Theoem Tuán s Theoem Let
More informationMAPPING LARGE PARALLEL SIMULATION PROGRAMS TO MULTICOMPUTER SYSTEMS
A.Tentne (ed.): High Pefomance Computing 1994, Poc. of the SCS Simulation Multiconfeence 1994, San Diego, 11.-15. Apil 1994. S. 285-290. MAPPING LARGE PARALLEL SIMULATION PROGRAMS TO MULTICOMPUTER SYSTEMS
More informationPsychometric Methods: Theory into Practice Larry R. Price
ERRATA Psychometic Methods: Theoy into Pactice Lay R. Pice Eos wee made in Equations 3.5a and 3.5b, Figue 3., equations and text on pages 76 80, and Table 9.1. Vesions of the elevant pages that include
More information6.4 Period and Frequency for Uniform Circular Motion
6.4 Peiod and Fequency fo Unifom Cicula Motion If the object is constained to move in a cicle and the total tangential foce acting on the total object is zeo, F θ = 0, then (Newton s Second Law), the tangential
More informationIn statistical computations it is desirable to have a simplified system of notation to avoid complicated formulas describing mathematical operations.
Chapte 1 STATISTICAL NOTATION AND ORGANIZATION 11 Summation Notation fo a One-Way Classification In statistical computations it is desiable to have a simplified system of notation to avoid complicated
More informationarxiv: v1 [math.co] 4 May 2017
On The Numbe Of Unlabeled Bipatite Gaphs Abdullah Atmaca and A Yavuz Ouç axiv:7050800v [mathco] 4 May 207 Abstact This pape solves a poblem that was stated by M A Haison in 973 [] This poblem, that has
More informationAn Exact Solution of Navier Stokes Equation
An Exact Solution of Navie Stokes Equation A. Salih Depatment of Aeospace Engineeing Indian Institute of Space Science and Technology, Thiuvananthapuam, Keala, India. July 20 The pincipal difficulty in
More informationCOLLAPSING WALLS THEOREM
COLLAPSING WALLS THEOREM IGOR PAK AND ROM PINCHASI Abstact. Let P R 3 be a pyamid with the base a convex polygon Q. We show that when othe faces ae collapsed (otated aound the edges onto the plane spanned
More informationOn the integration of the equations of hydrodynamics
Uebe die Integation de hydodynamischen Gleichungen J f eine u angew Math 56 (859) -0 On the integation of the equations of hydodynamics (By A Clebsch at Calsuhe) Tanslated by D H Delphenich In a pevious
More informationLET a random variable x follows the two - parameter
INTERNATIONAL JOURNAL OF MATHEMATICS AND SCIENTIFIC COMPUTING ISSN: 2231-5330, VOL. 5, NO. 1, 2015 19 Shinkage Bayesian Appoach in Item - Failue Gamma Data In Pesence of Pio Point Guess Value Gyan Pakash
More informationRejection Based Face Detection
Rejection Based Face Detection Michael Elad* Scientific Computing and Computational Mathematics Stanfod Univesit The Compute Vision Wokshop Mach 18 th, 00 * Collaboation with Y. Hel-O and R. Keshet 1 Pat
More information7.2. Coulomb s Law. The Electric Force
Coulomb s aw Recall that chaged objects attact some objects and epel othes at a distance, without making any contact with those objects Electic foce,, o the foce acting between two chaged objects, is somewhat
More informationPhysics 121 Hour Exam #5 Solution
Physics 2 Hou xam # Solution This exam consists of a five poblems on five pages. Point values ae given with each poblem. They add up to 99 points; you will get fee point to make a total of. In any given
More informationDonnishJournals
DonnishJounals 041-1189 Donnish Jounal of Educational Reseach and Reviews. Vol 1(1) pp. 01-017 Novembe, 014. http:///dje Copyight 014 Donnish Jounals Oiginal Reseach Pape Vecto Analysis Using MAXIMA Savaş
More information15.081J/6.251J Introduction to Mathematical Programming. Lecture 6: The Simplex Method II
15081J/6251J Intoduction to Mathematical Pogamming ectue 6: The Simplex Method II 1 Outline Revised Simplex method Slide 1 The full tableau implementation Anticycling 2 Revised Simplex Initial data: A,
More informationCOMPUTATIONS OF ELECTROMAGNETIC FIELDS RADIATED FROM COMPLEX LIGHTNING CHANNELS
Pogess In Electomagnetics Reseach, PIER 73, 93 105, 2007 COMPUTATIONS OF ELECTROMAGNETIC FIELDS RADIATED FROM COMPLEX LIGHTNING CHANNELS T.-X. Song, Y.-H. Liu, and J.-M. Xiong School of Mechanical Engineeing
More information2.5 The Quarter-Wave Transformer
/3/5 _5 The Quate Wave Tansfome /.5 The Quate-Wave Tansfome Reading Assignment: pp. 73-76 By now you ve noticed that a quate-wave length of tansmission line ( λ 4, β π ) appeas often in micowave engineeing
More informationEQUI-PARTITIONING OF HIGHER-DIMENSIONAL HYPER-RECTANGULAR GRID GRAPHS
EQUI-PARTITIONING OF HIGHER-DIMENSIONAL HYPER-RECTANGULAR GRID GRAPHS ATHULA GUNAWARDENA AND ROBERT R MEYER Abstact A d-dimensional gid gaph G is the gaph on a finite subset in the intege lattice Z d in
More informationMATH 415, WEEK 3: Parameter-Dependence and Bifurcations
MATH 415, WEEK 3: Paamete-Dependence and Bifucations 1 A Note on Paamete Dependence We should pause to make a bief note about the ole played in the study of dynamical systems by the system s paametes.
More information11) A thin, uniform rod of mass M is supported by two vertical strings, as shown below.
Fall 2007 Qualifie Pat II 12 minute questions 11) A thin, unifom od of mass M is suppoted by two vetical stings, as shown below. Find the tension in the emaining sting immediately afte one of the stings
More informationLecture 18: Graph Isomorphisms
INFR11102: Computational Complexity 22/11/2018 Lectue: Heng Guo Lectue 18: Gaph Isomophisms 1 An Athu-Melin potocol fo GNI Last time we gave a simple inteactive potocol fo GNI with pivate coins. We will
More informationPhysics 235 Chapter 5. Chapter 5 Gravitation
Chapte 5 Gavitation In this Chapte we will eview the popeties of the gavitational foce. The gavitational foce has been discussed in geat detail in you intoductoy physics couses, and we will pimaily focus
More informationReview: Electrostatics and Magnetostatics
Review: Electostatics and Magnetostatics In the static egime, electomagnetic quantities do not vay as a function of time. We have two main cases: ELECTROSTATICS The electic chages do not change postion
More informationAPPLICATION OF MAC IN THE FREQUENCY DOMAIN
PPLICION OF MC IN HE FREQUENCY DOMIN D. Fotsch and D. J. Ewins Dynamics Section, Mechanical Engineeing Depatment Impeial College of Science, echnology and Medicine London SW7 2B, United Kingdom BSRC he
More informationClassical Worm algorithms (WA)
Classical Wom algoithms (WA) WA was oiginally intoduced fo quantum statistical models by Pokof ev, Svistunov and Tupitsyn (997), and late genealized to classical models by Pokof ev and Svistunov (200).
More informationChapter 2: Introduction to Implicit Equations
Habeman MTH 11 Section V: Paametic and Implicit Equations Chapte : Intoduction to Implicit Equations When we descibe cuves on the coodinate plane with algebaic equations, we can define the elationship
More informationSuggested Solutions to Homework #4 Econ 511b (Part I), Spring 2004
Suggested Solutions to Homewok #4 Econ 5b (Pat I), Sping 2004. Conside a neoclassical gowth model with valued leisue. The (epesentative) consume values steams of consumption and leisue accoding to P t=0
More information3.1 Random variables
3 Chapte III Random Vaiables 3 Random vaiables A sample space S may be difficult to descibe if the elements of S ae not numbes discuss how we can use a ule by which an element s of S may be associated
More informationMachine Learning and Rendering
East Building, Balloom BC nvidia.com/siggaph2018 Machine Leaning and Rendeing Alex Kelle, Diecto of Reseach Machine Leaning and Rendeing Couse web page at https://sites.google.com/site/mlandendeing/ 14:00
More informationgr0 GRAPHS Hanan Samet
g0 GRPHS Hanan Samet ompute Science epatment and ente fo utomation Reseach and Institute fo dvanced ompute Studies Univesity of Mayland ollege Pak, Mayland 074 e-mail: hjs@umiacs.umd.edu opyight 1997 Hanan
More informationA Power Method for Computing Square Roots of Complex Matrices
JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS 13, 39345 1997 ARTICLE NO. AY975517 A Powe Method fo Computing Squae Roots of Complex Matices Mohammed A. Hasan Depatment of Electical Engineeing, Coloado
More informationGrouped data clustering using a fast mixture-model-based algorithm
Poceedings of the 29 IEEE Intenational Confeence on Systems, Man, and Cybenetics San Antonio, TX, USA - Octobe 29 Gouped data clusteing using a fast mixtue-model-based algoithm Allou SAMÉ Laboatoie des
More informationΔt The textbook chooses to say that the average velocity is
1-D Motion Basic I Definitions: One dimensional motion (staight line) is a special case of motion whee all but one vecto component is zeo We will aange ou coodinate axis so that the x-axis lies along the
More informationChapter Eight Notes N P U1C8S4-6
Chapte Eight Notes N P UC8S-6 Name Peiod Section 8.: Tigonometic Identities An identit is, b definition, an equation that is alwas tue thoughout its domain. B tue thoughout its domain, that is to sa that
More informationProbablistically Checkable Proofs
Lectue 12 Pobablistically Checkable Poofs May 13, 2004 Lectue: Paul Beame Notes: Chis Re 12.1 Pobablisitically Checkable Poofs Oveview We know that IP = PSPACE. This means thee is an inteactive potocol
More informationPrediction of Motion Trajectories Based on Markov Chains
2011 Intenational Confeence on Compute Science and Infomation Technology (ICCSIT 2011) IPCSIT vol. 51 (2012) (2012) IACSIT Pess, Singapoe DOI: 10.7763/IPCSIT.2012.V51.50 Pediction of Motion Tajectoies
More information2-Monoid of Observables on String G
2-Monoid of Obsevables on Sting G Scheibe Novembe 28, 2006 Abstact Given any 2-goupoid, we can associate to it a monoidal categoy which can be thought of as the 2-monoid of obsevables of the 2-paticle
More informationComputational Methods of Solid Mechanics. Project report
Computational Methods of Solid Mechanics Poject epot Due on Dec. 6, 25 Pof. Allan F. Bowe Weilin Deng Simulation of adhesive contact with molecula potential Poject desciption In the poject, we will investigate
More informationChem 453/544 Fall /08/03. Exam #1 Solutions
Chem 453/544 Fall 3 /8/3 Exam # Solutions. ( points) Use the genealized compessibility diagam povided on the last page to estimate ove what ange of pessues A at oom tempeatue confoms to the ideal gas law
More informationFUSE Fusion Utility Sequence Estimator
FUSE Fusion Utility Sequence Estimato Belu V. Dasaathy Dynetics, Inc. P. O. Box 5500 Huntsville, AL 3584-5500 belu.d@dynetics.com Sean D. Townsend Dynetics, Inc. P. O. Box 5500 Huntsville, AL 3584-5500
More informationA New Approach to General Relativity
Apeion, Vol. 14, No. 3, July 7 7 A New Appoach to Geneal Relativity Ali Rıza Şahin Gaziosmanpaşa, Istanbul Tukey E-mail: aizasahin@gmail.com Hee we pesent a new point of view fo geneal elativity and/o
More informationThe evolution of the phase space density of particle beams in external fields
The evolution of the phase space density of paticle beams in extenal fields E.G.Bessonov Lebedev Phys. Inst. RAS, Moscow, Russia, COOL 09 Wokshop on Beam Cooling and Related Topics August 31 Septembe 4,
More informationLifting Private Information Retrieval from Two to any Number of Messages
Lifting Pivate Infomation Retieval fom Two to any umbe of Messages Rafael G.L. D Oliveia, Salim El Rouayheb ECE, Rutges Univesity, Piscataway, J Emails: d746@scaletmail.utges.edu, salim.elouayheb@utges.edu
More information1 Explicit Explore or Exploit (E 3 ) Algorithm
2.997 Decision-Making in Lage-Scale Systems Mach 3 MIT, Sping 2004 Handout #2 Lectue Note 9 Explicit Exploe o Exploit (E 3 ) Algoithm Last lectue, we studied the Q-leaning algoithm: [ ] Q t+ (x t, a t
More informationHomework 7 Solutions
Homewok 7 olutions Phys 4 Octobe 3, 208. Let s talk about a space monkey. As the space monkey is oiginally obiting in a cicula obit and is massive, its tajectoy satisfies m mon 2 G m mon + L 2 2m mon 2
More information