An Alternative Scaling Factor In Broyden s Class Methods for Unconstrained Optimization
|
|
- Georgiana Banks
- 5 years ago
- Views:
Transcription
1 Joural of Mathematics ad Statistics 6 (): 63-67, 00 ISSN Sciece Publicatios A Alterative Scalig Factor I Broyde s Class Methods for Ucostraied Optimizatio Muhammad Fauzi bi Embog, Mustafa bi Mamat, Mohd Rivaie ad Ismail bi Mohd Departmet of Computer Sciece ad Mathematics, Uiversity echology MARA, Kuala ereggau Campus, 080 Kuala ereggau, Malaia Departmet of Mathematics, Faculty of Sciece ad echology, Uiversity Malaia ereggau, 030 Kuala ereggau, Malaia Abstract: Problem statemet: I order to calculate step size, a suitable lie search method ca be employed. As the step size usually ot exact, the error is uavoidable, thus radically affect quasi- Newto method by as little as 0. percet of the step size error. Approach: A suitable scalig factor has to be itroduced to overcome this iferiority. Self-scalig Variable Metric algorithms (SSVM s) are commoly used method, where a parameter is itroduced, alterig Broyde s sigle parameter class of approximatios to the iverse esssia to a double parameter class. his study proposes a alterative scalig factor for the algorithms. Results: he alterative scalig factor had bee tried o several commoly test fuctios ad the umerical results shows that the ew scaled algorithm shows sigificat improvemet over the stadard Broyde s class methods. Coclusio: he ew algorithm performace is comparable to the algorithm with iitial scalig o iverse essia approximatio by step size. A improvemet over uscaled BFGS is achieved, as for most of the cases, the umber of iteratios are reduced. Key words: Broyde s class, eigevalues, essia, scalig factor, self-scalig variable matrices INRODUCION he quasi-newto methods are very popular ad efficiet methods for solvig ucostraied optimizatio problem: mi f (x) x R () where, f: R R is a twice cotiuously differetiable fuctio. here are a large umber of quasi-newto methods but the Broyde s class of update is more popular. As other quasi-newto method, the Broyde s method are iterative, whereby at (k+)-th iteratio: x = x +α d () k+ k where, d k deotes the search directio ad α k is its step size. he search directio, d k, is calculated by usig: k = he iverse essia approximatio. he step size α k is a positive step legth chose by a lie search so that at each iteratio either: gd f(x +α d ) f(x ) ηα (4) k dk = kgk (3) (g(xk +αkd k) dk δ dkgk (7) Where: g k = he gradiet of f evaluated at the curret iterate where, < δ< ad δ <δ < (4). x k Correspodig Author: Muhammad Fauzi bi Embog, Departmet of Computer Sciece ad Mathematics, Uiversity echology MARA, Kuala ereggau Campus, 080 Kuala ereggau, Malaia 63 Or: f(x +α d ) f(x ) η g d (5) where, η ad η are positive costats. Note that the coditios (4) ad (5) are assumes i Byrd ad Nocedal (989). hey cover a large class of lie search strategies uder suitable coditios. If the gradiet of f is Lipschitz cotiuous, the for several well kow lie search satisfy the Wolfe coditios: f(x +α d ) f(x ) δα d g (6)
2 J. Math. & Stat., 6 (): 63-67, 00 Byrd ad Nocedal (989) prove that if the ratio betwee successive trial values of α is bouded away from zero, the ew iteratio produced by a backtrackig lie search satisfies (4) ad (5). he iverse essia approximatio is the updated by: ss yyh = + + v v (8) k k yhy k Where: s = x x (9) + k Clearly, whe γ k =, the formula (3) is reduced to Broyde s class update (8). Choices of the scalig factor: he choice of a suitable scalig factor ca be determied by the followig theorem. heorem (Ore ad Lueberger, 974) Let [0,] ad γ k >0 Let k be the iverse essia approximatio ad k + be defied by (3). Let λ λ λ ad µ µ... µ be eigevalues of k ad k+ respectively. he the followig statemets hold: y = g g (0) + k ( ) s v = y y y k k () ad is a parameter that may take ay real value. Accordig to Deis ad More (977), there are two updated formulae that are cotaied i the Broyde s class method, amely BFGS update if the parameter k = 0 ad DFP update if k =. Cosequetly, (.8) may be writte as: DEP BFGS ( ) = + () If we let [0,] (.8) is called Broyde covex family. Meawhile, if [0,-σ] for σ [0,] the (.8) is called the restricted Broyde s class method (Byrd et al., 987). MAERIALS AND MEODS Scalig the Broyde s class method: Self-scalig Variable Metric (SSVM) method: May modificatios have bee applied o quasi-newto methods i attempt to improve its efficiecy. Now, the discussio will be o the self-scalig variable metric algorithms developed by Ore (973) ad Ore ad Lueberger (974). Multiplyig k by γ k ad the replacig γ k k i (8), the Broyde s class formula ca be writte as: yy v v yy k+ = k + γ k+ k (3) where γ k is a self-scalig parameter. he formula (3) is v kow as self-scalig variable metric (SSVM) formula. 64 If γkλ, the µ = ad γkλi+ µ γkλi i =,,,- If γkλi the µ = ad γλ k i µ i γλ k i, i =,3,, If γkλ γkλ ad i 0 is a idex with γkλi0 γkλ i0 γkλ µ γλ k µ... γλ k i0 the i0 i0+ k i0+... µ µ γλ γλ ad there is at least oe eigevalue i µ i0 ad µ i0+ which equals. Readers who are iterested i the proof for the above theorem may refer Ore ad Lueberger (974), or Su ad Yua (006). From the above theorem, it ca be show that: γ k = (4) ss k is a suitable scalig factor (Su ad Yua, 006). Shao ad Phua (978) suggested a simple iitial scalig which require o additioal iformatio about the object fuctio tha that routiely required by variable metric algorithm. Iitially o = I may be used to determie x, where α o is chose accordig to some step legth or liear search criterio to assure sufficiet reductio i the fuctio f. Oce x has bee chose, but before is calculated, 0 ow beig scaled by: Ĥ ad: =α (5) ss yy ˆ ˆ = + v v (6) ˆ ˆ ( ˆ ) s = y y ˆ y 0 k ˆ (7)
3 J. Math. & Stat., 6 (): 63-67, 00 Substitutio of (5) ito (6) yields: yy 0 0 yy 0 α+ v v (8) After the iitial scalig of 0 by a appropriate step size α, the iverse essia approximatio is ever rescaled. Numerical experimets show that the iitial scalig is simple ad effective for a lot of problems i which the curvature chages smoothly (Su ad Yua, 006). A alterative scale factor: I this article, the smallest eigevalue of iverse essia approximatio was proposed as a alterative scalig factor of iitial scalig o as i (5). Replacig step size, α with the smallest eige value of, λ ito (8) yields: yy 0 0 yy 0 λ+ v v (9) As proposed by Shao ad Phua (978), this update is also a iitial scalig o iverse essia approximatio. After the iitial iteratio, the iverse essia approximatio is ever rescaled. he followig algorithm is proposed with the smallest eigevalue of, λ as the scalig factor. (BFGS), with eigevalue scalig (9) (deoted as ES- BFGS) ad with the iitial scalig (8) (deoted as S- BFGS). he three algorithms was applied o eight commoly tested fuctios, cosist of two variables ( = ) (fuctios ad four variable) ( = 4) fuctios: Rosebrock fuctio with = f (x) = 00(x x ) + (x ) Cube fuctio with = f (x) = 00(x x ) + (x ) Shalow fuctio with = 3 f(x) = (x x ) + ( x ) Strait fuctio with = f (x) = (x x ) + 00(x ) Rosebrock fuctio with = 4 f (x) = 00(x x ) + (x ) + 00(x x ) + (x ) Eigevalue scaled algorithm: For simplicity, we let =, thus a modificatio of the BFGS method is obtaied. For other members of Broyde s class methods, this algorithm is also applicable. Step : Iitializatio Give x 0, set k = 0 ad 0 =I. Step : Computig search directio d k = - k g k If g k = 0, the stop. Step 3: Computig step size, α. Step 4: Updatig ew poit, x k+ = x k +α k d k Step 5: Updatig approximatio of iverse essia approximatio, k+. For k =, use (9), else, use (8). Step 6: Coverget test ad stoppig criteria If (x k+ <(x k ) ad gk ε, the stop. Otherwise go to Step with k = k+. RESULS Cube fuctio with = 4 f (x) = 00(x x ) + (x ) + 00(x x ) + (x ) Shalow fuctio with = 4 f(x) = (x x ) + ( x ) + (x x ) + ( x ) Wood fuctio with = 4 f (x) = 00(x x ) + ( x ) + 90(x x ) + ( x ) + 0(x + x ) + 0.(x x ) he umerical results produced by implemetig the three algorithms to the test fuctios are preseted i the able. he efficiecy of the algorithm are based o the umber of iteratios eeded to reach the miimum value of the fuctios. Algorithm with less iteratio is cosidered more efficiet. A tolerace of A MAPLE subroutie was programmed to test three algorithms, BFGS algorithm without scalig ε = 0 6 is set as the stoppig criteria. 65
4 J. Math. & Stat., 6 (): 63-67, 00 able : Numerical results produced by the three tested algorithms, BFGS without scalig (BFGS), with Eigevalue Scalig (ES-BFGS) ad with step size scalig (S-BFGS) Number of iteratios est fuctio Iitial poit BFGS ES-BFGS S-BFGS Rosebrock (-,-) ( = ) (-00,00) (0 000, 0 000) 33 3 Cube (-.,.6) ( = ) (.5,-50) (00, 50) Shalow (5, 5) ( = ) (-00,00) (000,-5000) 9 9 Strait (, ) ( = ). (00,00) (000, 000) 3 3 Rosebrock (-,-,-,-) ( = 4). (-00,00,00,00) (00, 00, 00,.5) Cube (.5,-.5,.5,-.5) ( = 4). (0,-0, 0,-0) (5,-5, 5,-5) Shalow (, 4,, 4) ( = 4) (-00,400,00,400) (000, 000, 000, 000) Wood (,-,,-) 9 4 (= 4) (00,-5, 00,-5) (000, 000, 000, 000) DISCUSSION From the calculatio usig MAPLE software, a iterestig relatio betwee step size ad eigevalues is observed. For iitial iteratio, the value of step size ad the smallest eige value of essia approximatio is almost idetical, but after a umber of iteratios, the differece icreased accordigly. his explais why the ES-BFGS is effective o iitial scalig oly, a similarity with the scaled algorithm proposed by Shao ad Phua (978). Whe the scalig o essia approximatio was doe o every iteratio, the performace of the scaled BFGS deteriorated, or eve failed at all. he umerical results show that the ew algorithm (ES-BFGS) performace is comparable to the algorithm with iitial scalig (S-BFGS). CONCLUSION A improvemet over uscaled BFGS is achieved, as for most of the cases (8 out of 4), the umber of iteratios are reduced. Further ivestigatio will be carried out usig the alterative scalig factor, λ o the other types of quasi-newto methods. he relatioship betwee the smallest eigevalue of essia approximatio ad the optimal step size is also of the iterest i future research, triggerig the possibility of usig eigevalue as a ew step size i the quasi-newto methods. For every test fuctio, the miimum poit is (0,0) for the two variables fuctios ad (0,0,0,0) for the four variables fuctios. he miimum value is equal to zero for all the test fuctios. REFERENCES Byrd, R.., J. Nocedal ad J. Y.X Yua, 987. Global covergece of a class of quasi-ewto methods o Covex problems. SIAM J. Numer. Aal., 4: DOI: 0.37/ Byrd, R.. ad J. Nocedal, 989. A tool for the aalis of quasi-newto methods with applicatio to ucostraied miimizatio. SIAM J. Numer. Aal., 6: DOI: 0.37/07604 Deis, J.E. ad J.J. More, 977. Quasi-Newto methods, motivatio ad theory. SIAM Rev., 9: DOI: 0.37/09005 Ore, S.S. ad D.G. Lueberger, 974. Self-scalig Variable Metric (SSVM) algorithms. Maage. Sci., 0: URL: Ore, S.S., 973. Self-scalig variable metric algorithms without lie search for ucostraied miimizatio. Math. Comput. Am. Math. Soc., 7: URL: 66
5 J. Math. & Stat., 6 (): 63-67, 00 Su, W. ad Y.X. Yua, 006. Optimizatio heory ad Method. Spriger Optimizatio ad Its Applicatios. st Ed., New York USA., ISBN: 0: , pp: Shao, D.F. ad K.. Phua, 978. Matrix coditioig ad oliear optimizatio. Math. Programm., 4: DOI:0.007/BF
Differentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationA collocation method for singular integral equations with cosecant kernel via Semi-trigonometric interpolation
Iteratioal Joural of Mathematics Research. ISSN 0976-5840 Volume 9 Number 1 (017) pp. 45-51 Iteratioal Research Publicatio House http://www.irphouse.com A collocatio method for sigular itegral equatios
More informationSome New Iterative Methods for Solving Nonlinear Equations
World Applied Scieces Joural 0 (6): 870-874, 01 ISSN 1818-495 IDOSI Publicatios, 01 DOI: 10.589/idosi.wasj.01.0.06.830 Some New Iterative Methods for Solvig Noliear Equatios Muhammad Aslam Noor, Khalida
More informationHigher-order iterative methods by using Householder's method for solving certain nonlinear equations
Math Sci Lett, No, 7- ( 7 Mathematical Sciece Letters A Iteratioal Joural http://dxdoiorg/785/msl/5 Higher-order iterative methods by usig Householder's method for solvig certai oliear equatios Waseem
More informationTHE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.
THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of
More informationApplied Mathematics Letters
Applied Mathematics Letters 5 (01) 03 030 Cotets lists available at SciVerse ScieceDirect Applied Mathematics Letters joural homepage: www.elsevier.com/locate/aml O ew computatioal local orders of covergece
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More information1 Duality revisited. AM 221: Advanced Optimization Spring 2016
AM 22: Advaced Optimizatio Sprig 206 Prof. Yaro Siger Sectio 7 Wedesday, Mar. 9th Duality revisited I this sectio, we will give a slightly differet perspective o duality. optimizatio program: f(x) x R
More informationNEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE
UPB Sci Bull, Series A, Vol 79, Iss, 207 ISSN 22-7027 NEW FAST CONVERGENT SEQUENCES OF EULER-MASCHERONI TYPE Gabriel Bercu We itroduce two ew sequeces of Euler-Mascheroi type which have fast covergece
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationA NEW CLASS OF 2-STEP RATIONAL MULTISTEP METHODS
Jural Karya Asli Loreka Ahli Matematik Vol. No. (010) page 6-9. Jural Karya Asli Loreka Ahli Matematik A NEW CLASS OF -STEP RATIONAL MULTISTEP METHODS 1 Nazeeruddi Yaacob Teh Yua Yig Norma Alias 1 Departmet
More informationIntroduction to Optimization Techniques. How to Solve Equations
Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually
More informationMachine Learning Brett Bernstein
Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio
More informationChapter 2 The Solution of Numerical Algebraic and Transcendental Equations
Chapter The Solutio of Numerical Algebraic ad Trascedetal Equatios Itroductio I this chapter we shall discuss some umerical methods for solvig algebraic ad trascedetal equatios. The equatio f( is said
More informationPAijpam.eu ON TENSOR PRODUCT DECOMPOSITION
Iteratioal Joural of Pure ad Applied Mathematics Volume 103 No 3 2015, 537-545 ISSN: 1311-8080 (prited versio); ISSN: 1314-3395 (o-lie versio) url: http://wwwijpameu doi: http://dxdoiorg/1012732/ijpamv103i314
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationNewton Homotopy Solution for Nonlinear Equations Using Maple14. Abstract
Joural of Sciece ad Techology ISSN 9-860 Vol. No. December 0 Newto Homotopy Solutio for Noliear Equatios Usig Maple Nor Haim Abd. Rahma, Arsmah Ibrahim, Mohd Idris Jayes Faculty of Computer ad Mathematical
More informationThe Choquet Integral with Respect to Fuzzy-Valued Set Functions
The Choquet Itegral with Respect to Fuzzy-Valued Set Fuctios Weiwei Zhag Abstract The Choquet itegral with respect to real-valued oadditive set fuctios, such as siged efficiecy measures, has bee used i
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationG. R. Pasha Department of Statistics Bahauddin Zakariya University Multan, Pakistan
Deviatio of the Variaces of Classical Estimators ad Negative Iteger Momet Estimator from Miimum Variace Boud with Referece to Maxwell Distributio G. R. Pasha Departmet of Statistics Bahauddi Zakariya Uiversity
More informationDiscrete Orthogonal Moment Features Using Chebyshev Polynomials
Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationMath 312 Lecture Notes One Dimensional Maps
Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationSection A assesses the Units Numerical Analysis 1 and 2 Section B assesses the Unit Mathematics for Applied Mathematics
X0/70 NATIONAL QUALIFICATIONS 005 MONDAY, MAY.00 PM 4.00 PM APPLIED MATHEMATICS ADVANCED HIGHER Numerical Aalysis Read carefully. Calculators may be used i this paper.. Cadidates should aswer all questios.
More informationNumerical Conformal Mapping via a Fredholm Integral Equation using Fourier Method ABSTRACT INTRODUCTION
alaysia Joural of athematical Scieces 3(1): 83-93 (9) umerical Coformal appig via a Fredholm Itegral Equatio usig Fourier ethod 1 Ali Hassa ohamed urid ad Teh Yua Yig 1, Departmet of athematics, Faculty
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More informationNumber of Spanning Trees of Circulant Graphs C 6n and their Applications
Joural of Mathematics ad Statistics 8 (): 4-3, 0 ISSN 549-3644 0 Sciece Publicatios Number of Spaig Trees of Circulat Graphs C ad their Applicatios Daoud, S.N. Departmet of Mathematics, Faculty of Sciece,
More informationMATH 10550, EXAM 3 SOLUTIONS
MATH 155, EXAM 3 SOLUTIONS 1. I fidig a approximate solutio to the equatio x 3 +x 4 = usig Newto s method with iitial approximatio x 1 = 1, what is x? Solutio. Recall that x +1 = x f(x ) f (x ). Hece,
More informationMarkov Decision Processes
Markov Decisio Processes Defiitios; Statioary policies; Value improvemet algorithm, Policy improvemet algorithm, ad liear programmig for discouted cost ad average cost criteria. Markov Decisio Processes
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationCS537. Numerical Analysis and Computing
CS57 Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 Jauary 9 9 What is the Root May physical system ca be
More informationIN many scientific and engineering applications, one often
INTERNATIONAL JOURNAL OF COMPUTING SCIENCE AND APPLIED MATHEMATICS, VOL 3, NO, FEBRUARY 07 5 Secod Degree Refiemet Jacobi Iteratio Method for Solvig System of Liear Equatio Tesfaye Kebede Abstract Several
More informationLecture 8: Solving the Heat, Laplace and Wave equations using finite difference methods
Itroductory lecture otes o Partial Differetial Equatios - c Athoy Peirce. Not to be copied, used, or revised without explicit writte permissio from the copyright ower. 1 Lecture 8: Solvig the Heat, Laplace
More informationDECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS. Park Road, Islamabad, Pakistan
Mathematical ad Computatioal Applicatios, Vol. 9, No. 3, pp. 30-40, 04 DECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS Muhammad Aslam Noor, Khalida Iayat Noor ad Asif Waheed
More informationNumerical Solution of the Two Point Boundary Value Problems By Using Wavelet Bases of Hermite Cubic Spline Wavelets
Australia Joural of Basic ad Applied Scieces, 5(): 98-5, ISSN 99-878 Numerical Solutio of the Two Poit Boudary Value Problems By Usig Wavelet Bases of Hermite Cubic Splie Wavelets Mehdi Yousefi, Hesam-Aldie
More informationTrue Nature of Potential Energy of a Hydrogen Atom
True Nature of Potetial Eergy of a Hydroge Atom Koshu Suto Key words: Bohr Radius, Potetial Eergy, Rest Mass Eergy, Classical Electro Radius PACS codes: 365Sq, 365-w, 33+p Abstract I cosiderig the potetial
More information-ORDER CONVERGENCE FOR FINDING SIMPLE ROOT OF A POLYNOMIAL EQUATION
NEW NEWTON-TYPE METHOD WITH k -ORDER CONVERGENCE FOR FINDING SIMPLE ROOT OF A POLYNOMIAL EQUATION R. Thukral Padé Research Cetre, 39 Deaswood Hill, Leeds West Yorkshire, LS7 JS, ENGLAND ABSTRACT The objective
More informationSimple Linear Regression
Chapter 2 Simple Liear Regressio 2.1 Simple liear model The simple liear regressio model shows how oe kow depedet variable is determied by a sigle explaatory variable (regressor). Is is writte as: Y i
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationEstimation of Backward Perturbation Bounds For Linear Least Squares Problem
dvaced Sciece ad Techology Letters Vol.53 (ITS 4), pp.47-476 http://dx.doi.org/.457/astl.4.53.96 Estimatio of Bacward Perturbatio Bouds For Liear Least Squares Problem Xixiu Li School of Natural Scieces,
More informationREGRESSION (Physics 1210 Notes, Partial Modified Appendix A)
REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data
More informationDISTRIBUTION LAW Okunev I.V.
1 DISTRIBUTION LAW Okuev I.V. Distributio law belogs to a umber of the most complicated theoretical laws of mathematics. But it is also a very importat practical law. Nothig ca help uderstad complicated
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More informationStability Analysis of the Euler Discretization for SIR Epidemic Model
Stability Aalysis of the Euler Discretizatio for SIR Epidemic Model Agus Suryato Departmet of Mathematics, Faculty of Scieces, Brawijaya Uiversity, Jl Vetera Malag 6545 Idoesia Abstract I this paper we
More information4.1 Sigma Notation and Riemann Sums
0 the itegral. Sigma Notatio ad Riema Sums Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each simple shape, ad the add these smaller areas
More informationINEQUALITIES BJORN POONEN
INEQUALITIES BJORN POONEN 1 The AM-GM iequality The most basic arithmetic mea-geometric mea (AM-GM) iequality states simply that if x ad y are oegative real umbers, the (x + y)/2 xy, with equality if ad
More informationResearch Article A New Second-Order Iteration Method for Solving Nonlinear Equations
Abstract ad Applied Aalysis Volume 2013, Article ID 487062, 4 pages http://dx.doi.org/10.1155/2013/487062 Research Article A New Secod-Order Iteratio Method for Solvig Noliear Equatios Shi Mi Kag, 1 Arif
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationw (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.
2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For
More informationA PENALTY-CONJUGATE GRADIENT ALGORITHM FOR SOLVING CONSTRAINED OPTIMIZATION PROBLEMS
IJRRAS 35 () April 8 wwwarpapresscom/volumes/vol35issue/ijrras_35 pdf A PENALY-CONJUGAE GRADIEN ALGORIHM FOR SOLVING CONSRAINED OPIMIZAION PROBLEMS Hoia Zha Zhuohua Lia & Weli Zhao School of Mathematics
More informationCS321. Numerical Analysis and Computing
CS Numerical Aalysis ad Computig Lecture Locatig Roots o Equatios Proessor Ju Zhag Departmet o Computer Sciece Uiversity o Ketucky Leigto KY 456-6 September 8 5 What is the Root May physical system ca
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationPC5215 Numerical Recipes with Applications - Review Problems
PC55 Numerical Recipes with Applicatios - Review Problems Give the IEEE 754 sigle precisio bit patter (biary or he format) of the followig umbers: 0 0 05 00 0 00 Note that it has 8 bits for the epoet,
More informationSOME TRIBONACCI IDENTITIES
Mathematics Today Vol.7(Dec-011) 1-9 ISSN 0976-38 Abstract: SOME TRIBONACCI IDENTITIES Shah Devbhadra V. Sir P.T.Sarvajaik College of Sciece, Athwalies, Surat 395001. e-mail : drdvshah@yahoo.com The sequece
More informationNotes on iteration and Newton s method. Iteration
Notes o iteratio ad Newto s method Iteratio Iteratio meas doig somethig over ad over. I our cotet, a iteratio is a sequece of umbers, vectors, fuctios, etc. geerated by a iteratio rule of the type 1 f
More informationEstimation of Population Mean Using Co-Efficient of Variation and Median of an Auxiliary Variable
Iteratioal Joural of Probability ad Statistics 01, 1(4: 111-118 DOI: 10.593/j.ijps.010104.04 Estimatio of Populatio Mea Usig Co-Efficiet of Variatio ad Media of a Auxiliary Variable J. Subramai *, G. Kumarapadiya
More informationSolving a Nonlinear Equation Using a New Two-Step Derivative Free Iterative Methods
Applied ad Computatioal Mathematics 07; 6(6): 38-4 http://www.sciecepublishiggroup.com/j/acm doi: 0.648/j.acm.070606. ISSN: 38-5605 (Prit); ISSN: 38-563 (Olie) Solvig a Noliear Equatio Usig a New Two-Step
More informationn 3 ln n n ln n is convergent by p-series for p = 2 > 1. n2 Therefore we can apply Limit Comparison Test to determine lutely convergent.
06 微甲 0-04 06-0 班期中考解答和評分標準. ( poits) Determie whether the series is absolutely coverget, coditioally coverget, or diverget. Please state the tests which you use. (a) ( poits) (b) ( poits) (c) ( poits)
More informationMonte Carlo Optimization to Solve a Two-Dimensional Inverse Heat Conduction Problem
Australia Joural of Basic Applied Scieces, 5(): 097-05, 0 ISSN 99-878 Mote Carlo Optimizatio to Solve a Two-Dimesioal Iverse Heat Coductio Problem M Ebrahimi Departmet of Mathematics, Karaj Brach, Islamic
More informationCommutativity in Permutation Groups
Commutativity i Permutatio Groups Richard Wito, PhD Abstract I the group Sym(S) of permutatios o a oempty set S, fixed poits ad trasiet poits are defied Prelimiary results o fixed ad trasiet poits are
More informationON WELLPOSEDNESS QUADRATIC FUNCTION MINIMIZATION PROBLEM ON INTERSECTION OF TWO ELLIPSOIDS * M. JA]IMOVI], I. KRNI] 1.
Yugoslav Joural of Operatios Research 1 (00), Number 1, 49-60 ON WELLPOSEDNESS QUADRATIC FUNCTION MINIMIZATION PROBLEM ON INTERSECTION OF TWO ELLIPSOIDS M. JA]IMOVI], I. KRNI] Departmet of Mathematics
More informationRecursive Algorithm for Generating Partitions of an Integer. 1 Preliminary
Recursive Algorithm for Geeratig Partitios of a Iteger Sug-Hyuk Cha Computer Sciece Departmet, Pace Uiversity 1 Pace Plaza, New York, NY 10038 USA scha@pace.edu Abstract. This article first reviews the
More informationLecture 24: Variable selection in linear models
Lecture 24: Variable selectio i liear models Cosider liear model X = Z β + ε, β R p ad Varε = σ 2 I. Like the LSE, the ridge regressio estimator does ot give 0 estimate to a compoet of β eve if that compoet
More informationMIDTERM 3 CALCULUS 2. Monday, December 3, :15 PM to 6:45 PM. Name PRACTICE EXAM SOLUTIONS
MIDTERM 3 CALCULUS MATH 300 FALL 08 Moday, December 3, 08 5:5 PM to 6:45 PM Name PRACTICE EXAM S Please aswer all of the questios, ad show your work. You must explai your aswers to get credit. You will
More informationA note on the modified Hermitian and skew-hermitian splitting methods for non-hermitian positive definite linear systems
A ote o the modified Hermitia ad skew-hermitia splittig methods for o-hermitia positive defiite liear systems Shi-Liag Wu Tig-Zhu Huag School of Applied Mathematics Uiversity of Electroic Sciece ad Techology
More informationDefinitions and Theorems. where x are the decision variables. c, b, and a are constant coefficients.
Defiitios ad Theorems Remember the scalar form of the liear programmig problem, Miimize, Subject to, f(x) = c i x i a 1i x i = b 1 a mi x i = b m x i 0 i = 1,2,, where x are the decisio variables. c, b,
More information4.1 SIGMA NOTATION AND RIEMANN SUMS
.1 Sigma Notatio ad Riema Sums Cotemporary Calculus 1.1 SIGMA NOTATION AND RIEMANN SUMS Oe strategy for calculatig the area of a regio is to cut the regio ito simple shapes, calculate the area of each
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationThe picture in figure 1.1 helps us to see that the area represents the distance traveled. Figure 1: Area represents distance travelled
1 Lecture : Area Area ad distace traveled Approximatig area by rectagles Summatio The area uder a parabola 1.1 Area ad distace Suppose we have the followig iformatio about the velocity of a particle, how
More informationΩ ). Then the following inequality takes place:
Lecture 8 Lemma 5. Let f : R R be a cotiuously differetiable covex fuctio. Choose a costat δ > ad cosider the subset Ωδ = { R f δ } R. Let Ωδ ad assume that f < δ, i.e., is ot o the boudary of f = δ, i.e.,
More informationModified Decomposition Method by Adomian and. Rach for Solving Nonlinear Volterra Integro- Differential Equations
Noliear Aalysis ad Differetial Equatios, Vol. 5, 27, o. 4, 57-7 HIKARI Ltd, www.m-hikari.com https://doi.org/.2988/ade.27.62 Modified Decompositio Method by Adomia ad Rach for Solvig Noliear Volterra Itegro-
More informationBrief Review of Functions of Several Variables
Brief Review of Fuctios of Several Variables Differetiatio Differetiatio Recall, a fuctio f : R R is differetiable at x R if ( ) ( ) lim f x f x 0 exists df ( x) Whe this limit exists we call it or f(
More informationQuantum Annealing for Heisenberg Spin Chains
LA-UR # - Quatum Aealig for Heiseberg Spi Chais G.P. Berma, V.N. Gorshkov,, ad V.I.Tsifriovich Theoretical Divisio, Los Alamos Natioal Laboratory, Los Alamos, NM Istitute of Physics, Natioal Academy of
More informationLecture #18
18-1 Variatioal Method (See CTDL 1148-1155, [Variatioal Method] 252-263, 295-307[Desity Matrices]) Last time: Quasi-Degeeracy Diagoalize a part of ifiite H * sub-matrix : H (0) + H (1) * correctios for
More informationSynopsis of Euler s paper. E Memoire sur la plus grande equation des planetes. (Memoir on the Maximum value of an Equation of the Planets)
1 Syopsis of Euler s paper E105 -- Memoire sur la plus grade equatio des plaetes (Memoir o the Maximum value of a Equatio of the Plaets) Compiled by Thomas J Osler ad Jase Adrew Scaramazza Mathematics
More informationThe axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c.
5.4 Applicatio of Perturbatio Methods to the Dispersio Model for Tubular Reactors The axial dispersio model for tubular reactors at steady state ca be described by the followig equatios: d c Pe dz z =
More informationPAijpam.eu ON DERIVATION OF RATIONAL SOLUTIONS OF BABBAGE S FUNCTIONAL EQUATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 94 No. 204, 9-20 ISSN: 3-8080 (prited versio); ISSN: 34-3395 (o-lie versio) url: http://www.ijpam.eu doi: http://dx.doi.org/0.2732/ijpam.v94i.2 PAijpam.eu
More informationTaylor polynomial solution of difference equation with constant coefficients via time scales calculus
TMSCI 3, o 3, 129-135 (2015) 129 ew Treds i Mathematical Scieces http://wwwtmscicom Taylor polyomial solutio of differece equatio with costat coefficiets via time scales calculus Veysel Fuat Hatipoglu
More informationSection 1.1. Calculus: Areas And Tangents. Difference Equations to Differential Equations
Differece Equatios to Differetial Equatios Sectio. Calculus: Areas Ad Tagets The study of calculus begis with questios about chage. What happes to the velocity of a swigig pedulum as its positio chages?
More informationProperties of Fuzzy Length on Fuzzy Set
Ope Access Library Joural 206, Volume 3, e3068 ISSN Olie: 2333-972 ISSN Prit: 2333-9705 Properties of Fuzzy Legth o Fuzzy Set Jehad R Kider, Jaafar Imra Mousa Departmet of Mathematics ad Computer Applicatios,
More informationChandrasekhar Type Algorithms. for the Riccati Equation of Lainiotis Filter
Cotemporary Egieerig Scieces, Vol. 3, 00, o. 4, 9-00 Chadrasekhar ype Algorithms for the Riccati Equatio of Laiiotis Filter Nicholas Assimakis Departmet of Electroics echological Educatioal Istitute of
More informationRecurrence Relations
Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The
More information1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable
More informationDiscretized Scheme Examining Convergence and Geometric Ratio Profiles for Control Problem Constrained by Evolution Equation
Joural of Mathematics ad Statistics 7 (: 6-, ISSN 549-644 Sciece Publicatios Discretized Scheme Examiig Covergece ad Geometric Ratio Profiles for Cotrol Problem Costraied by Evolutio Equatio O. Olotu Departmet
More informationChapter 4. Fourier Series
Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,
More informationA New Solution Method for the Finite-Horizon Discrete-Time EOQ Problem
This is the Pre-Published Versio. A New Solutio Method for the Fiite-Horizo Discrete-Time EOQ Problem Chug-Lu Li Departmet of Logistics The Hog Kog Polytechic Uiversity Hug Hom, Kowloo, Hog Kog Phoe: +852-2766-7410
More informationl -State Solutions of a New Four-Parameter 1/r^2 Singular Radial Non-Conventional Potential via Asymptotic Iteration Method
America Joural of Computatioal ad Applied Mathematics 8, 8(): 7-3 DOI:.593/j.ajcam.88. l -State Solutios of a New Four-Parameter /r^ Sigular Radial No-Covetioal Potetial via Asymptotic Iteratio Method
More informationA Block Cipher Using Linear Congruences
Joural of Computer Sciece 3 (7): 556-560, 2007 ISSN 1549-3636 2007 Sciece Publicatios A Block Cipher Usig Liear Cogrueces 1 V.U.K. Sastry ad 2 V. Jaaki 1 Academic Affairs, Sreeidhi Istitute of Sciece &
More information62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +
62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of
More informationPrinciple Of Superposition
ecture 5: PREIMINRY CONCEP O RUCUR NYI Priciple Of uperpositio Mathematically, the priciple of superpositio is stated as ( a ) G( a ) G( ) G a a or for a liear structural system, the respose at a give
More informationHOUSEHOLDER S APPROXIMANTS AND CONTINUED FRACTION EXPANSION OF QUADRATIC IRRATIONALS. Vinko Petričević University of Zagreb, Croatia
HOUSEHOLDER S APPROXIMANTS AND CONTINUED FRACTION EXPANSION OF QUADRATIC IRRATIONALS Viko Petričević Uiversity of Zagre, Croatia Astract There are umerous methods for ratioal approximatio of real umers
More informationEigenvalue localization for complex matrices
Electroic Joural of Liear Algebra Volume 7 Article 1070 014 Eigevalue localizatio for complex matrices Ibrahim Halil Gumus Adıyama Uiversity, igumus@adiyama.edu.tr Omar Hirzallah Hashemite Uiversity, o.hirzal@hu.edu.jo
More informationON POINTWISE BINOMIAL APPROXIMATION
Iteratioal Joural of Pure ad Applied Mathematics Volume 71 No. 1 2011, 57-66 ON POINTWISE BINOMIAL APPROXIMATION BY w-functions K. Teerapabolar 1, P. Wogkasem 2 Departmet of Mathematics Faculty of Sciece
More informationt distribution [34] : used to test a mean against an hypothesized value (H 0 : µ = µ 0 ) or the difference
EXST30 Backgroud material Page From the textbook The Statistical Sleuth Mea [0]: I your text the word mea deotes a populatio mea (µ) while the work average deotes a sample average ( ). Variace [0]: The
More informationAdvanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology
Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4
More informationSolution of Differential Equation from the Transform Technique
Iteratioal Joural of Computatioal Sciece ad Mathematics ISSN 0974-3189 Volume 3, Number 1 (2011), pp 121-125 Iteratioal Research Publicatio House http://wwwirphousecom Solutio of Differetial Equatio from
More informationDecoupling Zeros of Positive Discrete-Time Linear Systems*
Circuits ad Systems,,, 4-48 doi:.436/cs..7 Published Olie October (http://www.scirp.org/oural/cs) Decouplig Zeros of Positive Discrete-Time Liear Systems* bstract Tadeusz Kaczorek Faculty of Electrical
More information