lecture 16: Introduction to Least Squares Approximation

Size: px
Start display at page:

Download "lecture 16: Introduction to Least Squares Approximation"

Transcription

1 97 lecture 16: Itroductio to Lest Squres Approximtio.4 Lest squres pproximtio The miimx criterio is ituitive objective for pproximtig fuctio. However, i my cses it is more ppelig (for both computtio d for the give pplictio) to fid pproximtio to f tht miimizes the itegrl of the squre of the error. Give f C[, b], fid P P such tht 1/ 1/. ( f (x) P (x)) dx mi ( f (x) p(x)) dx pp This is exmple of lest squres problem..4.1 Ier products for fuctio spces To fcilitte the developmet of lest squres pproximtio theory, we itroduce forml structure for C[, b]. First, recogize tht C[, b] is lier spce: y lier combitio of cotiuous fuctios o [, b] must itself be cotiuous o [, b]. Defiitio.. The ier product of the fuctios f, g C[, b] is h f, gi f (x)g(x) dx. The ier product stisfies the followig bsic xioms: h f + g, hi h f, hi + hg, hi for ll f, g, h C[, b] d ll IR; h f, gi hg, f i for ll f, g C[, b]; h f, f i for ll f C[, b]. With this ier product we ssocite the orm For simplicity we re ssumig tht f d g re rel-vlued. To hdle complex-vlued fuctios, oe geerlizes the ier product to h f, gi f (x)g(x) dx, which the gives h f, gi hg, f i. 1/. k f k : h f, f i 1/ f (x) dx This is ofte clled the L orm, where the superscript i L refers to the fct tht the itegrd ivolves the squre of the fuctio f ; the L stds for Lebesgue, comig from the fct tht this ier product c be geerlized from C[, b] to the set of ll fuctios tht re squre-itegrble, i the sese of Lebesgue itegrtio. By restrictig our ttetio to cotiuous fuctios, we dodge the mesuretheoretic complexities. The Lebesgue theory gives more robust defiitio of the itegrl th the covetiol Riem pproch. With such otios oe c exted lest squres pproximtio beyod C[, b], to more exotic fuctio spces.

2 98.4. Lest squres miimiztio vi clculus We re ow redy to solve the lest squres problem. We shll cll the optiml polyomil P P, i.e., k f P k mi pp k f pk. We c solve this miimiztio problem usig bsic clculus. Cosider this exmple for 1, where we optimize the error over polyomils of the form p(x) c + c 1 x. The polyomil tht miimizes k f pk will lso miimize its squre, k f pk. For y give p P 1, defie the error fuctio E(c, c 1 ) : k f (x) (c + c 1 x)k L ( f (x) c c 1 x) dx f (x) f (x)(c + c 1 x)+(c + c c 1 x + c 1 x ) dx f (x) dx c f (x) dx To fid the optiml polyomil, P, optimize E over c d c 1, i.e., fid the vlues of c d c 1 for which c 1 xf(x) dx + c (b )+c c 1 (b )+ 1 c 1 (b ). First, compute. c c 1 Z b f (x) dx + c (b )+c c 1 (b ) Z b xf(x) dx + c (b )+c c 1 (b ). 1 Settig these prtil derivtives equl to zero yields c (b )+c 1 (b ) f (x) dx c (b )+c 1 (b ) xf(x) dx. These equtios, lier i the ukows c d c 1, c be writte i the mtrix form " (b ) b # b (b ) #" c c 1 4 R b R b f (x) dx xf(x) dx Whe b 6 this system lwys hs uique solutio. The resultig c d c 1 re the coefficiets for the moomil-bsis expsio of the lest squres pproximtio P P 1 to f o [, b]. 5.

3 99 Exmple.4 ( f (x) e x ). Apply this result to f (x) e x for x [, 1]. Sice Z 1 e x dx e 1, Z 1 xe x dx e x (x 1) 1 x 1, we must solve the system " 1 #" c # " e # 1 c 1. The desired solutio is c 4e 1, c e. Figure.7 compres f to this lest squres pproximtio P d the miimx pproximtio p computed erlier x Figure.7: Top: Approximtio of f (x) e x (blue) over x [, 1] vi lest squres (P, show i red) d miimx (p, show s gry lie). Bottom: Error curves for lest squres, f P (red), d miimx, f p (gry) pproximtio. While the curves hve similr shpe, ote tht the red curve does ot tti its mximum devitio from f t + poits, while the gry oe does.. error, f (x) p(x) lest squres miimx x We c see from the plots i Figure.7 tht the pproximtio looks decet to the eye, but the error is ot terribly smll. We c I fct, k f P k This is decrese tht error by icresig the degree of the pproximtig polyomil. Just s we used -by- lier system to fid the best lier pproximtio, geerl ( + 1)-by-( + 1) lier system c be costructed to yield the degree- lest squres pproximtio. ideed smller th the -orm error of the miimx pproximtio p : k f p k

4 1.4. Geerl polyomil bses Note tht we performed the bove miimiztio i the moomil bsis: p(x) c + c 1 x is lier combitio of 1 d x. Our experiece with iterpoltio suggests tht differet choices for the bsis my yield pproximtio lgorithms with superior umericl properties. Thus, we develop the form of the pproximtig polyomil i rbitrry bsis. Suppose {f k } is bsis for P. Ay p P c be writte s p(x) The error expressio tkes the form c k f k (x). E(c,...,c ) : k f (x) p(x)k L f (x) c k f k (x) dx h f, f i c k h f, f k i + ` To miimize E, we seek criticl vlues of c [c,...,c +1 ] T IR +1, i.e., we wt coefficiets where the grdiet of E with respect to c is zero: r c E. To compute this grdiet, evlute / for j,..., : h f, f i c k h f, f k i + h f, f j i + c j hf j, f j i + k6j ` c k c j hf k, f j i + ` `6j c j c`hf j, f`i + I this lst lie, we hve broke the double sum o the previous lie ito four prts: oe tht cotis c j, two tht coti c j (c k c j for k 6 j; c j c` for ` 6 j), d oe (the double sum) tht does ot ivolve c j t ll. This decompositio mkes it esier to compute the derivtive: c j c hf j, f j i + j k6j c k c j hf k, f j i + c j hf j, f j i + c j hf j, f j i + k6j k6j ` `6j c j c`hf j, f`i + c k hf k, f j i + c k hf k, f j i. ` `6j ` k6j `6j c`hf j, f`i +. ` k6j `6j

5 11 These terms cotribute to / to give (.1) h f, f i + j c k hf k, f j i. To miimize E, set / for j,...,, which gives the + 1 equtios (.1) c k hf k, f j i h f, f j i, j,...,, i the + 1 ukows c,...,c. Sice these equtios re lier i the ukows, write them i mtrix form: hf, f i hf, f 1 i hf, f i c h f, f i hf 1, f i hf 1, f 1 i. c 1. h f, f 6. 1 i, hf, f i hf, f 1 i hf, f i h f, f i which we deote Gc b. The mtrix G is clled the Grm mtrix. Usig this mtrix-vector ottio, we c ccumulte the prtil derivtives formuls (.1) for E ito the grdiet r c E Gc b. Sice c is criticl poit if d oly if r c E(c), we must sk: How my criticl poits re there? Equivletly, how my c solve Gc b? If c is criticl poit, is it (locl or eve globl) miimum? We will swer the first questio by showig tht G is ivertible, d hece E hs uique criticl poit. To swer the secod questio, we must ispect the Hessi c r c E r c (r c E)G. The criticl poit c is locl miimum if d oly if the Hessi is symmetric positive defiite. The symmetry of the ier product implies hf j, f k i hf k, f j i, d hece G is symmetric. (I this cse, symmetry lso follows from the equivlece of mixed prtil deritivtes.) The followig theorem cofirms tht G is ideed positive defiite. A mtrix G is positive defiite provided z Gz > for ll z 6.

We will begin by supplying the proof to (a).

We will begin by supplying the proof to (a). (The solutios of problem re mostly from Jeffrey Mudrock s HWs) Problem 1. There re three sttemet from Exmple 5.4 i the textbook for which we will supply proofs. The sttemets re the followig: () The spce

More information

1.3 Continuous Functions and Riemann Sums

1.3 Continuous Functions and Riemann Sums mth riem sums, prt 0 Cotiuous Fuctios d Riem Sums I Exmple we sw tht lim Lower() = lim Upper() for the fuctio!! f (x) = + x o [0, ] This is o ccidet It is exmple of the followig theorem THEOREM Let f be

More information

Week 13 Notes: 1) Riemann Sum. Aim: Compute Area Under a Graph. Suppose we want to find out the area of a graph, like the one on the right:

Week 13 Notes: 1) Riemann Sum. Aim: Compute Area Under a Graph. Suppose we want to find out the area of a graph, like the one on the right: Week 1 Notes: 1) Riem Sum Aim: Compute Are Uder Grph Suppose we wt to fid out the re of grph, like the oe o the right: We wt to kow the re of the red re. Here re some wys to pproximte the re: We cut the

More information

0 otherwise. sin( nx)sin( kx) 0 otherwise. cos( nx) sin( kx) dx 0 for all integers n, k.

0 otherwise. sin( nx)sin( kx) 0 otherwise. cos( nx) sin( kx) dx 0 for all integers n, k. . Computtio of Fourier Series I this sectio, we compute the Fourier coefficiets, f ( x) cos( x) b si( x) d b, i the Fourier series To do this, we eed the followig result o the orthogolity of the trigoometric

More information

Lecture 19: Continuous Least Squares Approximation

Lecture 19: Continuous Least Squares Approximation Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for

More information

Review of the Riemann Integral

Review of the Riemann Integral Chpter 1 Review of the Riem Itegrl This chpter provides quick review of the bsic properties of the Riem itegrl. 1.0 Itegrls d Riem Sums Defiitio 1.0.1. Let [, b] be fiite, closed itervl. A prtitio P of

More information

FOURIER SERIES PART I: DEFINITIONS AND EXAMPLES. To a 2π-periodic function f(x) we will associate a trigonometric series. a n cos(nx) + b n sin(nx),

FOURIER SERIES PART I: DEFINITIONS AND EXAMPLES. To a 2π-periodic function f(x) we will associate a trigonometric series. a n cos(nx) + b n sin(nx), FOURIER SERIES PART I: DEFINITIONS AND EXAMPLES To -periodic fuctio f() we will ssocite trigoometric series + cos() + b si(), or i terms of the epoetil e i, series of the form c e i. Z For most of the

More information

1. (25 points) Use the limit definition of the definite integral and the sum formulas to compute. [1 x + x2

1. (25 points) Use the limit definition of the definite integral and the sum formulas to compute. [1 x + x2 Mth 3, Clculus II Fil Exm Solutios. (5 poits) Use the limit defiitio of the defiite itegrl d the sum formuls to compute 3 x + x. Check your swer by usig the Fudmetl Theorem of Clculus. Solutio: The limit

More information

( ) k ( ) 1 T n 1 x = xk. Geometric series obtained directly from the definition. = 1 1 x. See also Scalars 9.1 ADV-1: lim n.

( ) k ( ) 1 T n 1 x = xk. Geometric series obtained directly from the definition. = 1 1 x. See also Scalars 9.1 ADV-1: lim n. Sclrs-9.0-ADV- Algebric Tricks d Where Tylor Polyomils Come From 207.04.07 A.docx Pge of Algebric tricks ivolvig x. You c use lgebric tricks to simplify workig with the Tylor polyomils of certi fuctios..

More information

EVALUATING DEFINITE INTEGRALS

EVALUATING DEFINITE INTEGRALS Chpter 4 EVALUATING DEFINITE INTEGRALS If the defiite itegrl represets re betwee curve d the x-xis, d if you c fid the re by recogizig the shpe of the regio, the you c evlute the defiite itegrl. Those

More information

MATH 104 FINAL SOLUTIONS. 1. (2 points each) Mark each of the following as True or False. No justification is required. y n = x 1 + x x n n

MATH 104 FINAL SOLUTIONS. 1. (2 points each) Mark each of the following as True or False. No justification is required. y n = x 1 + x x n n MATH 04 FINAL SOLUTIONS. ( poits ech) Mrk ech of the followig s True or Flse. No justifictio is required. ) A ubouded sequece c hve o Cuchy subsequece. Flse b) A ifiite uio of Dedekid cuts is Dedekid cut.

More information

Sequence and Series of Functions

Sequence and Series of Functions 6 Sequece d Series of Fuctios 6. Sequece of Fuctios 6.. Poitwise Covergece d Uiform Covergece Let J be itervl i R. Defiitio 6. For ech N, suppose fuctio f : J R is give. The we sy tht sequece (f ) of fuctios

More information

Approximations of Definite Integrals

Approximations of Definite Integrals Approximtios of Defiite Itegrls So fr we hve relied o tiderivtives to evlute res uder curves, work doe by vrible force, volumes of revolutio, etc. More precisely, wheever we hve hd to evlute defiite itegrl

More information

Chapter 5. The Riemann Integral. 5.1 The Riemann integral Partitions and lower and upper integrals. Note: 1.5 lectures

Chapter 5. The Riemann Integral. 5.1 The Riemann integral Partitions and lower and upper integrals. Note: 1.5 lectures Chpter 5 The Riem Itegrl 5.1 The Riem itegrl Note: 1.5 lectures We ow get to the fudmetl cocept of itegrtio. There is ofte cofusio mog studets of clculus betwee itegrl d tiderivtive. The itegrl is (iformlly)

More information

Limit of a function:

Limit of a function: - Limit of fuctio: We sy tht f ( ) eists d is equl with (rel) umer L if f( ) gets s close s we wt to L if is close eough to (This defiitio c e geerlized for L y syig tht f( ) ecomes s lrge (or s lrge egtive

More information

INFINITE SERIES. ,... having infinite number of terms is called infinite sequence and its indicated sum, i.e., a 1

INFINITE SERIES. ,... having infinite number of terms is called infinite sequence and its indicated sum, i.e., a 1 Appedix A.. Itroductio As discussed i the Chpter 9 o Sequeces d Series, sequece,,...,,... hvig ifiite umber of terms is clled ifiite sequece d its idicted sum, i.e., + + +... + +... is clled ifite series

More information

Chapter 7 Infinite Series

Chapter 7 Infinite Series MA Ifiite Series Asst.Prof.Dr.Supree Liswdi Chpter 7 Ifiite Series Sectio 7. Sequece A sequece c be thought of s list of umbers writte i defiite order:,,...,,... 2 The umber is clled the first term, 2

More information

MAS221 Analysis, Semester 2 Exercises

MAS221 Analysis, Semester 2 Exercises MAS22 Alysis, Semester 2 Exercises Srh Whitehouse (Exercises lbelled * my be more demdig.) Chpter Problems: Revisio Questio () Stte the defiitio of covergece of sequece of rel umbers, ( ), to limit. (b)

More information

Chapter System of Equations

Chapter System of Equations hpter 4.5 System of Equtios After redig th chpter, you should be ble to:. setup simulteous lier equtios i mtrix form d vice-vers,. uderstd the cocept of the iverse of mtrix, 3. kow the differece betwee

More information

Taylor Polynomials. The Tangent Line. (a, f (a)) and has the same slope as the curve y = f (x) at that point. It is the best

Taylor Polynomials. The Tangent Line. (a, f (a)) and has the same slope as the curve y = f (x) at that point. It is the best Tylor Polyomils Let f () = e d let p() = 1 + + 1 + 1 6 3 Without usig clcultor, evlute f (1) d p(1) Ok, I m still witig With little effort it is possible to evlute p(1) = 1 + 1 + 1 (144) + 6 1 (178) =

More information

General properties of definite integrals

General properties of definite integrals Roerto s Notes o Itegrl Clculus Chpter 4: Defiite itegrls d the FTC Sectio Geerl properties of defiite itegrls Wht you eed to kow lredy: Wht defiite Riem itegrl is. Wht you c ler here: Some key properties

More information

Vectors. Vectors in Plane ( 2

Vectors. Vectors in Plane ( 2 Vectors Vectors i Ple ( ) The ide bout vector is to represet directiol force Tht mes tht every vector should hve two compoets directio (directiol slope) d mgitude (the legth) I the ple we preset vector

More information

The Definite Integral

The Definite Integral The Defiite Itegrl A Riem sum R S (f) is pproximtio to the re uder fuctio f. The true re uder the fuctio is obtied by tkig the it of better d better pproximtios to the re uder f. Here is the forml defiitio,

More information

The Basic Properties of the Integral

The Basic Properties of the Integral The Bsic Properties of the Itegrl Whe we compute the derivtive of complicted fuctio, like x + six, we usully use differetitio rules, like d [f(x)+g(x)] d f(x)+ d g(x), to reduce the computtio dx dx dx

More information

Math 104: Final exam solutions

Math 104: Final exam solutions Mth 14: Fil exm solutios 1. Suppose tht (s ) is icresig sequece with coverget subsequece. Prove tht (s ) is coverget sequece. Aswer: Let the coverget subsequece be (s k ) tht coverges to limit s. The there

More information

lecture 24: Gaussian quadrature rules: fundamentals

lecture 24: Gaussian quadrature rules: fundamentals 133 lecture 24: Gussi qudrture rules: fudmetls 3.4 Gussi qudrture It is cler tht the trpezoid rule, b 2 f ()+ f (b), exctly itegrtes lier polyomils, but ot ll qudrtics. I fct, oe c show tht o qudrture

More information

Quadrature Methods for Numerical Integration

Quadrature Methods for Numerical Integration Qudrture Methods for Numericl Itegrtio Toy Sd Istitute for Cle d Secure Eergy Uiversity of Uth April 11, 2011 1 The Need for Numericl Itegrtio Nuemricl itegrtio ims t pproximtig defiite itegrls usig umericl

More information

MATRIX ALGEBRA, Systems Linear Equations

MATRIX ALGEBRA, Systems Linear Equations MATRIX ALGEBRA, Systes Lier Equtios Now we chge to the LINEAR ALGEBRA perspective o vectors d trices to reforulte systes of lier equtios. If you fid the discussio i ters of geerl d gets lost i geerlity,

More information

POWER SERIES R. E. SHOWALTER

POWER SERIES R. E. SHOWALTER POWER SERIES R. E. SHOWALTER. sequeces We deote by lim = tht the limit of the sequece { } is the umber. By this we me tht for y ε > 0 there is iteger N such tht < ε for ll itegers N. This mkes precise

More information

THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK SUMMER EXAMINATION 2005 FIRST ENGINEERING

THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK SUMMER EXAMINATION 2005 FIRST ENGINEERING OLLSCOIL NA héireann, CORCAIGH THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK SUMMER EXAMINATION 2005 FIRST ENGINEERING MATHEMATICS MA008 Clculus d Lier

More information

Definite Integral. The Left and Right Sums

Definite Integral. The Left and Right Sums Clculus Li Vs Defiite Itegrl. The Left d Right Sums The defiite itegrl rises from the questio of fidig the re betwee give curve d x-xis o itervl. The re uder curve c be esily clculted if the curve is give

More information

INTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS)

INTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS) Mthemtics Revisio Guides Itegrtig Trig, Log d Ep Fuctios Pge of MK HOME TUITION Mthemtics Revisio Guides Level: AS / A Level AQA : C Edecel: C OCR: C OCR MEI: C INTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS)

More information

B. Examples 1. Finite Sums finite sums are an example of Riemann Sums in which each subinterval has the same length and the same x i

B. Examples 1. Finite Sums finite sums are an example of Riemann Sums in which each subinterval has the same length and the same x i Mth 06 Clculus Sec. 5.: The Defiite Itegrl I. Riem Sums A. Def : Give y=f(x):. Let f e defied o closed itervl[,].. Prtitio [,] ito suitervls[x (i-),x i ] of legth Δx i = x i -x (i-). Let P deote the prtitio

More information

The Weierstrass Approximation Theorem

The Weierstrass Approximation Theorem The Weierstrss Approximtio Theorem Jmes K. Peterso Deprtmet of Biologicl Scieces d Deprtmet of Mthemticl Scieces Clemso Uiversity Februry 26, 2018 Outlie The Wierstrss Approximtio Theorem MtLb Implemettio

More information

Approximate Integration

Approximate Integration Study Sheet (7.7) Approimte Itegrtio I this sectio, we will ler: How to fid pproimte vlues of defiite itegrls. There re two situtios i which it is impossile to fid the ect vlue of defiite itegrl. Situtio:

More information

Convergence rates of approximate sums of Riemann integrals

Convergence rates of approximate sums of Riemann integrals Jourl of Approximtio Theory 6 (9 477 49 www.elsevier.com/locte/jt Covergece rtes of pproximte sums of Riem itegrls Hiroyuki Tski Grdute School of Pure d Applied Sciece, Uiversity of Tsukub, Tsukub Ibrki

More information

MA123, Chapter 9: Computing some integrals (pp )

MA123, Chapter 9: Computing some integrals (pp ) MA13, Chpter 9: Computig some itegrls (pp. 189-05) Dte: Chpter Gols: Uderstd how to use bsic summtio formuls to evlute more complex sums. Uderstd how to compute its of rtiol fuctios t ifiity. Uderstd how

More information

Test Info. Test may change slightly.

Test Info. Test may change slightly. 9. 9.6 Test Ifo Test my chge slightly. Short swer (0 questios 6 poits ech) o Must choose your ow test o Tests my oly be used oce o Tests/types you re resposible for: Geometric (kow sum) Telescopig (kow

More information

UNIVERSITY OF BRISTOL. Examination for the Degrees of B.Sc. and M.Sci. (Level C/4) ANALYSIS 1B, SOLUTIONS MATH (Paper Code MATH-10006)

UNIVERSITY OF BRISTOL. Examination for the Degrees of B.Sc. and M.Sci. (Level C/4) ANALYSIS 1B, SOLUTIONS MATH (Paper Code MATH-10006) UNIVERSITY OF BRISTOL Exmitio for the Degrees of B.Sc. d M.Sci. (Level C/4) ANALYSIS B, SOLUTIONS MATH 6 (Pper Code MATH-6) My/Jue 25, hours 3 miutes This pper cotis two sectios, A d B. Plese use seprte

More information

Numbers (Part I) -- Solutions

Numbers (Part I) -- Solutions Ley College -- For AMATYC SML Mth Competitio Cochig Sessios v.., [/7/00] sme s /6/009 versio, with presettio improvemets Numbers Prt I) -- Solutios. The equtio b c 008 hs solutio i which, b, c re distict

More information

The Reimann Integral is a formal limit definition of a definite integral

The Reimann Integral is a formal limit definition of a definite integral MATH 136 The Reim Itegrl The Reim Itegrl is forml limit defiitio of defiite itegrl cotiuous fuctio f. The costructio is s follows: f ( x) dx for Reim Itegrl: Prtitio [, ] ito suitervls ech hvig the equl

More information

Infinite Series Sequences: terms nth term Listing Terms of a Sequence 2 n recursively defined n+1 Pattern Recognition for Sequences Ex:

Infinite Series Sequences: terms nth term Listing Terms of a Sequence 2 n recursively defined n+1 Pattern Recognition for Sequences Ex: Ifiite Series Sequeces: A sequece i defied s fuctio whose domi is the set of positive itegers. Usully it s esier to deote sequece i subscript form rther th fuctio ottio.,, 3, re the terms of the sequece

More information

Calculus II Homework: The Integral Test and Estimation of Sums Page 1

Calculus II Homework: The Integral Test and Estimation of Sums Page 1 Clculus II Homework: The Itegrl Test d Estimtio of Sums Pge Questios Emple (The p series) Get upper d lower bouds o the sum for the p series i= /ip with p = 2 if the th prtil sum is used to estimte the

More information

Remarks: (a) The Dirac delta is the function zero on the domain R {0}.

Remarks: (a) The Dirac delta is the function zero on the domain R {0}. Sectio Objective(s): The Dirc s Delt. Mi Properties. Applictios. The Impulse Respose Fuctio. 4.4.. The Dirc Delt. 4.4. Geerlized Sources Defiitio 4.4.. The Dirc delt geerlized fuctio is the limit δ(t)

More information

Linear Programming. Preliminaries

Linear Programming. Preliminaries Lier Progrmmig Prelimiries Optimiztio ethods: 3L Objectives To itroduce lier progrmmig problems (LPP To discuss the stdrd d coicl form of LPP To discuss elemetry opertio for lier set of equtios Optimiztio

More information

1 Tangent Line Problem

1 Tangent Line Problem October 9, 018 MAT18 Week Justi Ko 1 Tget Lie Problem Questio: Give the grph of fuctio f, wht is the slope of the curve t the poit, f? Our strteg is to pproimte the slope b limit of sect lies betwee poits,

More information

10.5 Test Info. Test may change slightly.

10.5 Test Info. Test may change slightly. 0.5 Test Ifo Test my chge slightly. Short swer (0 questios 6 poits ech) o Must choose your ow test o Tests my oly be used oce o Tests/types you re resposible for: Geometric (kow sum) Telescopig (kow sum)

More information

Course 121, , Test III (JF Hilary Term)

Course 121, , Test III (JF Hilary Term) Course 2, 989 9, Test III (JF Hilry Term) Fridy 2d Februry 99, 3. 4.3pm Aswer y THREE questios. Let f: R R d g: R R be differetible fuctios o R. Stte the Product Rule d the Quotiet Rule for differetitig

More information

n 2 + 3n + 1 4n = n2 + 3n + 1 n n 2 = n + 1

n 2 + 3n + 1 4n = n2 + 3n + 1 n n 2 = n + 1 Ifiite Series Some Tests for Divergece d Covergece Divergece Test: If lim u or if the limit does ot exist, the series diverget. + 3 + 4 + 3 EXAMPLE: Show tht the series diverges. = u = + 3 + 4 + 3 + 3

More information

PROGRESSIONS AND SERIES

PROGRESSIONS AND SERIES PROGRESSIONS AND SERIES A sequece is lso clled progressio. We ow study three importt types of sequeces: () The Arithmetic Progressio, () The Geometric Progressio, () The Hrmoic Progressio. Arithmetic Progressio.

More information

3.7 The Lebesgue integral

3.7 The Lebesgue integral 3 Mesure d Itegrtio The f is simple fuctio d positive wheever f is positive (the ltter follows from the fct tht i this cse f 1 [B,k ] = for ll k, ). Moreover, f (x) f (x). Ideed, if x, the there exists

More information

18.01 Calculus Jason Starr Fall 2005

18.01 Calculus Jason Starr Fall 2005 18.01 Clculus Jso Strr Lecture 14. October 14, 005 Homework. Problem Set 4 Prt II: Problem. Prctice Problems. Course Reder: 3B 1, 3B 3, 3B 4, 3B 5. 1. The problem of res. The ciet Greeks computed the res

More information

Closed Newton-Cotes Integration

Closed Newton-Cotes Integration Closed Newto-Cotes Itegrtio Jmes Keeslig This documet will discuss Newto-Cotes Itegrtio. Other methods of umericl itegrtio will be discussed i other posts. The other methods will iclude the Trpezoidl Rule,

More information

MTH 146 Class 16 Notes

MTH 146 Class 16 Notes MTH 46 Clss 6 Notes 0.4- Cotiued Motivtio: We ow cosider the rc legth of polr curve. Suppose we wish to fid the legth of polr curve curve i terms of prmetric equtios s: r f where b. We c view the cos si

More information

Numerical Solution of Fuzzy Fredholm Integral Equations of the Second Kind using Bernstein Polynomials

Numerical Solution of Fuzzy Fredholm Integral Equations of the Second Kind using Bernstein Polynomials Jourl of Al-Nhri Uiversity Vol.5 (), Mrch,, pp.-9 Sciece Numericl Solutio of Fuzzy Fredholm Itegrl Equtios of the Secod Kid usig Berstei Polyomils Srmd A. Altie Deprtmet of Computer Egieerig d Iformtio

More information

Lecture 2: Matrix Algebra

Lecture 2: Matrix Algebra Lecture 2: Mtrix lgebr Geerl. mtrix, for our purpose, is rectgulr rry of objects or elemets. We will tke these elemets s beig rel umbers d idicte elemet by its row d colum positio. mtrix is the ordered

More information

Convergence rates of approximate sums of Riemann integrals

Convergence rates of approximate sums of Riemann integrals Covergece rtes of pproximte sums of Riem itegrls Hiroyuki Tski Grdute School of Pure d Applied Sciece, Uiversity of Tsuku Tsuku Irki 5-857 Jp tski@mth.tsuku.c.jp Keywords : covergece rte; Riem sum; Riem

More information

Crushed Notes on MATH132: Calculus

Crushed Notes on MATH132: Calculus Mth 13, Fll 011 Siyg Yg s Outlie Crushed Notes o MATH13: Clculus The otes elow re crushed d my ot e ect This is oly my ow cocise overview of the clss mterils The otes I put elow should ot e used to justify

More information

F x = 2x λy 2 z 3 = 0 (1) F y = 2y λ2xyz 3 = 0 (2) F z = 2z λ3xy 2 z 2 = 0 (3) F λ = (xy 2 z 3 2) = 0. (4) 2z 3xy 2 z 2. 2x y 2 z 3 = 2y 2xyz 3 = ) 2

F x = 2x λy 2 z 3 = 0 (1) F y = 2y λ2xyz 3 = 0 (2) F z = 2z λ3xy 2 z 2 = 0 (3) F λ = (xy 2 z 3 2) = 0. (4) 2z 3xy 2 z 2. 2x y 2 z 3 = 2y 2xyz 3 = ) 2 0 微甲 07- 班期中考解答和評分標準 5%) Fid the poits o the surfce xy z = tht re closest to the origi d lso the shortest distce betwee the surfce d the origi Solutio Cosider the Lgrge fuctio F x, y, z, λ) = x + y + z

More information

Statistics for Financial Engineering Session 1: Linear Algebra Review March 18 th, 2006

Statistics for Financial Engineering Session 1: Linear Algebra Review March 18 th, 2006 Sttistics for Ficil Egieerig Sessio : Lier Algebr Review rch 8 th, 6 Topics Itroductio to trices trix opertios Determits d Crmer s rule Eigevlues d Eigevectors Quiz The cotet of Sessio my be fmilir to

More information

INTEGRATION IN THEORY

INTEGRATION IN THEORY CHATER 5 INTEGRATION IN THEORY 5.1 AREA AROXIMATION 5.1.1 SUMMATION NOTATION Fibocci Sequece First, exmple of fmous sequece of umbers. This is commoly ttributed to the mthemtici Fibocci of is, lthough

More information

The Definite Riemann Integral

The Definite Riemann Integral These otes closely follow the presettio of the mteril give i Jmes Stewrt s textook Clculus, Cocepts d Cotexts (d editio). These otes re iteded primrily for i-clss presettio d should ot e regrded s sustitute

More information

( ) dx ; f ( x ) is height and Δx is

( ) dx ; f ( x ) is height and Δx is Mth : 6.3 Defiite Itegrls from Riem Sums We just sw tht the exct re ouded y cotiuous fuctio f d the x xis o the itervl x, ws give s A = lim A exct RAM, where is the umer of rectgles i the Rectgulr Approximtio

More information

f(bx) dx = f dx = dx l dx f(0) log b x a + l log b a 2ɛ log b a.

f(bx) dx = f dx = dx l dx f(0) log b x a + l log b a 2ɛ log b a. Eercise 5 For y < A < B, we hve B A f fb B d = = A B A f d f d For y ɛ >, there re N > δ >, such tht d The for y < A < δ d B > N, we hve ba f d f A bb f d l By ba A A B A bb ba fb d f d = ba < m{, b}δ

More information

Riemann Integration. Chapter 1

Riemann Integration. Chapter 1 Mesure, Itegrtio & Rel Alysis. Prelimiry editio. 8 July 2018. 2018 Sheldo Axler 1 Chpter 1 Riem Itegrtio This chpter reviews Riem itegrtio. Riem itegrtio uses rectgles to pproximte res uder grphs. This

More information

f(t)dt 2δ f(x) f(t)dt 0 and b f(t)dt = 0 gives F (b) = 0. Since F is increasing, this means that

f(t)dt 2δ f(x) f(t)dt 0 and b f(t)dt = 0 gives F (b) = 0. Since F is increasing, this means that Uiversity of Illiois t Ur-Chmpig Fll 6 Mth 444 Group E3 Itegrtio : correctio of the exercises.. ( Assume tht f : [, ] R is cotiuous fuctio such tht f(x for ll x (,, d f(tdt =. Show tht f(x = for ll x [,

More information

y udv uv y v du 7.1 INTEGRATION BY PARTS

y udv uv y v du 7.1 INTEGRATION BY PARTS 7. INTEGRATION BY PARTS Ever differetitio rule hs correspodig itegrtio rule. For istce, the Substitutio Rule for itegrtio correspods to the Chi Rule for differetitio. The rule tht correspods to the Product

More information

Schrödinger Equation Via Laplace-Beltrami Operator

Schrödinger Equation Via Laplace-Beltrami Operator IOSR Jourl of Mthemtics (IOSR-JM) e-issn: 78-578, p-issn: 39-765X. Volume 3, Issue 6 Ver. III (Nov. - Dec. 7), PP 9-95 www.iosrjourls.org Schrödiger Equtio Vi Lplce-Beltrmi Opertor Esi İ Eskitşçioğlu,

More information

Review of Sections

Review of Sections Review of Sectios.-.6 Mrch 24, 204 Abstrct This is the set of otes tht reviews the mi ides from Chpter coverig sequeces d series. The specific sectios tht we covered re s follows:.: Sequces..2: Series,

More information

Background 1. Cramer-Rao inequality

Background 1. Cramer-Rao inequality Bro-06, Lecture, 60506 D/Stt/Bro-06/tex wwwmstqueesuc/ blevit/ Observtio vector, dt: Bckgroud Crmer-Ro iequlity X (X,, X X R Here dt c be rel- or vector vlued, compoets of the dt c be idepedet or depedet,

More information

Principles of Mathematical Analysis

Principles of Mathematical Analysis Ciro Uiversity Fculty of Scieces Deprtmet of Mthemtics Priciples of Mthemticl Alysis M 232 Mostf SABRI ii Cotets Locl Study of Fuctios. Remiders......................................2 Tylor-Youg Formul..............................

More information

Math 3B Midterm Review

Math 3B Midterm Review Mth 3B Midterm Review Writte by Victori Kl vtkl@mth.ucsb.edu SH 643u Office Hours: R 11:00 m - 1:00 pm Lst updted /15/015 Here re some short otes o Sectios 7.1-7.8 i your ebook. The best idictio of wht

More information

Math 140B - Notes. Neil Donaldson. September 2, 2009

Math 140B - Notes. Neil Donaldson. September 2, 2009 Mth 40B - Notes Neil Doldso September 2, 2009 Itroductio This clss cotiues from 40A. The mi purpose of the clss is to mke bsic clculus rigorous.. Nottio We will observe the followig ottio throughout this

More information

BC Calculus Path to a Five Problems

BC Calculus Path to a Five Problems BC Clculus Pth to Five Problems # Topic Completed U -Substitutio Rule Itegrtio by Prts 3 Prtil Frctios 4 Improper Itegrls 5 Arc Legth 6 Euler s Method 7 Logistic Growth 8 Vectors & Prmetrics 9 Polr Grphig

More information

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.

Probability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J. Probbility d Stochstic Processes: A Friedly Itroductio for Electricl d Computer Egieers Roy D. Ytes d Dvid J. Goodm Problem Solutios : Ytes d Goodm,4..4 4..4 4..7 4.4. 4.4. 4..6 4.6.8 4.6.9 4.7.4 4.7.

More information

A GENERALIZATION OF GAUSS THEOREM ON QUADRATIC FORMS

A GENERALIZATION OF GAUSS THEOREM ON QUADRATIC FORMS A GENERALIZATION OF GAU THEOREM ON QUADRATIC FORM Nicole I Brtu d Adi N Cret Deprtmet of Mth - Criov Uiversity, Romi ABTRACT A origil result cocerig the extesio of Guss s theorem from the theory of biry

More information

Important Facts You Need To Know/Review:

Important Facts You Need To Know/Review: Importt Fcts You Need To Kow/Review: Clculus: If fuctio is cotiuous o itervl I, the its grph is coected o I If f is cotiuous, d lim g Emple: lim eists, the lim lim f g f g d lim cos cos lim 3 si lim, t

More information

( a n ) converges or diverges.

( a n ) converges or diverges. Chpter Ifiite Series Pge of Sectio E Rtio Test Chpter : Ifiite Series By the ed of this sectio you will be ble to uderstd the proof of the rtio test test series for covergece by pplyig the rtio test pprecite

More information

Topic 4 Fourier Series. Today

Topic 4 Fourier Series. Today Topic 4 Fourier Series Toy Wves with repetig uctios Sigl geertor Clssicl guitr Pio Ech istrumet is plyig sigle ote mile C 6Hz) st hrmoic hrmoic 3 r hrmoic 4 th hrmoic 6Hz 5Hz 783Hz 44Hz A sigle ote will

More information

Frequency-domain Characteristics of Discrete-time LTI Systems

Frequency-domain Characteristics of Discrete-time LTI Systems requecy-domi Chrcteristics of Discrete-time LTI Systems Prof. Siripog Potisuk LTI System descriptio Previous bsis fuctio: uit smple or DT impulse The iput sequece is represeted s lier combitio of shifted

More information

Some New Iterative Methods Based on Composite Trapezoidal Rule for Solving Nonlinear Equations

Some New Iterative Methods Based on Composite Trapezoidal Rule for Solving Nonlinear Equations Itertiol Jourl of Mthemtics d Sttistics Ivetio (IJMSI) E-ISSN: 31 767 P-ISSN: 31-759 Volume Issue 8 August. 01 PP-01-06 Some New Itertive Methods Bsed o Composite Trpezoidl Rule for Solvig Nolier Equtios

More information

M3P14 EXAMPLE SHEET 1 SOLUTIONS

M3P14 EXAMPLE SHEET 1 SOLUTIONS M3P14 EXAMPLE SHEET 1 SOLUTIONS 1. Show tht for, b, d itegers, we hve (d, db) = d(, b). Sice (, b) divides both d b, d(, b) divides both d d db, d hece divides (d, db). O the other hd, there exist m d

More information

Notes 17 Sturm-Liouville Theory

Notes 17 Sturm-Liouville Theory ECE 638 Fll 017 Dvid R. Jckso Notes 17 Sturm-Liouville Theory Notes re from D. R. Wilto, Dept. of ECE 1 Secod-Order Lier Differetil Equtios (SOLDE) A SOLDE hs the form d y dy 0 1 p ( x) + p ( x) + p (

More information

In an algebraic expression of the form (1), like terms are terms with the same power of the variables (in this case

In an algebraic expression of the form (1), like terms are terms with the same power of the variables (in this case Chpter : Algebr: A. Bckgroud lgebr: A. Like ters: I lgebric expressio of the for: () x b y c z x y o z d x... p x.. we cosider x, y, z to be vribles d, b, c, d,,, o,.. to be costts. I lgebric expressio

More information

A GENERAL METHOD FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS: THE FROBENIUS (OR SERIES) METHOD

A GENERAL METHOD FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS: THE FROBENIUS (OR SERIES) METHOD Diol Bgoo () A GENERAL METHOD FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS: THE FROBENIUS (OR SERIES) METHOD I. Itroductio The first seprtio of vribles (see pplictios to Newto s equtios) is ver useful method

More information

MATH 104: INTRODUCTORY ANALYSIS SPRING 2008/09 PROBLEM SET 10 SOLUTIONS. f m. and. f m = 0. and x i = a + i. a + i. a + n 2. n(n + 1) = a(b a) +

MATH 104: INTRODUCTORY ANALYSIS SPRING 2008/09 PROBLEM SET 10 SOLUTIONS. f m. and. f m = 0. and x i = a + i. a + i. a + n 2. n(n + 1) = a(b a) + MATH 04: INTRODUCTORY ANALYSIS SPRING 008/09 PROBLEM SET 0 SOLUTIONS Throughout this problem set, B[, b] will deote the set of ll rel-vlued futios bouded o [, b], C[, b] the set of ll rel-vlued futios

More information

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures

FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 0 FURTHER CALCULUS II. Sequeces d series. Rolle s theorem d me vlue theorems 3. Tlor s d Mcluri s theorems 4. L Hopitl

More information

Numerical Solutions of Fredholm Integral Equations Using Bernstein Polynomials

Numerical Solutions of Fredholm Integral Equations Using Bernstein Polynomials Numericl Solutios of Fredholm Itegrl Equtios Usig erstei Polyomils A. Shiri, M. S. Islm Istitute of Nturl Scieces, Uited Itertiol Uiversity, Dhk-, gldesh Deprtmet of Mthemtics, Uiversity of Dhk, Dhk-,

More information

DETERMINANT. = 0. The expression a 1. is called a determinant of the second order, and is denoted by : y + c 1

DETERMINANT. = 0. The expression a 1. is called a determinant of the second order, and is denoted by : y + c 1 NOD6 (\Dt\04\Kot\J-Advced\SMP\Mths\Uit#0\NG\Prt-\0.Determits\0.Theory.p65. INTRODUCTION : If the equtios x + b 0, x + b 0 re stisfied by the sme vlue of x, the b b 0. The expressio b b is clled determit

More information

10.5 Power Series. In this section, we are going to start talking about power series. A power series is a series of the form

10.5 Power Series. In this section, we are going to start talking about power series. A power series is a series of the form 0.5 Power Series I the lst three sectios, we ve spet most of tht time tlkig bout how to determie if series is coverget or ot. Now it is time to strt lookig t some specific kids of series d we will evetully

More information

[ 20 ] 1. Inequality exists only between two real numbers (not complex numbers). 2. If a be any real number then one and only one of there hold.

[ 20 ] 1. Inequality exists only between two real numbers (not complex numbers). 2. If a be any real number then one and only one of there hold. [ 0 ]. Iequlity eists oly betwee two rel umbers (ot comple umbers).. If be y rel umber the oe d oly oe of there hold.. If, b 0 the b 0, b 0.. (i) b if b 0 (ii) (iii) (iv) b if b b if either b or b b if

More information

SUTCLIFFE S NOTES: CALCULUS 2 SWOKOWSKI S CHAPTER 11

SUTCLIFFE S NOTES: CALCULUS 2 SWOKOWSKI S CHAPTER 11 SUTCLIFFE S NOTES: CALCULUS SWOKOWSKI S CHAPTER Ifiite Series.5 Altertig Series d Absolute Covergece Next, let us cosider series with both positive d egtive terms. The simplest d most useful is ltertig

More information

Solution of the exam in TMA4212 Monday 23rd May 2013 Time: 9:00 13:00

Solution of the exam in TMA4212 Monday 23rd May 2013 Time: 9:00 13:00 Norwegi Uiversity of Sciece d Techology Deprtmet of Mthemticl Scieces Cotct durig the exm: Ele Celledoi, tlf. 735 93541 Pge 1 of 7 of the exm i TMA4212 Mody 23rd My 2013 Time: 9:00 13:00 Allowed ids: Approved

More information

2.1.1 Definition The Z-transform of a sequence x [n] is simply defined as (2.1) X re x k re x k r

2.1.1 Definition The Z-transform of a sequence x [n] is simply defined as (2.1) X re x k re x k r Z-Trsforms. INTRODUCTION TO Z-TRANSFORM The Z-trsform is coveiet d vluble tool for represetig, lyig d desigig discrete-time sigls d systems. It plys similr role i discrete-time systems to tht which Lplce

More information

Similar idea to multiplication in N, C. Divide and conquer approach provides unexpected improvements. Naïve matrix multiplication

Similar idea to multiplication in N, C. Divide and conquer approach provides unexpected improvements. Naïve matrix multiplication Next. Covered bsics of simple desig techique (Divided-coquer) Ch. of the text.. Next, Strsse s lgorithm. Lter: more desig d coquer lgorithms: MergeSort. Solvig recurreces d the Mster Theorem. Similr ide

More information

Exploring the Rate of Convergence of Approximations to the Riemann Integral

Exploring the Rate of Convergence of Approximations to the Riemann Integral Explorig the Rte of Covergece of Approximtios to the Riem Itegrl Lus Owes My 7, 24 Cotets Itroductio 2. Prelimiries............................................. 2.2 Motivtio..............................................

More information

Simpson s 1/3 rd Rule of Integration

Simpson s 1/3 rd Rule of Integration Simpso s 1/3 rd Rule o Itegrtio Mjor: All Egieerig Mjors Authors: Autr Kw, Chrlie Brker Trsormig Numericl Methods Eductio or STEM Udergrdutes 1/10/010 1 Simpso s 1/3 rd Rule o Itegrtio Wht is Itegrtio?

More information

Fast Fourier Transform 1) Legendre s Interpolation 2) Vandermonde Matrix 3) Roots of Unity 4) Polynomial Evaluation

Fast Fourier Transform 1) Legendre s Interpolation 2) Vandermonde Matrix 3) Roots of Unity 4) Polynomial Evaluation Algorithm Desig d Alsis Victor Admchi CS 5-45 Sprig 4 Lecture 3 J 7, 4 Cregie Mello Uiversit Outlie Fst Fourier Trsform ) Legedre s Iterpoltio ) Vdermode Mtri 3) Roots of Uit 4) Polomil Evlutio Guss (777

More information

Certain sufficient conditions on N, p n, q n k summability of orthogonal series

Certain sufficient conditions on N, p n, q n k summability of orthogonal series Avilble olie t www.tjs.com J. Nolier Sci. Appl. 7 014, 7 77 Reserch Article Certi sufficiet coditios o N, p, k summbility of orthogol series Xhevt Z. Krsiqi Deprtmet of Mthemtics d Iformtics, Fculty of

More information

ANALYSIS HW 3. f(x + y) = f(x) + f(y) for all real x, y. Demonstration: Let f be such a function. Since f is smooth, f exists.

ANALYSIS HW 3. f(x + y) = f(x) + f(y) for all real x, y. Demonstration: Let f be such a function. Since f is smooth, f exists. ANALYSIS HW 3 CLAY SHONKWILER () Fid ll smooth fuctios f : R R with the property f(x + y) = f(x) + f(y) for ll rel x, y. Demostrtio: Let f be such fuctio. Sice f is smooth, f exists. The The f f(x + h)

More information