lecture 16: Introduction to Least Squares Approximation
|
|
- Kelly Simmons
- 5 years ago
- Views:
Transcription
1 97 lecture 16: Itroductio to Lest Squres Approximtio.4 Lest squres pproximtio The miimx criterio is ituitive objective for pproximtig fuctio. However, i my cses it is more ppelig (for both computtio d for the give pplictio) to fid pproximtio to f tht miimizes the itegrl of the squre of the error. Give f C[, b], fid P P such tht 1/ 1/. ( f (x) P (x)) dx mi ( f (x) p(x)) dx pp This is exmple of lest squres problem..4.1 Ier products for fuctio spces To fcilitte the developmet of lest squres pproximtio theory, we itroduce forml structure for C[, b]. First, recogize tht C[, b] is lier spce: y lier combitio of cotiuous fuctios o [, b] must itself be cotiuous o [, b]. Defiitio.. The ier product of the fuctios f, g C[, b] is h f, gi f (x)g(x) dx. The ier product stisfies the followig bsic xioms: h f + g, hi h f, hi + hg, hi for ll f, g, h C[, b] d ll IR; h f, gi hg, f i for ll f, g C[, b]; h f, f i for ll f C[, b]. With this ier product we ssocite the orm For simplicity we re ssumig tht f d g re rel-vlued. To hdle complex-vlued fuctios, oe geerlizes the ier product to h f, gi f (x)g(x) dx, which the gives h f, gi hg, f i. 1/. k f k : h f, f i 1/ f (x) dx This is ofte clled the L orm, where the superscript i L refers to the fct tht the itegrd ivolves the squre of the fuctio f ; the L stds for Lebesgue, comig from the fct tht this ier product c be geerlized from C[, b] to the set of ll fuctios tht re squre-itegrble, i the sese of Lebesgue itegrtio. By restrictig our ttetio to cotiuous fuctios, we dodge the mesuretheoretic complexities. The Lebesgue theory gives more robust defiitio of the itegrl th the covetiol Riem pproch. With such otios oe c exted lest squres pproximtio beyod C[, b], to more exotic fuctio spces.
2 98.4. Lest squres miimiztio vi clculus We re ow redy to solve the lest squres problem. We shll cll the optiml polyomil P P, i.e., k f P k mi pp k f pk. We c solve this miimiztio problem usig bsic clculus. Cosider this exmple for 1, where we optimize the error over polyomils of the form p(x) c + c 1 x. The polyomil tht miimizes k f pk will lso miimize its squre, k f pk. For y give p P 1, defie the error fuctio E(c, c 1 ) : k f (x) (c + c 1 x)k L ( f (x) c c 1 x) dx f (x) f (x)(c + c 1 x)+(c + c c 1 x + c 1 x ) dx f (x) dx c f (x) dx To fid the optiml polyomil, P, optimize E over c d c 1, i.e., fid the vlues of c d c 1 for which c 1 xf(x) dx + c (b )+c c 1 (b )+ 1 c 1 (b ). First, compute. c c 1 Z b f (x) dx + c (b )+c c 1 (b ) Z b xf(x) dx + c (b )+c c 1 (b ). 1 Settig these prtil derivtives equl to zero yields c (b )+c 1 (b ) f (x) dx c (b )+c 1 (b ) xf(x) dx. These equtios, lier i the ukows c d c 1, c be writte i the mtrix form " (b ) b # b (b ) #" c c 1 4 R b R b f (x) dx xf(x) dx Whe b 6 this system lwys hs uique solutio. The resultig c d c 1 re the coefficiets for the moomil-bsis expsio of the lest squres pproximtio P P 1 to f o [, b]. 5.
3 99 Exmple.4 ( f (x) e x ). Apply this result to f (x) e x for x [, 1]. Sice Z 1 e x dx e 1, Z 1 xe x dx e x (x 1) 1 x 1, we must solve the system " 1 #" c # " e # 1 c 1. The desired solutio is c 4e 1, c e. Figure.7 compres f to this lest squres pproximtio P d the miimx pproximtio p computed erlier x Figure.7: Top: Approximtio of f (x) e x (blue) over x [, 1] vi lest squres (P, show i red) d miimx (p, show s gry lie). Bottom: Error curves for lest squres, f P (red), d miimx, f p (gry) pproximtio. While the curves hve similr shpe, ote tht the red curve does ot tti its mximum devitio from f t + poits, while the gry oe does.. error, f (x) p(x) lest squres miimx x We c see from the plots i Figure.7 tht the pproximtio looks decet to the eye, but the error is ot terribly smll. We c I fct, k f P k This is decrese tht error by icresig the degree of the pproximtig polyomil. Just s we used -by- lier system to fid the best lier pproximtio, geerl ( + 1)-by-( + 1) lier system c be costructed to yield the degree- lest squres pproximtio. ideed smller th the -orm error of the miimx pproximtio p : k f p k
4 1.4. Geerl polyomil bses Note tht we performed the bove miimiztio i the moomil bsis: p(x) c + c 1 x is lier combitio of 1 d x. Our experiece with iterpoltio suggests tht differet choices for the bsis my yield pproximtio lgorithms with superior umericl properties. Thus, we develop the form of the pproximtig polyomil i rbitrry bsis. Suppose {f k } is bsis for P. Ay p P c be writte s p(x) The error expressio tkes the form c k f k (x). E(c,...,c ) : k f (x) p(x)k L f (x) c k f k (x) dx h f, f i c k h f, f k i + ` To miimize E, we seek criticl vlues of c [c,...,c +1 ] T IR +1, i.e., we wt coefficiets where the grdiet of E with respect to c is zero: r c E. To compute this grdiet, evlute / for j,..., : h f, f i c k h f, f k i + h f, f j i + c j hf j, f j i + k6j ` c k c j hf k, f j i + ` `6j c j c`hf j, f`i + I this lst lie, we hve broke the double sum o the previous lie ito four prts: oe tht cotis c j, two tht coti c j (c k c j for k 6 j; c j c` for ` 6 j), d oe (the double sum) tht does ot ivolve c j t ll. This decompositio mkes it esier to compute the derivtive: c j c hf j, f j i + j k6j c k c j hf k, f j i + c j hf j, f j i + c j hf j, f j i + k6j k6j ` `6j c j c`hf j, f`i + c k hf k, f j i + c k hf k, f j i. ` `6j ` k6j `6j c`hf j, f`i +. ` k6j `6j
5 11 These terms cotribute to / to give (.1) h f, f i + j c k hf k, f j i. To miimize E, set / for j,...,, which gives the + 1 equtios (.1) c k hf k, f j i h f, f j i, j,...,, i the + 1 ukows c,...,c. Sice these equtios re lier i the ukows, write them i mtrix form: hf, f i hf, f 1 i hf, f i c h f, f i hf 1, f i hf 1, f 1 i. c 1. h f, f 6. 1 i, hf, f i hf, f 1 i hf, f i h f, f i which we deote Gc b. The mtrix G is clled the Grm mtrix. Usig this mtrix-vector ottio, we c ccumulte the prtil derivtives formuls (.1) for E ito the grdiet r c E Gc b. Sice c is criticl poit if d oly if r c E(c), we must sk: How my criticl poits re there? Equivletly, how my c solve Gc b? If c is criticl poit, is it (locl or eve globl) miimum? We will swer the first questio by showig tht G is ivertible, d hece E hs uique criticl poit. To swer the secod questio, we must ispect the Hessi c r c E r c (r c E)G. The criticl poit c is locl miimum if d oly if the Hessi is symmetric positive defiite. The symmetry of the ier product implies hf j, f k i hf k, f j i, d hece G is symmetric. (I this cse, symmetry lso follows from the equivlece of mixed prtil deritivtes.) The followig theorem cofirms tht G is ideed positive defiite. A mtrix G is positive defiite provided z Gz > for ll z 6.
We will begin by supplying the proof to (a).
(The solutios of problem re mostly from Jeffrey Mudrock s HWs) Problem 1. There re three sttemet from Exmple 5.4 i the textbook for which we will supply proofs. The sttemets re the followig: () The spce
More information1.3 Continuous Functions and Riemann Sums
mth riem sums, prt 0 Cotiuous Fuctios d Riem Sums I Exmple we sw tht lim Lower() = lim Upper() for the fuctio!! f (x) = + x o [0, ] This is o ccidet It is exmple of the followig theorem THEOREM Let f be
More informationWeek 13 Notes: 1) Riemann Sum. Aim: Compute Area Under a Graph. Suppose we want to find out the area of a graph, like the one on the right:
Week 1 Notes: 1) Riem Sum Aim: Compute Are Uder Grph Suppose we wt to fid out the re of grph, like the oe o the right: We wt to kow the re of the red re. Here re some wys to pproximte the re: We cut the
More information0 otherwise. sin( nx)sin( kx) 0 otherwise. cos( nx) sin( kx) dx 0 for all integers n, k.
. Computtio of Fourier Series I this sectio, we compute the Fourier coefficiets, f ( x) cos( x) b si( x) d b, i the Fourier series To do this, we eed the followig result o the orthogolity of the trigoometric
More informationLecture 19: Continuous Least Squares Approximation
Lecture 19: Continuous Lest Squres Approximtion 33 Continuous lest squres pproximtion We begn 31 with the problem of pproximting some f C[, b] with polynomil p P n t the discrete points x, x 1,, x m for
More informationReview of the Riemann Integral
Chpter 1 Review of the Riem Itegrl This chpter provides quick review of the bsic properties of the Riem itegrl. 1.0 Itegrls d Riem Sums Defiitio 1.0.1. Let [, b] be fiite, closed itervl. A prtitio P of
More informationFOURIER SERIES PART I: DEFINITIONS AND EXAMPLES. To a 2π-periodic function f(x) we will associate a trigonometric series. a n cos(nx) + b n sin(nx),
FOURIER SERIES PART I: DEFINITIONS AND EXAMPLES To -periodic fuctio f() we will ssocite trigoometric series + cos() + b si(), or i terms of the epoetil e i, series of the form c e i. Z For most of the
More information1. (25 points) Use the limit definition of the definite integral and the sum formulas to compute. [1 x + x2
Mth 3, Clculus II Fil Exm Solutios. (5 poits) Use the limit defiitio of the defiite itegrl d the sum formuls to compute 3 x + x. Check your swer by usig the Fudmetl Theorem of Clculus. Solutio: The limit
More information( ) k ( ) 1 T n 1 x = xk. Geometric series obtained directly from the definition. = 1 1 x. See also Scalars 9.1 ADV-1: lim n.
Sclrs-9.0-ADV- Algebric Tricks d Where Tylor Polyomils Come From 207.04.07 A.docx Pge of Algebric tricks ivolvig x. You c use lgebric tricks to simplify workig with the Tylor polyomils of certi fuctios..
More informationEVALUATING DEFINITE INTEGRALS
Chpter 4 EVALUATING DEFINITE INTEGRALS If the defiite itegrl represets re betwee curve d the x-xis, d if you c fid the re by recogizig the shpe of the regio, the you c evlute the defiite itegrl. Those
More informationMATH 104 FINAL SOLUTIONS. 1. (2 points each) Mark each of the following as True or False. No justification is required. y n = x 1 + x x n n
MATH 04 FINAL SOLUTIONS. ( poits ech) Mrk ech of the followig s True or Flse. No justifictio is required. ) A ubouded sequece c hve o Cuchy subsequece. Flse b) A ifiite uio of Dedekid cuts is Dedekid cut.
More informationSequence and Series of Functions
6 Sequece d Series of Fuctios 6. Sequece of Fuctios 6.. Poitwise Covergece d Uiform Covergece Let J be itervl i R. Defiitio 6. For ech N, suppose fuctio f : J R is give. The we sy tht sequece (f ) of fuctios
More informationApproximations of Definite Integrals
Approximtios of Defiite Itegrls So fr we hve relied o tiderivtives to evlute res uder curves, work doe by vrible force, volumes of revolutio, etc. More precisely, wheever we hve hd to evlute defiite itegrl
More informationChapter 5. The Riemann Integral. 5.1 The Riemann integral Partitions and lower and upper integrals. Note: 1.5 lectures
Chpter 5 The Riem Itegrl 5.1 The Riem itegrl Note: 1.5 lectures We ow get to the fudmetl cocept of itegrtio. There is ofte cofusio mog studets of clculus betwee itegrl d tiderivtive. The itegrl is (iformlly)
More informationLimit of a function:
- Limit of fuctio: We sy tht f ( ) eists d is equl with (rel) umer L if f( ) gets s close s we wt to L if is close eough to (This defiitio c e geerlized for L y syig tht f( ) ecomes s lrge (or s lrge egtive
More informationINFINITE SERIES. ,... having infinite number of terms is called infinite sequence and its indicated sum, i.e., a 1
Appedix A.. Itroductio As discussed i the Chpter 9 o Sequeces d Series, sequece,,...,,... hvig ifiite umber of terms is clled ifiite sequece d its idicted sum, i.e., + + +... + +... is clled ifite series
More informationChapter 7 Infinite Series
MA Ifiite Series Asst.Prof.Dr.Supree Liswdi Chpter 7 Ifiite Series Sectio 7. Sequece A sequece c be thought of s list of umbers writte i defiite order:,,...,,... 2 The umber is clled the first term, 2
More informationMAS221 Analysis, Semester 2 Exercises
MAS22 Alysis, Semester 2 Exercises Srh Whitehouse (Exercises lbelled * my be more demdig.) Chpter Problems: Revisio Questio () Stte the defiitio of covergece of sequece of rel umbers, ( ), to limit. (b)
More informationChapter System of Equations
hpter 4.5 System of Equtios After redig th chpter, you should be ble to:. setup simulteous lier equtios i mtrix form d vice-vers,. uderstd the cocept of the iverse of mtrix, 3. kow the differece betwee
More informationTaylor Polynomials. The Tangent Line. (a, f (a)) and has the same slope as the curve y = f (x) at that point. It is the best
Tylor Polyomils Let f () = e d let p() = 1 + + 1 + 1 6 3 Without usig clcultor, evlute f (1) d p(1) Ok, I m still witig With little effort it is possible to evlute p(1) = 1 + 1 + 1 (144) + 6 1 (178) =
More informationGeneral properties of definite integrals
Roerto s Notes o Itegrl Clculus Chpter 4: Defiite itegrls d the FTC Sectio Geerl properties of defiite itegrls Wht you eed to kow lredy: Wht defiite Riem itegrl is. Wht you c ler here: Some key properties
More informationVectors. Vectors in Plane ( 2
Vectors Vectors i Ple ( ) The ide bout vector is to represet directiol force Tht mes tht every vector should hve two compoets directio (directiol slope) d mgitude (the legth) I the ple we preset vector
More informationThe Definite Integral
The Defiite Itegrl A Riem sum R S (f) is pproximtio to the re uder fuctio f. The true re uder the fuctio is obtied by tkig the it of better d better pproximtios to the re uder f. Here is the forml defiitio,
More informationThe Basic Properties of the Integral
The Bsic Properties of the Itegrl Whe we compute the derivtive of complicted fuctio, like x + six, we usully use differetitio rules, like d [f(x)+g(x)] d f(x)+ d g(x), to reduce the computtio dx dx dx
More informationMath 104: Final exam solutions
Mth 14: Fil exm solutios 1. Suppose tht (s ) is icresig sequece with coverget subsequece. Prove tht (s ) is coverget sequece. Aswer: Let the coverget subsequece be (s k ) tht coverges to limit s. The there
More informationlecture 24: Gaussian quadrature rules: fundamentals
133 lecture 24: Gussi qudrture rules: fudmetls 3.4 Gussi qudrture It is cler tht the trpezoid rule, b 2 f ()+ f (b), exctly itegrtes lier polyomils, but ot ll qudrtics. I fct, oe c show tht o qudrture
More informationQuadrature Methods for Numerical Integration
Qudrture Methods for Numericl Itegrtio Toy Sd Istitute for Cle d Secure Eergy Uiversity of Uth April 11, 2011 1 The Need for Numericl Itegrtio Nuemricl itegrtio ims t pproximtig defiite itegrls usig umericl
More informationMATRIX ALGEBRA, Systems Linear Equations
MATRIX ALGEBRA, Systes Lier Equtios Now we chge to the LINEAR ALGEBRA perspective o vectors d trices to reforulte systes of lier equtios. If you fid the discussio i ters of geerl d gets lost i geerlity,
More informationPOWER SERIES R. E. SHOWALTER
POWER SERIES R. E. SHOWALTER. sequeces We deote by lim = tht the limit of the sequece { } is the umber. By this we me tht for y ε > 0 there is iteger N such tht < ε for ll itegers N. This mkes precise
More informationTHE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK SUMMER EXAMINATION 2005 FIRST ENGINEERING
OLLSCOIL NA héireann, CORCAIGH THE NATIONAL UNIVERSITY OF IRELAND, CORK COLÁISTE NA hollscoile, CORCAIGH UNIVERSITY COLLEGE, CORK SUMMER EXAMINATION 2005 FIRST ENGINEERING MATHEMATICS MA008 Clculus d Lier
More informationDefinite Integral. The Left and Right Sums
Clculus Li Vs Defiite Itegrl. The Left d Right Sums The defiite itegrl rises from the questio of fidig the re betwee give curve d x-xis o itervl. The re uder curve c be esily clculted if the curve is give
More informationINTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS)
Mthemtics Revisio Guides Itegrtig Trig, Log d Ep Fuctios Pge of MK HOME TUITION Mthemtics Revisio Guides Level: AS / A Level AQA : C Edecel: C OCR: C OCR MEI: C INTEGRATION TECHNIQUES (TRIG, LOG, EXP FUNCTIONS)
More informationB. Examples 1. Finite Sums finite sums are an example of Riemann Sums in which each subinterval has the same length and the same x i
Mth 06 Clculus Sec. 5.: The Defiite Itegrl I. Riem Sums A. Def : Give y=f(x):. Let f e defied o closed itervl[,].. Prtitio [,] ito suitervls[x (i-),x i ] of legth Δx i = x i -x (i-). Let P deote the prtitio
More informationThe Weierstrass Approximation Theorem
The Weierstrss Approximtio Theorem Jmes K. Peterso Deprtmet of Biologicl Scieces d Deprtmet of Mthemticl Scieces Clemso Uiversity Februry 26, 2018 Outlie The Wierstrss Approximtio Theorem MtLb Implemettio
More informationApproximate Integration
Study Sheet (7.7) Approimte Itegrtio I this sectio, we will ler: How to fid pproimte vlues of defiite itegrls. There re two situtios i which it is impossile to fid the ect vlue of defiite itegrl. Situtio:
More informationConvergence rates of approximate sums of Riemann integrals
Jourl of Approximtio Theory 6 (9 477 49 www.elsevier.com/locte/jt Covergece rtes of pproximte sums of Riem itegrls Hiroyuki Tski Grdute School of Pure d Applied Sciece, Uiversity of Tsukub, Tsukub Ibrki
More informationMA123, Chapter 9: Computing some integrals (pp )
MA13, Chpter 9: Computig some itegrls (pp. 189-05) Dte: Chpter Gols: Uderstd how to use bsic summtio formuls to evlute more complex sums. Uderstd how to compute its of rtiol fuctios t ifiity. Uderstd how
More informationTest Info. Test may change slightly.
9. 9.6 Test Ifo Test my chge slightly. Short swer (0 questios 6 poits ech) o Must choose your ow test o Tests my oly be used oce o Tests/types you re resposible for: Geometric (kow sum) Telescopig (kow
More informationUNIVERSITY OF BRISTOL. Examination for the Degrees of B.Sc. and M.Sci. (Level C/4) ANALYSIS 1B, SOLUTIONS MATH (Paper Code MATH-10006)
UNIVERSITY OF BRISTOL Exmitio for the Degrees of B.Sc. d M.Sci. (Level C/4) ANALYSIS B, SOLUTIONS MATH 6 (Pper Code MATH-6) My/Jue 25, hours 3 miutes This pper cotis two sectios, A d B. Plese use seprte
More informationNumbers (Part I) -- Solutions
Ley College -- For AMATYC SML Mth Competitio Cochig Sessios v.., [/7/00] sme s /6/009 versio, with presettio improvemets Numbers Prt I) -- Solutios. The equtio b c 008 hs solutio i which, b, c re distict
More informationThe Reimann Integral is a formal limit definition of a definite integral
MATH 136 The Reim Itegrl The Reim Itegrl is forml limit defiitio of defiite itegrl cotiuous fuctio f. The costructio is s follows: f ( x) dx for Reim Itegrl: Prtitio [, ] ito suitervls ech hvig the equl
More informationInfinite Series Sequences: terms nth term Listing Terms of a Sequence 2 n recursively defined n+1 Pattern Recognition for Sequences Ex:
Ifiite Series Sequeces: A sequece i defied s fuctio whose domi is the set of positive itegers. Usully it s esier to deote sequece i subscript form rther th fuctio ottio.,, 3, re the terms of the sequece
More informationCalculus II Homework: The Integral Test and Estimation of Sums Page 1
Clculus II Homework: The Itegrl Test d Estimtio of Sums Pge Questios Emple (The p series) Get upper d lower bouds o the sum for the p series i= /ip with p = 2 if the th prtil sum is used to estimte the
More informationRemarks: (a) The Dirac delta is the function zero on the domain R {0}.
Sectio Objective(s): The Dirc s Delt. Mi Properties. Applictios. The Impulse Respose Fuctio. 4.4.. The Dirc Delt. 4.4. Geerlized Sources Defiitio 4.4.. The Dirc delt geerlized fuctio is the limit δ(t)
More informationLinear Programming. Preliminaries
Lier Progrmmig Prelimiries Optimiztio ethods: 3L Objectives To itroduce lier progrmmig problems (LPP To discuss the stdrd d coicl form of LPP To discuss elemetry opertio for lier set of equtios Optimiztio
More information1 Tangent Line Problem
October 9, 018 MAT18 Week Justi Ko 1 Tget Lie Problem Questio: Give the grph of fuctio f, wht is the slope of the curve t the poit, f? Our strteg is to pproimte the slope b limit of sect lies betwee poits,
More information10.5 Test Info. Test may change slightly.
0.5 Test Ifo Test my chge slightly. Short swer (0 questios 6 poits ech) o Must choose your ow test o Tests my oly be used oce o Tests/types you re resposible for: Geometric (kow sum) Telescopig (kow sum)
More informationCourse 121, , Test III (JF Hilary Term)
Course 2, 989 9, Test III (JF Hilry Term) Fridy 2d Februry 99, 3. 4.3pm Aswer y THREE questios. Let f: R R d g: R R be differetible fuctios o R. Stte the Product Rule d the Quotiet Rule for differetitig
More informationn 2 + 3n + 1 4n = n2 + 3n + 1 n n 2 = n + 1
Ifiite Series Some Tests for Divergece d Covergece Divergece Test: If lim u or if the limit does ot exist, the series diverget. + 3 + 4 + 3 EXAMPLE: Show tht the series diverges. = u = + 3 + 4 + 3 + 3
More informationPROGRESSIONS AND SERIES
PROGRESSIONS AND SERIES A sequece is lso clled progressio. We ow study three importt types of sequeces: () The Arithmetic Progressio, () The Geometric Progressio, () The Hrmoic Progressio. Arithmetic Progressio.
More information3.7 The Lebesgue integral
3 Mesure d Itegrtio The f is simple fuctio d positive wheever f is positive (the ltter follows from the fct tht i this cse f 1 [B,k ] = for ll k, ). Moreover, f (x) f (x). Ideed, if x, the there exists
More information18.01 Calculus Jason Starr Fall 2005
18.01 Clculus Jso Strr Lecture 14. October 14, 005 Homework. Problem Set 4 Prt II: Problem. Prctice Problems. Course Reder: 3B 1, 3B 3, 3B 4, 3B 5. 1. The problem of res. The ciet Greeks computed the res
More informationClosed Newton-Cotes Integration
Closed Newto-Cotes Itegrtio Jmes Keeslig This documet will discuss Newto-Cotes Itegrtio. Other methods of umericl itegrtio will be discussed i other posts. The other methods will iclude the Trpezoidl Rule,
More informationMTH 146 Class 16 Notes
MTH 46 Clss 6 Notes 0.4- Cotiued Motivtio: We ow cosider the rc legth of polr curve. Suppose we wish to fid the legth of polr curve curve i terms of prmetric equtios s: r f where b. We c view the cos si
More informationNumerical Solution of Fuzzy Fredholm Integral Equations of the Second Kind using Bernstein Polynomials
Jourl of Al-Nhri Uiversity Vol.5 (), Mrch,, pp.-9 Sciece Numericl Solutio of Fuzzy Fredholm Itegrl Equtios of the Secod Kid usig Berstei Polyomils Srmd A. Altie Deprtmet of Computer Egieerig d Iformtio
More informationLecture 2: Matrix Algebra
Lecture 2: Mtrix lgebr Geerl. mtrix, for our purpose, is rectgulr rry of objects or elemets. We will tke these elemets s beig rel umbers d idicte elemet by its row d colum positio. mtrix is the ordered
More informationConvergence rates of approximate sums of Riemann integrals
Covergece rtes of pproximte sums of Riem itegrls Hiroyuki Tski Grdute School of Pure d Applied Sciece, Uiversity of Tsuku Tsuku Irki 5-857 Jp tski@mth.tsuku.c.jp Keywords : covergece rte; Riem sum; Riem
More informationCrushed Notes on MATH132: Calculus
Mth 13, Fll 011 Siyg Yg s Outlie Crushed Notes o MATH13: Clculus The otes elow re crushed d my ot e ect This is oly my ow cocise overview of the clss mterils The otes I put elow should ot e used to justify
More informationF x = 2x λy 2 z 3 = 0 (1) F y = 2y λ2xyz 3 = 0 (2) F z = 2z λ3xy 2 z 2 = 0 (3) F λ = (xy 2 z 3 2) = 0. (4) 2z 3xy 2 z 2. 2x y 2 z 3 = 2y 2xyz 3 = ) 2
0 微甲 07- 班期中考解答和評分標準 5%) Fid the poits o the surfce xy z = tht re closest to the origi d lso the shortest distce betwee the surfce d the origi Solutio Cosider the Lgrge fuctio F x, y, z, λ) = x + y + z
More informationStatistics for Financial Engineering Session 1: Linear Algebra Review March 18 th, 2006
Sttistics for Ficil Egieerig Sessio : Lier Algebr Review rch 8 th, 6 Topics Itroductio to trices trix opertios Determits d Crmer s rule Eigevlues d Eigevectors Quiz The cotet of Sessio my be fmilir to
More informationINTEGRATION IN THEORY
CHATER 5 INTEGRATION IN THEORY 5.1 AREA AROXIMATION 5.1.1 SUMMATION NOTATION Fibocci Sequece First, exmple of fmous sequece of umbers. This is commoly ttributed to the mthemtici Fibocci of is, lthough
More informationThe Definite Riemann Integral
These otes closely follow the presettio of the mteril give i Jmes Stewrt s textook Clculus, Cocepts d Cotexts (d editio). These otes re iteded primrily for i-clss presettio d should ot e regrded s sustitute
More information( ) dx ; f ( x ) is height and Δx is
Mth : 6.3 Defiite Itegrls from Riem Sums We just sw tht the exct re ouded y cotiuous fuctio f d the x xis o the itervl x, ws give s A = lim A exct RAM, where is the umer of rectgles i the Rectgulr Approximtio
More informationf(bx) dx = f dx = dx l dx f(0) log b x a + l log b a 2ɛ log b a.
Eercise 5 For y < A < B, we hve B A f fb B d = = A B A f d f d For y ɛ >, there re N > δ >, such tht d The for y < A < δ d B > N, we hve ba f d f A bb f d l By ba A A B A bb ba fb d f d = ba < m{, b}δ
More informationRiemann Integration. Chapter 1
Mesure, Itegrtio & Rel Alysis. Prelimiry editio. 8 July 2018. 2018 Sheldo Axler 1 Chpter 1 Riem Itegrtio This chpter reviews Riem itegrtio. Riem itegrtio uses rectgles to pproximte res uder grphs. This
More informationf(t)dt 2δ f(x) f(t)dt 0 and b f(t)dt = 0 gives F (b) = 0. Since F is increasing, this means that
Uiversity of Illiois t Ur-Chmpig Fll 6 Mth 444 Group E3 Itegrtio : correctio of the exercises.. ( Assume tht f : [, ] R is cotiuous fuctio such tht f(x for ll x (,, d f(tdt =. Show tht f(x = for ll x [,
More informationy udv uv y v du 7.1 INTEGRATION BY PARTS
7. INTEGRATION BY PARTS Ever differetitio rule hs correspodig itegrtio rule. For istce, the Substitutio Rule for itegrtio correspods to the Chi Rule for differetitio. The rule tht correspods to the Product
More informationSchrödinger Equation Via Laplace-Beltrami Operator
IOSR Jourl of Mthemtics (IOSR-JM) e-issn: 78-578, p-issn: 39-765X. Volume 3, Issue 6 Ver. III (Nov. - Dec. 7), PP 9-95 www.iosrjourls.org Schrödiger Equtio Vi Lplce-Beltrmi Opertor Esi İ Eskitşçioğlu,
More informationReview of Sections
Review of Sectios.-.6 Mrch 24, 204 Abstrct This is the set of otes tht reviews the mi ides from Chpter coverig sequeces d series. The specific sectios tht we covered re s follows:.: Sequces..2: Series,
More informationBackground 1. Cramer-Rao inequality
Bro-06, Lecture, 60506 D/Stt/Bro-06/tex wwwmstqueesuc/ blevit/ Observtio vector, dt: Bckgroud Crmer-Ro iequlity X (X,, X X R Here dt c be rel- or vector vlued, compoets of the dt c be idepedet or depedet,
More informationPrinciples of Mathematical Analysis
Ciro Uiversity Fculty of Scieces Deprtmet of Mthemtics Priciples of Mthemticl Alysis M 232 Mostf SABRI ii Cotets Locl Study of Fuctios. Remiders......................................2 Tylor-Youg Formul..............................
More informationMath 3B Midterm Review
Mth 3B Midterm Review Writte by Victori Kl vtkl@mth.ucsb.edu SH 643u Office Hours: R 11:00 m - 1:00 pm Lst updted /15/015 Here re some short otes o Sectios 7.1-7.8 i your ebook. The best idictio of wht
More informationMath 140B - Notes. Neil Donaldson. September 2, 2009
Mth 40B - Notes Neil Doldso September 2, 2009 Itroductio This clss cotiues from 40A. The mi purpose of the clss is to mke bsic clculus rigorous.. Nottio We will observe the followig ottio throughout this
More informationBC Calculus Path to a Five Problems
BC Clculus Pth to Five Problems # Topic Completed U -Substitutio Rule Itegrtio by Prts 3 Prtil Frctios 4 Improper Itegrls 5 Arc Legth 6 Euler s Method 7 Logistic Growth 8 Vectors & Prmetrics 9 Polr Grphig
More informationProbability and Stochastic Processes: A Friendly Introduction for Electrical and Computer Engineers Roy D. Yates and David J.
Probbility d Stochstic Processes: A Friedly Itroductio for Electricl d Computer Egieers Roy D. Ytes d Dvid J. Goodm Problem Solutios : Ytes d Goodm,4..4 4..4 4..7 4.4. 4.4. 4..6 4.6.8 4.6.9 4.7.4 4.7.
More informationA GENERALIZATION OF GAUSS THEOREM ON QUADRATIC FORMS
A GENERALIZATION OF GAU THEOREM ON QUADRATIC FORM Nicole I Brtu d Adi N Cret Deprtmet of Mth - Criov Uiversity, Romi ABTRACT A origil result cocerig the extesio of Guss s theorem from the theory of biry
More informationImportant Facts You Need To Know/Review:
Importt Fcts You Need To Kow/Review: Clculus: If fuctio is cotiuous o itervl I, the its grph is coected o I If f is cotiuous, d lim g Emple: lim eists, the lim lim f g f g d lim cos cos lim 3 si lim, t
More information( a n ) converges or diverges.
Chpter Ifiite Series Pge of Sectio E Rtio Test Chpter : Ifiite Series By the ed of this sectio you will be ble to uderstd the proof of the rtio test test series for covergece by pplyig the rtio test pprecite
More informationTopic 4 Fourier Series. Today
Topic 4 Fourier Series Toy Wves with repetig uctios Sigl geertor Clssicl guitr Pio Ech istrumet is plyig sigle ote mile C 6Hz) st hrmoic hrmoic 3 r hrmoic 4 th hrmoic 6Hz 5Hz 783Hz 44Hz A sigle ote will
More informationFrequency-domain Characteristics of Discrete-time LTI Systems
requecy-domi Chrcteristics of Discrete-time LTI Systems Prof. Siripog Potisuk LTI System descriptio Previous bsis fuctio: uit smple or DT impulse The iput sequece is represeted s lier combitio of shifted
More informationSome New Iterative Methods Based on Composite Trapezoidal Rule for Solving Nonlinear Equations
Itertiol Jourl of Mthemtics d Sttistics Ivetio (IJMSI) E-ISSN: 31 767 P-ISSN: 31-759 Volume Issue 8 August. 01 PP-01-06 Some New Itertive Methods Bsed o Composite Trpezoidl Rule for Solvig Nolier Equtios
More informationM3P14 EXAMPLE SHEET 1 SOLUTIONS
M3P14 EXAMPLE SHEET 1 SOLUTIONS 1. Show tht for, b, d itegers, we hve (d, db) = d(, b). Sice (, b) divides both d b, d(, b) divides both d d db, d hece divides (d, db). O the other hd, there exist m d
More informationNotes 17 Sturm-Liouville Theory
ECE 638 Fll 017 Dvid R. Jckso Notes 17 Sturm-Liouville Theory Notes re from D. R. Wilto, Dept. of ECE 1 Secod-Order Lier Differetil Equtios (SOLDE) A SOLDE hs the form d y dy 0 1 p ( x) + p ( x) + p (
More informationIn an algebraic expression of the form (1), like terms are terms with the same power of the variables (in this case
Chpter : Algebr: A. Bckgroud lgebr: A. Like ters: I lgebric expressio of the for: () x b y c z x y o z d x... p x.. we cosider x, y, z to be vribles d, b, c, d,,, o,.. to be costts. I lgebric expressio
More informationA GENERAL METHOD FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS: THE FROBENIUS (OR SERIES) METHOD
Diol Bgoo () A GENERAL METHOD FOR SOLVING ORDINARY DIFFERENTIAL EQUATIONS: THE FROBENIUS (OR SERIES) METHOD I. Itroductio The first seprtio of vribles (see pplictios to Newto s equtios) is ver useful method
More informationMATH 104: INTRODUCTORY ANALYSIS SPRING 2008/09 PROBLEM SET 10 SOLUTIONS. f m. and. f m = 0. and x i = a + i. a + i. a + n 2. n(n + 1) = a(b a) +
MATH 04: INTRODUCTORY ANALYSIS SPRING 008/09 PROBLEM SET 0 SOLUTIONS Throughout this problem set, B[, b] will deote the set of ll rel-vlued futios bouded o [, b], C[, b] the set of ll rel-vlued futios
More informationFACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING. Lectures
FACULTY OF MATHEMATICAL STUDIES MATHEMATICS FOR PART I ENGINEERING Lectures MODULE 0 FURTHER CALCULUS II. Sequeces d series. Rolle s theorem d me vlue theorems 3. Tlor s d Mcluri s theorems 4. L Hopitl
More informationNumerical Solutions of Fredholm Integral Equations Using Bernstein Polynomials
Numericl Solutios of Fredholm Itegrl Equtios Usig erstei Polyomils A. Shiri, M. S. Islm Istitute of Nturl Scieces, Uited Itertiol Uiversity, Dhk-, gldesh Deprtmet of Mthemtics, Uiversity of Dhk, Dhk-,
More informationDETERMINANT. = 0. The expression a 1. is called a determinant of the second order, and is denoted by : y + c 1
NOD6 (\Dt\04\Kot\J-Advced\SMP\Mths\Uit#0\NG\Prt-\0.Determits\0.Theory.p65. INTRODUCTION : If the equtios x + b 0, x + b 0 re stisfied by the sme vlue of x, the b b 0. The expressio b b is clled determit
More information10.5 Power Series. In this section, we are going to start talking about power series. A power series is a series of the form
0.5 Power Series I the lst three sectios, we ve spet most of tht time tlkig bout how to determie if series is coverget or ot. Now it is time to strt lookig t some specific kids of series d we will evetully
More information[ 20 ] 1. Inequality exists only between two real numbers (not complex numbers). 2. If a be any real number then one and only one of there hold.
[ 0 ]. Iequlity eists oly betwee two rel umbers (ot comple umbers).. If be y rel umber the oe d oly oe of there hold.. If, b 0 the b 0, b 0.. (i) b if b 0 (ii) (iii) (iv) b if b b if either b or b b if
More informationSUTCLIFFE S NOTES: CALCULUS 2 SWOKOWSKI S CHAPTER 11
SUTCLIFFE S NOTES: CALCULUS SWOKOWSKI S CHAPTER Ifiite Series.5 Altertig Series d Absolute Covergece Next, let us cosider series with both positive d egtive terms. The simplest d most useful is ltertig
More informationSolution of the exam in TMA4212 Monday 23rd May 2013 Time: 9:00 13:00
Norwegi Uiversity of Sciece d Techology Deprtmet of Mthemticl Scieces Cotct durig the exm: Ele Celledoi, tlf. 735 93541 Pge 1 of 7 of the exm i TMA4212 Mody 23rd My 2013 Time: 9:00 13:00 Allowed ids: Approved
More information2.1.1 Definition The Z-transform of a sequence x [n] is simply defined as (2.1) X re x k re x k r
Z-Trsforms. INTRODUCTION TO Z-TRANSFORM The Z-trsform is coveiet d vluble tool for represetig, lyig d desigig discrete-time sigls d systems. It plys similr role i discrete-time systems to tht which Lplce
More informationSimilar idea to multiplication in N, C. Divide and conquer approach provides unexpected improvements. Naïve matrix multiplication
Next. Covered bsics of simple desig techique (Divided-coquer) Ch. of the text.. Next, Strsse s lgorithm. Lter: more desig d coquer lgorithms: MergeSort. Solvig recurreces d the Mster Theorem. Similr ide
More informationExploring the Rate of Convergence of Approximations to the Riemann Integral
Explorig the Rte of Covergece of Approximtios to the Riem Itegrl Lus Owes My 7, 24 Cotets Itroductio 2. Prelimiries............................................. 2.2 Motivtio..............................................
More informationSimpson s 1/3 rd Rule of Integration
Simpso s 1/3 rd Rule o Itegrtio Mjor: All Egieerig Mjors Authors: Autr Kw, Chrlie Brker Trsormig Numericl Methods Eductio or STEM Udergrdutes 1/10/010 1 Simpso s 1/3 rd Rule o Itegrtio Wht is Itegrtio?
More informationFast Fourier Transform 1) Legendre s Interpolation 2) Vandermonde Matrix 3) Roots of Unity 4) Polynomial Evaluation
Algorithm Desig d Alsis Victor Admchi CS 5-45 Sprig 4 Lecture 3 J 7, 4 Cregie Mello Uiversit Outlie Fst Fourier Trsform ) Legedre s Iterpoltio ) Vdermode Mtri 3) Roots of Uit 4) Polomil Evlutio Guss (777
More informationCertain sufficient conditions on N, p n, q n k summability of orthogonal series
Avilble olie t www.tjs.com J. Nolier Sci. Appl. 7 014, 7 77 Reserch Article Certi sufficiet coditios o N, p, k summbility of orthogol series Xhevt Z. Krsiqi Deprtmet of Mthemtics d Iformtics, Fculty of
More informationANALYSIS HW 3. f(x + y) = f(x) + f(y) for all real x, y. Demonstration: Let f be such a function. Since f is smooth, f exists.
ANALYSIS HW 3 CLAY SHONKWILER () Fid ll smooth fuctios f : R R with the property f(x + y) = f(x) + f(y) for ll rel x, y. Demostrtio: Let f be such fuctio. Sice f is smooth, f exists. The The f f(x + h)
More information