x j β j + λ (x ij x j )βj + λ β c2 and y aug = λi λi = X X + λi, X λi = y X.
|
|
- Sybil Angela Washington
- 5 years ago
- Views:
Transcription
1 Stt 648: Assignment Solutions (115 points) (3.5) (5 pts.) Writing the ridge expression s y i 0 x ij j x j j + i1 y i ( 0 + i1 y i 0 c i1 j1 x j j ) j1 j1 x j j j1 (x ij x j ) j j1 (x ij x j )j c j1 + λ j1 + λ + λ j1 j1 j j c j for c j j nd c nd shifting the x i s to hve zero men only modifies the intercept nd not the slopes. A similr rgument holds for the lsso by gin letting j c j nd 0 c 0 + x j j. (3.1) (5 pts.) With X ug X y nd y ug λ I 0, y ug y ug y 0 y y y, 0 X ug X ug X X λi λi X X + λi, j1 x j j. j1 nd y ug X ug y 0 X λi y X. So, ˆ (X ug X ug ) 1 X ug y ug (X X + λi) 1 X y ˆ ridge. (3.16) (15 pts.) First, note tht ˆ (X X) 1 X y X y becuse of the orthonormlity of X. Best subset: Since the inputs re orthogonl, dropping terms will not chnge the estimtes of the other terms. Letting y M, X M, nd M represent reduced version of y, X, nd of size M, we wish to minimize (y M X M M ) (y M X M M ) y My M y MX M M + MX MX M M y My M M M since X M is orthonorml. This is minimized by choosing the M lrgest j s in mgnitude, giving estimtes ˆ j Irnk ˆ j M. Ridge: By Eqn. (3.44), ˆ ridge (X X + λi) 1 X y (I + λi) 1 X y since X is orthogonl ((1 + λ)i) 1 X y λ X y 1 ˆ 1 + λ 1
2 Lsso: ˆ lsso { rg min (y X) (y X) + λ } p j1 j where λ λ nd (y X) (y X) y y y X + X X Thus, we wish to minimize f() y y p j1 Setting df() d j (3.30) (8 pts.) Let X ug we wish to find min min y y y X + y y ˆ + y y ˆ j j + j1 ˆ j + j + λ sgn( j ) 0, nd since j ˆ j sgn( j1 j ˆ j j + p j1 j + λ p j1 j. λ sgn( ˆ ˆ j )( X y nd y ug αλ I 0 j ) ˆ j λ) + ˆ j nd j hve the sme signs,. Doing the lsso with X ug nd y ug, (yug X ug ) (y ug X ug ) + λ j where λ λ(1 α) j1 ug y y ug y ug X ug + X ug X ug + λ j. Now, in similr mnner to 3.1, y ug y ug y y, j1 So, we hve min min X ug X ug X X + αλi, y ug X ug y X. y y y X + ( X X + αλi ) + λ(1 α) j j1 (y X) (y X) + αλ + λ(1 α) j min y X + λ α + (1 α) 1. j1 (4.6) (10 pts.) () Seperbility implies tht sep such tht x i y i sepx i > 0 i y i sep x i > 0 i y i sepz i > 0 i. Let ɛ min i { yi sepz i } > 0 nd set sep sep/ɛ. Then, y i sepz i y i sepz i min i { yi sepz i } 1 i.
3 (b) new sep old + y i z i sep old sep + yi z i + y i old z i y i sepz i old sep + 1 yi sepz i since y i old z i 0 by misclssifiction old sep 1 by (). (5.) (16 pts.) () Suppose m 1. Then, for ll i, if x / τ i, τ i+m τ i, τ i+1, B i,m (x) B i,1 (x) 0. So the clim holds for m 1. Suppose the clim holds for m j for ll i {1,..., k + M m}. Then B i,j (x) 0 for x / τ i, τ i+j. Suppose x / τ i, τ i+j+1. Then x / τ i, τ i+j nd hence B i,j (x) 0. Also, x / τ i+1, τ i+j+1 nd hence B i+1,j (x) 0. Therefore, B i,j+1 x τ i τ i+j+1 x B i+j (x) 0 τ i+j+1 τ i+1 when x / τ i, τ i+j+1 nd the clim holds for m j + 1. This completes the proof by induction. (b) Suppose m 1. Then, for ll i, if x (τ i, τ i+m ) (τ i, τ i+1 ), B i,1 1 > 0. So the clim holds for m 1. Suppose the clim holds for m j, for ll i {1,..., k + M m}. Then B i,j (x) > 0 for x (τ i, τ i+j ). Suppose now tht x (τ i, τ i+j+1 ). If x (τ i, τ i+1 ) (τ i, τ i+j ), B i,j (x) > 0 nd x / τ i+1, τ i+j+1, so B i+1,j (x) 0 by (). If x τ i+1, τ i+j ), B i,j (x) > 0 nd B i,j+1 (x) > 0. If x τ i+j, τ i+j+1 ) (τ i+1, τ i+j+1 ), B i,j+1 (x) > 0 nd x / τ i, τ i+1, so B i,j (x) 0 by (). Thus, B i,j+1 x τ i τ i+j+1 x B i+j (x) > 0 τ i+j+1 τ i+1 when x (τ i, τ i+j+1 ) nd the clim holds for m j + 1. This completes the proof by induction. (c) For m 1, let x ξ 0, ξ k+1. Then x τ m, τ k+m+1 τ 1, τ k+ nd k+1 k+1 B i,1 (x) Iτ i x < τ i+1 1. i1 i1 Suppose the clim holds for m j. Then k+1 i1 B i,j(x) 1 x ξ 0, ξ k+1 τ j, τ j+k+1. Now let x ξ 0, ξ k+1 τ j+1, τ j+k+. i1 B i,j+1 (x) i1 ( x τi x τ 1 B 1,j (x) + τ j+1 τ 1 x τ 1 τ j+1 τ 1 B 1,j (x) + i B i,j (x) by (). i i τ ) i+j+1 x B i+1,j (x) τ i+j+1 τ i+1 k+j+ x τ i i1 ( x τi + τ i+j x τ i+j x B i,j (x) ) τ k+j+ x τ k+j+ τ k+j+ B k+j+,j (x) 3
4 Notice tht when m j becme m j + 1, the subscripts on the τ i s inside ξ 0, ξ k+1 incresed by 1 nd so did the B i,m s. So, i B i,j (x) 1. (d) For m 1, B i,1 (x) Iτ i x < τ i+1 is piecewise polynomil of degree 0 with breks t τ i nd τ i+1. Suppose the results holds for m j. Since B i,j+1 x τ i τ i+j+1 x B i+j (x) τ i+j+1 τ i+1 nd B i,j (x) nd B i+1,j (x) re piecewise polynomils of degree j 1, we hve tht B i,j+1 (x) is piecewise polynomil of degree j with breks only t the knots. (e) not grded (5.7) (10 pts.) () Since g is nturl cubic spline interpolnt for {x i, z i } N 1, it is liner outside x i, x N nd g () g (b) 0. Also, g (x) is constnt on the intervls x i, x i+1 ), i 1,,..., N 1. Since g nd g re both functions on, b tht interpolte the N pirs, g(x i ) g(x i ) z i nd h(x i ) 0 for i 1,..., N. Thus, (b) g (x)h (x)dx g (x)h (x) b N 1 g (x)h (x)dx g (x)h (x)dx g (x + j ){h(x j+1) h(x j )} 0 j1 g (t) dt (h (t) + g (t)) dt h (t) + h (t) + g (t) dt + g (t) dt by () g (t)h (t)dt g (t) dt with equlity holding only if h is 0 in, b. (c) Since ny interpolnt f evluted t x i yields the sme vlues s g(x i ), the sum of squres N i1 (y i f(x i )) will be the sme for ny choice of f. Thus, since λ is positive, we wish to minimize f (t) dt. In (b) it ws shown tht this is ccomplished by cubic spline with knots t ech of the x i. (5.11) (5 pts.) Since h 1 (x) 1 nd h (x) x, we cn write H 1 N 1 x N 1 T N (N ) for ( n N (N ) mtrix T. Since h 1 (x) 0, h (x) 0, nd Ω h j (t)h k ), (t)dt the first two 4
5 rows nd first two columns of Ω re 0. So, we cn write Ω (N ) (N ) mtrix M. Now, if we prtition H 1 into H 1 H u 1 u x u T v 1 v x v T W1 Wx WT 0 0 (N ) 0 (N ) M (N ) (N ) u 1 N v 1 N, we hve W (N ) N I 3 3. for n Thus, W1 0 nd Wx 0. Let nd b be ny constnts. Then u u (1 + bx) H 1 (1 + bx) v W (1 + bx) v (1 + bx) 0 Thus, K(1 + bx) H 1 ΩH 1 (1 + bx) H M re bsis vectors for the null spce of K.. u (1 + bx) v (1 + bx) 0 0, nd 1 nd x (5.1) (5 pts.) As in Eqn. (5.10) we write f(x) N j1 h j(x)θ j, where the h j (x) re n N- dimensionl set of bsis functions for representing this fmily of nturl splines. The criterion reduces to RSS(θ, λ) (y Hθ) W(y Hθ) + λθ Ωθ, where W dig(w 1,..., w N ), nd is minimized by ˆθ (H WH + λω) 1 H Wy. The fitted smoothing spline is given by ˆf(x) N j1 h j(x)ˆθ j. When the trining dt hve ties in X we remove ll ties except one, replcing the y with the verge of ll y s for the ties. The technique bove cn then be used by letting the weight equl the number of ties. (5.15) (16 pts.) () K(, x i ), f HK (γ j φ j (x i ))φ j ( ), c j φ j ( ) j1 j1 γ j φ j (x i )c j γ j j1 H K φ j (x i )c j f(x i ) j1 (b) K(, x i ), K(, x j ) HK (γ k φ k (x i ))φ k ( ), (γ k φ k (x j ))φ k ( ) k1 k1 k1 γ k φ k (x i )γ k φ k (x j ) γ k 5 H K γ k φ k (x i )φ k (x j ) K(x i, x j ) k1
6 (c) First, g(x) α i K(x, x i ) i1 α i γ j φ j (x)φ j (x i ) i1 j1 N γ j j1 i1 (α i φ j (x i ))φ j (x) c j φ j (x) j1 for c j γ j N i1 α iφ j (x i ). Then, (d) First, J(g) g H K j1 N γ j j1 i1 k1 i1 k1 γ j ( N i1 α iφ j (x i )) γ j α i α k φ j (x i )φ j (x k ) α i α k K(x i, x k ) ( N γ j α i φ j (x i ) j1 α i α k i1 i1 k1 j1 ) γ j φ j (x i )φ j (x k ) J( g) g + ρ H K g, g HK + g, ρ HK + ρ, ρ HK J(g) + α i K(x, x i ), ρ HK + J(ρ) i1 J(g) + J(ρ) J(g) with equlity holding iffρ(x) 0. Now, by (), g(x i ) K(, x), g HK K(, x), g HK + K(, x), ρ HK K(, x), g HK g(x i ) for i 1,..., N. Thus, N i1 L(y i, g(x i )) N i1 L(y i, g(x i )), nd L(y i, g(x i )) + λj( g) i1 L(y i, g(x i )) + λj(g), i1 with equlity holding iff ρ(x) 0. 6
7 Chpter 4 computing ssignment code (0 pts.) ##Prt 1, ccording to the outline vowelred.tble(" sep",",row.nmes1,hedertrue) Sigmtrix(rep(0,100),nrow10) mukmtrix(nrow11,ncol10) for(i in 1:11){ vowelkvowelvowel,1i,:11 muki,pply(vowelk,,men) SigSig+(1/11)*cov(vowelk)} Siginvsolve(Sig) eeigen(siginv) Ve$vectors Sig.hlfV%*%dig(sqrt(e$vlues))%*%t(V) mubrpply(muk,,men) mukstrsig.hlf%*%(t(muk)-mubr) Xvowel,:11 XstrSig.hlf%*%(t(X)-mubr) Wcov(t(mukstr)) eweigen(w) vew$vectors okt(v) Oxt(ok%*%Xstr) Omut(ok%*%mukstr) colorc("blck","ornge","green","brown","cyn","deeppink","yellow","gry", "red","drkviolet","blue") plot(-ox,1,ox,,colrep(color,48),xlb"coordinte 1 for Trining Dt", ylb"coordinte for Trining Dt",min"Liner Discriminnt Anlysis") points(-omu,1,omu,,colcolor,pch19,cex1.8) ##Prts nd 3 librry(mass) LDAld(y~x.1+x.+x.3+x.4+x.5+x.6+x.7+x.8+x.9+x.10,vowel) Oxlpredict(LDA,vowel)$x Omulpredict(LDA, newdts.dt.frme(lda$mens))$x pr(mfrowc(,)) plot(oxl,1,oxl,3,colrep(color,48),xlb"coordinte 1",ylb"Coordinte 3") points(omul,1,omul,3,colcolor,pch19,cex1.8) plot(oxl,,oxl,3,colrep(color,48),xlb"coordinte ",ylb"coordinte 3") points(omul,,omul,3,colcolor,pch19,cex1.8) plot(oxl,1,oxl,7,colrep(color,48),xlb"coordinte 1",ylb"Coordinte 7") points(omul,1,omul,7,colcolor,pch19,cex1.8) plot(oxl,9,oxl,10,colrep(color,48),xlb"coordinte 9",ylb"Coordinte 10") points(omul,9,omul,10,colcolor,pch19,cex1.8) 7
8 ##Prt 4 D1000 Colsmtrix(nrowD,ncolD) Cmtrix(c(-Omu,1,Omu,),nrow11) t1seq(-5,5,,d) tseq(-7,4,,d) for(i in 1:D){ for(j in 1:D){ F((C,1-t1i)^+(C,-tj)^) Colsi,jwhich.min(F)}} contour(t1,t,cols,drwlbelsfalse,xlb"coordinte 1",ylb"Coordinte ", min"clssified to nerest men") points(-ox,1,ox,,colrep(color,48)) points(-omu,1,omu,,colcolor,pch19,cex1.8) ##Prt 5, Logistic Regression librry(vgam) logregdtcbind(rep(1:11,48),-ox,1,ox,) colnmes(logregdt)c("y","c.1","c.") logregdts.dt.frme(logregdt) lrvglm(y~c.1+c.,fmilymultinomil(),dtlogregdt) D500 t1seq(-5,5,,d) tseq(-7,4,,d) Colmtrix(nrowD,ncolD) for(i in 1:D){ Tmtmtrix(c(rep(t1i,D),t),ncol,nrowD) colnmes(tmt)c("c.1","c.") Tmts.dt.frme(Tmt) Plrpredict(lr,newdtTmt,type"response") for(m in 1:D){ Coli,mwhich.mx(Plrm,)}} contour(t1,t,col,drwlbelsfalse,xlb"coordinte 1",ylb"Coordinte ", min"clssified by Logistic Regression") points(-ox,1,ox,,colrep(color,48)) points(-omu,1,omu,,colcolor,pch19,cex1.8) 8
Best Approximation in the 2-norm
Jim Lmbers MAT 77 Fll Semester 1-11 Lecture 1 Notes These notes correspond to Sections 9. nd 9.3 in the text. Best Approximtion in the -norm Suppose tht we wish to obtin function f n (x) tht is liner combintion
More informationBest Approximation. Chapter The General Case
Chpter 4 Best Approximtion 4.1 The Generl Cse In the previous chpter, we hve seen how n interpolting polynomil cn be used s n pproximtion to given function. We now wnt to find the best pproximtion to given
More informationLecture 4: Piecewise Cubic Interpolation
Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 4: Piecewise Cubic Interpoltion Compiled 5 September In this lecture we consider piecewise cubic interpoltion
More informationChapter 3 Polynomials
Dr M DRAIEF As described in the introduction of Chpter 1, pplictions of solving liner equtions rise in number of different settings In prticulr, we will in this chpter focus on the problem of modelling
More informationCMDA 4604: Intermediate Topics in Mathematical Modeling Lecture 19: Interpolation and Quadrature
CMDA 4604: Intermedite Topics in Mthemticl Modeling Lecture 19: Interpoltion nd Qudrture In this lecture we mke brief diversion into the res of interpoltion nd qudrture. Given function f C[, b], we sy
More informationNumerical Methods I Orthogonal Polynomials
Numericl Methods I Orthogonl Polynomils Aleksndr Donev Cournt Institute, NYU 1 donev@cournt.nyu.edu 1 MATH-GA 2011.003 / CSCI-GA 2945.003, Fll 2014 Nov 6th, 2014 A. Donev (Cournt Institute) Lecture IX
More informationTheoretical foundations of Gaussian quadrature
Theoreticl foundtions of Gussin qudrture 1 Inner product vector spce Definition 1. A vector spce (or liner spce) is set V = {u, v, w,...} in which the following two opertions re defined: (A) Addition of
More information1 The fundamental theorems of calculus.
The fundmentl theorems of clculus. The fundmentl theorems of clculus. Evluting definite integrls. The indefinite integrl- new nme for nti-derivtive. Differentiting integrls. Tody we provide the connection
More informationProperties of the Riemann Integral
Properties of the Riemnn Integrl Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University Februry 15, 2018 Outline 1 Some Infimum nd Supremum Properties 2
More informationa n = 1 58 a n+1 1 = 57a n + 1 a n = 56(a n 1) 57 so 0 a n+1 1, and the required result is true, by induction.
MAS221(216-17) Exm Solutions 1. (i) A is () bounded bove if there exists K R so tht K for ll A ; (b) it is bounded below if there exists L R so tht L for ll A. e.g. the set { n; n N} is bounded bove (by
More informationConvex Sets and Functions
B Convex Sets nd Functions Definition B1 Let L, +, ) be rel liner spce nd let C be subset of L The set C is convex if, for ll x,y C nd ll [, 1], we hve 1 )x+y C In other words, every point on the line
More informationThe final exam will take place on Friday May 11th from 8am 11am in Evans room 60.
Mth 104: finl informtion The finl exm will tke plce on Fridy My 11th from 8m 11m in Evns room 60. The exm will cover ll prts of the course with equl weighting. It will cover Chpters 1 5, 7 15, 17 21, 23
More informationAdvanced Computational Fluid Dynamics AA215A Lecture 3 Polynomial Interpolation: Numerical Differentiation and Integration.
Advnced Computtionl Fluid Dynmics AA215A Lecture 3 Polynomil Interpoltion: Numericl Differentition nd Integrtion Antony Jmeson Winter Qurter, 2016, Stnford, CA Lst revised on Jnury 7, 2016 Contents 3 Polynomil
More informationOrthogonal Polynomials
Mth 4401 Gussin Qudrture Pge 1 Orthogonl Polynomils Orthogonl polynomils rise from series solutions to differentil equtions, lthough they cn be rrived t in vriety of different mnners. Orthogonl polynomils
More information4.5 JACOBI ITERATION FOR FINDING EIGENVALUES OF A REAL SYMMETRIC MATRIX. be a real symmetric matrix. ; (where we choose θ π for.
4.5 JACOBI ITERATION FOR FINDING EIGENVALUES OF A REAL SYMMETRIC MATRIX Some reliminries: Let A be rel symmetric mtrix. Let Cos θ ; (where we choose θ π for Cos θ 4 purposes of convergence of the scheme)
More informationPresentation Problems 5
Presenttion Problems 5 21-355 A For these problems, ssume ll sets re subsets of R unless otherwise specified. 1. Let P nd Q be prtitions of [, b] such tht P Q. Then U(f, P ) U(f, Q) nd L(f, P ) L(f, Q).
More informationChapter 3. Vector Spaces
3.4 Liner Trnsformtions 1 Chpter 3. Vector Spces 3.4 Liner Trnsformtions Note. We hve lredy studied liner trnsformtions from R n into R m. Now we look t liner trnsformtions from one generl vector spce
More information1. Gauss-Jacobi quadrature and Legendre polynomials. p(t)w(t)dt, p {p(x 0 ),...p(x n )} p(t)w(t)dt = w k p(x k ),
1. Guss-Jcobi qudrture nd Legendre polynomils Simpson s rule for evluting n integrl f(t)dt gives the correct nswer with error of bout O(n 4 ) (with constnt tht depends on f, in prticulr, it depends on
More informationConstruction of Gauss Quadrature Rules
Jim Lmbers MAT 772 Fll Semester 2010-11 Lecture 15 Notes These notes correspond to Sections 10.2 nd 10.3 in the text. Construction of Guss Qudrture Rules Previously, we lerned tht Newton-Cotes qudrture
More information1 The Riemann Integral
The Riemnn Integrl. An exmple leding to the notion of integrl (res) We know how to find (i.e. define) the re of rectngle (bse height), tringle ( (sum of res of tringles). But how do we find/define n re
More informationMATH 174A: PROBLEM SET 5. Suggested Solution
MATH 174A: PROBLEM SET 5 Suggested Solution Problem 1. Suppose tht I [, b] is n intervl. Let f 1 b f() d for f C(I; R) (i.e. f is continuous rel-vlued function on I), nd let L 1 (I) denote the completion
More informationThe Banach algebra of functions of bounded variation and the pointwise Helly selection theorem
The Bnch lgebr of functions of bounded vrition nd the pointwise Helly selection theorem Jordn Bell jordn.bell@gmil.com Deprtment of Mthemtics, University of Toronto Jnury, 015 1 BV [, b] Let < b. For f
More informationAbstract inner product spaces
WEEK 4 Abstrct inner product spces Definition An inner product spce is vector spce V over the rel field R equipped with rule for multiplying vectors, such tht the product of two vectors is sclr, nd the
More informationLecture 14: Quadrature
Lecture 14: Qudrture This lecture is concerned with the evlution of integrls fx)dx 1) over finite intervl [, b] The integrnd fx) is ssumed to be rel-vlues nd smooth The pproximtion of n integrl by numericl
More informationW. We shall do so one by one, starting with I 1, and we shall do it greedily, trying
Vitli covers 1 Definition. A Vitli cover of set E R is set V of closed intervls with positive length so tht, for every δ > 0 nd every x E, there is some I V with λ(i ) < δ nd x I. 2 Lemm (Vitli covering)
More informationLecture 3. Limits of Functions and Continuity
Lecture 3 Limits of Functions nd Continuity Audrey Terrs April 26, 21 1 Limits of Functions Notes I m skipping the lst section of Chpter 6 of Lng; the section bout open nd closed sets We cn probbly live
More informationNUMERICAL INTEGRATION. The inverse process to differentiation in calculus is integration. Mathematically, integration is represented by.
NUMERICAL INTEGRATION 1 Introduction The inverse process to differentition in clculus is integrtion. Mthemticlly, integrtion is represented by f(x) dx which stnds for the integrl of the function f(x) with
More informationMath 120 Answers for Homework 13
Mth 12 Answers for Homework 13 1. In this problem we will use the fct tht if m f(x M on n intervl [, b] (nd if f is integrble on [, b] then (* m(b f dx M(b. ( The function f(x = 1 + x 3 is n incresing
More informationLecture 3 ( ) (translated and slightly adapted from lecture notes by Martin Klazar)
Lecture 3 (5.3.2018) (trnslted nd slightly dpted from lecture notes by Mrtin Klzr) Riemnn integrl Now we define precisely the concept of the re, in prticulr, the re of figure U(, b, f) under the grph of
More information1 Error Analysis of Simple Rules for Numerical Integration
cs41: introduction to numericl nlysis 11/16/10 Lecture 19: Numericl Integrtion II Instructor: Professor Amos Ron Scries: Mrk Cowlishw, Nthnel Fillmore 1 Error Anlysis of Simple Rules for Numericl Integrtion
More information1 Linear Least Squares
Lest Squres Pge 1 1 Liner Lest Squres I will try to be consistent in nottion, with n being the number of dt points, nd m < n being the number of prmeters in model function. We re interested in solving
More informationDiscrete Least-squares Approximations
Discrete Lest-squres Approximtions Given set of dt points (x, y ), (x, y ),, (x m, y m ), norml nd useful prctice in mny pplictions in sttistics, engineering nd other pplied sciences is to construct curve
More informationMath 61CM - Solutions to homework 9
Mth 61CM - Solutions to homework 9 Cédric De Groote November 30 th, 2018 Problem 1: Recll tht the left limit of function f t point c is defined s follows: lim f(x) = l x c if for ny > 0 there exists δ
More informationReview of Calculus, cont d
Jim Lmbers MAT 460 Fll Semester 2009-10 Lecture 3 Notes These notes correspond to Section 1.1 in the text. Review of Clculus, cont d Riemnn Sums nd the Definite Integrl There re mny cses in which some
More information1 The fundamental theorems of calculus.
The fundmentl theorems of clculus. The fundmentl theorems of clculus. Evluting definite integrls. The indefinite integrl- new nme for nti-derivtive. Differentiting integrls. Theorem Suppose f is continuous
More informationSTUDY GUIDE FOR BASIC EXAM
STUDY GUIDE FOR BASIC EXAM BRYON ARAGAM This is prtil list of theorems tht frequently show up on the bsic exm. In mny cses, you my be sked to directly prove one of these theorems or these vrints. There
More informationThe Riemann Integral
Deprtment of Mthemtics King Sud University 2017-2018 Tble of contents 1 Anti-derivtive Function nd Indefinite Integrls 2 3 4 5 Indefinite Integrls & Anti-derivtive Function Definition Let f : I R be function
More informationNumerical integration
2 Numericl integrtion This is pge i Printer: Opque this 2. Introduction Numericl integrtion is problem tht is prt of mny problems in the economics nd econometrics literture. The orgniztion of this chpter
More informationPolynomial Approximations for the Natural Logarithm and Arctangent Functions. Math 230
Polynomil Approimtions for the Nturl Logrithm nd Arctngent Functions Mth 23 You recll from first semester clculus how one cn use the derivtive to find n eqution for the tngent line to function t given
More informationPhysics 116C Solution of inhomogeneous ordinary differential equations using Green s functions
Physics 6C Solution of inhomogeneous ordinry differentil equtions using Green s functions Peter Young November 5, 29 Homogeneous Equtions We hve studied, especilly in long HW problem, second order liner
More informationFunctional Analysis I Solutions to Exercises. James C. Robinson
Functionl Anlysis I Solutions to Exercises Jmes C. Robinson Contents 1 Exmples I pge 1 2 Exmples II 5 3 Exmples III 9 4 Exmples IV 15 iii 1 Exmples I 1. Suppose tht v α j e j nd v m β k f k. with α j,
More informationa n+2 a n+1 M n a 2 a 1. (2)
Rel Anlysis Fll 004 Tke Home Finl Key 1. Suppose tht f is uniformly continuous on set S R nd {x n } is Cuchy sequence in S. Prove tht {f(x n )} is Cuchy sequence. (f is not ssumed to be continuous outside
More informationLecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014
Lecture 17 Integrtion: Guss Qudrture Dvid Semerro University of Illinois t Urbn-Chmpign Mrch 0, 014 Dvid Semerro (NCSA) CS 57 Mrch 0, 014 1 / 9 Tody: Objectives identify the most widely used qudrture method
More informationSTURM-LIOUVILLE BOUNDARY VALUE PROBLEMS
STURM-LIOUVILLE BOUNDARY VALUE PROBLEMS Throughout, we let [, b] be bounded intervl in R. C 2 ([, b]) denotes the spce of functions with derivtives of second order continuous up to the endpoints. Cc 2
More informationMath 118: Honours Calculus II Winter, 2005 List of Theorems. L(P, f) U(Q, f). f exists for each ǫ > 0 there exists a partition P of [a, b] such that
Mth 118: Honours Clculus II Winter, 2005 List of Theorems Lemm 5.1 (Prtition Refinement): If P nd Q re prtitions of [, b] such tht Q P, then L(P, f) L(Q, f) U(Q, f) U(P, f). Lemm 5.2 (Upper Sums Bound
More informationChapter Direct Method of Interpolation More Examples Civil Engineering
Chpter 5. Direct Method of Interpoltion More Exmples Civil Engineering Exmple o mximie ctch of bss in lke, it is suggested to throw the line to the depth of the thermocline. he chrcteristic feture of this
More informationPrinciples of Real Analysis I Fall VI. Riemann Integration
21-355 Principles of Rel Anlysis I Fll 2004 A. Definitions VI. Riemnn Integrtion Let, b R with < b be given. By prtition of [, b] we men finite set P [, b] with, b P. The set of ll prtitions of [, b] will
More informationQuadratic Forms. Quadratic Forms
Qudrtic Forms Recll the Simon & Blume excerpt from n erlier lecture which sid tht the min tsk of clculus is to pproximte nonliner functions with liner functions. It s ctully more ccurte to sy tht we pproximte
More informationDOING PHYSICS WITH MATLAB MATHEMATICAL ROUTINES
DOIG PHYSICS WITH MATLAB MATHEMATICAL ROUTIES COMPUTATIO OF OE-DIMESIOAL ITEGRALS In Cooper School of Physics, University of Sydney in.cooper@sydney.edu.u DOWLOAD DIRECTORY FOR MATLAB SCRIPTS mth_integrtion_1d.m
More information5.4, 6.1, 6.2 Handout. As we ve discussed, the integral is in some way the opposite of taking a derivative. The exact relationship
5.4, 6.1, 6.2 Hnout As we ve iscusse, the integrl is in some wy the opposite of tking erivtive. The exct reltionship is given by the Funmentl Theorem of Clculus: The Funmentl Theorem of Clculus: If f is
More informationThe Regulated and Riemann Integrals
Chpter 1 The Regulted nd Riemnn Integrls 1.1 Introduction We will consider severl different pproches to defining the definite integrl f(x) dx of function f(x). These definitions will ll ssign the sme vlue
More informationOverview of Calculus
Overview of Clculus June 6, 2016 1 Limits Clculus begins with the notion of limit. In symbols, lim f(x) = L x c In wors, however close you emn tht the function f evlute t x, f(x), to be to the limit L
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 203 Outline Riemnn Sums Riemnn Integrls Properties Abstrct
More informationUNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE
UNIFORM CONVERGENCE MA 403: REAL ANALYSIS, INSTRUCTOR: B. V. LIMAYE 1. Pointwise Convergence of Sequence Let E be set nd Y be metric spce. Consider functions f n : E Y for n = 1, 2,.... We sy tht the sequence
More informationMapping the delta function and other Radon measures
Mpping the delt function nd other Rdon mesures Notes for Mth583A, Fll 2008 November 25, 2008 Rdon mesures Consider continuous function f on the rel line with sclr vlues. It is sid to hve bounded support
More informationNumerical quadrature based on interpolating functions: A MATLAB implementation
SEMINAR REPORT Numericl qudrture bsed on interpolting functions: A MATLAB implementtion by Venkt Ayylsomyjul A seminr report submitted in prtil fulfillment for the degree of Mster of Science (M.Sc) in
More informationRecitation 3: More Applications of the Derivative
Mth 1c TA: Pdric Brtlett Recittion 3: More Applictions of the Derivtive Week 3 Cltech 2012 1 Rndom Question Question 1 A grph consists of the following: A set V of vertices. A set E of edges where ech
More informationLINEAR ALGEBRA APPLIED
5.5 Applictions of Inner Product Spces 5.5 Applictions of Inner Product Spces 7 Find the cross product of two vectors in R. Find the liner or qudrtic lest squres pproimtion of function. Find the nth-order
More informationMORE FUNCTION GRAPHING; OPTIMIZATION. (Last edited October 28, 2013 at 11:09pm.)
MORE FUNCTION GRAPHING; OPTIMIZATION FRI, OCT 25, 203 (Lst edited October 28, 203 t :09pm.) Exercise. Let n be n rbitrry positive integer. Give n exmple of function with exctly n verticl symptotes. Give
More informationMath 473: Practice Problems for the Material after Test 2, Fall 2011
Mth 473: Prctice Problems for the Mteril fter Test, Fll SOLUTION. Consider the following modified het eqution u t = u xx + u x. () Use the relevnt 3 point pproximtion formuls for u xx nd u x to derive
More informationRiemann Sums and Riemann Integrals
Riemnn Sums nd Riemnn Integrls Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University August 26, 2013 Outline 1 Riemnn Sums 2 Riemnn Integrls 3 Properties
More informationUndergraduate Research
Undergrdute Reserch A Trigonometric Simpson s Rule By Ctherine Cusimno Kirby nd Sony Stnley Biogrphicl Sketch Ctherine Cusimno Kirby is the dughter of Donn nd Sm Cusimno. Originlly from Vestvi Hills, Albm,
More informationEnergy Bands Energy Bands and Band Gap. Phys463.nb Phenomenon
Phys463.nb 49 7 Energy Bnds Ref: textbook, Chpter 7 Q: Why re there insultors nd conductors? Q: Wht will hppen when n electron moves in crystl? In the previous chpter, we discussed free electron gses,
More information7.2 Riemann Integrable Functions
7.2 Riemnn Integrble Functions Theorem 1. If f : [, b] R is step function, then f R[, b]. Theorem 2. If f : [, b] R is continuous on [, b], then f R[, b]. Theorem 3. If f : [, b] R is bounded nd continuous
More informationOrthogonal Polynomials and Least-Squares Approximations to Functions
Chpter Orthogonl Polynomils nd Lest-Squres Approximtions to Functions **4/5/3 ET. Discrete Lest-Squres Approximtions Given set of dt points (x,y ), (x,y ),..., (x m,y m ), norml nd useful prctice in mny
More information1 The Lagrange interpolation formula
Notes on Qudrture 1 The Lgrnge interpoltion formul We briefly recll the Lgrnge interpoltion formul. The strting point is collection of N + 1 rel points (x 0, y 0 ), (x 1, y 1 ),..., (x N, y N ), with x
More informationAQA Further Pure 1. Complex Numbers. Section 1: Introduction to Complex Numbers. The number system
Complex Numbers Section 1: Introduction to Complex Numbers Notes nd Exmples These notes contin subsections on The number system Adding nd subtrcting complex numbers Multiplying complex numbers Complex
More informationUniversity of Houston, Department of Mathematics Numerical Analysis II
University of Houston, Deprtment of Mtemtics Numericl Anlysis II 6 Glerkin metod, finite differences nd colloction 6.1 Glerkin metod Consider sclr 2nd order ordinry differentil eqution in selfdjoint form
More informationCOT4501 Spring Homework VII
COT451 Spring 1 Homework VII The ssignment is due in clss on Thursdy, April 19, 1. There re five regulr problems nd one computer problem (using MATLAB). For written problems, you need to show your work
More informationLecture 14 Numerical integration: advanced topics
Lecture 14 Numericl integrtion: dvnced topics Weinn E 1,2 nd Tiejun Li 2 1 Deprtment of Mthemtics, Princeton University, weinn@princeton.edu 2 School of Mthemticl Sciences, Peking University, tieli@pku.edu.cn
More informationMath 360: A primitive integral and elementary functions
Mth 360: A primitive integrl nd elementry functions D. DeTurck University of Pennsylvni October 16, 2017 D. DeTurck Mth 360 001 2017C: Integrl/functions 1 / 32 Setup for the integrl prtitions Definition:
More informationENGI 9420 Lecture Notes 7 - Fourier Series Page 7.01
ENGI 940 ecture Notes 7 - Fourier Series Pge 7.0 7. Fourier Series nd Fourier Trnsforms Fourier series hve multiple purposes, including the provision of series solutions to some liner prtil differentil
More informationMath 1B, lecture 4: Error bounds for numerical methods
Mth B, lecture 4: Error bounds for numericl methods Nthn Pflueger 4 September 0 Introduction The five numericl methods descried in the previous lecture ll operte by the sme principle: they pproximte the
More informationChapter 14. Matrix Representations of Linear Transformations
Chpter 4 Mtrix Representtions of Liner Trnsformtions When considering the Het Stte Evolution, we found tht we could describe this process using multipliction by mtrix. This ws nice becuse computers cn
More informationCAAM 453 NUMERICAL ANALYSIS I Examination There are four questions, plus a bonus. Do not look at them until you begin the exam.
Exmintion 1 Posted 23 October 2002. Due no lter thn 5pm on Mondy, 28 October 2002. Instructions: 1. Time limit: 3 uninterrupted hours. 2. There re four questions, plus bonus. Do not look t them until you
More informationMATH SS124 Sec 39 Concepts summary with examples
This note is mde for students in MTH124 Section 39 to review most(not ll) topics I think we covered in this semester, nd there s exmples fter these concepts, go over this note nd try to solve those exmples
More informationNotes on length and conformal metrics
Notes on length nd conforml metrics We recll how to mesure the Eucliden distnce of n rc in the plne. Let α : [, b] R 2 be smooth (C ) rc. Tht is α(t) (x(t), y(t)) where x(t) nd y(t) re smooth rel vlued
More informationg i fφdx dx = x i i=1 is a Hilbert space. We shall, henceforth, abuse notation and write g i f(x) = f
1. Appliction of functionl nlysis to PEs 1.1. Introduction. In this section we give little introduction to prtil differentil equtions. In prticulr we consider the problem u(x) = f(x) x, u(x) = x (1) where
More information4 7x =250; 5 3x =500; Read section 3.3, 3.4 Announcements: Bell Ringer: Use your calculator to solve
Dte: 3/14/13 Objective: SWBAT pply properties of exponentil functions nd will pply properties of rithms. Bell Ringer: Use your clcultor to solve 4 7x =250; 5 3x =500; HW Requests: Properties of Log Equtions
More informationRiemann is the Mann! (But Lebesgue may besgue to differ.)
Riemnn is the Mnn! (But Lebesgue my besgue to differ.) Leo Livshits My 2, 2008 1 For finite intervls in R We hve seen in clss tht every continuous function f : [, b] R hs the property tht for every ɛ >
More informationTaylor Polynomial Inequalities
Tylor Polynomil Inequlities Ben Glin September 17, 24 Abstrct There re instnces where we my wish to pproximte the vlue of complicted function round given point by constructing simpler function such s polynomil
More informationNUMERICAL INTEGRATION
NUMERICAL INTEGRATION How do we evlute I = f (x) dx By the fundmentl theorem of clculus, if F (x) is n ntiderivtive of f (x), then I = f (x) dx = F (x) b = F (b) F () However, in prctice most integrls
More informationCalculus in R. Chapter Di erentiation
Chpter 3 Clculus in R 3.1 Di erentition Definition 3.1. Suppose U R is open. A function f : U! R is di erentible t x 2 U if there exists number m such tht lim y!0 pple f(x + y) f(x) my y =0. If f is di
More informationp(x) = 3x 3 + x n 3 k=0 so the right hand side of the equality we have to show is obtained for r = b 0, s = b 1 and 2n 3 b k x k, q 2n 3 (x) =
Norwegin University of Science nd Technology Deprtment of Mthemticl Sciences Pge 1 of 5 Contct during the exm: Elen Celledoni, tlf. 73593541, cell phone 48238584 PLESE NOTE: this solution is for the students
More informationFourier series. Preliminary material on inner products. Suppose V is vector space over C and (, )
Fourier series. Preliminry mteril on inner products. Suppose V is vector spce over C nd (, ) is Hermitin inner product on V. This mens, by definition, tht (, ) : V V C nd tht the following four conditions
More informationPartial Derivatives. Limits. For a single variable function f (x), the limit lim
Limits Prtil Derivtives For single vrible function f (x), the limit lim x f (x) exists only if the right-hnd side limit equls to the left-hnd side limit, i.e., lim f (x) = lim f (x). x x + For two vribles
More informationMath 520 Final Exam Topic Outline Sections 1 3 (Xiao/Dumas/Liaw) Spring 2008
Mth 520 Finl Exm Topic Outline Sections 1 3 (Xio/Dums/Liw) Spring 2008 The finl exm will be held on Tuesdy, My 13, 2-5pm in 117 McMilln Wht will be covered The finl exm will cover the mteril from ll of
More informationIntegrals - Motivation
Integrls - Motivtion When we looked t function s rte of chnge If f(x) is liner, the nswer is esy slope If f(x) is non-liner, we hd to work hrd limits derivtive A relted question is the re under f(x) (but
More informationLine Integrals. Partitioning the Curve. Estimating the Mass
Line Integrls Suppose we hve curve in the xy plne nd ssocite density δ(p ) = δ(x, y) t ech point on the curve. urves, of course, do not hve density or mss, but it my sometimes be convenient or useful to
More informationLecture 6: Singular Integrals, Open Quadrature rules, and Gauss Quadrature
Lecture notes on Vritionl nd Approximte Methods in Applied Mthemtics - A Peirce UBC Lecture 6: Singulr Integrls, Open Qudrture rules, nd Guss Qudrture (Compiled 6 August 7) In this lecture we discuss the
More informationc n φ n (x), 0 < x < L, (1) n=1
SECTION : Fourier Series. MATH4. In section 4, we will study method clled Seprtion of Vribles for finding exct solutions to certin clss of prtil differentil equtions (PDEs. To do this, it will be necessry
More informationMATH34032: Green s Functions, Integral Equations and the Calculus of Variations 1
MATH34032: Green s Functions, Integrl Equtions nd the Clculus of Vritions 1 Section 1 Function spces nd opertors Here we gives some brief detils nd definitions, prticulrly relting to opertors. For further
More informationMatrices, Moments and Quadrature, cont d
Jim Lmbers MAT 285 Summer Session 2015-16 Lecture 2 Notes Mtrices, Moments nd Qudrture, cont d We hve described how Jcobi mtrices cn be used to compute nodes nd weights for Gussin qudrture rules for generl
More informationHomework 11. Andrew Ma November 30, sin x (1+x) (1+x)
Homewor Andrew M November 3, 4 Problem 9 Clim: Pf: + + d = d = sin b +b + sin (+) d sin (+) d using integrtion by prts. By pplying + d = lim b sin b +b + sin (+) d. Since limits to both sides, lim b sin
More informationNumerical Analysis. Doron Levy. Department of Mathematics Stanford University
Numericl Anlysis Doron Levy Deprtment of Mthemtics Stnford University December 1, 2005 D. Levy Prefce i D. Levy CONTENTS Contents Prefce i 1 Introduction 1 2 Interpoltion 2 2.1 Wht is Interpoltion?............................
More informationRiemann Integrals and the Fundamental Theorem of Calculus
Riemnn Integrls nd the Fundmentl Theorem of Clculus Jmes K. Peterson Deprtment of Biologicl Sciences nd Deprtment of Mthemticl Sciences Clemson University September 16, 2013 Outline Grphing Riemnn Sums
More informationSolutions to Assignment #8
Mth 1 Numericl Anlysis (Bueler) December 9, 29 Solutions to Assignment #8 Problems 64, exercise 14: The nswer turns out to be yes, which mens tht I hve to be orgnized in writing it up There re lot of fcts
More information8 Laplace s Method and Local Limit Theorems
8 Lplce s Method nd Locl Limit Theorems 8. Fourier Anlysis in Higher DImensions Most of the theorems of Fourier nlysis tht we hve proved hve nturl generliztions to higher dimensions, nd these cn be proved
More informationSeptember 13 Homework Solutions
College of Engineering nd Computer Science Mechnicl Engineering Deprtment Mechnicl Engineering 5A Seminr in Engineering Anlysis Fll Ticket: 5966 Instructor: Lrry Cretto Septemer Homework Solutions. Are
More informationSummary Information and Formulae MTH109 College Algebra
Generl Formuls Summry Informtion nd Formule MTH109 College Algebr Temperture: F = 9 5 C + 32 nd C = 5 ( 9 F 32 ) F = degrees Fhrenheit C = degrees Celsius Simple Interest: I = Pr t I = Interest erned (chrged)
More information