Consequences of Orthogonality
|
|
- Clifton Melton
- 5 years ago
- Views:
Transcription
1 Consequences of Orthogonality Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of Orthogonality Today 1 / 23
2 Introduction The three kind of examples we did above involved Dirichlet, Neumann and periodic boundary conditions. In all three cases, the boundary conditions were homogeneous. We reflect on these examples and put the techniques used into a more general mathematical framework. We will see that the nice properties integrals of sines and cosines have which allowed us to solve these problems more easily were not an accident or luck. In the process, we will introduce some important concepts from linear algebra and prove some important results about orthogonality and eigenvalues. We then apply these results to the last kind of boundary conditions we haven t studied yet: mixed or robin boundary conditions. We will also apply these results to boundary conditions which are not homogeneous. Philippe B. Laval (KSU) Consequences of Orthogonality Today 2 / 23
3 Linear Algebra Concepts There are many parallels between linear algebra and differential equations. They are based upon similar theoretical foundations we quickly review here. The underlying space under which both are studied is called a vector space. A vector space is not just a space containing the type of vectors studied in a multivariable class. It can contain many other objects such as matrices, functions,... A vector space is simply a space of elements which satisfies certain properties. As a refresher, we give the definition of a vector space. Philippe B. Laval (KSU) Consequences of Orthogonality Today 3 / 23
4 Linear Algebra Concepts: Vector Space Definition (Vector Space) A vector space is a non-empty set of objects V, called vectors, on which are defined two operations, called addition and scalar multiplication which must satisfy the ten axioms listed below. These axioms must be satisfied for every vector u, v, w in V and every scalar c and d. 1 u + v V, u + v = v + u, (u + v) + w = u + (v + w) 2 There exists a vector in V, called the zero vector and denoted 0 such that u + 0 = u 3 For every vector u in V, there exists a vector u also in V such that u + ( u) = 0 4 cu V, c (u + v) = cu + cv, (c + d) u = cu + du 5 c (du) = (cd) u, 1u = u Philippe B. Laval (KSU) Consequences of Orthogonality Today 4 / 23
5 Linear Algebra Concepts: Vector Space Remark When the above is satisfied, we say that (V, +,.) is a vector space. So it is important to understand that a vector space is a set of objects together with two operations acting on these objects. Remark How the two operations are defined depends on the set and the objects it contains. Remark The scalars which come into play in scalar multiplication can be either real numbers, in which case we have a real vector space, or complex numbers, in which case we have a complex vector space. Remark A vector is simply an element of a vector space. Philippe B. Laval (KSU) Consequences of Orthogonality Today 5 / 23
6 Linear Algebra Concepts: Inner Product Two important concepts associated with many vector spaces, are the concept of an inner product also known as a dot product and the concept of a norm. How the inner product is defined depends on the kind of vector space we have. For each example of vector spaces we give below, we will give the corresponding inner product. However, once we have an inner product, we can define the corresponding norm. The notation for the inner product is.,.. For example, if u and v are two vectors, then the dot or inner product between these two vectors is denoted u, v. When the vectors are elements of R 2, R 3, R n, we also use the notation u v for the inner product. Philippe B. Laval (KSU) Consequences of Orthogonality Today 6 / 23
7 Linear Algebra Concepts: Norm Definition Let V be a vector space and v V. The norm of v, denoted v is defined to be v = v v = v, v The notion of norm is very important, it allows us to have the concept of size or length of a vector. The notion of inner product allows us to determine when two vectors are orthogonal (perpendicular). Recall that u v u, v = 0 Philippe B. Laval (KSU) Consequences of Orthogonality Today 7 / 23
8 Linear Algebra Concepts Definition Let S = {v 1, v 2,..., v n } be a set of vectors in a vector space V. 1 We say that S is linearly independent if c 1 v 1 + c 2 v c n v n = 0 c 1 = c 2 =... = c n = 0 2 The expression c 1 v 1 + c 2 v c n v n is called a linear combination of the vectors v 1, v 2,..., v n. 3 If S in not linearly independent, then it is said to be linearly dependent. 4 We say that S spans V if every element in V can be written as a linear combination of elements of S. 5 A subset B of S is called a basis of V if B is linearly independent and spans V. In this case, the dimension of V is the number of elements in B. It can be proven that all the basis of a given vector space have the same number of elements. Philippe B. Laval (KSU) Consequences of Orthogonality Today 8 / 23
9 Linear Algebra Concepts Example A typical vector space studied in linear algebra is R n. Consider the vectors u = (u 1, u 2,..., u n ) and v = (v 1, v 2,..., v n ) from R n. n The inner product is u, v = u 1 v 1 + u 2 v u n v n = u i v i. The norm of a vector is u = u1 2 + u n u2 n = u and v are orthogonal, denoted u v when u, v = 0 that is when u 1 v 1 + u 2 v u n v n = 0. Let e i denote the vector in R n with 1 in the i th entry and 0 everywhere else. Then B = {e 1, e 2,..., e n } is a basis for R n. It is easy to see that it is linearly independent and that it spans R n. Since B has n elements, R n has dimension n. i=1 i=1 u 2 i Philippe B. Laval (KSU) Consequences of Orthogonality Today 9 / 23
10 Linear Algebra Concepts Example Consider the functions y (x) : [α, β] R, and let V = {y (x) : ay + by + cy = 0, where a, b, c R and a 0}. It can be shown V satisfies the properties of a vector space. The inner product is u (x), v (x) = β α u (x) v (x) dx for any two functions u (x) and v (x) in V. The norm of a function is then u (x) = ( ) 1 β u (x), u (x) = α u (x) u (x) dx 2. u (x) and v (x) are orthogonal, denoted u v if u (x), v (x) = β α u (x) v (x) dx = 0. Let B = {y 1 (x), y 2 (x)} be a fundamental solution set for ay + by + cy = 0 then B is a basis for V. Since B has two elements, V has dimension 2. Philippe B. Laval (KSU) Consequences of Orthogonality Today 10 / 23
11 Orthogonality and Eigenvalues We now focus on functions which are orthogonal. We look at families of functions. Definition A family of functions {f n (x) : [a, b] R} n=1 none of which is identically 0, is said to be an orthogonal family on [a, b] if f i, f j = 0, i j that is if b a f i (x) f j (x) dx = 0 We have already encountered several such families. Philippe B. Laval (KSU) Consequences of Orthogonality Today 11 / 23
12 Orthogonality and Eigenvalues Example { sin nπ } L x is an orthogonal family for 0 < x < L. It forms the basis of n=1 the Fourier sine series on 0 < x < L. Example { cos nπ } { L x or equivalently 1, cos nπ } n=0 L x is an orthogonal family for n=1 0 < x < L. It forms the basis of the Fourier cosine series on 0 < x < L. Example { 1, sin nπ L x, cos nπ } L x is an orthogonal family for L < x < L. It n=1 forms the basis of the Fourier series on L < x < L. Philippe B. Laval (KSU) Consequences of Orthogonality Today 12 / 23
13 Orthogonality and Eigenvalues Orthogonality played an important part in determining the coeffi cients in the Fourier series expansion of the initial condition when we were solving the IBVP in the preceding two sections. This was not an accident as we now show. Consider X + λx = 0 with Dirichlet, Neumann, periodic or mixed (Robin) boundary conditions. Suppose that λ 1 is an eigenvalue with corresponding eigenfunction X 1 and λ 2 is another eigenvalue with corresponding eigenfunction X 2. Then we have Using the identity X 1 = λ 1 X 1, X 2 = λ 2 X 2, λ 1 λ 2 (1) ( X 1 X 2 + X 1 X 2) = X 1 X 2 + X 1 X 2 (2) and integrating each side over a < x < b, we have Philippe B. Laval (KSU) Consequences of Orthogonality Today 13 / 23
14 Orthogonality and Eigenvalues or b a ( X 1 X 2 + X 1 X 2 ) b dx = a ( X 1 X 2 + X 1 X 2 ) dx (3) = ( X 1X 2 + X 1 X 2 ) b a b (λ 1 λ 2 ) X 1 X 2 dx a = X 1 (b) X 2 (b) + X 1 (b) X 2 (b) + X 1 (a) X 2 (a) X 1 (a) X 2 (a) We now see what the above equation becomes for each boundary condition. (4) Philippe B. Laval (KSU) Consequences of Orthogonality Today 14 / 23
15 Orthogonality and Eigenvalues Dirichlet: In this case, both eigenfunctions X 1 and X 2 satisfy X (a) = X (b) = 0 and the right-hand side of equation 4 is 0. Neumann: In this case, both eigenfunctions X 1 and X 2 satisfy X (a) = X (b) = 0 and the right-hand side of equation 4 is 0. Mixed or Robin: In this case, both eigenfunctions X 1 and X 2 satisfy αx (a) + βx (a) = 0 and αx (b) + βx (b) = 0 and the right-hand side of equation 4 is 0 (see homework). Periodic: In this case, both eigenfunctions X 1 and X 2 satisfy X (a) = X (b) and X (a) = X (b) and the right-hand side of equation 4 is 0 (see homework). Philippe B. Laval (KSU) Consequences of Orthogonality Today 15 / 23
16 for any pair of function f and g which satisfy 6. Philippe B. Laval (KSU) Consequences of Orthogonality Today 16 / 23 Orthogonality and Eigenvalues Hence, in all four cases we see that equation 4 becomes (λ 1 λ 2 ) b a X 1 X 2 dx = 0 (5) since λ 1 λ 2, we must have b a X 1X 2 dx = 0 which says that X 1 and X 2 are orthogonal for a < x < b. Definition Boundary conditions of the form α 1 X (a) + β 1 X (b) + γ 1 X (a) + δ 1 X (b) = 0 (6) α 2 X (a) + β 2 X (b) + γ 2 X (a) + δ 2 X (b) = 0 are called symmetric boundary conditions if ( f (x) g (x) f (x) g (x) ) b a = 0 (7)
17 Orthogonality and Eigenvalues Remark Before we continue, we make a few remarks. 1 The four boundary conditions we have studied so far are of the form described in equation 6 as long as they are homogeneous. 2 The four boundary conditions we have studied so far are symmetric for pairs of eigenfunctions as the computations above show, as long as they are homogeneous. This leads us to the following important theorem. Philippe B. Laval (KSU) Consequences of Orthogonality Today 17 / 23
18 Orthogonality and Eigenvalues Theorem Consider X + λx = 0 with any type of symmetric boundary conditions. 1 The sequence of eigenfunctions {X n (x)} forms an orthogonal family. 2 Suppose that b a f 2 (x) dx <. If f is expanded in an infinite series of these eigenfunctions f (x) = C n X n (x), a < x < b (8) n=1 then the coeffi cients for n = 1, 2,... are given by C n = f, X b n X n, X n = a f (x) X n (x) dx b a X n 2 (x) dx = b a f (x) X n (x) dx x n (x) 2 (9) Philippe B. Laval (KSU) Consequences of Orthogonality Today 18 / 23
19 Orthogonality and Eigenvalues: We make some important remarks before continuing. The first part of the theorem shows us that the nice formulas we used to find the coeffi cients in the two sections above was not just a calculus identity involving sine and cosines. It is in fact an inherent characteristic of eigenvalue problems with symmetric boundary conditions. In particular, this means that we don t have to verify the orthogonality condition for pairs of eigenvalues in an eigenvalue problem with symmetric boundary conditions. Theorem 11 guarantees they always happen. The second part of the theorem tells us that the technique we used to find the coeffi cients of the Fourier sine or cosine series apply to general eigenfunction expansions. Philippe B. Laval (KSU) Consequences of Orthogonality Today 19 / 23
20 Orthogonality and Eigenvalues In the work we did, we assumed there was such an expansion. In the next chapters, we will discuss when we have such an expansion. In all the work we did so far, we kind of assumed that λ was real. We are now in a position to prove it. Theorem Consider X + λx = 0 with any type of symmetric boundary conditions. All the eigenvalues are real and the corresponding eigenfunctions can be chosen to be real-valued functions. Again, let us emphasize that the four boundary conditions we have studied (Dirichlet, Neumann, mixed, and periodic) fall in this category as long as they are homogeneous. Philippe B. Laval (KSU) Consequences of Orthogonality Today 20 / 23
21 Orthogonality and Eigenvalues Looking back at the various examples we did, we noted that there was never a nontrivial solution for negative eigenvalues. We can now prove that this was not an accident. Theorem Consider X + λx = 0 with any type of symmetric boundary conditions. If the eigenfunctions satisfy then there are no negative eigenvalues. X (x) X (x) b a 0 (10) It is important to note that each of the boundary conditions we used in the previous two sections (Dirichlet, Neumann, and periodic) satisfy equation 10 as long as they are homogeneous. We can use this theorem to quickly rule out negative eigenvalues. We will see in the next section that mixed boundary conditions do not always satisfy equation 10. Philippe B. Laval (KSU) Consequences of Orthogonality Today 21 / 23
22 Summary We list the important results we found in this section. When solving the BVP X + λx = 0, the following is true: 1 The four boundary conditions (Dirichlet, Neumann, mixed, and periodic) are symmetric. 2 For symmetric boundary conditions, the eigenfunctions form an orthogonal family. Hence, for the four boundary conditions (Dirichlet, Neumann, mixed, and periodic), the eigenfunctions form an orthogonal family. 3 For symmetric boundary conditions, the eigenvalues are real. Hence, for the four boundary conditions (Dirichlet, Neumann, mixed, and periodic), the eigenvalues are real. 4 For symmetric boundary conditions for which the eigenfunctions also satisfy X (x) X (x) b a 0, there are no negative eigenvalues. This extra condition is always satisfied for Dirichlet, Neumann and periodic boundary conditions. It is not always satisfied for mixed boundary conditions. Hence, for mixed boundary conditions, the case λ < 0 will have to be checked. Philippe B. Laval (KSU) Consequences of Orthogonality Today 22 / 23
23 Exercises See the problems at the end of my notes on consequences of orthogonality. Philippe B. Laval (KSU) Consequences of Orthogonality Today 23 / 23
Differentiation and Integration of Fourier Series
Differentiation and Integration of Fourier Series Philippe B. Laval KSU Today Philippe B. Laval (KSU) Fourier Series Today 1 / 12 Introduction When doing manipulations with infinite sums, we must remember
More informationIntroduction to Partial Differential Equations
Introduction to Partial Differential Equations Philippe B. Laval KSU Current Semester Philippe B. Laval (KSU) Key Concepts Current Semester 1 / 25 Introduction The purpose of this section is to define
More informationStudy Guide for Linear Algebra Exam 2
Study Guide for Linear Algebra Exam 2 Term Vector Space Definition A Vector Space is a nonempty set V of objects, on which are defined two operations, called addition and multiplication by scalars (real
More informationRepresentation of Functions as Power Series
Representation of Functions as Power Series Philippe B. Laval KSU Today Philippe B. Laval (KSU) Functions as Power Series Today / Introduction In this section and the next, we develop several techniques
More informationThe Laplace Transform
The Laplace Transform Laplace Transform Philippe B. Laval KSU Today Philippe B. Laval (KSU) Definition of the Laplace Transform Today 1 / 16 Outline General idea behind the Laplace transform and other
More informationElements of linear algebra
Elements of linear algebra Elements of linear algebra A vector space S is a set (numbers, vectors, functions) which has addition and scalar multiplication defined, so that the linear combination c 1 v
More informationThe Cross Product. Philippe B. Laval. Spring 2012 KSU. Philippe B. Laval (KSU) The Cross Product Spring /
The Cross Product Philippe B Laval KSU Spring 2012 Philippe B Laval (KSU) The Cross Product Spring 2012 1 / 15 Introduction The cross product is the second multiplication operation between vectors we will
More informationThe Laplace Transform
The Laplace Transform Inverse of the Laplace Transform Philippe B. Laval KSU Today Philippe B. Laval (KSU) Inverse of the Laplace Transform Today 1 / 12 Outline Introduction Inverse of the Laplace Transform
More informationDifferentiation - Quick Review From Calculus
Differentiation - Quick Review From Calculus Philippe B. Laval KSU Current Semester Philippe B. Laval (KSU) Differentiation - Quick Review From Calculus Current Semester 1 / 13 Introduction In this section,
More informationMATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS
MATH 221: SOLUTIONS TO SELECTED HOMEWORK PROBLEMS 1. HW 1: Due September 4 1.1.21. Suppose v, w R n and c is a scalar. Prove that Span(v + cw, w) = Span(v, w). We must prove two things: that every element
More informationCriteria for Determining If A Subset is a Subspace
These notes closely follow the presentation of the material given in David C. Lay s textbook Linear Algebra and its Applications (3rd edition). These notes are intended primarily for in-class presentation
More informationArc Length. Philippe B. Laval. Today KSU. Philippe B. Laval (KSU) Arc Length Today 1 / 12
Philippe B. Laval KSU Today Philippe B. Laval (KSU) Arc Length Today 1 / 12 Introduction In this section, we discuss the notion of curve in greater detail and introduce the very important notion of arc
More informationv = v 1 2 +v 2 2. Two successive applications of this idea give the length of the vector v R 3 :
Length, Angle and the Inner Product The length (or norm) of a vector v R 2 (viewed as connecting the origin to a point (v 1,v 2 )) is easily determined by the Pythagorean Theorem and is denoted v : v =
More informationThe following definition is fundamental.
1. Some Basics from Linear Algebra With these notes, I will try and clarify certain topics that I only quickly mention in class. First and foremost, I will assume that you are familiar with many basic
More informationRow Space, Column Space, and Nullspace
Row Space, Column Space, and Nullspace MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Introduction Every matrix has associated with it three vector spaces: row space
More informationDefinition 1. A set V is a vector space over the scalar field F {R, C} iff. there are two operations defined on V, called vector addition
6 Vector Spaces with Inned Product Basis and Dimension Section Objective(s): Vector Spaces and Subspaces Linear (In)dependence Basis and Dimension Inner Product 6 Vector Spaces and Subspaces Definition
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More information4.3 - Linear Combinations and Independence of Vectors
- Linear Combinations and Independence of Vectors De nitions, Theorems, and Examples De nition 1 A vector v in a vector space V is called a linear combination of the vectors u 1, u,,u k in V if v can be
More informationEigenvalues and Eigenvectors
Eigenvalues and Eigenvectors Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) Eigenvalues and Eigenvectors Fall 2015 1 / 14 Introduction We define eigenvalues and eigenvectors. We discuss how to
More informationChapter 6: Orthogonality
Chapter 6: Orthogonality (Last Updated: November 7, 7) These notes are derived primarily from Linear Algebra and its applications by David Lay (4ed). A few theorems have been moved around.. Inner products
More information14 Fourier analysis. Read: Boas Ch. 7.
14 Fourier analysis Read: Boas Ch. 7. 14.1 Function spaces A function can be thought of as an element of a kind of vector space. After all, a function f(x) is merely a set of numbers, one for each point
More informationSolving the Heat Equation (Sect. 10.5).
Solving the Heat Equation Sect. 1.5. Review: The Stationary Heat Equation. The Heat Equation. The Initial-Boundary Value Problem. The separation of variables method. An example of separation of variables.
More informationLecture 7. Econ August 18
Lecture 7 Econ 2001 2015 August 18 Lecture 7 Outline First, the theorem of the maximum, an amazing result about continuity in optimization problems. Then, we start linear algebra, mostly looking at familiar
More informationMethod of Separation of Variables
MODUE 5: HEAT EQUATION 11 ecture 3 Method of Separation of Variables Separation of variables is one of the oldest technique for solving initial-boundary value problems (IBVP) and applies to problems, where
More informationMATH 2331 Linear Algebra. Section 1.1 Systems of Linear Equations. Finding the solution to a set of two equations in two variables: Example 1: Solve:
MATH 2331 Linear Algebra Section 1.1 Systems of Linear Equations Finding the solution to a set of two equations in two variables: Example 1: Solve: x x = 3 1 2 2x + 4x = 12 1 2 Geometric meaning: Do these
More informationIntroduction to Vector Functions
Introduction to Vector Functions Differentiation and Integration Philippe B. Laval KSU Today Philippe B. Laval (KSU) Vector Functions Today 1 / 14 Introduction In this section, we study the differentiation
More informationThe value of a problem is not so much coming up with the answer as in the ideas and attempted ideas it forces on the would be solver I.N.
Math 410 Homework Problems In the following pages you will find all of the homework problems for the semester. Homework should be written out neatly and stapled and turned in at the beginning of class
More informationMath Linear Algebra
Math 220 - Linear Algebra (Summer 208) Solutions to Homework #7 Exercise 6..20 (a) TRUE. u v v u = 0 is equivalent to u v = v u. The latter identity is true due to the commutative property of the inner
More informationVectors in Function Spaces
Jim Lambers MAT 66 Spring Semester 15-16 Lecture 18 Notes These notes correspond to Section 6.3 in the text. Vectors in Function Spaces We begin with some necessary terminology. A vector space V, also
More informationTesting Series with Mixed Terms
Testing Series with Mixed Terms Philippe B. Laval KSU Today Philippe B. Laval (KSU) Series with Mixed Terms Today 1 / 17 Outline 1 Introduction 2 Absolute v.s. Conditional Convergence 3 Alternating Series
More information1. What is the determinant of the following matrix? a 1 a 2 4a 3 2a 2 b 1 b 2 4b 3 2b c 1. = 4, then det
What is the determinant of the following matrix? 3 4 3 4 3 4 4 3 A 0 B 8 C 55 D 0 E 60 If det a a a 3 b b b 3 c c c 3 = 4, then det a a 4a 3 a b b 4b 3 b c c c 3 c = A 8 B 6 C 4 D E 3 Let A be an n n matrix
More informationReview of Some Concepts from Linear Algebra: Part 2
Review of Some Concepts from Linear Algebra: Part 2 Department of Mathematics Boise State University January 16, 2019 Math 566 Linear Algebra Review: Part 2 January 16, 2019 1 / 22 Vector spaces A set
More informationMAT 419 Lecture Notes Transcribed by Eowyn Cenek 6/1/2012
(Homework 1: Chapter 1: Exercises 1-7, 9, 11, 19, due Monday June 11th See also the course website for lectures, assignments, etc) Note: today s lecture is primarily about definitions Lots of definitions
More informationMath Linear Algebra II. 1. Inner Products and Norms
Math 342 - Linear Algebra II Notes 1. Inner Products and Norms One knows from a basic introduction to vectors in R n Math 254 at OSU) that the length of a vector x = x 1 x 2... x n ) T R n, denoted x,
More informationConsequences of the Completeness Property
Consequences of the Completeness Property Philippe B. Laval KSU Today Philippe B. Laval (KSU) Consequences of the Completeness Property Today 1 / 10 Introduction In this section, we use the fact that R
More informationSturm-Liouville Theory
LECTURE 5 Sturm-Liouville Theory In the three preceing lectures I emonstrate the utility of Fourier series in solving PDE/BVPs. As we ll now see, Fourier series are just the tip of the iceberg of the theory
More information2.3. VECTOR SPACES 25
2.3. VECTOR SPACES 25 2.3 Vector Spaces MATH 294 FALL 982 PRELIM # 3a 2.3. Let C[, ] denote the space of continuous functions defined on the interval [,] (i.e. f(x) is a member of C[, ] if f(x) is continuous
More informationTime-Frequency Analysis
Time-Frequency Analysis Basics of Fourier Series Philippe B. aval KSU Fall 015 Philippe B. aval (KSU) Fourier Series Fall 015 1 / 0 Introduction We first review how to derive the Fourier series of a function.
More informationWaves on 2 and 3 dimensional domains
Chapter 14 Waves on 2 and 3 dimensional domains We now turn to the studying the initial boundary value problem for the wave equation in two and three dimensions. In this chapter we focus on the situation
More informationThe set of all solutions to the homogeneous equation Ax = 0 is a subspace of R n if A is m n.
0 Subspaces (Now, we are ready to start the course....) Definitions: A linear combination of the vectors v, v,..., v m is any vector of the form c v + c v +... + c m v m, where c,..., c m R. A subset V
More informationIndependent Component Analysis
Independent Component Analysis Philippe B. Laval KSU Fall 2017 Philippe B. Laval (KSU) ICA Fall 2017 1 / 18 Introduction Independent Component Analysis (ICA) falls under the broader topic of Blind Source
More informationVector space and subspace
Vector space and subspace Math 112, week 8 Goals: Vector space, subspace, span. Null space, column space. Linearly independent, bases. Suggested Textbook Readings: Sections 4.1, 4.2, 4.3 Week 8: Vector
More informationFunctions of Several Variables
Functions of Several Variables Partial Derivatives Philippe B Laval KSU March 21, 2012 Philippe B Laval (KSU) Functions of Several Variables March 21, 2012 1 / 19 Introduction In this section we extend
More informationMath 1060 Linear Algebra Homework Exercises 1 1. Find the complete solutions (if any!) to each of the following systems of simultaneous equations:
Homework Exercises 1 1 Find the complete solutions (if any!) to each of the following systems of simultaneous equations: (i) x 4y + 3z = 2 3x 11y + 13z = 3 2x 9y + 2z = 7 x 2y + 6z = 2 (ii) x 4y + 3z =
More informationThe Singular Value Decomposition
The Singular Value Decomposition Philippe B. Laval KSU Fall 2015 Philippe B. Laval (KSU) SVD Fall 2015 1 / 13 Review of Key Concepts We review some key definitions and results about matrices that will
More informationMA 201: Method of Separation of Variables Finite Vibrating String Problem Lecture - 11 MA201(2016): PDE
MA 201: Method of Separation of Variables Finite Vibrating String Problem ecture - 11 IBVP for Vibrating string with no external forces We consider the problem in a computational domain (x,t) [0,] [0,
More informationOrthonormal Bases; Gram-Schmidt Process; QR-Decomposition
Orthonormal Bases; Gram-Schmidt Process; QR-Decomposition MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 205 Motivation When working with an inner product space, the most
More informationMultiple Choice Questions
Multiple Choice Questions There is no penalty for guessing. Three points per question, so a total of 48 points for this section.. What is the complete relationship between homogeneous linear systems of
More informationMATH 220: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY
MATH 22: INNER PRODUCT SPACES, SYMMETRIC OPERATORS, ORTHOGONALITY When discussing separation of variables, we noted that at the last step we need to express the inhomogeneous initial or boundary data as
More informationMath 4A Notes. Written by Victoria Kala Last updated June 11, 2017
Math 4A Notes Written by Victoria Kala vtkala@math.ucsb.edu Last updated June 11, 2017 Systems of Linear Equations A linear equation is an equation that can be written in the form a 1 x 1 + a 2 x 2 +...
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationDot Products, Transposes, and Orthogonal Projections
Dot Products, Transposes, and Orthogonal Projections David Jekel November 13, 2015 Properties of Dot Products Recall that the dot product or standard inner product on R n is given by x y = x 1 y 1 + +
More informationReview of Functions. Functions. Philippe B. Laval. Current Semester KSU. Philippe B. Laval (KSU) Functions Current Semester 1 / 12
Review of Functions Functions Philippe B. Laval KSU Current Semester Philippe B. Laval (KSU) Functions Current Semester 1 / 12 Introduction Students are expected to know the following concepts about functions:
More informationLecture 23: 6.1 Inner Products
Lecture 23: 6.1 Inner Products Wei-Ta Chu 2008/12/17 Definition An inner product on a real vector space V is a function that associates a real number u, vwith each pair of vectors u and v in V in such
More informationLast Update: April 7, 201 0
M ath E S W inter Last Update: April 7, Introduction to Partial Differential Equations Disclaimer: his lecture note tries to provide an alternative approach to the material in Sections.. 5 in the textbook.
More informationFirst Order Differential Equations
First Order Differential Equations Linear Equations Philippe B. Laval KSU Philippe B. Laval (KSU) 1st Order Linear Equations 1 / 11 Introduction We are still looking at 1st order equations. In today s
More informationProperties of Linear Transformations from R n to R m
Properties of Linear Transformations from R n to R m MATH 322, Linear Algebra I J. Robert Buchanan Department of Mathematics Spring 2015 Topic Overview Relationship between the properties of a matrix transformation
More information4 Vector Spaces. 4.1 Basic Definition and Examples. Lecture 10
Lecture 10 4 Vector Spaces 4.1 Basic Definition and Examples Throughout mathematics we come across many types objects which can be added and multiplied by scalars to arrive at similar types of objects.
More informationEigenvalue Problem. 1 The First (Dirichlet) Eigenvalue Problem
Eigenvalue Problem A. Salih Department of Aerospace Engineering Indian Institute of Space Science and Technology, Thiruvananthapuram July 06 The method of separation variables for solving the heat equation
More informationClass Meeting # 2: The Diffusion (aka Heat) Equation
MATH 8.52 COURSE NOTES - CLASS MEETING # 2 8.52 Introduction to PDEs, Fall 20 Professor: Jared Speck Class Meeting # 2: The Diffusion (aka Heat) Equation The heat equation for a function u(, x (.0.). Introduction
More informationTues Feb Vector spaces and subspaces. Announcements: Warm-up Exercise:
Math 2270-004 Week 7 notes We will not necessarily finish the material from a given day's notes on that day. We may also add or subtract some material as the week progresses, but these notes represent
More informationRelationship Between Integration and Differentiation
Relationship Between Integration and Differentiation Fundamental Theorem of Calculus Philippe B. Laval KSU Today Philippe B. Laval (KSU) FTC Today 1 / 16 Introduction In the previous sections we defined
More informationInner products. Theorem (basic properties): Given vectors u, v, w in an inner product space V, and a scalar k, the following properties hold:
Inner products Definition: An inner product on a real vector space V is an operation (function) that assigns to each pair of vectors ( u, v) in V a scalar u, v satisfying the following axioms: 1. u, v
More informationLINEAR ALGEBRA QUESTION BANK
LINEAR ALGEBRA QUESTION BANK () ( points total) Circle True or False: TRUE / FALSE: If A is any n n matrix, and I n is the n n identity matrix, then I n A = AI n = A. TRUE / FALSE: If A, B are n n matrices,
More informationFunctions of Several Variables: Limits and Continuity
Functions of Several Variables: Limits and Continuity Philippe B. Laval KSU Today Philippe B. Laval (KSU) Limits and Continuity Today 1 / 24 Introduction We extend the notion of its studied in Calculus
More informationCS 246 Review of Linear Algebra 01/17/19
1 Linear algebra In this section we will discuss vectors and matrices. We denote the (i, j)th entry of a matrix A as A ij, and the ith entry of a vector as v i. 1.1 Vectors and vector operations A vector
More informationCambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information
Introduction Consider a linear system y = Φx where Φ can be taken as an m n matrix acting on Euclidean space or more generally, a linear operator on a Hilbert space. We call the vector x a signal or input,
More informationLinear Equation: a 1 x 1 + a 2 x a n x n = b. x 1, x 2,..., x n : variables or unknowns
Linear Equation: a x + a 2 x 2 +... + a n x n = b. x, x 2,..., x n : variables or unknowns a, a 2,..., a n : coefficients b: constant term Examples: x + 4 2 y + (2 5)z = is linear. x 2 + y + yz = 2 is
More informationLinear Algebra. Alvin Lin. August December 2017
Linear Algebra Alvin Lin August 207 - December 207 Linear Algebra The study of linear algebra is about two basic things. We study vector spaces and structure preserving maps between vector spaces. A vector
More information1. Let m 1 and n 1 be two natural numbers such that m > n. Which of the following is/are true?
. Let m and n be two natural numbers such that m > n. Which of the following is/are true? (i) A linear system of m equations in n variables is always consistent. (ii) A linear system of n equations in
More informationBASIC ALGORITHMS IN LINEAR ALGEBRA. Matrices and Applications of Gaussian Elimination. A 2 x. A T m x. A 1 x A T 1. A m x
BASIC ALGORITHMS IN LINEAR ALGEBRA STEVEN DALE CUTKOSKY Matrices and Applications of Gaussian Elimination Systems of Equations Suppose that A is an n n matrix with coefficents in a field F, and x = (x,,
More informationElementary linear algebra
Chapter 1 Elementary linear algebra 1.1 Vector spaces Vector spaces owe their importance to the fact that so many models arising in the solutions of specific problems turn out to be vector spaces. The
More information6. The scalar multiple of u by c, denoted by c u is (also) in V. (closure under scalar multiplication)
Definition: A subspace of a vector space V is a subset H of V which is itself a vector space with respect to the addition and scalar multiplication in V. As soon as one verifies a), b), c) below for H,
More information10 Orthogonality Orthogonal subspaces
10 Orthogonality 10.1 Orthogonal subspaces In the plane R 2 we think of the coordinate axes as being orthogonal (perpendicular) to each other. We can express this in terms of vectors by saying that every
More informationReview For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: = 0 : homogeneous equation.
Review For the Final: Problem 1 Find the general solutions of the following DEs. a) x 2 y xy y 2 = 0 solution: y y x y2 = 0 : homogeneous equation. x2 v = y dy, y = vx, and x v + x dv dx = v + v2. dx =
More informationFinal Review Written by Victoria Kala SH 6432u Office Hours R 12:30 1:30pm Last Updated 11/30/2015
Final Review Written by Victoria Kala vtkala@mathucsbedu SH 6432u Office Hours R 12:30 1:30pm Last Updated 11/30/2015 Summary This review contains notes on sections 44 47, 51 53, 61, 62, 65 For your final,
More informationMath Linear Algebra Final Exam Review Sheet
Math 15-1 Linear Algebra Final Exam Review Sheet Vector Operations Vector addition is a component-wise operation. Two vectors v and w may be added together as long as they contain the same number n of
More informationVector Space Examples Math 203 Spring 2014 Myers. Example: S = set of all doubly infinite sequences of real numbers = {{y k } : k Z, y k R}
Vector Space Examples Math 203 Spring 2014 Myers Example: S = set of all doubly infinite sequences of real numbers = {{y k } : k Z, y k R} Define {y k } + {z k } = {y k + z k } and c{y k } = {cy k }. Example:
More informationMATH 1120 (LINEAR ALGEBRA 1), FINAL EXAM FALL 2011 SOLUTIONS TO PRACTICE VERSION
MATH (LINEAR ALGEBRA ) FINAL EXAM FALL SOLUTIONS TO PRACTICE VERSION Problem (a) For each matrix below (i) find a basis for its column space (ii) find a basis for its row space (iii) determine whether
More informationwhich are not all zero. The proof in the case where some vector other than combination of the other vectors in S is similar.
It follows that S is linearly dependent since the equation is satisfied by which are not all zero. The proof in the case where some vector other than combination of the other vectors in S is similar. is
More informationHomework for Math , Fall 2016
Homework for Math 5440 1, Fall 2016 A. Treibergs, Instructor November 22, 2016 Our text is by Walter A. Strauss, Introduction to Partial Differential Equations 2nd ed., Wiley, 2007. Please read the relevant
More informationExtreme Values and Positive/ Negative Definite Matrix Conditions
Extreme Values and Positive/ Negative Definite Matrix Conditions James K. Peterson Department of Biological Sciences and Department of Mathematical Sciences Clemson University November 8, 016 Outline 1
More informationFall 2016 MATH*1160 Final Exam
Fall 2016 MATH*1160 Final Exam Last name: (PRINT) First name: Student #: Instructor: M. R. Garvie Dec 16, 2016 INSTRUCTIONS: 1. The exam is 2 hours long. Do NOT start until instructed. You may use blank
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 994, 28. This chapter is available free to all individuals, on the understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More information( 9x + 3y. y 3y = (λ 9)x 3x + y = λy 9x + 3y = 3λy 9x + (λ 9)x = λ(λ 9)x. (λ 2 10λ)x = 0
Math 46 (Lesieutre Practice final ( minutes December 9, 8 Problem Consider the matrix M ( 9 a Prove that there is a basis for R consisting of orthonormal eigenvectors for M This is just the spectral theorem:
More informationMTH 2310, FALL Introduction
MTH 2310, FALL 2011 SECTION 6.2: ORTHOGONAL SETS Homework Problems: 1, 5, 9, 13, 17, 21, 23 1, 27, 29, 35 1. Introduction We have discussed previously the benefits of having a set of vectors that is linearly
More informationMTH 464: Computational Linear Algebra
MTH 464: Computational Linear Algebra Lecture Outlines Exam 2 Material Prof. M. Beauregard Department of Mathematics & Statistics Stephen F. Austin State University March 2, 2018 Linear Algebra (MTH 464)
More informationReview of Linear Algebra
Review of Linear Algebra Definitions An m n (read "m by n") matrix, is a rectangular array of entries, where m is the number of rows and n the number of columns. 2 Definitions (Con t) A is square if m=
More informationLinear Algebra: Homework 3
Linear Algebra: Homework 3 Alvin Lin August 206 - December 206 Section.2 Exercise 48 Find all values of the scalar k for which the two vectors are orthogonal. [ ] [ ] 2 k + u v 3 k u v 0 2(k + ) + 3(k
More informationGlossary of Linear Algebra Terms. Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB
Glossary of Linear Algebra Terms Basis (for a subspace) A linearly independent set of vectors that spans the space Basic Variable A variable in a linear system that corresponds to a pivot column in the
More informationIntroduction to Vector Functions
Introduction to Vector Functions Limits and Continuity Philippe B. Laval KSU Today Philippe B. Laval (KSU) Vector Functions Today 1 / 14 Introduction Until now, the functions we studied took a real number
More informationMATH Linear Algebra
MATH 304 - Linear Algebra In the previous note we learned an important algorithm to produce orthogonal sequences of vectors called the Gramm-Schmidt orthogonalization process. Gramm-Schmidt orthogonalization
More informationReview problems for MA 54, Fall 2004.
Review problems for MA 54, Fall 2004. Below are the review problems for the final. They are mostly homework problems, or very similar. If you are comfortable doing these problems, you should be fine on
More informationMath 3191 Applied Linear Algebra
Math 191 Applied Linear Algebra Lecture 1: Inner Products, Length, Orthogonality Stephen Billups University of Colorado at Denver Math 191Applied Linear Algebra p.1/ Motivation Not all linear systems have
More informationEigenvectors and Hermitian Operators
7 71 Eigenvalues and Eigenvectors Basic Definitions Let L be a linear operator on some given vector space V A scalar λ and a nonzero vector v are referred to, respectively, as an eigenvalue and corresponding
More informationHomework 1 Elena Davidson (B) (C) (D) (E) (F) (G) (H) (I)
CS 106 Spring 2004 Homework 1 Elena Davidson 8 April 2004 Problem 1.1 Let B be a 4 4 matrix to which we apply the following operations: 1. double column 1, 2. halve row 3, 3. add row 3 to row 1, 4. interchange
More information5.4 Continuity: Preliminary Notions
5.4. CONTINUITY: PRELIMINARY NOTIONS 181 5.4 Continuity: Preliminary Notions 5.4.1 Definitions The American Heritage Dictionary of the English Language defines continuity as an uninterrupted succession,
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 3th, 28 From separation of variables, we move to linear algebra Roughly speaking, this is the study of
More informationPhysics 342 Lecture 2. Linear Algebra I. Lecture 2. Physics 342 Quantum Mechanics I
Physics 342 Lecture 2 Linear Algebra I Lecture 2 Physics 342 Quantum Mechanics I Wednesday, January 27th, 21 From separation of variables, we move to linear algebra Roughly speaking, this is the study
More informationMATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003
MATH 23a, FALL 2002 THEORETICAL LINEAR ALGEBRA AND MULTIVARIABLE CALCULUS Solutions to Final Exam (in-class portion) January 22, 2003 1. True or False (28 points, 2 each) T or F If V is a vector space
More information