# II. DIFFERENTIABLE MANIFOLDS. Washington Mio CENTER FOR APPLIED VISION AND IMAGING SCIENCES

Save this PDF as:

Size: px
Start display at page:

Download "II. DIFFERENTIABLE MANIFOLDS. Washington Mio CENTER FOR APPLIED VISION AND IMAGING SCIENCES"

## Transcription

1 II. DIFFERENTIABLE MANIFOLDS Washington Mio Anuj Srivastava and Xiuwen Liu (Illustrations by D. Badlyans) CENTER FOR APPLIED VISION AND IMAGING SCIENCES Florida State University

2 WHY MANIFOLDS? Non-linearity underlies many mathematical structures and representations used in computer vision. For example, many image and shape descriptors fall in this category, as discussed in the introduction to this tutorial. On the other hand, differential calculus is one of the most useful tools employed in the study of phenomena modeled on Euclidean n-space R n. The study of optimization and inference problems, dynamics, and geometry on linear spaces can all be approached with the tools of calculus.

3 A natural question arises: What spaces can the techniques of differential calculus be extended to? Since derivative is a local notion, it is reasonable to expect that differential calculus can be developed in spaces that locally look like Euclidean spaces. These spaces are known as differentiable manifolds.

4 Manifolds Underlying Data Points

5 For simplicity, we only consider manifolds in Euclidean spaces, but a more general approach may be taken. Also, most concepts to be discussed extend to infinite-dimensional manifolds, whose relevance to shape and vision problems already has been indicated in the introduction. Our discussion will be somewhat informal. A few references to more complete and general treatments: W. Boothby, An Introduction to Differentiable Manifolds and Riemannian Geometry, Academic Press, F. Warner, Foundations of Differential Geometry and Lie Groups, Graduate Texts in Mathematics, Springer-Verlag, J. Lee, Introduction to Smooth Manifolds, Springer-Verlag, 2002.

6 How to make sense of locally similar to an Euclidean space? A map ϕ: U R m defined on an open region U R n, n m, is said to be a parameterization if: (i) ϕ is a smooth (i.e., infinitely differentiable), one-to-one mapping. ϕ U R 2 This simply says that V = ϕ(u) is produced by bending and stretching the region U in a gentle, elastic manner, disallowing self-intersections.

7 (ii) The m n Jacobian matrix J(x) = [ ] ϕi x j (x) Here, x = (x 1,...,x n ) and ϕ = (ϕ 1,...,ϕ m ). has rank n, for every x U (a) ϕ(t) = (t 3, t 2 ) (b) ϕ(t, s) = (t 3, t 2, s) This condition further ensures that V has no sharp bends, corners, peaks, or other singularities.

8 (ii) The inverse map x = ϕ 1 : V U is continuous. ϕ This condition has to do with the fact that we should be able to recover U from V with a continuous deformation. In the illustration above, ϕ 1 is not continuous. One often refers to ϕ as a parameterization of the set V = ϕ(u), and to the inverse mapping x = ϕ 1 as a local chart, or a local coordinate system on V.

9 Definition of Differentiable Manifolds A subspace M R m is an n-dimensional differentiable manifold if every point has a neighborhood that admits a parameterization defined on a region in R n. More precisely, for every point x M, there are a neighborhood V x M of x, and a parameterization ϕ: U R n R m, with ϕ(u) = V x. ϕ

10 The Space of Directions in R n Examples of Manifolds A direction is determined by a unit vector. Thus, this space can be identified with the unit sphere S n 1 = {x R n : x = 1} Notice that S n 1 can be described as the level set F 1 (1) of the function F(x 1,...,x n ) = x x 2 n.

11 This implicit description of the sphere is a special case of the following general construction. Let F : R m R k, k < m, be a smooth mapping, and let a R k. If the k m Jacobian matrix J(x) of F has rank k, for every x F 1 (a), then M = F 1 (a) R m is an (m k)-dimensional manifold. When this condition on J is satisfied, a R k is said to be a regular value of F. The Graph of a Smooth Function Let g: R n R l be smooth. Then, M = { (x, y) R n+k : y = g(x) } is an n-dimensional manifold. Here, F(x, y) = y g(x) and M = F 1 (0).

12 The Group O(n) of Orthogonal Matrices Let M(n) = R n2 be the space of all n n real matrices, and S(n) = R n(n+1)/2 the subcollection of all symmetric matrices. Consider the map F : M(n) S(n) given by F(A) = AA t, where the superscript t indicates transposition. Orthogonal matrices are those satisfying AA t = I. Hence, O(n) = F 1 (I). It can be shown that I is a regular value of F. Thus, the group of n n orthogonal matrices is a manifold of dimension n 2 n(n + 1) 2 = n(n 1). 2 Remark. O(n) has two components formed by the orthogonal matrices with positive and negative determinants, resp. The positive component is denoted SO(n).

13 Lines in R n Through the Origin A line in R n through the origin is completely determined by its intersection with the unit sphere S n 1. This intersection always consists a pair of antipodal points {x, x} S n 1. Thus, the space of lines through the origin can be modeled on the sphere S n 1 with antipodal points identified. This is an (n 1)-dimensional manifold known as the real projective space RP n 1.

14 Grassmann Manifolds The spaces G(n, k) of all k-planes through the origin in R n, k n, generalize real projective spaces. G(n, k) is a manifold of dimension k(n k) and is known as a Grassmann manifold. A k-plane in R n determines an (n k)-plane in R n (namely, its orthogonal complement), and vice-versa. Thus, G(n, k) = G(n, n k).

15 What is a Differentiable Function? Let f : M n R m R be a function. Given u 0 M, let ϕ: U R m be a parameterization such that ϕ(x 0 ) = u 0. The map f is said to be differentiable at the point u 0 if the composite map f ϕ: U R n R, given by f ϕ(x) = f(ϕ(x)), is differentiable at x 0. ϕ f

16 Tangent Vectors A tangent vector to a manifold M n R m at a point p M is a vector in R m that can be realized as the velocity at p of a curve in M. More precisely, a vector v R m is tangent to M at p if there is a smooth curve α: ( ε, ε) M R m such that α(0) = p and α (0) = v.

17 Tangent Spaces The collection of all tangent vectors to an n-manifold M n R m at a point p forms an n-dimensional real vector space denoted T p M. If ϕ: U R n M is a parameterization with ϕ(a) = p, then the set { ϕ (a),..., ϕ } (a) x 1 x n is a basis of T p M.

18 Example Let F : R m R be a differentiable function, and let a R be a regular value of F. The manifold M = F 1 (a) is (n 1)-dimensional and the tangent space to M at p consists of all vectors perpendicular to the gradient vector F(x); that is, T x M = {v R m : F(x), v = 0}. Here,, denotes the usual inner (or dot) product on R n. The Sphere If F(x 1,...,x n ) = x x 2 n, the level set Sn 1 = F 1 (1) is the (n 1)-dimensional unit sphere. In this case, F(x) = 2(x 1,...,x n ) = 2x. Thus, the tangent space to the S n 1 at the point x consists of vectors orthogonal to x; i.e., T x S n 1 = {v R n : x, v = 0}.

19 Derivatives Let f : M R be a differentiable function and v T p M a tangent vector to M at the point p. Realize v as the velocity vector at p of a parametric curve α: ( ε, ε) M. The derivative of f at p along v is the derivative of f(α(t)) at t = 0; that is, df p (v) = d dt (f α) (0). The derivatives of f at p M along vectors v T p M can be assembled into a single linear map referred to as the derivative of f at p. df p : T p M R v df p (v),

20 Differential Geometry on M Given a manifold M n R m, one can define geometric quantities such as the length of a curve in M, the area of a 2D region in M, and curvature. The length of a parametric curve α: [0, 1] M is defined in the usual way, as follows. The velocity vector α (t) is a tangent vector to M at the point α(t). The speed of α at t is given by α (t) = [ α (t), α (t) ] 1/2, and the length of α by L = 1 0 α (t) dt.

21 Geodesics The study of geodesics is motivated, for example, by the question of finding the curve of minimal length connecting two points in a manifold M. This is important in applications because minimal-length curves can be used to define an intrinsic geodesic metric on M, which is useful in a variety of ways. In addition, geodesics provide interpolation and extrapolation techniques, and tools of statistical analysis on non-linear manifolds. In order to avoid further technicalities, think of geodesics as length-minimizing curves in M (locally, this is always the case). A more accurate way of viewing geodesics is as parametric curves with zero intrinsic acceleration. A curve α: I M R m is a geodesic if and only if the acceleration vector α (t) R m is orthogonal to T α(t) M, for every t I.

22 Numerical Calculation of Geodesics 1. Geodesics with prescribed initial position and velocity For many manifolds that arise in applications to computer vision, one can write the differential equation that governs geodesics explicitly, which can then be integrated numerically using classical methods.

23 2. Geodesics between points a, b M One approach is to use a shooting strategy. The idea is to shoot a geodesic from a in a given direction v T a M and follow it for unit time. The terminal point exp a (v) M is known as the exponential of v. If we hit the target (that is, exp(v) = b), then the problem is solved.

24 Otherwise, we consider the miss function h(v) = exp(v) b 2, defined for v T a M. The goal is to minimize (or equivalently, annihilate) the function h. This optimization problem on the linear space T a M can be approached with standard gradient methods.

25 Optimization Problems on Manifolds How can one find minima of functions defined on nonlinear manifolds algorithmically? How to carry out a gradient search? Example. Let x 1,...,x k be sample points in a manifold M. How to make sense of the mean of these points? The arithmetic mean µ = (x x k ) /k used for data in linear spaces does not generalize to manifolds in an obvious manner. However, a simple calculation shows that µ can be viewed as the minimum of the total variance function V (x) = 1 2 k x x i 2. i=1 This minimization problem can be posed in more general manifolds using the geodesic metric.

26 Given x 1,...,x k M, consider the total variance function V (x) = 1 2 k d 2 (x, x i ), i=1 where d denotes geodesic distance. A Karcher mean of the sample is a local minimum µ M of V. Back to Optimization Gradient search strategies used for functions on R n can be adapted to find minima of functions f : M R defined on nonlinear manifolds. For example, the calculation of Karcher means can be approached with this technique. We discuss gradients next.

27 What is the Gradient of a Function on M? The gradient of a function F : M R at a point p M is the unique vector M F(p) T p M such that df p (v) = M F(p), v, for every v T p M. How can it be computed in practice? Oftentimes, F is defined not only on M, but on the larger space R m in which M is embedded. In this case, one first calculates F(p) = ( F,..., F ) x 1 x 1 R m. The orthogonal projection of this vector onto T p M gives M F(p).

28 Gradient Search At each p M, calculate M f(p) T p M. The goal is to search for minima of f by integrating the negative gradient vector field M f on M. Initialize the search at a point p M. Update p by infinitesimally following the unique geodesic starting at p with initial velocity M f(p). Iterate the procedure. Remark. The usual convergence issues associated with gradient methods on R n arise and can be dealt with in a similar manner.

29 Calculation of Karcher Means If {x 1,...,x n } are sample points in a manifold M, the negative gradient of the total variance function V is M V (x) = v 1 (x) v n (x), where v i (x) is the initial velocity of the geodesic that connects x to x i in unit time.

30 Applications to the Analysis of Planar Shapes To illustrate the techniques discussed, we apply them to the study of shapes of planar contours. We consider two different approaches, namely: The Procrustean Shape Analysis of Bookstein and Kendall. The Parametric-Curves Model of Klassen, Srivastava, Mio and Joshi. In both cases, a shape is viewed as an element of a shape space. Geodesics are used to quantify shape similarities and dissimilarities, interpolate and extrapolate shapes, and develop a statistical theory of shapes.

31 Procrustean Shape Analysis A contour is described by a finite, ordered sequence of landmark points in the plane, say, p 1,..., p n. Contours that differ by translations, rotations and uniform scalings of the plane are to be viewed as having the same shape. Hence, shape representations should be insensitive to these transformations. If µ be the centroid of the given points, the vector x = (p 1 µ,..., p n µ) R 2n. is invariant to translations of the contour. This representation places the centroid at the origin. To account for uniform scaling, we normalize x to have unit length. Thus, we adopt the preliminary representation y = x/ x S 2n 1.

32 In this y-representation, rotational effects reduce to rotations about the origin. If y = (y 1,...,y n ), in complex notation, a θ-rotation of y S 2n 1 about the origin is given by y λy = (λy 1,..., λy n ), where λ = e jθ, where j = 1. In other words, vectors y S 2n 1 that differ by a unit complex scalar represent the same shape. Thus, the Procrustean shape space is the space obtained from S 2n 1 by identifying points that differ by multiplication by a unit complex number. It is manifold of dimension (2n 2) known as the complex projective space CP(n 1). Geodesics in CP(n 1) can be used to study shapes quantitatively and develop a statistical theory of shapes. This will be discussed in more detail in Part III.

33 Examples of Procrustean Geodesics

34 Parametric-Curves Approach As a preliminary representation, think of a planar shape as a parametric curve α: I R 2 traversed with constant speed, where I = [0, 1]. To make the representation invariant to uniform scaling, fix the length of α to be 1. This is equivalent to assuming that α (s) = 1, s I. Since α is traversed with unit speed, we can write α (s) = e jθ(s), where j = 1. A function θ: I R with this property is called an angle function for α. Angle functions are insensitive to translations, and the effect of a rotation is to add a constant to θ.

35 To obtain shape representations that are insensitive to rigid motions of the plane, we fix the average of θ to be, say, π. In other words, we choose representatives that satisfy the constraint 1 0 θ(s) ds = π. We are only interested in closed curves. The closure condition α(1) α(0) = 1 0 α (s) ds = 1 0 e jθ(s) ds = 0 is equivalent to the real conditions 1 0 cos θ(s) ds = 0 and 1 0 sin θ(s) ds = 0. These are nonlinear conditions on θ, which will make the geometry of the shape space we consider interesting.

36 Let C the collection of all θ satisfying the three constraints above. We refer to an element of C as a pre-shape. Why call θ C a pre-shape instead of shape? This is because a shape may admit multiple representations in C due to the choices in the placement of the initial point (s = 0) on the curve. For each shape, there is a circle worth of initial points. Thus, our shape space S is the quotient of C by the action of the re-parametrization group S 1 ; i.e., the space S = C/ S 1, obtained by identifying all pre-shapes that differ by a reparameterization.

37 The manifold C and the shape space S are infinite dimensional. Although these spaces can be analyzed with the techniques we have discussed, we consider finite-dimensional approximations for implementation purposes. We discretize an angle function θ: I R using a uniform sampling x = (x 1,..., x m ) R m. The three conditions on θ that define C can be rephrased as: 1 0 θ(s) ds = π 1 m m i=1 x i = π 1 0 cos θ(s) ds = 0 m i=1 cos(x i) = sinθ(s) ds = 0 m i=1 sin(x i) = 0

38 Thus, the finite-dimensional analogue of C is a manifold C m R m of dimension (m 3). Modulo 2π, a reparameterization of θ corresponds to a cyclic permutation of (x 1,..., x m ), followed by an adjustment to ensure that the first of the three conditions is satisfied. The quotient space by reparameterizations is the finite-dimensional version of the shape space S. Examples of Geodesics in S

39

### Implicit Functions, Curves and Surfaces

Chapter 11 Implicit Functions, Curves and Surfaces 11.1 Implicit Function Theorem Motivation. In many problems, objects or quantities of interest can only be described indirectly or implicitly. It is then

### Tangent spaces, normals and extrema

Chapter 3 Tangent spaces, normals and extrema If S is a surface in 3-space, with a point a S where S looks smooth, i.e., without any fold or cusp or self-crossing, we can intuitively define the tangent

### Geometric Modelling Summer 2016

Geometric Modelling Summer 2016 Exercises Benjamin Karer M.Sc. http://gfx.uni-kl.de/~gm Benjamin Karer M.Sc. Geometric Modelling Summer 2016 1 Dierential Geometry Benjamin Karer M.Sc. Geometric Modelling

### Welcome to Copenhagen!

Welcome to Copenhagen! Schedule: Monday Tuesday Wednesday Thursday Friday 8 Registration and welcome 9 Crash course on Crash course on Introduction to Differential and Differential and Information Geometry

### Lectures in Discrete Differential Geometry 2 Surfaces

Lectures in Discrete Differential Geometry 2 Surfaces Etienne Vouga February 4, 24 Smooth Surfaces in R 3 In this section we will review some properties of smooth surfaces R 3. We will assume that is parameterized

### Terse Notes on Riemannian Geometry

Terse Notes on Riemannian Geometry Tom Fletcher January 26, 2010 These notes cover the basics of Riemannian geometry, Lie groups, and symmetric spaces. This is just a listing of the basic definitions and

### Good Problems. Math 641

Math 641 Good Problems Questions get two ratings: A number which is relevance to the course material, a measure of how much I expect you to be prepared to do such a problem on the exam. 3 means of course

### 1 Differentiable manifolds and smooth maps

1 Differentiable manifolds and smooth maps Last updated: April 14, 2011. 1.1 Examples and definitions Roughly, manifolds are sets where one can introduce coordinates. An n-dimensional manifold is a set

### Changing coordinates to adapt to a map of constant rank

Introduction to Submanifolds Most manifolds of interest appear as submanifolds of others e.g. of R n. For instance S 2 is a submanifold of R 3. It can be obtained in two ways: 1 as the image of a map into

### HILBERT S THEOREM ON THE HYPERBOLIC PLANE

HILBET S THEOEM ON THE HYPEBOLIC PLANE MATTHEW D. BOWN Abstract. We recount a proof of Hilbert s result that a complete geometric surface of constant negative Gaussian curvature cannot be isometrically

### Math 205C - Topology Midterm

Math 205C - Topology Midterm Erin Pearse 1. a) State the definition of an n-dimensional topological (differentiable) manifold. An n-dimensional topological manifold is a topological space that is Hausdorff,

### Math 396. Bijectivity vs. isomorphism

Math 396. Bijectivity vs. isomorphism 1. Motivation Let f : X Y be a C p map between two C p -premanifolds with corners, with 1 p. Assuming f is bijective, we would like a criterion to tell us that f 1

### HOMEWORK 2 SOLUTIONS

HOMEWORK SOLUTIONS MA11: ADVANCED CALCULUS, HILARY 17 (1) Find parametric equations for the tangent line of the graph of r(t) = (t, t + 1, /t) when t = 1. Solution: A point on this line is r(1) = (1,,

### CS 468. Differential Geometry for Computer Science. Lecture 17 Surface Deformation

CS 468 Differential Geometry for Computer Science Lecture 17 Surface Deformation Outline Fundamental theorem of surface geometry. Some terminology: embeddings, isometries, deformations. Curvature flows

### Shape Analysis of Elastic Curves in Euclidean Spaces

Shape Analysis of Elastic Curves in Euclidean Spaces Anuj Srivastava, Eric Klassen, Shantanu H. Joshi, and Ian Jermyn 1 Abstract This paper introduces a square-root velocity (SRV) representation for analyzing

### Gravitation: Tensor Calculus

An Introduction to General Relativity Center for Relativistic Astrophysics School of Physics Georgia Institute of Technology Notes based on textbook: Spacetime and Geometry by S.M. Carroll Spring 2013

### Lecture 13 The Fundamental Forms of a Surface

Lecture 13 The Fundamental Forms of a Surface In the following we denote by F : O R 3 a parametric surface in R 3, F(u, v) = (x(u, v), y(u, v), z(u, v)). We denote partial derivatives with respect to the

### Surfaces JWR. February 13, 2014

Surfaces JWR February 13, 214 These notes summarize the key points in the second chapter of Differential Geometry of Curves and Surfaces by Manfredo P. do Carmo. I wrote them to assure that the terminology

### Department of Mathematics, University of California, Berkeley. GRADUATE PRELIMINARY EXAMINATION, Part A Fall Semester 2016

Department of Mathematics, University of California, Berkeley YOUR 1 OR 2 DIGIT EXAM NUMBER GRADUATE PRELIMINARY EXAMINATION, Part A Fall Semester 2016 1. Please write your 1- or 2-digit exam number on

### THEODORE VORONOV DIFFERENTIABLE MANIFOLDS. Fall Last updated: November 26, (Under construction.)

4 Vector fields Last updated: November 26, 2009. (Under construction.) 4.1 Tangent vectors as derivations After we have introduced topological notions, we can come back to analysis on manifolds. Let M

### Introduction - Motivation. Many phenomena (physical, chemical, biological, etc.) are model by differential equations. f f(x + h) f(x) (x) = lim

Introduction - Motivation Many phenomena (physical, chemical, biological, etc.) are model by differential equations. Recall the definition of the derivative of f(x) f f(x + h) f(x) (x) = lim. h 0 h Its

### Differential Geometry and Lie Groups with Applications to Medical Imaging, Computer Vision and Geometric Modeling CIS610, Spring 2008

Differential Geometry and Lie Groups with Applications to Medical Imaging, Computer Vision and Geometric Modeling CIS610, Spring 2008 Jean Gallier Department of Computer and Information Science University

### CHAPTER 7. Connectedness

CHAPTER 7 Connectedness 7.1. Connected topological spaces Definition 7.1. A topological space (X, T X ) is said to be connected if there is no continuous surjection f : X {0, 1} where the two point set

### MATH 12 CLASS 5 NOTES, SEP

MATH 12 CLASS 5 NOTES, SEP 30 2011 Contents 1. Vector-valued functions 1 2. Differentiating and integrating vector-valued functions 3 3. Velocity and Acceleration 4 Over the past two weeks we have developed

### The Symmetric Space for SL n (R)

The Symmetric Space for SL n (R) Rich Schwartz November 27, 2013 The purpose of these notes is to discuss the symmetric space X on which SL n (R) acts. Here, as usual, SL n (R) denotes the group of n n

### arxiv: v3 [math.dg] 19 Jun 2017

THE GEOMETRY OF THE WIGNER CAUSTIC AND AFFINE EQUIDISTANTS OF PLANAR CURVES arxiv:160505361v3 [mathdg] 19 Jun 017 WOJCIECH DOMITRZ, MICHA L ZWIERZYŃSKI Abstract In this paper we study global properties

### Lie Groups for 2D and 3D Transformations

Lie Groups for 2D and 3D Transformations Ethan Eade Updated May 20, 2017 * 1 Introduction This document derives useful formulae for working with the Lie groups that represent transformations in 2D and

### The first order quasi-linear PDEs

Chapter 2 The first order quasi-linear PDEs The first order quasi-linear PDEs have the following general form: F (x, u, Du) = 0, (2.1) where x = (x 1, x 2,, x 3 ) R n, u = u(x), Du is the gradient of u.

### Integration and Manifolds

Integration and Manifolds Course No. 100 311 Fall 2007 Michael Stoll Contents 1. Manifolds 2 2. Differentiable Maps and Tangent Spaces 8 3. Vector Bundles and the Tangent Bundle 13 4. Orientation and Orientability

### Definition 5.1. A vector field v on a manifold M is map M T M such that for all x M, v(x) T x M.

5 Vector fields Last updated: March 12, 2012. 5.1 Definition and general properties We first need to define what a vector field is. Definition 5.1. A vector field v on a manifold M is map M T M such that

### AXIOMATIC AND COORDINATE GEOMETRY

AXIOMATIC AND COORDINATE GEOMETRY KAPIL PARANJAPE 1. Introduction At some point between high school and college we first make the transition between Euclidean (or synthetic) geometry and co-ordinate (or

### An Introduction to Riemannian Geometry

An Introduction to Riemannian Geometry with Applications to Mechanics and Relativity Leonor Godinho and José Natário Lisbon, 2004 Contents Chapter 1. Differentiable Manifolds 3 1. Topological Manifolds

### A Geometric Review of Linear Algebra

A Geometric Reiew of Linear Algebra The following is a compact reiew of the primary concepts of linear algebra. The order of presentation is unconentional, with emphasis on geometric intuition rather than

### Numerical solutions of nonlinear systems of equations

Numerical solutions of nonlinear systems of equations Tsung-Ming Huang Department of Mathematics National Taiwan Normal University, Taiwan E-mail: min@math.ntnu.edu.tw August 28, 2011 Outline 1 Fixed points

### Stratification of 3 3 Matrices

Stratification of 3 3 Matrices Meesue Yoo & Clay Shonkwiler March 2, 2006 1 Warmup with 2 2 Matrices { Best matrices of rank 2} = O(2) S 3 ( 2) { Best matrices of rank 1} S 3 (1) 1.1 Viewing O(2) S 3 (

### Errata for Vector and Geometric Calculus Printings 1-4

October 21, 2017 Errata for Vector and Geometric Calculus Printings 1-4 Note: p. m (n) refers to page m of Printing 4 and page n of Printings 1-3. p. 31 (29), just before Theorem 3.10. f x(h) = [f x][h]

### Faculty of Engineering, Mathematics and Science School of Mathematics

Faculty of Engineering, Mathematics and Science School of Mathematics GROUPS Trinity Term 06 MA3: Advanced Calculus SAMPLE EXAM, Solutions DAY PLACE TIME Prof. Larry Rolen Instructions to Candidates: Attempt

### Section 3.5 The Implicit Function Theorem

Section 3.5 The Implicit Function Theorem THEOREM 11 (Special Implicit Function Theorem): Suppose that F : R n+1 R has continuous partial derivatives. Denoting points in R n+1 by (x, z), where x R n and

### Focus was on solving matrix inversion problems Now we look at other properties of matrices Useful when A represents a transformations.

Previously Focus was on solving matrix inversion problems Now we look at other properties of matrices Useful when A represents a transformations y = Ax Or A simply represents data Notion of eigenvectors,

### STOKES THEOREM ON MANIFOLDS

STOKES THEOREM ON MANIFOLDS GIDEON DRESDNER Abstract. The generalization of the Fundamental Theorem of Calculus to higher dimensions requires fairly sophisticated geometric and algebraic machinery. In

### Ranking from Crowdsourced Pairwise Comparisons via Matrix Manifold Optimization

Ranking from Crowdsourced Pairwise Comparisons via Matrix Manifold Optimization Jialin Dong ShanghaiTech University 1 Outline Introduction FourVignettes: System Model and Problem Formulation Problem Analysis

### Adjoint Orbits, Principal Components, and Neural Nets

Adjoint Orbits, Principal Components, and Neural Nets Some facts about Lie groups and examples Examples of adjoint orbits and a distance measure Descent equations on adjoint orbits Properties of the double

### Interpolation of Rigid Motions in 3D

Interpolation of Rigid Motions in 3D David Eberly, Geometric Tools, Redmond WA 98052 https://www.geometrictools.com/ This work is licensed under the Creative Commons Attribution 4.0 International License.

### Introduction to Topology

Introduction to Topology Randall R. Holmes Auburn University Typeset by AMS-TEX Chapter 1. Metric Spaces 1. Definition and Examples. As the course progresses we will need to review some basic notions about

### SOME REMARKS ON THE TOPOLOGY OF HYPERBOLIC ACTIONS OF R n ON n-manifolds

SOME REMARKS ON THE TOPOLOGY OF HYPERBOLIC ACTIONS OF R n ON n-manifolds DAMIEN BOULOC Abstract. This paper contains some more results on the topology of a nondegenerate action of R n on a compact connected

### MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT

MATHEMATICS COMPREHENSIVE EXAM: IN-CLASS COMPONENT The following is the list of questions for the oral exam. At the same time, these questions represent all topics for the written exam. The procedure for

### LECTURE 8: THE SECTIONAL AND RICCI CURVATURES

LECTURE 8: THE SECTIONAL AND RICCI CURVATURES 1. The Sectional Curvature We start with some simple linear algebra. As usual we denote by ( V ) the set of 4-tensors that is anti-symmetric with respect to

### Shape analysis on Lie groups and Homogeneous Manifolds with applications in computer animation

Shape analysis on Lie groups and Homogeneous Manifolds with applications in computer animation Department of Mathematical Sciences, NTNU, Trondheim, Norway joint work with Markus Eslitzbichler and Alexander

### The Inverse Function Theorem 1

John Nachbar Washington University April 11, 2014 1 Overview. The Inverse Function Theorem 1 If a function f : R R is C 1 and if its derivative is strictly positive at some x R, then, by continuity of

### The nonsmooth Newton method on Riemannian manifolds

The nonsmooth Newton method on Riemannian manifolds C. Lageman, U. Helmke, J.H. Manton 1 Introduction Solving nonlinear equations in Euclidean space is a frequently occurring problem in optimization and

### Differentiation. f(x + h) f(x) Lh = L.

Analysis in R n Math 204, Section 30 Winter Quarter 2008 Paul Sally, e-mail: sally@math.uchicago.edu John Boller, e-mail: boller@math.uchicago.edu website: http://www.math.uchicago.edu/ boller/m203 Differentiation

### Richard S. Palais Department of Mathematics Brandeis University Waltham, MA The Magic of Iteration

Richard S. Palais Department of Mathematics Brandeis University Waltham, MA 02254-9110 The Magic of Iteration Section 1 The subject of these notes is one of my favorites in all mathematics, and it s not

### How well do I know the content? (scale 1 5)

Page 1 I. Number and Quantity, Algebra, Functions, and Calculus (68%) A. Number and Quantity 1. Understand the properties of exponents of s I will a. perform operations involving exponents, including negative

### Matrices and Vectors. Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A =

30 MATHEMATICS REVIEW G A.1.1 Matrices and Vectors Definition of Matrix. An MxN matrix A is a two-dimensional array of numbers A = a 11 a 12... a 1N a 21 a 22... a 2N...... a M1 a M2... a MN A matrix can

### Intro Vectors 2D implicit curves 2D parametric curves. Graphics 2011/2012, 4th quarter. Lecture 2: vectors, curves, and surfaces

Lecture 2, curves, and surfaces Organizational remarks Tutorials: Tutorial 1 will be online later today TA sessions for questions start next week Practicals: Exams: Make sure to find a team partner very

### The Way of Analysis. Robert S. Strichartz. Jones and Bartlett Publishers. Mathematics Department Cornell University Ithaca, New York

The Way of Analysis Robert S. Strichartz Mathematics Department Cornell University Ithaca, New York Jones and Bartlett Publishers Boston London Contents Preface xiii 1 Preliminaries 1 1.1 The Logic of

### Classical differential geometry of two-dimensional surfaces

Classical differential geometry of two-dimensional surfaces 1 Basic definitions This section gives an overview of the basic notions of differential geometry for twodimensional surfaces. It follows mainly

### 5.2 The Levi-Civita Connection on Surfaces. 1 Parallel transport of vector fields on a surface M

5.2 The Levi-Civita Connection on Surfaces In this section, we define the parallel transport of vector fields on a surface M, and then we introduce the concept of the Levi-Civita connection, which is also

### 1 Introduction: connections and fiber bundles

[under construction] 1 Introduction: connections and fiber bundles Two main concepts of differential geometry are those of a covariant derivative and of a fiber bundle (in particular, a vector bundle).

### 1. Method 1: bisection. The bisection methods starts from two points a 0 and b 0 such that

Chapter 4 Nonlinear equations 4.1 Root finding Consider the problem of solving any nonlinear relation g(x) = h(x) in the real variable x. We rephrase this problem as one of finding the zero (root) of a

### The Theorem of Gauß-Bonnet in Complex Analysis 1

The Theorem of Gauß-Bonnet in Complex Analysis 1 Otto Forster Abstract. The theorem of Gauß-Bonnet is interpreted within the framework of Complex Analysis of one and several variables. Geodesic triangles

### Inner product spaces. Layers of structure:

Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty

### Complete Surfaces of Constant Gaussian Curvature in Euclidean Space R 3.

Summary of the Thesis in Mathematics by Valentina Monaco Complete Surfaces of Constant Gaussian Curvature in Euclidean Space R 3. Thesis Supervisor Prof. Massimiliano Pontecorvo 19 May, 2011 SUMMARY The

### Multivariate Differentiation 1

John Nachbar Washington University February 23, 2017 1 Preliminaries. Multivariate Differentiation 1 I assume that you are already familiar with standard concepts and results from univariate calculus;

### Manifolds and tangent bundles. Vector fields and flows. 1 Differential manifolds, smooth maps, submanifolds

MA 755 Fall 05. Notes #1. I. Kogan. Manifolds and tangent bundles. Vector fields and flows. 1 Differential manifolds, smooth maps, submanifolds Definition 1 An n-dimensional C k -differentiable manifold

### DIFFERENTIAL GEOMETRY. LECTURE 12-13,

DIFFERENTIAL GEOMETRY. LECTURE 12-13, 3.07.08 5. Riemannian metrics. Examples. Connections 5.1. Length of a curve. Let γ : [a, b] R n be a parametried curve. Its length can be calculated as the limit of

### Generalized Shifted Inverse Iterations on Grassmann Manifolds 1

Proceedings of the Sixteenth International Symposium on Mathematical Networks and Systems (MTNS 2004), Leuven, Belgium Generalized Shifted Inverse Iterations on Grassmann Manifolds 1 J. Jordan α, P.-A.

### AP Calculus Chapter 3 Testbank (Mr. Surowski)

AP Calculus Chapter 3 Testbank (Mr. Surowski) Part I. Multiple-Choice Questions (5 points each; please circle the correct answer.). If f(x) = 0x 4 3 + x, then f (8) = (A) (B) 4 3 (C) 83 3 (D) 2 3 (E) 2

### Algebra I Fall 2007

MIT OpenCourseWare http://ocw.mit.edu 18.701 Algebra I Fall 007 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms. 18.701 007 Geometry of the Special Unitary

### 1 Lyapunov theory of stability

M.Kawski, APM 581 Diff Equns Intro to Lyapunov theory. November 15, 29 1 1 Lyapunov theory of stability Introduction. Lyapunov s second (or direct) method provides tools for studying (asymptotic) stability

### Then A n W n, A n is compact and W n is open. (We take W 0 =(

9. Mon, Nov. 4 Another related concept is that of paracompactness. This is especially important in the theory of manifolds and vector bundles. We make a couple of preliminary definitions first. Definition

### Manifolds, Lie Groups, Lie Algebras, with Applications. Kurt W.A.J.H.Y. Reillag (alias Jean Gallier) CIS610, Spring 2005

Manifolds, Lie Groups, Lie Algebras, with Applications Kurt W.A.J.H.Y. Reillag (alias Jean Gallier) CIS610, Spring 2005 1 Motivations and Goals 1. Motivations Observation: Often, the set of all objects

### Differential geometry II

Differential geometry II Lecture 2 Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry of non-rigid shapes Stanford University, Winter 2009 Intrinsic & extrinsic geometry 2 First

### Math 396. Map making

Math 396. Map making 1. Motivation When a cartographer makes a map of part of the surface of the earth, this amounts to choosing a C isomorphism from a 2-submanifold with corners S in the sphere S 2 (r)

### Commensurability between once-punctured torus groups and once-punctured Klein bottle groups

Hiroshima Math. J. 00 (0000), 1 34 Commensurability between once-punctured torus groups and once-punctured Klein bottle groups Mikio Furokawa (Received Xxx 00, 0000) Abstract. The once-punctured torus

### A Simple Proof of the Generalized Cauchy s Theorem

A Simple Proof of the Generalized Cauchy s Theorem Mojtaba Mahzoon, Hamed Razavi Abstract The Cauchy s theorem for balance laws is proved in a general context using a simpler and more natural method in

### Statistics 612: L p spaces, metrics on spaces of probabilites, and connections to estimation

Statistics 62: L p spaces, metrics on spaces of probabilites, and connections to estimation Moulinath Banerjee December 6, 2006 L p spaces and Hilbert spaces We first formally define L p spaces. Consider

### 1 Tensors and relativity

Physics 705 1 Tensors and relativity 1.1 History Physical laws should not depend on the reference frame used to describe them. This idea dates back to Galileo, who recognized projectile motion as free

### Chapter 8. Rigid transformations

Chapter 8. Rigid transformations We are about to start drawing figures in 3D. There are no built-in routines for this purpose in PostScript, and we shall have to start more or less from scratch in extending

### Lie Matrix Groups: The Flip Transpose Group

Rose-Hulman Undergraduate Mathematics Journal Volume 16 Issue 1 Article 6 Lie Matrix Groups: The Flip Transpose Group Madeline Christman California Lutheran University Follow this and additional works

### Or, more succinctly, lim

Lecture 7. Functions and Stuff PCMI Summer 2015 Undergraduate Lectures on Flag Varieties Lecture 7. Functions and differentiable and analytic manifolds. The implicit function theorem, cotangent spaces

### Differentiable Functions

Differentiable Functions Let S R n be open and let f : R n R. We recall that, for x o = (x o 1, x o,, x o n S the partial derivative of f at the point x o with respect to the component x j is defined as

### Math 215B: Solutions 3

Math 215B: Solutions 3 (1) For this problem you may assume the classification of smooth one-dimensional manifolds: Any compact smooth one-dimensional manifold is diffeomorphic to a finite disjoint union

### Clifford Algebras and Spin Groups

Clifford Algebras and Spin Groups Math G4344, Spring 2012 We ll now turn from the general theory to examine a specific class class of groups: the orthogonal groups. Recall that O(n, R) is the group of

### Math 234 Exam 3 Review Sheet

Math 234 Exam 3 Review Sheet Jim Brunner LIST OF TOPIS TO KNOW Vector Fields lairaut s Theorem & onservative Vector Fields url Divergence Area & Volume Integrals Using oordinate Transforms hanging the

### On the exponential map on Riemannian polyhedra by Monica Alice Aprodu. Abstract

Bull. Math. Soc. Sci. Math. Roumanie Tome 60 (108) No. 3, 2017, 233 238 On the exponential map on Riemannian polyhedra by Monica Alice Aprodu Abstract We prove that Riemannian polyhedra admit explicit

### Survey on exterior algebra and differential forms

Survey on exterior algebra and differential forms Daniel Grieser 16. Mai 2013 Inhaltsverzeichnis 1 Exterior algebra for a vector space 1 1.1 Alternating forms, wedge and interior product.....................

### L 2 Geometry of the Symplectomorphism Group

University of Notre Dame Workshop on Innite Dimensional Geometry, Vienna 2015 Outline 1 The Exponential Map on D s ω(m) 2 Existence of Multiplicity of Outline 1 The Exponential Map on D s ω(m) 2 Existence

### arxiv: v1 [math.dg] 24 Feb 2017

GEODESIC X-RAY TOMOGRAPHY FOR PIECEWISE CONSTANT FUNCTIONS ON NONTRAPPING MANIFOLDS JOONAS ILMAVIRTA, JERE LEHTONEN, AND MIKKO SALO arxiv:1702.07622v1 [math.dg] 24 Feb 2017 Abstract. We show that on a

### 2) e = e G G such that if a G 0 =0 G G such that if a G e a = a e = a. 0 +a = a+0 = a.

Chapter 2 Groups Groups are the central objects of algebra. In later chapters we will define rings and modules and see that they are special cases of groups. Also ring homomorphisms and module homomorphisms

### ANALYTIC DEFINITIONS FOR HYPERBOLIC OBJECTS. 0. Introduction

Trends in Mathematics Information Center for Mathematical Sciences Volume 5, Number 1,June 00, Pages 11 15 ANALYTIC DEFINITIONS FOR HYPERBOLIC OBJECTS YUNHI CHO AND HYUK KIM Abstract We can extend the

### What is a Space Curve?

What is a Space Curve? A space curve is a smooth map γ : I R R 3. In our analysis of defining the curvature for space curves we will be able to take the inclusion (γ, 0) and have that the curvature of

### Maths Higher Prelim Content

Maths Higher Prelim Content Straight Line Gradient of a line A(x 1, y 1 ), B(x 2, y 2 ), Gradient of AB m AB = y 2 y1 x 2 x 1 m = tanθ where θ is the angle the line makes with the positive direction of

### 1. General Vector Spaces

1.1. Vector space axioms. 1. General Vector Spaces Definition 1.1. Let V be a nonempty set of objects on which the operations of addition and scalar multiplication are defined. By addition we mean a rule

### Riemann Surface. David Gu. SMI 2012 Course. University of New York at Stony Brook. 1 Department of Computer Science

Riemann Surface 1 1 Department of Computer Science University of New York at Stony Brook SMI 2012 Course Thanks Thanks for the invitation. Collaborators The work is collaborated with Shing-Tung Yau, Feng

### Discriminative Direction for Kernel Classifiers

Discriminative Direction for Kernel Classifiers Polina Golland Artificial Intelligence Lab Massachusetts Institute of Technology Cambridge, MA 02139 polina@ai.mit.edu Abstract In many scientific and engineering

### MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS

T H I R D E D I T I O N MULTIVARIABLE CALCULUS, LINEAR ALGEBRA, AND DIFFERENTIAL EQUATIONS STANLEY I. GROSSMAN University of Montana and University College London SAUNDERS COLLEGE PUBLISHING HARCOURT BRACE

### Robustness of Principal Components

PCA for Clustering An objective of principal components analysis is to identify linear combinations of the original variables that are useful in accounting for the variation in those original variables.