CUT LOCI AND DISTANCE FUNCTIONS

Similar documents
LECTURE 22: THE CRITICAL POINT THEORY OF DISTANCE FUNCTIONS

274 Microlocal Geometry, Lecture 2. David Nadler Notes by Qiaochu Yuan

LECTURE 15: COMPLETENESS AND CONVEXITY

LECTURE 10: THE ATIYAH-GUILLEMIN-STERNBERG CONVEXITY THEOREM

fy (X(g)) Y (f)x(g) gy (X(f)) Y (g)x(f)) = fx(y (g)) + gx(y (f)) fy (X(g)) gy (X(f))

Diffeomorphism Groups of Reducible 3-Manifolds. Allen Hatcher

DEVELOPMENT OF MORSE THEORY

THE JORDAN-BROUWER SEPARATION THEOREM

LECTURE 16: CONJUGATE AND CUT POINTS

Bredon, Introduction to compact transformation groups, Academic Press

Euler Characteristic of Two-Dimensional Manifolds

Topological properties

Chapter 3. Riemannian Manifolds - I. The subject of this thesis is to extend the combinatorial curve reconstruction approach to curves

Foliations of Three Dimensional Manifolds

Pogorelov Klingenberg theorem for manifolds homeomorphic to R n (translated from [4])

B 1 = {B(x, r) x = (x 1, x 2 ) H, 0 < r < x 2 }. (a) Show that B = B 1 B 2 is a basis for a topology on X.

(iv) Whitney s condition B. Suppose S β S α. If two sequences (a k ) S α and (b k ) S β both converge to the same x S β then lim.

Centre for Mathematics and Its Applications The Australian National University Canberra, ACT 0200 Australia. 1. Introduction

TRANSITIVE HOLONOMY GROUP AND RIGIDITY IN NONNEGATIVE CURVATURE. Luis Guijarro and Gerard Walschap

SYMPLECTIC GEOMETRY: LECTURE 5

SOME ASPECTS ON CIRCLES AND HELICES IN A COMPLEX PROJECTIVE SPACE. Toshiaki Adachi* and Sadahiro Maeda

BROUWER FIXED POINT THEOREM. Contents 1. Introduction 1 2. Preliminaries 1 3. Brouwer fixed point theorem 3 Acknowledgments 8 References 8

DIFFERENTIAL GEOMETRY, LECTURE 16-17, JULY 14-17

THE POINCARE-HOPF THEOREM

INVERSE FUNCTION THEOREM and SURFACES IN R n

CALCULUS ON MANIFOLDS. 1. Riemannian manifolds Recall that for any smooth manifold M, dim M = n, the union T M =

HOMEWORK 2 - RIEMANNIAN GEOMETRY. 1. Problems In what follows (M, g) will always denote a Riemannian manifold with a Levi-Civita connection.

Chapter 16. Manifolds and Geodesics Manifold Theory. Reading: Osserman [7] Pg , 55, 63-65, Do Carmo [2] Pg ,

LECTURE: KOBORDISMENTHEORIE, WINTER TERM 2011/12; SUMMARY AND LITERATURE

(1) * "?; y«= hfï? ~ A'í>v + r^>>

Geometry of Skeletal Structures and Symmetry Sets

CALCULUS ON MANIFOLDS

Lecture 8. Connections

1 )(y 0) {1}. Thus, the total count of points in (F 1 (y)) is equal to deg y0

Def. A topological space X is disconnected if it admits a non-trivial splitting: (We ll abbreviate disjoint union of two subsets A and B meaning A B =

Math 147, Homework 1 Solutions Due: April 10, 2012

1 Directional Derivatives and Differentiability

Contents. 1. Introduction

Part IB Geometry. Theorems. Based on lectures by A. G. Kovalev Notes taken by Dexter Chua. Lent 2016

A sufficient condition for observability of waves by measurable subsets

A CONSTRUCTION OF TRANSVERSE SUBMANIFOLDS

On the exponential map on Riemannian polyhedra by Monica Alice Aprodu. Abstract

MORSE HOMOLOGY. Contents. Manifolds are closed. Fields are Z/2.

ON A CLASS OF NONSMOOTH COMPOSITE FUNCTIONS

1 Introduction: connections and fiber bundles

A Gauss-Bonnet theorem for constructible sheaves on reductive groups

Part IB GEOMETRY (Lent 2016): Example Sheet 1

4.7 The Levi-Civita connection and parallel transport

How curvature shapes space

On the Diffeomorphism Group of S 1 S 2. Allen Hatcher

DIFFERENTIAL GEOMETRY 1 PROBLEM SET 1 SOLUTIONS

SOME REMARKS ON THE TOPOLOGY OF HYPERBOLIC ACTIONS OF R n ON n-manifolds

On the Intrinsic Differentiability Theorem of Gromov-Schoen

Math 6455 Nov 1, Differential Geometry I Fall 2006, Georgia Tech

Stable tangential families and singularities of their envelopes

arxiv: v2 [math.ag] 24 Jun 2015

II. DIFFERENTIABLE MANIFOLDS. Washington Mio CENTER FOR APPLIED VISION AND IMAGING SCIENCES

HADAMARD FOLIATIONS OF H n. I

Lifting Smooth Homotopies of Orbit Spaces of Proper Lie Group Actions

Lecture 4: Knot Complements

PERVERSE SHEAVES ON A TRIANGULATED SPACE

Math Advanced Calculus II

THE DIMENSION OF A CUT LOCUS ON A SMOOTH RIEMANNIAN MANIFOLD

For Ramin. From Jonathan December 9, 2014

Notes on Real and Complex Analytic and Semianalytic Singularities

Math 396. Bijectivity vs. isomorphism

Math 341: Convex Geometry. Xi Chen

Foliations of hyperbolic space by constant mean curvature surfaces sharing ideal boundary

Eigenvalues and eigenfunctions of the Laplacian. Andrew Hassell

CUT LOCI AND CONJUGATE LOCI ON LIOUVILLE SURFACES

ON THE REAL MILNOR FIBRE OF SOME MAPS FROM R n TO R 2

Homework 4: Mayer-Vietoris Sequence and CW complexes

ON GEODESIC FLOWS MODELED BY EXPANSIVE FLOWS UP TO TIME-PRESERVING SEMI-CONJUGACY

4-DIMENSIONAL LOCALLY CAT(0)-MANIFOLDS WITH NO RIEMANNIAN SMOOTHINGS

Tangent spaces, normals and extrema

Definition We say that a topological manifold X is C p if there is an atlas such that the transition functions are C p.

INFINITE REDUCED WORDS AND THE TITS BOUNDARY OF A COXETER GROUP

arxiv: v4 [math.dg] 18 Jun 2015

Self-intersections of Closed Parametrized Minimal Surfaces in Generic Riemannian Manifolds

SPACES OF RATIONAL CURVES IN COMPLETE INTERSECTIONS

Rigidity result for certain 3-dimensional singular spaces and their fundamental groups.

Transversality. Abhishek Khetan. December 13, Basics 1. 2 The Transversality Theorem 1. 3 Transversality and Homotopy 2

Handlebody Decomposition of a Manifold

Stratification of 3 3 Matrices

The Classification of Nonsimple Algebraic Tangles

ON SPACE-FILLING CURVES AND THE HAHN-MAZURKIEWICZ THEOREM

Chapter 1. Smooth Manifolds

EXOTIC SMOOTH STRUCTURES ON TOPOLOGICAL FIBRE BUNDLES B

The Minimal Element Theorem

Stratified Morse Theory: Past and Present

Contents. O-minimal geometry. Tobias Kaiser. Universität Passau. 19. Juli O-minimal geometry

AN INTEGRAL FORMULA FOR TRIPLE LINKING IN HYPERBOLIC SPACE

Transport Continuity Property

arxiv:math/ v1 [math.dg] 23 Dec 2001

LECTURE 6: J-HOLOMORPHIC CURVES AND APPLICATIONS

THE FUNDAMENTAL GROUP OF MANIFOLDS OF POSITIVE ISOTROPIC CURVATURE AND SURFACE GROUPS

Hopf-Rinow and Hadamard Theorems

Chap. 1. Some Differential Geometric Tools

LECTURE 11: TRANSVERSALITY

Chapter 1. Canonical Decomposition. Notes on Basic 3-Manifold Topology. 1. Prime Decomposition

Transcription:

Math. J. Okayama Univ. 49 (2007), 65 92 CUT LOCI AND DISTANCE FUNCTIONS Jin-ichi ITOH and Takashi SAKAI 1. Introduction Let (M, g) be a compact Riemannian manifold and d(p, q) the distance between p, q M induced from the metric g. Then the distance function f := d p, d p (x) := d(p, x), to a point p M plays a fundamental role in Riemannian geometry. Recall that d p is directionally differentiable at any q p, namely for any unit tangent vector ξ U q M we have the first variation formula (1.1) f q (ξ) = cos α, where α denotes the infimum of angles between ξ and the initial directions of minimal geodesics from q to p. The behavior of the distance function d p is closely related to the structure of the cut locus of p. Recall that the cut locus C(p) of p M is given as follows: for any unit speed geodesic γ u emanating from p with the initial direction u = γ u (0) U p M, there exists the last parameter value i p (u) up to which γ u is a minimal geodesic segment, namely γ u [0, t] realizes the distance d(p, γ u (t)) for 0 < t i p (u). We call γ u (i p (u)) the cut point of p and i p (u) the cut distance to p along γ u. Then the cut locus C(p) of p is defined as (1.2) C(p) := {γ u (i p (u)) u U p M}. Recall that q is a cut point of p along γ u if and only if either there exists another minimal geodesic γ v, v U p M, v u, emanating from p with q = γ u (i p (u)) = γ v (i p (u)), or q is a (first) conjugate point to p along γ u, which means that there exists a nontrivial Jacobi field Y (t) along γ u with Y (0) = Y (i p (u)) = 0 (see e.g., [16]). The set C(p) := {i p (u)u u U p M} is called the tangent cut locus of p. Then if q( p) does not belong to the cut locus C(p), d p is differentiable at q and its gradient vector d p (q) is given by γ(l), where γ is a unique minimal The first author is partially supported by the Grant-in-Aid for Scientific Research (No. 14540086), JSPS, and the second author is partially supported by the Grant-in-Aid for Scientific Research (No. 12440020,17540079), JSPS.. 65

66 J. ITOH AND T. SAKAI geodesic parameterized by arclength joining p to q and we set l = d(p, q). Note that d p (q) = 1. On the other hand, if q C(p) then d p is in general not differentiable at q. Now, q( p) is said to be noncritical for f = d p, if there exists a ξ U q M such that f q (ξ) > 0. Namely, q( p) is a critical point of d p if for any ξ U q M there exists a minimal geodesic γ from q to p whose initial direction makes an angle α π/2 with ξ. Note that a critical point q( p) is a cut point of p, where d p is not differentiable. We consider p itself a critical point of f, since it is a unique minimum point. If f assumes a local maximum at q, then q is a critical point in the above sense. The notion of critical points was first considered by K. Grove and K. Shiohama, and then by M. Gromov ([9], [6]). If q is noncritical, then constructing a gradient-like vector field for f we may put a neighborhood of q nearer to p by an isotopy of M(isotopy lemma). Therefore, we have an analogy of Morse theory for the case without critical points, and this idea has played an essential roll in problems on curvature and topology of Riemannian manifolds ([9], [6], [7]). Now since distance function is the most fundamental function on Riemannian manifold, we ask the behavior of the levels of d p when it passes a critical value. Namely, we ask how to define the notion of index of d p at a critical point q and how we can get a normal form of d p around q under some nondegeneracy condition. As mentioned above, d p is not differentiable at its critical points, and the structure of the cut locus C(p) of p is related to the behavior of d p around critical points. In this note we are concerned with the above problem under the assumption that C(p) has rather nice structure, and we discuss an analogy of Morse theory for distance function. We give an application (Corollary 3.12), and hope to give further applications with the present approach ( [12] is our motivation for the present work). Indeed, V. Gerschkovich and H. Rubinstein have studied Morse theory for generic distance functions from the view point of min-type functions ([3],[4],[5]), and got results closely related to what we will discuss in the following. Especially, they studied the surface case in detail. Here we try to take a more geometric and direct approach. Assume that there is a point p M such that the tangent cut locus C(p) of p is disjoint from the first tangent conjugate locus, namely any minimal

CUT LOCI AND DISTANCE FUNCTIONS 67 geodesic segment emanating from p is conjugate point-free. Then we say that (M, g) satisfies the condition (C) at p M. We are interested in the structure of the cut locus C(p) of p under the above condition (C). Especially, if (M, g) admits no conjugate points along all geodesics emanating from p, then the structure of C(p) may be expressed in terms of the Dirichlet domain of the universal covering space M of M with the induced Riemannian metric g (see [15] for these assertions). If (M, g) is nonpositively curved, then for any point p M there appear no conjugate points to p along any geodesic emanating from p. On the other hand, A. Weinstein showed that for any compact manifold M with dim M 2 except for S 2 there exists a Riemannian metric such that there is a point p M with the cut locus C(p) disjoint from the first conjugate locus ([18]). In this case M satisfies the condition (C) at p. In 2 we introduce the notion of nondegenerate cut points under the condition (C), and show that the cut locus C(p) admits a nice Whitney stratification if all cut points are nondegenerate. As an application, using this peculiar stratification we give a description of the structure of the cut locus C(p) in a neighborhood of any cut point q C(p) in terms of the cone over the cut locus of finitely many unit vectors in general position in the unit sphere S n 1 in T q M (Theorem 2.5). This is also useful to give a normal form of d p around a critical point under some nondegeneracy condition in 3. We also show that critical points of d p in the angle sense are critical points of the smooth function, that is the restriction of the distance function d p to strata containing the critical points, in the usual sense. In 3, under the above assumption, first we define the notion of index for a critical point of d p in the angle sense, and we give a normal form of nondegenerate distance function d p around a critical point by geometric consideration. Then we show that usual procedure of Morse theory works. (Theorem 3.7. Compare [4].) Next, we also consider the condition (F) for p M, which states that for any unit speed geodesic γ u emanating from p, and for any Jacobi field Y along γ u with Y (0) = 0, γ Y (0) 0, we have Y (t), γu Y (t) > 0 for the parameter value t > 0 up to the cut distance i p (u) to p. Note that this implies that the condition (C) holds at p, and the condition (F) is satisfied for any p M when (M, g) is of nonpositive

68 J. ITOH AND T. SAKAI sectional curvature. Then under the assumption of condition (F), on any stratum of C(p) of codimension less than n, we see that the restriction f of the distance function d p to the stratum satisfies the following: any critical point r of d p in the angle sense belonging to the stratum is a strict local minimum of f, namely, r is a critical point of f in the usual sense and its Hessian is positive definite. Therefore, in this case we have simpler procedure of Morse theory (see Theorem 3.11). The structure of cut loci C(p) for generic Riemannian metrics was studied by applying singurality theory to smooth energy integral on the (finitedimensional approximation of) the space of piecewise smooth paths emanating from p ([1],[2],[17],[19]). However, it is not clear for us whether such structure theorems directly give information on the Riemannian distance function d p, and we take here more geometrical approach under somewhat stronger assumption on the cut locus. We are greateful to M. van Manen for his criticism and pointing out several references including [19]. We are greatful to H. Rubinstein for telling us [3],[4],[5]. We would like to also express our sincere appreciation to the referee for his kind suggestion to make the paper more readable. 2. Structure of the cut locus disjoint from the first conjugate locus Suppose a compact n-dimensional Riemannian manifold (M, g) satisfies the condition (C) at p, namely the tangent cut locus C(p) is disjoint from the first tangent conjugate locus of p. Let q C(p). Then from the assumption there are only finitely many minimal geodesics emanating from p to q. We denote by {γ 0,, γ k }(k 1) the set of the minimal geodesics parametrized by arclength from p to q, where k + 1 is called the order of the cut point q. Note that we may find open neighborhoods U q in M and V i l γ i (0) (i = 0,..., k) in T p M such that exp p : V i U are diffeomorphisms, where exp p : T p M M denotes the exponential map at p. We may also assume that for any minimal geodesic γ parameterized by arclength from p to a point r U the tangent vector d(p, r) γ(0) T p M belongs to one of the corresponding V i s. Then we set (2.1) F i := (exp p V i ) 1

CUT LOCI AND DISTANCE FUNCTIONS 69 that is a diffeomorphism from U onto V i for each i = 0,..., k. We set X i := γ i (l), l = d(p, q), i = 0,..., k which are pairwise different unit vectors of T q M. Namely, {X i } 0 i k is the set of initial directions of geodesics from q to p parametrized by arclength. Now we define the notion of nondegenerate cut points as follows: Definition 2.1. A cut point q C(p) of order k + 1 is said to be nondegenerate, if X 0,..., X k are in general position in T q M. This means that the dimension of the affine subspace of the tangent space T q M spanned by {X 0,, X k } is equal to k. This is also equivalent to the condition that X 0 X 1, X 0 X 2,..., X 0 X k (or equivalently, for fixed i, X i X j (j i)) are linearly independent. Then either X 0,..., X k are linearly independent and spans a k-dimensional affine subspace that does not contain the origin, or they are linearly dependent and spans a k-dimensional vector subspace. For instance, cut points of order 2 or of order 3 are always nondegenerate. Note that if q is a nondegenerate cut point, then its order k + 1 is at most n + 1. Remark 2.2. (1) Tangent cut loci of a point in 2-dimensional flat tori are in general hexagons, in which case all cut points are nondegenerate. If the tangent cut locus of p is given by a rectangle, then the cut point q which is furthest to p and is given by vertices of the rectangle of the tangent cut locus is degenerate. Indeed, we have four minimal geodesics from p to q. However, after slightly deforming the lattice such degenerate cut points disappear in this case. All cut points of p in an n-dimensional flat torus are nondegenerate if and only if the cut points, that are local maximum points of d p and given by the vertices of the tangent cut locus, are of order n + 1. (2) The distance function d p is a (germ of) min-type function in the sense of [4], namely, in a neighborhood of q we have d p (r) := min{ F i (r) 0 i k}. Now suppose that all cut points of p are nondegenerate. We denote by C k+1 C(p) the set of cut points of p of order k + 1. We assume that C k+1 is nonempty. Now for q C k+1 we denote by γ 0,..., γ k the set of minimal geodesics parametrized by arclength joining p to q. Recall that for any r U C k+1 and any minimal geodesic γ joining p to r, d(p, r) γ(0)

70 J. ITOH AND T. SAKAI belongs to V i for some 0 i k, and that U C(p) consists of cut points of p of order not greater than k + 1 (see e.g., [15]). Now, we consider a smooth map G : U R k defined by (2.2) G(r) := ( F 0 (r) F 1 (r),..., F 0 (r) F k (r) ), where F i = (exp p V i ) 1 : U V i T r M, i = 0,..., k, are given by (2.1). Then we easily see that (2.3) G 1 (0) = C k+1 U, and that for every r U the gradient vector G j (r) of the j-th coordinate function G j (r) := F 0 (r) F j (r) of G is given by (2.4) G j (r) = X j X 0 (j = 1,..., k) by the first variation formula. Since G j (r) are linearly independent for r G 1 (0) by the assumption, the differential DG(r) : T r U R k of G at any r G 1 (0) is of rank k. It follows by the implicit function theorem that C k+1 is a submanifold of M of codimension k. Equivalently, the hypersurfaces G 1 j (0) (j = 1,..., k) intersect transversally at r G 1 (0). However, note that C k+1 is not necessarily connected, and we denote by C k+1,q the connected component of C k+1 containing q C k+1. Since we have d p (r) = F 0 (r) (= F j (r), j = 1,..., k) for r C k+1 and F 0 is a diffeomorphism, we see that f := d p C k+1,q is a smooth function for q C k+1. Summing up we get Lemma 2.3. Suppose that C k+1 ( ) consists of nondegenerate cut points. Then C k+1 is a submanifold of codimension k of M, and d p is a smooth function when restricted to each connected component C k+1,q of C k+1. It may happen that some C k+1 is empty. For instance, the cut locus of the n-dimensional real projective space with canonical Riemannian metric of constant curvature 1 consists of nondegenerate cut points of order 2, and C k+1 (k 2) is empty. In this case the cut locus is an (n 1)-dimensional projective subspace and indeed a smooth submanifold. From the condition (C) we see that C k+1 is nonempty for some k 1 and then so is C l+1 for

CUT LOCI AND DISTANCE FUNCTIONS 71 1 l k from the nondegeneracy condition. For q C k+1 we have U C(p) = 1 l k C l+1 U and U \ C(p) = k D i, where D i := {r U F i (r) < F j (r) ; j i}. Note that the closure C k+1,q of C k+1,q is given by l k C l+1,r, where r C k+1,q is of order l +1. If C k+2 = then we see that C k+1,q is a smooth submanifold. It follows that we have a stratification of the cut locus by submanifolds C k+1,q, and it is easy to verify the Whitney s condition (B) in our case ([8]). Hence we get Proposition 2.4. Suppose a compact Riemannian manifold (M, g) satisfies the condition (C) at p M and cut points q C(p) are nondegenerate. Then the cut locus C(p) of p has a Whitney stratification given as above. Next we give a description of the tangent cone of a cut point q C(p). Suppose C k+1 consists of nondegenerate cut points. Then recall that C k+1 is an (n k)-dimensional submanifold of M, and d p is a smooth function when restricted to each connected component C k+1,q. Theorem 2.5. Suppose the condition (C) is satisfied at p and all cut points of p are nondegenerate. Let q C k+1 and let γ 0,..., γ k be the minimal geodesics from p to q. Set X i = γ i (l) U q M, i = 0,, k, with l = d(p, q). We denote by S(q) the cut locus of a finite subset {X 0,..., X k } of U q M, which is considered as the unit (n 1)-dimensional sphere with the canonical Riemannian metric. Then C(p) U is homeomorphic to the cone over S(q) in T q M with origin as the vertex, if we take a sufficiently small open neighborhood U of q. First we recall the structure of the cut locus S(q) of the finite set {X 0,..., X k } in the unit sphere U q M with respect to the canonical metric. Indeed, we have X S(q) if and only if there exists at least two minimizing geodesics of U q M from the set {X 0,..., X k } to X. Namely, S(q) consists of the parts of the bisectors of X i and X j (i < j) in the sphere U q M that are closer or of equidistance to other X l s, l i, j. In our case, X 0,, X k spans a k-dimensional affine subspace V 1 and they are contained in a (k 1)- dimensional great or small sphere in U q M. Note that they are contained in a great sphere S k 1 if and only if the affine subspace spanned by them contains i=0

72 J. ITOH AND T. SAKAI the origin and is a vector subspace. If they are contained in a small hypersphere Ŝk 1 in the k-dimensional great sphere S k := U q M X 0,, X k R, we consider the parallel great sphere S k 1 in S k and the corresponding unit vectors X 0,, X k in S k 1 that are projections of X 0,, X k from the north pole respectively. Let Ṽ1 = X 0,, X k R denote the k-dimensional vector subspace determined by S k 1. If {X 0,, X k } are contained in a (k 1)-dimensional great sphere S k 1 of V 1 = X 0,, X k R, we set X i = X i (i = 0,..., k) and Ṽ1 = V 1. Now we give a description of the structure of the cut locus S(q). Lemma 2.6. (i) The cut locus of { X 0,, X k } in the unit sphere U q M coincides with S(q), the cut locus of {X 0,..., X k } in U q M. (ii) The cut locus S k 2 (q) of { X 0,, X k } in S k 1 is given by the union of the boundaries of the Dirichlet domains (or Voronoi diagrams) {u S k 1 (u, X i ) < (u, X j ) for all j i, 0 j k} determined by X i s (0 i k). These Dirichlet domains are spherical (k 1)-dimensional simplices with totally geodesic boundaries in S k 1 and gives a triangulation of S k 1. Then S k 2 (q) is the (k 2)-skeleton of the triangulation consisting of k(k + 1)/2 facets, and (k l 1)-dimensional faces are given by {u S k 1 (u, X i0 ) = = (u, X il ) < (u, X j ); 0 j k, j i 0,..., i l }, which are totally geodesic submanifolds of S k 1. (iii) The whole cut locus S(q) is given by the spherical join of Sk 2 (q) and S n k 1, where S n k 1 consists of points in U q M of spherical distance π/2 (or orthogonal) to the given S k 1. Proof of Lemma. If k = 1, S(q) is given by a great sphere S n 2 of S n 1 obtained as the bisector of X 0 and X 1, and (ii), (iii) hold setting S k 2 (q) =. So we assume k 2 in the proof of (ii) and (iii). (i) Denoting by n the unit vector in V 1 := X 0,, X k R = R k+1 representing the north pole of S k, we have (2.5) X i = cos θ X i + sin θ n, where θ = (X i, X i ) is the spherical distance between S k 1 and Ŝk 1. It follows that for u S n 1 we have (u, X i ) = (u, X j ) (resp. (u, X i ) < (u, X j )) if and only if (u, X i ) = (u, X j )(resp. (u, X i ) < (u, X j )) holds, and the cut locus of { X 0,, X k } coincides with S(q).

CUT LOCI AND DISTANCE FUNCTIONS 73 (ii) By the nondegeneracy condition X 0,, X k S k 1 form vertices of a k-simplex in Ṽ1 = R k. Then (ii) follows from S k 2 (q) = i<j{u S k 1 (u, X i ) = (u, X j ) (u, X l )} where 0 l k, l i, j. (iii) Note that the sphere S n 1 = U q M with the canonical Riemannian metric is isometric to the spherical join S k 1 S n k 1 of S k 1 and S n k 1. Namely any y S n 1 may be written as γ(t), 0 t π/2, where γ is a unit-speed geodesic emanating from x S k 1 perpendicularly to S k 1. Then we have (2.6) cos (γ(t), X i ) = cos t cos (x, X i ) for 0 t π/2. It follows that if x = γ(0) S k 2 (q) then we have γ(t) S(q), 0 t < π/2 and vice versa. On the other hand, S n k 1 is contained in S(q), since S n k 1 is the set of points of equidistance π/2 to X i (i = 0,..., k), namely the set of furthest points to { X i }. Note that the (n k)-dimensional vector subspace V 0 of T q M containing S n k 1 is characterized as the set of points in T q M which are of equidistance from X 0,, X k with respect to the Euclidean metric. In the case where X 0,, X k lie on a small sphere in S k, the cut locus S k 1 (q) of these unit vectors in S k is the spherical suspension of the cut locus S k 2 (q) of X0,, X k in S k 1, and the cut locus S k 2 (q) of these unit vectors in the original small (k 1)-sphere Ŝk 1 is the intersection of S k 1 (q) and the k-dimensional affine subspace V 1 determined by these X i, 0 i k. Then S k 2 (q) is indeed homeomorphic to S k 2 (q). Further note that the cone over S(q) in T q M is homeomorphic to the product of the subspace V 0 and the cone T over S k 2 (q) in Ṽ1. Now we turn to the proof of Theorem 2.5, namely study the local structure of the cut locus C(p) around q C k+1. We set for r U (2.7) x i (r) := F i (r), X i (r) := x i (r), i = 0,, k, where F i is given in (2.1) and recall that we have X i = X i (q) = x i (q). Then from Lemma 2.3 we may regard that we have local coordinates (x 0,, x k, x k+1,, x n ), where (x k+1,, x n ) denotes local coordinates

74 J. ITOH AND T. SAKAI for C k+1 around q guaranteed by Lemma 2.3 on an open neighborhood U of q. In the above, we think (x 0,, x k ) as local coordinates around q for a submanifold N complementary to C k+1 with tangent space spanned by {X i X 0, i = 1, k}. More precisely, setting y i := x 0 x i, i = 1,..., k, we have local coordinates (y 1,, y k, x k+1,, x n ), where (y 1,, y k ) gives a local coordinates system for N taking U( q) smaller if necessary. However, we also use the above notation. Then around q the cut locus C(p) consists of k(k + 1)/2 pieces of hypersurfaces C i,j (0 i < j k) of M given by C i,j := {r C(p) U G ij (r) := x i (r) x j (r) = 0; x l (r) x i (r) = x j (r) for l i, j} corresponding to minimal geodesics γ i and γ j from p to r. Note that these hypersurfaces are also characterized in terms of y i, 1 i k, namely for 1 i < j k we obtain C 0,i := {r U 0 = y i (r) y l (r), l 0, i} C i,j := {r U 0 y i (r) = y j (r) y l (r), l 0, i, j}. The intersection of these hypersurfaces is nothing but C k+1 U. Now for I := {0 i 0 < i 1 < < i a k} we set C I := C i0,i 1 C i0,i 2 C i0,i a. Then C I := C I \ { C J J contains I with J = a + 1} are submanifolds of codimension l in M that give the stratification of the cut locus C(p) in Proposition 2.4. In terms of the coordinates y i we have C I = {r U 0 = y i1 =... = y ia (r) y l (r), l I} (0 = i 0 I), (2.8) C I = {r U 0 = y i1 =... = y ia (r) > y l (r), l I} (0 = i 0 I), C I = {r U 0 y i0 =... = y ia (r) y l (r), l I} (0 I), C I = {r U 0 < y i0 =... = y ia (r) > y l (r), l I} (0 I). Now, for any tangent vector u to C i,j at q we see that u is at the same spherical distance to X i and X j. Indeed, taking a curve s x(s) in C i,j tangent to u, we have x i (x(s)) = F i (x(s)) = F j (x(s)) = x j (x(s)). Then by the first variation formula, it follows that u, X i = u, X j. By the same argument we have u, X l u, X i = u, X j for l i, j, namely, we have for the spherical distance (u, X i ) = (u, X j ) (u, X l ) for l i, j.

CUT LOCI AND DISTANCE FUNCTIONS 75 It follows that T q C Ia = {u T q M u, X i0 = u, X i1 = = u, X ia } and V 0 = T q C k+1 = T q C K with K = {0, 1,..., k}. Now take a section N( U) through q C k+1 defined by x α = const. (α = k + 1,..., n) in U, that is tangent to Ṽ1 = X 1 (q) X 0 (q),..., X k (q) X 0 (q) R = X 1 (q) X 0 (q),..., X k (q) X 0 (q) R. Note that T q N is the orthogonal complement of V 0 = T q C k+1 in T q M. Then we have C 0j N = {r N 0 = y j (r) > y l (r), l j} for 1 j k, C ij N = {r N 0 < y i (r) = y j (r) > y l (r)} for 1 i < j k. and also have the similar expressions for C I N and C I N as in (2.8). Then in terms of the local coordinates (y 1,..., y k ), C(p) N is a cone, and the tangent cone to C I N (resp. C I N) at q is given by t{u U q N (X i0, u) = = (X ia, u) (X l, u), l i 0,..., i a }, t 0 t{u U q N (X i0, u) = = (X ia, u) < (X l, u), l i 0,..., i a } t 0 respectively. It follows that the tangent cone to N C(p) at q is nothing but the cone over S k 2 (q) in Ṽ1 = T q N as described by the above arguments. Therefore N C(p) is homeomorphic to the cone T over S k 2 (q) in Ṽ1. Note that the above fact also holds for r U C k+1,q, and taking U ( q) small if necessary, U C(p) is homeomorphic to the product of T and an open (n k)-disk, and the latter is homeomorphic to the cone over S(q) in T q M. In the case of k = 1, C(p) U is a hypersurface of M and is homeomorphic to open (n 1)-disk, that is the cone over S n 2 in U q M. Remark 2.7. We show that Theorem 2.5 does not hold without assuming the nondegeneracy condition. Let (T, g 0 ) be the 3-dimensional flat torus obtained by identifying the opposite faces of the cube A := [ 10, 10] [ 10, 10] [ 10, 10] in R 3, and we denote by φ : A T this identifying map. Then note that the tangent cut locus of the origin o = φ((0, 0, 0)) coincides with the boundary C of A, and the cut locus C is given by C = φ( C). Now there are exactly four minimal geodesics from the origin to any point in the segment E = {φ((10, 10, t)) 10 < t < 10}, and the cut locus around the point is given by four half planes gathering along the segment E.

76 J. ITOH AND T. SAKAI Now for any positive integer n, let B n (resp. B n ) be the 1 -ball centered 2 n+3 at (1, 1, tan 1 2 ) (resp. (1, 1, tan 1 n 2 )). We denote by 1 n 2 B 1 n (resp. 2 B n) the 1 -ball with the same center as B 2 n+4 n (resp. B n ). Now for an ɛ > 0 small enough take a smooth function χ n (resp. χ n) that is equal to ɛ/2 2n on 1 2 B 1 n (resp. 2 B n ), vanishes outside B n (resp. B n ), and is nonincreasing along radii. Then setting g n := (1 + χ n )g 0 (resp. g n := (1 + χ n)g 0 ), we get a new 3-dimensional almost flat torus. Note that s φ(s, s, s tan 1 2 ) n (resp. φ(s, s, s tan 1 2 )), 0 s 10, is not a g n n (resp. g n)-minimal geodesic from o to q n := φ((10, 10, 10 tan 1 2 ))(= φ((10, 10, 10 tan 1 n 2 ))). n But still there are exactly three g n (resp. g n)-minimal geodesics from o to q n. Namely, q n is a cut point of o and the cut locus around q n with respect to the metric g n (resp. g n) locally consists of three half planes P 1, P 2, P 3 (resp. P 1, P 2, P 3 ) gathering along the segment E, where we set P 1 : y = 10, x > 10; P 2 : x = 10, y > 10; P 3 : x = y < 10 (resp. P 1 : y = 10, x < 10; P 2 : x = 10, y < 10; P 3 : x = y > 10). Note that {B 2n, B 2n+2 } n=1 are pairwise disjoint, and they are disjoint from the segment s φ(s, s, 0). We take a new 3-dimensional almost flat torus (T, g) given by g = (1 + n (χ 2n + χ 2n+1 ))g 0. Then q := φ(10, 10, 0) is again a cut point of o with respect to the deformed Riemannian metric g and in fact there are exactly four g-minimal geodesics from the origin, that are also g 0 -minimal geodesics. It follows that the cut locus S(q) in U q T consists of four half great circles joining two antipodes, and the cone P over S(q) consists of four half planes gathering along a segment. However, the cut locus of the origin with respect to g is not homeomorphic to C, since both of the sequences {q 2n } and {q 2n+1 }) converges to q and the local structure of the cut locus around {q 2n } is different from the one around {q 2n+1 }. Remark 2.8. Even for real analytic metrics, the assumption of nondegeneracy seems necessary in Theorem 2.5, as is suggested by the following example: Take the functions f 1 := z + c, f 2 := z + c, f 3 := y + x 2 + c, f 4 := y + x 2 + c defined on R 3 = {(x, y, z) x, y, z R}, where c is a positive constant. Put f := min{f 1, f 2, f 3, f 4 } and consider the set C of points in R 3

CUT LOCI AND DISTANCE FUNCTIONS 77 such that there are at least two 1 i < j 4 with f = f i = f j. Although f is precisely not a distance function, the set C is similar to the cut locus. Note that the origin (0, 0, 0) belongs to C with f = f i = c(1 i 4), and that gradient vectors of f i at the origin are given by ± / z, ± / y. In this case C consists of the 4 half parabolic cylinders (given by y = z x 2, z 0; y = z + x 2, z 0; y = z x 2, z 0; y = z + x 2, z 0) and 2 cusp regions x y, x y in the xy-plane. On the other hand, S((0, 0, 0)) consists of 4 great half circles of S 2 joining the antipodes. Hence the cone over S((0, 0, 0)) is not homeomorphic to C. Now we set f := d p C k+1,q and give the gradient vector f of f at x C k+1,q. Indeed, let u T x C k+1,q and s x(s) be a curve in C k+1,q with ẋ(0) = u. Then noting that f(x(s)) = F i (x(s)) = x i (x(s)) for any 0 i k, we obtain by the first variation formula (see e.g., [16]) (2.9) f, u = d ds F i(x(s)) s=0 = X i, u, where X i, u is independent of i by the definition of C k+1. It follows that f(x) is the orthogonal projection of any X i to T x C k+1,q for i = 0,, k. Therefore, x is a critical points of f = d p C k+1,q in usual sense if and only if all of X i (i = 0,..., k) are orthogonal to C k+1,q and are located in a (k 1)-dimensional great sphere of U q M. Now how about the Hessian D 2 f(x) of f at a critical point x C k+1,q of f? Let u and s x(s) be as before. Then we have D 2 f(u, u) = d 2 ds 2 F i (x(s)) s=0 for each i (0 i k). Take a variation of γ i given by α(t, s) := exp p t l F i(x(s)), (0 t l := d(p, x), ɛ s ɛ). Then the variation vector field is a unique Jacobi field Y i (t) along γ i with Y i (0) = 0 and Y i (l) = u. Note that Y i is perpendicular to γ i. Then we get by the second variation formula (see e.g., [16]) (2.10) D 2 f(u, u) = l where we set l = d(p, x). 0 { γi Y i (t), γi Y i (t) R(Y i (t), γ i (t)) γ i (t), Y i (t) }dt X i, u ẋ(s) = u, γi Y i (l) X i, u ẋ(s),

78 J. ITOH AND T. SAKAI Now, if a point p of a compact Riemannian manifold (M, g) admits no conjugate points along all geodesics emanating from p (e.g., for any point of a nonpositively curved manifold), then the structure of C(p) may be expressed in terms of the Dirichlet domain of the universal covering space M of M with the induced Riemannian metric g. We briefly explain this case (see also [15]). Let π : M M be the covering projection, and set π 1 (p) = { p = p 0, p 1,..., p N,...}, that may be identified with the deck transformation group Γ = {g 0 = e, g 1,..., g N,...} via p i = g i ( p 0 ), where e denotes the identity. Note that p i (i = 0, 1,...) are poles, namely exp pi : T pi M M are diffeomorphisms, and for any q M there exists a unique minimal geodesic joining p i and q. We fix p as a base point. Then the cut locus C(p) may be described as follows: Let p be the Dirichlet domain of Γ. Namely, p = {H p,g( p) i = 1, 2,...} g( e) Γ with H p, q = { r M d( p, r) < d( q, r)}. Then we have C(p) = π( p ). Since M is compact, it suffices to consider a finite number of g Γ such that d( p, g p) d(m) so that we may write p = j=1,...,n H p,g j ( p). This also means that the distance function d p is a min-type function in the sense of [4], namely we have d p (q) := min{ d( q, g 1 p),..., d( q, g N p)}, where q π 1 (q). Let q C(p) be a cut point of order k + 1 and γ 0, γ k be the minimal geodesics from p to q with length l = d(p, q). As before we set X i = γ i (l) U q M (i = 0,..., k). Take the lift of γ 0 emanating from p with respect to the universal covering π, and we denote by q the end point of the lift. Then there exist g i0 = e, g i1,..., g ik in Γ such that γ j is expressed as the projection of a unique minimal geodesic γ j in M joining g ij p and q (j = 0,..., k) with d(g ij p, q) = d( p, q) = l. Now we set for I = {i 1,..., i k } C I := { r M d(g i p, r) = d( p, r) < d(g j p, r) for any i I, j I}. Then g i0 = e, g i1,..., g ik are chosen in common in the connected component containing q of the set of cut points of order k+1, and we have π( C I ) C(p). If we take the lift of γ j instead of γ 0 in the above, then we have gi 1 j q and CI instead of q and C I, respectively. Now suppose that all cut points of p g 1 i j are nondegenerate. Then X 0,..., X k are in general position in T q M, where

CUT LOCI AND DISTANCE FUNCTIONS 79 we set X i = γ i (l). Then if CI, CI (resp. π( C I )) is a submanifold of dimension n k of M (resp. M), and the cut locus C(p) is stratified by the strata π( C I ) by the same arguments as above. Remark 2.9. (1) We suspect whether Riemannian metrics such that all cut points of p are nondegenerate are open and dense in the set of all Riemannian metrics satisfying the condition (C) at p. For two-dimensional case, V. Gershkovich asserts that the above assertion holds ([3], [5]). This also follows applying a recent result of [13] to our situation. We suspect that their approach is helpful for the above problem. (2) For 3-dimensional case, approximating a Riemannian metric of A. Weinstein ([18]) in 1 by M. Buchner s cut stable metrics, we get Riemannian metrics satisfying the condition (C) for p M such that all cut points of p are nondegenerate ([2], this holds up to dimension 6). (3) M. van Manen pointed out that Y. Yodomin has considered cones over the (n 2)-skelton of simplices for central sets in R n in [19] that is related to our cut locus case. 3. Morse theory for distance functions First we recall the notion of a critical point of the distance function d p in the angle sense (see 1 and [9], [6]). A point q M is said to be a critical point of d p, if for any unit tangent vector v T q M there exists a minimal geodesic γ from p to q such that (v, γ(l)) π/2 holds with l = d(p, q). Note that any critical point q of d p is a cut point of p. Now we set (3.1) Γ(q) := { γ(l) U q M γ : [0, l] M; minimal geodesic from p to q} and define the set ˆΓ q T q M as the convex hull of Γ(q). Then, the above condition for q to be a critical point of d p means that ˆΓ q contains the origin 0 of T q M. Definition 3.1. For any critical point q of d p we define its degree as the dimension of the (vector) subspace spanned by Γ(q). Recall that we set X i := γ i (l), l = d(p, q) for minimal geodesics γ i (i = 0,, k) joining p to q. If C(p) is nondegenerate and q C k+1, then X 0,, X k span a k or (k + 1)-dimensional (vector) subspace V. If q is a

80 J. ITOH AND T. SAKAI critical point, then V is a subspace of dimension k, since the convex hull ˆΓ q contains 0. Therefore in this nondegenerate case, degree of q is equal to k. Now, suppose there exist no critical points in the annulus R(r 1, r 2 ) := d 1 p ([r 1, r 2 ]) = {x M r 1 d p (x) r 2 }, 0 < r 1 < r 2. Then the isotopy lemma asserts the following: All the levels d 1 p (r), r 1 r r 2 are homeomorphic to each other, and R(r 1, r 2 ) is homeomorphic to the product d 1 p (r 1) [r 1, r 2 ]. This may be proved as in usual Morse theory by considering a gradient-like vector field of d p (see e.g., [9], [6], [10] for more detail). Next, suppose that the cut locus C(p) of p consists of nondegenerate cut points. Then C k+1 is a submanifold of dimension n k of M, and d p is a smooth function when restricted to each connected component C k+1,q. First we will be concerned with the relation between the two kinds of critical points of the distance function, which was also obtained by V. Gershkovich and H. Rubinstein ([4]). Lemma 3.2. Suppose r C k+1,q is a critical point of d p in the angle sense. Then r is a critical point of the smooth function f := d p C k+1,q in the usual sense. If r C 2,q is a critical point of the smooth function f := d p C 2,q, then r is a critical point of d p in the angle sense. Proof. Suppose r C k+1,q is a critical point of d p in the angle sense and let γ i (i = 0,..., k) be a minimal geodesic parametrized by arclength joining p to r. To see that r is a critical point of f = d p C k+1,q in the usual sense, by (2.9) it suffices to show that α = u, X i is equal to 0 for any u T r C k+1,q, where X i = γ i (l), l = d(p, q). Recall that α is independent of i. Then from the assumption we may choose a i 0 (i = 0,..., k) with a i = 1 such that a i X i = 0, and it follows that α = a i α = u, a i X i = 0. Next suppose r is a critical point of d p C 2,q in the usual sense. Note that dim C 2,q = n 1. We have unit tangent vectors X 0, X 1 at r of minimal geodesics γ 0, γ 1 joining p to r, respectively. Then X 0, X 1 are different unit vectors perpendicular to the hypersubspace T r C 2,q of T r M by (2.6), and therefore should satisfy X 0 + X 1 = 0. It follows that r is a critical point of d p in the angle sense.

CUT LOCI AND DISTANCE FUNCTIONS 81 In general for k > 1, critical points of d p C k+1,q are not necessarily critical points of d p in the angle sense. For instance, if k = n then dim C n+1,q = 0 and every r C n+1 are critical points in the usual sense. However, r may not assume local maximum of d p (see Figure 1). C 2 γ 0 q C 3 C 2 C 2 γ 2 Figure 1.(Arrows denote the direction in which f increases.) γ 1 Next we define the notion of nondegeneracy for a distance function as follows: Definition 3.3. Suppose the cut locus C(p) consists of nondegenerate cut points of p under the condition (C). Then we call the distance function d p nondegenerate, if the following hold: (1) All critical points of d p in the angle sense are isolated, and ˆΓ q contains 0 in its interior for each critical point q of d p. Namely, for a critical point q C k+1 in the angle sense we may find (unique) a i > 0 (0 i k) with ai = 1 such that a i X i = 0 holds. (2) For any critical point q C k+1 of d p in the angle sense, q is a nondegenerate critical point in the usual sense of f := d p C k+1, the distance function restricted to the stratum C k+1 of C(p). The last condition in (1) above means that for a critical point q C k+1, the cone t 0 tˆγ q forms a vector subspace of dimension k = dim ˆΓ q that is the orthogonal complement of T q C k+1 in T q M. Note that this property holds for critical points of d p which are cut points of order 2. For instance,

82 J. ITOH AND T. SAKAI the distance functions d p of generic flat tori are nondegenerate for arbitrary points p. In the following we want to give a normal form of nondegenerate distance function d p in a neighborhood U of a critical point q C(p) of d p in the angle sense by choosing carefully a kind of local coordinates around q adapted to the local structure of C(p). For q C k+1 recall that x i (r) = F i (r), X i (r) = x i (r)(r U, i = 0,..., k) were given in (2.7), and we have X i = X i (q). Recall also that a small neighborhood U C(p) of q in the cut locus is homeomorphic to the cone over S(q) in T q M, where S(q) is the cut locus of {X 0,..., X k } in the unit sphere U q M (see Theorem 2.5). Then U \C(p) is divided into k +1 components D 0,..., D k where each D i contains the direction X i, namely, contains γ i ((l ɛ, l)) with l = d(p, q), where {γ i } 0 i k are minimal geodesics from p to q and ɛ > 0 is sufficiently small. D i (i = 0,..., k) is indeed given by D i = {r U x i (r) < x l (r) for any l i, 0 l k}, and note that we have d p (r) = x i (r) for r D i. Then it follows that D i D j = C i,j U for i < j, where D i denotes the closure of D i and C i,j is given just before the formula (2.8). Now let d p be nondegenerate distance function in the sense of Definition 3.3 and q a critical point of d p in the angle sense. To make our approach more understandable we begin with the simplest case where q is a critical point of order 2, namely q C 2. Then we have X 0 + X 1 = 0, and S(q) is a great hypersphere S n 2 of U q M. U \ C 2,q is divided into domains D 0 and D 1. For every point r D i (i = 0, 1) take a unique minimal geodesic γ r joining p to r, and denote by r 1 = γ x (l r ) C 2,q the cut point of p along γ r. Note that l r = d(p, r 1 ) is the cut distance along the geodesic γ r and depends smoothly on r D i, since γ r intersects C 2,q transversely. Now we set z := l r d(p, r) = i p ( γ r (0)) d p (r) > 0. For r C 2,q we set r 1 = r and z = 0. Then any r D i, i = 0, 1, may be uniquely expressed as r = (r 1, z) C 2,q R +. Since q = (q, 0) is a critical point of d p, q is a critical point of f := d p C 2,q by Lemma 3.2. Since d p is nondegenerate, q is a nondegenerate critical point of f and taking local

CUT LOCI AND DISTANCE FUNCTIONS 83 coordinates (x 2,..., x n ) around q C 2,q we may write (3.2) d p (r) = d p (q) ± x 2 2... ± x 2 n z. Therefore in this case, we may define the index of d p at q as the sum of the index of f := d p C 2,q at q and 1, where recall that 1 is the degree of the critical point q. Now we turn to a critical point q C k+1 of d p for general k 2. Then {X 0, X 1,..., X k } span a k-dimensional subspace of T q M orthogonal to the subspace T q C k+1,q of dimension n k, and the convex hull of {X 0, X 1,..., X k } contains the origin 0 of T q M in its interior. Now for any proper subset I of K := {0, 1,..., k} with I 2 we set C I = {r C(p) x i (r) = x j (r) < x l (r) for any i, j I and l I}, and C I denotes the closure of C I (see also (2.8)). For r C I we denote by T r C I := {u T r (M) u, X i (r) = u, X j (r) for any i, j I}(= lim ri C I r T ri C I ) the tangent space to C I at r. Then f I := d p C I is a smooth function and f I denotes the gradient vector of f I. For r C I we also use the notation f I (r)( T r C I ) that is given as lim ri C I r f I (r i ). Then we have the following lemmas. Lemma 3.4. Let q C k+1 be a critical point of nondegenerate distance function d p. Let I {0, 1,..., k} with I 2 be a proper subset. Now for any i I and r C I we denote by X i (r) the orthogonal projection of X i(r) to T r C I. Then we have X i (r) = f I (r) for any i I, r C I and we denote the above vector also by XI (r). Furthermore, there exist an open neighborhood U around q and δ > 0 such that f I (r) δ on U C I. Proof. For any curve t x(t) in C I emanating from r we have d p (x(t)) = f I (x(t)) = x i (x(t)) for any i I. Differentiating this equation with respect to t at t = 0, it follows that f I (r), ẋ(0) = x i (r)), ẋ(0) = X i (r), ẋ(0) = X i (r), ẋ(0) from which the first assertion follows. For the second assertion it suffices to show that X I (q) 0 at the critical point q of d p. Indeed, otherwise for a

84 J. ITOH AND T. SAKAI fixed i 0 I = {i 0,..., i a } we see that {X i X i0 } i I\{i0 } forms a basis of a subspace (T q C I ) of dimension a. Since q is a critical point of d p, {X i } i I span an a-dimensional subspace of T q M. However this contradicts the nondegeneracy condition that the faces of the convex hull of {X 0, X 1,..., X k } cannot contain the origin 0 of T q M. Note that the orthogonal projection of of X i to T q C k+1 is equal to zero since q is a critical point of d p, but the lemma asserts that the orthogonal projection Xi of X i (i I) to T q C I never vanishes for any proper subset I of {0, 1,..., k}. Lemma 3.5. Under the assumption of the previous lemma there exist positive constants a i (i = 0,..., k) with a i = 1 such that (3.3) ( i I a i ) X I (q), X I (q) = j I a j f I (q), X j (q). Indeed, we have 0 l k a lx l (q) = 0 at q for some a l > 0 (l = 0,..., k) with a l = 1 by Definition 3.3. Then considering the orthogonal projection of a l X l (q) to T q C I, we see that al X l (q), f I (q) = a i Xi (q), Xi (q) + a j f I (q), X j (q) i I j I vanishes by the previous lemma, and (3.3) follows. We also note that there exist no critical points of d p (and also of f I ) except q in U by the nondegeneracy condition. Now suppose r D i0 (0 i 0 k). First take a unique minimal geodesic γ r joining p to r, and denote by r 1 = γ r (l r ) C(p) the cut point of p along γ r, where l r = d(p, r 1 ) = i p ( γ r (0)) is the cut distance to p along γ r. Then r 1 lies in some C i0,i 1 that is a subset of the boundary of D i0. Note that here we do not assume that i 0 < i 1. For generic r D i0 we have r 1 C i0,i 1 := {r U x i0 (r) = x i1 (r) < x l (r) for any l i 0, i 1 } for some i 1, and γ r intersects C i0,i 1 transversely at r 1. Then we denote the above r 1 by r i1, and set z i0 := l r d(p, r)(> 0). By Lemma 3.4 the gradient vector f of f(= f i0 i 1 ) := d p C i0,i 1 at r i1 is given by X i 0 = X i 1 which is the orthogonal projection of X i0 (or X i1 ) to T r1 C i0,i 1, and does not vanish. Since r i1 is not a critical point of f, we may move r i1 along the trajectory of f to a point r 2 C i0,i 1,i 2 in general in the following manner. If k = 2,

CUT LOCI AND DISTANCE FUNCTIONS 85 then i 2 is uniquely determined, and we have a i0 X i0 + a i1 X i1 + a i2 X i2 = 0 at q for some a ij > 0. Since we have f = x i0 (= F i0 ) = x i1 (= F i1 ) and f(r), X i0 (r) = f(r), X i1 = f(r) 2 δ 2 > 0 by Lemma 3.4, x i0 = x i1 increases along the trajectory of f. On the other hand, x i2 decreases along the trajectory, because from (3.3) we have at q X i2 (q), f(q) = (a i0 + a i1 ) X 2 (q)/a i2 < 0, and X i2 (r), f(r) < 0, r U for small U. If k > 2, then from Lemma 3.5 there exists at least one index i 2 (0 i 2 k) different from i 0, i 1 such that X i2, f > 0. It follows again that x i0 = x i1 increases while x i2 decreases for such an i 2 along the trajectory of f. Therefore, along the trajectory we reach the point r 2 such that the values of x i0, x i1, x i2 are equal, while the value of other x j (= F j ) (j i 0, i 1, i 2 ) is not less than this value, namely a point of C i0,i 1,i 2 for some i 2. Note that for a starting point r D i0 the stratum C I, I {i 0, i 1, i 2 } of C(p) containing the above r 2 is uniquely determined and the trajectory is transversal to C I at r 2 unless I = K. We have l = 2 for generic r, and then we denote the above r 2 also by r i2. Let z i1 the parameter value of r 2 of the trajectory, namely z i1 = d(p, r i2 ) d(p, r i1 )( > 0), which is also uniquely determined from r and depends smoothly on r. Now for generic r D i0, repeating this procedure k times, we may have r i1,..., r ik and z i0,..., z ik 1, where r ik C k+1,q and z ik 1 = d(p, r ik ) d(p, r ik 1 )(> 0). Recall that we have local coordinates (x k+1,..., x n ) of C k+1 around q adapted to the smooth Morse function f := d p C k+1,q. On the other hand, if r D i0 moves along γ r to r 1 C I, I = {i 0,..., i a } (a < k), then γ r intersects C I transversely. In this case, we set r i1 = = r ia := r 1, and z i0 = d(p, r 1 ) d(p, r) = l r d(p, r) > 0, z i1 = = z ia 1 = 0. We make a similar arrangement for the case where the starting point r (resp. r j ) belongs to C I (a < k) (resp. C I (j < a)), and we get r i1,, r ik and z i0,, z ik 1 ( 0) for every r D i0, the closure of D i0. For instance, for r C I we set r i1 = = r ia := r and z i0 = = z ia 1 = 0, z ia = d(p, r ia+1 ) d(p, r), etc. Then setting D i0,i (I = {i 0, i 1,..., i a } K = {0, 1,..., k}) as the set of points r D i0 such that r reaches the point r 1 of C I along the geodesic γ r in the above manner, D i0 is stratified by D i0,i s. Indeed, D i0,i is a submanifold

86 J. ITOH AND T. SAKAI of codimension a 1 and is independent of the order of {i 1,..., i a }, in fact we have D i0,i = ( D i0,i 1 D i0,i l ) \ C(p). It follows that U = {C(p) U} { 0 i0 k( I i0 D i0,i)}, namely, U is stratified into submanifolds given by {D i0,i} and the stratification {C I } of C(p) given in 2. The boundary D i0,i of D i0,i consists of C J C(p) with J I and D i0,j with J I. Note that on D i0 we have the smooth unit vector field X i0 = d p which is transversal to the boundary, and on a stratum C I C(p) where I is a proper subset of {0, 1,..., k} with I 2 we have the nonvanishing smooth vector field XI = f I transversal to the boundary. For I with I 2 we also write D I = C I in the above notation. Then r i1,..., r ik, z i0,..., z ik 1 mentioned above are obtained by the successive trajetories of these vector fields on D I. Indeed, for I 0 I 1 I l K := {0,..., k} we denote by D I0,I 1,...,I l the set of points r D I0 that reach the points π(r) = r ik of C k+1 U along the successive trajectories of X i0 (or XI 0 ) and XI 1,..., XI l. We have an adapted chart (x k+1,..., x n ) on C k+1 around q to the Morse function f := d p C k+1, and we set x k+j (r) := x k+j (π(r)). Then D I0,I 1,...,I l is a submanifold of codimension k l 1 and its closure consists of D Ī0,...,Īl (l l) with I 0 Ī0,... I l Īl. Once D I 0,I 1,...,I l is fixed, (x k+1,..., x n, z i0,..., z ik 1 ) are uniquely determined for r D I0,I 1,...,I l and smooth where precisely (l + 1) of z i s are positive. Note that D I0,I 1,...,I l r (x k+1 (r),..., x n (r), z i0 (r),..., z ik 1 (r)) is an embedding into R n, since r (r i1, z i0 ) (r i2, z i0, z i1 ) (r ik, z i0,..., z ik 1 ) define an embedding at each stage. U is stratifed into submanifolds D I0,I 1,...,I l and D K := C k+1 U (corresponding to l = 1), and above embeddings are piecewise smoothly extended to the whole U. Thus we have local coordinates (x k+1,..., x n, z 1,..., z k ) around q, where (z 1,..., z k ) is given by (z i0,..., z ik 1 ) when restricted to D I0,I 1,...,I l and Lipschitz on U. Now recalling the local structure around q of M given by the cone structure of the cut locus mentioned above, we see that for a fixed point r C k+1 U with z 1 =... = z k = 0, the set defined by the equation z 1 +... + z k δ

CUT LOCI AND DISTANCE FUNCTIONS 87 (resp.= δ) with x k+1 = x k+1 (r),..., x n = x n (r) is homeomorphic to k- disk (resp.(k 1)-dimensional sphere). Indeed, we reverse the above procedure of defining (z 1, z 2,..., z k ). First for a fixed r C k+1 U, note that the equation z 1 = = z k 1 = 0, z k = δ represents k points (i.e., 0-disks) r ik C K\{ik } with d(r, r ik ) = δ such that r ik moves to r along the trajectory of f K\{ik } in C K\{ik }. Next the intersection of the set z 1 = = z k 2 = 0, z k 1 + z k = δ with C K\{ik 1,i k } is a curve (i.e., 1-disk) joining r ik 1 and r ik. Then z 1 = = z k 2 = 0, z k 1 + z k = δ defines a family of curves corresponding to the 1-skelton of the triangulation of S k 2 (q) given in Lemma 2.6. Repeating the procedure we see that the intersection of the set z 1 + + z k = δ with each D i0 is a (k 1)-disk, and that the set given by z 1 + + z k = δ is Lipschitz homeomorphic to a (k 1)-sphere. Now suppose k < n. Since q is a nondegenerate critical point of f := d p C k+1,q by Lemma 3.2, we may take local coordinates {x k+1,..., x n } around q in C k+1,q so that we may write d(π(r), p) = d(r ik, p) = d(p, q) ± x 2 k+1 ± ± x2 n. It follows that we have for r in an open neighborhood U of q (3.4) d p (r) = d(p, q) ± x 2 k+1 (r) ± ± x2 n (r) z 1(r) z k (r), where x k+j are smooth and z j are nonnegative Lipschitz functions. Therefore, we may consider that the index of d p at the critical point q C k+1 is given by the sum of the index of f := d p C k+1,q at q and k, where k is also equal to the degree of q (see Definition 3.1). If k = n, then dim C n+1 = 0 and C n+1 consists of vertices, i.e., strata of dimension 0 of C(p). If such a vertex q is a critical point of d p in the angle sense, then above procedure implies that we may write around q d p (r) = d(p, q) z 1 (r) z n (r) with z j 0 and we may consider that q is a critical point of index n. Summing up we have Lemma 3.6. Let q C k+1 be a critical point in the angle sense of nondegenerate distance function d p. Then we have a stratification of a neighborhood U of q by submanifolds D I0,I 1,...,I l s and embeddings φ : D I0,I 1,...,I l r (z 1 (r),..., z k (r), x k+i (r),..., x n (r)) R n

88 J. ITOH AND T. SAKAI with z i (r) 0 such that d p (r) =d(p, q) z 1 (r) z k (r) x k+1 (r) 2 x k+j (r) 2 + x k+j+1 (r) 2 + + x n (r) 2 where j is the index of f := d p C k+1 at q in the usual sense. i := k + j is called the index of d p at the critical point q. φ s are piecewise smoothly extended to the whole U and x k+i s are smooth and z i s are Lipschitz functions on U. Moreover for a fixed point r C k+1 U with z 1 =... = z k = 0, the set defined by the equation z 1 +...+z k δ with x k+1 = x k+1 (r),..., x n = x n (r) is homeomorphic to k-disk. Now if q is not a critical point of d p, we may make use of the isotopy lemma. Next suppose q C(p) is a critical point of index i of d p in the angle sense that is isolated by the nondegeneracy assumption. Then we may apply the usual procedure of Morse theory ([14]). Indeed, around q we have d p (r) = d(p, q) z 1 z k x 2 k+1 x2 k+j + x2 k+j+1 + + x2 n, where i = k + j is equal to the index of q. Then the subset defined by z 1 z k x 2 k+1 x2 k+j + x2 k+j+1 + + x2 n = c (resp. z 1 z k x 2 k+1 x2 k+j + x2 k+j+1 + + x2 n = c) for sufficiently small c > 0 is homeomorphic to S n k j 1 I k+j (resp. (S j 1 S k 1 ) I n k j, where S j 1 S k 1 denotes the spherical join and homeomorphic to S k+j 1 ). Then for sufficiently small ɛ > 0, levels d 1 p (t) U are homeomorphic to S n i 1 I i (resp. S i 1 I n i ) for t with 0 < t l ɛ (resp. ɛ t l < 0), and {r U d(p, r) l+ɛ} has the homotopy type of {r U d(p, r) l ɛ} with an i-cell attached. In the above, we set S n i 1 I i = for i = n. Since we may construct a nowhere vanishing gradient-like vector field of d p outside of a small neighborhood of the set of critical points of d p, we apply the usual procedure of Morse theory to get the following main result in this section. Theorem 3.7. Let (M, g) satisfy the condition (C) at p. Suppose all cut points of p are nondegenerate cut points and d p is a nondegenerate distance function. Let q be a critical point of d p in the angle sense. Note that q is