arxiv:math/0607751v4 [math.gn] 25 Nov 2006 On the uniqueness of the coincidence index on orientable differentiable manifolds P. Christoher Staecker October 12, 2006 Abstract The fixed oint index of toological fixed oint theory is a well studied integer-valued algebraic invariant of a maing which can be characterized by a small set of axioms. The coincidence index is an extension of the concet to toological (Nielsen) coincidence theory. We demonstrate that three natural axioms are sufficient to characterize the coincidence index in the setting of continuous maings on oriented differentiable manifolds, the most common setting for Nielsen coincidence theory. 1 Introduction For two maings f, g : X Y, we say that x X is a coincidence oint of f and g (we write x Coin(f, g)) if f(x) = g(x). This notion generalizes the common concet of a fixed oint, in which X = Y and g = id, the identity maing. For any oen set U X, let Coin(f, g, U) = Coin(f, g) U. The well known fixed oint index of a maing over a given subset (see [1] or [2]) was generalized to Nielsen coincidence theory by Schirmer [3] in the setting of maings between oriented manifolds of the same (finite) dimension. Although Nielsen coincidence theory of nonmanifolds [4] and ossibly nonorientable manifolds of nonequal dimension has been studied, very little is known, and the coincidence index is in general undefined in those settings. Since definitions of the fixed oint index of a maing on a set can be cumbersome, it is often resented in the exository literature in terms of several roerties: it is homotoy invariant, is additive on disjoint subsets, and the total index over the whole sace equals the Lefschetz number of the maing. This resentation is bolstered by uniqueness results which use such roerties as axioms, and demonstrate that at most one function can satisfy the axioms (see [5], in which five axioms are used). In [6], Furi, Pera, and Sadini show that three axioms: homotoy invariance, additivity, and a normalization axiom, are sufficient to uniquely characterize the fixed oint index in the setting of oriented differentiable manifolds. It is their aroach that we follow to demonstrate a similar result for the coincidence index. 1
Throughout, we study continuous maings f, g : X Y of oriented differentiable manifolds of the same dimension. The general aroach, following [6], is to first demonstrate the uniqueness of the coincidence index for maings f, g : R n R n. The uniqueness result on orientable manifolds is then obtained by aroximating our maings first by differentiable, and then (locally) by linear mas. I would like to thank Robert F. Brown for bringing the roblem to my attention, Julia Weber for helful conversations and notes on early drafts of the aer, and the referees for helful suggestions. 2 Preliminaries For continuous mas f, g : X Y and some oen subset U X, we say that the trile (f, g, U) is admissable if the set of coincidences of f and g in U is comact. In articular, this will be true rovided that U has comact closure and no coincidences on its toological boundary. Let C be the set of all admissable triles of maings where X and Y are oriented differentiable manifolds of the same (finite) dimension. If f t, g t : X [0, 1] Y are homotoies and U X is an oen subset, we say that the air (f t, g t ) is a air of admissable homotoies in U if {(x, t) x Coin(f t, g t, U), t [0, 1]} is a comact subset of X [0, 1]. In this case we say that (f 0, g 0, U) is admissably homotoic to (f 1, g 1, U). A function ind : C R is said to be a coincidence index if it satisfies the following three axioms: Axiom 1 (Normalization). Let f : X X be constant, and id : X X be the identity ma. Then ind(f, id, X) = 1. Axiom 2 (Additivity). Given mas f, g : X Y and an admissable trile (f, g, U), if U 1 and U 2 are disjoint oen subsets of U with Coin(f, g, U) U 1 U 2, then ind(f, g, U) = ind(f, g, U 1 ) + ind(f, g, U 2 ). Axiom 3 (Homotoy). If there exists an admissable homotoy of the trile (f 0, g 0, U) to (f 1, g 1, U), then Our main theorem is the following: ind(f 0, g 0, U) = ind(f 1, g 1, U). Theorem 4. There is exactly one real valued function ind : C R which satisfies the above three axioms. We can derive some immediate corollaries from these three axioms, which will be useful in the exosition to follow. In the following roositions, ind denotes any coincidence index. 2
Proosition 5. (Fixed-oint roerty) If (f, id, U) is an admissable trile, then ind(f, id, U) = i(f, U), where the right-hand side is the well known fixed oint index. Proof. To demonstrate that ind(f, id, U) is the fixed oint index, we need only show that it obeys the three axioms described in [6]. Each of those three axioms are clearly secial cases of our axioms above, so they are satisfied. Proosition 6. (Emty set roerty) The trile (f, g, ) is admissable, and has index 0. Proof. By the additivity axiom, we write =, and we have and so ind(f, g, ) = 0. ind(f, g, ) = ind(f, g, ) + ind(f, g, ), Proosition 7. (Excision roerty) If (f, g, U) C and U U is an oen subset containing Coin(f, g, U), then ind(f, g, U) = ind(f, g, U ). Proof. By the additivity axiom, we have: ind(f, g, U) = ind(f, g, U ) + ind(f, g, ) = ind(f, g, U ). Proosition 8. (Solution roerty) If ind(f, g, U) 0, then f and g have a coincidence on U. Proof. We rove the contraositive: if f and g have no coincidence on U, then by the excision roerty we have ind(f, g, U) = ind(f, g, ) = 0. 3 The coincidence index for maings of R n Let M n be the sace of linear mas A : R n R n, and Gl n the subsace of invertible mas. Define the set N M n M n as the set of all airs of mas (A, B) such that B A Gl n. Note that N gives recisely the maings for which (A, B, R n ) is admissable, since Coin(A, B) will be a linear subsace of R n, and thus will be comact if and only if it is {0}, in which case det(b A) 0. We define N + = {(A, B) det(b A) > 0}, N = {(A, B) det(b A) < 0}, 3
and note that N is a disconnected set, with comonents N + and N. Each of these is oen in M n M n, and therefore ath-connected. Thus by the homotoy axiom, for any (A, B) M n M n, the value of any coincidence index ind(a, B, R n ) deends only on the ath comonent containing (A, B). By the normalization axiom we know that ind(0, id, R n ) = 1, and so we have that ind(a, B, R n ) = 1 for all (A, B) N +. Lemma 9. For any (A, B) N, we have ind(a, B, R n ) = 1. Proof. It suffices to show that ind(a, B, R n ) = 1 for some articular air (Â, ˆB) N. We will show this for ˆB = id and  the linear ma of the same name described in Lemma 3.1 of [6]: Â(x 1,..., x n 1, x n ) = (0,...,0, 2x n ). Since we are taking ˆB to be the identity ma, Proosition 5 imlies that we need only demonstrate that the fixed oint index of  is 1, and this is demonstrated in Lemma 3.1 of [6]. The above discussion and lemma give our first uniqueness result, that all coincidence indices agree for linear maings of R n. Lemma 10. For any coincidence index ind, if A, B : R n R n are linear mas and (A, B, R n ) C, then ind(a, B, R n ) = signdet(b A). Let f, g : X Y be differentiable maings on two manifolds of the same dimension (say n), and let df x, dg x : R n R n denote the derivative mas of f and g at any oint x X. If the trile (f, g, U) is admissable, and dg df Gl n for any coincidence oint, then we say that the trile (f, g, U) is nondegenerate. Since we have established that the index is very well behaved for linear maings, the following linearization result for the index is very useful. Lemma 11. Let U R n be oen, and let (f, g, U) be a nondegenerate trile, with f, g : R n R n. Then each coincidence oint is isolated, and for some isolating neighborhood V of, we have for any coincidence index ind. ind(f, g, V ) = ind(df, dg, R n ), Proof. Let be a coincidence oint. Since f and g are differentiable at, we have f(x) = f() + df (x ) + x ǫ(x ), g(x) = g() + dg (x ) + x δ(x ), 4
where ǫ, δ : U R n are continuous with ǫ(0) = δ(0) = 0. Then we have g(x) f(x) = (dg df )(x ) + x (δ(x ) ǫ(x )) (dg df )(x ) x δ(x ) ǫ(x ) Since dg df is a linear ma, we have (dg df )(x ) = x (dg df ) ( x ( x x ) inf (dg df )(v) v =1 and so ( ) g(x) f(x) x inf (dg df )(v) δ(x ) ǫ(x ). v =1 The infimum is known to be strictly ositive, since (f, g, U) is nondegenerate. Thus for all x sufficiently close to, the term δ(x ) ǫ(x ) will be sufficiently small so that g(x) f(x) > 0, which is to say that is an isolated coincidence oint. It remains to show that if V is an isolating neighborhood of, then Define the following homotoies: ind(f, g, V ) = ind(df, dg, R n ). f t (x) = f() + df (x ) + t x ǫ(x ), g t (x) = g() + dg (x ) + t x δ(x ). By the same argument as above, for all t [0, 1] we have g t (x) f t (x) > 0 for all x in some neighborhood W V of. Thus (f t, g t ) is an admissable homotoy on W of f and g to the affine linear mas x f() + df (x ) and x g()+dg (x ). These affine linear mas have as their only coincidence oint, since dg df Gl n. Thus we have ), ind(f, g, W) = ind(f() + df (x ), g() + dg (x ), W) = ind(f() + df (x ), g() + dg (x ), R n ) by the homotoy axiom and the excision roerty. But these affine mas are clearly admissably homotoic to df and dg, and so we have ind(f, g, V ) = ind(f, g, W) = ind(df, dg, R n ), where the first equality is by the excision roerty, and the second is by the homotoy axiom. 5
4 The coincidence index for maings of orientable manifolds Lemmas 10 and 11 established the uniqueness of the index for nondegenerate airs of maings on R n. The next two lemmas show that any index for nondegenerate airs on arbitrary orientable manifolds is comuted similarly to the index of Lemma 10. Lemma 12. If (f, g, U) is a nondegenerate trile, then each coincidence oint is isolated. Proof. For some Coin(f, g, U), choose a chart Z q Y containing q = f() = g() with a diffeomorhism ψ q : Z q R n. Choose a chart W f 1 (Z q ) g 1 (Z q ) containing with a diffeomorhism φ : W R n. Let ω(f, g, W ) = (ψ q f φ 1, ψ q g φ 1, φ (W )). So ω gives a corresondence between certain admissable triles on manifolds, and admissible triles on R n. Since (f, g, U) is nondegenerate, then clearly (f, g, W ) will be nondegenerate. For any coincidence oint x Coin(ω(f, g, W )), we have d(ψ q f φ 1 ) x d(ψ q g φ 1 ) x = d(ψ q ) f(φ 1 (x)) (df φ 1 (x) dg φ 1 (x) )d(φ 1 ) x, since f(φ 1 (x)) = g(φ 1 (x)). Since φ and ψ q are diffeomorhisms, the above will be in Gl n by nondegeneracy of (f, g, W ). Thus ω(f, g, W ) is nondegenerate, which imlies by Lemma 11 that Coin(ω(f, g, W )) is a set of isolated oints. But this coincidence set is in diffeomorhic corresondence via φ and ψ q to Coin(f, g, W ), so this too is a set of isolated oints, and in articular is an isolated coincidence oint. Lemma 13. If (f, g, U) is a nondegenerate trile, and ind is any coincidence index, then ind(f, g, U) = sign(det(dg df )). (1) Coin(f,g,U) Proof. Note that since (f, g, U) is nondegenerate, by Lemma 12 the coincidence set C = Coin(f, g, U) consists of finitely many isolated oints. First we rove the theorem in the secial case where f and g are maings of some Euclidean sace f, g : R n R n, with U R n. For each coincidence oint U, let V be an isolating neighborhood of. Since C is comact, we may choose the sets V to be airwise disjoint. Then by the additivity roerty, Lemma 11 and Lemma 10, we have ind(f, g, U) = C = C ind(f, g, V ) = C sign(det(dg df )). ind(df, dg, R n ) 6
It remains to rove the result in the general case that f, g : X Y are maings of oriented manifolds of the same dimension n, with U X an oen set. About each isolated coincidence oint, choose airwise disjoint isolating neighborhoods W diffeomorhic to R n by orientation reserving diffeomorhisms φ : W R n. We also choose neighborhoods Z q of each coincidence value q = f() = g() with Z q diffeomorhic to R n by orientation reserving diffeomorhisms ψ q : Z q R n. Let ω(f, g, U) be as in Lemma 12. Note that ω has an inverse given by ω 1 (F, G, S) = (ψ 1 q F φ, ψ 1 q G φ, φ 1 (S)), where S is an oen set in R n and F, G : R n R n. Then we have trivially that ind(f, g, W ) = ind ω 1 (ω(f, g, W )). Observe that ind ω 1 is a real-valued function on admissable triles in R n which satisfies the three axioms for the coincidence index. Thus, by the secial case above, it is calculated according to (1). Thus we have: ind(f, g, U) = C = C ind(f, g, W ) = C sign(det(dψ q dg dφ 1 ind ω 1 (ω(f, g, W )) dψ q df dφ 1 )) by the derivative chain rule. (For brevity, we have written dφ 1 d(φ 1 ) and dψ q to indicate d(ψ q ) q.) But the above is simly C sign(det(dψ q (dg df )dφ 1 )) = sign(det(dg df )) C since all φ and ψ q are taken to be orientation reserving. to indicate One final Lemma is required, showing that any air of mas can be aroximated by a nondegenerate air of mas. Lemma 14. Let (f, g, U) be admissable, and V U be an oen subset containing Coin(f, g, U) with comact closure V U. Then (f, g, V ) is admissably homotoic in V to a nondegenerate trile. Proof. In order to facilitate the construction of exlicit straight-line homotoies, we begin by embedding our manifolds in some Euclidean sace, and aroximating our mas accordingly by close olynomial aroximations. Without loss of generality, assume that X and Y are embedded in R k for some k. By the ǫ-neighborhood theorem (see [7]), there exists a neighborhood Ω of Y in R k with a submersive retraction r : Ω Y such that x r(x) = dist(x, Y ). For any δ > 0, by the Weierstrass aroximation theorem, there exist olynomial mas f δ, g δ : R k R k with f(x) f δ (x) < δ and g(x) g δ (x) < δ for 7
all x V. Since V is comact, we may choose δ sufficiently small so that the homotoies f t (x) = r((1 t)f(x) + tf δ (x)) g t (x) = r((1 t)g(x) + tg δ (x)) are well-defined and (f t, g t ) is an admissable homotoy on V. Thus the air (f, g) is admissably homotoic to (r f δ, r g δ ) in V. To simlify our notation, let f = r f δ, and g = r g δ. We will show that the air (f, g ) is admissably homotoic to some nondegenerate air. Let B be a ball about the origin sufficiently small that for all x V and y B the function x r(f (x) + y) is defined and has no coincidences with g on V. Then define H : V B V Y by and note that the derivative ma H(x, y) = (x, r(f (x) + y)), dh (x,y) : R k R k R k T r(f (x)+y)y is surjective (since r is a submersion). Thus at oints where the image of H intersects with the grah of g in V Y, the intersection will be transversal. By the transversality theorem (see [7]), H(x, y) is transversal to grahg for almost all y B. Choose one such ȳ so that H(x) = (x, r(f (x) + ȳ)) is transversal to grahg. Note that a air of maings is nondegenerate if and only if their grahs intersect transversally. This means that (r(f + ȳ), g, V )) is a nondegenerate trile. But our assumtion on B means that the homotoy given by (r(f + tȳ), g ) is admissable on V, and thus the nondegenerate trile above is admissably homotoic to (f, g, V ), which has already been shown to be admissably homotoic to (f, g, V ). At this oint we will briefly address the issue of the existence of the coincidence index. The above lemmas can be used to define a coincidence index in the following way: given any admissable trile (f, g, U), let (f, g, V ) be a nondegenerate trile given by Lemma 14, admissably homotoic to (f, g, V ) with Coin(f, g, U) V. We then define ind(f, g, U) = ind(f, g, V ), where ind(f, g, V ) is comuted according to (1). Provided that this definition is well defined, it clearly satisfies the three axioms, and thus is a coincidence index. A roof that this definition is well defined would show that any two admissably homotoic nondegenerate triles have the same index. Such a roof seems nontrivial, and we will not attemt it here. We instead take the existence of a coincidence index as given, and refer to the standard discussions in [3] and [8], [9]. 8
Theorem 15. There is a unique coincidence index on the set of all admissable triles. Proof. Let ind be a coincidence index. If (f, g, U) C, then by Lemma 14 there is an oen set V U containing Coin(f, g, U) with (f, g, V ) admissably homotoic to a nondegenerate trile (f, g, V ). Thus by excision and the homotoy axiom, we have ind(f, g, U) = ind(f, g, U), and so by Lemma 13 we have ind(f, g, U) = Coin(f,g,V ) sign(det(dg df )). The above calculation does not deend on the choice of nondegenerate trile (f, g, U), since any alternative choice would automatically have the same index by the homotoy axiom. Since any coincidence index must obey the calculation given above, we have shown that all indices must agree, and that there is exactly one. References [1] B. Jiang, Lectures on Nielsen fixed oint Theory, Contemorary Mathematics 14, American Mathematical Society, 1983. [2] R. Brown, The Lefschetz Fixed Point Theorem, Scott, Foresman and Comany, 1971. [3] H. Schirmer, Mindestzahlen von Koinzidenzunkten, Journal für die reine und angewandte Mathematik 194 (1955) 21 39. [4] D. L. Gonçalves, Coincidence theory for mas from a comlex into a manifold, Toology and Its Alications 92 (1999) 63 77. [5] R. Brown, An elementary roof of the uniqueness of the fixed oint index, Pacific Journal of Mathematics 35 (1970) 549 558. [6] M. Furi, M. P. Pera, M. Sadini, On the uniqueness of the fixed oint index on differentiable manifolds, Fixed Point Theory and Alications 4 (2004) 251 259. [7] V. Guillemin, A. Pollack, Differential Toology, Prentice-Hall, 1974. [8] R. Brooks, Coincidences, roots, and fixed oints, Doctoral dissertation, University of California, Los Angeles (1967). [9] R. Brooks, R. Brown, A lower bound on the -Nielsen number, Transactions of the American Mathematical Society 143 (1969) 555 564. 9