arxiv: v1 [cs.cc] 27 Jul 2014

Transcription

1 DMVP: Foremost Waypoint Coverage of Time-Varying Graphs Eri Aaron 1, Danny Krizan 2, and Elliot Meyerson 2 arxiv: v1 [s.cc] 27 Jul Computer Siene Department, Vassar College, Poughkeepsie, NY, USA 2 Department of Mathematis & Computer Siene, Wesleyan University, Middletown, CT, USA Abstrat We onsider the Dynami Map Visitation Problem (DMVP), in whih a team of agents must visit a olletion of ritial loations as quikly as possible, in an environment that may hange rapidly and unpreditably during the agents navigation. We apply reent formulations of time-varying graphs (TVGs) to DMVP, shedding new light on the omputational hierarhy R B P of TVG lasses by analyzing them in the ontext of graph navigation. We provide hardness results for all three lasses, and for several restrited topologies, we show a separation between the lasses by showing severe inapproximability in R, limited approximability in B, and tratability in P. We also give topologies in whih DMVP in R is fixed parameter tratable, whih may serve as a first step toward fully haraterizing the features that make DMVP diffiult. 1 Introdution In navigation-oriented appliation domains suh as autonomous mobile robots, wireless sensor networks, seurity, surveillane, mehanial inspetion, and more, graph representations are ommonly employed for formulating and analyzing the entral navigation or area inspetion problems. Many approahes to overage problems [10, 11, 12] are based on stati graph representations, as are visitation problems [1] or related ombinatorial optimization problems suh as the k-chinese Postman Problem [2, 6] and k-traveling Repairman Problem [13, 14]. But stati graph strutures do not represent the dynami environments that an our in appliations of autonomous robots or non-player haraters in video games and virtual worlds. In this paper, we present the Dynami Map Visitation Problem (DMVP), applying reent formulations of highly dynami graphs (or time-varying graphs (TVGs)) [8, 23] to an essential graph navigation problem: In DMVP, a team of agents must inspet a olletion of ritial loations on a map (represented as a graph) as quikly as possible, but the agents environment may hange during navigation. The appliation of TVG models is essential to DMVP. In appliations suh as planetary exploration [26], searh and resue in hazardous environments (e.g., natural disasters, areas of armed onflit), or even ad-ho network inspetion, many aspets of the struture of graph waypoints and edges governing navigation an hange during agent navigation, and TVG models an apture variation in graph struture in ways that stati graphs annot. Our paper presents new results about eaaron@s.vassar.edu ekmeyerson@wesleyan.edu dkrizan@wesleyan.edu 1

2 DMVP omplexity and demonstrates distintions among lasses of TVGs; details of our main results are summarized in Setion 1.2. When inorporating dynamis into a problem suh as DMVP, there are many options for how to onstrain/model the dynamis of the graph. Dynamis an be deterministi (e.g., [7, 19, 20, 24, 27]) or stohasti (e.g., [4, 9]). In this paper, to provide a foundation for future work, and exemplify the aspets of topologies and dynamis that make our problem easy or hard, we fous on the deterministi ase. The deterministi approah is also partiularly relevant for situations in whih some predition of hanges is feasible. Quite a bit of this previous work has required that the graph be onneted at all times [9, 20, 22]. Indeed, for omplete map visitation to be possible, every ritial loation must be eventually reahable. However, in appliation environments suh as those outlined above, at any given time the waypoint graph may be disonneted. Our model must be general enough to allow for this phenomenon. We adopt three lasses of TVGs, eah of whih plaes onstraints on edge dynamis. In R, edges must reappear eventually; in B, edges must appear within some time bound; in P edge appearanes are periodi. These lasses have proven to be ritial to the TVG taxonomy [8]. They have been studied with respet to problems suh as broadast [7] and exploration [16, 19], with results relating to feasibility of omputation and bounds on broadast and exploration time. R, B, and P plae intuitive onstraints on the nature of dynami navigation domains. Even the assumption of periodiity of edges has appliations to navigation of transportation networks [16, 19], as well as environments periodially patrolled by other agents, who an prohibit or guarantee safe traversal of an edge. In this paper, we shed further light on the omputational hierarhy of R, B, and P [7], by analyzing them in the ontext of DMVP, a natural but diffiult problem in global navigation. We provide hardness results for all three lasses. For several restrited topologies, we demonstrate separation between the lasses by showing severe inapproximability in R, limited approximability in B, and tratability in P. We also give topologies in whih DMVP in R is tratable and fixed parameter tratable, whih may serve as a first step towards fully haraterizing the topologial features that make DMVP diffiult. Beause our goal in this paper is to leanly differentiate the lasses of dynamis we are exploring, rather than explore the interations between multiple agents, our results here fous on the ase of a single agent. 1.1 Definitions and TVG Conepts As a foundation for our work, we adopt the definitions below from Santoro et al. [8]. Definition 1. A TVG (time-varying graph, dynami graph, or dynami network) is a five-tuple G = (V, E, T, ρ, ζ), where T T is the lifetime of the system, presene funtion ρ(e, t) = 1 edge e E is available at time t T, and lateny funtion ζ(e, t) gives the time it takes to ross e if starting at time t. The graph G = (V, E) is alled the underlying graph of G, with V = n. In the most general ase, T an be R, and edges an be direted. However, in our work we onsider the disrete ase in whih T = N, edges are undireted, and all edges have uniform travel ost ζ(e, t) = 1 at all times. If agent a is at u, and edge (u, v) is available at time τ, then a an take (u, v) during this time step, visiting v at time τ + 1. As a traverses G we say a both visits and overs the verties in its traversal, and we will heneforth use these terms interhangeably. A temporal subgraph of a TVG G results from restriting the lifetime T of G to some T T. A stati snapshot is a temporal subgraph throughout whih the availability of eah edge does not hange, i.e., edges are stati. Definition 2. J = {(e 1, t 1 ),..., (e k, t k )} is a journey {e 1,..., e k } is a walk in G (alled the underlying walk of J ), ρ(e i, t i ) = 1 and t i+1 t i + ζ(e i, t i ) for all i < k. The topologial length of J is k, the number of edges traversed. The temporal length is the duration of the journey: (arrival date) (departure date).

3 Given a date t, a journey from u to v departing on or after t whose arrival date t is soonest is alled foremost; whose topologial length is minimal is alled shortest; and whose temporal length is minimal is alled fastest. In [8], a hierarhy of thirteen lasses of TVG s is presented. In related work on exploration [16] and broadast [7], fous is primarily on the hain R B P defined below. We adopt these lasses into our domain, whih we believe enfore natural onstraints in our appliation environments. Definition 3. (Reurrent edges) R is the lass of all TVG s G suh that G is onneted, and e E, t T, t > t s.t. ρ(e, t ) = 1. Definition 4. (Time-bounded reurrent edges) B is the lass of all TVG s G suh that G is onneted, and e E, t T, t [t, t + ) s.t. ρ(e, t ) = 1, for some integer. Definition 5. (Periodi edges) P is the lass of all TVG s G suh that G is onneted, and e E, t T, k N, ρ(e, t) = ρ(e, t + kp) for some integer p. p is alled the period of G. As muh as possible, we also take standard notation and terms from the graph theory literature. We rely on several underlying graph topologies. A star is a tree in whih at most one vertex has degree greater than one. The leaves of a star are alled points. A spider is a tree in whih at most one vertex has degree greater than two. In other words, a spider onsists of a set of vertex-disjoint paths, alled arms, eah of whih has exatly one endpoint onneted to the ommon entral vertex. A omb is a max-degree 3 tree, in whih there exists a simple path ontaining every vertex of degree 3. Suh a path is alled a bakbone of the omb. Paths edge-disjoint to the bakbone are alled arms. A leaf distane 1 from the bakbone is alled a tooth. An r-almost-tree is a onneted graph with V + r 1 edges, that is, r edges an be removed to produe a tree. Problem. Given a TVG G and a set of starting loations S for k agents in G, the TVG foremost overage or dynami map visitation problem ( DMVP) is the task of finding journeys starting at time 0 for eah of these k agents suh that every node in V is in some journey, and the maximum temporal length among all k journeys is minimized. The deision variant asks whether these journeys an be found suh that no journey ends after time t. We think of the input G as a temporal subgraph of some TVG G with lifetime N and the same edge onstraints as G. Thus, the limited information provided in G is used to ompute omplete solutions for agents overing G. When unspeified, assume that DMVP refers to DMVP for a single agent. 1.2 Main Results Our results are summarized in Table 1. We show that DMVP in R is NP-hard to approximate within any fator, when the underlying graph G is restrited to a star or tree of max degree 3. We show that in B this problem is NP-hard to approximate within any fator less than, when G is restrited to a spider or tree of max degree 3. We show that in P, DMVP is NP-omplete when p = 1, and that there is a nontrivial lass of graphs for whih p = 2 is NP-hard, but p = 1 is not. We show that in R, DMVP is solvable in O(T ) when G is a path, O(T n) when G is a yle, and O(T n 3 + n 2 2 n ) for general graphs, where T is the duration of G, as defined in Setion 2. Furthermore, in R, DMVP is fixed parameter tratable when G is an m-leaf O(1)-almost tree, and poly-time solvable when m = O(lg n). In B, we demonstrate a tight -approximation for trees, and a 2 -approximation for general graphs. We demonstrate a lass of problems whih are NP-hard in B, but solvable by an online algorithm in P. We show that DMVP in P is solvable in polynomial time when G is a spider, for fixed p, and we show that when p = 2, DMVP is solvable in linear time for general trees. The remainder of this paper is organized as follows: preliminaries (2), lower bounds (3), upper bounds (4), open problems and disussion (5).

4 Table 1: DMVP separations and results by TVG lass and graph lass DMVP separations TVG lass spiders max-degree 3 trees general trees R no approx. no approx. no approx. B tight -approx. tight -approx. tight -approx. P in P, for fixed p O(n) exat, for p = 2 O(n) exat, for p = 2 graph lass over whih DMVP NP-hard in P with p = 2, easy with p = 1. Complexity of exat algorithms in R path yle general graphs m-leaf -almost trees O(lg n)-leaf -almost trees O(T ) O(T n) O(T n 3 + n 2 2 n ) in FPT in P 2 Preliminaries For the minimization problem DMVP(G, S) and the orresponding deision problem DMVP(G, S, t), input is viewed as a sequene of graphs G i eah represented as an adjaeny matrix, with an assoiated integer duration t i, i.e. G = (G 1, t 1 ), (G 2, t 2 ),..., (G m, t m ), where G 1 appears initially at time zero. Let T = m i=1 t i. Note that sine eah t i an be enoded in O(lg t i ) spae, it is possible for T to be exponential in the size of G. The following observation is required to show that the number of time steps of G that need to be onsidered for DMVP is in fat polynomial in the size of G. Observation 1. When omputing DMVP over G, it is not neessary to onsider eah stati temporal subgraph (G i, t i ) for more than 2n 3 time steps. Proof. Suppose G i is the available stati subgraph of G from times τ to τ + t i, and t i > 2n 3. Suppose agent a starts at vertex u at time τ. There are two ases: Case 1: If a an omplete its overage of G by only traversing in G i, then in the worst ase a an exeute any omplete spanning tree traversal of G i, whih takes no more than 2n 3 steps. In this ase, it does not matter at whih vertex a ends up, beause the task has been ompleted. Case 2: If there is a vertex v suh that a has not overed v by time τ, and u and v are in different onneted omponents in G i, then a annot omplete overage of G when G i is the available stati subgraph. In this ase it may matter whih vertex a ends up at, depending on whih future edges will be available. The size of the onneted omponent of u in G i is at most n 1, so a spanning tree traversal of this omponent ending up bak at u takes no more than 2n 4 steps. If a would rather end up at a different vertex w u, it simply traverses w s branh of the spanning tree last, and returns up only to w, in fewer than 2n 4 steps. By Observation 1, for any t i > 2n 3, when omputing DMVP, all time steps after the first 2n 3 an be ignored (skipped). DMVP over G an be omputed by omputing DMVP over G = (G 1, min(t 1, 2n 3)),..., (G m, min(t m, 2n 3)), and adding bak the umulative time skipped before ompletion. G an learly be derived from G in O(m) time. The total duration of G is T = m i=1 min(t i, 2n 3) < 2nm 3m, whih is polynomial in G. Let ɛ(τ) be the time skipped through time τ T. ɛ(τ) an be simply alulated for all τ T in O(T ) time. A similar O(T ) preproessing step an be run to assoiate eah time τ T with the orresponding available stati graph G i, enabling O(1) edge presene lookups ρ(e, τ). Sine all of the algorithms we present run in Ω(T ) time, we an run these preproessing steps for every instane of DMVP and not affet the asymptoti running time. Therefore, for the sake of simpliity, for the rest of our results we assume that this preproessing has taken plae, i.e., we think of G as G and T as T, thereby avoiding the exponential nature of T. Note also that for the ase of P, the onstraint of periodiity implies that it is only neessary to look at p onseutive time steps of the input.

5 3 Lower Bounds As motivation for many of the results in this paper, it is important to note that MVP for a single agent is solvable in linear time on trees [1]. To haraterize the diffiulty of DMVP in R, we first show inapproximability over stars. A similar theorem was independently disovered in [25]. Theorem 1. DMVP for a single agent in R is NP-hard to approximate within any fator, even when the underlying graph is a star. Proof. We redue from the set over problem (SCP). Given a universe U = {1, 2,..., m}, a family S of subsets s 1, s 2,..., s n of U, and an integer k, it is NP-omplete to deide whether S ontains a over of U of size k or less [21]. Given an instane of SCP, onstrut a star G = (V, E) with entral vertex ; points,..., v m, orresponding to elements in U;,..., p n, orresponding to sets in S; and a single hek point. We use the following stati subgraphs to onstrut a TVG G. For all s i in S, let pass(i) = (V, {, p i }), and let take(i) = (V, E i ), where E i = {(, v j ) : j s i }. Let hek = (V, {, }). Let finish = (V, F ), where F = {(, p i ) : 1 i n}. Consider the TVG G = (pass(1), 1),(take(1), t 1 ),(pass(1), 1),...,(pass(n), 1),(take(n), t n ),(pass(n), 1),(hek, 2),(finish, 2k 1), where t i = 2 s i, i {1,..., n}. The total duration of G is D = 2n + 2 n i=1 s i + 2k + 1 < 2n + 2mn + 2k + 1. Consider the problem of deiding if DMVP over G with a single agent a starting at has a solution of length no more than D. This problem is in NP, sine given a journey over G, we an easily hek that it hits every vertex, and that all of its edges are available at the orret times. Suh a solution an be no longer than D, sine D is the total duration of G. Suppose S ontains a over C of U of size k or less. Then for all s i C, a takes s i, that is, a waits at during both instanes of pass(i), and visits all v j s i and returns to during take(i), whih is possible sine the duration of take(i) is 2 s i. Sine C is a over of U, a visits all v i. For all s i / C, a passes s i, that is, a moves from to p i during the first pass(i), waits at p i during take(i), and returns to during the seond pass(i). During hek, a moves from to, then bak to. At this point, sine C k, a has passed at least n k s i s. So, there are no more than k p i s left unvisited. a visits these during f inish, thus ompleting visitation of all verties of G in no more than D steps (e.g., Figure 1). Suppose there exists a solution to this instane of DMVP of length no more than D. Prior to finish, a must have visited at least n k p i s, sine finish only lasts for 2k 1 steps. So a must have passed at least n k s i s. Taking and passing for a single s i are mutually exlusive, beause if a moves to p i during the first pass(i), a must wait during take(i), and if a both takes s i and moves to p i during the seond pass(i), a will be trapped at p i until finish, and will never be able to reah, whih must be visited during hek, the only input time at whih is available. Thus, a ould have taken no more than k s i s. During these k or fewer takes, a must have overed all,..., v m. So, the union of these k or fewer take(i) s ontains all edges (, v j ), whih implies that the orresponding s i s form a over of U or size k or less. Hene, the deision problem is NP-omplete. Consider the minimization version of the problem with the same setup. Sine it is NP-hard to deide if there is a solution of length D or less, it is NP-hard to find suh a solution. But after D steps, a may have to wait an arbitrarily long time for the next edge is a feasible solution to appear, so any feasible solution that takes longer than D steps an be arbitrarily long. Therefore, the problem annot be approximated within any fator. This inapproximability also holds over the restrition of underlying graphs to trees of max-degree 3, in partiular, ombs. Theorem 2. DMVP for a single agent in R is NP-hard to approximate within any fator, even when the underlying graph is a omb. Proof. Analogous to Theorem 1, we redue from the set over problem (SCP) [21]. Given an instane of SCP, onstrut a omb G = (V, E) with bakbone b 0 b 1 b m+n+1 ; teeth,..., v m, orresponding

6 pass(1) take(1) pass(1) pass(2) take(2) pass(2) pass(3) take(3) pass(3) pass(4) take(4) pass(4) hek finish Agent loation after overing eah stati temporal subgraph in dark gray; nodes overed so far in light gray. Figure 1: Thm.1 stati snapshots for U = {1, 2, 3, 4, 5}, S = {{1, 2, 4}, {2, 4}, {3, 4}, {3, 5}}, k = 2.

7 to elements in U, with (b i, v i ) E i = 1,..., m; teeth,..., p n, orresponding to sets in S, with (b m+i, p i ) E i = 1,..., n; and two hek teeth and p n+1 with (b 0, ), (b m+n+1, p n+1 ) E. Let B = {(b 0, b 1 ),..., (b m+n 1, b m+n )} be the set of all edges in the bakbone of G. We use the following stati subgraphs of G to onstrut a TVG G. For all s i in S, let pass(i) = (V, B {(b m+i, p i )}), and let take(i) = (V, E i ), where E i = B {(b j, v j ) : j s i }. Let hek = (V, {(b 0, )}). Let finish = (V, F ), where F = B {(b m+i, p i ) : 1 i n + 1} {(b m+n+1, p n+1 ). Let bak = (V, B). Define the TVG G = (bak, m + n), (pass(1), 1), (take(1), 3m), (pass(1), 1),...,(bak, m + n), (pass(n), 1),(take(n), 3m),(pass(n), 1), (bak, m + n), (hek, 2),(finish, m + n k). The total duration of G is D = n(4m + n + 2) + (m + n) (m + n k) = n 2 + 4mn + 4n + 2m + 2k + 3. Consider the problem of deiding if DMVP over G with a single agent a starting at b 0 has a solution of length no more than D. This problem is in NP, sine given a journey over G, we an easily hek that it hits every vertex, and that all of its edges are available at the orret times. Suh a solution an be no longer than D, sine D is the total duration of G. Suppose S ontains a over C of U of size k or less. Then for all s i C, a takes s i, that is, a travels to b 0 during bak, and visits all v j s i, and returns to the bakbone during take(i), whih is possible sine the duration of take(i) is 3m, whih allows a to take all of the at most m available elements while traveling up the bakbone. Sine C is a over of U, a visits all v i. For all s i / C, a passes s i, that is, a moves to b i+m during bak, and to p i during the first pass(i), waits at p i during take(i), and returns to b i+m during the seond pass(i). During the final bak, a moves to b 0, and during hek, a moves from b 0 to, then bak to b 0. At this point, sine C k, a has passed at least n k s i s. So, there are no more than k p i s left unvisited. a visits these during finish, eah at ost 2 off the path length m + n + 2 path up the bakbone to p n+1, thus ompleting visitation of all verties of G in no more than D steps (e.g., Table 1). Suppose there exists a solution to this instane of DMVP of length no more than D. Prior to finish, a must have visited at least n k p i s, sine finish only lasts for 2k 1. So a must have passed at least n k s i s. Taking and passing for a single s i are mutually exlusive, beause if a moves to p i during the first pass(i), a must wait during take(i), and if a both takes s i and moves to p i during the seond pass(i), a will be trapped at p i until finish, and will never be able to reah, whih must be visited during hek, the only input time at whih is available. Thus, a ould have taken no more than k s i s. During these k or fewer takes, a must have overed all,..., v m. So, the union of these k or fewer take(i) s ontains all edges (, v j ), whih implies that the orresponding s i s form a over of U or size k or less. Hene, the deision problem is NP-omplete. Consider the minimization version of the problem with the same setup. Sine it is NP-hard to deide if there is a solution of length D or less, it is NP-hard to find suh a solution. But after D steps, a may have to wait an arbitrarily long time for the next edge is a feasible solution to appear, so any feasible solution that takes longer than D steps an be arbitrarily long. Therefore, the problem annot be approximated within any fator. We have a similar set of lower bounds for the ase of B, but with some ability to approximate. We later show (Theorem 11) that these approximation bounds are indeed tight for all trees. Theorem 3. DMVP for a single agent in B is NP-hard to approximate within any fator less than, even when the underlying graph is a spider, > 1. Proof. We redue from 3-partition. Given a multiset of 3m positive integers S = {s 1,..., s 3m }, it is strongly NP-omplete to deide if they an be partitioned into m sets where all sets have the same sum [17]. Let 3m i=1 s i = M. Then B = M/m is the required sum for eah partition. Starting with the ommon entral vertex, onstrut a spider in the following way. For eah s i S, add a orresponding arm of length s i. Add m arms of length one to be used as hekpoints, and add a single long arm A 0 of some length k > 2M +2m (e.g., Figure 3). For the TVG used in this proof, arms over any period of time are in one of three modes: steady, flashing, or arrying. When an arm A is steady over a period of time from τ to τ, all of its edges are onstantly available during

8 p 5 b 10 p 5 b 10 p 5 b 10 b 9 b 9 b 9 pass(1) b 8 take(1) b 8 bak b 8 b 7 b 7 b 7 b 6 b 6 b 6 b 5 b 5 b 5 b 4 b 4 b 4 b 3 b 3 b 3 b 2 b 2 b 2 b 1 b 1 b 1 b 0 b 0 b 0 p 5 b 10 p 5 b 10 b 9 b 9 hek b 8 finish b 8 b 7 b 7 b 6 b 6 b 5 b 5 b 4 b 4 b 3 b 3 b 2 b 2 b 1 b 0 b 1 b 0 Agent loation after eah stati temporal subgraph in dark gray; nodes overed so far in light gray. Figure 2: Thm. 2 sample stati snapshots for U = {1, 2, 3, 4, 5}, s 1 = {1, 2, 4} S, with S = 4, and k = 2.

9 that period. When A is flashing, all of its edges synhronously alternate between being unavailable for 1 steps, and available for 1 step, satisfying the time-bounded reurrene onstraint. Formally, if A is flashing, then e A, t [τ, τ ], { 1 if t τ p 1 mod p, ρ(e, t) = 0 otherwise. When A is arrying, all of its edges at as if A were flashing, with the exeption that the edge distane i from is always available at time τ + i, so that starting at time τ, an agent at an travel along A for τ τ steps without waiting. Formally, if A = a 0...a l is arrying, then (u, v) E(A), t [τ, τ ], 1 if t τ p 1 mod p, ρ(e, t) = 1 if v = a t τ, 0 otherwise. Let take be the temporal subgraph of duration 2B in whih the arms orresponding to s i s are steady, and all others are flashing. Let hek be the temporal subgraph of duration 2 in whih all hekpoint arms are steady, and all others are flashing. Let f inish be the temporal subgraph of duration k in whih all arms are flashing exept for A 0, whih is arrying. Let G be the TVG formed by alternating between take and hek m times, before ending with f inish. The total duration of G is D = 2M + 2m + k. Consider the problem of deiding if DMVP over G with a single agent a starting at has a solution of length no more than D. Sine k > 2M + 2m, suh a solution must take the long arm last, as traversing this arm twie would result in a solution of length greater than 2k > (2M + 2m) + k = D. Furthermore, sine every arm must be traversed twie exept the long arm, the topologial length of a solution journey an be no less than 2M + 2m + k = D. So a solution of temporal length no more than D annot involve waiting. Suppose there exists a 3-partition of S. During eah take, a an explore the arms of the spider orresponding to one partition, and return to in exatly 2B steps. During the subsequent hek, a visits one hekpoint arm, and returns to in the allotted 2 steps. Repeating this proess for the remaining takes and heks, a will over all the s i arms and hekpoint arms without ever waiting, and end up again at. Finally, during finish, a takes the long arm A 0, reahing its leaf without waiting, ompleting overage in D steps. Now, suppose this instane of DMVP has a solution of length D. To avoid waiting, a must take omplete arms and return to during eah take, so that it is not stalled by flashing. Similarly, a must take a single hekpoint arm and return to during eah hek. Doing this m times, a has effetively partitioned the s i arms into sets eah of total length B. So, the deision problem is NP-omplete, sine 3-partition remains NP-omplete even when input integers are given in unary. a ompletes the solution by following the long arm A 0, whih an be traversed in k steps immediately after a returns to from the final hekpoint. Consider the minimization version of the problem with the same setup. Note that if a does not begin taking A 0 right as finish begins, A 0 will take at least (k 1) + 1 to traverse, this best ase ourring when a does not have to wait for the first edge. In partiular, if a takes A 0 last, but has not visited all other arms before finish starts, visiting those arms must have taken at least 2M + 2m + ( 1) > 2M + 2m, > 1, sine a must wait at least one during its traversal. The total ost of the solution is then at least D = (k 1) M + 2m + ( 1) = k + 2M + 2m. If a does not take A 0 last, it must traverse A 0 twie, taking at least (k 1) k steps (this best ase ourring when a starts taking the long arm out right as finish starts), and one it returns must wait at least one while traversing the remaining arms, making the length of the total solution at least D = (k 1) k + 2M + 2m + ( 1) = k + 2M + 2m + k > D. Take any real onstant δ <. Choose the least integer N s.t. N > 1 δ. Let k = Nδ(2M + 2m). Then, ( δ)nδ(2m + 2m) > δ(2m + 2m),

10 A 0 Figure 3: Underlying spider for Thm. 3 for 3-partition input: S = {2, 3, 4, 4, 5, 8}. ( δ)k > δ(2m + 2m), k > δ(2m + 2m + k), k + 2M + 2m = D > δd, > 1. Therefore, any solution that ontains waiting annot be a δ-approximation. So, finding a δ-approximation is equivalent to finding a solution with no waiting, i.e., a minimal solution, and thus is NP-hard. Hene, the problem is NP-hard to approximate within any fator less than. Theorem 4. DMVP for a single agent in B is NP-hard to approximate within any fator less than, even when the underlying graph is a omb, > 1. Proof. We use a similar extension to that for R to extend this result from spider to a omb with long enough arms. We again redue from 3-partition. Given a multiset of 3m positive integers S = {s 1,..., s 3m }, it is strongly NP-omplete to deide if they an be partitioned into m sets where all sets have the same sum [17]. This result learly still holds even when m is even. So suppose m is even and, let 3m i=1 s i = M. Then B = M/m is the required sum for eah partition. Let l = 7m2 2 3m Starting with a bakbone β = b 1...b 4m+1, onstrut a omb in the following way: For eah s i S, add a orresponding arm of length ls i attahed to β at b m 2 +i. Add m arms 1,..., m of length one to be used as hekpoints, with i attahed at b m 2 i 1 if i is odd, and b 7m i 2 if i is even. Add a single long arm of some length k > 2lBm + 7m2 2 2m 2 + 3, attahed at b 4m+1. For the TVG used in this proof (e.g., Figure 4), arms over any period of time are in one of three modes: steady, f lashing, or arrying (see the proof of Theorem 3). Assume all edges in β be available at all times, unless stated otherwise. Let take be the temporal subgraph of duration 2lB +3m in whih the arms orresponding to s i s are steady, and all others are flashing. Let hek(j) be the temporal subgraph of duration i + (i mod 2) + 2 in whih hekpoint j s arm is steady, and all others are flashing. Let finalhek be the temporal subgraph of duration m 2 +2 in whih hekpoint m s arm is steady, and all others are flashing. Let finish be the temporal subgraph of duration k in whih β is flashing, and all arms are flashing exept for the long arm of length k, whih is arrying. Let G be the TVG take, hek(1), take, hek(2),..., take, hek(m 1), take, finalhek, finish. The duration of G up until the start of finish is d = 2lBm + 3m 2 + m i=1 (i + (i mod 2) + 2) + m 7m = 2lBm + 2 2m The total duration of G is D = d + k. Consider the problem of deiding whether DMVP over G with a single agent a starting at b 7m 2 has a solution of length no more than D. Sine k > 2lBm + 7m2 2 2m 2 + 3, suh a solution must

11 take the long arm last, as traversing this arm twie would result in a solution of length greater than 2k > (2lBm + 7m2 2 2m 2 + 3) + k = D. Suppose there exists a 3-partition of S. During the jth take, if j is odd (even), starting at b 7m 2 (b m 2 +1 ), a an explore the arms of the spider orresponding to one partition, and end up at b m 2 +1 (b 7m ) in exatly 2Bl + 3m steps. During the subsequent hek(j), a visits j, and returns to b m to m and then to (b 7m ) in exatly i + (i mod 2) + 2 steps. During finalhek, a travels from b 7m 2 2 b 4m+1 in the allotted m steps. Finally, during finish, a takes the long arm, reahing its leaf without waiting, ompleting overage in D steps. Now, suppose this instane of DMVP has a solution of length D. If there is no 3-partition of S, then a must wait during traversal of at least one arm orresponding to an s i. Sine the length of this arm is ls i, a must in fat wait for at least l edges of this arm, inurring a ost of ( 1)l = ( 1)( 7m2 2 3m 2 + 2). Sine in the length D solution desribed above a never waits on an arm, this inurred ost must be made up for by minimizing traversal of edges in β. However, in the length D solution desribed above, a only traverses β for a total of 7m2 2 3m < ( 1)l steps, > 1. Therefore, the solution must be in the form of the solution desribed above in whih a 3-partition of S does indeed exists. So, the deision problem is NP-omplete, sine 3-partition remains NP-omplete even when input integers are given in unary. Consider the minimization version of the problem with the same setup. Note that if a does not begin taking the long arm right as finish begins, the long arm will take at least (k 1) + 1 to traverse, this best ase ourring when a does not have to wait for the first edge. In partiular, if a takes the long arm last, but has not visited all other arms before finish starts, visiting those arms must have taken at least d + ( 1), sine a must wait at least one during their traversal, and the total ost of the solution is then at least D = (k 1) d + ( 1) = k 1 + d. If a does not take the long arm last, it must traverse the long arm twie, taking at least (k 1) k steps (this best ase ourring when a starts taking the long arm right as finish starts), and one it returns must wait at least one while traversing the remaining arms, making the length of the total solution at least D = (k 1) k + d + ( 1) = (k + 1) + d > D. Take any real onstant δ <. Choose the least integer N s.t. N > 1 δ. Let k = Nδd. Then ( δ)nδd > δd, ( δ)k > δd, k > δd + δk, k + d = D > δd, > 1. Therefore, any solution that ontains waiting annot be a δ-approximation. So, finding a δ-approximation is equivalent to finding a solution with no waiting, i.e., a minimal solution, and thus is NP-hard. Hene, the problem is NP-hard to approximate within any fator less than. As is shown in Setion 4, there is a muh greater potential for tratability of DMVP in P than in B or R. However, the next result follows immediately via redution from hamiltonian path by simply restriting t to n 1. Theorem 5. DMVP for a single agent in P is NP-omplete, when p = 1. Proof. p = 1 is simply the stati ase, so the theorem follows immediately from the result that MVP is NP-omplete for a single agent on general graphs [1]. DMVP in P for p = 1 is then also NP-omplete for all lasses of graphs for whih hamiltonian path is NP-omplete, in partiular, planar graphs of maximum degree 3, bridgeless undireted planar 3-regular bipartite graphs, and 3-onneted 3-regular bipartite graphs [3]. To show that P is an interesting dynamis lass for DMVP in its own right, it is important to show that DMVP yields

12 b 1 b 2 b 3 b 4 b 5 b 6 b 7 b 8 b Figure 4: 3-partition underlying omb for some S with S = 6. Agent starts at b 8. different hardness results over P than over stati graphs. Thus, we onstrut a lass of graphs for the following result: Theorem 6. There is an infinite lass of graphs C suh that DMVP for a single agent in P over graphs in C is NP-omplete when p = 2, but trivial when p = 1. Proof. Given a graph G with an even number of verties arbitrarily ordered v 0,..., v n 1, onstrut a orresponding graph G C by adding n new verties 0,..., n 1, and adding the edges (v i, i ), (v i, i+1 ), and ( i, i+1 ) for all 0 < i < n, where indies are taken mod n. To show the problem is NP-omplete for a single agent in P over graphs in C, with p = 2, we redue from the hamiltonian path problem [21]. Consider a graph G with an even number of verties n, and one of those verties v 0, with the problem of deiding whether G ontains a hamiltonian path starting at v 0. Take the graph G C orresponding to G as the underlying graph of G. G begins at time 0. In P with p = 2, traversable edges an only be one of three possible types: (01) available at odd times but not even times, (10) available at even times but not odd times, (11) available at all times. Let all original edges of G be of type 11. Let (v i, i ) be of type 01 when i is even and type 10 when i is odd. Let (v i, i+1 ) be of type 10 when i is even and 01 when i is odd. Let ( i, i+1 ) be of type 10 when i is even and 01 when i is odd (see Figure 5). Consider the problem of deiding if DMVP over G for a single agent a starting at v 0 has a solution of length no more than 2n 1, i.e., a solution with no waiting, and in whih eah vertex is visited exatly one. This problem is learly in NP. If there is a hamiltonian path in G from v 0 vertex v i, then this path will be onstantly available in G. a an take this path in n 1 steps, and, ending at an odd time, immediately follow (v i, i ) if i is even, or (v i, i+1 ) if i is odd, then follow either the path i i+1 i+2... i 1 or i+1 i+2 i+2... i, the edges for whih are always available as a reahes the inoming verties, thus ompleting the overall traversal in exatly 2n 1 steps. Suppose there is a solution to this problem of length 2n 1. By onstrution, if a moves to any i before overing every v j, a must then wait at least one at some k before visiting any further v l. This is beause for all i, one i is reahed via either (v i 1, i ), (v i, i ), or ( i 1, i ) the only edge that an be immediately taken without waiting is ( i, i+1 ). So a must visit all v j exatly one without visiting any i, thus following a path orresponding to a hamiltonian path in G.

13 However, if we onsider the same setup over G but with p = 1, v n 1 v n 1 0 is always an optimal solution. 4 Upper Bounds In this setion, we map out a lass of graphs over whih DMVP in R is solvable in polynomial time. We first start with a very useful lemma. Note that a related observation (about turning around on a ring) was made in [20]. Lemma 1 (Turning around lemma). There is always an optimal solution J that never turns around at a degree 2 vertex of the edge-indued subgraph of J in G. Proof. Suppose v is a degree 2 vertex with neighbors u, w in the edge-indued subgraph of J in G. Suppose agent a takes edge (u, v) at time τ, then turns around, taking (u, v) at time τ as the very next edge in its traversal. Sine (v, w) is in the edge-indued subgraph of J, a must traverse (v, w) at some other time, thereby reahing v at that time. So, a ould have waited at u from times τ to τ + 1, instead of taking (u, v) at time τ, and the solution would still be optimal (see Figure 6). We apply Lemma 1 to get the following solvability results for restrited lasses of underlying graphs. Theorem 7. DMVP for a single agent in R on a path is solvable in O(T ) time. Proof. Consider DMVP for a single agent a with underlying graph G the path v 0...v n, and a starting at v k. To reah v 0, a must over all v k 1,..., along the way. Similarly, to reah v n, a must over all v k+1,..., v n 1. By Lemma 1, an optimal solution an be onstruted by first taking a foremost journey to either v 0 or v n, then taking the foremost journey to the remaining endpoint. One of these two topologial journeys, alled the lef t and right journeys, must embody an optimal solution, but in the worst ase edge availability must be heked for all t T, yielding an O(T ) runtime. Theorem 8. DMVP for a single agent in R on a yle is solvable in O(T n) time. Proof. A similar ase to Theorem 7 an be made for the yle C = v 0...v n v 0. Suppose a starts at v 0 at time 0. Consider an optimal visitation of C for a. In this optimal solution, there is some vertex v k v 0 that is visited last. The seond to last vertex is then either v k 1 or v k+1. If it is v k 1, then a must have already visited v k+1 without visiting v k. So, the edge (v k+1, v k ) is never traversed. Therefore, the solution redues to an optimal solution over the path graph v k v k 1...v k+1 starting at v 0. Similarly, if instead v k+1 is the vertex visited seond to last, then a must have already visited v k 1 without visiting v k, and the solution redues to an optimal solution over the path v k 1 v k 2...v k+1 v k. Sine there are n 1 possible final verties for an optimal solution, the ost of an optimal solution an be omputed by for eah of these verties omputing the minimal ost between optimal overage of eah of the two orresponding paths using Algorithm 1, and taking the minimum over all n 1 verties possible final verties (see Figure 7). This yields an O(T n) runtime. Now we show that despite the severe inapproximability of DMVP over R, we an always ompute an optimal solution in exponential time. Theorem 9. DMVP for a single agent in R is solvable in O(T n 3 + n 2 2 n ) time.

14 G v 0 G Figure 5: G (from Thm. 6) with underlying graph G onstruted from some six-node graph G. Edges labeled 10 are available at even times; 01 at odd times.

15 v 0 Figure 6: The 7 ways, satisfying Lemma 1, of overing the verties of a length 5 path with degree 2 intermediate nodes. Proof. The proposed algorithm first omputes all-pairs-all-times-foremost-journey of input TVG G, using a straightforward dynami programming algorithm, then uses this information to run another dynami programming algorithm, oneived along the lines of a standard method for TSP [5]. Let d t uv be the length of the foremost journey from u to v, starting at time t. Algorithm 2 omputes d t uv for all vertex pairs (u, v), and times t T for a given TVG G. At all times t, for all verties u V, d t uu is learly 0. At time T, the time limit has been reahed, so an agent annot move to another vertex in any guaranteed time, and thus we set d T uv = for all u v. For all T 1 t 0, in the worst ase an agent an wait at u for one step, and take the foremost journey to v starting at time t + 1. If there is a better journey than this, it must onsist of not waiting, rather taking one of the edges available at time t from u to some vertex k. Subsequently taking the foremost journey from k to v starting at time t + 1 results in an optimal journey through k. Algorithm 2 learly runs in O(T n 3 ) time, and uses O(T n 2 ) spae. Algorithm 3 uses the d t uv values omputed by Algorithm 2 to ompute the ost of a minimal solution to DMVP for a single agent in R. Let V V and (V, v) be the minimal time it takes to visit all verties in V starting at vertex s at time 0 and ending at vertex v V. After initializing the minimal osts for visiting subsets up to size 2, the algorithm repeatedly uses the minimal osts for size i subsets to alulate (V, v) for eah size i + 1 subset V and v s V. One omputed up to size n, the algorithm returns the minimal ost among journeys that over all verties. This is an optimal solution to DMVP as it is the minimum ost of taking foremost journeys between verties that results in a omplete over. There are 2 n subsets of V, and so n2 n subsetvertex pairs of the form (V, v). For eah of these, the algorithm omputes the minimum of O(n) values. So, Algorithm 3 has running time O(n 2 2 n ). Sine it saves one ost for eah subset-vertex pair, Algorithm 3 also uses O(n2 n ) spae. Sequentially running Algorithm 2 followed by Algorithm 3, we have a omplete algorithm for DMVP for a single agent in R, with ombined running time O(T n 3 + n 2 2 n ). Almost-trees have been previously studied with respet to fixed parameter tratability (e.g., [15]). We use Theorem 9 to generalize Theorems 7 and 8 with the following: Theorem 10. DMVP in R is fixed parameter tratable, when G is an m-leaf -almost-tree, for fixed parameter m, and onstant. Proof. First, onsider the restrited ase where G is an m-leaf tree. Sine every leaf must be visited, and visiting all leaves implies overage of the entire tree, there is a minimal solution that an be thought of as an ordering of the set of leaves of G, and the foremost journeys between them. In this ase, there is only one way to visit any node, namely, on the way to a leaf. Using this observation and Algorithm 3 from the proof of Theorem 9, we see that we only need to onsider all orderings of

16 Algorithm 1 DMVP-Line(G, {v k }) llo = rlo = k lt urned = rt urned = omplete = F alse t = 0 while not omplete do if not lt urned then if ρ((v llo, v llo 1 ), t) = 1 then llo = llo 1 if llo = 0 then lt urned = T rue else if ρ((v llo, v llo+1 ), t) = 1 then llo = llo + 1 if rlo = n then omplete = T rue if not rt urned then if ρ((v rlo, v rlo+1 ), t) = 1 then rlo = rlo + 1 if rlo = n then rt urned = T rue else if ρ((v rlo, v rlo 1 ), t) = 1 then rlo = rlo 1 if rlo = 0 then omplete = T rue t = t + 1 return t Both possible journeys start at v k Advane left journey if possible Left endpoint reahed Right endpoint reahed Advane right journey if possible Right endpoint reahed Left endpoint reahed Step leaves, instead of all orderings of verties, yielding a run time of O(T n 3 + m 2 2 m ), whih is indeed fixed parameter tratable for parameter m. Suppose the underlying graph G of G is an m-leaf -almost-tree. Consider all edges e suh that removing e from G results in a ( 1)-almost-tree. Eah of these edges lies on some path P suh that removing any edge of P will similarly result in a ( 1)-almost-tree, and every intermediate vertex on the path has degree 2. Suppose P is the path v 0...v l. Sine G is an m-leaf -almost-tree, there are O(m) paths of this type. The edge-indued subgraph G of the underlying walk of an optimal overing of G an be any ( )-almost-tree G, for 0. For eah, a solution involves seleting paths, eah of O(n) length, from whih to remove an edge. So, there are O(m n ) possible hoies of ( )-almost-trees, and thus O( =0 n (m )) = O(m n ) hoies for G. Every G has no more than m + 2 leaves. Sine every edge of G is overed, by Lemma 1, there are at most 2 ways to over eah of the remaining O(m) paths v 0...v l of intermediate vertex degree 2, namely: entering at v 0 and exiting at v l, or entering at v l and exiting at v 0. Augment the set of leaves to be ordered in a solution with the seleted ways of overing these paths, that is, selet one of the onseutive subsequenes v 0 v l or v l v 0 to be in the ordering. With this augmentation, we still have a set of O(m) elements to be ordered, the optimal ordering of whih an be omputed via Theorem 9 in O(T n 3 + m 2 2 m ) time. The minimum over all ways of overing G an then be omputed in O(2 m )O(T n 3 + m 2 2 m ) = O(T n 3 2 m + m 2 2 2m ). The overall minimum ost for overing G an then be omputed by taking the minimum ost over all O(m n ) edge-indued subgraphs in O(m n )O(T n 3 2 m + m 2 2 2m ) = O(T n 3+ f(m)) time. The following result follows immediately for the ase when m = O(lg n).

17 v 0 Figure 7: The 8 possible underlying walks of solutions, satisfying Lemma 1, to the 5-yle starting at v 0. Corollary 1. DMVP in R is solvable in polynomial time, if G is an O(lg n)-leaf -almost-tree, for onstant. We onjeture (see Setion 5) that the maximal lass of graphs over whih DMVP in R is polytime solvable is the lass of all graphs with polynomially many spanning trees, all of whih have O(lg n) leaves. Sine DMVP in B is bounded by 2 n, the running time of the algorithm in Theorem 9 on TVGs over B redues to O( n 4 +n 2 2 n ). We also see that we are able to greatly improve on approximation from R to B: Theorem 11. DMVP in B over a tree an be -approximated in O(n) time. This approximation is tight. Proof. In [1], it is shown that minimal MVP ost C an be omputed in O(n) for stati graphs. In the dynami ase, the journey orresponding to following exatly the edges in the stati solution when they are available an be followed, waiting at most 1 steps for eah edge to appear before it is traversed. Sine no solution an be better than C, and the proposed journey takes at most C, it must be a -approximation. From Theorems 3 and 4, we know there an be no better approximation. Hene, this approximation is tight. Theorem 12. DMVP in B an be 2 -approximated by any online spanning tree traversal of G. Proof. The topologial length of a spanning tree traversal is no more than 2n 3. In the worst ase, waiting 1 time steps for eah subsequent edge to appear results in overage of G in 2n 3 steps. The fastest possible overage of G is via the traversal of a hamiltonian path in G without waiting, whih takes n 1 steps, and 2 (n 1) > 2n 3.

18 Algorithm 2 All-pairs-all-times-foremost-journey(G) for all u, v V V do Initialize base ase for t = T. if u = v then d T uv = 0 else d T uv = Sine input ends at T, agent annot move. for t = T 1,..., 0 do Work bakwards until start time t = 0. for all u, v V V do if u = v then d t uv = 0 else d t uv = d t+1 uv + 1 In worst ase, just wait at u. for all k V do if ρ((u, k), t) = 1 then Chek for better route. d t uv = min(d t uv, d t+1 kv + 1) Algorithm 3 DMVP(G, {s}) ({s}, s) = 0 Initialize subset of size 1. for all v s V do Initialize subsets of size 2. ({s, v}, v) = d 0 sv for i = 3,...,n do Build up to subsets of size n. for all S V s.t. S = i do for all v s V do (V, v) = min u s V \{v}((v \ {v}, u) + d (V \{v},u) uv ) return min v s V ((V, v)) Theorems 3 and 4 show the tightness of Theorem 11. Here, B is starkly differentiated from R in that we have at least some ability to approximate in B. See Setion 5 for a further disussion of the relationship between these two lasses. Similar to the ase for B, DMVP in P is bounded by 2pn, so the running time of the algorithm in Theorem 9 redues to O(pn 4 + n 2 2 n ). To exemplify the differenes between P and B, and motivate interest in the tratability of DMVP over P, we first give the following simple example: Theorem 13. For any p, there is a lass of problems over ombs, for whih DMVP in B is NP-hard, but in P is solvable by the online algorithm: take arms when you get to them. Proof. Suppose an agent a starts at b 0. a an either take A 0 immediately, or travel along B to visit other arms and return to visit A 0 at a later time. Suppose the fastest an agent starting at b 0 an visit the leaf of A 0 and return to b 0 is l steps. Then the longest this ould possibly take a starting at time 0 is l + (p 1) steps, this worst ase ourring when a must wait p 1 steps for the fastest journey to beome available. Suppose the fastest journey from b 0 to b k takes k steps. Then in the worst ase, traveling from b 0 to b k takes k + (p 1) steps. Suppose the fastest overage of the remaining indued subgraph G = G \ (A 0 {b 0,..., b k 1 }) takes m steps. If G has only one arm, the foremost journey from b k to the leaf of this arm is learly optimal. Assume that if G has α arms, then the following online algorithm results in an optimal solution: if at the endpoint of an unvisited arm, take that arm, otherwise visit the next unvisited vertex of B. In the α + 1 arm ase, our agent starting at b 0 using this algorithm will omplete overage in no more than l + (p 1) + k + (p 1) + m = l + k + (2p 2) + m steps. But any solution in whih a

19 A 0 A 1 A 2 b 0 b k b 2k k 2p 2 k Figure 8: Segment of an underlying omb for whih DMVP in P for an agent starting at b 0 is solved by the simple online tree traversal algorithm, regardless of the lengths of eah arm A i does not take A 0 first must ost at least l + k + k + m, as a must retraverse b k...b 0 on its way bak to over A 0. Sine k 2p 2, the online solution must be minimal. It is straightforward to modify Theorem 4 (i.e., by appropriately saling up the underlying graph: elongating arms, extending the bakbone, separating arms along the bakbone, and adding an additional hek tooth at b 0 ) to show that DMVP over the above lass of ombs is NP-hard in B, for a single agent starting at b 0. The quality of P we take advantage of above is that if the fastest journey between two nodes takes d steps, the foremost journey an take no longer than d + (p 1), while in B it an be as bad as d. We again harness this effet in the following result, a stronger theorem in the ontext of our inapproximability results for R and B (Theorems 1 and 3): Theorem 14. DMVP in P over a spider is solvable in polynomial time, for fixed p. Proof. Starting at the enter of the spider, it is never useful for an agent to travel along any arm, unless it reahes a leaf. That is, an optimal solution is essentially an optimal visitation order of the leaves. We an set up a ost funtion (l, t) giving the minimal time it takes to travel from to leaf l and bak, starting at time t. Sine G is periodi, (l, t) = (l, t + kp) k Z. Suppose the fastest journey from to l and bak has ost m(l). Let extra time e(l, t) = (l, t) m(l), be the ost above minimum inurred by traveling to l and bak starting at time t. 0 e(l, t) < p l, t, sine a an always simply wait at most p 1 steps for the periodially fastest journey to be available. For any l, there are only possible funtions e(l, t), sine for all 0 t (mod p) p 1, 0 e(l, t) < p. Let r(l, t) be the return time mod p of traveling to l and bak, that is, (l, t) = i = r(l, t) = t + i (mod p). Classify eah l by e and r. Let l 1 l 2 e(l 1, t) = e(l 2, t) and r(l 1, t) = r(l 2, t) t. Sine for eah t there are p hoies for e and p hoies for r, there are suh equivalene lasses. During a traversal of the spider, leaves with a ommon equivalene lass are interhangeable, sine at a given time, taking any of the same lass will result in equivalent inurrene of ost above minimum as well as equivalent return time. Thus, a minimal traversal onsists of traversing an ordering of arms orresponding to a sequene of equivalene lasses q i, suh that the frequeny of q i in the sequene is the number of arms lassified as q i. Notie that for any length p traversed sequene q 1 q 2...q p, by the pigeonhole priniple, there must be q i, q j with i < j suh that r(q i, t i ) = r(q j, t j ), where t i is the start time for traversing the q i arm, and t j is the start time for traversing the q j arm. Let Q t be a pattern if Q is a sequene of equivalene lasses with 0 < Q p, and starting at at time t, the traversal of Q returns at some time t t (mod p). Furthermore, Q t is not a pattern if it ontains any subpatterns, i.e., traversed subsequene with equivalent start and end time. Any length p sequene must ontain a