Asymptotic theory for bent-cable regression the basic case

Size: px
Start display at page:

Download "Asymptotic theory for bent-cable regression the basic case"

Transcription

1 Journal of Statistical Planning and Inference 27 (2005) Asymptotic theory for bent-cable regression the basic case Grace Chiu a;b;, Richard Lockhart a, Richard Routledge a a Department of Statistics and Actuarial Science, Simon Fraser University, Burnaby, British Columbia, Canada V5A S6 b Pacic Institute for the Mathematical Sciences, Simon Fraser University, Burnaby, British Columbia, Canada V5A S6 Accepted 6 September 2003 Abstract We use what we call the bent-cable model to describe potential change-point phenomena. The class of bent cables includes the commonly used broken stick (a bent cable without a bend segment). Theory for least-squares (LS) estimation is developed for the basic bent cable, whose incoming and outgoing linear phases have slopes 0 and, respectively, and are joined smoothly by a quadratic bend. Conditions on the design are given to ensure regularity of the estimation problem, despite non-dierentiability of the model s rst partial derivatives (with respect to the covariate and model parameters). Under such conditions, we show that the LS estimators (i) are consistent, regardless of a zero or positive true bend width; and (ii) asymptotically follow a bivariate normal distribution, if the underlying cable has all three segments. In the latter case, we show that the deviance statistic has an asymptotic chi-squared distribution with two degrees of freedom. c 2003 Elsevier B.V. All rights reserved. MSC: 62F2 (62J02) Keywords: Change points; Segmented regression; Least-squares estimation; Asymptotic theory This research has been funded by the Natural Sciences and Engineering Research Council of Canada through a Postgraduate Scholarship to G. Chiu during her graduate studies at SFU, and Research Grants to R. Lockhart and R. Routledge. Corresponding author. addresses: sgchiu@stat.sfu.ca, grace@pims.math.ca (G. Chiu), lockhart@stat.sfu.ca (R. Lockhart), routledg@stat.sfu.ca (R. Routledge) /$ - see front matter c 2003 Elsevier B.V. All rights reserved. doi:0.06/j.jspi

2 44 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) Introduction Given known design points x ;:::;x n, we consider random responses Y ;:::;Y n generated by the regression model where Y i = q(x i ; 0 ; 0 )+ i ; i=;:::;n; () (x + )2 q(x; ; )= { x 6 } +(x ){x } (2) 4 is referred to as the basic bent cable (Fig. ), and i s are i.i.d. random errors with mean 0 and known, constant standard deviation. We write 0 =( 0 ; 0 ). Least-squares (LS) estimation of 0 =( ;M] [0; ) on the open regression domain X = R is considered. Here, M is some nite positive upper bound (large) for the candidate -values. Zero is the natural lower bound for candidate -values. Any basic bent cable q(x; ) for is a candidate model. In this article, we prove, given a set of conditions on the location of the design points x ;:::;x n (Section 3), that the least-squares estimators (LSEs) for 0 and 0 are consistent when 0 0, and asymptotically follow a bivariate normal distribution when 0 0. Asymptotic distributional properties for the case of 0 = 0 appear in Chiu et al. (2002a). A bent cable with free slope parameters is required in practice. The full bent-cable model can be written as f(x; 0 ; ; 2 ;;)= 0 + x + 2 q(x; ; ). This article is intended to provide a framework for the complex estimation theory associated with the full model. Seber and Wild (989, Chapter 9) have suggested employing the class of bent-cable models which includes the piecewise-linear broken-stick model when = 0 in situations where both smooth and sharp transitions are plausible. However, modeling change phenomena by the broken stick remains common (Barrowman and Myers, 2000; Naylor and Su, 998; Neuman et al., 200). Numerical instability due to the non-dierentiability of this model prompted Tishler and Zang (98) to develop (2). Their introduction of a phoney bend of xed, non-trivial width to replace the kink at was a computational tactic. Upon numerical convergence, would be ignored. However, when no law of nature or auxiliary knowledge is available to support an abruptness notion, a broken-stick t would encourage the investigator to look for sources of change associated with the sole value of ˆ. In contrast, the bent cable incorporates as part of the parametric model. It generalizes the broken stick by removing the a priori assumption of a sharp threshold, allowing for a possibly gradual transition. A bent-cable t would point to one or more sources of change whose inuence took hold gradually over a certain covariate range. Thus, it helps to avoid data misinterpretation due to possible over-simplication of the nature of change. We call it the bent cable due to the smooth bend as opposed to a sharp break in a snapped stick. The performance of bent-cable regression for assessing the abruptness of change is discussed in Chiu et al. (2002b). In practice, estimation of may be required. Chiu (2002) shows that the results of this article extend to LS estimation assuming unknown, and that the LSE of is consistent.

3 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) Fig.. The basic bent cable q(x; ; ), with the dotted quadratic bend. (The solid line is the broken stick.) 2. Theory for segmented models Whether is zero or positive, the second partial derivatives of (2) fail to exist where the segments meet. This irregularity prevents the direct application of asymptotics readily available for LS problems that are regular. Feder (975) and Ivanov (997), among others, have discussed asymptotics for non-linear regression involving segmented models of general forms with unknown join points. Similar regression problems include the consideration of broken-stick models (Bhattacharya, 990; Huskova, 998) and general two-phase linear-nonlinear or other multiphase non-linear models (Gallant, 974, 975; Huskova and Steinebach, 2000; Jaruskova, 998a, b, 200; Rukhin and Vajda, 997). Feder s principal assumption is continuity of the underlying function without extra smoothness constraints. If the underlying model has an odd order of smoothness (number of continuous derivatives plus one), then the asymptotics are radically dierent compared to those for an even order. Gallant considers once-dierentiable candidate and underlying models of common functional form. In the case of a once-dierentiable quadratic quadratic model, consistency and asymptotic normality of the LSE for the unknown joint is established by, among other requirements, (i) taking the design points to be near replicates of a basic design with ve distinct covariate values (see Gallant,

4 46 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) , p. 26; Gallant, 974, pp. 6 7), and (ii) restricting the search for candidate knots to within a compact subset trapped between two consecutive covariate values from (i) (see Gallant, 975, p. 26). Gallant, Ivanov, and Rukhin and Vajda all establish consistency by assuming a bounded or compact parameter space. Ivanov adds a somewhat unintuitive condition which relates the candidate model to the response error variability (see Ivanov, 997, p. 30, expression (3.3)). Rukhin and Vajda simply exclude the LSE from their M-estimators (see condition (C3) in their article). To establish asymptotic normality, Rukhin and Vajda and Ivanov assume twice-dierentiability of the regression function, although Rukhin and Vajda cite a tactic for relaxing such an assumption (see Vaart and Wellner, 996, Chapter 3). Huskova, Huskova and Steinebach, Jaruskova, and Rukhin and Vajda all consider evenly spaced regressors, while Bhattacharya considers a more general design. These authors have all shown standard LS asymptotics despite a lack of higher-order derivatives of the regression function. However, their results are not directly applicable to our specialized problem. We consider underlying and candidate models within the class of bent cables. General and structurally simple design conditions are provided and proved to suce for establishing regularity. 3. Conditions for the basic bent cable Besides an unspecied upper bound on the -space, our only regularity conditions are placed on the design. Given 0 and sequence n 0, rst dene c 0 () = lim inf { xi }; n n c () = lim inf n c + () = lim inf n n n { xi }; {xi }; n ( n )= n { xi n }: The regularity conditions on x ;:::;x n are [A ]If 0 =0; then 0; c 0 () 0. [A 2 ]If 0 0; then 0 such that c c ( ) 0. [B] For 0 0; 0 such that c+ c + ( ) 0. [C] If 0 0; then n 0; n ( n ) 0. [D] If 0 0; then x i 0 ± 0 i =;:::;n. The practical value in these conditions is that they indicate a general design (not necessarily equidistant) which ensures that data are collected at appropriate x-locations for reliable LS estimation of 0. While 0 is unknown, the investigator s expertise in the subject matter should suggest a range of design points that easily satises conditions

5 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) [A] and [B]. Satisfying condition [C] in practice is not dicult as the precise locations of 0 ± 0 are unknown. For a continuous covariate, it is reasonable to rule out exact equality that would violate Condition [D]. At the cost of some notational complexity, [D] could be entirely eliminated. 4. Method and results For normally distributed i s in (), the log-likelihood as a function of is n ( )= 2 2 S n( ) + constant; where S n ( )= n i= [Y i q(x i ; )] 2. In this case, maximum likelihood (ML) and LS theories coincide. In the absence of normality, we maximize n but do not refer to it as the ML function. Maximization of n is equivalent to minimization of S n (i.e. LS estimation). The results in this section imply that ML and LS asymptotics coincide even without the normality of the i s in the latter case. When a sample yields multiple maximizers of n, we take the LSE ˆ n to be the one selected sequentially as follows: (i) pick out the one(s) with the least vector norm; (ii) keep the one(s) with the least ; (iii) if necessary, select that with the least. The following notation is used in stating the results: U n ( ( ); U n( ( ); U n( )=(U n ( ); U n ( )) T ; V n ( )= U n ( ) (wherever dened); I n ( ) = Cov 0 [U n ( )]: Note that I n and U n are analogous to the Fisher Information and the score function in ML estimation. With conditions [A] [D], our only irregularity lies in a Hessian, V n, that is not well-dened everywhere. However, [D] preserves regularity at 0, and is used to establish the uniform convergence (in probability) of V n and I n in a shrinking neighborhood of 0 (Lemma 3). Regular LS asymptotics follow. Condensed proofs for the following key results appear in Section 6. Motivational and mathematical details are in Chiu (2002). Lemma (Identiability). Take and from [A] and [B]. Suppose w [ ; ). Furthermore, () if 0 0 and w 0 [ ; ], then q(w i ; 0 )=q(w i ; ) for i =; 2 implies = 0 ;(2) if 0 =0 and w 0 [ 0 =8; 0 +=8], where (0; =2), then q(w i ; 0 )=q(w i ; ) for i =; 2 implies 0 6. Remark. This lemma is fundamental to establishing consistency. Theorem (Consistency): Consider LS estimation for model () as dened in Section. Under conditions [A] and [B], ˆ n P 0 as n.

6 48 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) Before stating our next theorem, we provide a fact about the square-root matrix to avoid ambiguity. For a symmetric positive-denite matrix A, there is a unique symmetric positive-denite matrix B such that A = B 2 = B T B (Golub and Van Loan, 996, Exercise P.2.4.). We write B = A =2, the square root of A. Theorem 2 (Asymptotic Normality). Consider LS estimation for model () as dened in Section. Under conditions [A] [D] and 0 0,. (=n)i n ( 0 ) is positive denite for all suciently large n; 2. n[(=n)i n ( 0 )] =2 ( ˆ n 0 ) converges in distribution to a standard bivariate normal random variable; 3. P 0 {(=n)i n ( ˆ n ) is positive denite} ; 4. n[(=n)i n ( ˆ n )] =2 ( ˆ n 0 ) converges in distribution to a standard bivariate normal random variable; 5. G n 2[ n ( ˆ n ) n ( 0 )], the deviance statistic, converges in distribution to a 2 random variable with 2 degrees of freedom. 5. Auxiliary lemmas for proving Theorem 2 First, note that the ith summands of U n ( ) and U n ( ) are, respectively, U ;i ( )= 2 [ i+d 0; (x i (x i where d ; 2 (x)=q(x; ) q(x; 2 (x (x i = x i ( ) 2 [ = 4 x i ; U ;i ( )= 2 [ i+d 0; (x i (x i ) { x i 6 } {x i + }; (3) 2] { x i 6 }: (4) Thus, for each i, both U ;i and U ;i are continuous surfaces over the (; )-plane, but they have folds along the rays dened by R i+ = { : = x i }; R i = { : = x i }: Summing these surfaces over i produces continuous U n and U n surfaces, each with n pairs of folds indexed by the data x ;:::;x n (Chiu, 2002, Fig. 4.). As a result, the matrix V n is well-dened everywhere on except along the R i± s. To avoid technical diculties we dene a directional Hessian: V j;i ( ) = lim h U j;i( + h; ); V j;i ( ) = lim h U j;i(; + h)

7 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) for all i =;:::;n and j = ;. Of course, these V i + s are merely regular derivatives when evaluated at some R k± ; k =;:::;n. Now, we can replace V n by [ n V + V + ;i ( ) V ;i + n ( )= ( ) ] i= V ;i + ( ) V ;i + ( ) ; which is well-dened on, and coincides with V n ( ) except along the R k± s. Lemma 2. For all, we have [ T U n ( )=U n ( 0 )+ Vn( ;t)dt] ( 0 ); (5) 0 where, for all t [0; ] and, [ n V + V ;i ( 0 + t( 0 ); 0 ) V ;i + n( ;t)= ( ] 0 + t( 0 ); 0 ) V ;i + (; 0 + t( 0 )) V ;i + (; : 0 + t( 0 )) i= Remark 2. Had the Hessian been continuous, all its components in the integrand would have been simply ( 0 +t( 0 ); 0 +t( 0 ))= 0 +t( 0 ). As V + n is discontinuous, slightly dierent arguments are used, as given by V n. Lemma 3. Given are conditions [A] [D], and a sequence n 0. Then, j; k = ; + V + n;jk ( ) P 0 as n ; (6) I n;jk ( 0 ) sup n where r = { : 0 6 r} and V + n;jk similarly for I n;jk. denotes the (j; k)th component of V+ n, and Lemma 4 (Corollary to Theorem ): Under conditions [A] and [B], there exists a decreasing sequence n 0 such that P 0 { ˆ n 0 6 n } as n. Remark 3. In proving Theorem 2, we concentrate on the behavior of the U n surface over n. 6. Proofs In addition to the notation from Sections 4 and 5, write T n ( )= n d 0; (x i ) 2 ; n S n ( )= n i + d 0; (x i ) 2 ; S n ( )= n S n( ); H n ( )=E 0 [ S n ( )]:

8 50 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) Proof of Lemma. See Chiu (2002). Proof of Theorem. This proof of consistency is mostly standard, with the exceptions that the parameter space is unbounded, and that the boundary value of 0 =0 is handled properly. Below, we highlight the crucial elements of the proof. Claim. There exists M 0 such that P 0 { ˆ n 0 M } 0. Proof. By conditions [A] and [B], there are M ;M 2 ;N 0 such that n N inf M 2 [ M ;M] inf M 0 n T n( ) 6 2 : This lower bound and the Strong Law of Large Numbers can then be applied to show that inf M S n ( ) a:s: S n ( ˆ n ) for all n N, where M = max{m ;M 2 }. Claim 2. For each (0; =2), there is an 0 such that lim inf n inf D {H n ( ) H n ( 0 )}, where D = { : M }. Proof. Dene T (w 0 ;w ; )= d 0; (w 0 ) 2 + d 0; (w ) 2 and { [0 C ;R = (w 0 ;w ): w 0 + ; ] if [ 0 =8; 0 + =8] if 0 =0 w [ ;R] for some R ( M ; ). By Lemma, a compactness argument can show that ;R inf {T (w 0 ;w ; ): D ; (w 0 ;w ) C ;R } 0. Next, pick (0;=4) and dene c = min{c ;c 0 ( );c +} 0. Then, choose from the dataset {x ;:::;x n } pairs of design points (x 0j ;x j ) C lim K C ;K. Conditions [A] and [B] imply that there are at least nc such pairs for all n N for some N. Moreover, it can be shown that ;K = ;R for all K R. Take = ;R c. Then, T n ( )= n n d 0; (x i ) 2 nc T (x 0j ;x j ; ) n n i= j= nc j= ; { } inf T ;R c = : C This lower bound is positive and -free. Then, inf D T n ( ) for all n N for the given D. Since T n ( )=H n ( ) H n ( 0 ), the claim follows. Claim 3. For all 0; P 0 {sup M S n ( ) H n ( ) 6 }. Proof. We employ a standard chaining argument, using the fact that the basic bent cable q(x i ; ) satises the Lipschitz condition q(x; ) q(x; 2 ) = d ; 2 (x) 6 B r 2 ; 2 r x R; (7)

9 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) where r 6 M, and B r is a positive constant that can be derived using (3) and (4). The remainder of the proof is straightforward. Proof of Lemma 2. Each summand of U n is piecewise continuously dierentiable as a function of either or. Thus, for example, integrating V + n; over gives U n (; ) U n ( 0 ;)= 0 n i= =( 0 ) 0 V ;i + (s; )ds n V ;i + ( 0 + t( 0 );)dt: i= The algebra is similar for integrating V n; + over and for other V + n;jk s. Then, since U nj ( )=U nj ( 0 ; 0 )+[U nj (; 0 ) U nj ( 0 ; 0 )]+[U nj (; ) U nj (; 0 )] for all j = ;, the lemma follows by routine algebra. Proof of Lemma 3. We examine the components of V + n and I n. To simplify the algebra, write i = {x i + }; 2i = x i ( ) { x i 6 }; 2 [ 3i = x i 2] 4 { x i 6 }; 4i = x i all of which are functions of (but the argument is suppressed in the notation). (x i )=@ = i + 2i (x i )=@ = 3i, and the directional derivatives for the summands of U n are V ;i + ( )= I ;i [ i + d 0; (x i )]{ x i 6 + }; V + ;i ( )= I ;i + V + ;i ( )= I ;i + V + ;i ( )= I ;i + 4i [ i + d 0; (x i )]{ x i 6 + }; 4i [ i + d 0; (x i )]{ x i 6 }; 2 4i [ i + d 0; (x i )]{ x i 6 }; where the summands of the components of I n are I ;i ( )= i + 2 2i 2 ; I ;i ( )= 2i 3i 2 = I ;i ( ); I ;i ( )= 2 3i 2 : (8)

10 52 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) By conditions [A] and [B], one can show that there are N and M jk m jk 0; j;k=;, such that n N implies m jk 6 n I n;jk( 0 ) 6 M jk j; k = ; : (9) That is, for all j; k = ; ; I n;jk ( 0 ) is bounded between two non-trivial multiples of n for all suciently large n. Thus, to prove the lemma, it suces to show sup n;jk ( ) =o(n) (0) n sup n n;jk ( ) =o p (n) () for each pair of (j; k), where n;jk ( ) =I n;jk ( ) I n;jk ( 0 ) and n;jk ( ) =V + n;jk ( ) + I n;jk ( ). There are three cases: (a) j = k =, (b) j = k =, and (c) j k. We do only Case (a). First, consider (0). Given any n, apply (8) toget 2 n; ( ) 6 2 i 2 i; i 2 2i;0 ; (2) where ki;0 (k =; 2; 3) is the value of ki with replaced by 0. For the second sum in (2), partition the index set {;:::;n} into the four sets I {i : x i ; x i 0 0 }; I 2 {i : x i 6 ; x i }; I 3 {i : x i 6 ; x i 0 0 }, and I 4 {i : x i ; x i }. Then, use (7) to show that sup n 2 2i 2 2i;0 =O( n) over I and I 2. For i I 3 I 4, note that 2 2i 2 2i;0 6. Now, dene K + n =[ n ; n ] and K n =[ 0 0 n ; n ], which shrink to the join points 0 ± 0 as n. Then, apply condition [C] to see that for all suciently large n, n 2i 2 2i;0 2 = no( n )+ i= 6 no() + i I 3 I 4 2 2i 2 2i;0 i: x i K ± n 6 o(n)+n n ( n )=o(n): This bound is -free. A similar argument applies to the rst sum in (2), with a suitable partition of the index set. Therefore, n; ( ) is uniformly bounded by o(n) over n. (For Cases (b) and (c), not having accumulation at the joints 0 ± 0 is crucial in keeping the matrices I n ( ) and I n ( 0 ) close everywhere on n.) To show (), Case (a), rst, dene a n; ( )=(2) d 0; (x i ){ x i 6 + } and B n; ( ) =(2) i { x i 6 + } so that 2 n; ( ) =a n; ( ) + B n; ( ). By (7), one can show that sup n a n; ( ) =o(n). Now, relabel the data so that x 6 x 2 6 6x n, and dene the martingale M m = m i= i; 6 m 6 n. For each n, there are integers s and t; 6 s 6 t 6 n, such that n i= i{ x i 6 +

11 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) } = M t M s. Hence, B n; ( )= M t M s 2 6 M t + M s n max 6m6n M m This -free bound is O p ( n) by the Doob Kolmogorovinequality (see Breiman, 968, p. 89, Problem 2). Thus, sup n n; ( ) 6 o(n)+o p ( n)=o p (n). Note that for Cases (b) and (c), each summand of B n; ( ) orb n; ( ) has the form i! i ( ), and the martingale tactic above does not apply. Instead, the reader can verify that a routine chaining argument suces in these cases. Proof of Theorem 2. Part. Denote the eigenvalues of the covariance matrix n I n ( 0 ) by n and n2, where 0 6 n 6 n2. With the upper bounds of (9), it remains to show integer N and 0 s:t: n N n : (3) One can prove (3) by relating n and n2 to the trace and determinant of n I n ( 0 ), then applying conditions [A] and [B]. We omit the details. Part 2. By eigenvalue properties, Lemma 3, and Part of the theorem, P 0 { n V+ n ( ) is negative denite for all n } : (4) : Now, we introduce a lemma about the concavity of a once-dierentiable function. Its rst assertion is due to Theorem in Stoer and Witzgall (970), and the second, the denition of concavity. We omit the proof. Lemma 5. () Let N be a subset of [0; ] consisting of isolated points. Suppose that a dierentiable function f :[0; ] R has a continuous second derivative, f, in [0; ] \ N. Then, f is strictly concave on [0; ] if f (t) 0 for all but those isolated values of t N. (2) A dierentiable function g : n R is strictly concave if and only if h(t) g( + t( 2 )) is concave on [0; ] for each ; 2 n, where 2. For our problem, we study h n (t) n ( + t( 2 )) for ; 2 n ; 2 ; t [0; ]. In what follows, we restrict our attention to the event dened in (4). First, consider and 2 which do not both lie on R k± for any k. They dene a line segment along which n is piecewise twice dierentiable. By the chain rule, [ ] n h n (t)=( 2 ) T n V n( + t( 2 )) ( 2 ) (5) [ ] =( 2 ) T n V+ n ( + t( 2 )) ( 2 ) 0 (6) for all but isolated values of t [0; ]. By Lemma 5, it follows that n n, hence, n, is concave along this line segment.

12 54 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) We are left to examine the case where and 2 both lie on a ray. By symmetry, we need only to consider, say, the 45 R k+ s. Here, the chain rule cannot be applied to yield (5), since V n is not dened at + t( 2 ) for any t [0; ]. Instead, one can expand h n (t), dierentiate it twice, and verify, after some lengthy algebra, that n h n (t) indeed equals the expression in (6) for all but isolated values of t [0; ]. These isolated values correspond to the intersections of the line segment (joining and 2 on R k+ ) with the 35 R i s. Thus, we have shown that every cross-section, and hence, the entire surface, of n over n is strictly concave on the event dened in (4). By consistency, P 0 { ˆ n is the unique maximizer of n over n } : Now, this unique ˆ n can be substituted into the Taylor-type expansion of Lemma 2. Finally, asymptotic normality of ˆ n results from standard matrix manipulation by noting that the summands of U n ( 0 ) satisfy the Lindeberg Condition, and thus Part and the Lindeberg Feller Central Limit Theorem ensure that [I n ( 0 )] =2 U n ( 0 )is asymptotically standard normal. Parts 3 and 4. The results follow, respectively, from Parts and 2 due to consistency and (0). Part 5. Since n is once-dierentiable, we can write n ( = n ( 0 )+( 0 ) T U n ( 0 + t( 0 )) dt: (7) By Lemma 2, we have, for all t [0; ], 0 [ T U n ( 0 + t( 0 )) = U n ( 0 )+ V n( 0 + t( 0 );s)ds] t( 0 ): (8) Substitute (8) into (7) and apply Lemma 3 and Part 2 to complete the proof Concluding remarks We have given some structurally simple conditions on the design. These provide a practical guideline for data collection when considering basic bent-cable regression. We have shown that these few regularity conditions suce to compensate for the intrinsic irregularity of the problem due to non-dierentiability of the model s rst partial derivatives. In particular, they ensure that the I n ( 0 ) matrix is asymptotically well-behaved, in the sense that the amount of information about the unknown parameter 0 contained in all suciently large datasets is no less than a non-trivial multiple of the sample size. Furthermore, as V + n ( ) is the negative (directional) Hessian of n, its uniform closeness to I n ( 0 )on n ensures that its discontinuities are asymptotically negligible, leading to an n -surface that is uniformly well-behaved

13 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) on this ever-decreasing neighborhood of 0. This is the basis of the regularity of our problem, despite U n surfaces that are folded. Thus, standard asymptotic results apply. With slightly modied conditions, our results here can be extended to the full bent-cable model with non-normal errors and unknown constant variance. The details are to appear in a future article and are currently available in Chiu (2002). Acknowledgements We thank the Co-ordinating Editor and referees for providing valuable suggestions and extra references. References Barrowman, N.J., Myers, R.A., Still more spawner-recruitment curves: the hockey stick and its generalizations. Can. J. Fish. Aquat. Sci. 57, Bhattacharya, P.K., 990. Weak convergence of the log likelihood process in the two-phase linear regression problem. Proceedings of the R.C. Bose Symposium on Probability, Statistics and Design of Experiments, Wiley Eastern, New Delhi. Breiman, L., 968. Probability. Addison-Wesley, Reading, MA. Chiu, G.S., Bent-cable regression for assessing abruptness of change. Ph.D. Thesis, Department of Statistics and Actuarial Science, Simon Fraser University, Burnaby, BC. Chiu, G., Lockhart, R., Routledge, R., 2002a. Bent-cable asymptotics when the bend is missing. Statist. Probab. Letters 56, 9 6. Chiu, G., Routledge, R., Lockhart, R., 2002b. Using the bent cable to assess an abrupt change in species abundance and other phenomena. Winning student paper. WNAR/IMS 2002 Conference, Los Angeles, CA. Feder, P.I., 975. On asymptotic distribution theory in segmented regression problems identied case. Ann. Statist. 3, Gallant, A.R., 974. The theory of nonlinear regression as it relates to segmented polynomial regressions with estimated join points. Mimeograph Series No Institute of Statistics, North Carolina State University, Rayleigh, NC. Gallant, A.R., 975. Inference for nonlinear models. Mimeograph Series No Institute of Statistics, North Carolina State University, Rayleigh, NC. Golub, G.H., Van Loan, C.F., 996. Matrix Computations. Johns Hopkins University Press, Baltimore, MD. Huskova, M., 998. Estimators in the location model with gradual changes. Comment. Math. Univ. Carolinae 39, Huskova, M., Steinebach, J., Limit theorems for a class of tests of gradual changes. J. Statist. Plann. Inference 89, Ivanov, A.V., 997. Asymptotic Theory of Nonlinear Regression. Kluwer Academic Publishers, Dordrecht. Jaruskova, D., 998a. Testing appearance of linear trend. J. Statist. Plann. Inference 70, Jaruskova, D., 998b. Change-point estimator in gradually changing sequences. Comment. Math. Univ. Carolinae 39, Jaruskova, D., 200. Change-point estimator in continuous quadratic regression. Comment. Math. Univ. Carolinae 42, Naylor, R.E.L., Su, J., 998. Plant development of triticale cv. Lasko at dierent sowing dates. J. Agric. Sci. 30, Neuman, M.J., Witting, D.A., Able, K.W., 200. Relationships between otolith microstructure, otolith growth, somatic growth and ontogenetic transitions in two cohorts of windowpane. J. Fish Biol. 58,

14 56 G. Chiu et al. / Journal of Statistical Planning and Inference 27 (2005) Rukhin, A.L., Vajda, I., 997. Change-point estimation as a nonlinear regression problem. Statistics 30, Seber, G.A.F., Wild, C.J., 989. Nonlinear Regression. Wiley, New York. Stoer, J., Witzgall, C., 970. Convexity and Optimization in Finite Dimensions, I.. Springer, Berlin. Tishler, A., Zang, I., 98. A new maximum likelihood algorithm for piecewise regression. J. Amer. Statist. Assoc. 76, Vaart, A.W.van der., Wellner, J.A., 996. Weak Convergence and Empirical Processes. Springer, New York.

Bent-cable asymptotics when the bendis missing

Bent-cable asymptotics when the bendis missing Statistics & Probability Letters 59 (2002) 9 6 Bent-cable asymptotics when the bendis missing Grace Chiu, RichardLockhart, RichardRoutledge Department of Statistics and Actuarial Science, Simon Fraser

More information

ON STATISTICAL INFERENCE UNDER ASYMMETRIC LOSS. Abstract. We introduce a wide class of asymmetric loss functions and show how to obtain

ON STATISTICAL INFERENCE UNDER ASYMMETRIC LOSS. Abstract. We introduce a wide class of asymmetric loss functions and show how to obtain ON STATISTICAL INFERENCE UNDER ASYMMETRIC LOSS FUNCTIONS Michael Baron Received: Abstract We introduce a wide class of asymmetric loss functions and show how to obtain asymmetric-type optimal decision

More information

A characterization of consistency of model weights given partial information in normal linear models

A characterization of consistency of model weights given partial information in normal linear models Statistics & Probability Letters ( ) A characterization of consistency of model weights given partial information in normal linear models Hubert Wong a;, Bertrand Clare b;1 a Department of Health Care

More information

Constrained Leja points and the numerical solution of the constrained energy problem

Constrained Leja points and the numerical solution of the constrained energy problem Journal of Computational and Applied Mathematics 131 (2001) 427 444 www.elsevier.nl/locate/cam Constrained Leja points and the numerical solution of the constrained energy problem Dan I. Coroian, Peter

More information

Computation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy

Computation Of Asymptotic Distribution. For Semiparametric GMM Estimators. Hidehiko Ichimura. Graduate School of Public Policy Computation Of Asymptotic Distribution For Semiparametric GMM Estimators Hidehiko Ichimura Graduate School of Public Policy and Graduate School of Economics University of Tokyo A Conference in honor of

More information

On reaching head-to-tail ratios for balanced and unbalanced coins

On reaching head-to-tail ratios for balanced and unbalanced coins Journal of Statistical Planning and Inference 0 (00) 0 0 www.elsevier.com/locate/jspi On reaching head-to-tail ratios for balanced and unbalanced coins Tamas Lengyel Department of Mathematics, Occidental

More information

Numerical Integration for Multivariable. October Abstract. We consider the numerical integration of functions with point singularities over

Numerical Integration for Multivariable. October Abstract. We consider the numerical integration of functions with point singularities over Numerical Integration for Multivariable Functions with Point Singularities Yaun Yang and Kendall E. Atkinson y October 199 Abstract We consider the numerical integration of functions with point singularities

More information

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a

N.G.Bean, D.A.Green and P.G.Taylor. University of Adelaide. Adelaide. Abstract. process of an MMPP/M/1 queue is not a MAP unless the queue is a WHEN IS A MAP POISSON N.G.Bean, D.A.Green and P.G.Taylor Department of Applied Mathematics University of Adelaide Adelaide 55 Abstract In a recent paper, Olivier and Walrand (994) claimed that the departure

More information

STABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin

STABILITY OF INVARIANT SUBSPACES OF COMMUTING MATRICES We obtain some further results for pairs of commuting matrices. We show that a pair of commutin On the stability of invariant subspaces of commuting matrices Tomaz Kosir and Bor Plestenjak September 18, 001 Abstract We study the stability of (joint) invariant subspaces of a nite set of commuting

More information

The Pacic Institute for the Mathematical Sciences http://www.pims.math.ca pims@pims.math.ca Surprise Maximization D. Borwein Department of Mathematics University of Western Ontario London, Ontario, Canada

More information

The best expert versus the smartest algorithm

The best expert versus the smartest algorithm Theoretical Computer Science 34 004 361 380 www.elsevier.com/locate/tcs The best expert versus the smartest algorithm Peter Chen a, Guoli Ding b; a Department of Computer Science, Louisiana State University,

More information

460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses

460 HOLGER DETTE AND WILLIAM J STUDDEN order to examine how a given design behaves in the model g` with respect to the D-optimality criterion one uses Statistica Sinica 5(1995), 459-473 OPTIMAL DESIGNS FOR POLYNOMIAL REGRESSION WHEN THE DEGREE IS NOT KNOWN Holger Dette and William J Studden Technische Universitat Dresden and Purdue University Abstract:

More information

A CLT FOR MULTI-DIMENSIONAL MARTINGALE DIFFERENCES IN A LEXICOGRAPHIC ORDER GUY COHEN. Dedicated to the memory of Mikhail Gordin

A CLT FOR MULTI-DIMENSIONAL MARTINGALE DIFFERENCES IN A LEXICOGRAPHIC ORDER GUY COHEN. Dedicated to the memory of Mikhail Gordin A CLT FOR MULTI-DIMENSIONAL MARTINGALE DIFFERENCES IN A LEXICOGRAPHIC ORDER GUY COHEN Dedicated to the memory of Mikhail Gordin Abstract. We prove a central limit theorem for a square-integrable ergodic

More information

STOCHASTIC DIFFERENTIAL EQUATIONS WITH EXTRA PROPERTIES H. JEROME KEISLER. Department of Mathematics. University of Wisconsin.

STOCHASTIC DIFFERENTIAL EQUATIONS WITH EXTRA PROPERTIES H. JEROME KEISLER. Department of Mathematics. University of Wisconsin. STOCHASTIC DIFFERENTIAL EQUATIONS WITH EXTRA PROPERTIES H. JEROME KEISLER Department of Mathematics University of Wisconsin Madison WI 5376 keisler@math.wisc.edu 1. Introduction The Loeb measure construction

More information

Bounds on expectation of order statistics from a nite population

Bounds on expectation of order statistics from a nite population Journal of Statistical Planning and Inference 113 (2003) 569 588 www.elsevier.com/locate/jspi Bounds on expectation of order statistics from a nite population N. Balakrishnan a;, C. Charalambides b, N.

More information

290 J.M. Carnicer, J.M. Pe~na basis (u 1 ; : : : ; u n ) consisting of minimally supported elements, yet also has a basis (v 1 ; : : : ; v n ) which f

290 J.M. Carnicer, J.M. Pe~na basis (u 1 ; : : : ; u n ) consisting of minimally supported elements, yet also has a basis (v 1 ; : : : ; v n ) which f Numer. Math. 67: 289{301 (1994) Numerische Mathematik c Springer-Verlag 1994 Electronic Edition Least supported bases and local linear independence J.M. Carnicer, J.M. Pe~na? Departamento de Matematica

More information

Stochastic dominance with imprecise information

Stochastic dominance with imprecise information Stochastic dominance with imprecise information Ignacio Montes, Enrique Miranda, Susana Montes University of Oviedo, Dep. of Statistics and Operations Research. Abstract Stochastic dominance, which is

More information

Efficiency of Profile/Partial Likelihood in the Cox Model

Efficiency of Profile/Partial Likelihood in the Cox Model Efficiency of Profile/Partial Likelihood in the Cox Model Yuichi Hirose School of Mathematics, Statistics and Operations Research, Victoria University of Wellington, New Zealand Summary. This paper shows

More information

PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS

PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS PROOF OF TWO MATRIX THEOREMS VIA TRIANGULAR FACTORIZATIONS ROY MATHIAS Abstract. We present elementary proofs of the Cauchy-Binet Theorem on determinants and of the fact that the eigenvalues of a matrix

More information

An FKG equality with applications to random environments

An FKG equality with applications to random environments Statistics & Probability Letters 46 (2000) 203 209 An FKG equality with applications to random environments Wei-Shih Yang a, David Klein b; a Department of Mathematics, Temple University, Philadelphia,

More information

Lecture 21. Hypothesis Testing II

Lecture 21. Hypothesis Testing II Lecture 21. Hypothesis Testing II December 7, 2011 In the previous lecture, we dened a few key concepts of hypothesis testing and introduced the framework for parametric hypothesis testing. In the parametric

More information

On Controllability and Normality of Discrete Event. Dynamical Systems. Ratnesh Kumar Vijay Garg Steven I. Marcus

On Controllability and Normality of Discrete Event. Dynamical Systems. Ratnesh Kumar Vijay Garg Steven I. Marcus On Controllability and Normality of Discrete Event Dynamical Systems Ratnesh Kumar Vijay Garg Steven I. Marcus Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin,

More information

Intrinsic products and factorizations of matrices

Intrinsic products and factorizations of matrices Available online at www.sciencedirect.com Linear Algebra and its Applications 428 (2008) 5 3 www.elsevier.com/locate/laa Intrinsic products and factorizations of matrices Miroslav Fiedler Academy of Sciences

More information

The iterative convex minorant algorithm for nonparametric estimation

The iterative convex minorant algorithm for nonparametric estimation The iterative convex minorant algorithm for nonparametric estimation Report 95-05 Geurt Jongbloed Technische Universiteit Delft Delft University of Technology Faculteit der Technische Wiskunde en Informatica

More information

Minimax and -minimax estimation for the Poisson distribution under LINEX loss when the parameter space is restricted

Minimax and -minimax estimation for the Poisson distribution under LINEX loss when the parameter space is restricted Statistics & Probability Letters 50 (2000) 23 32 Minimax and -minimax estimation for the Poisson distribution under LINEX loss when the parameter space is restricted Alan T.K. Wan a;, Guohua Zou b, Andy

More information

Pointwise convergence rate for nonlinear conservation. Eitan Tadmor and Tao Tang

Pointwise convergence rate for nonlinear conservation. Eitan Tadmor and Tao Tang Pointwise convergence rate for nonlinear conservation laws Eitan Tadmor and Tao Tang Abstract. We introduce a new method to obtain pointwise error estimates for vanishing viscosity and nite dierence approximations

More information

2 Sequences, Continuity, and Limits

2 Sequences, Continuity, and Limits 2 Sequences, Continuity, and Limits In this chapter, we introduce the fundamental notions of continuity and limit of a real-valued function of two variables. As in ACICARA, the definitions as well as proofs

More information

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition)

Vector Space Basics. 1 Abstract Vector Spaces. 1. (commutativity of vector addition) u + v = v + u. 2. (associativity of vector addition) Vector Space Basics (Remark: these notes are highly formal and may be a useful reference to some students however I am also posting Ray Heitmann's notes to Canvas for students interested in a direct computational

More information

Küchenhoff: An exact algorithm for estimating breakpoints in segmented generalized linear models

Küchenhoff: An exact algorithm for estimating breakpoints in segmented generalized linear models Küchenhoff: An exact algorithm for estimating breakpoints in segmented generalized linear models Sonderforschungsbereich 386, Paper 27 (996) Online unter: http://epububuni-muenchende/ Projektpartner An

More information

A Finite Element Method for an Ill-Posed Problem. Martin-Luther-Universitat, Fachbereich Mathematik/Informatik,Postfach 8, D Halle, Abstract

A Finite Element Method for an Ill-Posed Problem. Martin-Luther-Universitat, Fachbereich Mathematik/Informatik,Postfach 8, D Halle, Abstract A Finite Element Method for an Ill-Posed Problem W. Lucht Martin-Luther-Universitat, Fachbereich Mathematik/Informatik,Postfach 8, D-699 Halle, Germany Abstract For an ill-posed problem which has its origin

More information

A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations

A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations Journal of Statistical Planning and Inference 18 (22) 85 97 www.elsevier.com/locate/jspi A scale-free goodness-of-t statistic for the exponential distribution based on maximum correlations J. Fortiana,

More information

2 ANDREW L. RUKHIN We accept here the usual in the change-point analysis convention that, when the minimizer in ) is not determined uniquely, the smal

2 ANDREW L. RUKHIN We accept here the usual in the change-point analysis convention that, when the minimizer in ) is not determined uniquely, the smal THE RATES OF CONVERGENCE OF BAYES ESTIMATORS IN CHANGE-OINT ANALYSIS ANDREW L. RUKHIN Department of Mathematics and Statistics UMBC Baltimore, MD 2228 USA Abstract In the asymptotic setting of the change-point

More information

Nonmonotonic back-tracking trust region interior point algorithm for linear constrained optimization

Nonmonotonic back-tracking trust region interior point algorithm for linear constrained optimization Journal of Computational and Applied Mathematics 155 (2003) 285 305 www.elsevier.com/locate/cam Nonmonotonic bac-tracing trust region interior point algorithm for linear constrained optimization Detong

More information

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione

MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione MODELLING OF FLEXIBLE MECHANICAL SYSTEMS THROUGH APPROXIMATED EIGENFUNCTIONS L. Menini A. Tornambe L. Zaccarian Dip. Informatica, Sistemi e Produzione, Univ. di Roma Tor Vergata, via di Tor Vergata 11,

More information

On the reconstruction of the degree sequence

On the reconstruction of the degree sequence Discrete Mathematics 259 (2002) 293 300 www.elsevier.com/locate/disc Note On the reconstruction of the degree sequence Charles Delorme a, Odile Favaron a, Dieter Rautenbach b;c; ;1 a LRI, Bât. 490, Universite

More information

Minimum distance tests and estimates based on ranks

Minimum distance tests and estimates based on ranks Minimum distance tests and estimates based on ranks Authors: Radim Navrátil Department of Mathematics and Statistics, Masaryk University Brno, Czech Republic (navratil@math.muni.cz) Abstract: It is well

More information

r( = f 2 L 2 (1.2) iku)! 0 as r!1: (1.3) It was shown in book [7] that if f is assumed to be the restriction of a function in C

r(  = f 2 L 2 (1.2) iku)! 0 as r!1: (1.3) It was shown in book [7] that if f is assumed to be the restriction of a function in C Inverse Obstacle Problem: Local Uniqueness for Rougher Obstacles and the Identication of A Ball Changmei Liu Department of Mathematics University of North Carolina Chapel Hill, NC 27599 December, 1995

More information

Spatial autoregression model:strong consistency

Spatial autoregression model:strong consistency Statistics & Probability Letters 65 (2003 71 77 Spatial autoregression model:strong consistency B.B. Bhattacharyya a, J.-J. Ren b, G.D. Richardson b;, J. Zhang b a Department of Statistics, North Carolina

More information

Proofs for Large Sample Properties of Generalized Method of Moments Estimators

Proofs for Large Sample Properties of Generalized Method of Moments Estimators Proofs for Large Sample Properties of Generalized Method of Moments Estimators Lars Peter Hansen University of Chicago March 8, 2012 1 Introduction Econometrica did not publish many of the proofs in my

More information

This article was published in an Elsevier journal. The attached copy is furnished to the author for non-commercial research and education use, including for instruction at the author s institution, sharing

More information

Semi-strongly asymptotically non-expansive mappings and their applications on xed point theory

Semi-strongly asymptotically non-expansive mappings and their applications on xed point theory Hacettepe Journal of Mathematics and Statistics Volume 46 (4) (2017), 613 620 Semi-strongly asymptotically non-expansive mappings and their applications on xed point theory Chris Lennard and Veysel Nezir

More information

Balance properties of multi-dimensional words

Balance properties of multi-dimensional words Theoretical Computer Science 273 (2002) 197 224 www.elsevier.com/locate/tcs Balance properties of multi-dimensional words Valerie Berthe a;, Robert Tijdeman b a Institut de Mathematiques de Luminy, CNRS-UPR

More information

2 Garrett: `A Good Spectral Theorem' 1. von Neumann algebras, density theorem The commutant of a subring S of a ring R is S 0 = fr 2 R : rs = sr; 8s 2

2 Garrett: `A Good Spectral Theorem' 1. von Neumann algebras, density theorem The commutant of a subring S of a ring R is S 0 = fr 2 R : rs = sr; 8s 2 1 A Good Spectral Theorem c1996, Paul Garrett, garrett@math.umn.edu version February 12, 1996 1 Measurable Hilbert bundles Measurable Banach bundles Direct integrals of Hilbert spaces Trivializing Hilbert

More information

Abstract. Jacobi curves are far going generalizations of the spaces of \Jacobi

Abstract. Jacobi curves are far going generalizations of the spaces of \Jacobi Principal Invariants of Jacobi Curves Andrei Agrachev 1 and Igor Zelenko 2 1 S.I.S.S.A., Via Beirut 2-4, 34013 Trieste, Italy and Steklov Mathematical Institute, ul. Gubkina 8, 117966 Moscow, Russia; email:

More information

Linear Models 1. Isfahan University of Technology Fall Semester, 2014

Linear Models 1. Isfahan University of Technology Fall Semester, 2014 Linear Models 1 Isfahan University of Technology Fall Semester, 2014 References: [1] G. A. F., Seber and A. J. Lee (2003). Linear Regression Analysis (2nd ed.). Hoboken, NJ: Wiley. [2] A. C. Rencher and

More information

Likelihood Ratio Tests and Intersection-Union Tests. Roger L. Berger. Department of Statistics, North Carolina State University

Likelihood Ratio Tests and Intersection-Union Tests. Roger L. Berger. Department of Statistics, North Carolina State University Likelihood Ratio Tests and Intersection-Union Tests by Roger L. Berger Department of Statistics, North Carolina State University Raleigh, NC 27695-8203 Institute of Statistics Mimeo Series Number 2288

More information

3.5 Quadratic Approximation and Convexity/Concavity

3.5 Quadratic Approximation and Convexity/Concavity 3.5 Quadratic Approximation and Convexity/Concavity 55 3.5 Quadratic Approximation and Convexity/Concavity Overview: Second derivatives are useful for understanding how the linear approximation varies

More information

Differentiable Functions

Differentiable Functions Differentiable Functions Let S R n be open and let f : R n R. We recall that, for x o = (x o 1, x o,, x o n S the partial derivative of f at the point x o with respect to the component x j is defined as

More information

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques

Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Monte Carlo Methods for Statistical Inference: Variance Reduction Techniques Hung Chen hchen@math.ntu.edu.tw Department of Mathematics National Taiwan University 3rd March 2004 Meet at NS 104 On Wednesday

More information

Proposition 5. Group composition in G 1 (N) induces the structure of an abelian group on K 1 (X):

Proposition 5. Group composition in G 1 (N) induces the structure of an abelian group on K 1 (X): 2 RICHARD MELROSE 3. Lecture 3: K-groups and loop groups Wednesday, 3 September, 2008 Reconstructed, since I did not really have notes { because I was concentrating too hard on the 3 lectures on blow-up

More information

Optimization Methods. Lecture 18: Optimality Conditions and. Gradient Methods. for Unconstrained Optimization

Optimization Methods. Lecture 18: Optimality Conditions and. Gradient Methods. for Unconstrained Optimization 5.93 Optimization Methods Lecture 8: Optimality Conditions and Gradient Methods for Unconstrained Optimization Outline. Necessary and sucient optimality conditions Slide. Gradient m e t h o d s 3. The

More information

On locally Lipschitz functions

On locally Lipschitz functions On locally Lipschitz functions Gerald Beer California State University, Los Angeles, Joint work with Maribel Garrido - Complutense, Madrid TERRYFEST, Limoges 2015 May 18, 2015 Gerald Beer (CSU) On locally

More information

Average Reward Parameters

Average Reward Parameters Simulation-Based Optimization of Markov Reward Processes: Implementation Issues Peter Marbach 2 John N. Tsitsiklis 3 Abstract We consider discrete time, nite state space Markov reward processes which depend

More information

Antonietta Mira. University of Pavia, Italy. Abstract. We propose a test based on Bonferroni's measure of skewness.

Antonietta Mira. University of Pavia, Italy. Abstract. We propose a test based on Bonferroni's measure of skewness. Distribution-free test for symmetry based on Bonferroni's Measure Antonietta Mira University of Pavia, Italy Abstract We propose a test based on Bonferroni's measure of skewness. The test detects the asymmetry

More information

Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution

Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution Journal of Computational and Applied Mathematics 216 (2008) 545 553 www.elsevier.com/locate/cam Analysis of variance and linear contrasts in experimental design with generalized secant hyperbolic distribution

More information

Comments on integral variants of ISS 1

Comments on integral variants of ISS 1 Systems & Control Letters 34 (1998) 93 1 Comments on integral variants of ISS 1 Eduardo D. Sontag Department of Mathematics, Rutgers University, Piscataway, NJ 8854-819, USA Received 2 June 1997; received

More information

ON THE COMPLETE PIVOTING CONJECTURE FOR A HADAMARD MATRIX OF ORDER 12 ALAN EDELMAN 1. Department of Mathematics. and Lawrence Berkeley Laboratory

ON THE COMPLETE PIVOTING CONJECTURE FOR A HADAMARD MATRIX OF ORDER 12 ALAN EDELMAN 1. Department of Mathematics. and Lawrence Berkeley Laboratory ON THE COMPLETE PIVOTING CONJECTURE FOR A HADAMARD MATRIX OF ORDER 12 ALAN EDELMAN 1 Department of Mathematics and Lawrence Berkeley Laboratory University of California Berkeley, California 94720 edelman@math.berkeley.edu

More information

April 25 May 6, 2016, Verona, Italy. GAME THEORY and APPLICATIONS Mikhail Ivanov Krastanov

April 25 May 6, 2016, Verona, Italy. GAME THEORY and APPLICATIONS Mikhail Ivanov Krastanov April 25 May 6, 2016, Verona, Italy GAME THEORY and APPLICATIONS Mikhail Ivanov Krastanov Games in normal form There are given n-players. The set of all strategies (possible actions) of the i-th player

More information

A general procedure for rst/second-order reliability method (FORM/SORM)

A general procedure for rst/second-order reliability method (FORM/SORM) Structural Safety 21 (1999) 95±112 www.elsevier.nl/locate/strusafe A general procedure for rst/second-order reliability method (FORM/SORM) Yan-Gang Zhao*, Tetsuro Ono Department of Architecture, Nagoya

More information

Improved Newton s method with exact line searches to solve quadratic matrix equation

Improved Newton s method with exact line searches to solve quadratic matrix equation Journal of Computational and Applied Mathematics 222 (2008) 645 654 wwwelseviercom/locate/cam Improved Newton s method with exact line searches to solve quadratic matrix equation Jian-hui Long, Xi-yan

More information

Quantum logics with given centres and variable state spaces Mirko Navara 1, Pavel Ptak 2 Abstract We ask which logics with a given centre allow for en

Quantum logics with given centres and variable state spaces Mirko Navara 1, Pavel Ptak 2 Abstract We ask which logics with a given centre allow for en Quantum logics with given centres and variable state spaces Mirko Navara 1, Pavel Ptak 2 Abstract We ask which logics with a given centre allow for enlargements with an arbitrary state space. We show in

More information

Garrett: `Bernstein's analytic continuation of complex powers' 2 Let f be a polynomial in x 1 ; : : : ; x n with real coecients. For complex s, let f

Garrett: `Bernstein's analytic continuation of complex powers' 2 Let f be a polynomial in x 1 ; : : : ; x n with real coecients. For complex s, let f 1 Bernstein's analytic continuation of complex powers c1995, Paul Garrett, garrettmath.umn.edu version January 27, 1998 Analytic continuation of distributions Statement of the theorems on analytic continuation

More information

Pathwise Construction of Stochastic Integrals

Pathwise Construction of Stochastic Integrals Pathwise Construction of Stochastic Integrals Marcel Nutz First version: August 14, 211. This version: June 12, 212. Abstract We propose a method to construct the stochastic integral simultaneously under

More information

Closest Moment Estimation under General Conditions

Closest Moment Estimation under General Conditions Closest Moment Estimation under General Conditions Chirok Han Victoria University of Wellington New Zealand Robert de Jong Ohio State University U.S.A October, 2003 Abstract This paper considers Closest

More information

1 Directional Derivatives and Differentiability

1 Directional Derivatives and Differentiability Wednesday, January 18, 2012 1 Directional Derivatives and Differentiability Let E R N, let f : E R and let x 0 E. Given a direction v R N, let L be the line through x 0 in the direction v, that is, L :=

More information

The Uniformity Principle: A New Tool for. Probabilistic Robustness Analysis. B. R. Barmish and C. M. Lagoa. further discussion.

The Uniformity Principle: A New Tool for. Probabilistic Robustness Analysis. B. R. Barmish and C. M. Lagoa. further discussion. The Uniformity Principle A New Tool for Probabilistic Robustness Analysis B. R. Barmish and C. M. Lagoa Department of Electrical and Computer Engineering University of Wisconsin-Madison, Madison, WI 53706

More information

A note on profile likelihood for exponential tilt mixture models

A note on profile likelihood for exponential tilt mixture models Biometrika (2009), 96, 1,pp. 229 236 C 2009 Biometrika Trust Printed in Great Britain doi: 10.1093/biomet/asn059 Advance Access publication 22 January 2009 A note on profile likelihood for exponential

More information

106 CHAPTER 3. TOPOLOGY OF THE REAL LINE. 2. The set of limit points of a set S is denoted L (S)

106 CHAPTER 3. TOPOLOGY OF THE REAL LINE. 2. The set of limit points of a set S is denoted L (S) 106 CHAPTER 3. TOPOLOGY OF THE REAL LINE 3.3 Limit Points 3.3.1 Main Definitions Intuitively speaking, a limit point of a set S in a space X is a point of X which can be approximated by points of S other

More information

In manycomputationaleconomicapplications, one must compute thede nite n

In manycomputationaleconomicapplications, one must compute thede nite n Chapter 6 Numerical Integration In manycomputationaleconomicapplications, one must compute thede nite n integral of a real-valued function f de ned on some interval I of

More information

2 DAVID W. BOYD AND R. DANIEL MAULDIN of a Pisot number, A() 6=, A(1=) 6=, and ja(z)j jq(z)j on jzj = 1. Thus jf(z)j 1onjzj = 1 and f(z) has a unique

2 DAVID W. BOYD AND R. DANIEL MAULDIN of a Pisot number, A() 6=, A(1=) 6=, and ja(z)j jq(z)j on jzj = 1. Thus jf(z)j 1onjzj = 1 and f(z) has a unique Topology and Its Applications, 69(1996), 115-12 THE ORDER TYPE OF THE SET OF PISOT NUMBERS David W. Boyd and R. Daniel Mauldin y University of British Columbia and University of North Texas September 7,

More information

GMM-based inference in the AR(1) panel data model for parameter values where local identi cation fails

GMM-based inference in the AR(1) panel data model for parameter values where local identi cation fails GMM-based inference in the AR() panel data model for parameter values where local identi cation fails Edith Madsen entre for Applied Microeconometrics (AM) Department of Economics, University of openhagen,

More information

Realization of set functions as cut functions of graphs and hypergraphs

Realization of set functions as cut functions of graphs and hypergraphs Discrete Mathematics 226 (2001) 199 210 www.elsevier.com/locate/disc Realization of set functions as cut functions of graphs and hypergraphs Satoru Fujishige a;, Sachin B. Patkar b a Division of Systems

More information

1 Introduction It will be convenient to use the inx operators a b and a b to stand for maximum (least upper bound) and minimum (greatest lower bound)

1 Introduction It will be convenient to use the inx operators a b and a b to stand for maximum (least upper bound) and minimum (greatest lower bound) Cycle times and xed points of min-max functions Jeremy Gunawardena, Department of Computer Science, Stanford University, Stanford, CA 94305, USA. jeremy@cs.stanford.edu October 11, 1993 to appear in the

More information

ECON2285: Mathematical Economics

ECON2285: Mathematical Economics ECON2285: Mathematical Economics Yulei Luo Economics, HKU September 17, 2018 Luo, Y. (Economics, HKU) ME September 17, 2018 1 / 46 Static Optimization and Extreme Values In this topic, we will study goal

More information

The spectra of super line multigraphs

The spectra of super line multigraphs The spectra of super line multigraphs Jay Bagga Department of Computer Science Ball State University Muncie, IN jbagga@bsuedu Robert B Ellis Department of Applied Mathematics Illinois Institute of Technology

More information

Note On Parikh slender context-free languages

Note On Parikh slender context-free languages Theoretical Computer Science 255 (2001) 667 677 www.elsevier.com/locate/tcs Note On Parikh slender context-free languages a; b; ; 1 Juha Honkala a Department of Mathematics, University of Turku, FIN-20014

More information

ADJUSTED POWER ESTIMATES IN. Ji Zhang. Biostatistics and Research Data Systems. Merck Research Laboratories. Rahway, NJ

ADJUSTED POWER ESTIMATES IN. Ji Zhang. Biostatistics and Research Data Systems. Merck Research Laboratories. Rahway, NJ ADJUSTED POWER ESTIMATES IN MONTE CARLO EXPERIMENTS Ji Zhang Biostatistics and Research Data Systems Merck Research Laboratories Rahway, NJ 07065-0914 and Dennis D. Boos Department of Statistics, North

More information

3. block. BV M. Bökstedt and H. Vosegaard, Notes on point-set topology, electronically available at

3. block. BV M. Bökstedt and H. Vosegaard, Notes on point-set topology, electronically available at Location Department of Mathematical Sciences,, G5-109. Main A T. Apostol, Mathematical Analysis, Addison-Wesley. BV M. Bökstedt and H. Vosegaard, Notes on point-set topology, electronically available at

More information

Stabilization as a CW approximation

Stabilization as a CW approximation Journal of Pure and Applied Algebra 140 (1999) 23 32 Stabilization as a CW approximation A.D. Elmendorf Department of Mathematics, Purdue University Calumet, Hammond, IN 46323, USA Communicated by E.M.

More information

Nonlinear Coordinate Transformations for Unconstrained Optimization I. Basic Transformations

Nonlinear Coordinate Transformations for Unconstrained Optimization I. Basic Transformations Nonlinear Coordinate Transformations for Unconstrained Optimization I. Basic Transformations TIBOR CSENDES Kalmár Laboratory, József Attila University, Szeged, Hungary and TAMÁS RAPCSÁK Computer and Automation

More information

Note Coveringhypercubes by isometric paths

Note Coveringhypercubes by isometric paths Discrete Mathematics 240 (2001) 253 260 www.elsevier.com/locate/disc Note Coveringhypercubes by isometric paths Shannon L. Fitzpatrick a, Richard J. Nowakowski b;, Derek Holton c, Ian Caines b a Acadia

More information

(1.) For any subset P S we denote by L(P ) the abelian group of integral relations between elements of P, i.e. L(P ) := ker Z P! span Z P S S : For ea

(1.) For any subset P S we denote by L(P ) the abelian group of integral relations between elements of P, i.e. L(P ) := ker Z P! span Z P S S : For ea Torsion of dierentials on toric varieties Klaus Altmann Institut fur reine Mathematik, Humboldt-Universitat zu Berlin Ziegelstr. 13a, D-10099 Berlin, Germany. E-mail: altmann@mathematik.hu-berlin.de Abstract

More information

REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS. Eduardo D. Sontag. SYCON - Rutgers Center for Systems and Control

REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS. Eduardo D. Sontag. SYCON - Rutgers Center for Systems and Control REMARKS ON THE TIME-OPTIMAL CONTROL OF A CLASS OF HAMILTONIAN SYSTEMS Eduardo D. Sontag SYCON - Rutgers Center for Systems and Control Department of Mathematics, Rutgers University, New Brunswick, NJ 08903

More information

A note on L convergence of Neumann series approximation in missing data problems

A note on L convergence of Neumann series approximation in missing data problems A note on L convergence of Neumann series approximation in missing data problems Hua Yun Chen Division of Epidemiology & Biostatistics School of Public Health University of Illinois at Chicago 1603 West

More information

Part III. 10 Topological Space Basics. Topological Spaces

Part III. 10 Topological Space Basics. Topological Spaces Part III 10 Topological Space Basics Topological Spaces Using the metric space results above as motivation we will axiomatize the notion of being an open set to more general settings. Definition 10.1.

More information

Long-Run Covariability

Long-Run Covariability Long-Run Covariability Ulrich K. Müller and Mark W. Watson Princeton University October 2016 Motivation Study the long-run covariability/relationship between economic variables great ratios, long-run Phillips

More information

Null controllable region of LTI discrete-time systems with input saturation

Null controllable region of LTI discrete-time systems with input saturation Automatica 38 (2002) 2009 2013 www.elsevier.com/locate/automatica Technical Communique Null controllable region of LTI discrete-time systems with input saturation Tingshu Hu a;, Daniel E. Miller b,liqiu

More information

SMOOTHNESS PROPERTIES OF SOLUTIONS OF CAPUTO- TYPE FRACTIONAL DIFFERENTIAL EQUATIONS. Kai Diethelm. Abstract

SMOOTHNESS PROPERTIES OF SOLUTIONS OF CAPUTO- TYPE FRACTIONAL DIFFERENTIAL EQUATIONS. Kai Diethelm. Abstract SMOOTHNESS PROPERTIES OF SOLUTIONS OF CAPUTO- TYPE FRACTIONAL DIFFERENTIAL EQUATIONS Kai Diethelm Abstract Dedicated to Prof. Michele Caputo on the occasion of his 8th birthday We consider ordinary fractional

More information

A new ane scaling interior point algorithm for nonlinear optimization subject to linear equality and inequality constraints

A new ane scaling interior point algorithm for nonlinear optimization subject to linear equality and inequality constraints Journal of Computational and Applied Mathematics 161 (003) 1 5 www.elsevier.com/locate/cam A new ane scaling interior point algorithm for nonlinear optimization subject to linear equality and inequality

More information

Estimation of the Bivariate and Marginal Distributions with Censored Data

Estimation of the Bivariate and Marginal Distributions with Censored Data Estimation of the Bivariate and Marginal Distributions with Censored Data Michael Akritas and Ingrid Van Keilegom Penn State University and Eindhoven University of Technology May 22, 2 Abstract Two new

More information

A NOTE ON SIMPLE DOMAINS OF GK DIMENSION TWO

A NOTE ON SIMPLE DOMAINS OF GK DIMENSION TWO A NOTE ON SIMPLE DOMAINS OF GK DIMENSION TWO JASON P. BELL Abstract. Let k be a field. We show that a finitely generated simple Goldie k-algebra of quadratic growth is noetherian and has Krull dimension

More information

Classical regularity conditions

Classical regularity conditions Chapter 3 Classical regularity conditions Preliminary draft. Please do not distribute. The results from classical asymptotic theory typically require assumptions of pointwise differentiability of a criterion

More information

Asymptotic behavior for sums of non-identically distributed random variables

Asymptotic behavior for sums of non-identically distributed random variables Appl. Math. J. Chinese Univ. 2019, 34(1: 45-54 Asymptotic behavior for sums of non-identically distributed random variables YU Chang-jun 1 CHENG Dong-ya 2,3 Abstract. For any given positive integer m,

More information

An Adaptive Bayesian Network for Low-Level Image Processing

An Adaptive Bayesian Network for Low-Level Image Processing An Adaptive Bayesian Network for Low-Level Image Processing S P Luttrell Defence Research Agency, Malvern, Worcs, WR14 3PS, UK. I. INTRODUCTION Probability calculus, based on the axioms of inference, Cox

More information

Techinical Proofs for Nonlinear Learning using Local Coordinate Coding

Techinical Proofs for Nonlinear Learning using Local Coordinate Coding Techinical Proofs for Nonlinear Learning using Local Coordinate Coding 1 Notations and Main Results Denition 1.1 (Lipschitz Smoothness) A function f(x) on R d is (α, β, p)-lipschitz smooth with respect

More information

Markov Sonin Gaussian rule for singular functions

Markov Sonin Gaussian rule for singular functions Journal of Computational and Applied Mathematics 169 (2004) 197 212 www.elsevier.com/locate/cam Markov Sonin Gaussian rule for singular functions G.Mastroianni, D.Occorsio Dipartimento di Matematica, Universita

More information

Ideals of Endomorphism rings 15 discrete valuation ring exists. We address this problem in x3 and obtain Baer's Theorem for vector spaces as a corolla

Ideals of Endomorphism rings 15 discrete valuation ring exists. We address this problem in x3 and obtain Baer's Theorem for vector spaces as a corolla 1. Introduction DESCRIBING IDEALS OF ENDOMORPHISM RINGS Brendan Goldsmith and Simone Pabst It is well known that the ring of linear transformations of a nite dimensional vector space is simple, i.e. it

More information

MARKOV CHAINS: STATIONARY DISTRIBUTIONS AND FUNCTIONS ON STATE SPACES. Contents

MARKOV CHAINS: STATIONARY DISTRIBUTIONS AND FUNCTIONS ON STATE SPACES. Contents MARKOV CHAINS: STATIONARY DISTRIBUTIONS AND FUNCTIONS ON STATE SPACES JAMES READY Abstract. In this paper, we rst introduce the concepts of Markov Chains and their stationary distributions. We then discuss

More information

The properties of L p -GMM estimators

The properties of L p -GMM estimators The properties of L p -GMM estimators Robert de Jong and Chirok Han Michigan State University February 2000 Abstract This paper considers Generalized Method of Moment-type estimators for which a criterion

More information

ON TRIVIAL GRADIENT YOUNG MEASURES BAISHENG YAN Abstract. We give a condition on a closed set K of real nm matrices which ensures that any W 1 p -grad

ON TRIVIAL GRADIENT YOUNG MEASURES BAISHENG YAN Abstract. We give a condition on a closed set K of real nm matrices which ensures that any W 1 p -grad ON TRIVIAL GRAIENT YOUNG MEASURES BAISHENG YAN Abstract. We give a condition on a closed set K of real nm matrices which ensures that any W 1 p -gradient Young measure supported on K must be trivial the

More information