arxiv: v1 [stat.co] 23 Jun 2012
|
|
- Phoebe Greer
- 5 years ago
- Views:
Transcription
1 Noname manuscript No. (will be inserte by the eitor) Moments Calculation For the Doubly Truncate Multivariate Normal Density Manjunath B G Stefan Wilhelm arxiv: v1 [stat.co] 23 Jun 2012 This version: Abstract In the present article we erive an explicit expression for the truncate mean an variance for the multivariate normal istribution with arbitrary rectangular ouble truncation. We use the moment generating approach of Tallis (1961) an exten it to general µ, Σ an all combinations of truncation. As part of the solution we also give a formula for the bivariate marginal ensity of truncate multinormal variates. We also prove an invariance property of some elements of the inverse covariance after truncation. Computer algorithms for computing the truncate mean, variance an the bivariate marginal probabilities for oubly truncate multivariate normal variates have been written in R an are presente along with three examples. Keywors multivariate normal; ouble truncation; moment generating function; bivariate marginal ensity function; graphical moels; conitional inepenence Mathematics Subject Classification (2010) 60E05 62H05 B. G. Manjunath CEAUL an DEIO, FCUL, University of Lisbon, Portugal bgmanjunath@gmail.com Stefan Wilhelm Department of Finance, University of Basel, Switzerlan Tel.: Stefan.Wilhelm@stu.unibas.ch
2 2 Manjunath B G, Stefan Wilhelm 1 Introuction The multivariate normal istribution arises frequently an has a wie range of applications in fiels like multivariate regression, Bayesian statistics or the analysis of Brownian motion. One motivation to eal with moments of the truncate multivariate normal istribution comes from the analysis of special financial erivatives ( auto-callables or Expresszertifikate ) in Germany. These proucts can expire early epening on some restrictions of the unerlying trajectory, if the unerlying is above or below certain call levels. In the framework of Brownian motion the finite-imensional istributions for log returns at any points in time are multivariate normal. When some of the multinormal variates X = (x 1,..., x ) N(µ, Σ) are subject to inequality constraints (e.g. a i x i b i ), this results in truncate multivariate normal istributions. Several types of truncations an their moment calculation have been escribe so far, for example the one-sie rectangular truncation x a (Tallis 1961), the rather unusual elliptical an raial truncations a x Rx b (Tallis 1963) an the plane truncation Cx p (Tallis 1965). Linear constraints like a Cx b can often be reuce to rectangular truncation by transformation of the variables (in case of a full rank matrix C : a = C 1 a x C 1 b = b ), which makes the ouble rectangular truncation a x b especially important. The existing works on moment calculations iffer in the number of variables they consier (univariate, bivariate, multivariate) an the types of rectangular truncation they allow (single vs. ouble truncation). Single or onesie truncation can be either from above (x a) or below (x a), but only on one sie for all variables, whereas ouble truncation a x b can have both lower an upper truncations points. Other istinguishing features of previous works are further limitations or restrictions they impose on the type of istribution (e.g. zero mean) an the methos they use to erive the results (e.g. irect integration or moment-generating function). Next, we will briefly outline the line of research. Rosenbaum (1961) gave an explicit formula for the moments of the bivariate case with single truncation from below in both variables by irect integration. His results for the bivariate normal istribution have been extene by Shah an Parikh (1964), Regier an Haman (1971) an Muthén (1990) to ouble truncation. For the multivariate case, Tallis (1961) erive an explicit expression for the first two moments in case of a singly truncate multivariate normal ensity with zero mean vector an the correlation matrix R using the moment generating function. Amemiya (1974) an Lee (1979) extene the Tallis (1961) erivation to a general covariance matrix Σ an also evaluate the relationship between the first two moments. Gupta an Tracy (1976) an Lee (1983) gave very simple recursive relationships between moments of any orer for the oubly truncate case. But since except for the mean there are fewer equations than parameters, these recurrent conitions o not uniquely ientify
3 Moments Calculation For the Doubly Truncate Multivariate Normal Density 3 Table 1 Survey of previous works on the moments for the truncate multivariate normal istribution Author #Variates Truncation Focus Rosenbaum (1961) bivariate single moments for bivariate normal variates with single truncation, b 1 < y 1 <, b 2 < y 2 < Tallis (1961) multivariate single moments for multivariate normal variates with single truncation from below Shah an Parikh (1964) bivariate ouble recurrence relations between moments Regier an Haman (1971) bivariate ouble an explicit formula only for the case of truncation from below at the same point in both variables Amemiya (1974) multivariate single relationship between first an secon moments Gupta an Tracy (1976) multivariate ouble recurrence relations between moments Lee (1979) multivariate single recurrence relations between moments Lee (1983) multivariate ouble recurrence relations between moments Leppar an Tallis (1989) multivariate single moments for multivariate normal istribution with single truncation Muthén (1990) bivariate ouble moments for bivariate normal istribution with ouble truncation, b 1 < y 1 < a 1, b 2 < y 2 < a 2 Manjunath/Wilhelm multivariate ouble moments for multivariate normal istribution with ouble truncation in all variables a x b moments of orer 2 an are therefore not sufficient for the computation of the variance an other higher orer moments. Table 1 summarizes our survey of existing publications ealing with the computation of truncate moments an their limitations. Even though the rectangular truncation a x b can be foun in many situations, no explicit moment formulas for the truncate mean an variance in the general multivariate case of ouble truncation from below an/or above have been presente so far in the literature an are reaily apparent. The contribution of this paper is to erive these formulas for the first two truncate moments an to exten an generalize existing results on moment calculations from especially Tallis (1961); Lee (1983); Leppar an Tallis (1989); Muthén (1990). The remainer of this paper is organize as follows. Section 2 presents the moment generating function (m.g.f) for the oubly truncate multivariate normal case. In Section 3 we erive the first an secon moments by ifferentiating the m.g.f. These results are complete in Section 4 by giving a formula for computing the bivariate marginal ensity. In Section 5 we present two numerical examples an compare our results with simulation results. Section 6 links our results to the theory of graphical moels an erives some properties of the inverse covariance matrix. Finally, Section 7 summarizes our results an gives an outlook for further research.
4 4 Manjunath B G, Stefan Wilhelm 2 Moment Generating Function The imensional normal ensity with location parameter vector µ R an non-singular covariance matrix Σ is given by { 1 ϕ µ,σ (x) = (2π) /2 exp 1 } Σ 1/2 2 (x µ) Σ 1 (x µ), x R. (1) The pertaining istribution function is enote by Φ µ,σ (x). Corresponingly, the multivariate truncate normal ensity, truncate at a an b, in R, is efine as ϕ µ,σ (x), for a x b, ϕ αµ,σ (x) = P{a X b} (2) 0, otherwise. Denote α = P{a X b} as the fraction after truncation. The moment generating function (m.g.f) of a imensional truncate ranom variable X, truncate at a an b, in R, having the ensity f(x) is efine as the fol integral of the form ( m(t) = E e t X ) b = x a et f(x)x. Therefore, the m.g.f for the ensity in (2) is m(t) = 1 b { α(2π) /2 Σ 1/2 a exp 1 [ (x µ) Σ 1 (x µ) 2t x] } x. (3) 2 In the following, the moments are first erive for the special case µ = 0. Later, the results will be generalize to all µ by applying a location transformation. Now, consier only the exponent term in (3) for the case µ = 0. Then we have 1 [ ] x Σ 1 x 2t x 2 which can also be written as where ξ = Σt. 1 2 t Σt 1 2 [ ] (x ξ) Σ 1 (x ξ), Consequently, the m.g.f of the rectangularly oubly truncate multivariate normal is e m(t) = T b { α(2π) /2 Σ 1/2 a exp 1 [ (x ξ) Σ (x ξ)] } 1 x, (4) 2
5 Moments Calculation For the Doubly Truncate Multivariate Normal Density 5 where T = 1 2 t Σt. The above equation can be further reuce to e m(t) = T b ξ { α(2π) /2 Σ 1/2 a ξ exp 1 } 2 x Σ 1 x For notational convenience, we write equation (5) as x. (5) m(t) = e T Φ ασ (6) where Φ ασ = 1 b ξ { α(2π) /2 Σ 1/2 a ξ exp 1 } 2 x Σ 1 x x. 3 First An Secon Moment Calculation In this section we erive the first an secon moments of the rectangularly oubly truncate multivariate normal ensity by ifferentiating the m.g.f.. Consequently, by taking the partial erivative of (6) with respect to t i we have m(t) t i = e T Φ ασ t i + Φ ασ e T t i. (7) In the above equation the only essential terms which will be simplifie are an Φ ασ t i e T t i = e T k=1 σ i,k t k = b 1 b... ϕ ασ (x)x t...x 1, (8) i a1 a where a i = a i k=1 σ i,kt k an b i = b i k=1 σ i,kt k. Subsequently, (8) is where Φ ασ = t i σ i,k (F k (a k ) F k(bk )), (9) k=1 F i (x) = b 1 a 1... b i 1 b i+1 a i 1 a i+1... b a ϕ ασ (x 1,.., x i 1, x, x i+1,..x )x...x i+1 x i 1...x 1. (10)
6 6 Manjunath B G, Stefan Wilhelm Note that at t k = 0, for all k = 1, 2,...,, we have a i = a i an b i = b i. Therefore, F i (x) will be the i th marginal ensity. An especially convenient way of computing these one-imensional marginals is given in Cartinhour (1990). From (7) (9) for k = 1, 2,..., all t k = 0. Hence, the first moment is E(X i ) = m(t) t t=0 = i σ i,k (F k (a k ) F k (b k )). (11) k=1 Now, by taking the partial erivative of (7) with respect to t j, we have 2 m(t) t j t i = e T 2 Φ ασ t j t i + Φ ασ t i e T t j + Φ ασ 2 e T t j t i + et t i Φ ασ t j. (12) The essential terms for simplification are 2 e T t j t i = σ i,j an clearly, the partial erivative of (9) with respect to t j gives ( 2 Φ ασ F k (a = t j t i k σ ) ) ( F k (bk i,k t k=1 j σ ) ) i,k. (13) t k=1 j In the above equation merely consier the partial erivative of the marginal ensity F k (a k ) with respect to t j. With further simplification it reuces to F k (a k ) t j = b 1 b k 1 b k+1 b ϕ ασ (x 1,.., x t k 1, a j a1 a a k 1 a k+1 k, x k+1,..x )x k = σ j,ka k F k(a k ) + q =k σ k,k ( σ j,q σ k,qσ j,k σ k,k ) ( ) F k,q(a k, a q) F k,q (a k, b q), (14) where F k,q (x, y) = b 1... a 1 b k 1 b k+1 a k 1 a k+1 b q 1 b q+1 b ϕ ασ (x, y, x k, q )x k, q, (15) a q 1 a q+1 a an the short form x k enotes the vector (x 1,.., x k 1, x k+1,..x ) in ( 1) imensions an x k, q enotes the ( 2) imensional vector (x 1,..., x k 1, x k+1,..., x q 1, x q+1,..., x ) for k = q. The above equation (14) is euce from Lee (1979), pp Note that for all t k = 0 the term F k,q (x, y) will be the bivariate marginal ensity for which we will give a formula in the next section.
7 Moments Calculation For the Doubly Truncate Multivariate Normal Density 7 Subsequently, F k(bk ) t can be obtaine by substituting a j k by b k. From (12) (15) at all t k = 0, k = 1, 2,...,, the secon moment is E(X i X j ) = 2 m(t) t j t i t=0 = σ i,j + + k=1 k=1 σ i,k σ j,k (a k F k (a k ) b k F k (b k )) σ i,k q =k σ k,k ( σ j,q σ k,qσ j,k σ k,k ( F k,q (b k, a q ) F k,q (b k, b q ) ) [( F k,q(a k, a q ) F k,q(a k, b q )) )]. (16) Having erive expressions for the first an secon moments for ouble truncation in case of µ = 0, we will now generalize to all µ: if Y N(µ, Σ) with a y b, then X = Y µ N(0, Σ) with a = a µ x b µ = b an E(Y) = E(X)+µ an Cov(Y) = Cov(X). Equations (11) an (16) can then be use to compute E(X) an Cov(X). Hence, for general µ, the first moment is The covariance matrix E(Y i ) = σ i,k (F k (a k ) F k (b k ))+µ i. (17) k=1 Cov(Y i, Y j ) = Cov(X i, X j ) = E(X i X j ) E(X i )E(X j ) (18) is invariant to the shift in location. The equations (17) an (18) in combination with (11) an (16) form our esire result an allow the calculation of the truncate mean an truncate variance for general ouble truncation. A formula for the term F k,q (x k, x q ), the bivariate marginal ensity, will be given in the next section. We have implemente the moment calculation for mean vectormean, covariance matrixsigma an truncation vectorslower anupper as a function mtmvnorm(mean, sigma, lower, upper) in the R package tmvtnorm (Wilhelm an Manjunath 2010a;?), where the coe is open source. In Section 5 we show a usage example for this function. 4 Bivariate Marginal Density Computation In orer to compute the bivariate marginal ensity in this section we mainly follow Tallis (1961), p. 223 an Leppar an Tallis (1989) who implicitly use the bivariate marginal ensity as part of the moments calculation for single truncation, evaluate at the integration bouns. However, we exten it to the
8 8 Manjunath B G, Stefan Wilhelm oubly truncate case an state the function for all points within the support region. Without loss of generality we use a z-transformation for all variates x = (x 1,..., x ) as well as for all lower an upper truncation points a = (a 1,..., a ) an b = (b 1,..., b ), resulting in a N(0, R) istribution with correlation matrix R for the stanarize untruncate variates. In this section we treat all variables as if they are z-transforme, leaving the notation unchange. For computing the bivariate marginal ensity F q,r (x q, x r ) with a q x q b q, a r x r b r, q = r, we use the fact that for truncate normal ensities the conitional ensities are truncate normal again. The following relationship hols for x s, z s R 2 if we conition on x q = c q an x r = c r (s = q = r): α 1 ϕ (x s, x q = c q, x r = c r ; R) = α 1 ϕ(c q, c r ; ρ qr )ϕ 2 (z s ; R qr ), (19) where z s = (x s β sq.r c q β sr.q c r )/ (1 ρ 2 sq)(1 ρ 2 sr.q) (20) an R qr is the matrix of secon-orer partial correlation coefficients for s = q = r. β sq.r an β sr.q are the partial regression coefficients of x s on x q an x r respectively an ρ sr.q is the partial correlation coefficient between x s an x r for fixe x q. Integrating out( 2) variables x s leas to F q,r (x q, x r ) as a prouct of a bivariate normal ensity ϕ(x q, x r ) an a( 2)-imension normal integral Φ 2 : b1 F q,r (x q = c q, x r = c r ) =... a 1 br+1... a r+1 bq 1 a q 1 b a bq+1 br 1... a q+1 a r 1 ϕ αr (x s, c q, c r )x s = α 1 ϕ(c q, c r ; ρ qr )Φ 2 (A q rs; B q rs; R qr ) (21) where Ars q an Brs q enote the lower an upper integration bouns of Φ 2 given x q = c q an x r = c r : Ars q = (a s β sq.r c q β sr.q c r )/ (1 ρ 2 sq)(1 ρ 2 sr.q) (22) Brs q = (b s β sq.r c q β sr.q c r )/ (1 ρ 2 sq)(1 ρ 2 sr.q). (23) The computation of F q,r (x q, x r ) just nees the evaluation of the normal integral Φ 2 in 2 imensions, which is reaily available in most statistics software packages, for example as the function pmvnorm() in the R package mvtnorm (?). The bivariate marginal ensity function tmvnorm(x, mean, sigma, lower, upper, margin=c(q,r)) is also part of the R package tmvtnorm (Wilhelm an Manjunath 2010a;?), where reaers can fin the source coe as well as help files an aitional examples.
9 Moments Calculation For the Doubly Truncate Multivariate Normal Density 9 bivariate marginal ensity (x 1,x 2 ) x x 1 Fig. 1 Contour plot for the bivariate truncate ensity function Marginal ensity x 1 Marginal ensity x 2 Density Density x 1 x 2 Fig. 2 Marginal ensities F k (x) (k = 1, 2) for x 1 an x 2 obtaine from Kernel ensity estimation of ranom samples an from irect evaluation of F k (x) 5 Numerical Examples 5.1 Example 1 We will use the following bivariate example with µ = (0.5, 0.5) an covariance matrix Σ ( ) Σ = as well as lower an upper truncation points a = ( 1, ), b = (0.5, 1), i.e. x 1 is oubly, while x 2 is singly truncate. The bivariate marginal ensity F q,r (x, y) is the ensity function itself an is shown in figure 1, the oneimensional ensities F k (x) (k = 1, 2) in figure 2. The moment calculation for our example can be performe in R as
10 10 Manjunath B G, Stefan Wilhelm Monte Carlo estimator for µ^1 Monte Carlo estimator for µ^2 µ^ theoretical value 95% MC confience interval µ^ theoretical value 95% MC confience interval sample size sample size Fig. 3 Trace plots of the Monte Carlo estimator for µ > library(tmvtnorm) > mu <- c(0.5, 0.5) > sigma <- matrix(c(1, 1.2, 1.2, 2), 2, 2) > a <- c(-1, -Inf) > b <- c(0.5, 1) > moments <- mtmvnorm(mean=mu, sigma=sigma, > lower=a, upper=b) an results in µ = ( 0.152, 0.388) an covariance matrix Σ = ( ) The trace plots in figures 3 an 4 show the evolution of a Monte Carlo estimate for the elements of the mean vector an the covariance matrix respectively for growing sample sizes. Furthermore, the 95% confience interval obtaine from Monte Carlo using the full sample of items is shown. All confience intervals contain the true theoretical value, but Monte Carlo estimates still show substantial variation even with a sample size of Simulation from a truncate multivariate istribution an calculating the sample mean or the sample covariance respectively also leas to consistent estimates of µ an Σ. Since the rate of convergence of the MC estimator is O( n), one has to ensure sufficient Monte Carlo iterations in orer to have a goo approximation or to choose variance reuction techniques.
11 Moments Calculation For the Doubly Truncate Multivariate Normal Density 11 Monte Carlo estimator for Cov(x 1, x 1) Monte Carlo estimator for Cov(x 1, x 2) Monte Carlo estimator for Cov(x 2, x 2) Cov(x1, x1) theoretical value Cov(x1, x2) theoretical value Cov(x2, x2) theoretical value sample size sample size sample size Fig. 4 Trace plots of the Monte Carlo estimator for the 3 elements of Σ (σ 11, σ 12 = σ 21 an σ 22 ) 5.2 Example 2 Let µ = (0, 0, 0),the covariance matrix Σ = an the lower an upper truncation points a = ( 1,, ) an b = (0.5,, ), then the only truncate variable is x 1, which is furthermore uncorrelate with x 3. Our formula results in µ = c( 0.210, 0.229, 0) an Σ = For this special case of only k < truncate variables(x 1,..., x k ), the remaining k variables(x k+1,..., x ) can be regresse on the truncate variables, an a simple formula for the mean an covariance matrix can be given (see Johnson an Kotz (1971), p. 70). Let the covariance matrix Σ of(x 1,..., x ) be partitione as Σ = ( ) V11 V 12 V 21 V 22 (24)
12 12 Manjunath B G, Stefan Wilhelm where V 11 enotes the k k covariance matrix of (x 1,..., x k ). The mean vector 1 an the covariance matrix Σ of all variables can be compute as an ( Σ = U 11 (ξ 1, ξ 1 V 1 11 V 12) (25) U 11 V 1 11 V 12 V 21 V 1 11 U 11 V 22 V 21 (V 1 11 V 1 11 U 11V 1 11 )V 12 where ξ 1 an U 11 are the mean an covariance of the (x 1,..., x k ) after truncation. The mean an stanar eviation for the univariate truncate normal x 1 are ξ 1 = µ 1 = σ ϕ µ1,σ 11 (a 1 ) ϕ µ1,σ 11 (b 1 ) 11 Φ µ1,σ 11 (b 1 ) Φ µ1,σ 11 (a 1 ) σ 11 = σ 11+σ 11 a 1 ϕ µ1,σ 11 (a 1 ) b 1 ϕ µ1,σ 11 (b 1 ) Φ µ1,σ 11 (b 1 ) Φ µ1,σ 11 (a 1 ) Letting U 11 = σ 11 an inserting ξ 1 an U 11 into equations (25) an (26), one can verify our formula an the results for µ an Σ. However, the crux in using the Johnson/Kotz formula is the nee to first compute the moments of the truncate variables (x 1,..., x k ) for k 2. But this has been exactly the subject of our paper. ) (26) 6 Moment Calculation an Conitional Inepenence In this section we establish a link between our moment calculation an the theory of graphical moels (Whittaker (1990), Ewars (1995) an Lauritzen (1996)). We present some properties of the inverse covariance matrix an show how the epenence structure of variables is affecte after selection. Graphical moelling uses graphical representations of variables as noes in a graph an epenencies among them as eges. A key concept in graphical moelling is the conitional inepenence property. Two variables X an Y are conitional inepenent given a variable or a set of variables Z (notation X Y Z), when X an Y are inepenent after partialling out the effect of Z. For conitional inepenent X an Y the ege between them in the graph is omitte an the joint ensity factorizes as f(x, y z) = f(x z) f(y z). Conitional inepenence is equivalent to having zero elements Ω xy in the inverse covariance matrix Ω = Σ 1 as well as having a zero partial covariance/correlation between X an Y given the remaining variables: X Y Rest Ω xy = 0 ρ xy.rest = 0 1 The formula for the truncate mean given in Johnson an Kotz (1971), p. 70 is only vali for a zero-mean vector or after emeaning all variables appropriately. For non-zero means µ = (µ 1, µ 2 ) it will be(ξ 1, µ 2 +(ξ 1 µ 1 )V 1 11 V 12).
13 Moments Calculation For the Doubly Truncate Multivariate Normal Density 13 Both marginal inepenence an conitional inepenence between variables simplify the computations of the truncate covariance in equation (16). In the presence of conitional inepenence of i an j given q, the terms σ ij σ iq σqq 1σ qj = 0 vanish as they reflect the partial covariance of i an j given q. As has been shown by Marchetti an Stanghellini (2008), the conitional inepenence property is preserve after selection, i.e. the inverse covariance matrices Ω an Ω before an after truncation share the same zero-elements. We prove that many elements of the precision matrix are invariant to truncation. For the case of k < truncate variables, we efine the set of truncate variables with T = {x 1,..., x k }, an the remaining k variables as S = {x k+1,..., x }. We can show that the off-iagonal elements Ω i,j are invariant after truncation for i T S an j S: Proposition 6.1. The off-iagonal elements Ω i,j an the iagonal elements Ω j,j are invariant after truncation for i T S an j S. Proof. The proof is a irect application of the Johnson/Kotz formula in equation (26) in the previous section. As a result of the formula for partitione inverse matrices (Greene (2003), section A.5.3), the corresponing inverse covariance matrix Ω of the partitione covariance matrix Σ is ( V 1 Ω = 11 (I+V 12F 2 V 21 V11 1) V 1 11 V ) 12F 2 F 2 V 21 V11 1 (27) F 2 with F 2 = (V 22 V 21 V 1 11 V 12) 1. Inverting the truncate covariance matrix Σ in equation (26) using the formula for the partitione inverse leas to the truncate precision matrix ( Ω U 1 = 11 + V 1 11 V 12F 2 V 21 V11 1 V11 1 V ) 12F 2 F 2 V 21 V11 1 (28) F 2 where the Ω12 an Ω 21 elements are the same as Ω 12 an Ω 21 respectively. The same is true for the elements in Ω22, especially the iagonal elements in Ω22. Here, we prove this invariance property only for a subset of truncate variables. Base on our experiments we conjecture that the same is true also for the case of full truncation (i.e. all off-iagonal elements in Ω11 ), but we o not give a rigorous proof here an leave it to future research. 6.1 Example 3 We illustrate the invariance of the elements of the inverse covariance matrix with the famous mathematics marks example use in Whittaker (1990) an Ewars (1995), p. 49. The inepenence graph of the five variables(w, V, X,
14 14 Manjunath B G, Stefan Wilhelm Y, Z) in this example takes the form of a butterfly. vectors (W) statistics (Z) algebra (X) mechanics (V) analysis (Y) Here, we have the conitional inepenencies (W, V) (Y, Z) X. A corresponing precision matrix might look like (sample ata; zero-elements marke as. ): Ω = After truncation in some variables (for example(w, V, X) as 2 W 1, 1 V 1, 0 X 1), we apply equation (16) to compute the truncate secon moment an the inverse covariance matrix as: (29) Ω = (30) The precision matrix Ω after selection iffers from Ω only in the iagonal elements of(w, V, X). From Ω we can rea how partial correlations between variables have change ue to the selection process. Each iagonal element Ω yy of the precision matrix is the inverse of the partial variance after regressing on all other variables (Whittaker (1990),p. 143). Since only those iagonal elements in the precision matrix for the k of the truncate variables will change after selection, this leas to the iea to just compute these k elements after selection rather than the full k(k + 1)/2 symmetric elements in the truncate covariance matrix an applying the Johnson/Kotz formula for the remaining k variables. However, the inverse partial variance of a scalar Y given the remaining variables X = {x 1,..., x }\ y [ ] 1 [ ] 1 Ω yy = Σ y.x = Σ yy Σ yx Σ 1 XX Σ Xy still requires the truncate covariance results erive in Section 3.
15 Moments Calculation For the Doubly Truncate Multivariate Normal Density 15 7 Summary In this paper we erive a formula for the first an secon moments of the oubly truncate multivariate normal istribution an for their bivariate marginal ensity. An implementation for both formulas has been mae available in the R statistics software as part of the tmvtnorm package. We linke our results to the theory of graphical moels an prove an invariance property for elements of the precision matrix. Further research can eal with other types of truncation than we consiere (e.g. elliptical). Another line of research can look at the moments of the oubly truncate multivariate Stuent-t istribution, which contains the truncate multivariate normal istribution as a special case. References Amemiya T (1974) Multivariate regression an simultaneous equations moels when the epenent variables are truncate normal. Econometrica 42: Cartinhour J (1990) One-imensional marginal ensity functions of a truncate multivariate normal ensity function. Communications in Statistics - Theory an Methos 19: Ewars D (1995) Introuction to graphical moelling. Springer Genz A, Bretz F, Miwa T, Mi X, Leisch F, Scheipl F, Hothorn T (2010) mvtnorm: Multivariate normal an t istributions. URL R package version Greene WH (2003) Econometric Analysis, 5th en. Prentice-Hall Gupta AK, Tracy DS (1976) Recurrence relations for the moments of truncate multinormal istribution. Communications in Statistics - Theory an Methos 5(9): Johnson NL, Kotz S (1971) Distributions in Statistics: Continuous Multivariate Distributions. John Wiley & Sons Lauritzen S (1996) Graphical Moels. Oxfor University Press Lee LF (1979) On the first an secon moments of the truncate multi-normal istribution an a simple estimator. Economics Letters 3: Lee LF (1983) The etermination of moments of the oubly truncate multivariate tobit moel. Economics Letters 11: Leppar P, Tallis GM (1989) Algorithm AS 249: Evaluation of the mean an covariance of the truncate multinormal istribution. Applie Statistics 38: Marchetti GM, Stanghellini E (2008) A note on istortions inuce by truncation with applications to linear regression systems. Statistics & Probability Letters 78: Muthén B (1990) Moments of the censore an truncate bivariate normal istribution. British Journal of Mathematical an Statistical Psychology 43: Regier MH, Haman MA (1971) Correlation in a bivariate normal istribution with truncation in both variables. Australian Journal of Statistics 13:77 82 Rosenbaum S (1961) Moments of a truncate bivariate normal istribution. Journal of the Royal Statistical Society Series B (Methoological) 23: Shah SM, Parikh NT (1964) Moments of single an oubly truncate stanar bivariate normal istribution. Viya (Gujarat University) 7:82 91 Tallis GM (1961) The moment generating function of the truncate multinormal istribution. Journal of the Royal Statistical Society, Series B (Methoological) 23(1): Tallis GM (1963) Elliptical an raial truncation in normal populations. The Annals of Mathematical Statistics 34(3): Tallis GM (1965) Plane truncation in normal populations. Journal of the Royal Statistical Society, Series B (Methoological) 27(2): Whittaker J (1990) Graphical moels in applie multivariate statistics. John Wiley & Sons
16 16 Manjunath B G, Stefan Wilhelm Wilhelm S, Manjunath BG (2010a) tmvtnorm: A Package for the Truncate Multivariate Normal Distribution. The R Journal 2(1):25 29, URL Wilhelm S, Manjunath BG (2010b) tmvtnorm: Truncate multivariate normal istribution an Stuent t istribution. URL R package version 1.1-5
A note on asymptotic formulae for one-dimensional network flow problems Carlos F. Daganzo and Karen R. Smilowitz
A note on asymptotic formulae for one-imensional network flow problems Carlos F. Daganzo an Karen R. Smilowitz (to appear in Annals of Operations Research) Abstract This note evelops asymptotic formulae
More informationLeast-Squares Regression on Sparse Spaces
Least-Squares Regression on Sparse Spaces Yuri Grinberg, Mahi Milani Far, Joelle Pineau School of Computer Science McGill University Montreal, Canaa {ygrinb,mmilan1,jpineau}@cs.mcgill.ca 1 Introuction
More informationRobust Forward Algorithms via PAC-Bayes and Laplace Distributions. ω Q. Pr (y(ω x) < 0) = Pr A k
A Proof of Lemma 2 B Proof of Lemma 3 Proof: Since the support of LL istributions is R, two such istributions are equivalent absolutely continuous with respect to each other an the ivergence is well-efine
More informationExpected Value of Partial Perfect Information
Expecte Value of Partial Perfect Information Mike Giles 1, Takashi Goa 2, Howar Thom 3 Wei Fang 1, Zhenru Wang 1 1 Mathematical Institute, University of Oxfor 2 School of Engineering, University of Tokyo
More informationJointly continuous distributions and the multivariate Normal
Jointly continuous istributions an the multivariate Normal Márton alázs an álint Tóth October 3, 04 This little write-up is part of important founations of probability that were left out of the unit Probability
More informationarxiv: v4 [math.pr] 27 Jul 2016
The Asymptotic Distribution of the Determinant of a Ranom Correlation Matrix arxiv:309768v4 mathpr] 7 Jul 06 AM Hanea a, & GF Nane b a Centre of xcellence for Biosecurity Risk Analysis, University of Melbourne,
More informationQuantile function expansion using regularly varying functions
Quantile function expansion using regularly varying functions arxiv:705.09494v [math.st] 9 Aug 07 Thomas Fung a, an Eugene Seneta b a Department of Statistics, Macquarie University, NSW 09, Australia b
More informationComputing Exact Confidence Coefficients of Simultaneous Confidence Intervals for Multinomial Proportions and their Functions
Working Paper 2013:5 Department of Statistics Computing Exact Confience Coefficients of Simultaneous Confience Intervals for Multinomial Proportions an their Functions Shaobo Jin Working Paper 2013:5
More informationSome Examples. Uniform motion. Poisson processes on the real line
Some Examples Our immeiate goal is to see some examples of Lévy processes, an/or infinitely-ivisible laws on. Uniform motion Choose an fix a nonranom an efine X := for all (1) Then, {X } is a [nonranom]
More informationA simple tranformation of copulas
A simple tranformation of copulas V. Durrleman, A. Nikeghbali & T. Roncalli Groupe e Recherche Opérationnelle Créit Lyonnais France July 31, 2000 Abstract We stuy how copulas properties are moifie after
More informationmodel considered before, but the prey obey logistic growth in the absence of predators. In
5.2. First Orer Systems of Differential Equations. Phase Portraits an Linearity. Section Objective(s): Moifie Preator-Prey Moel. Graphical Representations of Solutions. Phase Portraits. Vector Fiels an
More informationLinear First-Order Equations
5 Linear First-Orer Equations Linear first-orer ifferential equations make up another important class of ifferential equations that commonly arise in applications an are relatively easy to solve (in theory)
More informationLeast Distortion of Fixed-Rate Vector Quantizers. High-Resolution Analysis of. Best Inertial Profile. Zador's Formula Z-1 Z-2
High-Resolution Analysis of Least Distortion of Fixe-Rate Vector Quantizers Begin with Bennett's Integral D 1 M 2/k Fin best inertial profile Zaor's Formula m(x) λ 2/k (x) f X(x) x Fin best point ensity
More informationIntroduction to the Vlasov-Poisson system
Introuction to the Vlasov-Poisson system Simone Calogero 1 The Vlasov equation Consier a particle with mass m > 0. Let x(t) R 3 enote the position of the particle at time t R an v(t) = ẋ(t) = x(t)/t its
More informationTime-of-Arrival Estimation in Non-Line-Of-Sight Environments
2 Conference on Information Sciences an Systems, The Johns Hopkins University, March 2, 2 Time-of-Arrival Estimation in Non-Line-Of-Sight Environments Sinan Gezici, Hisashi Kobayashi an H. Vincent Poor
More informationLogarithmic spurious regressions
Logarithmic spurious regressions Robert M. e Jong Michigan State University February 5, 22 Abstract Spurious regressions, i.e. regressions in which an integrate process is regresse on another integrate
More information1. Aufgabenblatt zur Vorlesung Probability Theory
24.10.17 1. Aufgabenblatt zur Vorlesung By (Ω, A, P ) we always enote the unerlying probability space, unless state otherwise. 1. Let r > 0, an efine f(x) = 1 [0, [ (x) exp( r x), x R. a) Show that p f
More informationSome vector algebra and the generalized chain rule Ross Bannister Data Assimilation Research Centre, University of Reading, UK Last updated 10/06/10
Some vector algebra an the generalize chain rule Ross Bannister Data Assimilation Research Centre University of Reaing UK Last upate 10/06/10 1. Introuction an notation As we shall see in these notes the
More informationApplications of the Wronskian to ordinary linear differential equations
Physics 116C Fall 2011 Applications of the Wronskian to orinary linear ifferential equations Consier a of n continuous functions y i (x) [i = 1,2,3,...,n], each of which is ifferentiable at least n times.
More informationModelling and simulation of dependence structures in nonlife insurance with Bernstein copulas
Moelling an simulation of epenence structures in nonlife insurance with Bernstein copulas Prof. Dr. Dietmar Pfeifer Dept. of Mathematics, University of Olenburg an AON Benfiel, Hamburg Dr. Doreen Straßburger
More informationBivariate distributions characterized by one family of conditionals and conditional percentile or mode functions
Journal of Multivariate Analysis 99 2008) 1383 1392 www.elsevier.com/locate/jmva Bivariate istributions characterize by one family of conitionals an conitional ercentile or moe functions Barry C. Arnol
More informationEuler equations for multiple integrals
Euler equations for multiple integrals January 22, 2013 Contents 1 Reminer of multivariable calculus 2 1.1 Vector ifferentiation......................... 2 1.2 Matrix ifferentiation........................
More informationLower Bounds for the Smoothed Number of Pareto optimal Solutions
Lower Bouns for the Smoothe Number of Pareto optimal Solutions Tobias Brunsch an Heiko Röglin Department of Computer Science, University of Bonn, Germany brunsch@cs.uni-bonn.e, heiko@roeglin.org Abstract.
More informationLecture Introduction. 2 Examples of Measure Concentration. 3 The Johnson-Lindenstrauss Lemma. CS-621 Theory Gems November 28, 2012
CS-6 Theory Gems November 8, 0 Lecture Lecturer: Alesaner Mąry Scribes: Alhussein Fawzi, Dorina Thanou Introuction Toay, we will briefly iscuss an important technique in probability theory measure concentration
More informationTHE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE
Journal of Soun an Vibration (1996) 191(3), 397 414 THE VAN KAMPEN EXPANSION FOR LINKED DUFFING LINEAR OSCILLATORS EXCITED BY COLORED NOISE E. M. WEINSTEIN Galaxy Scientific Corporation, 2500 English Creek
More informationChapter 2 Lagrangian Modeling
Chapter 2 Lagrangian Moeling The basic laws of physics are use to moel every system whether it is electrical, mechanical, hyraulic, or any other energy omain. In mechanics, Newton s laws of motion provie
More information6 General properties of an autonomous system of two first order ODE
6 General properties of an autonomous system of two first orer ODE Here we embark on stuying the autonomous system of two first orer ifferential equations of the form ẋ 1 = f 1 (, x 2 ), ẋ 2 = f 2 (, x
More informationMonotonicity for excited random walk in high dimensions
Monotonicity for excite ranom walk in high imensions Remco van er Hofsta Mark Holmes March, 2009 Abstract We prove that the rift θ, β) for excite ranom walk in imension is monotone in the excitement parameter
More informationQuantum Mechanics in Three Dimensions
Physics 342 Lecture 20 Quantum Mechanics in Three Dimensions Lecture 20 Physics 342 Quantum Mechanics I Monay, March 24th, 2008 We begin our spherical solutions with the simplest possible case zero potential.
More informationState-Space Model for a Multi-Machine System
State-Space Moel for a Multi-Machine System These notes parallel section.4 in the text. We are ealing with classically moele machines (IEEE Type.), constant impeance loas, an a network reuce to its internal
More informationLATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION
The Annals of Statistics 1997, Vol. 25, No. 6, 2313 2327 LATTICE-BASED D-OPTIMUM DESIGN FOR FOURIER REGRESSION By Eva Riccomagno, 1 Rainer Schwabe 2 an Henry P. Wynn 1 University of Warwick, Technische
More informationTutorial on Maximum Likelyhood Estimation: Parametric Density Estimation
Tutorial on Maximum Likelyhoo Estimation: Parametric Density Estimation Suhir B Kylasa 03/13/2014 1 Motivation Suppose one wishes to etermine just how biase an unfair coin is. Call the probability of tossing
More informationTable of Common Derivatives By David Abraham
Prouct an Quotient Rules: Table of Common Derivatives By Davi Abraham [ f ( g( ] = [ f ( ] g( + f ( [ g( ] f ( = g( [ f ( ] g( g( f ( [ g( ] Trigonometric Functions: sin( = cos( cos( = sin( tan( = sec
More informationLecture XII. where Φ is called the potential function. Let us introduce spherical coordinates defined through the relations
Lecture XII Abstract We introuce the Laplace equation in spherical coorinates an apply the metho of separation of variables to solve it. This will generate three linear orinary secon orer ifferential equations:
More informationProblem Sheet 2: Eigenvalues and eigenvectors and their use in solving linear ODEs
Problem Sheet 2: Eigenvalues an eigenvectors an their use in solving linear ODEs If you fin any typos/errors in this problem sheet please email jk28@icacuk The material in this problem sheet is not examinable
More informationParameter estimation: A new approach to weighting a priori information
Parameter estimation: A new approach to weighting a priori information J.L. Mea Department of Mathematics, Boise State University, Boise, ID 83725-555 E-mail: jmea@boisestate.eu Abstract. We propose a
More informationImplicit Differentiation
Implicit Differentiation Thus far, the functions we have been concerne with have been efine explicitly. A function is efine explicitly if the output is given irectly in terms of the input. For instance,
More informationREAL ANALYSIS I HOMEWORK 5
REAL ANALYSIS I HOMEWORK 5 CİHAN BAHRAN The questions are from Stein an Shakarchi s text, Chapter 3. 1. Suppose ϕ is an integrable function on R with R ϕ(x)x = 1. Let K δ(x) = δ ϕ(x/δ), δ > 0. (a) Prove
More informationAgmon Kolmogorov Inequalities on l 2 (Z d )
Journal of Mathematics Research; Vol. 6, No. ; 04 ISSN 96-9795 E-ISSN 96-9809 Publishe by Canaian Center of Science an Eucation Agmon Kolmogorov Inequalities on l (Z ) Arman Sahovic Mathematics Department,
More informationMonte Carlo Methods with Reduced Error
Monte Carlo Methos with Reuce Error As has been shown, the probable error in Monte Carlo algorithms when no information about the smoothness of the function is use is Dξ r N = c N. It is important for
More informationGaussian processes with monotonicity information
Gaussian processes with monotonicity information Anonymous Author Anonymous Author Unknown Institution Unknown Institution Abstract A metho for using monotonicity information in multivariate Gaussian process
More informationHyperbolic Moment Equations Using Quadrature-Based Projection Methods
Hyperbolic Moment Equations Using Quarature-Base Projection Methos J. Koellermeier an M. Torrilhon Department of Mathematics, RWTH Aachen University, Aachen, Germany Abstract. Kinetic equations like the
More informationLecture 6 : Dimensionality Reduction
CPS290: Algorithmic Founations of Data Science February 3, 207 Lecture 6 : Dimensionality Reuction Lecturer: Kamesh Munagala Scribe: Kamesh Munagala In this lecture, we will consier the roblem of maing
More informationFLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS. 1. Introduction
FLUCTUATIONS IN THE NUMBER OF POINTS ON SMOOTH PLANE CURVES OVER FINITE FIELDS ALINA BUCUR, CHANTAL DAVID, BROOKE FEIGON, MATILDE LALÍN 1 Introuction In this note, we stuy the fluctuations in the number
More informationModeling of Dependence Structures in Risk Management and Solvency
Moeling of Depenence Structures in Risk Management an Solvency University of California, Santa Barbara 0. August 007 Doreen Straßburger Structure. Risk Measurement uner Solvency II. Copulas 3. Depenent
More informationCHAPTER 1 : DIFFERENTIABLE MANIFOLDS. 1.1 The definition of a differentiable manifold
CHAPTER 1 : DIFFERENTIABLE MANIFOLDS 1.1 The efinition of a ifferentiable manifol Let M be a topological space. This means that we have a family Ω of open sets efine on M. These satisfy (1), M Ω (2) the
More informationθ x = f ( x,t) could be written as
9. Higher orer PDEs as systems of first-orer PDEs. Hyperbolic systems. For PDEs, as for ODEs, we may reuce the orer by efining new epenent variables. For example, in the case of the wave equation, (1)
More information1 dx. where is a large constant, i.e., 1, (7.6) and Px is of the order of unity. Indeed, if px is given by (7.5), the inequality (7.
Lectures Nine an Ten The WKB Approximation The WKB metho is a powerful tool to obtain solutions for many physical problems It is generally applicable to problems of wave propagation in which the frequency
More informationThe Three-dimensional Schödinger Equation
The Three-imensional Schöinger Equation R. L. Herman November 7, 016 Schröinger Equation in Spherical Coorinates We seek to solve the Schröinger equation with spherical symmetry using the metho of separation
More informationConvergence of Random Walks
Chapter 16 Convergence of Ranom Walks This lecture examines the convergence of ranom walks to the Wiener process. This is very important both physically an statistically, an illustrates the utility of
More informationIntroduction to Markov Processes
Introuction to Markov Processes Connexions moule m44014 Zzis law Gustav) Meglicki, Jr Office of the VP for Information Technology Iniana University RCS: Section-2.tex,v 1.24 2012/12/21 18:03:08 gustav
More informationMath Notes on differentials, the Chain Rule, gradients, directional derivative, and normal vectors
Math 18.02 Notes on ifferentials, the Chain Rule, graients, irectional erivative, an normal vectors Tangent plane an linear approximation We efine the partial erivatives of f( xy, ) as follows: f f( x+
More informationIntroduction to variational calculus: Lecture notes 1
October 10, 2006 Introuction to variational calculus: Lecture notes 1 Ewin Langmann Mathematical Physics, KTH Physics, AlbaNova, SE-106 91 Stockholm, Sween Abstract I give an informal summary of variational
More informationSchrödinger s equation.
Physics 342 Lecture 5 Schröinger s Equation Lecture 5 Physics 342 Quantum Mechanics I Wenesay, February 3r, 2010 Toay we iscuss Schröinger s equation an show that it supports the basic interpretation of
More informationWitten s Proof of Morse Inequalities
Witten s Proof of Morse Inequalities by Igor Prokhorenkov Let M be a smooth, compact, oriente manifol with imension n. A Morse function is a smooth function f : M R such that all of its critical points
More informationMulti-View Clustering via Canonical Correlation Analysis
Technical Report TTI-TR-2008-5 Multi-View Clustering via Canonical Correlation Analysis Kamalika Chauhuri UC San Diego Sham M. Kakae Toyota Technological Institute at Chicago ABSTRACT Clustering ata in
More informationOn conditional moments of high-dimensional random vectors given lower-dimensional projections
Submitte to the Bernoulli arxiv:1405.2183v2 [math.st] 6 Sep 2016 On conitional moments of high-imensional ranom vectors given lower-imensional projections LUKAS STEINBERGER an HANNES LEEB Department of
More informationThe derivative of a function f(x) is another function, defined in terms of a limiting expression: f(x + δx) f(x)
Y. D. Chong (2016) MH2801: Complex Methos for the Sciences 1. Derivatives The erivative of a function f(x) is another function, efine in terms of a limiting expression: f (x) f (x) lim x δx 0 f(x + δx)
More information23 Implicit differentiation
23 Implicit ifferentiation 23.1 Statement The equation y = x 2 + 3x + 1 expresses a relationship between the quantities x an y. If a value of x is given, then a corresponing value of y is etermine. For
More informationarxiv: v4 [cs.ds] 7 Mar 2014
Analysis of Agglomerative Clustering Marcel R. Ackermann Johannes Blömer Daniel Kuntze Christian Sohler arxiv:101.697v [cs.ds] 7 Mar 01 Abstract The iameter k-clustering problem is the problem of partitioning
More informationA Unified Theorem on SDP Rank Reduction
A Unifie heorem on SDP Ran Reuction Anthony Man Cho So, Yinyu Ye, Jiawei Zhang November 9, 006 Abstract We consier the problem of fining a low ran approximate solution to a system of linear equations in
More informationConservation Laws. Chapter Conservation of Energy
20 Chapter 3 Conservation Laws In orer to check the physical consistency of the above set of equations governing Maxwell-Lorentz electroynamics [(2.10) an (2.12) or (1.65) an (1.68)], we examine the action
More informationarxiv: v2 [cond-mat.stat-mech] 11 Nov 2016
Noname manuscript No. (will be inserte by the eitor) Scaling properties of the number of ranom sequential asorption iterations neee to generate saturate ranom packing arxiv:607.06668v2 [con-mat.stat-mech]
More informationFinal Exam Study Guide and Practice Problems Solutions
Final Exam Stuy Guie an Practice Problems Solutions Note: These problems are just some of the types of problems that might appear on the exam. However, to fully prepare for the exam, in aition to making
More informationRobust Low Rank Kernel Embeddings of Multivariate Distributions
Robust Low Rank Kernel Embeings of Multivariate Distributions Le Song, Bo Dai College of Computing, Georgia Institute of Technology lsong@cc.gatech.eu, boai@gatech.eu Abstract Kernel embeing of istributions
More informationA new proof of the sharpness of the phase transition for Bernoulli percolation on Z d
A new proof of the sharpness of the phase transition for Bernoulli percolation on Z Hugo Duminil-Copin an Vincent Tassion October 8, 205 Abstract We provie a new proof of the sharpness of the phase transition
More informationSpurious Significance of Treatment Effects in Overfitted Fixed Effect Models Albrecht Ritschl 1 LSE and CEPR. March 2009
Spurious Significance of reatment Effects in Overfitte Fixe Effect Moels Albrecht Ritschl LSE an CEPR March 2009 Introuction Evaluating subsample means across groups an time perios is common in panel stuies
More information1 Math 285 Homework Problem List for S2016
1 Math 85 Homework Problem List for S016 Note: solutions to Lawler Problems will appear after all of the Lecture Note Solutions. 1.1 Homework 1. Due Friay, April 8, 016 Look at from lecture note exercises:
More informationDiagonalization of Matrices Dr. E. Jacobs
Diagonalization of Matrices Dr. E. Jacobs One of the very interesting lessons in this course is how certain algebraic techniques can be use to solve ifferential equations. The purpose of these notes is
More informationA. Exclusive KL View of the MLE
A. Exclusive KL View of the MLE Lets assume a change-of-variable moel p Z z on the ranom variable Z R m, such as the one use in Dinh et al. 2017: z 0 p 0 z 0 an z = ψz 0, where ψ is an invertible function
More informationInfluence of weight initialization on multilayer perceptron performance
Influence of weight initialization on multilayer perceptron performance M. Karouia (1,2) T. Denœux (1) R. Lengellé (1) (1) Université e Compiègne U.R.A. CNRS 817 Heuiasyc BP 649 - F-66 Compiègne ceex -
More informationarxiv: v1 [math-ph] 5 May 2014
DIFFERENTIAL-ALGEBRAIC SOLUTIONS OF THE HEAT EQUATION VICTOR M. BUCHSTABER, ELENA YU. NETAY arxiv:1405.0926v1 [math-ph] 5 May 2014 Abstract. In this work we introuce the notion of ifferential-algebraic
More informationEntanglement is not very useful for estimating multiple phases
PHYSICAL REVIEW A 70, 032310 (2004) Entanglement is not very useful for estimating multiple phases Manuel A. Ballester* Department of Mathematics, University of Utrecht, Box 80010, 3508 TA Utrecht, The
More informationA Modification of the Jarque-Bera Test. for Normality
Int. J. Contemp. Math. Sciences, Vol. 8, 01, no. 17, 84-85 HIKARI Lt, www.m-hikari.com http://x.oi.org/10.1988/ijcms.01.9106 A Moification of the Jarque-Bera Test for Normality Moawa El-Fallah Ab El-Salam
More informationSYSTEMS OF DIFFERENTIAL EQUATIONS, EULER S FORMULA. where L is some constant, usually called the Lipschitz constant. An example is
SYSTEMS OF DIFFERENTIAL EQUATIONS, EULER S FORMULA. Uniqueness for solutions of ifferential equations. We consier the system of ifferential equations given by x = v( x), () t with a given initial conition
More informationSurvey Sampling. 1 Design-based Inference. Kosuke Imai Department of Politics, Princeton University. February 19, 2013
Survey Sampling Kosuke Imai Department of Politics, Princeton University February 19, 2013 Survey sampling is one of the most commonly use ata collection methos for social scientists. We begin by escribing
More informationThe Exact Form and General Integrating Factors
7 The Exact Form an General Integrating Factors In the previous chapters, we ve seen how separable an linear ifferential equations can be solve using methos for converting them to forms that can be easily
More informationConstruction of the Electronic Radial Wave Functions and Probability Distributions of Hydrogen-like Systems
Construction of the Electronic Raial Wave Functions an Probability Distributions of Hyrogen-like Systems Thomas S. Kuntzleman, Department of Chemistry Spring Arbor University, Spring Arbor MI 498 tkuntzle@arbor.eu
More informationPDE Notes, Lecture #11
PDE Notes, Lecture # from Professor Jalal Shatah s Lectures Febuary 9th, 2009 Sobolev Spaces Recall that for u L loc we can efine the weak erivative Du by Du, φ := udφ φ C0 If v L loc such that Du, φ =
More informationA Review of Multiple Try MCMC algorithms for Signal Processing
A Review of Multiple Try MCMC algorithms for Signal Processing Luca Martino Image Processing Lab., Universitat e València (Spain) Universia Carlos III e Mari, Leganes (Spain) Abstract Many applications
More informationTopic 7: Convergence of Random Variables
Topic 7: Convergence of Ranom Variables Course 003, 2016 Page 0 The Inference Problem So far, our starting point has been a given probability space (S, F, P). We now look at how to generate information
More informationNOTES ON EULER-BOOLE SUMMATION (1) f (l 1) (n) f (l 1) (m) + ( 1)k 1 k! B k (y) f (k) (y) dy,
NOTES ON EULER-BOOLE SUMMATION JONATHAN M BORWEIN, NEIL J CALKIN, AND DANTE MANNA Abstract We stuy a connection between Euler-MacLaurin Summation an Boole Summation suggeste in an AMM note from 196, which
More informationRank, Trace, Determinant, Transpose an Inverse of a Matrix Let A be an n n square matrix: A = a11 a1 a1n a1 a an a n1 a n a nn nn where is the jth col
Review of Linear Algebra { E18 Hanout Vectors an Their Inner Proucts Let X an Y be two vectors: an Their inner prouct is ene as X =[x1; ;x n ] T Y =[y1; ;y n ] T (X; Y ) = X T Y = x k y k k=1 where T an
More informationEIGEN-ANALYSIS OF KERNEL OPERATORS FOR NONLINEAR DIMENSION REDUCTION AND DISCRIMINATION
EIGEN-ANALYSIS OF KERNEL OPERATORS FOR NONLINEAR DIMENSION REDUCTION AND DISCRIMINATION DISSERTATION Presente in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the Grauate
More informationAssignment 1. g i (x 1,..., x n ) dx i = 0. i=1
Assignment 1 Golstein 1.4 The equations of motion for the rolling isk are special cases of general linear ifferential equations of constraint of the form g i (x 1,..., x n x i = 0. i=1 A constraint conition
More informationStable and compact finite difference schemes
Center for Turbulence Research Annual Research Briefs 2006 2 Stable an compact finite ifference schemes By K. Mattsson, M. Svär AND M. Shoeybi. Motivation an objectives Compact secon erivatives have long
More informationMultivariate Random Variable
Multivariate Random Variable Author: Author: Andrés Hincapié and Linyi Cao This Version: August 7, 2016 Multivariate Random Variable 3 Now we consider models with more than one r.v. These are called multivariate
More informationEnergy behaviour of the Boris method for charged-particle dynamics
Version of 25 April 218 Energy behaviour of the Boris metho for charge-particle ynamics Ernst Hairer 1, Christian Lubich 2 Abstract The Boris algorithm is a wiely use numerical integrator for the motion
More informationTAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS
MISN-0-4 TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS f(x ± ) = f(x) ± f ' (x) + f '' (x) 2 ±... 1! 2! = 1.000 ± 0.100 + 0.005 ±... TAYLOR S POLYNOMIAL APPROXIMATION FOR FUNCTIONS by Peter Signell 1.
More informationOn the number of isolated eigenvalues of a pair of particles in a quantum wire
On the number of isolate eigenvalues of a pair of particles in a quantum wire arxiv:1812.11804v1 [math-ph] 31 Dec 2018 Joachim Kerner 1 Department of Mathematics an Computer Science FernUniversität in
More informationIntroduction. A Dirichlet Form approach to MCMC Optimal Scaling. MCMC idea
Introuction A Dirichlet Form approach to MCMC Optimal Scaling Markov chain Monte Carlo (MCMC quotes: Metropolis et al. (1953, running coe on the Los Alamos MANIAC: a feasible approach to statistical mechanics
More informationMathematical Review Problems
Fall 6 Louis Scuiero Mathematical Review Problems I. Polynomial Equations an Graphs (Barrante--Chap. ). First egree equation an graph y f() x mx b where m is the slope of the line an b is the line's intercept
More information7.1 Support Vector Machine
67577 Intro. to Machine Learning Fall semester, 006/7 Lecture 7: Support Vector Machines an Kernel Functions II Lecturer: Amnon Shashua Scribe: Amnon Shashua 7. Support Vector Machine We return now to
More informationSYNCHRONOUS SEQUENTIAL CIRCUITS
CHAPTER SYNCHRONOUS SEUENTIAL CIRCUITS Registers an counters, two very common synchronous sequential circuits, are introuce in this chapter. Register is a igital circuit for storing information. Contents
More informationFunction Spaces. 1 Hilbert Spaces
Function Spaces A function space is a set of functions F that has some structure. Often a nonparametric regression function or classifier is chosen to lie in some function space, where the assume structure
More informationarxiv:math/ v1 [math.pr] 19 Apr 2001
Conitional Expectation as Quantile Derivative arxiv:math/00490v math.pr 9 Apr 200 Dirk Tasche November 3, 2000 Abstract For a linear combination u j X j of ranom variables, we are intereste in the partial
More informationTHE EFFICIENCIES OF THE SPATIAL MEDIAN AND SPATIAL SIGN COVARIANCE MATRIX FOR ELLIPTICALLY SYMMETRIC DISTRIBUTIONS
THE EFFICIENCIES OF THE SPATIAL MEDIAN AND SPATIAL SIGN COVARIANCE MATRIX FOR ELLIPTICALLY SYMMETRIC DISTRIBUTIONS BY ANDREW F. MAGYAR A issertation submitte to the Grauate School New Brunswick Rutgers,
More informationPermanent vs. Determinant
Permanent vs. Determinant Frank Ban Introuction A major problem in theoretical computer science is the Permanent vs. Determinant problem. It asks: given an n by n matrix of ineterminates A = (a i,j ) an
More informationChapter 6: Energy-Momentum Tensors
49 Chapter 6: Energy-Momentum Tensors This chapter outlines the general theory of energy an momentum conservation in terms of energy-momentum tensors, then applies these ieas to the case of Bohm's moel.
More informationPartial Differential Equations
Chapter Partial Differential Equations. Introuction Have solve orinary ifferential equations, i.e. ones where there is one inepenent an one epenent variable. Only orinary ifferentiation is therefore involve.
More information