Keywords: Estimator, Bias, Mean-squared error, normality, generalized Pareto distribution
|
|
- Roderick Shields
- 6 years ago
- Views:
Transcription
1 Testing approxiate norality of an estiator using the estiated MSE and bias with an application to the shape paraeter of the generalized Pareto distribution J. Martin van Zyl Abstract In this work the norality in sall saples of three often used estiators of the shape paraeter of the generalized Pareto distribution are investigated. Norality iplies that hypotheses can be tested with confidence in saller saples. Often it is not easy to choose between estiators, based on the estiated MSE and bias using siulation studies and norality give the added advantage that hypotheses concerning the paraeter can be tested in sall saples. A confidence interval for the index of the S&P5 index is found by applying the results to estiators of the generalized Pareto distribution. Keywords: Estiator, Bias, Mean-squared error, norality, generalized Pareto distribution Introduction Three well-known estiators of the shape paraeter of a generalized Pareto distribution (GPD) are investigated to see if they can be used to test hypotheses assuing norality in sall saples and also to get an indication at which saples sizes it is acceptable to assue norality. Often it can be proven that an estiator is asyptotically norally distributed but that is very vague and for soe estiators this can ean large saple sizes of thousands of observations which are often not available in practical probles. The shape paraeter and the inverse of it, the tail index, is iportant in risk analysis and used to check if data is heavy-tailed. The probability weighted oent (PWM) estiator, axiu likelihood (ML) estiator and the epirical Bayes estiator proposed by Zhang and Stephens (9) will be investigated. Saples fro the three-paraeter will be siulated and transfored to the two-paraeter GPD by subtracting the scale paraeter estiated as the sallest observation in a saple. It was found that the distribution of the Zhang and Stephens estiator (9) is closest to norally distributed in sall saples and in saller saples it can be used with confidence to test hypotheses. The ML estiator is only norally distributed in larger saples of say n=5 and above and the PWM estiator is not even close to norally distributed in saples of size n=5. The Jarque Bera test (Jarque and Bera, 987) and the Lilliefors test for norality (Lilliefors, 967) will both be applied. It should be noted that norality as such does not iply good results with respect to bias and ean squared error (MSE), but all three these
2 estiators were shown to perfor well (Zhang and Stephens, 9), (de Zea Berudez, Kotz, ). Soe of the estiators are asyptotically norally distributed and the asyptotic variances known, but not for sall saples (Hosking and Wallis, 987). Using these results it is shown in an application in section 5 that with 95% certainty, that the index of the S&P5 is at least.796, thus with a finite variance. A new test which can be applied specifically in siulation studies where the true paraeter is known is also proposed and used. This is an exact ethod although very siple, and under the hypothesis of norality will involve no approxiations when perforing tests. When testing a hypothesis, under the true null-hypothesis where the true paraeter is known, the hypothesis can be rejected if the underlying distribution of the data is not distributed according to the distribution of the saple on which the test is based. In siulation studies where the true paraeters are known, this aspect can be used to test norality. A t-test is based on the assuption of norally distributed observations when calculating the test statistic. Consider a general estiation proble of a paraeter θ in a siulation study, which is a paraeter of a specified distribution. After saples of sizes n each siulated were siulated with true paraeter θ, estiators: ˆ θ ˆ,..., θ are available with ean θ and estiated variance ˆ ˆ = (/ ) ( j ) S θ θ θ and the estiated variance of θ is norality of the estiator, the following statistic can be used: S ˆ /( ). To test the θ t S θ = ( )( θ θ) /. () ˆ If the estiators, ˆ θ ˆ,..., θ, are norally distributed, the t-statistic would be central t distributed with ν = degrees of freedo. If this statistic is used to test the hypothesis H : θ = θ, it will be rejected with high probably only if the estiator is not norally distributed, because the hypothesis is true and the estiated variance correct. This is exact under the hypothesis of norality and the size of this statistic can also give an indication of the distance of the distribution of the estiator and the noral distribution. It will be shown in section, that this statistic can be written in ters of the estiated bias and MSE at saple size n, which eans that previously published results where the MSE and bias were reported can be used to check norality of an estiator. An approxiate variance can be investigated if it can be used at a saple size where it was shown that the estiator is norally distributed. Say it is established or known that at saple size n an estiator is norally distributed, and there is an expression for the variance (aybe an asyptotic variance) say ˆa σ. If the expression for the variance is correct, and t-statistics are fored under the true null hypothesis t = ( ˆ θ θ ) / ˆ σ, j =,...,, the statistics should be approxiately for n large be j j aj
3 distributed noral with ean and variance. If the sae principle is applied the statistic * t = ( ) t / S, with t t = (/ ) t, S = (/ ) ( t t ), j t j should have a t distribution with - degrees of freedo. Since would alost always be large in a siulation study, the statistic would be approxiately norally distributed and can also be copared against a standard noral critical value. If the test statistic is not standard noral distributed, using the approxiate variances, a bootstrap estiate of the variance of the estiator ust be calculated to perfor hypothesis testing in practical probles. Both of these aspects are iportant when testing hypotheses, the distribution and the variance of the statistic. An application of using the t-statistic to test norality using previously published results concerning estiator of the GPD paraeters, where the MSE and bias were reported, will also be given. Testing norality of estiators using the MSE and bias It is first shown that the t-statistic can be written in ters of the estiated ean square error (MSE) and bias calculated fro the siulated estiation results. This for can be used to check norality of an estiator using the MSE and Bias. Consider again the estiators as described in section. The perforance of an estiator was tested on the basis of siulated saples of size n each, resulting in estiators ˆ θ ˆ,..., θ of the true paraeter θ. It will be assued that the estiators are asyptotically unbiased. Let θ ˆ = θ j / denote the saple ean of ˆ θ ˆ,..., θ, and the estiated variance of ˆ θ by S σ ˆ θ ˆ θ j θ = ˆ ( ) = ( ) /( ), and the variance of θ is ˆ σ ( θ ) = S /. The estiated bias and MSE using the true paraeter are respectively B( ˆ θ) = θ θ, and ˆ MSE = (/ ) ( θ θ ). It follows that MSE = ( ˆ θ θ ) j j = ν S + ( θ θ ), ν = = ν S ˆ + B ( θ). 3
4 n Thus S = ( MSE ( θ θ ) ) and ˆ σ ( θ ) = ˆ σ ( ˆ θ j / ) = S /. If ˆ θ,..., ˆ θ are ν norally distributed under the true hypothesis, then the statistic in () is exactly t distributed and can be written as t θ θ B( ˆ θ ) = = S( θ ) { ( MSE B ( ˆ θ ))}/ ν ν ˆ θ ˆ θ ν = B( ) / ( MSE B ( )), = () ν ( θ θ ) / S t ν = The nuber of siulated saples will ostly be large, ore than say 5 saples generated, thus the t-statistic is approxiately standard norally distributed with the test statistic z N (,), ν, if the estiator is norally distributed and the test statistic is z = ν ( θ θ ) / ˆ σ ( ˆ θ ). (3) Rejection of the hypothesis H : θ = θ, will iply with high probability that the saple is not noral distributed. The approxiate distribution of the statistic z where the ˆ's θ are not norally distributed and the variance of the true paraeters known, attracted uch attention and the ost well known approxiation in such a case is the Edgeworth expansion for large saples with ( ) 3 6 3/ f ( z) = φ( z) + ρ H ( z) /(6 n) + (3 ρ H ( z) + ρ H ( z)) /(7 n) + O( n ), r / where n the saple size, ρr = κ r / κ are the standardized cuulants and κ r denotes the r ( r) r-th cuulant. H r ( z) = ( ) φ ( z) / φ( z) denotes a Herite polynoial of order r. Using these results a saple approxiation of the distribution is (Kendall, Stuart and Ord, 987): ( ˆ ˆ 3 3 ) f ( z) = φ( z) + ( ρ 3 5 ρ ) /(4 n) + ( n ). Expression of the series in ters of the t-distribution function was considered in the paper of Finner and Dickhaus (). This can be considered as a way to calculate the power for a specific estiator for large saple sizes. It can be seen that for large saple sizes 4
5 the noralized ratio can be considered as an indication of how close the distribution is to a noral distribution, since theoretically f ( z) = φ( z) if z is noral. Since would alost always be large in a siulation study, the statistic would be approxiately norally distributed and can also be copared against a standard noral critical value. If the test statistic is not standard noral distributed, using the approxiate variances, a bootstrap estiate of the variance of the estiator ust be calculated to perfor hypothesis testing in practical probles. Both of these aspects are iportant when testing hypotheses, the distribution and the variance of the statistic. The GPD (Johnson et al., 994) distribution is / ξ F( x) = ( + ( ξ / σ )( x µ )), x µ, σ >, ξ >, σ is a scale paraeter, ξ the shape paraeter and µ the location paraeter. The shape paraeter deterines how heavy the tail is and oents up to order the index α, whereα = / ξ, are finite. Using the PWM procedure eans that the paraeters are estiated as ˆ a ˆ /( a ˆ a ˆ ) ˆ σ = ˆ ˆ /( ˆ ˆ ), ξ = and aa a a n aˆ = x, aˆ = x ( p ), p = ( j.35) / n, ( j) j j n j = for a saple of size n fro the two-paraeter GPD and x()... x( n) the order statistics (Zea Berudez, Kotz ()). This section will be in two parts, a siulation testing norality for various saples sizes and shape paraeters and in the second part the siulation results given in the paper of Hosking and Wallis (987) will be used to show how previously published results can be used to check norality of three estiators in sall saples. 3 A siulation study to test norality In the 3. three ways to test norality will be used for three estiators and in 3. it is shown how by using a t-statistic norality can be tested when previously published siulation studies are available, where the MSE and bias of an estiator was reported. 3. Checking norality of the estiators of the shape paraeter of a GPD In this section a siulation study will be conducted to check the approxiate norality of the PWM, Zhang and Stephens (9) and two-paraeter ML estiators of the shape 5
6 paraeter ξ will be investigated. Data is siulated fro the three-paraeter GPD, transfored to the two-paraeter by subtracting the iniu saple value. Jarque Bera PWM Zhang-Stephens ML Lilliefors and t- statistic (.8498) (8.843) (6.8775) (4.5).4 (3.5756) (9.789) (6.493) (.69) (9.489) (6.657) (3.869) (3.38) (3.8) (.5493) (.563) Jarque Bera Lilliefors and t-statistic ξ =.5, σ = (.39) (.778) (.33) (.97) (.448) ξ =.5, σ = (.45) (.575) (.3966) (.58) (.4) ξ =.75, σ = (.75) (.3536) (3.) (.97) (.95) Jarque Bera Lilliefors and t- statistic (.8354) (8.545) (6.3). (3.853). (3.34) (9.56) (6.966) (4.4957).6 (.7493).494 (.684) (7.756) (5.6499) (5.44).336 (.93).556 (.597) Table. testing norality of three estiators of the shape paraeter of a GPD, for various saple sizes and paraeters. P-values given and norality will be rejected for P<.5. Based on = saples generated for each saple size and set of paraeters. 6
7 Fro the above results it can be seen that the estiator of Zhang and Stephens (9) is approxiately norally distributed especially for n>5, and the PWM not close to noral for n=5. In figure a histogra of estiated paraeters using the Zhang and Stephens (9) ethod is shown. The skewness and kurtosis of the three estiators PWM, Zhang&Stephens and ML are respectively:.38, ,.67, 3.59,.4, frequency estiated shape paraeter Figure. Histogra of =, n=5 estiated shape paraeter fro GPD with ξ =.75, σ =., µ =.. In the next siulation study the testing of hypotheses using a bootstrap estiate for the variance will be investigated. There are = siulated statistics and each tie the statistic ˆ z = ( ξ ξ ˆ ) / σ* ( ξ), ˆ σ ˆ * ( ξ ) the bootstrap variance for each saple. The nuber of rejections at the 5% level is shown. H : ξ = ξ Testing: n Average Mean, variance z % rejected ξ =., σ = (.996) (.) (.74) (.38) (.45) 5.9 7
8 ξ =.4, σ = (.934) (.436) (.36) (.467) (.364) 5.8 ξ =.6, σ = (.77) (.994) (.95) (.48) (.33) 7. Table. Checking the rejection rate under the true hypothesis at the 5% level using the ethod of Zhang and a bootstrap estiate of the variance. 3. Using previously published results to check norality Hosking and Wallis (987) conducted a siulation study, generating =5 saples to estiate the MSE and bias of the axiu likelihood estiator (MLE), MOM and PWM estiators, tables and 3 in their paper. They reported the estiated bias and RMSE, where MSE is the square of RMSE. Using the equation ˆ ˆ ˆ z ν B( θ ) / ( MSE B ( θ )) = ν B( θ ) / ( RMSE B ( ˆ θ )) their results will be used to check for norality in sall saples. Two siulation studies where the estiator is possibly biased with different nubers of generated saples can be ade coparable. Hosking and Wallis (987) used =5 saples and if one wish to see if the z are of the sae order size as that of a siulation study with =, the statistic * ˆ z 999 B( θ) / ( MSE B ( ˆ θ)) can be calculated. Both are reported. As entioned in section, the test statistic should not increase as the nuber of siulated saples increase if the estiator is unbiased. σ =, ξ =.4 N ML MOM PWM Bias RMSE * z, z Bias RMSE * z, z Bias RMSE z, z * Table 3. Test statistics for norality calculated using reported bias and MSE 8
9 The estiators are not norally distributed for saples sizes less than n=. The * adjusted z can be copared to those found in the siulation study in section 4. where saple sizes of = were generated and it will be seen that the test statistics calculated for the PWM estiators fro the study of Hosking and Wallace (987) are approxiately equal. 4 A confidence interval for the log returns of the S&P5 Using the closing values of the S&P5 over the last 5 years, 6 to, 58 log returns was calculated. A GPD was fitted to the largest 5 returns using a threshold of.6. The purpose is to calculate a 95% confidence interval for ξ using the above approxiate norality of the Zhang and Stephens estiator and a bootstrap estiate for the variance of the estiator. The estiated values of σ using MOM, PWM and Zhang and Stephens are.46,.44,.44 respectively and the estiated values of ξ using the three ethods are.494,.75,.99. The bootstrap estiate of the standard deviation of the Zhang and Stephens estiate of ξ is.897, resulting in a 95% confidence interval of [.6:.3677], with the iplication that the index of the tail observations is not less than.796 (=/.3677). The P-P plot of the estiated distribution versus the epirical distribution function is shown in figure 4. epirical cdf fitted cdf GPD Figure. P-P plot of the fitted GPD and epirical distribution to the 5 largest log returns fro a saple of size 58. 9
10 It can be seen that the line is close to straight and the GPD gives a good fit. 5 Conclusions and Rearks Norality in saller saples of the estiator of the shape paraeter of a GPD was investigated, and the estiator of Zhang and Stephens (9) was shown to be close to norally distributed even in sall saples, and when using excesses over a threshold when perforing the estiation. Soe test are robust, especially the t-test, but the knowledge of norality, can assure ore confidence in the conclusions ade. It was shown the previously published results where the estiated MSE and bias were given can be used to check the norality of estiators. References De Zea Berudez, P., S. Kotz,. Paraeter estiation of the generalized Pareto distribution Part I. Journal of Statistical Planning and Inference, Volue 4, Issue 6, Pages Finner, H. and Dickhaus, T.,. Edgeworth expansions and rates of convergence for noralized sus: Chung s 946 ethod revisited. Statistics and Probability Letters, 8, Hosking, J.R.M. and J.R. Wallace Paraeter and quantile estiation for the generalized Pareto distribution. Technoetrics, 9(3), Hossain, A., Zier, W.,3. Coparison of estiation ethods for Weibull paraeters: Coplete and censored saples. Journal of Statistical Coputation and Siulation, 73:, Jarque, C.M. and Bera, A. K. (98). "Efficient tests for norality, hooscedasticity and serial independence of regression residuals". Econoics Letters 6 (3): Jarque, C.M. and Bera, A. K. (987). "A test for norality of observations and regression residuals". International Statistical Review 55 (): Johnson, N.L., S. Kotz and N. Balakrishnan Continuous Univariate Distributions. Volue. Wiley, New York.
11 Kendall, M., Stuart, A. and Ord, J.K. (987). Kendall s Advanced Theory of Statistics. Charles Griffin and Copany, London. Lilliefors, H. (June 967), "On the Kologorov Sirnov test for norality with ean and variance unknown", JASA, Vol. 6. pp Zhang, J. and Stephens, M.A. (9). A New and Efficient Estiation ethod for the Generalized Pareto Distribution. Technoetrics, 5,3,
Biostatistics Department Technical Report
Biostatistics Departent Technical Report BST006-00 Estiation of Prevalence by Pool Screening With Equal Sized Pools and a egative Binoial Sapling Model Charles R. Katholi, Ph.D. Eeritus Professor Departent
More informationTEST OF HOMOGENEITY OF PARALLEL SAMPLES FROM LOGNORMAL POPULATIONS WITH UNEQUAL VARIANCES
TEST OF HOMOGENEITY OF PARALLEL SAMPLES FROM LOGNORMAL POPULATIONS WITH UNEQUAL VARIANCES S. E. Ahed, R. J. Tokins and A. I. Volodin Departent of Matheatics and Statistics University of Regina Regina,
More informationTesting equality of variances for multiple univariate normal populations
University of Wollongong Research Online Centre for Statistical & Survey Methodology Working Paper Series Faculty of Engineering and Inforation Sciences 0 esting equality of variances for ultiple univariate
More informationExtension of CSRSM for the Parametric Study of the Face Stability of Pressurized Tunnels
Extension of CSRSM for the Paraetric Study of the Face Stability of Pressurized Tunnels Guilhe Mollon 1, Daniel Dias 2, and Abdul-Haid Soubra 3, M.ASCE 1 LGCIE, INSA Lyon, Université de Lyon, Doaine scientifique
More informationMachine Learning Basics: Estimators, Bias and Variance
Machine Learning Basics: Estiators, Bias and Variance Sargur N. srihari@cedar.buffalo.edu This is part of lecture slides on Deep Learning: http://www.cedar.buffalo.edu/~srihari/cse676 1 Topics in Basics
More informationESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS. A Thesis. Presented to. The Faculty of the Department of Mathematics
ESTIMATING AND FORMING CONFIDENCE INTERVALS FOR EXTREMA OF RANDOM POLYNOMIALS A Thesis Presented to The Faculty of the Departent of Matheatics San Jose State University In Partial Fulfillent of the Requireents
More informationThe proofs of Theorem 1-3 are along the lines of Wied and Galeano (2013).
A Appendix: Proofs The proofs of Theore 1-3 are along the lines of Wied and Galeano (2013) Proof of Theore 1 Let D[d 1, d 2 ] be the space of càdlàg functions on the interval [d 1, d 2 ] equipped with
More informationOBJECTIVES INTRODUCTION
M7 Chapter 3 Section 1 OBJECTIVES Suarize data using easures of central tendency, such as the ean, edian, ode, and idrange. Describe data using the easures of variation, such as the range, variance, and
More informationare equal to zero, where, q = p 1. For each gene j, the pairwise null and alternative hypotheses are,
Page of 8 Suppleentary Materials: A ultiple testing procedure for ulti-diensional pairwise coparisons with application to gene expression studies Anjana Grandhi, Wenge Guo, Shyaal D. Peddada S Notations
More informationMeta-Analytic Interval Estimation for Bivariate Correlations
Psychological Methods 2008, Vol. 13, No. 3, 173 181 Copyright 2008 by the Aerican Psychological Association 1082-989X/08/$12.00 DOI: 10.1037/a0012868 Meta-Analytic Interval Estiation for Bivariate Correlations
More informationOn the block maxima method in extreme value theory
On the bloc axiethod in extree value theory Ana Ferreira ISA, Univ Tecn Lisboa, Tapada da Ajuda 349-7 Lisboa, Portugal CEAUL, FCUL, Bloco C6 - Piso 4 Capo Grande, 749-6 Lisboa, Portugal anafh@isa.utl.pt
More informationA Simple Regression Problem
A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where
More informationNon-Parametric Non-Line-of-Sight Identification 1
Non-Paraetric Non-Line-of-Sight Identification Sinan Gezici, Hisashi Kobayashi and H. Vincent Poor Departent of Electrical Engineering School of Engineering and Applied Science Princeton University, Princeton,
More informationOn the Maximum Likelihood Estimation of Weibull Distribution with Lifetime Data of Hard Disk Drives
314 Int'l Conf. Par. and Dist. Proc. Tech. and Appl. PDPTA'17 On the Maxiu Likelihood Estiation of Weibull Distribution with Lifetie Data of Hard Disk Drives Daiki Koizui Departent of Inforation and Manageent
More informationEstimating Parameters for a Gaussian pdf
Pattern Recognition and achine Learning Jaes L. Crowley ENSIAG 3 IS First Seester 00/0 Lesson 5 7 Noveber 00 Contents Estiating Paraeters for a Gaussian pdf Notation... The Pattern Recognition Proble...3
More informationRAFIA(MBA) TUTOR S UPLOADED FILE Course STA301: Statistics and Probability Lecture No 1 to 5
Course STA0: Statistics and Probability Lecture No to 5 Multiple Choice Questions:. Statistics deals with: a) Observations b) Aggregates of facts*** c) Individuals d) Isolated ites. A nuber of students
More informationResearch in Area of Longevity of Sylphon Scraies
IOP Conference Series: Earth and Environental Science PAPER OPEN ACCESS Research in Area of Longevity of Sylphon Scraies To cite this article: Natalia Y Golovina and Svetlana Y Krivosheeva 2018 IOP Conf.
More informationModel Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon
Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential
More informationAN EFFICIENT CLASS OF CHAIN ESTIMATORS OF POPULATION VARIANCE UNDER SUB-SAMPLING SCHEME
J. Japan Statist. Soc. Vol. 35 No. 005 73 86 AN EFFICIENT CLASS OF CHAIN ESTIMATORS OF POPULATION VARIANCE UNDER SUB-SAMPLING SCHEME H. S. Jhajj*, M. K. Shara* and Lovleen Kuar Grover** For estiating the
More informationSharp Time Data Tradeoffs for Linear Inverse Problems
Sharp Tie Data Tradeoffs for Linear Inverse Probles Saet Oyak Benjain Recht Mahdi Soltanolkotabi January 016 Abstract In this paper we characterize sharp tie-data tradeoffs for optiization probles used
More informationSoft Computing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis
Soft Coputing Techniques Help Assign Weights to Different Factors in Vulnerability Analysis Beverly Rivera 1,2, Irbis Gallegos 1, and Vladik Kreinovich 2 1 Regional Cyber and Energy Security Center RCES
More informationIn this chapter, we consider several graph-theoretic and probabilistic models
THREE ONE GRAPH-THEORETIC AND STATISTICAL MODELS 3.1 INTRODUCTION In this chapter, we consider several graph-theoretic and probabilistic odels for a social network, which we do under different assuptions
More informationAN OPTIMAL SHRINKAGE FACTOR IN PREDICTION OF ORDERED RANDOM EFFECTS
Statistica Sinica 6 016, 1709-178 doi:http://dx.doi.org/10.5705/ss.0014.0034 AN OPTIMAL SHRINKAGE FACTOR IN PREDICTION OF ORDERED RANDOM EFFECTS Nilabja Guha 1, Anindya Roy, Yaakov Malinovsky and Gauri
More informationSHORT TIME FOURIER TRANSFORM PROBABILITY DISTRIBUTION FOR TIME-FREQUENCY SEGMENTATION
SHORT TIME FOURIER TRANSFORM PROBABILITY DISTRIBUTION FOR TIME-FREQUENCY SEGMENTATION Fabien Millioz, Julien Huillery, Nadine Martin To cite this version: Fabien Millioz, Julien Huillery, Nadine Martin.
More informationA Note on the Applied Use of MDL Approximations
A Note on the Applied Use of MDL Approxiations Daniel J. Navarro Departent of Psychology Ohio State University Abstract An applied proble is discussed in which two nested psychological odels of retention
More informationEstimation of the Population Mean Based on Extremes Ranked Set Sampling
Aerican Journal of Matheatics Statistics 05, 5(: 3-3 DOI: 0.593/j.ajs.05050.05 Estiation of the Population Mean Based on Extrees Ranked Set Sapling B. S. Biradar,*, Santosha C. D. Departent of Studies
More informationIntelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley osig 1 Winter Seester 2018 Lesson 6 27 February 2018 Outline Perceptrons and Support Vector achines Notation...2 Linear odels...3 Lines, Planes
More informationAn Introduction to Meta-Analysis
An Introduction to Meta-Analysis Douglas G. Bonett University of California, Santa Cruz How to cite this work: Bonett, D.G. (2016) An Introduction to Meta-analysis. Retrieved fro http://people.ucsc.edu/~dgbonett/eta.htl
More informationEstimation of the Population Variance Using. Ranked Set Sampling with Auxiliary Variable
Int. J. Contep. Math. Sciences, Vol. 5, 00, no. 5, 567-576 Estiation of the Population Variance Using Ranked Set Sapling with Auiliar Variable Said Ali Al-Hadhrai College of Applied Sciences, Nizwa, Oan
More informationTesting the lag length of vector autoregressive models: A power comparison between portmanteau and Lagrange multiplier tests
Working Papers 2017-03 Testing the lag length of vector autoregressive odels: A power coparison between portanteau and Lagrange ultiplier tests Raja Ben Hajria National Engineering School, University of
More informationEstimation of the Mean of the Exponential Distribution Using Maximum Ranked Set Sampling with Unequal Samples
Open Journal of Statistics, 4, 4, 64-649 Published Online Septeber 4 in SciRes http//wwwscirporg/ournal/os http//ddoiorg/436/os4486 Estiation of the Mean of the Eponential Distribution Using Maiu Ranked
More informationThis article appeared in a journal published by Elsevier. The attached copy is furnished to the author for internal non-commercial research and
This article appeared in a ournal published by Elsevier. The attached copy is furnished to the author for internal non-coercial research and education use, including for instruction at the authors institution
More informationarxiv: v1 [stat.ot] 7 Jul 2010
Hotelling s test for highly correlated data P. Bubeliny e-ail: bubeliny@karlin.ff.cuni.cz Charles University, Faculty of Matheatics and Physics, KPMS, Sokolovska 83, Prague, Czech Republic, 8675. arxiv:007.094v
More informationDEPARTMENT OF ECONOMETRICS AND BUSINESS STATISTICS
ISSN 1440-771X AUSTRALIA DEPARTMENT OF ECONOMETRICS AND BUSINESS STATISTICS An Iproved Method for Bandwidth Selection When Estiating ROC Curves Peter G Hall and Rob J Hyndan Working Paper 11/00 An iproved
More informationBest Linear Unbiased and Invariant Reconstructors for the Past Records
BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY http:/athusy/bulletin Bull Malays Math Sci Soc (2) 37(4) (2014), 1017 1028 Best Linear Unbiased and Invariant Reconstructors for the Past Records
More informationClassical and Bayesian Inference for an Extension of the Exponential Distribution under Progressive Type-II Censored Data with Binomial Removals
J. Stat. Appl. Pro. Lett. 1, No. 3, 75-86 (2014) 75 Journal of Statistics Applications & Probability Letters An International Journal http://dx.doi.org/10.12785/jsapl/010304 Classical and Bayesian Inference
More informationProbability Distributions
Probability Distributions In Chapter, we ephasized the central role played by probability theory in the solution of pattern recognition probles. We turn now to an exploration of soe particular exaples
More informationIs the seismic moment frequency relation universal?
Geophys. J. Int. (2) 142, 193 198 Is the seisic oent frequency relation universal? C. Godano1 and F. Pingue2 1 Dipartiento di Scienze Abientali, Seconda Università di Napoli, via V ivaldi 43, 811 Caserta,
More informationOn Pearson families of distributions and its applications
Vol. 6(5) pp. 08-7 May 03 DOI: 0.5897/AJMCSR03.0465 ISSN 006-973 03 Acadeic Journals http://www.acadeicournals.org/ajmcsr African Journal of Matheatics and Coputer Science Research Full Length Research
More informationE. Alpaydın AERFAISS
E. Alpaydın AERFAISS 00 Introduction Questions: Is the error rate of y classifier less than %? Is k-nn ore accurate than MLP? Does having PCA before iprove accuracy? Which kernel leads to highest accuracy
More informationTopic 5a Introduction to Curve Fitting & Linear Regression
/7/08 Course Instructor Dr. Rayond C. Rup Oice: A 337 Phone: (95) 747 6958 E ail: rcrup@utep.edu opic 5a Introduction to Curve Fitting & Linear Regression EE 4386/530 Coputational ethods in EE Outline
More information1 Bounding the Margin
COS 511: Theoretical Machine Learning Lecturer: Rob Schapire Lecture #12 Scribe: Jian Min Si March 14, 2013 1 Bounding the Margin We are continuing the proof of a bound on the generalization error of AdaBoost
More informationProc. of the IEEE/OES Seventh Working Conference on Current Measurement Technology UNCERTAINTIES IN SEASONDE CURRENT VELOCITIES
Proc. of the IEEE/OES Seventh Working Conference on Current Measureent Technology UNCERTAINTIES IN SEASONDE CURRENT VELOCITIES Belinda Lipa Codar Ocean Sensors 15 La Sandra Way, Portola Valley, CA 98 blipa@pogo.co
More informationA Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair
Proceedings of the 6th SEAS International Conference on Siulation, Modelling and Optiization, Lisbon, Portugal, Septeber -4, 006 0 A Siplified Analytical Approach for Efficiency Evaluation of the eaving
More informationModeling the Structural Shifts in Real Exchange Rate with Cubic Spline Regression (CSR). Turkey
International Journal of Business and Social Science Vol. 2 No. 17 www.ijbssnet.co Modeling the Structural Shifts in Real Exchange Rate with Cubic Spline Regression (CSR). Turkey 1987-2008 Dr. Bahar BERBEROĞLU
More informationBootstrapping Dependent Data
Bootstrapping Dependent Data One of the key issues confronting bootstrap resapling approxiations is how to deal with dependent data. Consider a sequence fx t g n t= of dependent rando variables. Clearly
More informationTABLE FOR UPPER PERCENTAGE POINTS OF THE LARGEST ROOT OF A DETERMINANTAL EQUATION WITH FIVE ROOTS. By William W. Chen
TABLE FOR UPPER PERCENTAGE POINTS OF THE LARGEST ROOT OF A DETERMINANTAL EQUATION WITH FIVE ROOTS By Willia W. Chen The distribution of the non-null characteristic roots of a atri derived fro saple observations
More informationList Scheduling and LPT Oliver Braun (09/05/2017)
List Scheduling and LPT Oliver Braun (09/05/207) We investigate the classical scheduling proble P ax where a set of n independent jobs has to be processed on 2 parallel and identical processors (achines)
More informationEE5900 Spring Lecture 4 IC interconnect modeling methods Zhuo Feng
EE59 Spring Parallel LSI AD Algoriths Lecture I interconnect odeling ethods Zhuo Feng. Z. Feng MTU EE59 So far we ve considered only tie doain analyses We ll soon see that it is soeties preferable to odel
More informationCorrecting a Significance Test for Clustering in Designs With Two Levels of Nesting
Institute for Policy Research Northwestern University Working Paper Series WP-07-4 orrecting a Significance est for lustering in Designs With wo Levels of Nesting Larry V. Hedges Faculty Fellow, Institute
More informationOptimal Jackknife for Discrete Time and Continuous Time Unit Root Models
Optial Jackknife for Discrete Tie and Continuous Tie Unit Root Models Ye Chen and Jun Yu Singapore Manageent University January 6, Abstract Maxiu likelihood estiation of the persistence paraeter in the
More informationEstimation for the Parameters of the Exponentiated Exponential Distribution Using a Median Ranked Set Sampling
Journal of Modern Applied Statistical Metods Volue 14 Issue 1 Article 19 5-1-015 Estiation for te Paraeters of te Exponentiated Exponential Distribution Using a Median Ranked Set Sapling Monjed H. Sau
More informationGeneralized Augmentation for Control of the k-familywise Error Rate
International Journal of Statistics in Medical Research, 2012, 1, 113-119 113 Generalized Augentation for Control of the k-failywise Error Rate Alessio Farcoeni* Departent of Public Health and Infectious
More informationSmooth Test for Testing Equality of Two Densities 1
Sooth Test for Testing Equality of Two Densities Anil K. Bera University of Illinois. E-ail:abera@uiuc.edu. Phone: 7-333-4596. Aurobindo Ghosh Singapore Manageent University. E-ail:aurobindo@su.edu.sg.
More informationFeature Extraction Techniques
Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that
More informationOn Constant Power Water-filling
On Constant Power Water-filling Wei Yu and John M. Cioffi Electrical Engineering Departent Stanford University, Stanford, CA94305, U.S.A. eails: {weiyu,cioffi}@stanford.edu Abstract This paper derives
More informationSolutions to the problems in Chapter 6 and 7
Solutions to the probles in Chapter 6 and 7 6.3 Pressure of a Feri gas at zero teperature The nuber of electrons N and the internal energy U, inthevoluev,are N = V D(ε)f(ε)dε, U = V εd(ε)f(ε)dε, () The
More informationIN modern society that various systems have become more
Developent of Reliability Function in -Coponent Standby Redundant Syste with Priority Based on Maxiu Entropy Principle Ryosuke Hirata, Ikuo Arizono, Ryosuke Toohiro, Satoshi Oigawa, and Yasuhiko Takeoto
More informationTail Estimation of the Spectral Density under Fixed-Domain Asymptotics
Tail Estiation of the Spectral Density under Fixed-Doain Asyptotics Wei-Ying Wu, Chae Young Li and Yiin Xiao Wei-Ying Wu, Departent of Statistics & Probability Michigan State University, East Lansing,
More informationBlock designs and statistics
Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent
More informationSpine Fin Efficiency A Three Sided Pyramidal Fin of Equilateral Triangular Cross-Sectional Area
Proceedings of the 006 WSEAS/IASME International Conference on Heat and Mass Transfer, Miai, Florida, USA, January 18-0, 006 (pp13-18) Spine Fin Efficiency A Three Sided Pyraidal Fin of Equilateral Triangular
More informationStochastic Subgradient Methods
Stochastic Subgradient Methods Lingjie Weng Yutian Chen Bren School of Inforation and Coputer Science University of California, Irvine {wengl, yutianc}@ics.uci.edu Abstract Stochastic subgradient ethods
More informationInternational Journal of Pure and Applied Mathematics Volume 37 No , IMPROVED DATA DRIVEN CONTROL CHARTS
International Journal of Pure and Applied Matheatics Volue 37 No. 3 2007, 423-438 IMPROVED DATA DRIVEN CONTROL CHARTS Wille Albers 1, Wilbert C.M. Kallenberg 2 1,2 Departent of Applied Matheatics Faculty
More informationA Better Algorithm For an Ancient Scheduling Problem. David R. Karger Steven J. Phillips Eric Torng. Department of Computer Science
A Better Algorith For an Ancient Scheduling Proble David R. Karger Steven J. Phillips Eric Torng Departent of Coputer Science Stanford University Stanford, CA 9435-4 Abstract One of the oldest and siplest
More informationCh 12: Variations on Backpropagation
Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith
More informationarxiv: v1 [cs.ds] 3 Feb 2014
arxiv:40.043v [cs.ds] 3 Feb 04 A Bound on the Expected Optiality of Rando Feasible Solutions to Cobinatorial Optiization Probles Evan A. Sultani The Johns Hopins University APL evan@sultani.co http://www.sultani.co/
More informationUfuk Demirci* and Feza Kerestecioglu**
1 INDIRECT ADAPTIVE CONTROL OF MISSILES Ufuk Deirci* and Feza Kerestecioglu** *Turkish Navy Guided Missile Test Station, Beykoz, Istanbul, TURKEY **Departent of Electrical and Electronics Engineering,
More informationThe Distribution of the Covariance Matrix for a Subset of Elliptical Distributions with Extension to Two Kurtosis Parameters
journal of ultivariate analysis 58, 96106 (1996) article no. 0041 The Distribution of the Covariance Matrix for a Subset of Elliptical Distributions with Extension to Two Kurtosis Paraeters H. S. Steyn
More informationSampling How Big a Sample?
C. G. G. Aitken, 1 Ph.D. Sapling How Big a Saple? REFERENCE: Aitken CGG. Sapling how big a saple? J Forensic Sci 1999;44(4):750 760. ABSTRACT: It is thought that, in a consignent of discrete units, a certain
More informationA general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics, EPFL, Lausanne Phone: Fax:
A general forulation of the cross-nested logit odel Michel Bierlaire, EPFL Conference paper STRC 2001 Session: Choices A general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics,
More informationMoments of the product and ratio of two correlated chi-square variables
Stat Papers 009 50:581 59 DOI 10.1007/s0036-007-0105-0 REGULAR ARTICLE Moents of the product and ratio of two correlated chi-square variables Anwar H. Joarder Received: June 006 / Revised: 8 October 007
More informationW-BASED VS LATENT VARIABLES SPATIAL AUTOREGRESSIVE MODELS: EVIDENCE FROM MONTE CARLO SIMULATIONS
W-BASED VS LATENT VARIABLES SPATIAL AUTOREGRESSIVE MODELS: EVIDENCE FROM MONTE CARLO SIMULATIONS. Introduction When it coes to applying econoetric odels to analyze georeferenced data, researchers are well
More informationNecessity of low effective dimension
Necessity of low effective diension Art B. Owen Stanford University October 2002, Orig: July 2002 Abstract Practitioners have long noticed that quasi-monte Carlo ethods work very well on functions that
More informationTwo-Sided Cumulative Sum (cusum) Control Chart for Monitoring Shift in the Shape Parameter of the Pareto Distribution
J. Stat. Appl. Pro. 7, No. 1, 29-37 2018 29 Journal of Statistics Applications & Probability An International Journal http://dx.doi.org/10.18576/jsap/070103 Two-Sided Cuulative Su cusu Control Chart for
More informationExamining the Effects of Site Selection Criteria for Evaluating the Effectiveness of Traffic Safety Countermeasures
Exaining the Effects of Site Selection Criteria for Evaluating the Effectiveness of Traffic Safety Countereasures Doinique Lord* Associate Professor and Zachry Developent Professor I Zachry Departent of
More informationBayesian Approach for Fatigue Life Prediction from Field Inspection
Bayesian Approach for Fatigue Life Prediction fro Field Inspection Dawn An and Jooho Choi School of Aerospace & Mechanical Engineering, Korea Aerospace University, Goyang, Seoul, Korea Srira Pattabhiraan
More informationExperimental Design For Model Discrimination And Precise Parameter Estimation In WDS Analysis
City University of New York (CUNY) CUNY Acadeic Works International Conference on Hydroinforatics 8-1-2014 Experiental Design For Model Discriination And Precise Paraeter Estiation In WDS Analysis Giovanna
More informationAn Approximate Model for the Theoretical Prediction of the Velocity Increase in the Intermediate Ballistics Period
An Approxiate Model for the Theoretical Prediction of the Velocity... 77 Central European Journal of Energetic Materials, 205, 2(), 77-88 ISSN 2353-843 An Approxiate Model for the Theoretical Prediction
More informationNonlinear Log-Periodogram Regression for Perturbed Fractional Processes
Nonlinear Log-Periodogra Regression for Perturbed Fractional Processes Yixiao Sun Departent of Econoics Yale University Peter C. B. Phillips Cowles Foundation for Research in Econoics Yale University First
More informationEXTENDED NEYMAN SMOOTH GOODNESS-OF-FIT TESTS, APPLIED TO COMPETING HEAVY-TAILED DISTRIBUTIONS. J. Huston McCulloch and E. Richard Percy, Jr.
EXTENDED NEYMAN SMOOTH GOODNESS-OF-FIT TESTS, APPLIED TO COMPETING HEAVY-TAILED DISTRIBUTIONS J. Huston McCulloch and E. Richard Percy, Jr.* J. Econoetrics Special Issue Subission: Sept. 4, 200 First Revision:
More informationTwo New Unbiased Point Estimates Of A Population Variance
Journal of Modern Applied Statistical Methods Volue 5 Issue Article 7 5--006 Two New Unbiased Point Estiates Of A Population Variance Matthew E. Ela The University of Alabaa, ela@baa.ua.edu Follow this
More informationE0 370 Statistical Learning Theory Lecture 6 (Aug 30, 2011) Margin Analysis
E0 370 tatistical Learning Theory Lecture 6 (Aug 30, 20) Margin Analysis Lecturer: hivani Agarwal cribe: Narasihan R Introduction In the last few lectures we have seen how to obtain high confidence bounds
More informationSPECTRUM sensing is a core concept of cognitive radio
World Acadey of Science, Engineering and Technology International Journal of Electronics and Counication Engineering Vol:6, o:2, 202 Efficient Detection Using Sequential Probability Ratio Test in Mobile
More informatione-companion ONLY AVAILABLE IN ELECTRONIC FORM
OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer
More informationSample Mean Deviation (d) Chart Under the Assumption of Moderateness and its Performance Analysis Under Normality Against Moderateness
Volue-7, Issue-4, July-August 217 International Journal of Engineering a Manageent Research Page Nuber: 292-296 Saple Mean Deviation () Chart Uer the Assuption of Moerateness a its Perforance Analysis
More informationKernel-Based Nonparametric Anomaly Detection
Kernel-Based Nonparaetric Anoaly Detection Shaofeng Zou Dept of EECS Syracuse University Eail: szou@syr.edu Yingbin Liang Dept of EECS Syracuse University Eail: yliang6@syr.edu H. Vincent Poor Dept of
More informationHomework 3 Solutions CSE 101 Summer 2017
Hoework 3 Solutions CSE 0 Suer 207. Scheduling algoriths The following n = 2 jobs with given processing ties have to be scheduled on = 3 parallel and identical processors with the objective of iniizing
More informationOnline Publication Date: 19 April 2012 Publisher: Asian Economic and Social Society
Online Publication Date: April Publisher: Asian Econoic and Social Society Using Entropy Working Correlation Matrix in Generalized Estiating Equation for Stock Price Change Model Serpilılıç (Faculty of
More informationPORTMANTEAU TESTS FOR ARMA MODELS WITH INFINITE VARIANCE
doi:10.1111/j.1467-9892.2007.00572.x PORTMANTEAU TESTS FOR ARMA MODELS WITH INFINITE VARIANCE By J.-W. Lin and A. I. McLeod The University of Western Ontario First Version received Septeber 2006 Abstract.
More informationOptical Properties of Plasmas of High-Z Elements
Forschungszentru Karlsruhe Techni und Uwelt Wissenschaftlishe Berichte FZK Optical Properties of Plasas of High-Z Eleents V.Tolach 1, G.Miloshevsy 1, H.Würz Project Kernfusion 1 Heat and Mass Transfer
More informationANALYTICAL INVESTIGATION AND PARAMETRIC STUDY OF LATERAL IMPACT BEHAVIOR OF PRESSURIZED PIPELINES AND INFLUENCE OF INTERNAL PRESSURE
DRAFT Proceedings of the ASME 014 International Mechanical Engineering Congress & Exposition IMECE014 Noveber 14-0, 014, Montreal, Quebec, Canada IMECE014-36371 ANALYTICAL INVESTIGATION AND PARAMETRIC
More informationMultiscale Entropy Analysis: A New Method to Detect Determinism in a Time. Series. A. Sarkar and P. Barat. Variable Energy Cyclotron Centre
Multiscale Entropy Analysis: A New Method to Detect Deterinis in a Tie Series A. Sarkar and P. Barat Variable Energy Cyclotron Centre /AF Bidhan Nagar, Kolkata 700064, India PACS nubers: 05.45.Tp, 89.75.-k,
More informationFairness via priority scheduling
Fairness via priority scheduling Veeraruna Kavitha, N Heachandra and Debayan Das IEOR, IIT Bobay, Mubai, 400076, India vavitha,nh,debayan}@iitbacin Abstract In the context of ulti-agent resource allocation
More informationCOS 424: Interacting with Data. Written Exercises
COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well
More informationDESIGN OF THE DIE PROFILE FOR THE INCREMENTAL RADIAL FORGING PROCESS *
IJST, Transactions of Mechanical Engineering, Vol. 39, No. M1, pp 89-100 Printed in The Islaic Republic of Iran, 2015 Shira University DESIGN OF THE DIE PROFILE FOR THE INCREMENTAL RADIAL FORGING PROCESS
More informationA MESHSIZE BOOSTING ALGORITHM IN KERNEL DENSITY ESTIMATION
A eshsize boosting algorith in kernel density estiation A MESHSIZE BOOSTING ALGORITHM IN KERNEL DENSITY ESTIMATION C.C. Ishiekwene, S.M. Ogbonwan and J.E. Osewenkhae Departent of Matheatics, University
More informationPh 20.3 Numerical Solution of Ordinary Differential Equations
Ph 20.3 Nuerical Solution of Ordinary Differential Equations Due: Week 5 -v20170314- This Assignent So far, your assignents have tried to failiarize you with the hardware and software in the Physics Coputing
More informationVariance Reduction. in Statistics, we deal with estimators or statistics all the time
Variance Reduction in Statistics, we deal with estiators or statistics all the tie perforance of an estiator is easured by MSE for biased estiators and by variance for unbiased ones hence it s useful to
More informationThe degree of a typical vertex in generalized random intersection graph models
Discrete Matheatics 306 006 15 165 www.elsevier.co/locate/disc The degree of a typical vertex in generalized rando intersection graph odels Jerzy Jaworski a, Michał Karoński a, Dudley Stark b a Departent
More informationBIVARIATE NONCENTRAL DISTRIBUTIONS: AN APPROACH VIA THE COMPOUNDING METHOD
South African Statist J 06 50, 03 03 BIVARIATE NONCENTRAL DISTRIBUTIONS: AN APPROACH VIA THE COMPOUNDING METHOD Johan Ferreira Departent of Statistics, Faculty of Natural and Agricultural Sciences, University
More information