arxiv: v2 [stat.me] 13 Jul 2015

Size: px

Start display at page:

Download "arxiv: v2 [stat.me] 13 Jul 2015"

Cathleen Pierce
5 years ago
Views:

1 One- and wo-sample nonpaameic ess fo he al-o-noise aio based on ecod saisics axiv: v2 [sa.me] 13 Jul 2015 Damien Challe 1,2 1 Laboaoie de mahémaiques appliquées aux sysèmes, CenaleSupélec, Châenay-Malaby CEDEX, Fance 2 Encelade Capial SA, EPFL Innovaion Pak, 1015 Lausanne, Swizeland June 25, 2018 Absac A new family of nonpaameic saisics, he -saisics, is inoduced. I consiss of couning he numbe of ecods of he cumulaive sum of he sample. The single-sample -saisic is almos as poweful as Suden s -saisic fo Gaussian and unifomly disibued vaiables, and moe poweful han he and Wilcoxon ed-ank saisics as long as he daa ae no oo heavy-ailed. Thee wo-sample paameic -saisics ae poposed, one wih a highe specificiy bu a smalle sensiiviy han Mann-Whiney U-es and he ohe one a highe sensiiviy bu a smalle specificiy. A nonpaameic wo-sample -saisic is inoduced, whose powe is vey close o ha of Welch saisic fo Gaussian o unifomly disibued vaiables. keywods: nonpaameic saisics, al-o-noise aio, saisical powe, AUC, ecod saisics 1 Inoducion Nonpaameic saisics play a special ole in daa analysis as hey ae usually moe obus and equie less assumpions abou he undelying daa disibuion [1]. Well-known nonpaameic saisics, such as and Wilcoxon ed-ank fo single samples, and Mann-Whiney U-saisic fo wo samples ae howeve much less poweful han he paameic - o Welch saisics fo Gaussian o unifomly disibued vaiables, while he opposie holds fo fa-ailed daa. Hee I popose a new ype of nonpaameic saisics, called -saisics, which is almos as poweful as - and Welch saisics fo Gaussian vaiables and bee 1

2 han he all he above fo no oo fa-ailed vaiables. As a consequence, hey povide a obus alenaive o usual saisics. Le us wie down he definiion of he -saisic as a way o inoduce useful noaions. Take a sample of N values of a quaniy of inees, denoed by {x n }, n = 1,, N, assumed o be independenly idenically disibued (iid). Denoing an esimae wih a ha, he -saisic of he sample is ˆ = ˆθ N whee ˆθ = ˆµ/ˆσ is is esimaed al-o-noise aio (SNR heeafe), ˆµ is esimaed aveage and ˆσ is esimaed sandad deviaion. The obusness of commonly used nonpaameic saisics is due in pa o he fac ha hey educe sample values o inege quaniies, such as anks and s, fom which he saisics ae compued. The same ecipe undelies -saisics which ae based on he (inege) numbe of ecods of he cumulaive sum (o equivalenly he inegaed al) of he sample values defined as ξ N = {X } 1 N whee X = n=1 x n, 1 N. If he disibuion of x has a zeo aveage, X is nohing else han he posiion of an unbiased andom walke a ime. A emakable esul, based on Spae Andesen heoem [2], saes ha he disibuion of he numbe of uppe ecods (o equivalenly he numbe of jumps of he unning maximum) in N seps, denoed by, does no depend on he disibuion of x n as long as i is symmeic (i.e. x and x ae equipobable) and coninuous, and he sample values ae uncoelaed [3]; noe ha he fis poin is always consideed as he fis uppe (and lowe) ecod (see Fig. 1). In addiion, his disibuion is known exacly: ( ) 2N R+ + 1 P (, N) = /2 2N R++1, (1) N which ends o a Gaussian disibuion N ( 4N/π, (4 2/π)N) fo lage N [3]. Fo symmey easons, he numbe of lowe ecods (i.e., he numbe of jumps of he unning minimum), denoed by R, follows he same disibuion. This esul has spawned many sudies on so-called ecod saisics (see [4] fo a eview). 2 Single-sample saisics Even if single-sample saisic is a well-odden domain in saisics, using an eve so slighly moe poweful saisic povides an invaluable advanage in compeiive siuaions such as speculaive ading o fiend-o-foe idenificaion. One of he poblems of single-sample nonpaameic saisics is ha hey ae less poweful han a -saisic fo Gaussian o unifomly-disibued vaiables. The -saisic emedies his poblem while being obus. Noe ha Spae Andesen s assumpion of symmeic disibuion is shaed by Wilcoxon edank saisic. Up o his poin, he quaniies and R have wo flaws as saisics: fis, hey ae bounded fom below by zeo, hus i is much easie o de a saisical es based on hei diffeence R 0 = R. The numbe of uppe 2

3 value cumulaive sum cumulaive sum } =3 R - = sample numbe pemuaion value cumulaive sum cumulaive sum } =3 R - =4 R 0 =-2/ sample numbe pemuaion value cumulaive sum cumulaive sum } =2 R - = sample numbe Figue 1: Schemaic explanaion of he idea behind he -saisics: one compues he diffeence beween he numbe of jumps of he unning maximum (dashed lines) and he numbe of jumps of he unning minimum (doed lines) of he cumulaed sums of he sample values, aveaged ove many andom pemuaions. By convenion, he fis poin couns as a fis jump fo boh he unning maximum and minimum. The -saisic is simply R 0 /σ N whee σ N 1.97 fo N = 6 (see Eq. ). 3

4 ecods of X N has a saighfowad inepeaion: is nohing else han he numbe of ime seps duing which X N is no in a dawdown (i.e., no below is unning maximum). Thus, he quaniy R is he ime spen in a dawup minus he ime spen in a dawdown. Second, R 0 is by definiion an inege numbe, which may be deimenal o boh saisical powe and efficiency. The key new idea is o noe ha, fo iid daa x n, he inegaed al of any andom pemuaion of {x n } is as valid a epesenaion as X N. Thus one can compue he aveage numbe of ecods of R 0 ove P 1 andom pemuaions, denoed by R 0. Figue 1 explains his idea gaphically. Le us simply wie R 0 insead of R0 in he following fo he sake of eadabiliy. By definiion, he disibuion of R 0 conveges owads a Gaussian disibuion of zeo aveage. Because he numbes of uppe and lowe ecods of a given andom walk ae coelaed in an unknown way, he sandad deviaion of he disibuion of R0, denoed by σ N, mus be measued numeically fo he ime being. Exensive numeical simulaions (see Appendix A) show ha σ N = 1.66(1 0.88N 1/2 ) (2 4/π)N, hus he single-sample -saisic is defined as = R (1 0.88N 1/2 ) (2 4/π)N. Asympoically P () N [0, (σ N ) 2 ], bu he convegence o Gaussian disibuion is quie slow. Fo example, P (R 0 ) is Gaussian up o 2 sandad deviaions fo N = 1000 (see Appendix A); hus, fo he ime being, o build a saisical es one mus eso o esimaing he disibuion of P (R 0 ) numeically fo a given N and use i o obain p-values. Compuaions ae quick (and he full souce code is available). Assessing he powe of he single-sample -saisic equies o esimae P (R 0 ) fo θ = 0 and fo he alenaive θ 0 (sepaaely), and hen o compue he Receive Opeaing Chaaceisic (ROC) cuve of he -saisic [5]. ROC cuves fo -, -,, and Wilcoxon ed-ank sum saisics ae epoed in Appendix B. The ROC cuves of -saisics do no coss hose of he ohe saisics, hence he Aea Unde Cuve (AUC), a scala summay of saisical powe measued in ROC cuves (he lage, he bee), is meaningful fo compaing he powe of -saisic wih ha of ohe saisics. Le us sa wih Gaussian vaiables. T-saisic is unifomly mos poweful in his case [6], hence one expecs ha is AUC is he lages of all. Figue 2 shows ha while and Wilcoxon saisics ae much less poweful han -saisic fo Gaussian vaiables (as i is well known), -saisic has vey nealy he same powe as - saisics. Unifomly disibued vaiables lead o simila esuls (same figue). Geneically, he elaive powe of -saisic wih espec o ha of and Wilcoxon saisics deceases as he ails of he daa become heavie. This is illusaed in Fig. 3 which epos he AUC vesus he ν, he ail paamee of Suden s -disibuion (used as a paameic way o obain heavy-ailed daa). Wilcoxon saisic becomes moe poweful han -saisic fo ν 2.5, while 4

5 Gauss Unifom AUC 0.7 saisics Wilcox AUC 0.7 saisics Wilcox SNR SNR Figue 2: Aea unde cuve (AUC) vesus he al-o-noise aio θ = µ/σ of he alenaive; N = 100, samples pe poin, andom pemuaions pe sample. Eo bas se a wo sandad deviaions. Coninuous lines ae only mean fo eye-guidance. saisic wins when ν < 3.5. The same behaviou is found fo exponenially disibued vaiables (same figue), in which case saisic is bee han -saisic. One of he assumpions of he -saisic is ha he incemens have a zeo aveage, bu his does no ell wha he alenaive is. When he aveage incemen is no zeo, bu sill comes fom a symmeic disibuion aound is aveage, he aveage ecod numbe of such andom walks is a funcion of he al-o-noise aio θ = µ/σ [7, 8, 4]. Thus he -saisic is a es fo he al-o-noise aio. 3 Two-sample siuaion Building a wo-sample vesion -saisic may be done in seveal ways. Le us denoe he wo samples by x = {x n }, n = 1,, N x, and y = {y m }, m = 1,, N y. Assuming fo he ime being ha N x = N y, he simples idea is o es if he diffeence of sample elemens. If he wo samples ae paied, hen z = {z n = x n y n }, i.e., he same andom pemuaion mus be applied o boh sample elemens; ohewise, independen pemuaions may be applied o x and y. he has zeo al-o-noise aio, hence aveage, which amouns o compuing he -saisic of {z}, denoed R z in he following. I is nonpaameic by definiion. Noe ha if he wo samples ae paied, hen one should Anohe appoach is o compue ecod saisics fo each sample and hen compae hem. Fo example, one can use he diffeence beween he numbe of 5

6 1.00 Suden Exponenial AUC saisics Wilcox AUC saisics Wilcox nu SNR Figue 3: Aea unde cuve (AUC) vs he al-o-noise aio θ = µ/σ fo vaious ypes of disibuions of {x n }. N = 100, samples pe poin, andom pemuaions pe sample. Eo bas se a wo sandad deviaions.coninuous lines ae only mean fo eye-guidance. uppe (o lowe) ecods of boh samples, i.e., R + = (x) (y) (3) R = R (x) R (y). (4) This suggess a fouh saisics, R d = R. Given he fac ha he expeced numbe of ecods associaed wih a sample of non-zeo aveage is a funcion of boh he al-o-noise aio and of he disibuion of he sample values, he disibuions of hese hee saisics have zeo aveage if boh samples have he same disibuion and he same al-o-noise aio, which is heefoe hei associaed null hypohesis. These hee saisics would be nonpaameic if hei sandad deviaion was nonpaameic. This is no he case, as shown by Ref. [4] which gives a geneic expession of he disibuiondependen pefaco of his quaniy. Hence, R ± and R d ae bound o be paameic. Figue 4 shows ROC cuves fo R ± and R d saisics when boh samples have he same disibuion, he same lengh and one of hem has zeo aveage. ROC cuves fo all disibuions have common chaaceisics: geneically, R + has he lages specificiy in he limi of lage specificiy and smalles sensiiviy is he exac opposie. R d and R z have appoximaely he same powe as a Welch saisic fo disibuions wih mild ails (Gaussian and unifom), bu do wose han Mann-Whiney ohewise, hus, pefeing R z ove R d makes sense. Thee ae wo subleies ha apply o all wo-sample vesions of he - in he limi of lage sensiiviy of all saisics esed hee, while he R 6

7 Gauss Suden nu=3.5 Sensiiviy Welch R d U R R z Sensiiviy Welch R d U R R z Specificiy Specificiy Figue 4: Two-sample siuaion: ROC cuves fo Gaussian (lef plo) and Suden -disibued vaiables wih ν = 3.5 (igh plo) fo he fou -saisics, Mann-Whiney U-saisic and Welch saisic. Boh samples have σ = 1, while E(x) = 0 and E(y) = 1. N = 100, samples pe poin, andom pemuaions pe sample. Specificiy is equal o 1-false posiive ae, and sensiiviy is he ue posiive ae.l saisics: fis, The second subley aises when he wo samples do no have he same numbe of elemens, denoed by N x and N y especively. One soluion consiss in compuing he ecod saisics of pemuaions of min(n x, N y ) elemens fom each sample. Because of he andom naue of he pemuaions, his scheme ensues a fai sampling of he lage sample; anohe possibiliy is o keep all elemens of he lage sample and o esample he smalle sample so as o have wo samples of equal lengh. 4 Conclusion While he -saisics aleady have some diec applicaions, hee impoan cases sill need o be invesigaed. Fis, -saisics as inoduced hee ae only valid fo uncoelaed daa. While hee is no exac esul abou ecod saisics of coelaed andom walks, numeical simulaions poin o simple coecions in specific cases [9]; whehe -saisics emain nonpaameic fo non-iid vaiables emains o be esed. Pacically, a simple modificaion of he way in which -saisics ae compued especs sho-ange coelaion: one should pemue blocks of daa insead of single values, much like block boosaps (e.g. [10, 11, 12]); he lengh of he blocks may be found in a selfconsisen way [13]. The second case is discee disibuions. While Spae Andesen heoem is only valid fo coninuous vaiables, ecod saisics of andom walks wih discee incemens is simila [3]. Finally, he case of non- 7

8 symmeic disibuions, e.g., he ole of he skew is o be invesigaed. The fac ha he -saisics eflec al-o-noise aios is of paicula inees o finance, because he pefomance of wo asses (o ading saegies) ae adiionally assessed wih hei Shape aio, which is concepually a al-o-noise aio. The usual mehods ae essenially equivalen o a Welchsaisic of hei diffeence, compued wih moe sophisicaed mehods such as boosaps and genealized momen mehods [14, 13]. The lae equie he esimaion of fis and second momens of he samples; some of hem equie he hid and he fouh momens, which is poblemaic fo asse pices [14, 15, 16]. Fuhe wok exploes he efficiency of -saisic as a al-o-noise esimao [17]. As a final noe, he univesaliy of ecod saisics of unbiased andom walks wih symmeic incemens exends o he ime beween wo ecods [3], which howeve does no yield a moe poweful saisics. The auho hanks Gilles Faÿ fo his suggesions. Full souce code (R and C++) available a hps://gihub.com/damienchalle/ saisics. A Asympoic behaviou of he single-sample R 0 A.1 Sandad deviaion Numeical simulaions wee pefomed fo N = floo(10 (100 1/20 ) k ) fo k = 0, 1,, 20, hus N [10, 1000]: 10 5 samples of R 0 wee compued fo Gaussian vaiables (10000 andom pemuaions fo each sample). Then a non-linea fi σ N = (2 4/π)N[a(1 bn c )] (5) yields a = ± 0.008, b = 0.88 ± 0.04, c = 0.5 ± 0.02 (eos se a wo sandad deviaions); he goodness of fi is obvious in Figue 5. A.2 Convegence o a Gaussian disibuion The disibuion of -saisic = R 0 /σ N conveges slowly o a Gaussian, as illusaed by he qq-plo of Fig. 6. B ROC cuves B.1 One sample Figue 7 plos ROC cuves fo he fou disibuions invesigaed hee. I should be noed ha -saisic cuves do no coss hose of he ohe saisics. B.2 Two samples Figue 8 plos ROC cuves fo he unifom and exponenial disibuions; hose fo Gaussian and Suden s disibuions ae epoed in Fig. 4. 8

9 sd(r_0) N Figue 5: Sandad deviaion of R 0 as a funcion of N: numeical simulaions (cicles) and non-linea fi (coninuous line) ; 10 5 samples pel poin of R 0 wee compued fo Gaussian vaiables, wih 10 5 pemuaions fo each sample. Nomal Q Q Plo Sample Quaniles Theoeical Quaniles Figue 6: QQ-plo showing he convegence of he single-sample -saisic R 0 o a Gaussian vaiable as a funcion of N 9

10 Gauss Unifom Sensiiviy saisics Wilcoxon Sensiiviy saisics Wilcoxon Specificiy Specificiy Exponenial Suden nu=3 Sensiiviy saisics Wilcoxon Sensiiviy saisics Wilcoxon Specificiy Specificiy Figue 7: Single-sample siuaion: ROC cuves fo vaious disibuions of {x n }; he alenaive has a al-o-noise aio θ = µ/σ = 0.11, samples of lengh N = 100, andom pemuaions pe sample. 10

11 Exponenial Unifom Sensiiviy Welch R d U R R z Sensiiviy Welch R d U R R z Specificiy Specificiy Figue 8: Two-sample siuaion: ROC cuves fo vaious saisics. Boh samples have σ = 1, while E(x) = 0 and E(y) = 1. N = 100, samples pe poin, pemuaions pe sample. Refeences [1] Gibson, J. D. & Melsa, J. L Inoducion o nonpaameic deecion wih applicaions, vol Academic pess. [2] Andesen, E. S On he flucuaions of sums of andom vaiables. Mahemaica Scandinavica, 1, [3] Majumda, S. N. & Ziff, R. M Univesal ecod saisics of andom walks and Lévy flighs. Physical Review Lees, 101(5), [4] Majumda, S. N., Scheh, G. & Wegen, G Recod saisics and pesisence fo a andom walk wih a dif. Jounal of Physics A: Mahemaical and Theoeical, 45(35), [5] Hasie, T., Tibshiani, R., Fiedman, J., Hasie, T., Fiedman, J. & Tibshiani, R The Elemens of Saisical Leaning. Spinge. [6] Neyman, J. & Peason, E On he poblems of he mos efficien ess of saisical hypoheses. Philosophical Tansacions of he Royal Sociey of London. [7] Wegen, G., Bogne, M. & Kug, J Recod saisics fo biased andom walks, wih an applicaion o financial daa. Physical Review E, 83(5), [8] Wegen, G., Majumda, S. N. & Scheh, G Recod saisics fo muliple andom walks. Physical Review E, 86(1),

12 [9] Wegen, G Modeling ecod-beaking sock pices. Physica A: Saisical Mechanics and is Applicaions, 396, [10] Calsein, E The use of subseies values fo esimaing he vaiance of a geneal saisic fom a saionay sequence. The Annals of Saisics, p [11] Kunsch, H. R The jackknife and he boosap fo geneal saionay obsevaions. The Annals of Saisics, p [12] LePage, R. & Billad, L In Exploing he Limis of Boosap, vol. 270 ofwiley Seies in Pobabiliy and Saisics (eds. R. LePage & L. Billad), pp Wiley. [13] Ledoi, O. & Wolf, M Robus pefomance hypohesis esing wih he Shape aio. Jounal of Empiical Finance, 15(5), [14] Lo, A. W The saisics of Shape aios. Financial Analyss Jounal, 58(4), [15] Meens, O Commens on he coec vaiance of esimaed Shape aios in Lo (2002, FAJ) when euns ae iid. Reseach Noe hp:// sopano01.pdf, accessed [16] Chisie, S Is he Shape aio useful in asse allocaion? Macquaie Applied Finance Cene Reseach Pape. [17] Challe, D A obus, efficien, and momen-fee esimao of Shape aios. Woking pape, available a hp://axiv.og/abs/

Low-complexity Algorithms for MIMO Multiplexing Systems

Low-complexity Algorithms for MIMO Multiplexing Systems Low-complexiy Algoihms fo MIMO Muliplexing Sysems Ouline Inoducion QRD-M M algoihm Algoihm I: : o educe he numbe of suviving pahs. Algoihm II: : o educe he numbe of candidaes fo each ansmied signal. :