Additional Tables of Simulation Results
|
|
- Amice Fowler
- 5 years ago
- Views:
Transcription
1 Saisica Siica: Suppleme REGULARIZING LASSO: A CONSISTENT VARIABLE SELECTION METHOD Quefeg Li ad Ju Shao Uiversiy of Wiscosi, Madiso, Eas Chia Normal Uiversiy ad Uiversiy of Wiscosi, Madiso Supplemeary Maerial The supplemeary maerial is orgaized as he follows. I Secio S, we provide addiioal iformaio regardig he simulaio sudies i Secio 5.. I Secio S, we give lemmas for esablishig asympoic resuls whe he precisio mari is sparse. The proofs of all lemmas ad heorems are give i Secio S3. S Addiioal Tables of Simulaio Resuls Table provides he average compuaioal ime i miues for he eigh mehods uder he simulaio seigs. SIS clearly requires he leas compuaioal effor, whereas as well as Scou require much loger compuaioal ime. Bu all mehods ecep CLIME ca be compued uder a reasoable amou of ime for p = 5000 ad = 00. CLIME akes much loger because of iverig a mari of 5000 dimesio. However, miues of compuaio may sill be accepable. I a urepored simulaio wih p = 000 ad he same oher seigs, he average compuaioal ime for CLIME is 46.7 miues. Fially, because he esimaio of Σ is a impora sep i, we provide he average Frobeius orms of esimaed Σ ad Ω i he simulaio i Table. I is clear ha S is o a good esimaor of Σ i erms of he Frobeius orm, ˆΣ by hresholdig or ˆΩ by CLIME is a good esimaor whe Σ or Ω is sparse bu o so good whe Σ or Ω is o sparse. S Lemmas Lemma S. Assume codiios C-C ad C3, for ay λ 0, here eis posiive cosas C 4, C 5, C 6 such ha β β > 8 ep C 4 [/s h r q ] q + 4p ep C 5 /s h + 8p ep C6 for ay 0 < < 8M h s h.
2 S Table : Average compuaioal ime of various mehods i miues p = 5000 ad = 00 Model Model Model 3 Model 4 AT CLIME GLASSO Scou, LASSO LASSO+T SLSE+T SIS Table : The average Frobeius orms of esimaed Σ ad Ω Model Model Model 3 Model 4 S Σ F S = X X/ ˆΣ Σ F AT ˆΩ Ω F CLIME Lemma S. Assume codiios C, C ad C3, for ay λ 0, here eis posiive cosas C, C, C 3 ad C 4 such ha β [ ] q β > C ep C [/r q s h ] + l τ for ay 0 < < 8M h s h. + C 3 p s l h l l + C 4 p l l, S3 roofs roof of Lemma. From, ˆβ Mj β Mj = = k= ij µ + [ β k ik + σ i ɛ i k= ] ij ik E j k β k + E j k β k k= σ i ij ɛ i + µ ij. The, ˆβ Mj β Mj > ij ik E j k β k > 3 k= S3. + σ i ij ɛ i > + µ 3 ij > 3
3 S3 Uder codiio C, applyig Lemma of Cai ad Liu 0 o ± ij ik E ij ik gives ha here eis D > 0 ad D > 0 such ha ma jk ij ik E j k > ep D, for all 0 < D. The, uder codiio C, i follows by Boferroi iequaliy ha here eis C > 0 ad C 3 > 0 such ha, for ay j p, ij ik E j k β k > 3 k= M h s h ma ij ik E ij ik k > 3 S3. p ma jk ij ik E j k > 3M h s h p ep C /s h, for all 0 < C 3 s h. Similarly, ma j p ma j p σ i ij ɛ i > ep C, 3 µ ij > ep C, 3 for some C > 0. Therefore, ˆβ Mj β Mj > p ep C /s h + 4 ep C. S3.3 S3.4 S3.5 The, Lemma follows by ˆβ M β M > j= ˆβ Mj β Mj >. roof of Lemma. By Karush-Kuh-Tucker codiios, he soluio β o 8 saisfies ha ˆΣ β ˆβ M = λ Z, S3.6 where Z has he form of, if β j > 0; Z =, if β j < 0; S3.7 [, ], if β j = 0.
4 S4 Simple algebra from S3.6 yields β β = Σ [ ˆβ M β M λ Z ˆΣ Σβ ˆΣ Σ β β]. S3.8 Hece, β β v p ˆβ M β M + λ Z + ˆΣ Σβ + ˆΣ Σ β β. Equivalely, v p β β ˆΣ Σ β β ˆβ M β M + λ Z + ˆΣ Σβ The, by ˆΣ Σ β β ˆΣ Σ β β, i holds ha β β > = β β >, ˆΣ Σ v p ˆβ M β M + λ Z + ˆΣ Σβ > + + ˆΣ Σ > v p ˆβ M β M > ˆΣ Σ > v p := I + II + III + IV + λ Z > + β β >, ˆΣ Σ > v p By Lemma, here eis posiive cosas C 4 ad C 5 such ha v p, ˆΣ Σ v p + ˆΣ Σβ > I p ep C 4 /s h v p + 4p ep C 5 /v p. S3.9 By he choice of λ, II = 0, whe is sufficiely large. For III, uder codiio C, ˆΣ Σβ ˆΣ Σ β M ˆΣ Σ. The, i follows from Theorem i of Cai ad Liu 0 ha, III + IV ˆΣ Σ > C 6 / p δ r q v p / / q, S3.0 6Mv p for some C 6 > 0. This complees he proof of he lemma.
5 S5 roof of Theorem. Noe ha M β = M β, ad M β,a M β = j: βj >a } j j: βj >a } j β j > a β β > a [ O ep C 7 log α α3 η + /p δ log / q α α3 η ] / q by Lemma ad he choice of a ad. Similarly, M β M β,/a = j: βj /a } j { j: βj /a β } j β j > a β β > a [ = O ep C 7 log α α3 η + /p δ log / q α α3 η ] / q. This complees he proof of he firs par of Theorem. I paricular, if we choose h = 0, M β M β = j Mβ } j j Mβ { β j β } j β j { j Mβ β } j β j / S3. = O [ep C 8 α α3 η + /p δ / q α α3 η/ q], sice uder C5, by he choice of, mi j Mβ β j > 3 for large eough. O he oher had, M β M β = j Mβ } j > = j Mβ } j β j > S3. = O [ep C 8 α α3 η + /p δ / q α α3 η/ q]. S3. ad S3. ogeher prove he heorem.
6 S6 roof of Lemma 3. The proof is aalogous o ha of Lemma. C, i holds ha Uder codiio E ij ik E j k l l [ E ij ik l + E ij ik l] = O. The, by Chebyshev Iequaliy ad Theorem i While 960. ma ij ik E j k jk > l E ij ik E j k Therefore, by replacig S3. wih ij ik E j k β k > 3 k= p ma jk ij ik E j k > 3M h s h C 9 ps l h l l, for some C 9 > 0 ad replacig S3.3 ad S3.4 wih ma σ i ij ɛ i > C 0 j p 3 l l, ma µ j p ij > C 0 3 l l, for some C 0 > 0, he res of proof follows from S3.. roof of Lemma 4. From Lemma 3, i holds ha ˆβ M β M > C p s l h vp l l l + C pvp l l l, for some C > 0 ad C > 0. l = O l l. S3.3 Uder codiio C3, i follows from Theorem ii of Cai ad Liu 0 ha, here eiss C 3 > 0 ha ˆΣ Σ > C 3 / p δ r q v p / / q + l τ. S3.4 6Mv p Replacig S3.9 ad S3.0 wih S3.3 ad S3.4 ad observig ha by he choice of λ, λ Z > = 0, whe is sufficiely large, he res of he proof resembles he proof of Lemma. roof of Theorem. The proof is he same as he proof of Theorem by replacig resuls i Lemma wih resuls i Lemma 4.
7 S7 roof of Lemma S. From S3.6, β = ˆΩ ˆβ M λ ˆΩZ. Recall ha, β = Ωβ M. Hece, β β = ˆΩ ˆβ M Ωβ M λ ˆΩZ. The, β β > ˆΩ ˆβ M Ωβ M > / + λ ˆΩZ > /. S3.5 Sice i holds ha ˆΩ ˆβ M Ωβ M = ˆΩ Ω ˆβ M + Ω ˆβ M β M, ˆΩ ˆβ M Ωβ M > / ˆΩ Ω ˆβ M > /4 + Ω ˆβ M β M > /4. S3.6 The firs iem i S3.6 is bouded by ˆΩ Ω ˆβ M > /4 ˆΩ Ω ˆβ M > /4 ˆβ M β M /8 + ˆβ M β M > /8 ˆΩ Ω β M > /8 ˆβ M β M /8 + + ˆΩ Ω ˆβ M β M > /8 ˆβ M β M /8 ˆβ M β M > /8 ˆΩ Ω > /[8M h s h ] + ˆΩ Ω > + ˆβ M β M > /8. For he secod iem i S3.6, i follows from he assumpio Ω M ha Ω ˆβ M β M > /4 Ω ˆβ M β M > /4 ˆβ M β M > /[4M]. Wihou loss of geeraliy, assume M. The, for ay 0 < < 8M h s h, β β > ˆΩ Ω > /[8M h s h ] + ˆβ M β M > /[4M], S3.7 sice λ ˆΩZ λ ˆΩ Z λ ˆΩ λ Ω M λ. By he choice of λ, whe is sufficiely large, λ ˆΩZ > / = 0. Uder C, i follows by Theorem a of Cai, Liu, ad Luo 0 ha ˆΩ Ω > /[8M h s h ] 4 ep C 4 [/s h r q ] / q, S3.8
8 S8 for some C 4 > 0. From Lemma, i holds ha ˆβ M β M > /4M p ep C 5 /s h + 4p ep C6. S3.9 S3.7, S3.8 ogeher wih S3.9 proves he lemma. roof of Lemma S. Uder codiios C ad C3, by Theorem ii of Cai, Liu, ad Luo 0. ˆΩ Ω > 8M h C [ ] q ep C [/s h r q ] + l τ. s h From Lemma 3, i holds ha ˆβ M β M > /4M C 3 p s l h l l + C 4 p l l. The res of proof follows by S3.7. roof of Theorem 3 ad Theorem 4. By usig resuls i Lemma S ad Lemma S, he proof is he same as ha of Theorem. roof of 5. Decompose Σ as Is0 Σ Σ =, Σ I p s0 where Σ = B 0. S S = S S I s 0 + S Σ I s0 + Σ. S3.0 I is well kow e.g. see Bickel ad Levia 008 ha for ormally disribued covariaes, ma s ij ρ ij = O log p, i,j p where s ij is he i, jh eleme of S. The, S Σ = ma s 0 s 0<i p j= Hece, S Σ I s0 = O s 0 log p. Moreover, S I s 0 = S I s 0 S. The, s ij ρ ij = O s 0 log p. S I s 0 S I s0 S + S I s 0 I s0 S.
9 S9 Hece, S I s 0 I s0 S / I s0 S = O s 0 log p. The, S S I s 0 S S I s 0 Σ + S Σ S I s 0 = O s 0 + s 0 log p O s 0 log p = O s 0 log p Sice Σ B + γ, uder he assumpios ha log p 0 ad s 0 is fied, i follows from S3.0 ha S S + γ. Refereces Bickel,. J. ad Levia, E Covariace regularizaio by hresholdig. The Aals of Saisics 36, Cai, T. ad Liu, W. 0. Adapive hresholdig for sparse covariace mari esimaio. Joural of he America Saisical Associaio 06, Cai, T., Liu, W., ad Luo, X. 0. A cosraied l miimizaio approach o sparse precisio mari esimaio. Joural of he America Saisical Associaio 06, While, Bouds for he momes of liear ad quadraic forms i idepede variables. Theory of robabiliy ad is Applicaios 5, 30.
Supplement for SADAGRAD: Strongly Adaptive Stochastic Gradient Methods"
Suppleme for SADAGRAD: Srogly Adapive Sochasic Gradie Mehods" Zaiyi Che * 1 Yi Xu * Ehog Che 1 iabao Yag 1. Proof of Proposiio 1 Proposiio 1. Le ɛ > 0 be fixed, H 0 γi, γ g, EF (w 1 ) F (w ) ɛ 0 ad ieraio
More informationSTK4080/9080 Survival and event history analysis
STK48/98 Survival ad eve hisory aalysis Marigales i discree ime Cosider a sochasic process The process M is a marigale if Lecure 3: Marigales ad oher sochasic processes i discree ime (recap) where (formally
More information1. Solve by the method of undetermined coefficients and by the method of variation of parameters. (4)
7 Differeial equaios Review Solve by he mehod of udeermied coefficies ad by he mehod of variaio of parameers (4) y y = si Soluio; we firs solve he homogeeous equaio (4) y y = 4 The correspodig characerisic
More informationOn the Validity of the Pairs Bootstrap for Lasso Estimators
O he Validiy of he Pairs Boosrap for Lasso Esimaors Lorezo Campoovo Uiversiy of S.Galle Ocober 2014 Absrac We sudy he validiy of he pairs boosrap for Lasso esimaors i liear regressio models wih radom covariaes
More informationOLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17
OLS bias for ecoomeric models wih errors-i-variables. The Lucas-criique Supplemeary oe o Lecure 7 RNy May 6, 03 Properies of OLS i RE models I Lecure 7 we discussed he followig example of a raioal expecaios
More informationLecture 8 April 18, 2018
Sas 300C: Theory of Saisics Sprig 2018 Lecure 8 April 18, 2018 Prof Emmauel Cades Scribe: Emmauel Cades Oulie Ageda: Muliple Tesig Problems 1 Empirical Process Viewpoi of BHq 2 Empirical Process Viewpoi
More informationMean Square Convergent Finite Difference Scheme for Stochastic Parabolic PDEs
America Joural of Compuaioal Mahemaics, 04, 4, 80-88 Published Olie Sepember 04 i SciRes. hp://www.scirp.org/joural/ajcm hp://dx.doi.org/0.436/ajcm.04.4404 Mea Square Coverge Fiie Differece Scheme for
More informationA TAUBERIAN THEOREM FOR THE WEIGHTED MEAN METHOD OF SUMMABILITY
U.P.B. Sci. Bull., Series A, Vol. 78, Iss. 2, 206 ISSN 223-7027 A TAUBERIAN THEOREM FOR THE WEIGHTED MEAN METHOD OF SUMMABILITY İbrahim Çaak I his paper we obai a Tauberia codiio i erms of he weighed classical
More informationResearch Article A Generalized Nonlinear Sum-Difference Inequality of Product Form
Joural of Applied Mahemaics Volume 03, Aricle ID 47585, 7 pages hp://dx.doi.org/0.55/03/47585 Research Aricle A Geeralized Noliear Sum-Differece Iequaliy of Produc Form YogZhou Qi ad Wu-Sheg Wag School
More informationBig O Notation for Time Complexity of Algorithms
BRONX COMMUNITY COLLEGE of he Ciy Uiversiy of New York DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE CSI 33 Secio E01 Hadou 1 Fall 2014 Sepember 3, 2014 Big O Noaio for Time Complexiy of Algorihms Time
More informationA Note on Random k-sat for Moderately Growing k
A Noe o Radom k-sat for Moderaely Growig k Ju Liu LMIB ad School of Mahemaics ad Sysems Sciece, Beihag Uiversiy, Beijig, 100191, P.R. Chia juliu@smss.buaa.edu.c Zogsheg Gao LMIB ad School of Mahemaics
More informationOnline Supplement to Reactive Tabu Search in a Team-Learning Problem
Olie Suppleme o Reacive abu Search i a eam-learig Problem Yueli She School of Ieraioal Busiess Admiisraio, Shaghai Uiversiy of Fiace ad Ecoomics, Shaghai 00433, People s Republic of Chia, she.yueli@mail.shufe.edu.c
More informationComparisons Between RV, ARV and WRV
Comparisos Bewee RV, ARV ad WRV Cao Gag,Guo Migyua School of Maageme ad Ecoomics, Tiaji Uiversiy, Tiaji,30007 Absrac: Realized Volailiy (RV) have bee widely used sice i was pu forward by Aderso ad Bollerslev
More informationFIXED FUZZY POINT THEOREMS IN FUZZY METRIC SPACE
Mohia & Samaa, Vol. 1, No. II, December, 016, pp 34-49. ORIGINAL RESEARCH ARTICLE OPEN ACCESS FIED FUZZY POINT THEOREMS IN FUZZY METRIC SPACE 1 Mohia S. *, Samaa T. K. 1 Deparme of Mahemaics, Sudhir Memorial
More informationInference of the Second Order Autoregressive. Model with Unit Roots
Ieraioal Mahemaical Forum Vol. 6 0 o. 5 595-604 Iferece of he Secod Order Auoregressive Model wih Ui Roos Ahmed H. Youssef Professor of Applied Saisics ad Ecoomerics Isiue of Saisical Sudies ad Research
More informationCOS 522: Complexity Theory : Boaz Barak Handout 10: Parallel Repetition Lemma
COS 522: Complexiy Theory : Boaz Barak Hadou 0: Parallel Repeiio Lemma Readig: () A Parallel Repeiio Theorem / Ra Raz (available o his websie) (2) Parallel Repeiio: Simplificaios ad he No-Sigallig Case
More information10.3 Autocorrelation Function of Ergodic RP 10.4 Power Spectral Density of Ergodic RP 10.5 Normal RP (Gaussian RP)
ENGG450 Probabiliy ad Saisics for Egieers Iroducio 3 Probabiliy 4 Probabiliy disribuios 5 Probabiliy Desiies Orgaizaio ad descripio of daa 6 Samplig disribuios 7 Ifereces cocerig a mea 8 Comparig wo reames
More informationExtremal graph theory II: K t and K t,t
Exremal graph heory II: K ad K, Lecure Graph Theory 06 EPFL Frak de Zeeuw I his lecure, we geeralize he wo mai heorems from he las lecure, from riagles K 3 o complee graphs K, ad from squares K, o complee
More informationA Note on Prediction with Misspecified Models
ITB J. Sci., Vol. 44 A, No. 3,, 7-9 7 A Noe o Predicio wih Misspecified Models Khresha Syuhada Saisics Research Divisio, Faculy of Mahemaics ad Naural Scieces, Isiu Tekologi Badug, Jala Gaesa Badug, Jawa
More informationSamuel Sindayigaya 1, Nyongesa L. Kennedy 2, Adu A.M. Wasike 3
Ieraioal Joural of Saisics ad Aalysis. ISSN 48-9959 Volume 6, Number (6, pp. -8 Research Idia Publicaios hp://www.ripublicaio.com The Populaio Mea ad is Variace i he Presece of Geocide for a Simple Birh-Deah-
More informationB. Maddah INDE 504 Simulation 09/02/17
B. Maddah INDE 54 Simulaio 9/2/7 Queueig Primer Wha is a queueig sysem? A queueig sysem cosiss of servers (resources) ha provide service o cusomers (eiies). A Cusomer requesig service will sar service
More informationAn interesting result about subset sums. Nitu Kitchloo. Lior Pachter. November 27, Abstract
A ieresig resul abou subse sums Niu Kichloo Lior Pacher November 27, 1993 Absrac We cosider he problem of deermiig he umber of subses B f1; 2; : : :; g such ha P b2b b k mod, where k is a residue class
More informationSolutions to selected problems from the midterm exam Math 222 Winter 2015
Soluios o seleced problems from he miderm eam Mah Wier 5. Derive he Maclauri series for he followig fucios. (cf. Pracice Problem 4 log( + (a L( d. Soluio: We have he Maclauri series log( + + 3 3 4 4 +...,
More informationSome Properties of Semi-E-Convex Function and Semi-E-Convex Programming*
The Eighh Ieraioal Symposium o Operaios esearch ad Is Applicaios (ISOA 9) Zhagjiajie Chia Sepember 2 22 29 Copyrigh 29 OSC & APOC pp 33 39 Some Properies of Semi-E-Covex Fucio ad Semi-E-Covex Programmig*
More informationIdeal Amplifier/Attenuator. Memoryless. where k is some real constant. Integrator. System with memory
Liear Time-Ivaria Sysems (LTI Sysems) Oulie Basic Sysem Properies Memoryless ad sysems wih memory (saic or dyamic) Causal ad o-causal sysems (Causaliy) Liear ad o-liear sysems (Lieariy) Sable ad o-sable
More information1 Notes on Little s Law (l = λw)
Copyrigh c 26 by Karl Sigma Noes o Lile s Law (l λw) We cosider here a famous ad very useful law i queueig heory called Lile s Law, also kow as l λw, which assers ha he ime average umber of cusomers i
More informationFour equations describe the dynamic solution to RBC model. Consumption-leisure efficiency condition. Consumption-investment efficiency condition
LINEARIZING AND APPROXIMATING THE RBC MODEL SEPTEMBER 7, 200 For f( x, y, z ), mulivariable Taylor liear expasio aroud ( x, yz, ) f ( x, y, z) f( x, y, z) + f ( x, y, z)( x x) + f ( x, y, z)( y y) + f
More informationBEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS
BEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS Opimal ear Forecasig Alhough we have o meioed hem explicily so far i he course, here are geeral saisical priciples for derivig he bes liear forecas, ad
More informationAsymptotic statistics for multilayer perceptron with ReLu hidden units
ESANN 8 proceedigs, Europea Symposium o Arificial Neural Neworks, Compuaioal Ielligece ad Machie Learig. Bruges (Belgium), 5-7 April 8, i6doc.com publ., ISBN 978-8758747-6. Available from hp://www.i6doc.com/e/.
More informationMath 6710, Fall 2016 Final Exam Solutions
Mah 67, Fall 6 Fial Exam Soluios. Firs, a sude poied ou a suble hig: if P (X i p >, he X + + X (X + + X / ( evaluaes o / wih probabiliy p >. This is roublesome because a radom variable is supposed o be
More informationLecture 9: Polynomial Approximations
CS 70: Complexiy Theory /6/009 Lecure 9: Polyomial Approximaios Isrucor: Dieer va Melkebeek Scribe: Phil Rydzewski & Piramaayagam Arumuga Naiar Las ime, we proved ha o cosa deph circui ca evaluae he pariy
More informationNEWTON METHOD FOR DETERMINING THE OPTIMAL REPLENISHMENT POLICY FOR EPQ MODEL WITH PRESENT VALUE
Yugoslav Joural of Operaios Research 8 (2008, Number, 53-6 DOI: 02298/YUJOR080053W NEWTON METHOD FOR DETERMINING THE OPTIMAL REPLENISHMENT POLICY FOR EPQ MODEL WITH PRESENT VALUE Jeff Kuo-Jug WU, Hsui-Li
More information2 f(x) dx = 1, 0. 2f(x 1) dx d) 1 4t t6 t. t 2 dt i)
Mah PracTes Be sure o review Lab (ad all labs) There are los of good quesios o i a) Sae he Mea Value Theorem ad draw a graph ha illusraes b) Name a impora heorem where he Mea Value Theorem was used i he
More informationA note on deviation inequalities on {0, 1} n. by Julio Bernués*
A oe o deviaio iequaliies o {0, 1}. by Julio Berués* Deparameo de Maemáicas. Faculad de Ciecias Uiversidad de Zaragoza 50009-Zaragoza (Spai) I. Iroducio. Le f: (Ω, Σ, ) IR be a radom variable. Roughly
More informationActuarial Society of India
Acuarial Sociey of Idia EXAMINAIONS Jue 5 C4 (3) Models oal Marks - 5 Idicaive Soluio Q. (i) a) Le U deoe he process described by 3 ad V deoe he process described by 4. he 5 e 5 PU [ ] PV [ ] ( e ).538!
More informationFermat Numbers in Multinomial Coefficients
1 3 47 6 3 11 Joural of Ieger Sequeces, Vol. 17 (014, Aricle 14.3. Ferma Numbers i Muliomial Coefficies Shae Cher Deparme of Mahemaics Zhejiag Uiversiy Hagzhou, 31007 Chia chexiaohag9@gmail.com Absrac
More informationMathematical Statistics. 1 Introduction to the materials to be covered in this course
Mahemaical Saisics Iroducio o he maerials o be covered i his course. Uivariae & Mulivariae r.v s 2. Borl-Caelli Lemma Large Deviaios. e.g. X,, X are iid r.v s, P ( X + + X where I(A) is a umber depedig
More informationOrder Determination for Multivariate Autoregressive Processes Using Resampling Methods
joural of mulivariae aalysis 57, 175190 (1996) aricle o. 0028 Order Deermiaio for Mulivariae Auoregressive Processes Usig Resamplig Mehods Chaghua Che ad Richard A. Davis* Colorado Sae Uiversiy ad Peer
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 4 9/16/2013. Applications of the large deviation technique
MASSACHUSETTS ISTITUTE OF TECHOLOGY 6.265/5.070J Fall 203 Lecure 4 9/6/203 Applicaios of he large deviaio echique Coe.. Isurace problem 2. Queueig problem 3. Buffer overflow probabiliy Safey capial for
More informationFour equations describe the dynamic solution to RBC model. Consumption-leisure efficiency condition. Consumption-investment efficiency condition
LINEAR APPROXIMATION OF THE BASELINE RBC MODEL FEBRUARY, 202 Iroducio For f(, y, z ), mulivariable Taylor liear epasio aroud (, yz, ) f (, y, z) f(, y, z) + f (, y, z)( ) + f (, y, z)( y y) + f (, y, z)(
More informationThe analysis of the method on the one variable function s limit Ke Wu
Ieraioal Coferece o Advaces i Mechaical Egieerig ad Idusrial Iformaics (AMEII 5) The aalysis of he mehod o he oe variable fucio s i Ke Wu Deparme of Mahemaics ad Saisics Zaozhuag Uiversiy Zaozhuag 776
More informationCalculus Limits. Limit of a function.. 1. One-Sided Limits...1. Infinite limits 2. Vertical Asymptotes...3. Calculating Limits Using the Limit Laws.
Limi of a fucio.. Oe-Sided..... Ifiie limis Verical Asympoes... Calculaig Usig he Limi Laws.5 The Squeeze Theorem.6 The Precise Defiiio of a Limi......7 Coiuiy.8 Iermediae Value Theorem..9 Refereces..
More informationApproximating Solutions for Ginzburg Landau Equation by HPM and ADM
Available a hp://pvamu.edu/aam Appl. Appl. Mah. ISSN: 193-9466 Vol. 5, No. Issue (December 1), pp. 575 584 (Previously, Vol. 5, Issue 1, pp. 167 1681) Applicaios ad Applied Mahemaics: A Ieraioal Joural
More informationSolution. 1 Solutions of Homework 6. Sangchul Lee. April 28, Problem 1.1 [Dur10, Exercise ]
Soluio Sagchul Lee April 28, 28 Soluios of Homework 6 Problem. [Dur, Exercise 2.3.2] Le A be a sequece of idepede eves wih PA < for all. Show ha P A = implies PA i.o. =. Proof. Noice ha = P A c = P A c
More informationFORBIDDING HAMILTON CYCLES IN UNIFORM HYPERGRAPHS
FORBIDDING HAMILTON CYCLES IN UNIFORM HYPERGRAPHS JIE HAN AND YI ZHAO Absrac For d l
More informationODEs II, Supplement to Lectures 6 & 7: The Jordan Normal Form: Solving Autonomous, Homogeneous Linear Systems. April 2, 2003
ODEs II, Suppleme o Lecures 6 & 7: The Jorda Normal Form: Solvig Auoomous, Homogeeous Liear Sysems April 2, 23 I his oe, we describe he Jorda ormal form of a marix ad use i o solve a geeral homogeeous
More informationarxiv: v3 [math.st] 8 Mar 2018
arxiv: arxiv:1801.05565 Robus Modificaios of U-saisics ad Applicaios o Covariace Esimaio Problems Saislav Miser 1,* ad Xiaoha Wei,** 1 Deparme of Mahemaics, Uiversiy of Souher Califoria, Los Ageles, CA
More informationLINEAR APPROXIMATION OF THE BASELINE RBC MODEL JANUARY 29, 2013
LINEAR APPROXIMATION OF THE BASELINE RBC MODEL JANUARY 29, 203 Iroducio LINEARIZATION OF THE RBC MODEL For f( x, y, z ) = 0, mulivariable Taylor liear expasio aroud f( x, y, z) f( x, y, z) + f ( x, y,
More informationOn The Eneström-Kakeya Theorem
Applied Mahemaics,, 3, 555-56 doi:436/am673 Published Olie December (hp://wwwscirporg/oural/am) O The Eesröm-Kakeya Theorem Absrac Gulsha Sigh, Wali Mohammad Shah Bharahiar Uiversiy, Coimbaore, Idia Deparme
More informationComparison between Fourier and Corrected Fourier Series Methods
Malaysia Joural of Mahemaical Scieces 7(): 73-8 (13) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES Joural homepage: hp://eispem.upm.edu.my/oural Compariso bewee Fourier ad Correced Fourier Series Mehods 1
More informationSUMMATION OF INFINITE SERIES REVISITED
SUMMATION OF INFINITE SERIES REVISITED I several aricles over he las decade o his web page we have show how o sum cerai iiie series icludig he geomeric series. We wa here o eed his discussio o he geeral
More informationLinear System Theory
Naioal Tsig Hua Uiversiy Dearme of Power Mechaical Egieerig Mid-Term Eamiaio 3 November 11.5 Hours Liear Sysem Theory (Secio B o Secio E) [11PME 51] This aer coais eigh quesios You may aswer he quesios
More informationLINEAR APPROXIMATION OF THE BASELINE RBC MODEL SEPTEMBER 17, 2013
LINEAR APPROXIMATION OF THE BASELINE RBC MODEL SEPTEMBER 7, 203 Iroducio LINEARIZATION OF THE RBC MODEL For f( xyz,, ) = 0, mulivariable Taylor liear expasio aroud f( xyz,, ) f( xyz,, ) + f( xyz,, )( x
More informationMATH 507a ASSIGNMENT 4 SOLUTIONS FALL 2018 Prof. Alexander. g (x) dx = g(b) g(0) = g(b),
MATH 57a ASSIGNMENT 4 SOLUTIONS FALL 28 Prof. Alexader (2.3.8)(a) Le g(x) = x/( + x) for x. The g (x) = /( + x) 2 is decreasig, so for a, b, g(a + b) g(a) = a+b a g (x) dx b so g(a + b) g(a) + g(b). Sice
More informationLecture 15 First Properties of the Brownian Motion
Lecure 15: Firs Properies 1 of 8 Course: Theory of Probabiliy II Term: Sprig 2015 Isrucor: Gorda Zikovic Lecure 15 Firs Properies of he Browia Moio This lecure deals wih some of he more immediae properies
More informationDynamic h-index: the Hirsch index in function of time
Dyamic h-idex: he Hirsch idex i fucio of ime by L. Egghe Uiversiei Hassel (UHassel), Campus Diepebeek, Agoralaa, B-3590 Diepebeek, Belgium ad Uiversiei Awerpe (UA), Campus Drie Eike, Uiversieisplei, B-260
More informationTAKA KUSANO. laculty of Science Hrosh tlnlersty 1982) (n-l) + + Pn(t)x 0, (n-l) + + Pn(t)Y f(t,y), XR R are continuous functions.
Iera. J. Mah. & Mah. Si. Vol. 6 No. 3 (1983) 559-566 559 ASYMPTOTIC RELATIOHIPS BETWEEN TWO HIGHER ORDER ORDINARY DIFFERENTIAL EQUATIONS TAKA KUSANO laculy of Sciece Hrosh llersy 1982) ABSTRACT. Some asympoic
More informationBAYESIAN ESTIMATION METHOD FOR PARAMETER OF EPIDEMIC SIR REED-FROST MODEL. Puji Kurniawan M
BAYESAN ESTMATON METHOD FOR PARAMETER OF EPDEMC SR REED-FROST MODEL Puji Kuriawa M447 ABSTRACT. fecious diseases is a impora healh problem i he mos of couries, belogig o doesia. Some of ifecious diseases
More informationBRIDGE ESTIMATOR AS AN ALTERNATIVE TO DICKEY- PANTULA UNIT ROOT TEST
The 0 h Ieraioal Days of Saisics ad Ecoomics Prague Sepember 8-0 06 BRIDGE ESTIMATOR AS AN ALTERNATIVE TO DICKEY- PANTULA UNIT ROOT TEST Hüseyi Güler Yeliz Yalҫi Çiğdem Koşar Absrac Ecoomic series may
More informationAvailable online at J. Math. Comput. Sci. 4 (2014), No. 4, ISSN:
Available olie a hp://sci.org J. Mah. Compu. Sci. 4 (2014), No. 4, 716-727 ISSN: 1927-5307 ON ITERATIVE TECHNIQUES FOR NUMERICAL SOLUTIONS OF LINEAR AND NONLINEAR DIFFERENTIAL EQUATIONS S.O. EDEKI *, A.A.
More informationThe Moment Approximation of the First Passage Time for the Birth Death Diffusion Process with Immigraton to a Moving Linear Barrier
America Joural of Applied Mahemaics ad Saisics, 015, Vol. 3, No. 5, 184-189 Available olie a hp://pubs.sciepub.com/ajams/3/5/ Sciece ad Educaio Publishig DOI:10.1691/ajams-3-5- The Mome Approximaio of
More informationF D D D D F. smoothed value of the data including Y t the most recent data.
Module 2 Forecasig 1. Wha is forecasig? Forecasig is defied as esimaig he fuure value ha a parameer will ake. Mos scieific forecasig mehods forecas he fuure value usig pas daa. I Operaios Maageme forecasig
More information11. Adaptive Control in the Presence of Bounded Disturbances Consider MIMO systems in the form,
Lecure 6. Adapive Corol i he Presece of Bouded Disurbaces Cosider MIMO sysems i he form, x Aref xbu x Bref ycmd (.) y Cref x operaig i he presece of a bouded ime-depede disurbace R. All he assumpios ad
More informationxp (X = x) = P (X = 1) = θ. Hence, the method of moments estimator of θ is
Exercise 7 / page 356 Noe ha X i are ii from Beroulli(θ where 0 θ a Meho of momes: Sice here is oly oe parameer o be esimae we ee oly oe equaio where we equae he rs sample mome wih he rs populaio mome,
More informationSemiparametric and Nonparametric Methods in Political Science Lecture 1: Semiparametric Estimation
Semiparameric ad Noparameric Mehods i Poliical Sciece Lecure : Semiparameric Esimaio Michael Peress, Uiversiy of Rocheser ad Yale Uiversiy Lecure : Semiparameric Mehods Page 2 Overview of Semi ad Noparameric
More information6/10/2014. Definition. Time series Data. Time series Graph. Components of time series. Time series Seasonal. Time series Trend
6//4 Defiiio Time series Daa A ime series Measures he same pheomeo a equal iervals of ime Time series Graph Compoes of ime series 5 5 5-5 7 Q 7 Q 7 Q 3 7 Q 4 8 Q 8 Q 8 Q 3 8 Q 4 9 Q 9 Q 9 Q 3 9 Q 4 Q Q
More informationOutline. simplest HMM (1) simple HMMs? simplest HMM (2) Parameter estimation for discrete hidden Markov models
Oulie Parameer esimaio for discree idde Markov models Juko Murakami () ad Tomas Taylor (2). Vicoria Uiversiy of Welligo 2. Arizoa Sae Uiversiy Descripio of simple idde Markov models Maximum likeliood esimae
More informationSolutions to Problems 3, Level 4
Soluios o Problems 3, Level 4 23 Improve he resul of Quesio 3 whe l. i Use log log o prove ha for real >, log ( {}log + 2 d log+ P ( + P ( d 2. Here P ( is defied i Quesio, ad parial iegraio has bee used.
More informationSIGNAL estimation has been a fundamental problem in a
90 IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, VOL., NO. 3, SEPTEMBER 06 A Olie Parallel Algorihm for Recursive Esimaio of Sparse Sigals Yag Yag, Member, IEEE, Marius Pesaveo,
More informationSkewness of Gaussian Mixture Absolute Value GARCH(1, 1) Model
Commuicaios for Saisical Applicaios ad Mehods 203, Vol. 20, No. 5, 395 404 DOI: hp://dx.doi.org/0.535/csam.203.20.5.395 Skewess of Gaussia Mixure Absolue Value GARCH(, Model Taewook Lee,a a Deparme of
More informationPENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD
PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.
More informationA Probabilistic Nearest Neighbor Filter for m Validated Measurements.
A Probabilisic Neares Neighbor iler for m Validaed Measuremes. ae Lyul Sog ad Sag Ji Shi ep. of Corol ad Isrumeaio Egieerig, Hayag Uiversiy, Sa-og 7, Asa, Kyuggi-do, 45-79, Korea Absrac - he simples approach
More informationRegularity conditions
Statistica Siica: Supplemet MEASUREMENT ERROR IN LASSO: IMPACT AND LIKELIHOOD BIAS CORRECTION Øystei Sørese, Aroldo Frigessi ad Mage Thorese Uiversity of Oslo Supplemetary Material This ote cotais proofs
More informationBasic Results in Functional Analysis
Preared by: F.. ewis Udaed: Suday, Augus 7, 4 Basic Resuls i Fucioal Aalysis f ( ): X Y is coiuous o X if X, (, ) z f( z) f( ) f ( ): X Y is uiformly coiuous o X if i is coiuous ad ( ) does o deed o. f
More informationElectrical Engineering Department Network Lab.
Par:- Elecrical Egieerig Deparme Nework Lab. Deermiaio of differe parameers of -por eworks ad verificaio of heir ierrelaio ships. Objecive: - To deermie Y, ad ABD parameers of sigle ad cascaded wo Por
More informationInstitute of Actuaries of India
Isiue of cuaries of Idia Subjec CT3-robabiliy ad Mahemaical Saisics May 008 Eamiaio INDICTIVE SOLUTION Iroducio The idicaive soluio has bee wrie by he Eamiers wih he aim of helig cadidaes. The soluios
More informationIf boundary values are necessary, they are called mixed initial-boundary value problems. Again, the simplest prototypes of these IV problems are:
3. Iiial value problems: umerical soluio Fiie differeces - Trucaio errors, cosisecy, sabiliy ad covergece Crieria for compuaioal sabiliy Explici ad implici ime schemes Table of ime schemes Hyperbolic ad
More informationApproximately Quasi Inner Generalized Dynamics on Modules. { } t t R
Joural of Scieces, Islamic epublic of Ira 23(3): 245-25 (22) Uiversiy of Tehra, ISSN 6-4 hp://jscieces.u.ac.ir Approximaely Quasi Ier Geeralized Dyamics o Modules M. Mosadeq, M. Hassai, ad A. Nikam Deparme
More informationDavid Randall. ( )e ikx. k = u x,t. u( x,t)e ikx dx L. x L /2. Recall that the proof of (1) and (2) involves use of the orthogonality condition.
! Revised April 21, 2010 1:27 P! 1 Fourier Series David Radall Assume ha u( x,) is real ad iegrable If he domai is periodic, wih period L, we ca express u( x,) exacly by a Fourier series expasio: ( ) =
More informationSolutions Manual 4.1. nonlinear. 4.2 The Fourier Series is: and the fundamental frequency is ω 2π
Soluios Maual. (a) (b) (c) (d) (e) (f) (g) liear oliear liear liear oliear oliear liear. The Fourier Series is: F () 5si( ) ad he fudameal frequecy is ω f ----- H z.3 Sice V rms V ad f 6Hz, he Fourier
More informationUNIVERSITY OF NOTTINGHAM. Discussion Papers in Economics
UNIVERSITY OF NOTTINGHAM Discussio Papers i Ecoomics Discussio Paper No. /9 JAMES-STEIN TYPE ESTIMATORS IN LARGE SAMPLES WITH APPLICATION TO THE LEAST ABSOLUTE DEVIATION ESTIMATOR by Tae-Hwa Kim ad Halber
More informationECE 570 Session 7 IC 752-E Computer Aided Engineering for Integrated Circuits. Transient analysis. Discuss time marching methods used in SPICE
ECE 570 Sessio 7 IC 75-E Compuer Aided Egieerig for Iegraed Circuis Trasie aalysis Discuss ime marcig meods used i SPICE. Time marcig meods. Explici ad implici iegraio meods 3. Implici meods used i circui
More informationExercise 3 Stochastic Models of Manufacturing Systems 4T400, 6 May
Exercise 3 Sochasic Models of Maufacurig Sysems 4T4, 6 May. Each week a very popular loery i Adorra pris 4 ickes. Each ickes has wo 4-digi umbers o i, oe visible ad he oher covered. The umbers are radomly
More informationCHARACTERIZATIONS OF THE NON-UNIFORM IN TIME ISS PROPERTY AND APPLICATIONS
CHARACTERIZATIONS OF THE NON-UNIFORM IN TIME ISS PROPERTY AND APPLICATIONS I. Karafyllis ad J. Tsiias Depare of Maheaics, Naioal Techical Uiversiy of Ahes, Zografou Capus 578, Ahes, Greece Eail: jsi@ceral.ua.gr.
More informationThe Connection between the Basel Problem and a Special Integral
Applied Mahemaics 4 5 57-584 Published Olie Sepember 4 i SciRes hp://wwwscirporg/joural/am hp://ddoiorg/436/am45646 The Coecio bewee he Basel Problem ad a Special Iegral Haifeg Xu Jiuru Zhou School of
More informationCSE 202: Design and Analysis of Algorithms Lecture 16
CSE 202: Desig ad Aalysis of Algorihms Lecure 16 Isrucor: Kamalia Chaudhuri Iequaliy 1: Marov s Iequaliy Pr(X=x) Pr(X >= a) 0 x a If X is a radom variable which aes o-egaive values, ad a > 0, he Pr[X a]
More informationThe periodogram of fractional processes
The periodogram of fracioal processes Carlos Velasco y Deparameo de Ecoomía Uiversidad Carlos III de Madrid December 4, 2005 Absrac We aalyze asympoic properies of he discree Fourier rasform ad he periodogram
More informationOn the distribution of the ψ 2 -norm of linear functionals on isotropic convex bodies
O he disribuio of he ψ 2 -orm of liear fucioals o isoropic covex bodies A. Giaopoulos, G. Paouris ad P. Valeas Absrac I is ow ha every isoropic covex body K i R has a subgaussia direcio wih cosa r = O(
More informationThe Uniqueness Theorem for Inverse Nodal Problems with a Chemical Potential
Iraia J. Mah. Chem. 8 4 December 7 43 4 Iraia Joural of Mahemaical Chemisr Joural homepage: www.imc.ashau.ac.ir The Uiueess Theorem for Iverse Nodal Problems wih a Chemical Poeial SEYFOLLAH MOSAZADEH Deparme
More informationBoundary-to-Displacement Asymptotic Gains for Wave Systems With Kelvin-Voigt Damping
Boudary-o-Displaceme Asympoic Gais for Wave Sysems Wih Kelvi-Voig Dampig Iasso Karafyllis *, Maria Kooriaki ** ad Miroslav Krsic *** * Dep. of Mahemaics, Naioal Techical Uiversiy of Ahes, Zografou Campus,
More informationλiv Av = 0 or ( λi Av ) = 0. In order for a vector v to be an eigenvector, it must be in the kernel of λi
Liear lgebra Lecure #9 Noes This week s lecure focuses o wha migh be called he srucural aalysis of liear rasformaios Wha are he irisic properies of a liear rasformaio? re here ay fixed direcios? The discussio
More informationhal , version 5-4 Oct 2012
Auhor mauscrip, published i "Advaces i Applied Probabiliy 13 3" ERROR BOUNDS FOR SMALL JUMPS OF LÉVY PROCESSES EL HADJ ALY DIA Absrac The pricig of opios i expoeial Lévy models amous o he compuaio of expecaios
More informationA Bayesian Approach for Detecting Outliers in ARMA Time Series
WSEAS RASACS o MAEMAICS Guochao Zhag Qigmig Gui A Bayesia Approach for Deecig Ouliers i ARMA ime Series GUOC ZAG Isiue of Sciece Iformaio Egieerig Uiversiy 45 Zhegzhou CIA 94587@qqcom QIGMIG GUI Isiue
More informationAN EXTENSION OF LUCAS THEOREM. Hong Hu and Zhi-Wei Sun. (Communicated by David E. Rohrlich)
Proc. Amer. Mah. Soc. 19(001, o. 1, 3471 3478. AN EXTENSION OF LUCAS THEOREM Hog Hu ad Zhi-Wei Su (Commuicaed by David E. Rohrlich Absrac. Le p be a prime. A famous heorem of Lucas saes ha p+s p+ ( s (mod
More informationFourier transform. Continuous-time Fourier transform (CTFT) ω ω
Fourier rasform Coiuous-ime Fourier rasform (CTFT P. Deoe ( he Fourier rasform of he sigal x(. Deermie he followig values, wihou compuig (. a (0 b ( d c ( si d ( d d e iverse Fourier rasform for Re { (
More informationThe universal vector. Open Access Journal of Mathematical and Theoretical Physics [ ] Introduction [ ] ( 1)
Ope Access Joural of Mahemaical ad Theoreical Physics Mii Review The uiversal vecor Ope Access Absrac This paper akes Asroheology mahemaics ad pus some of i i erms of liear algebra. All of physics ca be
More informationEXISTENCE THEORY OF RANDOM DIFFERENTIAL EQUATIONS D. S. Palimkar
Ieraioal Joural of Scieific ad Research Publicaios, Volue 2, Issue 7, July 22 ISSN 225-353 EXISTENCE THEORY OF RANDOM DIFFERENTIAL EQUATIONS D S Palikar Depare of Maheaics, Vasarao Naik College, Naded
More informationCalculus BC 2015 Scoring Guidelines
AP Calculus BC 5 Scorig Guidelies 5 The College Board. College Board, Advaced Placeme Program, AP, AP Ceral, ad he acor logo are regisered rademarks of he College Board. AP Ceral is he official olie home
More informationK3 p K2 p Kp 0 p 2 p 3 p
Mah 80-00 Mo Ar 0 Chaer 9 Fourier Series ad alicaios o differeial equaios (ad arial differeial equaios) 9.-9. Fourier series defiiio ad covergece. The idea of Fourier series is relaed o he liear algebra
More informationL-functions and Class Numbers
L-fucios ad Class Numbers Sude Number Theory Semiar S. M.-C. 4 Sepember 05 We follow Romyar Sharifi s Noes o Iwasawa Theory, wih some help from Neukirch s Algebraic Number Theory. L-fucios of Dirichle
More information