An Analysis of State Evolution for Approximate Message Passing with Side Information
|
|
- Dale Russell
- 5 years ago
- Views:
Transcription
1 A Aalysis of Sae Evoluio for Approxiae Message Passig wih Side Iforaio Hagji Liu NC Sae Uiversiy Eail: Cyhia Rush Colubia Uiversiy Eail: Dror Baro NC Sae Uiversiy Eail: Absrac A coo goal i ay research areas is o recosruc a ukow sigal x fro oisy liear easurees. Approxiae essage passig AMP is a class of low-coplexiy algorihs for efficiely solvig such high-diesioal regressio asks. Ofe, i is he case ha side iforaio SI is available durig recosrucio. For his reaso a ovel algorihic fraework ha icorporaes SI io AMP, referred o as approxiae essage passig wih side iforaio AMP-SI, has bee recely iroduced. A aracive feaure of AMP is ha whe he elees of he sigal are exchageable, he eries of he easuree arix are idepede ad ideically disribued i.i.d. Gaussia, ad he deoiser applies he sae o-lieariy a each ery, he perforace of AMP ca be prediced accuraely by a scalar ieraio referred o as sae evoluio SE. However, he AMP-SI fraework uses differe ery-wise scalar deoisers, based o he ery-wise level of he SI, ad herefore is o suppored by he sadard AMP heory. I his work, we provide rigorous perforace guaraees for AMP-SI whe he ipu sigal ad SI are draw i.i.d. accordig o soe joi disribuio subjec o fiie oe cosrais. Moreover, we provide uerical exaples o suppor he heory which deosrae epirically ha he SE ca predic he AMP- SI ea square error accuraely. I. INTRODUCTION High-diesioal liear regressio is a well-sudied odel ha has bee used i ay applicaios icludig copressed sesig, iagig, ad achie learig ad saisics 3. The ukow sigal x R is viewed hrough he liear odel: y Ax + w, where y R are he easurees, A R is a kow easuree arix, ad w R is easuree oise. The goal is o esiae he ukow sigal x havig kowledge oly of he oisy easurees y ad he easuree arix A. Whe he proble is uder-deeried i.e., <, i order for recosrucio o be successful, i is ecessary o exploi srucural or probabilisic characerisics of he ipu sigal x. Ofe a prior disribuio o he ipu sigal x is assued, ad i his case approxiae essage passig AMP algorihs ca be used for he recosrucio ask. AMP, 4 is a class of low-coplexiy algorihs for efficiely solvig high-diesioal regressio asks. AMP works by ieraively geeraig esiaes of he ukow ipu vecor, x, usig a possibly o-liear deoiser fucio ailored o ay prior kowledge abou x. Oe favorable feaure of AMP is ha uder soe echical codiios o he easuree arix A ad x, he observaios a each ieraio of he algorih are alos surely equal i disribuio o x plus idepede ad ideically disribued i.i.d. Gaussia oise i he large syse i. AMP wih Side Iforaio AMP-SI: I iforaio heory 5, whe differe couicaio syses share side iforaio SI, overall couicaio ca becoe ore efficie. Recely 6, 7, a ovel algorihic fraework, referred o as AMP-SI, has bee iroduced for icorporaig SI io AMP for high-diesioal regressio asks. AMP- SI has bee epirically deosraed o have good recosrucio qualiy ad is easy o use. For exaple, we have proposed o use AMP-SI for chael esiaio i eergig ileer wave couicaio syses 8, where he ie dyaics of he chael srucure allow previous chael esiaes o be used as SI whe esiaig he curre chael srucure 7. We odel each ery of he observed SI, deoed by x R, as depedig saisically o he correspodig ery of he ukow sigal x hrough soe joi probabiliy desiy fucio pdf, fx, X. AMP-SI uses a codiioal deoiser, η : R R, o icorporae SI, η a, b EX X + λ Z a, X b. The AMP-SI algorih ieraively updaes esiaes of he ipu sigal x: le x 0 0, he all-zeros vecor, he r y Ax + r η δ x + A T r, x, 3 x + η x + A T r, x, 4 where x R is he esiae of ipu sigal a ieraio, ad he deoiser i is applied ery-wise o vecor ipus. The derivaive η s,. s η s,. is wih respec o he firs ipu, ad v is he epirical average of a vecor v, i.e., v v i. Usig he deoiser i, he AMP-SI algorih 3-4 provides he iiu ea squared error MMSE esiae of he sigal whe SI X is available 6. Sae Evoluio SE: I has bee prove ha he perforace of AMP, as easured, for exaple, by he oralized squared l -error x x bewee he esiae x ad rue sigal x, ca be accuraely prediced by a scalar recursio referred as SE 9, 0 whe he easuree arix A is i.i.d. Gaussia uder various assupios o he elees of he sigal. The SE equaio for AMP-SI is as follows. Assue
2 he eries of he oise w are i.i.d. fw wih σw EW, ad le λ 0 σw + EX /δ. The for 0, λ σw + δ E η X + λ Z, X X, 5 where X, X fx, X are idepede of Z N 0,, where we use N µ, σ o deoe a Gaussia disribuio wih ea µ ad variace σ. Cosiderig AMP-SI 3-4, however, we cao direcly apply he exisig AMP heoreical resuls 9, 0, as he codiioal deoiser depeds o he idex i hrough he SI, eaig ha differe scalar deoisers will be used a differe idices wihi he AMP-SI ieraios. Rece resuls, however, exed he asypoic SE aalysis o a larger class of possible deoisers, allowig, for exaple, each elee of he ipu o use a differe o-liear deoiser as is he case i AMP-SI. We eploy hese resuls o rigorously relae he SE preseed i 5 o he AMP-SI algorih i 3-4. Relaed Work: While iegraig SI io recosrucio algorihs is o ew, AMP-SI iroduces a uified fraework wihi AMP supporig arbirary sigal ad SI depedecies. Prior work usig SI has bee eiher heurisic, ied o specific applicaios, or ouside he AMP fraework. For exaple, Wag ad Liag iegrae SI io AMP for a specific sigal prior desiy, bu he ehod is difficul o apply o oher sigal odels. Ziiel ad Schier 3 develop a AMP-based recosrucio algorih for a ie-varyig sigal odel based o Markov processes for he suppor ad apliude. This sigal odel is easily icorporaed io he AMP-SI fraework as discussed i he aalysis of he birhdeah-drif odel of 6, 7. Maoel e al. iplee a AMP-based algorih i which he ipu sigal is repeaedly recosruced i a sreaig fashio, ad iforaio fro pas recosrucio aeps is aggregaed io a prior, hus iprovig ogoig recosrucio resuls 4. This recosrucio schee resebles ha of AMP-SI, i paricular whe he Beroulli-Gaussia odel is used see Secio II-B. Coribuio ad Oulie: Ma e al. use uerical experies o show ha SE 5 accuraely racks he perforace of AMP-SI 3-4 7, as was show rigorously for sadard AMP. Ma e al. cojecure ha rigorous heoreical guaraees ca be give for AMP-SI as well 7. I his work, we aalyze AMP-SI perforace whe he ipu sigal ad SI are draw i.i.d. accordig o a geeral pdf fx, X obeyig soe fiie oe codiios, he AMP-SI deoiser is Lipschiz, ad he easuree arix A is i.i.d. Gaussia. I Secio II, we give he ai resuls, exaples for various sigal ad SI odels, ad uerical experies coparig he epirical perforace of AMP-SI ad he SE predicios. The proof of our ai heore is provided i Secio III. A. Mai Theore II. MAIN RESULTS Our ai resul provides AMP-SI perforace guaraees whe cosiderig pseudo-lipschiz loss fucios, which we defie i he followig. Defiiio II.. Pseudo-Lipschiz fucios 9: For k N >0 ad ay N >0, a fucio φ : R R is pseudo-lipschiz of order k if here exiss a cosa L, referred o as he pseudo-lipschiz cosa of φ, such ha for ay x, y R, φx φy L + x k + y k x y. 6 For k, his defiiio coicides wih he sadard defiiio of a Lipschiz fucio. Throughou his work, deoes he Euclidea or. We are ow ready o sae our ai resul. Throughou he paper we le p deoe covergece i probabiliy. Theore II.. For ay order k pseudo-lipschiz fucios φ : R R ad ψ : R 3 R, assue he followig. A The easuree arix A has i.i.d. Gaussia eries wih ea 0 ad variace /. A The oise w is i.i.d. fw wih fiie E W k. A3 The sigal ad SI X, X are sapled i.i.d. fro fx, X wih fiie E X k, fiie E X k, ad fiie E X X. A4 For 0, he deoisers η, defied i are Lipschiz coiuous, eaig for scalars a, a, b, b, ad cosa L > 0, The, η a, b η a, b L a, b a, b. φri, w i p E φw + λ σw Z, W, ψx i + A T r i, x i, x i p E ψx + λ Z, X, X, 7 where Z, Z are sadard Gaussias, idepede of W fw ad X, X fx, X. I he above, x ad r are defied i he AMP-SI recursio 3-4, ad λ i he SE 5. Secio III coais he proof of Theore II.. The proof follows fro Berhier e al., Theore 4 ad he srog law of large ubers. The ai echical deails ivolve showig ha our assupios A A4 are eough o saisfy he assupios eeded for, Theore 4. The deails are give i Secio III. As a cocree exaple of how Theore II. provides perforace guaraees for AMP-SI, le us cosider a few ieresig pseudo-lipschiz loss fucios. Corollary II... Uder assupios A A4, leig ψ : R 3 R be he l loss, ψ x, y, z x y, he by Theore II., x + A T r x p λ, where λ is defied i 5. Siilarly if ψ : R 3 R is defied as ψ x, y, z η x, z y, he by Theore II. x+ x p δλ σ w.
3 B. Exaples Nex, we cosider a few sigal ad SI odels o show how oe ca derive he deoiser i, use his o cosruc he AMP-SI algorih ad he SE, ad apply Theore II.. Before we ge o he exaples we sae a lea ha allows us kow abou how fucios wih bouded derivaive are Lipschiz. Lea II.. A fucio φ : R derivaives, 0 < D, D <, x φx, y D ad R havig bouded y φx, y D is Lipschiz coiuous wih Lipschiz cosa D + D. Proof. The resul follows usig he Triagle Iequaliy ad Cauchy-Schwarz, φx, y φx, y φx, y φx, y + φx, y φx, y φx, y φx, y + φx, y φx, y D y y +D x x D + D y y + x x D + D x, y x, y. Gaussia-Gaussia Sigal ad SI: I his odel, referred o as he GG odel heceforh, he sigal has i.i.d. Gaussia eries wih zero ea ad fiie variace ad we have access o SI i he for of he sigal wih addiive whie Gaussia oise AWGN. The sigal, X, ad SI, X, are relaed by X X + N 0, σ I. 9 I his case, he AMP-SI deoiser equals 7 η a, b E XX + λ Z a, X b σ xσ a + σxλ b σxσ + λ + σ λ. 8 0 The he SE 5 ca be copued as λ σw + σxσ λ δ σxσ + λ + σ λ. We oe ha he deoiser i 0 is Lipschiz coiuous as a resul of Lea II. because η σ a, b xσ σxσ + λ + σ λ, ad b η a, b σ xλ σxσ + λ + σ λ, ad herefore he assupios A A5 are saisfied i he GG case ad we ca apply Thoere II.. Beroulli-Gaussia Sigal ad SI: The Beroulli- Gaussia BG odel reflecs sceario i which oe wishes o recover a sparse sigal ad has access o SI i he for of he sigal wih AWGN as i 9. I his odel, each ery of he sigal is idepedely geeraed accordig o x i ɛn 0, + ɛδ 0, where δ 0 is he Dirac dela fucio a 0. I words, he eries of he sigal idepedely ake he value 0 wih probabiliy ɛ ad are N 0, wih probabiliy ɛ. I his case, he AMP-SI deoiser equals 7 η a, b E XX + λ Z a, X b Pr X 0 a, b E X a, b, X 0 σ a + λ b Pr X 0 a, b σ + λ + σ λ, where, leig ρ τ x be he zero-ea Gaussia desiy wih variace τ evaluaed a x, ad defiig ν : σ λ σ +λ + σ λ, where we deoe PrX 0 a, b + T a,b, 3 ɛρ λ T a,b : aρ σ b b ɛρ +σ bρ σ +σ +λ +σ a ɛ σ + λ + σ λ ɛ λ σ { σ a + λ exp b } σ λ σ + λ + σ λ ɛ ν π ɛ λ σ ρ ν σ a + λ b, 4 The he SE 5 ca be copued as λ σw + Ta,b σ + λ + σ λ δ + T a,b σ + λ + σ λ. 5 We agai use Lea II. o show ha he deoiser defied i ad 3 is Lipschiz coiuous so ha he assupios A A5 are saisfied i he BG case ad we ca apply Thoere II.. We sudy he parial derivaives. Deoe Cobiig 3 ad 4 ad 6, σ a + λ b f a,b : σ + λ + σ λ. 6 η a, b + T a,b f a,b. The, η a, b fa,b Ta,b + T a,b + T a,b f a,b + T a,b f a,b T a,b f a,b + T a,b + + T a,b. 7
4 Now we show upperbouds for he wo ers of 7 separaely. For he firs er, we see ha f a,b, so + T a,b f a,b + T a,b. Now we cosider he secod er of Cosider he secod er of 7. Firs we oe ha Ta,b + T a,b f a,b + T. a,b f a,b T a,b f a,b The fro 4 ad 6, ɛ T a,b f a,b πσ a + λ bρ ν σ a + λ b, ɛ he usig ha x ρ τ x x τ ρ τ x, we have σ π ρ ν σ a + λ b σ σ a + λ b ρ ν σ a + λ b ν ɛ πσ ρ ν σ a + λ b ɛ ν ν σ a + λ b. T a,b f a,b ɛ ɛ 8 To upper boud he above, we use exp{ x} +x whe x 0, ad so ρ τ x { x } exp πτ τ π τ τ + x. Usig his i 8, we fid σ T ɛ ν σ a + λ a,b f a,b b ν ɛ ν + σ a + λ b σ ɛ ɛ, ν ɛ σ w ɛ where i he fial iequaliy we use λ σ w by 5, ad σ σ ν λ σ + λ + σ λ λ. + λ σ + λ λ Usig he above i 7, we have η a, b + As i 7 we ca show b η a, b + T a,b + T a,b b f a,b The, + ɛ. σ w ɛ + T a,b Ta,b b f a,b + T a,b + T a,b b f a,b, 9 0, + b T a,b f a,b ad a boud as i 8-9 gives + b T a,b + T a,b Ta,b b f a,b C. Nuerical Exaples f a,b b λ ɛ ν σ a + λ b ν ɛ ν + σ a + λ b λ ɛ ɛ. ν ɛ σɛ T a,b f a,b Fially, we provide uerical resuls o copare he epirical ea square error MSE perforace of AMP-SI ad he perforace prediced by SE. Fig. shows he MSE achieved by AMP-SI i he GG sceario ad he SE predicio of is perforace. I his exaple, he sigal variace σx, he easuree oise variace σw 0.0, he variace of AWGN i SI σ We averaged over 0 rials of a GG recovery proble for epirical resuls of AMP-SI. The copariso i Fig. a, Fig. b ad Fig. c give by hree differe sigal legh. For saller here is soe gap bewee he epirical MSE ad he SE predicio, as show i Fig. for 00, bu he gap shriks as is icreased. The resuls show he epirical MSE racks he SE predicio icely. Fig. shows he MSE achieved by AMP-SI i he BG sceario, ad he SE predicio of is perforace. We agai averaged over 0 rials of a BG recovery proble for epirical resuls of AMP-SI. The sigal legh 0000, 3000, he easuree oise variace σw 0.0, ad ɛ 0., where 0% of he eries i he sigal are ozero. We vary he variace of AWGN i SI fro σ 0.04, σ 0.5, ad σ. The resuls show ha SE ca predic he MSE achieved by AMP-SI a every ieraio. III. PROOF OF THEOREM II. Proof of The proof Theore II. coais wo seps. I he firs sep we use Berhier e al., Theore 4 ad i he secod sep we ake a appeal o he srog law of large ubers SLLN. We reid he reader of he srog law: Defiiio III.. Srog Law of Large Nubers 5: Le X, X,... be a sequece of i.i.d. rado variables wih fiie ea µ. The Pr X + X X µ, I words, he parial averages X +X +...+X coverge alos surely o µ <. A. Sep We will ake use of Berhier e al., Theore 4, resaed here for coveiece. Before proceedig we iclude a defiiio of uiforly pseudo-lipschiz fucios, ha geeralizes he ideal of pseudo-lipschiz fucios give i Defiiio II.. Defiiio III.. Uiforly pseudo-lipschiz fucios : A sequece i of pseudo-lipschiz fucios {φ } N>0
5 5 0 AMP-SI Epirical wih 0.04 AMP-SI Epirical wih 0.5 AMP-SI Epirical wih SE Predicio AMP-SI Epirical wih 00 SE Predicio wih 00 MSE db MSE db MSE db MSE db Ieraio a 00 AMP-SI Epirical wih 000 SE Predicio wih Ieraio b 000 AMP-SI Epirical wih 0000 SE Predicio wih Ieraio c 0000 Fig. : Epirical MSE perforace of AMP-SI ad SE predicio. GG odel, δ 0.3, σ x, σ w 0., ad σ Ieraio Fig. : Epirical MSE perforace of AMP-SI ad SE predicio. BG odel, 0000, 3000, ɛ 0., σ w 0.. is called uiforly pseudo-lipschiz of order k if, deoig by L is he pseudo-lipschiz cosa of order k of φ, we have L < for each ad sup L <. Berhier e al., Theore 4 requires he followig assupios: C The easuree arix A has Gaussia eries wih i.i.d. ea 0 ad variace /. C Defie a sequece of deoisers η : R R o be hose ha apply he deoiser η defied i elee-wise o vecor ipu: η X : η X, X. For each, η are uiforly Lipschiz. A fucio is uiforly Lipschiz i if he Lipschiz cosa does o deped o. C3 x / coverges o a cosa as. C4 The i σ w w / is fiie. C5 For ay ieraios s, N ad for ay covariace arix Σ, he followig is exis. E Z x i η x i + Z i, x i <, E Z,Z η x i + Z i, x i η s x i + Z i, x i <, where Z, Z N0, Σ I, wih deoig he esor produc ad I he ideiy arix. Theore III.. Uder he assupios C C5, for ay sequeces of uiforly pseudo-lipschiz fucios φ : R R R ad ψ : R R R, φ r, w E Z φ w + λ σ w Z, w ψ x + A T r, x E Z ψ x + λ Z, x p 0, p 0, where Z N 0, I, Z N 0, I, x ad r are defied i he AMP-SI recursio 3-4, ad λ i he SE 5. Now we deosrae ha our assupios A A4 saed i Secio II are eough o saisfy he assupios C C6 eeded o apply Theore III..
6 Assupios A ad C are ideical. We will show ha C follows fro A4, C4 follows fro A, ad C3 follows fro A3. Fially we show C5 ad C6 follow fro A3 ad A4. Firs cosider assupio C. The o-separable deoiser η X η X, X applies he AMP-SI deoiser defied i erywise o is vecor ipus. Fro A4, {η, } 0 are Lipschiz coiuous. Thus, for legh- vecors x, x, ad fixed SI x, η x η x η x i, x i η x i, x i ad so L x i x i L x x, η x η x L x x. The Lipschiz cosa does o deped o, so η is uiforly Lipschiz. Now cosider assupio C4. Fro A, he easuree oise w i has i.i.d. eries wih zero-ea ad fiie E W k. The applyig Defiiio III., w wi σw <, where we have used ha σw < follows fro E W k < for k. The proof of C3 siilarly follows usig he SLLN ad he fiieess of E X k give i assupio A3. We ow show ha C5 is e. Recall Z N 0, σzi. Defie y i : x i E Z η x i + Z i, x i for i,,...,. By assupio A3, he sigal ad side iforaio X, X are sapled i.i.d. fro he joi desiy fx, X. I follows ha y, y,..., y are also i.i.d., so by Defiiio III. if EXη X + Z, X < where Z N 0, σz idepede of X, X fx, X, he x i E Z η x i + Z i, x i EXη X + Z, X, We will ow show ha EXη X + Z, X <. Firs oe ha A4 assues η, is Lipschiz, eaig for scalars a, a, b, b ad soe cosa L > 0, η a, b η a, b L a, b a, b Therefore leig a b 0 we have L a a + L b b. η a, b η 0, 0 η a, b η 0, 0 L a +L b, givig he follows upper boud for cosa L > 0, η a, b L + a + b. Now usig ad he riagle iequaliy, EXη X + Z, X L E X + X + Z + X L E X + EX + E X E Z + E X X. 3 Fially, by assupio A3 we have ha E X k, E X k ad E X X are all fiie. The oig ha for ay rado variable, Y, we have Y r + Y k for r k, eaig E Y r < + E Y k he boudedes of EXη X + Z, X follows fro 3 wih assupio A3. The proof of C6 follows siilarly o he proof of C5. Recall Z, Z N0, Σ I. Defie y i : E Z,Z η x i + Z i, x i η s x i +Z i, x i for i,,...,. By assupio A3, he sigal ad side iforaio X, X are sapled i.i.d. fro he joi desiy fx, X. I follows ha y, y,..., y are also i.i.d., so by Defiiio III. if Eη X + Z, Xη s X + Z, X < where Z N 0, σ z ad Z N 0, σ z, idepede of X, X fx, X, he E Z,Z η x i + Z i, x i η s x i + Z i, x i Eη X + Z, Xη s X + Z, X. We will ow show ha Eη X + Z, Xη s X + Z, X <. Usig he boud, Eη X + Z, Xη s X + Z, X E η X + Z, X η s X + Z, X L E + X + Z + X + X + Z + X. The usig he riagle iequaliy, E + X + Z + X + X + Z + X E + X + Z + X + X + Z + X + E X + E X + E X X + EX + E X + E X Z + E X Z + E X Z + E X Z + E Z + E Z + E Z Z + E X + E X + E X X + EX + E X + E Z + E X + E X + E Z + E X + E X + E ZZ. 4 Fially we apply Theore III. o he sequeces of uiforly pseudo-lipschiz fucios φ : R R R ad ψ : R R R defied as follows: for vecors a, b R ad x, y, x R, ad φ a, b : φa i, b i, ψ x, y : ψx i, y i, x i, 5 where φ ad ψ are he pseudo-lipschiz fucios defied i Theore II.. This he gives he resul
7 ad φri, w i p E Z φw i + λ σw Z, w i, ψ x i + A T r i, x i, x i p E Z ψ x i + λ Z, x i, x i. 6 7 As a fial sep, we show ha he fucios defied i 5 are uiforly pseudo-lipschiz as eeded o apply Theore III.. Usig ha φ : R R is pseudo-lipschiz of order k, eaig for vecors a, a, b, b R, ay idex i,,..., φa i, ã i φb i, b i L + ai, ã i k + bi, b i k ai, ã i b i, b i, where L > 0 is soe cosa. The usig he above, Nex, oe ha for vecors v, w R we have v i + w i k v i + w i k. The, a i, ã i k ai + ã i k a i + ã i k a + ã k a, ã k, 30 where he fial sep follows sice by a, ã k we ea o hik of he objec a, ã R R as sigle legh vecor, so a, ã k a i + ã i k a + ã k 3 Now puig 9 ad 30 io 8 we have he desired resul, φ a, ã φ b, b L + a, ã k + b, b k a, ã b, b. 3 B. Sep φ a, ã φ b, b φa i, ã i φb i, b i L + ai, ã i k + bi, b i k ai, ã i b i, b i L + a i, ã i k + b i, b i k a i, ã i b i, b i 8 where he fial sep follows by Cauchy-Schwarz. Firs oe a i, ã i b i, b i a i b i + ã i b i a, ã b, b 9 where a, ã b, b cosiders he objec a, ã R R o be a sigle legh vecor, so a, ã b, b a b + ã b. Now cosider he sep resul 6, our fial goal is do deosrae a.s. E E Z φw i + λ σw Z, w i φw + λ σw Z, W, E Z ψx i + λ Z, x i, x i a.s. E ψx + λ Z, X, X. The resul follows by he SLLN Defiiio III. so log as EφW + λ σ w Z, W ad EψX + λ Z, X, X are boh fiie. Recall, if φ : R R, is a pseudo-lipschiz fucio of order k, he here is a cosa L > 0 such ha for all x R : φx L + x k 9. Usig his, φ W + λ σw Z, W L + W + λ σw Z, W k/ L + 6k/ W k + 4k/ λ σw k/ Z k, 33
8 where we have used ha W + λ σw k Z, W k W + λ σw Z + W 3W + λ σwz k 6 k W k + k λ σ w k Z k. The, usig 33, ad he boudedess of E W k by A, EφW + λ σw Z, W L + 3k X k + 6k/ λk Z k + 3k/ 3 3 X k, 34 where we have used ha X + λ Z, X, X k X + λ Z + X + X k/ 3X + λ Z + X k/ 3 k X k + 6k/ 3 λk Z k + 3k/ 3 X k. Therefore, usig 34, ad he boudedess of E X k ad E X k assued i A3, EψX + λ Z, X, X L + 3 k E X k + 6k/ 3 λk E Z k + 3 3k/ E X k <. ACKNOWLEDGMENT We hak You Joe Zhou for isighful coversaios ad valuable advice. I addiio, Liu ad Baro ackowledge suppor fro NSF EECS #6. REFERENCES D. L. Dooho, A. Maleki, ad A. Moaari. Message passig algorihs for copressed sesig. Proc. Na. Acadey Sci., 0645: , Nov H. Arguello ad G. Arce. Code aperure opiizaio for specrally agile copressive iagig. J. Op. Soc. A., 8:400 43, Nov T. Hasie, R. Tibshirai, ad J. H. Frieda. The Elees of Saisical Learig. Spriger, Aug S. Raga. Geeralized approxiae essage passig for esiaio wih rado liear ixig. Arxiv prepri arxiv:00.54, Oc T. M. Cover ad J. A. Thoas. Elees of Iforaio Theory. New York, NY, USA: Wiley-Iersciece, D. Baro, A. Ma, D. Needell, C. Rush, ad T. Woolf. Codiioal approxiae essage passig wih side iforaio. I Proc. IEEE Asiloar Cof. Sigals, Sys. Copu., A. Ma, Y. Zhou, C. Rush, D. Baro, ad D. Needell. A approxiae essage passig fraework for side iforaio. arxiv: , Jul A. Saleh ad R. Valezuela. A saisical odel for idoor ulipah propagaio. IEEE J. Selec. Areas Cou., 5:8 37, Feb M. Bayai ad A. Moaari. The dyaics of essage passig o dese graphs, wih applicaios o copressed sesig. IEEE Tras. If. Theory, 57: , Feb C. Rush ad R. Vekaaraaa. Fiie saple aalysis of approxiae L + 6 k E W k + 4 k essage passig algorihs. IEEE Tras. If. Theory, 64:764 λ σw k E Z k 786, Nov. 08. <. R. Berhier, A. Moaari, ad P. M. Nguye. Sae evoluio for approxiae essage passig wih o-separable fucios. arxiv: , Siilarly, we have he upper boud, ψx+λ Z, X, X L + X + λ Z, X, X / Aug. 07. X. Wag ad J. Liag. Approxiae essage passig-based copressed k 3 sesig recosrucio wih geeralized elasic e prior. Sigal Process. Iage, 37:9 33, Sep J. Ziiel ad P. Schier. Dyaic copressive sesig of ie-varyig sigals via approxiae essage passig. IEEE Tras. Sigal Process., 6: , Nov Adre Maoel, Flore Krzakala, Eric W Trael, ad Leka Zdeborová. Sreaig bayesia iferece: heoreical is ad ii-bach approxiae essage-passig. I Couicaio, Corol, ad Copuig Allero, 07 55h Aual Allero Coferece o, pages IEEE, J. S. Rosehal. A Firs Look a Rigorous Probabiliy Theory. World Scieific Publishig Co. Pe. Ld., secod ediio, 006.
Ideal Amplifier/Attenuator. Memoryless. where k is some real constant. Integrator. System with memory
Liear Time-Ivaria Sysems (LTI Sysems) Oulie Basic Sysem Properies Memoryless ad sysems wih memory (saic or dyamic) Causal ad o-causal sysems (Causaliy) Liear ad o-liear sysems (Lieariy) Sable ad o-sable
More informationBEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS
BEST LINEAR FORECASTS VS. BEST POSSIBLE FORECASTS Opimal ear Forecasig Alhough we have o meioed hem explicily so far i he course, here are geeral saisical priciples for derivig he bes liear forecas, ad
More informationEXISTENCE THEORY OF RANDOM DIFFERENTIAL EQUATIONS D. S. Palimkar
Ieraioal Joural of Scieific ad Research Publicaios, Volue 2, Issue 7, July 22 ISSN 225-353 EXISTENCE THEORY OF RANDOM DIFFERENTIAL EQUATIONS D S Palikar Depare of Maheaics, Vasarao Naik College, Naded
More informationBE.430 Tutorial: Linear Operator Theory and Eigenfunction Expansion
BE.43 Tuorial: Liear Operaor Theory ad Eigefucio Expasio (adaped fro Douglas Lauffeburger) 9//4 Moivaig proble I class, we ecouered parial differeial equaios describig rasie syses wih cheical diffusio.
More informationSupplement for SADAGRAD: Strongly Adaptive Stochastic Gradient Methods"
Suppleme for SADAGRAD: Srogly Adapive Sochasic Gradie Mehods" Zaiyi Che * 1 Yi Xu * Ehog Che 1 iabao Yag 1. Proof of Proposiio 1 Proposiio 1. Le ɛ > 0 be fixed, H 0 γi, γ g, EF (w 1 ) F (w ) ɛ 0 ad ieraio
More informationOnline Supplement to Reactive Tabu Search in a Team-Learning Problem
Olie Suppleme o Reacive abu Search i a eam-learig Problem Yueli She School of Ieraioal Busiess Admiisraio, Shaghai Uiversiy of Fiace ad Ecoomics, Shaghai 00433, People s Republic of Chia, she.yueli@mail.shufe.edu.c
More informationSTK4080/9080 Survival and event history analysis
STK48/98 Survival ad eve hisory aalysis Marigales i discree ime Cosider a sochasic process The process M is a marigale if Lecure 3: Marigales ad oher sochasic processes i discree ime (recap) where (formally
More informationMoment Generating Function
1 Mome Geeraig Fucio m h mome m m m E[ ] x f ( x) dx m h ceral mome m m m E[( ) ] ( ) ( x ) f ( x) dx Mome Geeraig Fucio For a real, M () E[ e ] e k x k e p ( x ) discree x k e f ( x) dx coiuous Example
More informationCHARACTERIZATIONS OF THE NON-UNIFORM IN TIME ISS PROPERTY AND APPLICATIONS
CHARACTERIZATIONS OF THE NON-UNIFORM IN TIME ISS PROPERTY AND APPLICATIONS I. Karafyllis ad J. Tsiias Depare of Maheaics, Naioal Techical Uiversiy of Ahes, Zografou Capus 578, Ahes, Greece Eail: jsi@ceral.ua.gr.
More informationComparison between Fourier and Corrected Fourier Series Methods
Malaysia Joural of Mahemaical Scieces 7(): 73-8 (13) MALAYSIAN JOURNAL OF MATHEMATICAL SCIENCES Joural homepage: hp://eispem.upm.edu.my/oural Compariso bewee Fourier ad Correced Fourier Series Mehods 1
More informationMath 6710, Fall 2016 Final Exam Solutions
Mah 67, Fall 6 Fial Exam Soluios. Firs, a sude poied ou a suble hig: if P (X i p >, he X + + X (X + + X / ( evaluaes o / wih probabiliy p >. This is roublesome because a radom variable is supposed o be
More informationFIXED FUZZY POINT THEOREMS IN FUZZY METRIC SPACE
Mohia & Samaa, Vol. 1, No. II, December, 016, pp 34-49. ORIGINAL RESEARCH ARTICLE OPEN ACCESS FIED FUZZY POINT THEOREMS IN FUZZY METRIC SPACE 1 Mohia S. *, Samaa T. K. 1 Deparme of Mahemaics, Sudhir Memorial
More informationThe Central Limit Theorem
The Ceral Limi Theorem The ceral i heorem is oe of he mos impora heorems i probabiliy heory. While here a variey of forms of he ceral i heorem, he mos geeral form saes ha give a sufficiely large umber,
More informationPaper Introduction. ~ Modelling the Uncertainty in Recovering Articulation from Acoustics ~ Korin Richmond, Simon King, and Paul Taylor.
Paper Iroducio ~ Modellig he Uceraiy i Recoverig Ariculaio fro Acousics ~ Kori Richod, Sio Kig, ad Paul Taylor Tooi Toda Noveber 6, 2003 Proble Addressed i This Paper Modellig he acousic-o-ariculaory appig
More informationExtremal graph theory II: K t and K t,t
Exremal graph heory II: K ad K, Lecure Graph Theory 06 EPFL Frak de Zeeuw I his lecure, we geeralize he wo mai heorems from he las lecure, from riagles K 3 o complee graphs K, ad from squares K, o complee
More informationApproximate Message Passing with Consistent Parameter Estimation and Applications to Sparse Learning
Approximae Message Passig wih Cosise Parameer Esimaio ad Applicaios o Sparse Learig Ulugbek S. Kamilov EPFL ulugbek.kamilov@epfl.ch Sudeep Raga Polyechic Isiue of New York Uiversiy sraga@poly.edu Alyso
More informationth m m m m central moment : E[( X X) ] ( X X) ( x X) f ( x)
1 Trasform Techiques h m m m m mome : E[ ] x f ( x) dx h m m m m ceral mome : E[( ) ] ( ) ( x) f ( x) dx A coveie wa of fidig he momes of a radom variable is he mome geeraig fucio (MGF). Oher rasform echiques
More informationEnergy Density / Energy Flux / Total Energy in 1D. Key Mathematics: density, flux, and the continuity equation.
ecure Phys 375 Eergy Desiy / Eergy Flu / oal Eergy i D Overview ad Moivaio: Fro your sudy of waves i iroducory physics you should be aware ha waves ca raspor eergy fro oe place o aoher cosider he geeraio
More information10.3 Autocorrelation Function of Ergodic RP 10.4 Power Spectral Density of Ergodic RP 10.5 Normal RP (Gaussian RP)
ENGG450 Probabiliy ad Saisics for Egieers Iroducio 3 Probabiliy 4 Probabiliy disribuios 5 Probabiliy Desiies Orgaizaio ad descripio of daa 6 Samplig disribuios 7 Ifereces cocerig a mea 8 Comparig wo reames
More informationSolution. 1 Solutions of Homework 6. Sangchul Lee. April 28, Problem 1.1 [Dur10, Exercise ]
Soluio Sagchul Lee April 28, 28 Soluios of Homework 6 Problem. [Dur, Exercise 2.3.2] Le A be a sequece of idepede eves wih PA < for all. Show ha P A = implies PA i.o. =. Proof. Noice ha = P A c = P A c
More information1 Notes on Little s Law (l = λw)
Copyrigh c 26 by Karl Sigma Noes o Lile s Law (l λw) We cosider here a famous ad very useful law i queueig heory called Lile s Law, also kow as l λw, which assers ha he ime average umber of cusomers i
More informationLecture 15 First Properties of the Brownian Motion
Lecure 15: Firs Properies 1 of 8 Course: Theory of Probabiliy II Term: Sprig 2015 Isrucor: Gorda Zikovic Lecure 15 Firs Properies of he Browia Moio This lecure deals wih some of he more immediae properies
More informationODEs II, Supplement to Lectures 6 & 7: The Jordan Normal Form: Solving Autonomous, Homogeneous Linear Systems. April 2, 2003
ODEs II, Suppleme o Lecures 6 & 7: The Jorda Normal Form: Solvig Auoomous, Homogeeous Liear Sysems April 2, 23 I his oe, we describe he Jorda ormal form of a marix ad use i o solve a geeral homogeeous
More informationIntroduction to Mobile Robotics Mapping with Known Poses
Iroducio o Mobile Roboics Mappig wih Kow Poses Wolfra Burgard Cyrill Sachiss Mare Beewi Kai Arras Why Mappig? Learig aps is oe of he fudaeal probles i obile roboics Maps allow robos o efficiely carry ou
More informationA quadratic convergence method for the management equilibrium model
(IJACSA Ieraioal Joural of Advaced Copuer Sciece ad Applicaios Vol No 9 03 A quadraic covergece ehod for he aagee equilibriu odel Jiayi Zhag Feixia School Liyi Uiversiy Feixia Shadog PRChia Absrac i his
More informationNotes 03 largely plagiarized by %khc
1 1 Discree-Time Covoluio Noes 03 largely plagiarized by %khc Le s begi our discussio of covoluio i discree-ime, sice life is somewha easier i ha domai. We sar wih a sigal x[] ha will be he ipu io our
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.265/15.070J Fall 2013 Lecture 4 9/16/2013. Applications of the large deviation technique
MASSACHUSETTS ISTITUTE OF TECHOLOGY 6.265/5.070J Fall 203 Lecure 4 9/6/203 Applicaios of he large deviaio echique Coe.. Isurace problem 2. Queueig problem 3. Buffer overflow probabiliy Safey capial for
More informationN! AND THE GAMMA FUNCTION
N! AND THE GAMMA FUNCTION Cosider he produc of he firs posiive iegers- 3 4 5 6 (-) =! Oe calls his produc he facorial ad has ha produc of he firs five iegers equals 5!=0. Direcly relaed o he discree! fucio
More informationCLOSED FORM EVALUATION OF RESTRICTED SUMS CONTAINING SQUARES OF FIBONOMIAL COEFFICIENTS
PB Sci Bull, Series A, Vol 78, Iss 4, 2016 ISSN 1223-7027 CLOSED FORM EVALATION OF RESTRICTED SMS CONTAINING SQARES OF FIBONOMIAL COEFFICIENTS Emrah Kılıc 1, Helmu Prodiger 2 We give a sysemaic approach
More informationK3 p K2 p Kp 0 p 2 p 3 p
Mah 80-00 Mo Ar 0 Chaer 9 Fourier Series ad alicaios o differeial equaios (ad arial differeial equaios) 9.-9. Fourier series defiiio ad covergece. The idea of Fourier series is relaed o he liear algebra
More informationMathematical Statistics. 1 Introduction to the materials to be covered in this course
Mahemaical Saisics Iroducio o he maerials o be covered i his course. Uivariae & Mulivariae r.v s 2. Borl-Caelli Lemma Large Deviaios. e.g. X,, X are iid r.v s, P ( X + + X where I(A) is a umber depedig
More informationA Note on Prediction with Misspecified Models
ITB J. Sci., Vol. 44 A, No. 3,, 7-9 7 A Noe o Predicio wih Misspecified Models Khresha Syuhada Saisics Research Divisio, Faculy of Mahemaics ad Naural Scieces, Isiu Tekologi Badug, Jala Gaesa Badug, Jawa
More informationSamuel Sindayigaya 1, Nyongesa L. Kennedy 2, Adu A.M. Wasike 3
Ieraioal Joural of Saisics ad Aalysis. ISSN 48-9959 Volume 6, Number (6, pp. -8 Research Idia Publicaios hp://www.ripublicaio.com The Populaio Mea ad is Variace i he Presece of Geocide for a Simple Birh-Deah-
More informationActuarial Society of India
Acuarial Sociey of Idia EXAMINAIONS Jue 5 C4 (3) Models oal Marks - 5 Idicaive Soluio Q. (i) a) Le U deoe he process described by 3 ad V deoe he process described by 4. he 5 e 5 PU [ ] PV [ ] ( e ).538!
More informationE will be denoted by n
JASEM ISSN 9-8362 All rigs reserved Full-ex Available Olie a p:// wwwbiolieorgbr/ja J Appl Sci Eviro Mg 25 Vol 9 3) 3-36 Corollabiliy ad Null Corollabiliy of Liear Syses * DAVIES, I; 2 JACKREECE, P Depare
More informationIn this section we will study periodic signals in terms of their frequency f t is said to be periodic if (4.1)
Fourier Series Iroducio I his secio we will sudy periodic sigals i ers o heir requecy is said o be periodic i coe Reid ha a sigal ( ) ( ) ( ) () or every, where is a uber Fro his deiiio i ollows ha ( )
More informationB. Maddah INDE 504 Simulation 09/02/17
B. Maddah INDE 54 Simulaio 9/2/7 Queueig Primer Wha is a queueig sysem? A queueig sysem cosiss of servers (resources) ha provide service o cusomers (eiies). A Cusomer requesig service will sar service
More informationWILD Estimating Abundance for Closed Populations with Mark-Recapture Methods
WILD 50 - Esiaig Abudace for Closed Populaios wih Mark-Recapure Mehods Readig: Chaper 4 of WNC book (especially secios 4. & 4.) Esiaig N is uch ore difficul ha you igh iiially expec A variey of ehods ca
More informationMean Square Convergent Finite Difference Scheme for Stochastic Parabolic PDEs
America Joural of Compuaioal Mahemaics, 04, 4, 80-88 Published Olie Sepember 04 i SciRes. hp://www.scirp.org/joural/ajcm hp://dx.doi.org/0.436/ajcm.04.4404 Mea Square Coverge Fiie Differece Scheme for
More informationb : the two eigenvectors of the Grover iteration Quantum counting algorithm
.5.3. Quau couig algorih How quickly ca we deerie he uber of arge saes i Grover s algorih, i.e. arked saes, r, o a N= daa base search proble, if r is o kow i advace. Classical search ~ ( N ) Quau search
More informationON THE CONVERGENCE OF DECOMPOSITION METHODS FOR MULTISTAGE STOCHASTIC CONVEX PROGRAMS
ON THE CONVERGENCE OF DECOMPOSITION METHODS FOR MULTISTAGE STOCHASTIC CONVEX PROGRAMS P. GIRARDEAU, V. LECLERE, AND A. B. PHILPOTT Absrac. We prove he alos-sure covergece of a class of sapligbased esed
More informationProcessamento Digital de Sinal
Deparaeo de Elecróica e Telecouicações da Uiversidade de Aveiro Processaeo Digial de ial Processos Esocásicos uar ado Processes aioar ad ergodic Correlaio auo ad cross Fucio Covariace Fucio Esiaes of he
More informationA TAUBERIAN THEOREM FOR THE WEIGHTED MEAN METHOD OF SUMMABILITY
U.P.B. Sci. Bull., Series A, Vol. 78, Iss. 2, 206 ISSN 223-7027 A TAUBERIAN THEOREM FOR THE WEIGHTED MEAN METHOD OF SUMMABILITY İbrahim Çaak I his paper we obai a Tauberia codiio i erms of he weighed classical
More informationECE 901 Lecture 4: Estimation of Lipschitz smooth functions
ECE 9 Lecture 4: Estiatio of Lipschitz sooth fuctios R. Nowak 5/7/29 Cosider the followig settig. Let Y f (X) + W, where X is a rado variable (r.v.) o X [, ], W is a r.v. o Y R, idepedet of X ad satisfyig
More informationThe Importance of Ordering the Number of Lattice Points Inside a Rational Polyhedron Using Generating Functions
Ieraioal Joural of Copuer Sciece ad Elecroics Egieerig (IJCSEE Volue Issue ( ISSN 48 (Olie he Iporace of Orderig he Nuber of Laice ois Iside a Raioal olyhedro Usig Geeraig Fucios Halil Sopce Absrac I pure
More informationSUMMATION OF INFINITE SERIES REVISITED
SUMMATION OF INFINITE SERIES REVISITED I several aricles over he las decade o his web page we have show how o sum cerai iiie series icludig he geomeric series. We wa here o eed his discussio o he geeral
More informationA note on deviation inequalities on {0, 1} n. by Julio Bernués*
A oe o deviaio iequaliies o {0, 1}. by Julio Berués* Deparameo de Maemáicas. Faculad de Ciecias Uiversidad de Zaragoza 50009-Zaragoza (Spai) I. Iroducio. Le f: (Ω, Σ, ) IR be a radom variable. Roughly
More information1. Solve by the method of undetermined coefficients and by the method of variation of parameters. (4)
7 Differeial equaios Review Solve by he mehod of udeermied coefficies ad by he mehod of variaio of parameers (4) y y = si Soluio; we firs solve he homogeeous equaio (4) y y = 4 The correspodig characerisic
More informationNew Class of Estimators of Population Mean. DECISION SCIENCES INSTITUTE New Class of Estimators of Population Mean Utilizing Median of Study Variable
New lass of Esiaors of Poulaio Mea DEISION SIENES INSTITUTE New lass of Esiaors of Poulaio Mea Uilizig Media of Sudy Variable S.K. Yadav Dr. RML Avadh Uiversiy drskysas@gail.co Diesh K. Shara Uiversiy
More informationChapter 3 Moments of a Distribution
Chaper 3 Moes of a Disribuio Epecaio We develop he epecaio operaor i ers of he Lebesgue iegral. Recall ha he Lebesgue easure λ(a) for soe se A gives he legh/area/volue of he se A. If A = (3; 7), he λ(a)
More informationImprovement Over General And Wider Class of Estimators Using Ranked Set Sampling
ITERATIOAL JOURAL OF SIETIFI & TEOLOG RESEAR VOLUME ISSUE 7 AUGUST ISS 77-866 Iprovee Over Geeral Ad ider lass of Esiaors Usi Raked Se Sapli V L Madoara iu Meha Raka Absrac: I his paper Iprovee over eeral
More informationRecursive Identification of Hammerstein Systems with Polynomial Function Approximation
Ieraioal Joural of Maagee ad Fuzzy Syses 7; 3(6): 87-94 hp://www.sciecepublishiggroup.co//ifs doi:.648/.ifs.736. ISSN: 575-4939 (Pri); ISSN: 575-4947 (Olie) Research/echical Noe Recursive Ideificaio of
More informationCOS 522: Complexity Theory : Boaz Barak Handout 10: Parallel Repetition Lemma
COS 522: Complexiy Theory : Boaz Barak Hadou 0: Parallel Repeiio Lemma Readig: () A Parallel Repeiio Theorem / Ra Raz (available o his websie) (2) Parallel Repeiio: Simplificaios ad he No-Sigallig Case
More informationF D D D D F. smoothed value of the data including Y t the most recent data.
Module 2 Forecasig 1. Wha is forecasig? Forecasig is defied as esimaig he fuure value ha a parameer will ake. Mos scieific forecasig mehods forecas he fuure value usig pas daa. I Operaios Maageme forecasig
More informationSupplementary Figure S1 Characterization of the two-qubit system. a-d, When the nuclear spin is polarized along the
Suppleeary Figure S Characeriaio of he wo-qubi syse. a-d Whe he uclear spi is polaried alog he axis is free precessio sigal abou he axis is odulaed by he relaive agle bewee he codiioal local fields. a-b
More informationLecture 8 April 18, 2018
Sas 300C: Theory of Saisics Sprig 2018 Lecure 8 April 18, 2018 Prof Emmauel Cades Scribe: Emmauel Cades Oulie Ageda: Muliple Tesig Problems 1 Empirical Process Viewpoi of BHq 2 Empirical Process Viewpoi
More informationStochastic Processes Adopted From p Chapter 9 Probability, Random Variables and Stochastic Processes, 4th Edition A. Papoulis and S.
Sochasic Processes Adoped From p Chaper 9 Probabiliy, adom Variables ad Sochasic Processes, 4h Ediio A. Papoulis ad S. Pillai 9. Sochasic Processes Iroducio Le deoe he radom oucome of a experime. To every
More informationλiv Av = 0 or ( λi Av ) = 0. In order for a vector v to be an eigenvector, it must be in the kernel of λi
Liear lgebra Lecure #9 Noes This week s lecure focuses o wha migh be called he srucural aalysis of liear rasformaios Wha are he irisic properies of a liear rasformaio? re here ay fixed direcios? The discussio
More informationDavid Randall. ( )e ikx. k = u x,t. u( x,t)e ikx dx L. x L /2. Recall that the proof of (1) and (2) involves use of the orthogonality condition.
! Revised April 21, 2010 1:27 P! 1 Fourier Series David Radall Assume ha u( x,) is real ad iegrable If he domai is periodic, wih period L, we ca express u( x,) exacly by a Fourier series expasio: ( ) =
More informationSection 8 Convolution and Deconvolution
APPLICATIONS IN SIGNAL PROCESSING Secio 8 Covoluio ad Decovoluio This docume illusraes several echiques for carryig ou covoluio ad decovoluio i Mahcad. There are several operaors available for hese fucios:
More informationLecture 9: Polynomial Approximations
CS 70: Complexiy Theory /6/009 Lecure 9: Polyomial Approximaios Isrucor: Dieer va Melkebeek Scribe: Phil Rydzewski & Piramaayagam Arumuga Naiar Las ime, we proved ha o cosa deph circui ca evaluae he pariy
More informationSome Properties of Semi-E-Convex Function and Semi-E-Convex Programming*
The Eighh Ieraioal Symposium o Operaios esearch ad Is Applicaios (ISOA 9) Zhagjiajie Chia Sepember 2 22 29 Copyrigh 29 OSC & APOC pp 33 39 Some Properies of Semi-E-Covex Fucio ad Semi-E-Covex Programmig*
More informationDynamic h-index: the Hirsch index in function of time
Dyamic h-idex: he Hirsch idex i fucio of ime by L. Egghe Uiversiei Hassel (UHassel), Campus Diepebeek, Agoralaa, B-3590 Diepebeek, Belgium ad Uiversiei Awerpe (UA), Campus Drie Eike, Uiversieisplei, B-260
More informationComparisons Between RV, ARV and WRV
Comparisos Bewee RV, ARV ad WRV Cao Gag,Guo Migyua School of Maageme ad Ecoomics, Tiaji Uiversiy, Tiaji,30007 Absrac: Realized Volailiy (RV) have bee widely used sice i was pu forward by Aderso ad Bollerslev
More informationOutline. simplest HMM (1) simple HMMs? simplest HMM (2) Parameter estimation for discrete hidden Markov models
Oulie Parameer esimaio for discree idde Markov models Juko Murakami () ad Tomas Taylor (2). Vicoria Uiversiy of Welligo 2. Arizoa Sae Uiversiy Descripio of simple idde Markov models Maximum likeliood esimae
More informationOptimum design of complementary transient experiments for estimating thermal properties
Opiu desig of copleeary rasie experies for esiaig heral properies Jaes V. Beck*, Filippo de Moe, Doald E. Aos *Depare of Mechaical Egieerig, Michiga Sae Uiversiy, USA Depare of Idusrial ad Iforaio Egieerig
More informationAn interesting result about subset sums. Nitu Kitchloo. Lior Pachter. November 27, Abstract
A ieresig resul abou subse sums Niu Kichloo Lior Pacher November 27, 1993 Absrac We cosider he problem of deermiig he umber of subses B f1; 2; : : :; g such ha P b2b b k mod, where k is a residue class
More informationL-functions and Class Numbers
L-fucios ad Class Numbers Sude Number Theory Semiar S. M.-C. 4 Sepember 05 We follow Romyar Sharifi s Noes o Iwasawa Theory, wih some help from Neukirch s Algebraic Number Theory. L-fucios of Dirichle
More informationBig O Notation for Time Complexity of Algorithms
BRONX COMMUNITY COLLEGE of he Ciy Uiversiy of New York DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE CSI 33 Secio E01 Hadou 1 Fall 2014 Sepember 3, 2014 Big O Noaio for Time Complexiy of Algorihms Time
More informationConvergence theorems. Chapter Sampling
Chaper Covergece heorems We ve already discussed he difficuly i defiig he probabiliy measure i erms of a experimeal frequecy measureme. The hear of he problem lies i he defiiio of he limi, ad his was se
More informationExtended Laguerre Polynomials
I J Coemp Mah Scieces, Vol 7, 1, o, 189 194 Exeded Laguerre Polyomials Ada Kha Naioal College of Busiess Admiisraio ad Ecoomics Gulberg-III, Lahore, Pakisa adakhaariq@gmailcom G M Habibullah Naioal College
More informationBernstein Direct Method for Solving. Variational Problems
Ieraioal Maheaical Foru, 5,, o. 48, 35-37 Bersei Direc Mehod for Solvig Variaioal Probles Sadeep Dixi*, Viee K. Sigh**, Ai K. Sigh*, O P. Sigh* *Depare of Applied Maheaics, Isiue of echology, Baaras Hidu
More informationOLS bias for econometric models with errors-in-variables. The Lucas-critique Supplementary note to Lecture 17
OLS bias for ecoomeric models wih errors-i-variables. The Lucas-criique Supplemeary oe o Lecure 7 RNy May 6, 03 Properies of OLS i RE models I Lecure 7 we discussed he followig example of a raioal expecaios
More informationThe Eigen Function of Linear Systems
1/25/211 The Eige Fucio of Liear Sysems.doc 1/7 The Eige Fucio of Liear Sysems Recall ha ha we ca express (expad) a ime-limied sigal wih a weighed summaio of basis fucios: v ( ) a ψ ( ) = where v ( ) =
More informationResearch Article A Generalized Nonlinear Sum-Difference Inequality of Product Form
Joural of Applied Mahemaics Volume 03, Aricle ID 47585, 7 pages hp://dx.doi.org/0.55/03/47585 Research Aricle A Geeralized Noliear Sum-Differece Iequaliy of Produc Form YogZhou Qi ad Wu-Sheg Wag School
More informationAdditional Tables of Simulation Results
Saisica Siica: Suppleme REGULARIZING LASSO: A CONSISTENT VARIABLE SELECTION METHOD Quefeg Li ad Ju Shao Uiversiy of Wiscosi, Madiso, Eas Chia Normal Uiversiy ad Uiversiy of Wiscosi, Madiso Supplemeary
More informationThe analysis of the method on the one variable function s limit Ke Wu
Ieraioal Coferece o Advaces i Mechaical Egieerig ad Idusrial Iformaics (AMEII 5) The aalysis of he mehod o he oe variable fucio s i Ke Wu Deparme of Mahemaics ad Saisics Zaozhuag Uiversiy Zaozhuag 776
More informationTAKA KUSANO. laculty of Science Hrosh tlnlersty 1982) (n-l) + + Pn(t)x 0, (n-l) + + Pn(t)Y f(t,y), XR R are continuous functions.
Iera. J. Mah. & Mah. Si. Vol. 6 No. 3 (1983) 559-566 559 ASYMPTOTIC RELATIOHIPS BETWEEN TWO HIGHER ORDER ORDINARY DIFFERENTIAL EQUATIONS TAKA KUSANO laculy of Sciece Hrosh llersy 1982) ABSTRACT. Some asympoic
More informationC(p, ) 13 N. Nuclear reactions generate energy create new isotopes and elements. Notation for stellar rates: p 12
Iroducio o sellar reacio raes Nuclear reacios geerae eergy creae ew isoopes ad elemes Noaio for sellar raes: p C 3 N C(p,) 3 N The heavier arge ucleus (Lab: arge) he ligher icomig projecile (Lab: beam)
More informationStationarity and Error Correction
Saioariy ad Error Correcio. Saioariy a. If a ie series of a rado variable Y has a fiie σ Y ad σ Y,Y-s or deeds oly o he lag legh s (s > ), bu o o, he series is saioary, or iegraed of order - I(). The rocess
More informationThe Moment Approximation of the First Passage Time for the Birth Death Diffusion Process with Immigraton to a Moving Linear Barrier
America Joural of Applied Mahemaics ad Saisics, 015, Vol. 3, No. 5, 184-189 Available olie a hp://pubs.sciepub.com/ajams/3/5/ Sciece ad Educaio Publishig DOI:10.1691/ajams-3-5- The Mome Approximaio of
More informationFour equations describe the dynamic solution to RBC model. Consumption-leisure efficiency condition. Consumption-investment efficiency condition
LINEARIZING AND APPROXIMATING THE RBC MODEL SEPTEMBER 7, 200 For f( x, y, z ), mulivariable Taylor liear expasio aroud ( x, yz, ) f ( x, y, z) f( x, y, z) + f ( x, y, z)( x x) + f ( x, y, z)( y y) + f
More informationBAYESIAN ESTIMATION METHOD FOR PARAMETER OF EPIDEMIC SIR REED-FROST MODEL. Puji Kurniawan M
BAYESAN ESTMATON METHOD FOR PARAMETER OF EPDEMC SR REED-FROST MODEL Puji Kuriawa M447 ABSTRACT. fecious diseases is a impora healh problem i he mos of couries, belogig o doesia. Some of ifecious diseases
More informationAsymptotic statistics for multilayer perceptron with ReLu hidden units
ESANN 8 proceedigs, Europea Symposium o Arificial Neural Neworks, Compuaioal Ielligece ad Machie Learig. Bruges (Belgium), 5-7 April 8, i6doc.com publ., ISBN 978-8758747-6. Available from hp://www.i6doc.com/e/.
More informationChemistry 1B, Fall 2016 Topics 21-22
Cheisry B, Fall 6 Topics - STRUCTURE ad DYNAMICS Cheisry B Fall 6 Cheisry B so far: STRUCTURE of aos ad olecules Topics - Cheical Kieics Cheisry B ow: DYNAMICS cheical kieics herodyaics (che C, 6B) ad
More informationCSE 241 Algorithms and Data Structures 10/14/2015. Skip Lists
CSE 41 Algorihms ad Daa Srucures 10/14/015 Skip Liss This hadou gives he skip lis mehods ha we discussed i class. A skip lis is a ordered, doublyliked lis wih some exra poiers ha allow us o jump over muliple
More informationMATH 507a ASSIGNMENT 4 SOLUTIONS FALL 2018 Prof. Alexander. g (x) dx = g(b) g(0) = g(b),
MATH 57a ASSIGNMENT 4 SOLUTIONS FALL 28 Prof. Alexader (2.3.8)(a) Le g(x) = x/( + x) for x. The g (x) = /( + x) 2 is decreasig, so for a, b, g(a + b) g(a) = a+b a g (x) dx b so g(a + b) g(a) + g(b). Sice
More informationECE-314 Fall 2012 Review Questions
ECE-34 Fall 0 Review Quesios. A liear ime-ivaria sysem has he ipu-oupu characerisics show i he firs row of he diagram below. Deermie he oupu for he ipu show o he secod row of he diagram. Jusify your aswer.
More information1 Widrow-Hoff Algorithm
COS 511: heoreical Machine Learning Lecurer: Rob Schapire Lecure # 18 Scribe: Shaoqing Yang April 10, 014 1 Widrow-Hoff Algorih Firs le s review he Widrow-Hoff algorih ha was covered fro las lecure: Algorih
More informationErgodic Control of Semilinear Stochastic Equations and the Hamilton Jacobi Equation*
Joural of Maheaical Aalysis ad Applicaios 34, 5963 999 Aricle ID jaa9996387, available olie a hp:wwwidealibraryco o Ergodic Corol of Seiliear Sochasic Equaios ad he ailojacobi Equaio* Beiai Goldys School
More informationSliding Mode Control for Robust Stabilization of Uncertain Input-Delay Systems
98 CSE: he siue of Corol, uoaio ad Syses Egieers, KORE Vol, No, Jue, Slidig Mode Corol for Robus Sabilizaio of Ucerai pu-delay Syses Youg-Hoo Roh ad Ju-Ho Oh bsrac: his paper is cocered wih a delay-depede
More informationInference of the Second Order Autoregressive. Model with Unit Roots
Ieraioal Mahemaical Forum Vol. 6 0 o. 5 595-604 Iferece of he Secod Order Auoregressive Model wih Ui Roos Ahmed H. Youssef Professor of Applied Saisics ad Ecoomerics Isiue of Saisical Sudies ad Research
More informationA Note on Random k-sat for Moderately Growing k
A Noe o Radom k-sat for Moderaely Growig k Ju Liu LMIB ad School of Mahemaics ad Sysems Sciece, Beihag Uiversiy, Beijig, 100191, P.R. Chia juliu@smss.buaa.edu.c Zogsheg Gao LMIB ad School of Mahemaics
More informationExercise 3 Stochastic Models of Manufacturing Systems 4T400, 6 May
Exercise 3 Sochasic Models of Maufacurig Sysems 4T4, 6 May. Each week a very popular loery i Adorra pris 4 ickes. Each ickes has wo 4-digi umbers o i, oe visible ad he oher covered. The umbers are radomly
More informationOn the Validity of the Pairs Bootstrap for Lasso Estimators
O he Validiy of he Pairs Boosrap for Lasso Esimaors Lorezo Campoovo Uiversiy of S.Galle Ocober 2014 Absrac We sudy he validiy of he pairs boosrap for Lasso esimaors i liear regressio models wih radom covariaes
More informationES 330 Electronics II Homework 03 (Fall 2017 Due Wednesday, September 20, 2017)
Pae1 Nae Soluios ES 330 Elecroics II Hoework 03 (Fall 017 ue Wedesday, Sepeber 0, 017 Proble 1 You are ive a NMOS aplifier wih drai load resisor R = 0 k. The volae (R appeari across resisor R = 1.5 vols
More informationf(1), and so, if f is continuous, f(x) = f(1)x.
2.2.35: Let f be a additive fuctio. i Clearly fx = fx ad therefore f x = fx for all Z+ ad x R. Hece, for ay, Z +, f = f, ad so, if f is cotiuous, fx = fx. ii Suppose that f is bouded o soe o-epty ope set.
More informationProcedia - Social and Behavioral Sciences 230 ( 2016 ) Joint Probability Distribution and the Minimum of a Set of Normalized Random Variables
Available olie a wwwsciecedireccom ScieceDirec Procedia - Social ad Behavioral Scieces 30 ( 016 ) 35 39 3 rd Ieraioal Coferece o New Challeges i Maageme ad Orgaizaio: Orgaizaio ad Leadership, May 016,
More informationState and Parameter Estimation of The Lorenz System In Existence of Colored Noise
Sae ad Parameer Esimaio of he Lorez Sysem I Eisece of Colored Noise Mozhga Mombeii a Hamid Khaloozadeh b a Elecrical Corol ad Sysem Egieerig Researcher of Isiue for Research i Fudameal Scieces (IPM ehra
More informationHomotopy Analysis Method for Solving Fractional Sturm-Liouville Problems
Ausralia Joural of Basic ad Applied Scieces, 4(1): 518-57, 1 ISSN 1991-8178 Homoopy Aalysis Mehod for Solvig Fracioal Surm-Liouville Problems 1 A Neamay, R Darzi, A Dabbaghia 1 Deparme of Mahemaics, Uiversiy
More information