ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham

Size: px
Start display at page:

Download "ECE 559: Wireless Communication Project Report Diversity Multiplexing Tradeoff in MIMO Channels with partial CSIT. Hoa Pham"

Transcription

1 ECE 559: Wreless Commucato Project Report Dversty Multplexg Tradeoff MIMO Chaels wth partal CSIT Hoa Pham. Summary I ths project, I have studed the performace ga of MIMO systems. There are two types of ga provded by the MIMO chaels: oe measures the crease of the capacty by the umber of degrees of freedom of the chael (spatal multplexg ga), ad the other mprovemet of the relablty by the dversty ga. Most of prevous works focus o ether oe of these two types of ga by desgg schemes to extract ether maxmal dversty ga or maxmal spatal multplexg ga. However, maxmzg oe type of gas may ot ecessarly maxmze the other. Ths make t dffcult to compare dversty-based schemes ad multplexg-based schemes. Recetly, Zheg ad Tse [] proposed a ew pot of vew that ufes these two types of gas: gve a MIMO chael, both gas ca be smultaeously obtaed, but there s a tradeoff betwee how much of each type of ga ay codg scheme ca extract. The optmal dverstymultplexg tradeoff s a fudametal performace lmt of a MIMO chael. By studyg ths fudametal tradeoff, we ca ga mportat sghts o the resource costrat of MIMO systems, as well as o specfc schemes to commucate over such systems. The tradeoff curve ca be used as a ufed framework to compare the performace of varous space-tme codg schemes for MIMO chaels ad stmulates the desg of ew schemes. For each scheme, we ca compute the achevable dverstymultplexg tradeoff curve ad compare t agast the optmal curve. By dog ths, we ca take to accout both the capablty of a scheme to combat agast fadg (through dversty ga) ad ts acheved spatal multplexg ga. Therefore, the tradeoff curve provdes a ufed framework to make far comparsos. The aalyss focus o slow fadg chael (the chael s costat durg a block) ad hgh SNR rego. The approach used for both cases of o CSIT ad partal CSIT based o evaluatg the age probablty at hgh SNR. For the case of o CSI at the trasmtter, the optmal tradeoff curve s a pecewse lear curve coectg the pots (r, (m-r)(-r)), where r s the multplexg ga ad (m-r)(r) s the dversty ga. Itutvely, we ca thk of a pot o the optmal curve as followed: If we wat to use r trasmt ateas ad r receve ateas for multplexg

2 ga to crease the rate, the remag (m-r) trasmt ateas ad (-r) receve ateas ca be used to gve the dversty ga of (m-r) (-r). Cosder a example of the x system. The maxmal dversty ga for ths chael s d max = 4, ad the total umber of degrees of freedom the chael s r max =. To get the maxmal dversty ga, each formato bt eeds to pass through all the four paths from the trasmtter to the recevers. The smplest way s to use repetto code, ths wll guaratee the maxmal dversty, however, t oly acheved the rate / sce oly oe symbol s trasmtted over two symbol perods. As class we see that, the Alam scheme ca also acheve the full dversty. However terms of tradeoff acheved, the Alam scheme s strctly better tha the repto scheme, sce t acheves a hgher dversty ga for ay posttve spatal multplexg ga ad ts maxmal multplexg ga s. However, the tradeoff curve acheved by the Alam scheme s stll below the optmal curve for postve values of r. Fgure shows a example of dfferet codg schemes for the x MIMO chael. Fgure. Example of tradeoff curves for dfferet codg schemes

3 For the case of partal CSIT, the recever, after estmatg the chael wll feedback a dex to the trasmtter. Ths dex dcates the rego to whch the chael state belogs. Based o ths formato, the trasmtter wll cotrol the power to mmze the age probablty whle rema sastfyg the log term power costrat. The tradeoff curve dervato for ths case s smlar to the case whe there s o CSI at trasmtter whch s based o the age probablty. The mportat pot ths case s fdg the optmal dex mappg for dfferet states of the chael. Aother mportat pot s the cocept of exteded approxmately uversal codto (stated the slde) whch guaratees the upper boud ad lower boud to be matched. The ma results are gve the attached slde. There are two terestg results: - The maxmal dversty ga of MIMO chael ca be creased expoetally wth the umber of quatzed regos ( d (0) = ( m), where K s the umber of quatzed regos). Note that whe K = (o feedback), the result s the same as before. Ths result suggests that, we ca use oly a few bt of feedback to get the dversty ga ad save most of atea resource for multplexg ga. - Whe the adaptve rate trasmsso scheme s used (dfferet multplexg gas r are used for dfferet regos of the chael state, we ca acheve o-zero dversty ga at maxmal multplexg ga. Ths ca ot be acheved the case of o CSIT. For K =, the full dversty ga of the o-csit case (m) ca be acheved at maxmal multplexg ga. The ext secto provdes some detaled proofs stated the presetato to derve the optmal tradeoff curve of the MIMO chael whe the trasmtter does ot kow the CSI. The approach to dervg the tradeoff curve for the partal CSIT case s the same except the troducto of exteded approxmately uversal codto ad the optmal dex mappg scheme whch results the much hgher dversty ga. The detaled of the proofs ca be foud [], whch I wll ot cover here. K k = k. Dversty-Multplexg tradeoff wth o CSI at trasmtter [] Ths secto gves some detaled dervato of the optmal dversty-multplexg tradeoff curve. As we kow from the presetato, the approach s as followed: - Formulate the age probablty - Lower boud the error probablty by age probablty - Fd the upper boud o the error probablty - The upper boud turs to match the lower boud, therefore we get the SNR expoet of the error probablty Deftos: A scheme s sad to acheve spatal multplexg ga r ad the dversty ga d f the data rate:

4 ad the average error probablty RSNR ( ) lm = r, deoted by R rlog SNR log SNR SNR log Pe ( SNR) lm = d, deoted by Pe SNR log SNR SNR d. Outage probablty As the presetato we have, o the scale of terest (hgh SNR): P R P I SNR R ( ) [log det( + HH ) < ] To compute the asymptotcal age probablty, we eed the followg lemma: Lemma : let R be a m x radom matrx wth..d CN(0,) etres. Suppose m, μ μ... μ be the ordered o-zero egevalues of RR, the the jot pdf of μ s s: m = m, j = < j p( μ,..., μ ) K μ ( μ μ ) e μ Where K m, s the ormalzg costat. Defe: we ca fd the jot pdf of α s: α log μ / log SNR, for all. The ( ) m + α α α j α m, = < j = p( α) = K (log SNR) SNR. ( SNR SNR ) exp[ SNR ] Now cosder the age probablty wth R = rlog SNR, let λ λ... λ be the ozero egevalues of HH, ad λ = SNR α, we have: r ( ) [log det( + HH ) < ] = [ ( + λ ) < ] = P R P I SNR R P SNR SNR At hgh SNR, we have + ( ) ( + SNRλ ) SNR α, where (x) + deotes max{x,0}. The, + ( α ) + ( ) [ < ] = [ ( α ) < ] P R P SNR R P r Sce, we are oly terested the SNR expoet of P, we ca gore the term K, (log ) m SNR. Furthermore, for ay α < 0, the term ( SNR α ) decays expoetally

5 wth SNR. Thus, we ca gore the tegral over the rage wth α < 0, ad defe the set A m{ m, } + + ' = { α R α α... αm{ m, } 0, ad ( α) < r}, the: ( m + ) α α α P ( log ). ( j r SNR SNR SNR SNR ) d A' = < j The, we have the followg theorem: Theorem : Let the data rate R = rlog SNR, wth r m{ m, }. The age probablty sastfes: d ( r) P ( rlog SNR) SNR α A' m{ m, } where d ( r) = f + m α Proof. See [] for detaled proof. = The mmzg α ca be explctly computed. I the case that r takes a terger value k, we have: α =, for =,..., k ad α = 0, for = k+,...,. Itutvely, a geeral mx system, a age occurs whe the chael matrx H s ear sgular. The key step s to explctly quatfy how sgular H eeds to be for age to occur. Sce the smaller sgular values have a much hgher probablty to be close to zero tha the larger oes, the typcal age evet has -k smallest sgular values λ SNR ad k largest sgular values are of order. For the case that r s ot a terger, say r ( k, k + ), we have: α α α α =, for =,..., k, = 0, for = k+,..., ad k = k+ r. Wth these optmzed value of α, we get. Error Probablty d () r = ( m r)( r) Lower Boud: Frst, we wll prove the error probablty s lower boud by the age probablty. Fx a codebook C of sze Rl mxl, ad let X C be the put of the chael, whch s uformly draw from the codebook C. Codtoed o a specfc chael realzato H = H, by Fao s equalty, we have:

6 Rl + P(error H = H) Rl+ I( X; Y H= H), hece I( XY ; H= H) P(error H = H) lr log SNR lr log SNR The last term goes to zero as SNR goes to fty. Averagg over H gves the average error probablty P ( ) [ (error e SNR = EH P H = H)] Defe a set Dδ { H : I( XY ; H= H) < ( r δ ) llog SNR}, for ay H D δ, the r δ probablty of error s lower bouded by + o( ), hece r ( ) r δ P () ( e SNR + o P Dδ ) r The choose the put X to mmze PD ( δ ) ad apply the theorem, we have:. r Pe ( SNR) + o() SNR r SNR δ d ( r δ ) d ( r δ ) d ( r) Take δ 0, by the cotuty of d (r), we have the lower boud Pe ( SNR) SNR Ths result suggests that codtoed o the chael age evet, t s very lkely that a detecto error occurs.. Upper Boud: Choose the put to be the radom code from the..d Gaussa esemble. We have, Pe ( SNR) = P ( R) P(error age) + P(error, o age) P ( R) + P(error, o age) The secod term ca be upper-bouded va a uo boud. Assume X(0), X() are two possble trasmtted codeword ad Δ X = X(0) X(). Suppose X(0) s trasmtted, the probablty that a ML recever wll make a detecto error favor of X(), codtoed o a certa realzato of the chael, s SNR PX ( (0) X() H = H) = P H( ΔX) w m F

7 Where w s the addtve ose o the drecto of H ( Δ X ) wth varace /. Usg the upper boud for the Q-fucto, we have SNR PX ( (0) X() H = H) exp H( ΔX) 4m Averagg over the esemble of radom codes, we have the average parwse error probablty (PEP) codtoed o the chael realzato [3] SNR PX ( (0) X() H = H) det I+ HH m lr Apply the uo boud for SNR codewords, we have lr SNR PX ( (0) X() H = H) SNR exp H( ΔX) 4m = l m{ m, } lr SNR = SNR ( + ) m λ l Averagg wth respect to the dstrbuto of the SNR expoet α of sgular values ad wth a smlar argumet as Theorem, we ca approxmate ths as. dg ( r, α ) P(error, o age) SNR d c ( A') m{ m, } m{ m, } + wth dg( r, α) = + m α + l ( α) r = = The probablty s domated by the term correspodg to α that mmzes dg ( r, α ). For l (m{ m, }) + m = m+, the mmum always occurs wth ( α ) = r, hece α m{ m, } d () r m ( + m ) α = d () r r G α = m{ m, } r = Therefore P( SNR) P ( R) + P(error, o age) e. SNR + SNR SNR d ( r) dg ( r) d ( r)

8 We see that the upper boud ad the lower boud are matched, thus d ( r) Pe ( SNR) SNR, or we have the dversty ga d () r = d () r = ( m r)( r) whch gves the optmal tradeoff curve. 3. Q&A Q: How ca the tradeoff curve be utlzed? (What s the applcato of the tradeoff curve?) A: The optmal tradeoff curve shows the optmal tradeoff betwee dversty ga ad multplexg ga provded by the MIMO chael. It s used as a ufed framework to compare dfferet space-tme codes. By computg the tradeoff curve of each specfc scheme ad compare t to the optmal curve, we ca see how optmal that scheme s. Sce some schemes are desged to maxmze the capablty to combat fadg ad the others are desged to maxmze the trasmsso rate, t s dffcult to compare these schemes. However, by computg the tradeoff curves of these schemes, we take to accout both of these capabltes that each schemes ca acheve. That make the far comparso. Besde, the optmal tradeoff curve may stmulate the desg of ew schemes to utlze the resources gve by the MIMO chaels. However, t may ot show how to acheve the optmal curve. Q: It s ot clear to me f ths result provdes some boud o geeral space-tme code? A: Yes. Because, the optmal curve s the upper boud o the dversty ga ad multplexg ga that a MIMO chael ca support. Ay space-tme code s desged to utlzed these gas ad ca ot get above the optmal curve. Q: What s the tuto behd the pecewse lear tradeoff curve? Is t some kd of tme multplexg? Ad, Q: How ca we acheve pots the curve by tme-sharg? Partcularly, how to acheve the pot (0,) Alam scheme for x system? A: A specfc pot o the curve s ot acheved the sese of tme sharg or tme multplexg. The optmal curve s derved by fxg the multplexg ga r, ad fd the maxmal dversty ga that ca be acheved at that rate. Therefore, a specfc pot o the curve llustrates that f we wat to operate the system at the rate R rlog SNR, the maxmal dversty we ca get s the dversty ga at pot (r, d(r)). Itutvely, for a mx MIMO system, f we use r trasmt ateas ad r receve ateas for multplexg ga to crease the rate, the remag (m-r) trasmt ateas ad (-r) receve ateas ca be used to gve the dversty ga of (m-r) (-r). For the Alam scheme, the pot (0,) ca be acheved by scalg the rate R as R = log SNR ad compute the error probablty whe SNR goes to fty, we ca see

9 that the SNR expoet of the error probablty s the same as the sgle atea case, whch gve zero dversty ga. Q: How ca a specfc pot o the tradeoff curve ca be acheved practce? A: The optmal curve does ot tell how to acheve a specfc pot practce, sce t oly gves the boud o the gas that a chael may provde. Q: Practcally speakg, whe should we choose betwee dversty ad multplexg gas? Whch should be prefered? Is there a relato betwee the relablty ad the scheme that we choose? A: I my opo, ths deped o the chael codtos ad the applcato we wat to provde. The dversty oreted schemes may be chose the case of bad fadg chael where we wat to provde depedet fadg paths to combat fadg. The multplexgoreted schemes may be chose whe we wat hgh data-rate applcatos but do ot have tght requremets o error probablty. Q: Ca radom codg be used to arrve at the lower boud o the probablty of error? A: I the age probablty formulato, the put s take as the Gaussa dstrbuto ad the the age probablty s take as the fmum over all put dstrbuto. Sce the ose s Gausa, the Gaussa put maxmze the mutual formato ad the age occurs whe the mutual formato drops below the requred rate R, ths gve the lower boud o age probablty for every put dstrbuto. Furthermore, as we showed that the error s very lkely to occur whe the age evet occurs, therefore we ca use age probablty as a lower boud for the error probablty. Q: How s the tradeoff curve affected by feedback from the recever? A: Whe the recever feedbacks the quatzed value of CSI whch dcate the rego whch the chael appears, to the trasmtter, the trasmtter ca use that formato to cotrol the power. The dversty ga acheved s surprsgly creased expoetally wth the umber of quatzed regos, the maxmal dversty ga whch ca be acheved K k s ( NN t r), where K s the umber of quatzed regos []. Aother terestg result k = s that, whe adaptve rate trasmsso s used (dfferet multplexg gas for dfferet chael state regos), we ca have o-zero dversty ga at maxmal multplexg ga, whch ca ot be acheved the case of o CSIT.

10 Refereces [] L. Zheg ad D. Tse, Dversty ad Multplexg: A Fudametal Tradeoff Multple Atea Chaels, IEEE Trasactos o Iformato Theory, vol. 49, May 003, pp [] Tug T. Km ad Mkael Slogkud, Dversty-Multplexg Tradeoff MIMO Chaels wth Partal CSIT, IEEE Tras. Iform. Theory, vol. 53, NO. 8, August 007. [3] V.Tarokh, N. Seshadr, ad Calderbak, Space-tme codes for hgh data rate wreless commucatos: Performace crtero ad code costructo, IEEE Tras. Iform. Theory, vol. 44, pp , Mar. 998

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

Lecture 9: Tolerant Testing

Lecture 9: Tolerant Testing Lecture 9: Tolerat Testg Dael Kae Scrbe: Sakeerth Rao Aprl 4, 07 Abstract I ths lecture we prove a quas lear lower boud o the umber of samples eeded to do tolerat testg for L dstace. Tolerat Testg We have

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Postpoed exam: ECON430 Statstcs Date of exam: Jauary 0, 0 Tme for exam: 09:00 a.m. :00 oo The problem set covers 5 pages Resources allowed: All wrtte ad prted

More information

Chapter 5 Properties of a Random Sample

Chapter 5 Properties of a Random Sample Lecture 6 o BST 63: Statstcal Theory I Ku Zhag, /0/008 Revew for the prevous lecture Cocepts: t-dstrbuto, F-dstrbuto Theorems: Dstrbutos of sample mea ad sample varace, relatoshp betwee sample mea ad sample

More information

The Mathematical Appendix

The Mathematical Appendix The Mathematcal Appedx Defto A: If ( Λ, Ω, where ( λ λ λ whch the probablty dstrbutos,,..., Defto A. uppose that ( Λ,,..., s a expermet type, the σ-algebra o λ λ λ are defed s deoted by ( (,,...,, σ Ω.

More information

Basics of Information Theory: Markku Juntti. Basic concepts and tools 1 Introduction 2 Entropy, relative entropy and mutual information

Basics of Information Theory: Markku Juntti. Basic concepts and tools 1 Introduction 2 Entropy, relative entropy and mutual information : Maru Jutt Overvew he propertes of adlmted Gaussa chaels are further studed, parallel Gaussa chaels ad Gaussa chaels wth feedac are solved. Source he materal s maly ased o Sectos.4.6 of the course oo

More information

PTAS for Bin-Packing

PTAS for Bin-Packing CS 663: Patter Matchg Algorthms Scrbe: Che Jag /9/00. Itroducto PTAS for B-Packg The B-Packg problem s NP-hard. If we use approxmato algorthms, the B-Packg problem could be solved polyomal tme. For example,

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then

X X X E[ ] E X E X. is the ()m n where the ( i,)th. j element is the mean of the ( i,)th., then Secto 5 Vectors of Radom Varables Whe workg wth several radom varables,,..., to arrage them vector form x, t s ofte coveet We ca the make use of matrx algebra to help us orgaze ad mapulate large umbers

More information

Point Estimation: definition of estimators

Point Estimation: definition of estimators Pot Estmato: defto of estmators Pot estmator: ay fucto W (X,..., X ) of a data sample. The exercse of pot estmato s to use partcular fuctos of the data order to estmate certa ukow populato parameters.

More information

STK4011 and STK9011 Autumn 2016

STK4011 and STK9011 Autumn 2016 STK4 ad STK9 Autum 6 Pot estmato Covers (most of the followg materal from chapter 7: Secto 7.: pages 3-3 Secto 7..: pages 3-33 Secto 7..: pages 35-3 Secto 7..3: pages 34-35 Secto 7.3.: pages 33-33 Secto

More information

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b

Discrete Mathematics and Probability Theory Fall 2016 Seshia and Walrand DIS 10b CS 70 Dscrete Mathematcs ad Probablty Theory Fall 206 Sesha ad Walrad DIS 0b. Wll I Get My Package? Seaky delvery guy of some compay s out delverg packages to customers. Not oly does he had a radom package

More information

Special Instructions / Useful Data

Special Instructions / Useful Data JAM 6 Set of all real umbers P A..d. B, p Posso Specal Istructos / Useful Data x,, :,,, x x Probablty of a evet A Idepedetly ad detcally dstrbuted Bomal dstrbuto wth parameters ad p Posso dstrbuto wth

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

TESTS BASED ON MAXIMUM LIKELIHOOD

TESTS BASED ON MAXIMUM LIKELIHOOD ESE 5 Toy E. Smth. The Basc Example. TESTS BASED ON MAXIMUM LIKELIHOOD To llustrate the propertes of maxmum lkelhood estmates ad tests, we cosder the smplest possble case of estmatg the mea of the ormal

More information

Multiple Choice Test. Chapter Adequacy of Models for Regression

Multiple Choice Test. Chapter Adequacy of Models for Regression Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

CHAPTER VI Statistical Analysis of Experimental Data

CHAPTER VI Statistical Analysis of Experimental Data Chapter VI Statstcal Aalyss of Expermetal Data CHAPTER VI Statstcal Aalyss of Expermetal Data Measuremets do ot lead to a uque value. Ths s a result of the multtude of errors (maly radom errors) that ca

More information

D. VQ WITH 1ST-ORDER LOSSLESS CODING

D. VQ WITH 1ST-ORDER LOSSLESS CODING VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) Varable-Rate VQ = Quatzato + Lossless Varable-Legth Bary Codg A rage of optos -- from smple to complex A. Uform scalar quatzato wth varable-legth codg, oe

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

3. Basic Concepts: Consequences and Properties

3. Basic Concepts: Consequences and Properties : 3. Basc Cocepts: Cosequeces ad Propertes Markku Jutt Overvew More advaced cosequeces ad propertes of the basc cocepts troduced the prevous lecture are derved. Source The materal s maly based o Sectos.6.8

More information

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem

CS286.2 Lecture 4: Dinur s Proof of the PCP Theorem CS86. Lecture 4: Dur s Proof of the PCP Theorem Scrbe: Thom Bohdaowcz Prevously, we have prove a weak verso of the PCP theorem: NP PCP 1,1/ (r = poly, q = O(1)). Wth ths result we have the desred costat

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Chain Rules for Entropy

Chain Rules for Entropy Cha Rules for Etroy The etroy of a collecto of radom varables s the sum of codtoal etroes. Theorem: Let be radom varables havg the mass robablty x x.x. The...... The roof s obtaed by reeatg the alcato

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy

Bounds on the expected entropy and KL-divergence of sampled multinomial distributions. Brandon C. Roy Bouds o the expected etropy ad KL-dvergece of sampled multomal dstrbutos Brado C. Roy bcroy@meda.mt.edu Orgal: May 18, 2011 Revsed: Jue 6, 2011 Abstract Iformato theoretc quattes calculated from a sampled

More information

X ε ) = 0, or equivalently, lim

X ε ) = 0, or equivalently, lim Revew for the prevous lecture Cocepts: order statstcs Theorems: Dstrbutos of order statstcs Examples: How to get the dstrbuto of order statstcs Chapter 5 Propertes of a Radom Sample Secto 55 Covergece

More information

Chapter 9 Jordan Block Matrices

Chapter 9 Jordan Block Matrices Chapter 9 Jorda Block atrces I ths chapter we wll solve the followg problem. Gve a lear operator T fd a bass R of F such that the matrx R (T) s as smple as possble. f course smple s a matter of taste.

More information

Multivariate Transformation of Variables and Maximum Likelihood Estimation

Multivariate Transformation of Variables and Maximum Likelihood Estimation Marquette Uversty Multvarate Trasformato of Varables ad Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Assocate Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 03 by Marquette Uversty

More information

Chapter 4 Multiple Random Variables

Chapter 4 Multiple Random Variables Revew for the prevous lecture: Theorems ad Examples: How to obta the pmf (pdf) of U = g (, Y) ad V = g (, Y) Chapter 4 Multple Radom Varables Chapter 44 Herarchcal Models ad Mxture Dstrbutos Examples:

More information

Source-Channel Prediction in Error Resilient Video Coding

Source-Channel Prediction in Error Resilient Video Coding Source-Chael Predcto Error Reslet Vdeo Codg Hua Yag ad Keeth Rose Sgal Compresso Laboratory ECE Departmet Uversty of Calfora, Sata Barbara Outle Itroducto Source-chael predcto Smulato results Coclusos

More information

1. BLAST (Karlin Altschul) Statistics

1. BLAST (Karlin Altschul) Statistics Parwse seuece algmet global ad local Multple seuece algmet Substtuto matrces Database searchg global local BLAST Seuece statstcs Evolutoary tree recostructo Gee Fdg Prote structure predcto RNA structure

More information

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ  1 STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Recall Assumpto E(Y x) η 0 + η x (lear codtoal mea fucto) Data (x, y ), (x 2, y 2 ),, (x, y ) Least squares estmator ˆ E (Y x) ˆ " 0 + ˆ " x, where ˆ

More information

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d

9 U-STATISTICS. Eh =(m!) 1 Eh(X (1),..., X (m ) ) i.i.d 9 U-STATISTICS Suppose,,..., are P P..d. wth CDF F. Our goal s to estmate the expectato t (P)=Eh(,,..., m ). Note that ths expectato requres more tha oe cotrast to E, E, or Eh( ). Oe example s E or P((,

More information

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015

Homework 1: Solutions Sid Banerjee Problem 1: (Practice with Asymptotic Notation) ORIE 4520: Stochastics at Scale Fall 2015 Fall 05 Homework : Solutos Problem : (Practce wth Asymptotc Notato) A essetal requremet for uderstadg scalg behavor s comfort wth asymptotc (or bg-o ) otato. I ths problem, you wll prove some basc facts

More information

The Selection Problem - Variable Size Decrease/Conquer (Practice with algorithm analysis)

The Selection Problem - Variable Size Decrease/Conquer (Practice with algorithm analysis) We have covered: Selecto, Iserto, Mergesort, Bubblesort, Heapsort Next: Selecto the Qucksort The Selecto Problem - Varable Sze Decrease/Coquer (Practce wth algorthm aalyss) Cosder the problem of fdg the

More information

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i.

1 Mixed Quantum State. 2 Density Matrix. CS Density Matrices, von Neumann Entropy 3/7/07 Spring 2007 Lecture 13. ψ = α x x. ρ = p i ψ i ψ i. CS 94- Desty Matrces, vo Neuma Etropy 3/7/07 Sprg 007 Lecture 3 I ths lecture, we wll dscuss the bascs of quatum formato theory I partcular, we wll dscuss mxed quatum states, desty matrces, vo Neuma etropy

More information

ECE 729 Introduction to Channel Coding

ECE 729 Introduction to Channel Coding chaelcodg.tex May 4, 2006 ECE 729 Itroducto to Chael Codg Cotets Fudametal Cocepts ad Techques. Chaels.....................2 Ecoders.....................2. Code Rates............... 2.3 Decoders....................

More information

Lecture 3 Probability review (cont d)

Lecture 3 Probability review (cont d) STATS 00: Itroducto to Statstcal Iferece Autum 06 Lecture 3 Probablty revew (cot d) 3. Jot dstrbutos If radom varables X,..., X k are depedet, the ther dstrbuto may be specfed by specfyg the dvdual dstrbuto

More information

KLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames

KLT Tracker. Alignment. 1. Detect Harris corners in the first frame. 2. For each Harris corner compute motion between consecutive frames KLT Tracker Tracker. Detect Harrs corers the frst frame 2. For each Harrs corer compute moto betwee cosecutve frames (Algmet). 3. Lk moto vectors successve frames to get a track 4. Itroduce ew Harrs pots

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

Lecture 02: Bounding tail distributions of a random variable

Lecture 02: Bounding tail distributions of a random variable CSCI-B609: A Theorst s Toolkt, Fall 206 Aug 25 Lecture 02: Boudg tal dstrbutos of a radom varable Lecturer: Yua Zhou Scrbe: Yua Xe & Yua Zhou Let us cosder the ubased co flps aga. I.e. let the outcome

More information

Class 13,14 June 17, 19, 2015

Class 13,14 June 17, 19, 2015 Class 3,4 Jue 7, 9, 05 Pla for Class3,4:. Samplg dstrbuto of sample mea. The Cetral Lmt Theorem (CLT). Cofdece terval for ukow mea.. Samplg Dstrbuto for Sample mea. Methods used are based o CLT ( Cetral

More information

Laboratory I.10 It All Adds Up

Laboratory I.10 It All Adds Up Laboratory I. It All Adds Up Goals The studet wll work wth Rema sums ad evaluate them usg Derve. The studet wll see applcatos of tegrals as accumulatos of chages. The studet wll revew curve fttg sklls.

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections

ENGI 4421 Joint Probability Distributions Page Joint Probability Distributions [Navidi sections 2.5 and 2.6; Devore sections ENGI 441 Jot Probablty Dstrbutos Page 7-01 Jot Probablty Dstrbutos [Navd sectos.5 ad.6; Devore sectos 5.1-5.] The jot probablty mass fucto of two dscrete radom quattes, s, P ad p x y x y The margal probablty

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights

CIS 800/002 The Algorithmic Foundations of Data Privacy October 13, Lecture 9. Database Update Algorithms: Multiplicative Weights CIS 800/002 The Algorthmc Foudatos of Data Prvacy October 13, 2011 Lecturer: Aaro Roth Lecture 9 Scrbe: Aaro Roth Database Update Algorthms: Multplcatve Weghts We ll recall aga) some deftos from last tme:

More information

L5 Polynomial / Spline Curves

L5 Polynomial / Spline Curves L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a

More information

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance

Chapter 13, Part A Analysis of Variance and Experimental Design. Introduction to Analysis of Variance. Introduction to Analysis of Variance Chapter, Part A Aalyss of Varace ad Epermetal Desg Itroducto to Aalyss of Varace Aalyss of Varace: Testg for the Equalty of Populato Meas Multple Comparso Procedures Itroducto to Aalyss of Varace Aalyss

More information

18.413: Error Correcting Codes Lab March 2, Lecture 8

18.413: Error Correcting Codes Lab March 2, Lecture 8 18.413: Error Correctg Codes Lab March 2, 2004 Lecturer: Dael A. Spelma Lecture 8 8.1 Vector Spaces A set C {0, 1} s a vector space f for x all C ad y C, x + y C, where we take addto to be compoet wse

More information

VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING)

VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) VARIABLE-RATE VQ (AKA VQ WITH ENTROPY CODING) Varable-Rate VQ = Quatzato + Lossless Varable-Legth Bary Codg A rage of optos -- from smple to complex a. Uform scalar quatzato wth varable-legth codg, oe

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations Dervato of -Pot Block Method Formula for Solvg Frst Order Stff Ordary Dfferetal Equatos Kharul Hamd Kharul Auar, Kharl Iskadar Othma, Zara Bb Ibrahm Abstract Dervato of pot block method formula wth costat

More information

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS

UNIT 2 SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Numercal Computg -I UNIT SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS Structure Page Nos..0 Itroducto 6. Objectves 7. Ital Approxmato to a Root 7. Bsecto Method 8.. Error Aalyss 9.4 Regula Fals Method

More information

Lecture Notes Types of economic variables

Lecture Notes Types of economic variables Lecture Notes 3 1. Types of ecoomc varables () Cotuous varable takes o a cotuum the sample space, such as all pots o a le or all real umbers Example: GDP, Polluto cocetrato, etc. () Dscrete varables fte

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~

More information

The Occupancy and Coupon Collector problems

The Occupancy and Coupon Collector problems Chapter 4 The Occupacy ad Coupo Collector problems By Sarel Har-Peled, Jauary 9, 08 4 Prelmares [ Defto 4 Varace ad Stadard Devato For a radom varable X, let V E [ X [ µ X deote the varace of X, where

More information

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits Block-Based Compact hermal Modelg of Semcoductor Itegrated Crcuts Master s hess Defese Caddate: Jg Ba Commttee Members: Dr. Mg-Cheg Cheg Dr. Daqg Hou Dr. Robert Schllg July 27, 2009 Outle Itroducto Backgroud

More information

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos

More information

For combinatorial problems we might need to generate all permutations, combinations, or subsets of a set.

For combinatorial problems we might need to generate all permutations, combinations, or subsets of a set. Addtoal Decrease ad Coquer Algorthms For combatoral problems we mght eed to geerate all permutatos, combatos, or subsets of a set. Geeratg Permutatos If we have a set f elemets: { a 1, a 2, a 3, a } the

More information

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek

Investigation of Partially Conditional RP Model with Response Error. Ed Stanek Partally Codtoal Radom Permutato Model 7- vestgato of Partally Codtoal RP Model wth Respose Error TRODUCTO Ed Staek We explore the predctor that wll result a smple radom sample wth respose error whe a

More information

1 Onto functions and bijections Applications to Counting

1 Onto functions and bijections Applications to Counting 1 Oto fuctos ad bectos Applcatos to Coutg Now we move o to a ew topc. Defto 1.1 (Surecto. A fucto f : A B s sad to be surectve or oto f for each b B there s some a A so that f(a B. What are examples of

More information

8.1 Hashing Algorithms

8.1 Hashing Algorithms CS787: Advaced Algorthms Scrbe: Mayak Maheshwar, Chrs Hrchs Lecturer: Shuch Chawla Topc: Hashg ad NP-Completeess Date: September 21 2007 Prevously we looked at applcatos of radomzed algorthms, ad bega

More information

CHAPTER 4 RADICAL EXPRESSIONS

CHAPTER 4 RADICAL EXPRESSIONS 6 CHAPTER RADICAL EXPRESSIONS. The th Root of a Real Number A real umber a s called the th root of a real umber b f Thus, for example: s a square root of sce. s also a square root of sce ( ). s a cube

More information

2. Independence and Bernoulli Trials

2. Independence and Bernoulli Trials . Ideedece ad Beroull Trals Ideedece: Evets ad B are deedet f B B. - It s easy to show that, B deedet mles, B;, B are all deedet ars. For examle, ad so that B or B B B B B φ,.e., ad B are deedet evets.,

More information

ENGI 3423 Simple Linear Regression Page 12-01

ENGI 3423 Simple Linear Regression Page 12-01 ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable

More information

Lecture 4 Sep 9, 2015

Lecture 4 Sep 9, 2015 CS 388R: Radomzed Algorthms Fall 205 Prof. Erc Prce Lecture 4 Sep 9, 205 Scrbe: Xagru Huag & Chad Voegele Overvew I prevous lectures, we troduced some basc probablty, the Cheroff boud, the coupo collector

More information

ρ < 1 be five real numbers. The

ρ < 1 be five real numbers. The Lecture o BST 63: Statstcal Theory I Ku Zhag, /0/006 Revew for the prevous lecture Deftos: covarace, correlato Examples: How to calculate covarace ad correlato Theorems: propertes of correlato ad covarace

More information

Long Tailed functions

Long Tailed functions Log Taled fuctos Log tal fuctos are desrable for fttg may physologcal data sets A geeral example s fttg the respose of a system to a mpulse put Most passve systems have u modal rght skewed respose fuctos

More information

On the Delay-Throughput Tradeoff in Distributed Wireless Networks

On the Delay-Throughput Tradeoff in Distributed Wireless Networks SUBMITTED TO IEEE TRANSACTIONS ON INFORMATION THEORY, OCTOBER 2009 O the Delay-Throughput Tradeoff Dstrbuted Wreless Networks Jamshd Aboue, Alreza Bayesteh, ad Amr K. Khada Codg ad Sgal Trasmsso Laboratory

More information

An Introduction to. Support Vector Machine

An Introduction to. Support Vector Machine A Itroducto to Support Vector Mache Support Vector Mache (SVM) A classfer derved from statstcal learg theory by Vapk, et al. 99 SVM became famous whe, usg mages as put, t gave accuracy comparable to eural-etwork

More information

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory

C-1: Aerodynamics of Airfoils 1 C-2: Aerodynamics of Airfoils 2 C-3: Panel Methods C-4: Thin Airfoil Theory ROAD MAP... AE301 Aerodyamcs I UNIT C: 2-D Arfols C-1: Aerodyamcs of Arfols 1 C-2: Aerodyamcs of Arfols 2 C-3: Pael Methods C-4: Th Arfol Theory AE301 Aerodyamcs I Ut C-3: Lst of Subects Problem Solutos?

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Lecture 2 - What are component and system reliability and how it can be improved?

Lecture 2 - What are component and system reliability and how it can be improved? Lecture 2 - What are compoet ad system relablty ad how t ca be mproved? Relablty s a measure of the qualty of the product over the log ru. The cocept of relablty s a exteded tme perod over whch the expected

More information

A New Measure of Probabilistic Entropy. and its Properties

A New Measure of Probabilistic Entropy. and its Properties Appled Mathematcal Sceces, Vol. 4, 200, o. 28, 387-394 A New Measure of Probablstc Etropy ad ts Propertes Rajeesh Kumar Departmet of Mathematcs Kurukshetra Uversty Kurukshetra, Ida rajeesh_kuk@redffmal.com

More information

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems

Analysis of System Performance IN2072 Chapter 5 Analysis of Non Markov Systems Char for Network Archtectures ad Servces Prof. Carle Departmet of Computer Scece U Müche Aalyss of System Performace IN2072 Chapter 5 Aalyss of No Markov Systems Dr. Alexader Kle Prof. Dr.-Ig. Georg Carle

More information

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic Covergece of the Desrozers scheme ad ts relato to the lag ovato dagostc chard Méard Evromet Caada, Ar Qualty esearch Dvso World Weather Ope Scece Coferece Motreal, August 9, 04 o t t O x x x y x y Oservato

More information

This lecture and the next. Why Sorting? Sorting Algorithms so far. Why Sorting? (2) Selection Sort. Heap Sort. Heapsort

This lecture and the next. Why Sorting? Sorting Algorithms so far. Why Sorting? (2) Selection Sort. Heap Sort. Heapsort Ths lecture ad the ext Heapsort Heap data structure ad prorty queue ADT Qucksort a popular algorthm, very fast o average Why Sortg? Whe doubt, sort oe of the prcples of algorthm desg. Sortg used as a subroute

More information

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted

More information

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables

Complete Convergence and Some Maximal Inequalities for Weighted Sums of Random Variables Joural of Sceces, Islamc Republc of Ira 8(4): -6 (007) Uversty of Tehra, ISSN 06-04 http://sceces.ut.ac.r Complete Covergece ad Some Maxmal Iequaltes for Weghted Sums of Radom Varables M. Am,,* H.R. Nl

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements

Chapter 4 (Part 1): Non-Parametric Classification (Sections ) Pattern Classification 4.3) Announcements Aoucemets No-Parametrc Desty Estmato Techques HW assged Most of ths lecture was o the blacboard. These sldes cover the same materal as preseted DHS Bometrcs CSE 90-a Lecture 7 CSE90a Fall 06 CSE90a Fall

More information

Wireless Link Properties

Wireless Link Properties Opportustc Ecrypto for Robust Wreless Securty R. Chadramoul ( Moul ) moul@steves.edu Multmeda System, Networkg, ad Commucatos (MSyNC) Laboratory, Departmet of Electrcal ad Computer Egeerg, Steves Isttute

More information

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations

hp calculators HP 30S Statistics Averages and Standard Deviations Average and Standard Deviation Practice Finding Averages and Standard Deviations HP 30S Statstcs Averages ad Stadard Devatos Average ad Stadard Devato Practce Fdg Averages ad Stadard Devatos HP 30S Statstcs Averages ad Stadard Devatos Average ad stadard devato The HP 30S provdes several

More information

1 Solution to Problem 6.40

1 Solution to Problem 6.40 1 Soluto to Problem 6.40 (a We wll wrte T τ (X 1,...,X where the X s are..d. wth PDF f(x µ, σ 1 ( x µ σ g, σ where the locato parameter µ s ay real umber ad the scale parameter σ s > 0. Lettg Z X µ σ we

More information

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation

PGE 310: Formulation and Solution in Geosystems Engineering. Dr. Balhoff. Interpolation PGE 30: Formulato ad Soluto Geosystems Egeerg Dr. Balhoff Iterpolato Numercal Methods wth MATLAB, Recktewald, Chapter 0 ad Numercal Methods for Egeers, Chapra ad Caale, 5 th Ed., Part Fve, Chapter 8 ad

More information

Parameter, Statistic and Random Samples

Parameter, Statistic and Random Samples Parameter, Statstc ad Radom Samples A parameter s a umber that descrbes the populato. It s a fxed umber, but practce we do ot kow ts value. A statstc s a fucto of the sample data,.e., t s a quatty whose

More information

to the estimation of total sensitivity indices

to the estimation of total sensitivity indices Applcato of the cotrol o varate ate techque to the estmato of total sestvty dces S KUCHERENKO B DELPUECH Imperal College Lodo (UK) skuchereko@mperalacuk B IOOSS Electrcté de Frace (Frace) S TARANTOLA Jot

More information

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS

UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS UNIVERSITY OF OSLO DEPARTMENT OF ECONOMICS Exam: ECON430 Statstcs Date of exam: Frday, December 8, 07 Grades are gve: Jauary 4, 08 Tme for exam: 0900 am 00 oo The problem set covers 5 pages Resources allowed:

More information

f f... f 1 n n (ii) Median : It is the value of the middle-most observation(s).

f f... f 1 n n (ii) Median : It is the value of the middle-most observation(s). CHAPTER STATISTICS Pots to Remember :. Facts or fgures, collected wth a defte pupose, are called Data.. Statstcs s the area of study dealg wth the collecto, presetato, aalyss ad terpretato of data.. The

More information

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity

Strong Convergence of Weighted Averaged Approximants of Asymptotically Nonexpansive Mappings in Banach Spaces without Uniform Convexity BULLETIN of the MALAYSIAN MATHEMATICAL SCIENCES SOCIETY Bull. Malays. Math. Sc. Soc. () 7 (004), 5 35 Strog Covergece of Weghted Averaged Appromats of Asymptotcally Noepasve Mappgs Baach Spaces wthout

More information

Beam Warming Second-Order Upwind Method

Beam Warming Second-Order Upwind Method Beam Warmg Secod-Order Upwd Method Petr Valeta Jauary 6, 015 Ths documet s a part of the assessmet work for the subject 1DRP Dfferetal Equatos o Computer lectured o FNSPE CTU Prague. Abstract Ths documet

More information

Pseudo-random Functions

Pseudo-random Functions Pseudo-radom Fuctos Debdeep Mukhopadhyay IIT Kharagpur We have see the costructo of PRG (pseudo-radom geerators) beg costructed from ay oe-way fuctos. Now we shall cosder a related cocept: Pseudo-radom

More information