Maximum Power Estimation Using the Limiting Distributions of Extreme Order Statistics

Size: px
Start display at page:

Download "Maximum Power Estimation Using the Limiting Distributions of Extreme Order Statistics"

Transcription

1 Maxiu Power Estiatio Usig the Liitig Distributios of Extree Order Statistics Qiru Qiu Qig Wu ad Massoud Pedra Departet of Electrical Egieerig Systes Uiversity of Souther Califoria Los Ageles CA {qiru qigwu Abstract I this paper we preset a statistical ethod for estiatig the axiu power cosuptio i VLSI circuits. The ethod is based o the theory of extree order statistics applied to the probabilistic distributios of the cycle-by-cycle power cosuptio the axiu lielihood estiatio ad the Mote- Carlo siulatio. It ca predict the axiu power i the space of costraied iput vector pairs as well as the coplete space of all possible iput vector pairs. The siulatio-based ature of the proposed ethod allows it to avoid the liitatios of a gate-level delay odel ad a gate-level circuit structure. Last but ot least the proposed ethod ca produce axiu power estiates to satisfy user-specified error ad cofidece levels. Experietal results show that this ethod o average produces axiu power estiates withi 5% of the actual value ad with a 90% cofidece level by siulatig oly about 500 vector pairs. I. Itroductio Circuit reliability is a iportat issue i today s VLSI aufacturig. There are ay sources that ay cause circuit failure oe of the is excessive power dissipatio over a short period of tie. Uexpected high curret i short tie ay lead to peraet circuit daage sudde voltage chage o the supply source ad groud ets or teporary circuit failure. To desig a circuit with high reliability desigers have to rely o the efficiet ad accurate estiatio of axiu cycle-by-cycle power (or for short axiu power). Maxiu power estiatio i VLSI circuits is also essetial to deterie the IR drop ad bouce oise o supply lies ad to optiize the power ad groud routig etwors. I ost of the previous research wor axiu power estiatio refers to the proble of estiatig the axiu power (or curre that the circuit ay cosue withi ay cloc cycle. The proble is thus equivalet to looig for the axiu-power-cosuig vector pair aog all possible iput vector pairs. Therefore these techiques focus o fidig the lower boud ad upper boud of the axiu power. However differet desig requireets of today s VLSI chips ae thigs a little bit ore coplicated. I geeral we divide the scope of axiu power estiatio proble ito two categories: I. The axiu power for all possible vector pairs applied to the iputs of the circuit. We refer to this as the ucostraied axiu power. I. The axiu power for give trasitio/joit-trasitio probability specificatio for the circuit iputs. We refer to this as the costraied axiu power. A uber of techiques have bee developed to solve the probles i Category I. []-[8] ad Category I.. The ethod proposed i [] propagates the sigal ucertaity through the circuits to obtai a loose upper boud o the axiu power. The boud is the ade tighter by doig a detailed search o part of the priary iputs. The boud tighteig ethod teds to be tie cosuig whe the uber of the priary iputs is large. The Autoatic Test Patter Geeratio (ATPG) based techiques [3]-[4] try to geerate a iput vector pair that produces the largest switched capacitace i the circuit. The power cosuptio by the vector pair is the used as a lower boud o the axiu power of the circuit. The ATPG based techiques are very efficiet ad geerate a tighter lower boud tha that geerated by rado vector geeratio. The liitatios are however that the ATPG based techiques ca oly hadle siple delay odels such as the zero-delay ad uit-delay odels ad that the aalysis is doe at the gate-level. Cosequetly the estiatio accuracy is ot high. A cotiuous optiizatio ethod was proposed i [5] which treats the iput vector space as a cotiuous real-valued vector space ad the perfors a gradiet search to fid the fuctio axiu. Siilar to the ATPG based techiques the estiatio accuracy is ot high. The authors of [6] proposed a techique for fidig the axiu power-cosuig vector usig a geetic search algorith. The liitatio of this approach is that it requires siulatio of a lot of vectors i.e. its efficiecy is ot high. Statistical ethods have bee studied for axiu power estiatio. I [3] a Mote- Carlo based statistical techique for axiu curret estiatio was briefly discussed. The ethod radoly geerates highactivity vector pairs ad the axiu power is the estiated by siulatio. This ethod also suffers fro low efficiecy. The theory of order statistics has bee applied i [7][8] to estiate axiu power by estiatig the high quatile poit. Their efficiecy is as low as the rado vector geeratio techique. I this paper we preset a siulatio-based statistical ethod for axiu power estiatio for cobiatioal circuits. It is a ethod of estiatig the axiu power usig the theory of Asyptotic Extree Order Statistics. Copared to previous wor our approach aes the followig tagible cotributios:

2 . Our approach is the first approach that provides the cofidece iterval for the estiated axiu power for the user-specified cofidece level.. Our approach is the first approach which ca do axiu power estiatio for ay give error ad cofidece levels. 3. Our approach ca estiate the axiu power defied i both categories I. ad I.. 4. Because it is a siulatio-based techique the delay odel or the circuit structure do ot liit its accuracy. 5. By efficiet statistical estiatio of the extree distributios the estiatio efficiecy is largely iproved copared to existig statistical ethods (icludig siple rado saplig or quatile estiatio). O average the ethod ca do axiu power estiatio by siulatig oly about 500 vector pairs to achieve a 5% error at a cofidece level of 90%. This paper is orgaized as follows Sectio II itroduces the theory of asyptotic extree order statistics ad axiu lielihood estiatio. Sectio III describes our approaches for axiu power estiatio. Sectio IV presets our experietal results ad Sectio V gives the cocludig rears. II. Bacgroud. The asyptotic theory of extree order statistics The (cuulative) distributio fuctio (i short d.f.) of a rado variable (i short r.v.) x is defied as: F( = P{ x t} (.) The quatile fuctio (i short q.f.) of a d.f. F is defied as: F ( q) = if{ t : F( q} q [0] (.) rado where if(s) calculates the lower boud of set S. Notice that the q.f. F - is a real-valued fuctio ad F - (q) is the sallest q quatile of F that is if Z is a r.v. with d.f. F the F - (q) is the sallest value t such that P{Z < t} q P{Z t}. We rear that F(x)=sup{q [0]: F - (q) x}. Let z z... z be rado uits draw fro a coo distributio. If they are draw i a rado aer they are called idepedet idetically distributed (i short i.i.d.) r.v. s. If oe is ot iterested i the order i which z z...z are draw but iterested i the order of the agitude of their values oe has to exaie the ordered saple values X : X : X : which are the order statistics of a saple of size. X r: is called the rth order statistic ad the rado vector (X : X :... X : ) is the order statistic. Note that X : is the saple iiu ad X : is the saple axiu. X : is called the iia order statistic ad X : is called the axia order statistic or i geeral they are called the extree order statistics of a saple of size. The distributio fuctio of the saple axia X : is give by: P { X : = F( (.3) Three distributio fuctios are give for studyig the liitig d.f. of saple axia (i other words: extree value d.f. s): 0 0 ( ) = x G α x if exp( α FrFchet (.4) x ) x > 0 α exp( ( x) ) x 0 G α ( x) = if Weibull (.5) 0 x > 0 x G3( x) = exp( e ) for every x Gubel (.6) Defiitio [0] F is said to belog to the wea doai of attractio of liitig d.f. G if there exist serious of costats a > 0 ad reals b such that: F ( b + xa ) G( x) (.7) for every cotiuity poit of G. Let us defie the right edpoit of d.f. F as: ω ( = sup{ x : F( x) < } = F () (.8) Theore [0] A d.f. F belogs to the wea doai of attractio of a extree value d.f. G iα iff. oe of the followig coditios holds: F( tx) α ( α ) : ω( = ad li = x x > 0 t F( (.9) F( ω( + x α ( α ) : ω( < ad li = ( ) < 0 0 ( ( ) ) x x (.0) t F ω F t (3) : F( t + xg( ) li = e ω ( F ) F( t x - < x < (.) ad represets approachig decreasigly represets approachig icreasigly. Moreover costats a ad b ca be chose i the followig way: ( α ) : b = 0 a = F ( ) (.) ( α ) : b = ω( a = ω( F ( ) (.3) (3) : b = F ( ) a = g( b ) (.4) If a distributio F satisfies oe of the coditios i Theore we siply call the correspodig G iα the asyptotic distributio of the saple axia of distributio F. Theore ot oly gives the coditios of to which d.f. G the extree distributio will coverge but also the guidelies for us to choose a correct asyptotic extree distributio for a specific applicatio. Theore [0] The wea covergece to the liitig d.f. G holds for other choices of costats a ad b if ad oly if a a ad ( b b ) a 0 as (.5) Theore gives other possibilities of choosig a ad b i theore. I special cases whe F(x) has a fiite right edpoit by Theore the choice of b ( ) i Eq.(.3) is uique.. Maxiu-lielihood estiatio for paraeters of the Weibull distributio whe α > For reasos that will be ade clear i a later sectio we are iterested i developig a axiu-lielihood estiator for paraeters of a geeralized Weibull distributio defied as: α exp( β ( μ x) ) x μ G ( x; α β μ) = if (.6) 0 x > μ where μ is a locatio paraeter which deteries the right edpoit (i.e. axiu) of the distributio β > 0 is a scale paraeter ad α is the shape paraeter. The axiu-lielihood estiatio proble is defied as follows: Give idepedet rado saples x x x of G(x; α β μ) fid the values of α β μ which axiize the lielihood fuctio [9]: L = β μ) log[ G( x i i= ( α ; α β μ)] (.7) This axiu lielihood estiator whe it exists will be deoted by the vector αˆ βˆ ˆ μ ) ad satisfies: (

3 L ( αˆ ˆ ˆ β μ ) = 0 (.8) { α β μ} Let α 0 β0 μ0 deote the actual values of paraeters of the distributio G. It was proved i [9] that whe α > αˆ α βˆ β μˆ μ ) coverges i distributio ( ( ) to a oral rado distributio vector with ea 0. III. The estiatio Approach The proble of axiu power estiatio ca be stated as follows: Give a set V (called populatio) of iput vector pairs estiate the axiu power dissipatio that the circuit ay exhibit for ay vector pair i the populatio. A vector pair i V is called a uit of the populatio. I this paper the populatio ay iclude either all possible iput vector pairs applied to a circuit or all possible vector pairs uder soe iput trasitio probability costraits. Although there could oly be a fiite uber of distict vector pairs i the populatio but the size of V represeted by V is assued to be ifiite sice there is the possibility of repeatig the vector pairs. 3. The asyptotic distributio of the saple axiu power If we regard power cosuptio for a vector pair as a rado variable p a distributio of p is the fored by the power cosuptio values of vector pairs i set V. The average power is the ea value of the distributio. The axiu power is the the right edpoit of the distributio. Lie other papers o statistical power estiatio we assue the d.f. of power cosuptio i a large LSI circuit as a cotiuous distributio. Give populatio V the ith saple for ax power estiatio is fored by the power values of radoly selected uits: pi pi pi i = where is called the saple size ad the uber of saples. The axiu power i each saple is defied as: pi MAX = ax{ pi pi pi } i = (3.) Accordig to Eq.(.5) the d.f. of p imax ca be writte as: H ( p MAX ) = F ( p). As etioed i Theore H(b + p imax a ) asyptotically coverges to oe of the three distributios defied i Eq. s(.7) (.8) ad (.9). I the reaider of this paper we will use ω( deotig the actual axiu power of the populatio. We ow that power cosuptio i a LSI circuit is always a fiite value i.e. ω( <. Therefore the coditio i (.9) is ot et ad H(b + p imax a ) ca ot coverge to G α. Also because the upper boud of supportig doai for G 3 is ifiite while that of G α is fiite The coditio i (.0) is ore liely to hold tha that i (.). Therefore H(b + p imax a ) is ore liely to coverge to G α rather tha G 3. It is poited out i [0] that ost frequetly used cotiuous distributios with fiite right edpoit ( ω ( < ) satisfy the coditio i Eq.(.0). Therefore i ay egieerig applicatios of axia estiatio it is assued that the distributio uder study belogs to the wea covergece doai of G α. This stateet has also bee epirically proved to be true by our experiets (cf. later this sectio). Therefore we state that the distributio of p imax asyptotically follows the Weibull distributio G α. This eas that there exist a ad b such that: F( b + a p ) = F ( b + a p) G α ( p ) (3.) i MAX i MAX pi MAX b or F( pi MAX ) G α ( ) i = (3.3) a Fro Eq. s (.3) ad (.5) we get b = ω( where ω( is the axiu power cosuptio of the populatio. If we substitute the geeralized Weibull distributio defied i Eq.(.6) ito Eq.(3.3) we get F p ) G( p ; α β μ) i = ( i MAX i MAX where β=(/a ) α ad μ=b. Experiets have bee desiged to verify the asyptotic distributio of saple axia. The distributios of saple axia for differet saple size ( = ) was fored by 000 rado saples fro the populatio. Their closest Weibull distributios are obtaied by usig least-square fittig techiques. Figure shows the results for circuit C3540. = = 0 = 30 = 50 Figure The copariso betwee distributio of saple axia ad Weibull distributio Experiets are doe for other circuits ad populatios ad the siilar results are obtaied. Fro these results we cocluded that the differece betwee distributios of p imax ad Weibull distributio i the regio ear the axiu power is egligible whe 30. Sice we are oly iterested i estiatig the axiu power we fix the saple size to 30 ad assu that the distributio of p imax follows Weibull distributio whe 30. Cosequetly p imax (i= ) ( = 30) becoe the saples of the geeralized Weibull distributio i (.6). Most iportatly if previous assuptios hold we have: ω ( = μ. Therefore the proble of axiu power estiatio is equivalet to the proble of estiatig the locatio paraeter μ of a geeralized Weibull distributio fro rado saples. The siplest way of doig this is to curve-fit the saples to Eq.(.6) to get values of α β ad μ. However our study shows that the curve fittig approach is ustable sice the proble becoes difficult whe we tryig to costruct the distributio fro sall uber of saples. We choose aother estiatio ethod that is ore robust ad has a solid theoretical support. 3.3 A Maxiu-lielihood estiator of axiu power dissipatio The axiu-lielihood estiators for paraeters of geeralized Weibull distributio for α > have bee itroduced i Sectio II. I fact α is always large tha if the saple size is uch saller tha the populatio size V. Cosequetly let αˆ βˆ μˆ be the estiators that satisfy Eq. (.8) we ca prove the followig result. Theore 3 αˆ βˆ μˆ ( ) are the ubiased estiators of α β μ of the Weibull distributio which eas that

4 αˆ βˆ μˆ ( ) follow oral distributios with ea values of α 0 β0 μ0 ad covariace atrix VAR. The atrix VAR is defied as: σ α σ α β σ α μ VAR = σ β α σ β σ β μ (3.4) σ μ α σ μ β σ μ Fro Theore 3 we ow that the axiu power estiator μˆ coverges to a oral distributio with ea of μ 0 (which is the actual axiu power ω() ad variace of σ μ. Theore 4 μˆ is a ubiased estiator for axiu power ω(. Give cofidece level l (l (0)) the cofidece iterval of the estiated axiu power μˆ ( ) is give by: [ ω( ul σ μ ω( + ul σ μ ] (3.5) where ω( is the actual axiu power is the uber of saples σ μ is defied i Eq.(3.4) ad u l is defied as: ul e dx = l (3.6) ul π Theore 4 states that the probability that the estiated axiu power falls ito the iterval defied i Eq.(3.5) is l. For a give l saller cofidece iterval eas higher estiatio accuracy. Therefore the relative estiatio error is iversely proportioal to the square root of the variace of the estiator. I practice the theoretical cofidece iterval caot be calculated directly because σ μ is uow. Therefore we do ot ow a priori how ay saples are eeded to achieve certai cofidece iterval at give cofidece level. A iterative (Mote-Carlo) ethod has bee desiged to solve this proble. 3.4 The iterative estiatio procedure Experiets have bee desiged to study the distributio of the axiu lielihood estiator for axiu power i cases whe the uber of saples is fiite (we ow fro Theore 3 that whe this axiu lielihood estiator for ω( follows a oral distributio). The saple size is fixed at =30 ad differet uber of saples are used (=050). Durig each sigle experiet saples with saple size are radoly selected fro the populatio. Maxiu power is the estiated by usig the axiu lielihood estiator μˆ. The progra for axiu lielihood estiatio ca be foud i ay places. For each distict the saplig-estiatio procedure is repeated 00 ties to for the distributio of estiated value. The distributios of estiated axiu power for differet values of are the fored ad their earest oral distributios are obtaied by least-square curve fittig. The results for circuit C3540 are show i Figure. Figure The distributios of estiated axiu power copared with the earest oral distributio Siilar results are obtaied for other circuits. Fro the experietal results we ca coclude that the estiator for x =0 =50 axiu power is approxiately orally distributed whe the uber of saples is large eough ( 0). Therefore we assue oral distributio of estiator for axiu power whe 0. Before we itroduce our practical axiu power estiatio procedure we suarize our discussios i earlier part of this sectio as show i Figure 3. Saple MAX Populatio Maxiu- Lielihood Estiatio Hyper Saple Saple MAX The distributio of sapled uits follows the distributio of the origial populatio F(p) Distributio of saple axia follows the geeralized Weibull distributio G(p imax ; αβμ) whe 30 The estiated axiu power follows oral distributio whe 0 Figure 3 Syopsis of axiu power estiatio ethod I Figure 3 a hyper-saple is defied as the result of oe ru of axiu power estiatio for saples with size. We fix the value of to 30 ad value of to 0 the the uber of uits which is eeded to for a hyper-saple is 300. Theore 5 Let P ˆ i MAX (i=...) deote the ith hyper-saple for =30 ad =0 P ˆ i MAX follows the oral distributio with ea value of ω( ad variace of σ μ 0 where σ μ is defied i Eq.(3.4). By defie: PMAX = Pˆ i ad MAX s = ( Pˆ i MAX PMAX ) (3.7) i= i= Theore 6 P MAX ad s are ubiased estiators of the actual axiu power ω( ad σ μ 0 respectively. Give cofidece level l the cofidece iterval for the actual axiu power is give by: tl s tl s [ PMAX PMAX + ] (3.8) where t l- is the l 00% percetile poit of the t distributio with degree of freedo of -. Theore 6 gives us a guidelie for desigig a iterative procedure for axiu power estiatio subject to the required accuracy (relative error less tha or equal to ε) at give cofidece level l. The basic worflow is show i Figure 4. I Figure 4 the geeratio of a hyper-saple follows the procedure show i Figure 3. Cofidece iterval is calculated usig Eq.(3.8). The axiu relative error is calculated usig tl s the cofidece iterval as PMAX. If this quatity is

5 larger tha the required ε the the estiated value has ot coverged ad we add oe ore hyper-saple; otherwise the estiatio has coverged ad we report the estiatio result. START Add oe hyper-saple Copute the cofidece iterval for give Is the cofidece iterval saller tha the required value? YES Report Result Figure 4 Iterative flow of axiu power estiatio 3.5 Practical issue: fiite populatio versus ifiite populatio The approach discussed i the earlier part of this sectio is desiged for estiatig the axiu power of a ifiite populatio. However we ust deal with a fiite populatio i real applicatios. As a exaple our experietal setup i the ext sectio uses fiite populatios. Experietal results shows that if we use the sae approach for fiite populatio as for the ifiite populatio there will be bias i axiu lielihood estiatio i the sese that the ea of the estiated value is always larger tha the actual axiu power of the populatio. This happes because estiator μˆ is estiatig the axiu power of a ifiite populatio that should have (with soe probability) a eve tail after the actual axiu power of the populatio. While this tail does ot exist i the case of a fiite populatio. To solve this proble we ca regard the fiite populatio V as a saple of size V selected radoly fro the assued cotiuous distributio for the ifiite populatio. Assue there is oly oe uit i the fiite populatio which cosues the axiu power the the axiu power of the fiite populatio becoes the estiated (-/ V ) quatile poit of the assued cotiuous distributio. Accordig to the tail-equivalece property betwee a distributio ad the liitig distributio of its saple axia [0] estiatig the (-/ V ) quatile poit of the origial populatio is equivalet to estiatig the (-/ V ) quatile poit of the asyptotic Weibull distributio of the saple axia. Therefore whe estiatig the axiu power of a fiite populatio istead of usig the theoretical Add oe ore hyper-saple NO μˆ (which is the 00% quatile poit of the estiated geeralized Weibull distributio) we use the (-/ V ) quatile poit of the Weibull distributio (whose paraeters ca be estiated by usig the axiu lielihood estiator) as the estiator for the axiu power. We call this the odified estiator for the fiite populatio. Experietal results show that the odified estiator gives us a ubiased estiator for fiite populatios. IV. Experietal results Category I.. Estiatig the ucostraied axiu power. Proposed ethod: I this category the goal is to estiate the axiu power of the circuit for all possible iput vector pairs. Cosequetly the siple rado saplig procedure ca be realized by radoly geeratig vector pairs that is the two ethod (i.e. rado vector geeratio ad siple rado saplig) are equivalet i this case. Except for the fact that the saplig techique is replaced by the rado vector geeratio the reaiig part of our approach (cf. Figure 3 ad Figure 4) reais the sae. Experietal results ad discussio: Let us give a theoretical study o the efficiecy of the estiatio ethod of rado vector geeratio or siple rado saplig. Assue we wat to estiate axiu power of error less tha 5% at cofidece level 90% for a populatio. Let the size of the populatio be V. Defie the qualified uits as those uits whose values are withi 5% differece of the actual axiu. Assue the uber of the qualified uits is Z. The portio of the qualifies uits i the whole populatio is the Y=Z/ V. If we saple x uits fro the populatio the probability that there is at least oe qualified uit i these x uits is give by: x P = ( Y ). For P to be larger tha or equal to 90% we eed o average x = log(0.)/log(-y) sapled uits. Fro our experiets we have observed that Y is very sall (e.g. <0.000). This leads to very large x (e.g. >3000). The experietal setup is as follows. The populatio cotais radoly geerated high activity (average switchig activity larger that 0.3) vector pairs. Rado vector geeratio is equivalet to siple rado saplig vector pairs fro the populatio. The whole populatio is siulated usig Powerill [] to get the power cosuptio value for each uit ad i the process the actual axiu power. Our approach (=30 =0) ad siple rado saplig (SRS) have bee applied to do axiu power estiatio for relative error < 5% at cofidece level 90%. The experietal results are show i Table ad Table. Our approach has bee applied to do axiu power estiatio 00 ties for each circuit. Table shows the copariso of efficiecy ad accuracy of our approach versus siple rado saplig. The portio of the qualified uits i the whole populatio is give i the d colu. The axiu iiu ad average uber of uits eeded for our approach to coverge are reported i the 3 rd 4 th ad 5 th colus respectively. The 6 th colu gives the theoretically calculated (accordig to the discussio of the secod paragraph fro the botto of page 4) uber of uits eeded by siple rado saplig to achieve the sae error (5%) ad cofidece (90%) level. The 7 th ad 8 th colus give the absolute value of the axiu ad iiu estiatio error of our approach. We have ot give the relative error for SRS because the SRS techique is ot able to predict the axiu power subject to give error ad cofidece levels. Table shows the copariso for the estiatio quality. Siple rado saplig techiques usig 500 0K ad 0K uits are perfored 00 ties respectively. The d colu gives the actual axiu power of the populatio. Colus ad 6 give the results of largest-error estiates for differet techiques. Colu ad 0 give the results of the percetage of the tie whe the estiated value exceeds the error level. The experietal results shows that our approach is uch ore efficiet tha the siple rado saplig techique (about X speedup o average). More iportatly however siple rado saplig or siilar techiques are ot reliable because they caot provide cofidece iterval ad cofidece level for axiu power estiatio. Also the estiatio quality of our approach is obviously better tha siple rado saplig. Fro the results of Table if we copare our approach with siple

6 rado saplig with 0K uits the average largest error is 5.3% for our approach ad 0.4% for SRS. As to the average percetage of estiated value with error larger tha 5% it is 4.3% for our approach ad 3% for SRS. It ca be foresee that the advatage of our approach over SRS will be ore predoiat for ifiite populatio. Portio of the # of uits eeded Relative error Circuit qualified Our approach SRS Our approach uits MAX MIN AVE AVE MAX MIN C % 0.3% C %.4% C % 0.6% C %.% C %.7% C % 0.8% C % 0.05% C % 0.6% C %.9% Table Results for coparig the efficiecy ad accuracy Actual Largest estiatio error % of estiates with error > Circuits ax. 5% power Our SRS Our SRS (W) appr K 0K appr K 0K C % -3% -8.5% -6.3% 6% 80% 5% 5% C % -4% 7.5% -6.3% 3% 73% 8% 8% C % -8.6% -5.4% -.5% % 38% % 0% C % -4% -0% -8.9% 5% 80% 5% 33% C % -% -3% -4% 8% 89% 73% 57% C % -9.7% -7.7% -6.% % 73% 7% 3% C % -% -% -% 3% 76% 6% 5% C % -4% -0% -7.3% 7% 9% 69% 54% C % -0% -5% -% 4% 88% 4% 9% Table Results for coparig the estiatio quality Portio of the # of uits eeded Relative error Circuit qualified uits Our approach SRS Our approach MAX MIN AVE AVE MAX MIN C %.8% C %.0% C % 0.5% C % 4.0% C %.% C % 4.% C %.7% C % 0.9% C %.% Table 3 Results for coparig efficiecy ad accuracy Category I.. Estiatig the costraied axiu power. Proposed ethod: Siilar to Category I. except that vector pairs are geerated uder give costraits. Experietal setup: Siilar to Category I. this tie we geerate two populatios (each of size 80000) subject to the costrait that the average switchig activity per iput lie is 0.7 ad 0.3 respectively. Detailed copariso with siple rado saplig has bee perfored as well. However we give oly the tables for coparig efficiecy ad accuracy i order to save space. The experietal results for populatios of average switchig activity 0.7 ad 0.3 are show i Table 3 ad Table 4 respectively. The eaig of etries i differet colus is the sae as that i Table. The estiatio quality copariso ca be see fro the value of the portio of the qualified uits i the d colus of both tables. As expected whe he uber of qualified uits i the populatio decreases the uber of uits eeded to estiated the axiu power dissipatio i the circuit icreases. Portio of the # of uits eeded Relative error Circuit qualified Our approach SRS Our approach uits MAX MIN AVE AVE MAX MIN C %.% C % 3.5% C %.7% C %.9% C %.4% C % 3.4% C % 0.6% C % 3.3% C %.9% Table 4 Results for coparig efficiecy ad accuracy V. Coclusio I coclusio a statistical approach has bee proposed based o the asyptotic theory of extree order statistics. This is the first axiu power estiatio approach which ca provide cofidece iterval at give cofidece level. This is also the first approach which ca do axiu power estiatio for ay userspecified error ad cofidece levels. The proposed approach ca predict the axiu power i the space of costraied iput vector pairs as well as the coplete space of all possible iput vector pairs. It is a efficiet siulatio-based approach with high accuracy. The geerality of this approach aes it also applicable to other fields of VLSI desig autoatio for exaple axiu delay estiatio. REFERENCES [] H. Kriplai F. Naj ad I. Hajj Maxiu Curret Estiatio i CMOS Circuits Proceedigs of Desig Autoatio Coferece 99. [] S.Mae A.Pardo R.Bahar G.Hachtel F.Soezi E.Macii ad M.Pocio Coputig the Maxiu Power Cycles of a Sequetial Circuit Proceedigs of Desig Autoatio Coferece 995. [3] C.-Y. Wag ad K. Roy Maxiu Curret Estiatio i CMOS Circuits Usig Deteriistic ad Statistical Techiques Proceedigs of IEEE VLSI Desig Coferece Ja [4] C.-Y. Wag T.-L. Chou ad K. Roy Maxiu Power Estiatio Uder Arbitrary Delay Model Proceedigs of IEEE Iteratioal Syposiu o Circuits ad Systes 996. [5] C.-Y. Wag ad K. Roy COSMOS: A Cotiuous Optiizatio Approach for Maxiu Power Estiatio of CMOS Circuits Proceedigs of ACM/IEEE Iteratioal Coferece o Coputer- Aided Desig 997 to appear. [6] M.S. Hsiao E.M. Rudic ad J.H. Patel K: A Estiator for Pea Sustaiable Power of VLSI Circuits Proceedigs of Iteratioal Syposiu o Low Power Electroics ad Desig pp Aug [7] A. Hill C.-C. Teg ad S.M. Kag Siulatio-based axiu power estiatio Proceedigs of ISCAS [8] C.S. Dig Q. Wu C.T. Hsieh ad M. Pedra Statistical Estiatio of the Cuulative Distributio Fuctio for power dissipatio i VLSI Circuits Proceedigs of Desig Autoatio Coferece pp Ju [9] R.L. Sith Maxiu lielihood estiatio i a class of oregular cases Bioetria pp [0] J. Galabos The Asyptotic Theory of Extree Order Statistics Robert E. Krieger Publishig Copay 987 [] Aalog Cirsuit Egie Release Notes Syopsis 997.

Contents Two Sample t Tests Two Sample t Tests

Contents Two Sample t Tests Two Sample t Tests Cotets 3.5.3 Two Saple t Tests................................... 3.5.3 Two Saple t Tests Setup: Two Saples We ow focus o a sceario where we have two idepedet saples fro possibly differet populatios. Our

More information

We have also learned that, thanks to the Central Limit Theorem and the Law of Large Numbers,

We have also learned that, thanks to the Central Limit Theorem and the Law of Large Numbers, Cofidece Itervals III What we kow so far: We have see how to set cofidece itervals for the ea, or expected value, of a oral probability distributio, both whe the variace is kow (usig the stadard oral,

More information

Data Analysis and Statistical Methods Statistics 651

Data Analysis and Statistical Methods Statistics 651 Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tau.edu/~suhasii/teachig.htl Suhasii Subba Rao Exaple The itroge cotet of three differet clover plats is give below. 3DOK1 3DOK5 3DOK7

More information

ECE 901 Lecture 4: Estimation of Lipschitz smooth functions

ECE 901 Lecture 4: Estimation of Lipschitz smooth functions ECE 9 Lecture 4: Estiatio of Lipschitz sooth fuctios R. Nowak 5/7/29 Cosider the followig settig. Let Y f (X) + W, where X is a rado variable (r.v.) o X [, ], W is a r.v. o Y R, idepedet of X ad satisfyig

More information

AN EFFICIENT ESTIMATION METHOD FOR THE PARETO DISTRIBUTION

AN EFFICIENT ESTIMATION METHOD FOR THE PARETO DISTRIBUTION Joural of Statistics: Advaces i Theory ad Applicatios Volue 3, Nuber, 00, Pages 6-78 AN EFFICIENT ESTIMATION METHOD FOR THE PARETO DISTRIBUTION Departet of Matheatics Brock Uiversity St. Catharies, Otario

More information

The Hypergeometric Coupon Collection Problem and its Dual

The Hypergeometric Coupon Collection Problem and its Dual Joural of Idustrial ad Systes Egieerig Vol., o., pp -7 Sprig 7 The Hypergeoetric Coupo Collectio Proble ad its Dual Sheldo M. Ross Epstei Departet of Idustrial ad Systes Egieerig, Uiversity of Souther

More information

Lecture 19. Curve fitting I. 1 Introduction. 2 Fitting a constant to measured data

Lecture 19. Curve fitting I. 1 Introduction. 2 Fitting a constant to measured data Lecture 9 Curve fittig I Itroductio Suppose we are preseted with eight poits of easured data (x i, y j ). As show i Fig. o the left, we could represet the uderlyig fuctio of which these data are saples

More information

Statistics and Data Analysis in MATLAB Kendrick Kay, February 28, Lecture 4: Model fitting

Statistics and Data Analysis in MATLAB Kendrick Kay, February 28, Lecture 4: Model fitting Statistics ad Data Aalysis i MATLAB Kedrick Kay, kedrick.kay@wustl.edu February 28, 2014 Lecture 4: Model fittig 1. The basics - Suppose that we have a set of data ad suppose that we have selected the

More information

Surveying the Variance Reduction Methods

Surveying the Variance Reduction Methods Available olie at www.scizer.co Austria Joural of Matheatics ad Statistics, Vol 1, Issue 1, (2017): 10-15 ISSN 0000-0000 Surveyig the Variace Reductio Methods Arash Mirtorabi *1, Gholahossei Gholai 2 1.

More information

X. Perturbation Theory

X. Perturbation Theory X. Perturbatio Theory I perturbatio theory, oe deals with a ailtoia that is coposed Ĥ that is typically exactly solvable of two pieces: a referece part ad a perturbatio ( Ĥ ) that is assued to be sall.

More information

Probabilistic Analysis of Rectilinear Steiner Trees

Probabilistic Analysis of Rectilinear Steiner Trees Probabilistic Aalysis of Rectiliear Steier Trees Chuhog Che Departet of Electrical ad Coputer Egieerig Uiversity of Widsor, Otario, Caada, N9B 3P4 E-ail: cche@uwidsor.ca Abstract Steier tree is a fudaetal

More information

A string of not-so-obvious statements about correlation in the data. (This refers to the mechanical calculation of correlation in the data.

A string of not-so-obvious statements about correlation in the data. (This refers to the mechanical calculation of correlation in the data. STAT-UB.003 NOTES for Wedesday 0.MAY.0 We will use the file JulieApartet.tw. We ll give the regressio of Price o SqFt, show residual versus fitted plot, save residuals ad fitted. Give plot of (Resid, Price,

More information

Chapter 2. Asymptotic Notation

Chapter 2. Asymptotic Notation Asyptotic Notatio 3 Chapter Asyptotic Notatio Goal : To siplify the aalysis of ruig tie by gettig rid of details which ay be affected by specific ipleetatio ad hardware. [1] The Big Oh (O-Notatio) : It

More information

Statistics for Applications Fall Problem Set 7

Statistics for Applications Fall Problem Set 7 18.650. Statistics for Applicatios Fall 016. Proble Set 7 Due Friday, Oct. 8 at 1 oo Proble 1 QQ-plots Recall that the Laplace distributio with paraeter λ > 0 is the cotiuous probaλ bility easure with

More information

Mixture models (cont d)

Mixture models (cont d) 6.867 Machie learig, lecture 5 (Jaakkola) Lecture topics: Differet types of ixture odels (cot d) Estiatig ixtures: the EM algorith Mixture odels (cot d) Basic ixture odel Mixture odels try to capture ad

More information

Binomial transform of products

Binomial transform of products Jauary 02 207 Bioial trasfor of products Khristo N Boyadzhiev Departet of Matheatics ad Statistics Ohio Norther Uiversity Ada OH 4580 USA -boyadzhiev@ouedu Abstract Give the bioial trasfors { b } ad {

More information

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces

Lecture 10: Bounded Linear Operators and Orthogonality in Hilbert Spaces Lecture : Bouded Liear Operators ad Orthogoality i Hilbert Spaces 34 Bouded Liear Operator Let ( X, ), ( Y, ) i i be ored liear vector spaces ad { } X Y The, T is said to be bouded if a real uber c such

More information

Bertrand s postulate Chapter 2

Bertrand s postulate Chapter 2 Bertrad s postulate Chapter We have see that the sequece of prie ubers, 3, 5, 7,... is ifiite. To see that the size of its gaps is ot bouded, let N := 3 5 p deote the product of all prie ubers that are

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

Hypothesis tests and confidence intervals

Hypothesis tests and confidence intervals Hypothesis tests ad cofidece itervals The 95% cofidece iterval for µ is the set of values, µ 0, such that the ull hypothesis H 0 : µ = µ 0 would ot be rejected by a two-sided test with α = 5%. The 95%

More information

Optimal Estimator for a Sample Set with Response Error. Ed Stanek

Optimal Estimator for a Sample Set with Response Error. Ed Stanek Optial Estiator for a Saple Set wit Respose Error Ed Staek Itroductio We develop a optial estiator siilar to te FP estiator wit respose error tat was cosidered i c08ed63doc Te first 6 pages of tis docuet

More information

(s)h(s) = K( s + 8 ) = 5 and one finite zero is located at z 1

(s)h(s) = K( s + 8 ) = 5 and one finite zero is located at z 1 ROOT LOCUS TECHNIQUE 93 should be desiged differetly to eet differet specificatios depedig o its area of applicatio. We have observed i Sectio 6.4 of Chapter 6, how the variatio of a sigle paraeter like

More information

CSCI-6971 Lecture Notes: Stochastic processes

CSCI-6971 Lecture Notes: Stochastic processes CSCI-6971 Lecture Notes: Stochastic processes Kristopher R. Beevers Departet of Coputer Sciece Resselaer Polytechic Istitute beevek@cs.rpi.edu February 2, 2006 1 Overview Defiitio 1.1. A stochastic process

More information

5.6 Binomial Multi-section Matching Transformer

5.6 Binomial Multi-section Matching Transformer 4/14/21 5_6 Bioial Multisectio Matchig Trasforers 1/1 5.6 Bioial Multi-sectio Matchig Trasforer Readig Assiget: pp. 246-25 Oe way to axiize badwidth is to costruct a ultisectio Γ f that is axially flat.

More information

Non-asymptotic sequential confidence regions with fixed sizes for the multivariate nonlinear parameters of regression. Andrey V.

Non-asymptotic sequential confidence regions with fixed sizes for the multivariate nonlinear parameters of regression. Andrey V. No-asyptotic sequetial cofidece regios with fixed sizes for the ultivariate oliear paraeters of regressio Adrey V Tiofeev Abstract I this paper we cosider a sequetial desig for estiatio of o-liear paraeters

More information

Some Examples on Gibbs Sampling and Metropolis-Hastings methods

Some Examples on Gibbs Sampling and Metropolis-Hastings methods Soe Exaples o Gibbs Saplig ad Metropolis-Hastigs ethods S420/620 Itroductio to Statistical Theory, Fall 2012 Gibbs Sapler Saple a ultidiesioal probability distributio fro coditioal desities. Suppose d

More information

Chapter 6 Sampling Distributions

Chapter 6 Sampling Distributions Chapter 6 Samplig Distributios 1 I most experimets, we have more tha oe measuremet for ay give variable, each measuremet beig associated with oe radomly selected a member of a populatio. Hece we eed to

More information

6.3 Testing Series With Positive Terms

6.3 Testing Series With Positive Terms 6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial

More information

42 Dependence and Bases

42 Dependence and Bases 42 Depedece ad Bases The spa s(a) of a subset A i vector space V is a subspace of V. This spa ay be the whole vector space V (we say the A spas V). I this paragraph we study subsets A of V which spa V

More information

Burr-XII Distribution Parametric Estimation and Estimation of Reliability of Multicomponent Stress-Strength

Burr-XII Distribution Parametric Estimation and Estimation of Reliability of Multicomponent Stress-Strength Burr-XII Distributio Paraetric Estiatio ad Estiatio of Reliability of Multicopoet Stress-Stregth G. Sriivasa Rao ad Muhaad Asla ad Debasis Kudu 3 Departet of Statistic School of M & C S, Dilla Uiversity,

More information

Lecture 19: Convergence

Lecture 19: Convergence Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may

More information

REDUCING THE POSSIBILITY OF SUBJECTIVE ERROR IN THE DETERMINATION OF THE STRUCTURE-FUNCTION-BASED EFFECTIVE THERMAL CONDUCTIVITY OF BOARDS

REDUCING THE POSSIBILITY OF SUBJECTIVE ERROR IN THE DETERMINATION OF THE STRUCTURE-FUNCTION-BASED EFFECTIVE THERMAL CONDUCTIVITY OF BOARDS Nice, Côte d Azur, Frace, 27-29 Septeber 2006 REDUCING THE POSSIBILITY OF SUBJECTIVE ERROR IN THE DETERMINATION OF THE STRUCTURE-FUNCTION-BASED EFFECTIVE THERMAL CONDUCTIVITY OF BOARDS Erő Kollár, Vladiír

More information

Lecture Outline. 2 Separating Hyperplanes. 3 Banach Mazur Distance An Algorithmist s Toolkit October 22, 2009

Lecture Outline. 2 Separating Hyperplanes. 3 Banach Mazur Distance An Algorithmist s Toolkit October 22, 2009 18.409 A Algorithist s Toolkit October, 009 Lecture 1 Lecturer: Joatha Keler Scribes: Alex Levi (009) 1 Outlie Today we ll go over soe of the details fro last class ad ake precise ay details that were

More information

1 Introduction to reducing variance in Monte Carlo simulations

1 Introduction to reducing variance in Monte Carlo simulations Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by

More information

CHAPTER 6 RESISTANCE FACTOR FOR THE DESIGN OF COMPOSITE SLABS

CHAPTER 6 RESISTANCE FACTOR FOR THE DESIGN OF COMPOSITE SLABS CHAPTER 6 RESISTANCE FACTOR FOR THE DESIGN OF COMPOSITE SLABS 6.1. Geeral Probability-based desig criteria i the for of load ad resistace factor desig (LRFD) are ow applied for ost costructio aterials.

More information

Wavelet Transform Theory. Prof. Mark Fowler Department of Electrical Engineering State University of New York at Binghamton

Wavelet Transform Theory. Prof. Mark Fowler Department of Electrical Engineering State University of New York at Binghamton Wavelet Trasfor Theory Prof. Mark Fowler Departet of Electrical Egieerig State Uiversity of New York at Bighato What is a Wavelet Trasfor? Decopositio of a sigal ito costituet parts Note that there are

More information

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3

(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3 MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special

More information

The Binomial Multi-Section Transformer

The Binomial Multi-Section Transformer 4/15/2010 The Bioial Multisectio Matchig Trasforer preset.doc 1/24 The Bioial Multi-Sectio Trasforer Recall that a ulti-sectio atchig etwork ca be described usig the theory of sall reflectios as: where:

More information

Bayesian Estimation and Prediction for Pareto Distribution based on Ranked set Sampling

Bayesian Estimation and Prediction for Pareto Distribution based on Ranked set Sampling J. Stat. Appl. Pro. 4, No. 2, 211-221 215 211 Joural of Statistics Applicatios & Probability A Iteratioal Joural http://dx.doi.org/1.12785/jsap/423 Bayesia Estiatio ad Predictio for Pareto Distributio

More information

Queueing Theory II. Summary. M/M/1 Output process Networks of Queue Method of Stages. General Distributions

Queueing Theory II. Summary. M/M/1 Output process Networks of Queue Method of Stages. General Distributions Queueig Theory II Suary M/M/1 Output process Networks of Queue Method of Stages Erlag Distributio Hyperexpoetial Distributio Geeral Distributios Ebedded Markov Chais 1 M/M/1 Output Process Burke s Theore:

More information

Expectation and Variance of a random variable

Expectation and Variance of a random variable Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio

More information

Element sampling: Part 2

Element sampling: Part 2 Chapter 4 Elemet samplig: Part 2 4.1 Itroductio We ow cosider uequal probability samplig desigs which is very popular i practice. I the uequal probability samplig, we ca improve the efficiecy of the resultig

More information

5.6 Binomial Multi-section Matching Transformer

5.6 Binomial Multi-section Matching Transformer 4/14/2010 5_6 Bioial Multisectio Matchig Trasforers 1/1 5.6 Bioial Multi-sectio Matchig Trasforer Readig Assiget: pp. 246-250 Oe way to axiize badwidth is to costruct a ultisectio Γ f that is axially flat.

More information

Discrete Mathematics for CS Spring 2008 David Wagner Note 22

Discrete Mathematics for CS Spring 2008 David Wagner Note 22 CS 70 Discrete Mathematics for CS Sprig 2008 David Wager Note 22 I.I.D. Radom Variables Estimatig the bias of a coi Questio: We wat to estimate the proportio p of Democrats i the US populatio, by takig

More information

A PROBABILITY PROBLEM

A PROBABILITY PROBLEM A PROBABILITY PROBLEM A big superarket chai has the followig policy: For every Euros you sped per buy, you ear oe poit (suppose, e.g., that = 3; i this case, if you sped 8.45 Euros, you get two poits,

More information

Sample size calculations. $ available $ per sample

Sample size calculations. $ available $ per sample Saple size calculatios = $ available $ per saple Too few aials A total waste Too ay aials A partial waste Power X 1,...,X iid oralµ A, A Y 1,...,Y iid oralµ B, B Test H 0 : µ A = µ B vs H a : µ A µ B at

More information

Lebesgue Constant Minimizing Bivariate Barycentric Rational Interpolation

Lebesgue Constant Minimizing Bivariate Barycentric Rational Interpolation Appl. Math. If. Sci. 8, No. 1, 187-192 (2014) 187 Applied Matheatics & Iforatio Scieces A Iteratioal Joural http://dx.doi.org/10.12785/ais/080123 Lebesgue Costat Miiizig Bivariate Barycetric Ratioal Iterpolatio

More information

A Tabu Search Method for Finding Minimal Multi-Homogeneous Bézout Number

A Tabu Search Method for Finding Minimal Multi-Homogeneous Bézout Number Joural of Matheatics ad Statistics 6 (): 105-109, 010 ISSN 1549-3644 010 Sciece Publicatios A Tabu Search Method for Fidig Miial Multi-Hoogeeous Bézout Nuber Hassa M.S. Bawazir ad Ali Abd Raha Departet

More information

Define a Markov chain on {1,..., 6} with transition probability matrix P =

Define a Markov chain on {1,..., 6} with transition probability matrix P = Pla Group Work 0. The title says it all Next Tie: MCMC ad Geeral-state Markov Chais Midter Exa: Tuesday 8 March i class Hoework 4 due Thursday Uless otherwise oted, let X be a irreducible, aperiodic Markov

More information

Output Analysis and Run-Length Control

Output Analysis and Run-Length Control IEOR E4703: Mote Carlo Simulatio Columbia Uiversity c 2017 by Marti Haugh Output Aalysis ad Ru-Legth Cotrol I these otes we describe how the Cetral Limit Theorem ca be used to costruct approximate (1 α%

More information

Introduction to Optimization, DIKU Monday 19 November David Pisinger. Duality, motivation

Introduction to Optimization, DIKU Monday 19 November David Pisinger. Duality, motivation Itroductio to Optiizatio, DIKU 007-08 Moday 9 Noveber David Pisiger Lecture, Duality ad sesitivity aalysis Duality, shadow prices, sesitivity aalysis, post-optial aalysis, copleetary slackess, KKT optiality

More information

Statistics 511 Additional Materials

Statistics 511 Additional Materials Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability

More information

Evaluation of Bessel Functions Using a Computer Program

Evaluation of Bessel Functions Using a Computer Program Evaluatio of Bessel Fuctios Usig a Coputer Progra P. S. Yeh, Ph.D. Abstract I cylidrical coordiate, there are two types of Bessel fuctios. These fuctios are the Bessel fuctio ad the odified Bessel fuctio.

More information

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.

Resampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n. Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator

More information

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.

Statistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample. Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized

More information

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10

DS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10 DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set

More information

Integrals of Functions of Several Variables

Integrals of Functions of Several Variables Itegrals of Fuctios of Several Variables We ofte resort to itegratios i order to deterie the exact value I of soe quatity which we are uable to evaluate by perforig a fiite uber of additio or ultiplicatio

More information

After the completion of this section the student

After the completion of this section the student Chapter II CALCULUS II. Liits ad Cotiuity 55 II. LIMITS AND CONTINUITY Objectives: After the copletio of this sectio the studet - should recall the defiitios of the it of fuctio; - should be able to apply

More information

Sequences and Series of Functions

Sequences and Series of Functions Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

CS 70 Second Midterm 7 April NAME (1 pt): SID (1 pt): TA (1 pt): Name of Neighbor to your left (1 pt): Name of Neighbor to your right (1 pt):

CS 70 Second Midterm 7 April NAME (1 pt): SID (1 pt): TA (1 pt): Name of Neighbor to your left (1 pt): Name of Neighbor to your right (1 pt): CS 70 Secod Midter 7 April 2011 NAME (1 pt): SID (1 pt): TA (1 pt): Nae of Neighbor to your left (1 pt): Nae of Neighbor to your right (1 pt): Istructios: This is a closed book, closed calculator, closed

More information

FUZZY RELIABILITY ANALYSIS OF COMPOUND SYSTEM BASED ON WEIBULL DISTRIBUTION

FUZZY RELIABILITY ANALYSIS OF COMPOUND SYSTEM BASED ON WEIBULL DISTRIBUTION IJAMML 3:1 (2015) 31-39 Septeber 2015 ISSN: 2394-2258 Available at http://scietificadvaces.co.i DOI: http://dx.doi.org/10.18642/ijal_7100121530 FUZZY RELIABILITY ANALYSIS OF COMPOUND SYSTEM BASED ON WEIBULL

More information

Convergence of random variables. (telegram style notes) P.J.C. Spreij

Convergence of random variables. (telegram style notes) P.J.C. Spreij Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space

More information

Orthogonal Functions

Orthogonal Functions Royal Holloway Uiversity of odo Departet of Physics Orthogoal Fuctios Motivatio Aalogy with vectors You are probably failiar with the cocept of orthogoality fro vectors; two vectors are orthogoal whe they

More information

Answer Key, Problem Set 1, Written

Answer Key, Problem Set 1, Written Cheistry 1 Mies, Sprig, 018 Aswer Key, Proble Set 1, Writte 1. 14.3;. 14.34 (add part (e): Estiate / calculate the iitial rate of the reactio); 3. NT1; 4. NT; 5. 14.37; 6. 14.39; 7. 14.41; 8. NT3; 9. 14.46;

More information

19.1 The dictionary problem

19.1 The dictionary problem CS125 Lecture 19 Fall 2016 19.1 The dictioary proble Cosider the followig data structural proble, usually called the dictioary proble. We have a set of ites. Each ite is a (key, value pair. Keys are i

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

arxiv: v1 [math.st] 12 Dec 2018

arxiv: v1 [math.st] 12 Dec 2018 DIVERGENCE MEASURES ESTIMATION AND ITS ASYMPTOTIC NORMALITY THEORY : DISCRETE CASE arxiv:181.04795v1 [ath.st] 1 Dec 018 Abstract. 1) BA AMADOU DIADIÉ AND 1,,4) LO GANE SAMB 1. Itroductio 1.1. Motivatios.

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

7.1 Convergence of sequences of random variables

7.1 Convergence of sequences of random variables Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite

More information

Lesson 10: Limits and Continuity

Lesson 10: Limits and Continuity www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals

More information

Estimation for Complete Data

Estimation for Complete Data Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of

More information

Chapter 8: Estimating with Confidence

Chapter 8: Estimating with Confidence Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig

More information

f(1), and so, if f is continuous, f(x) = f(1)x.

f(1), and so, if f is continuous, f(x) = f(1)x. 2.2.35: Let f be a additive fuctio. i Clearly fx = fx ad therefore f x = fx for all Z+ ad x R. Hece, for ay, Z +, f = f, ad so, if f is cotiuous, fx = fx. ii Suppose that f is bouded o soe o-epty ope set.

More information

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01

ENGI 4421 Confidence Intervals (Two Samples) Page 12-01 ENGI 44 Cofidece Itervals (Two Samples) Page -0 Two Sample Cofidece Iterval for a Differece i Populatio Meas [Navidi sectios 5.4-5.7; Devore chapter 9] From the cetral limit theorem, we kow that, for sufficietly

More information

Chapter 2 The Monte Carlo Method

Chapter 2 The Monte Carlo Method Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful

More information

Random Variables, Sampling and Estimation

Random Variables, Sampling and Estimation Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig

More information

A statistical method to determine sample size to estimate characteristic value of soil parameters

A statistical method to determine sample size to estimate characteristic value of soil parameters A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig

More information

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values

Confidence interval for the two-parameter exponentiated Gumbel distribution based on record values Iteratioal Joural of Applied Operatioal Research Vol. 4 No. 1 pp. 61-68 Witer 2014 Joural homepage: www.ijorlu.ir Cofidece iterval for the two-parameter expoetiated Gumbel distributio based o record values

More information

Discrete Mathematics: Lectures 8 and 9 Principle of Inclusion and Exclusion Instructor: Arijit Bishnu Date: August 11 and 13, 2009

Discrete Mathematics: Lectures 8 and 9 Principle of Inclusion and Exclusion Instructor: Arijit Bishnu Date: August 11 and 13, 2009 Discrete Matheatics: Lectures 8 ad 9 Priciple of Iclusio ad Exclusio Istructor: Arijit Bishu Date: August ad 3, 009 As you ca observe by ow, we ca cout i various ways. Oe such ethod is the age-old priciple

More information

Stat 421-SP2012 Interval Estimation Section

Stat 421-SP2012 Interval Estimation Section Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Lecture 11. Solution of Nonlinear Equations - III

Lecture 11. Solution of Nonlinear Equations - III Eiciecy o a ethod Lecture Solutio o Noliear Equatios - III The eiciecy ide o a iterative ethod is deied by / E r r: rate o covergece o the ethod : total uber o uctios ad derivative evaluatios at each step

More information

APPLIED MULTIVARIATE ANALYSIS

APPLIED MULTIVARIATE ANALYSIS ALIED MULTIVARIATE ANALYSIS FREQUENTLY ASKED QUESTIONS AMIT MITRA & SHARMISHTHA MITRA DEARTMENT OF MATHEMATICS & STATISTICS INDIAN INSTITUTE OF TECHNOLOGY KANUR X = X X X [] The variace covariace atrix

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

1 The Primal and Dual of an Optimization Problem

1 The Primal and Dual of an Optimization Problem CS 189 Itroductio to Machie Learig Fall 2017 Note 18 Previously, i our ivestigatio of SVMs, we forulated a costraied optiizatio proble that we ca solve to fid the optial paraeters for our hyperplae decisio

More information

Seunghee Ye Ma 8: Week 5 Oct 28

Seunghee Ye Ma 8: Week 5 Oct 28 Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value

More information

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions

Overview. p 2. Chapter 9. Pooled Estimate of. q = 1 p. Notation for Two Proportions. Inferences about Two Proportions. Assumptions Chapter 9 Slide Ifereces from Two Samples 9- Overview 9- Ifereces about Two Proportios 9- Ifereces about Two Meas: Idepedet Samples 9-4 Ifereces about Matched Pairs 9-5 Comparig Variatio i Two Samples

More information

Math 312 Lecture Notes One Dimensional Maps

Math 312 Lecture Notes One Dimensional Maps Math 312 Lecture Notes Oe Dimesioal Maps Warre Weckesser Departmet of Mathematics Colgate Uiversity 21-23 February 25 A Example We begi with the simplest model of populatio growth. Suppose, for example,

More information

Chapter 6 Principles of Data Reduction

Chapter 6 Principles of Data Reduction Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a

More information

Recall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y.

Recall the study where we estimated the difference between mean systolic blood pressure levels of users of oral contraceptives and non-users, x - y. Testig Statistical Hypotheses Recall the study where we estimated the differece betwee mea systolic blood pressure levels of users of oral cotraceptives ad o-users, x - y. Such studies are sometimes viewed

More information

Application of Homotopy Analysis Method for Solving various types of Problems of Ordinary Differential Equations

Application of Homotopy Analysis Method for Solving various types of Problems of Ordinary Differential Equations Iteratioal Joural o Recet ad Iovatio Treds i Coputig ad Couicatio IN: 31-8169 Volue: 5 Issue: 5 16 Applicatio of Hootopy Aalysis Meod for olvig various types of Probles of Ordiary Differetial Equatios

More information

Measure and Measurable Functions

Measure and Measurable Functions 3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies

More information

AVERAGE MARKS SCALING

AVERAGE MARKS SCALING TERTIARY INSTITUTIONS SERVICE CENTRE Level 1, 100 Royal Street East Perth, Wester Australia 6004 Telephoe (08) 9318 8000 Facsiile (08) 95 7050 http://wwwtisceduau/ 1 Itroductio AVERAGE MARKS SCALING I

More information

A practical approach for comparing means of two groups without equal variance assumption

A practical approach for comparing means of two groups without equal variance assumption STATISTICS IN MEDICINE Statist. Med. 00; 1:3137 3151 DOI: 10.100/si.138) A practical approach for coparig eas of two groups without equal variace assuptio Hasheg Wag ad Shei-Chug Chow StatPlus; Ic.; 1790

More information

2D DSP Basics: Systems Stability, 2D Sampling

2D DSP Basics: Systems Stability, 2D Sampling - Digital Iage Processig ad Copressio D DSP Basics: Systes Stability D Saplig Stability ty Syste is stable if a bouded iput always results i a bouded output BIBO For LSI syste a sufficiet coditio for stability:

More information

ORDANOVA: Analysis of Ordinal Variation

ORDANOVA: Analysis of Ordinal Variation It. Statistical Ist.: Proc. 58th World Statistical Cogress, 0, Dubli (Sessio CPS040) p.48 ORDANOVA: Aalysis of Ordial Variatio Gadrich, Taar ORT Braude College, Idustrial Egieerig ad aageet Departet 5

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

Metrol. Meas. Syst., Vol. XVII (2010), No. 2, pp METROLOGY AND MEASUREMENT SYSTEMS. Index , ISSN

Metrol. Meas. Syst., Vol. XVII (2010), No. 2, pp METROLOGY AND MEASUREMENT SYSTEMS. Index , ISSN Metrol. Meas. Syst., Vol. XVII (, No., pp. 95-4 MEROLOY AND MEASUREMEN SYSEMS Idex 3393, ISSN 86-89 www.etrology.pg.gda.pl UNCERAINY INERVAL EVALUAION USIN HE CHI-SQUARE AND FISHER DISRIBUIONS IN HE MEASUREMEN

More information