Architecture of Artificial Neural Network in Identification of Internal Dynamics and Prediction of Dynamic System Rainfall Data Time Series

Size: px
Start display at page:

Download "Architecture of Artificial Neural Network in Identification of Internal Dynamics and Prediction of Dynamic System Rainfall Data Time Series"

Transcription

1 Archtecture of Artfcal Neural Networ Idetfcato of Iteral Dyamcs ad Predcto of Dyamc System Rafall Data Tme Seres Beyutty Varghese, Gyaesh Shrvastava 2, Saeev Karmaar 3, Mao Kumar Kowar 4 & Pula Guhathaurta 5,2,3&4 Bhla Isttute of Techology, Durg, Bhla House, 4900, Durg, Chhattsgarh, Ida 5 Ida Meteorologcal Departmet, Pue, Sva Nagar, Pue, Mharastra, Ida E-mal : armaar_saeev@gmal.com 3, mowar@gmal.com 4, pguhathaurta@redffmal.com 5 Abstract - The obectve of ths study s to expad ad evaluate the bac-propagato artfcal eural etwor (BPANN) ad to apply the detfcato of teral dyamcs of very hgh dyamc system such log-rage total rafall data tme seres. Ths obectve s cosdered va comprehesve revew of lterature (978-20). It s foud that, detal of dscusso cocerg the archtecture of ANN for the same s rarely vsble the lterature; however varous applcatos of ANN are avalable. The detal archtecture of BPANN wth ts parameters,.e., learg rate, umber of hdde layers, umber of euros hdde layers, umber of put vectors put layer, tal ad optmzed weghts etc., desged learg algorthm, observatos of local ad global mma, ad results have bee dscussed. It s observed that obtag global mma s almost complcated ad always a temporal ervousess. However, achevemet of global mma for the perod of the trag has bee dscussed. It s foud that, the applcato of the BPANN o detfcato for teral dyamcs ad predcto for the log-rage total aual rafall has produced good results. The results are explaed through the strog assocato betwee rafall predctors.e., clmate parameter (depedet parameter) ad total aual rafall (depedet parameter) are preseted ths paper as well. Keywords - Meteorology, Rafall, Spatal, Iterpolato, Neural Networ, Bac-Propagato. I. INTRODUCTION I much scece ad egeerg practce today, there s a creasg demad for techques whch are capable of terpolatg rregularly scattered data dstrbuted space. These techques have may applcatos cludg rafall estmato. Mathematcally, the geeral model for spatal terpolato of values µ a surface R ca be expressed as: φ = f (x, x 2,,, v, v 2,.., v ) Where, (x, x 2,,) s a putted depedet parameters ad v, v 2,..., v are addtoal varables such as weghts to be optmzed. I ths secto, cotrbutos from the year 978 to 20 have bee revewed. It s foud that, there are several terpolato methods for solvg the above problem have bee used. Techques such as geostatstcal co-rgg (Jourel ad Hubregts, 978) ad ANN (Hor et al., 987) are commo [, 2]. Goovaerts, 997, Demyaov, 998, S. va der Hede has suggested four methods for terpolato cludg ANN ther wor [4]. Huag et al. (998), demostrated the use of dyamc fuzzy-reasog-based fucto estmator (DFFE) to terpolate rafall data a case study Swtzerlad [5]. The fuctoal parameters are also optmzed by geetc algorthms (GA). Rcardo ad Palutof, 999, have successfully appled ANN techque for smulato of daly temperature for clmate chage scearos over Portugal [6]. Guhathaurta, 998, has appled hybrd ANN predcto of Ida mosoo rafall ad has foud very sgfcat results almost more tha 85% correctess [7]. Guhathaurta, 999, appled ths ANN method effectvely predcto of surface Ozoe whch s very dyamc ad upredctable ature for very smaller geographcal earth rego. He has also cotrbuted extremely sgfcat fdg the year of 2000 ad 2006 wth the smlar ANN methods especally for clmate varable predcto [7-3]. Raeeva et al. (2000) have gve a power regresso based log-rag mosoo rafall forecastg system for pesular Ida rego [4]. However, Guhathaurta (2006) ad Karmaar et al. (2008) have foud that, the ANN method s better evaluated over the statstcal techque for the same [5-2]. Sell, 2000 has foud a ew method for the spatal terpolato of daly maxmum surface ar temperatures. Ths ew method uses ANN to geerate temperature estmates at eleve locatos gve formato from a lattce of surroudg locatos. The out-of-sample performace Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202

2 of the ANNs s evaluated relatve to a varety of bechmar methods (spatal average, earest eghbor, ad verse dstace methods). He has foud that, the ANN approach s superor both terms of predctve accuracy ad model ecompassg [22]. Atoć et al. (200) have descrbed Spato-temporal terpolato of clmatc varables over large rego of complex terra usg eural etwors [23]. Preseted terpolato models provde relable, both spatal ad temporal estmatos of clmatc varables, especally useful for dedroecologcal aalyss. Rgol et al. (200) have descrbed spatal terpolato of daly mmum ar temperature usg a feed-forward bac-propagato eural etwor. Smple etwor cofguratos were traed to predct mmum temperature usg as puts: () date ad terra varables; (2) temperature observatos at a umber of eghbourg locatos; (3) date, terra varables ad eghbourg temperature observatos. Ths s the frst tme that tred ad spatal assocato are explctly cosdered together whe terpolatg usg a ANN [24]. Koe et al. (200) suggested a terpolato method based o a multlayer eural etwor (MNN), has bee examed ad tested for the data of rregular sample locatos, He foud that, the ma advatage of MNN s that t ca deal wth geographcal data wth olear behavor [25]. Brya ad Adams (2002) have successfully appled terpolato of Mea Precptato ad Temperature Surfaces for Cha [26, 27]. L (2002) have suggested ANN models could be used to accurately estmate these weather varables. I ths study, ANNbased methods were developed to estmate daly maxmum ad mmum ar temperature ad total solar radato for locatos Georga. Observed weather data from 996 to 998 were used for model developmet, ad data from 999 to 2000 were used for fal ANN model evaluato [28]. Iser et al. (2002) have foud that, the ANN Medum Term Forecastg of Rafall over Ida rego s suffcetly sutable [29]. Slva 2003 has successfully appled ANN techque for specal terpolato of temperature varable carred out the Austra Cetral Isttute of Meteorology ad Geodyamcs ZAMG, o the scope of the COST Acto 79. Ths wor focuses o the capabltes of Neural Networs used the spatal terpolato of some clmate varables showg the advatages ad dsadvatages [30]. The applcato of a ANN o the Austra mea ar temperature dstrbuto for August has produced good results, explaed by the strog alttude depedecy of ths parameter. Tmo ad Saveleva, 2005, have descrbed aother applcato for spatal predcto of radoactvty usg GRNN [3]. Guhathaurta 2006, Karmaar et al. (2008, 2009) have foud that, the Rumelhart,986 learg algorthm based Neural Networ model ca be also approprate for log-rage mosoo rafall predcto over very smaller geographcal rego. Attorre et al. (2007) have compared three methods that have bee proved to be useful at regoal scale: - a local terpolato method based o de-treded verse dstace weghtg (D-IDW), 2 - uversal rgg (.e. smple rgg wth tred fucto defed o the bass of a set of covarates) whch s optmal (.e. BLUP, best lear ubased predctor) f spatal assocato s preset, 3 - multlayer eural etwors traed wth bac-propagato (represetg a complex olear fttg) ad foud ANN terpolator has prove to be more effcet [32]. Chattopadhyay, ad Chattopadhyay, 2008, have foud that, the ANN for Ida Rafall predcto usg ANN s sutable ad especally he suggested archtecture of hdde layer of the etwor. Ultmately t has bee establshed that the elevehdde-odes three-layered eural etwor has more effcacy tha asymptotc regresso the preset forecastg tas [33]. Hug, 2009, preseted ANN techque to mprove rafall forecast performace over Bago Thalad [34]. Medes ad Marego, 200 have developed ad tested a ovel type of statstcal dowscalg techque based o the ANN, appled of the clmate chage. The ANN used here are based o a feed forward cofgurato of the multlayer percepto that has bee used by a growg umber of authors [35]. Svapragasam et al. (200) have foud that, the terpolato of Hydrologcal varable such as rafall, groud water level, etc for Taml Nadu state Ida usg ANN s useful. However, 8 statos data samples have bee used to develop ANN. It s observed that, by more statos, ths methodology ca produce better result [36]. Ghazafar et al. (20), have suggested a ew model PERSIANN (Precptato estmato from remotely sesed formato usg artfcal eural etwor) model wors based o the ANN system whch uses multvarate olear put-output relatoshp fuctos to ft local cloud top temperature to pxel ra rates. I ths study, PERSIANN model ad two terpolato methods (Krgg & IDW) are employed to estmate precptato cover for North-Khorasa betwee the years 2006 utl He has foud better correlato betwee PERSIANN output ad stato data tha the other two terpolato methods. Whle correlato coeffcet for Kedal s test s betwee model ad Boord Stato data, ths coeffcet s ad for Krgg method [37]. By revew of very sgfcat cotrbutos of all the authors from 978 to 20, t s cocluded that, ANN method s suffcetly sutable for detfyg teral dyamcs of rafall varables, as well as sgfcat to develop a assocato betwee depedet ad depedet varable predcto as well as terpolato. However, t s also foud that, the selecto of approprate archtecture of ANN s Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 2

3 exceptoally trcy addto to ts trag. Selecto of ts parameters,.e., umber of put vectors, hdde layers, ad hdde euros s aga very dyamc depedg o data seres. Trag of ANN s also aga eormous challegg tas. It s foud that, the selecto of parameters ad trag process may cause of temporal ervousess as well. To tra the etwor, how may epochs are requred, how to obta global mma durg error mmzato process (.e., trag) s ot ofte clearly avalable the lterature although very wde rage of applcatos of ANN has bee foud. No author has foud who have clearly descrbed these aspects ther cotrbutos. The developmet of BPANN wth these essetal aspects, applcato detfcato of teral dyamcs of hgh dyamc system such as log rage total aual rafall by developg a relatoshp betwee rafall ad ts predctors ad ts performaces are clearly descrbed the subsequet sectos. II. DATA DESCRIPTION AND PREPROCESSING A data tme seres ( ) of total aual rafall (TAR) of locato Baster of Chhattsgarh (Geologcal stuato Lattude 7046' N to 2405'N Logtude 8005' E to 84020' E s cosdered ths study. The eght clmate parameters data tme seres ( ) those are physcally coected wth the TAR of ths locato are detfed ad used to put the ANN as depedetly. These parameters are total evaporato, maxmum temperature, mmum temperature, sushe, vapor pressure, wd, humdty ad total rafall of prevous year as show Table. These parameters are show good Correlato Coeffcet (CC) wth TAR. The all data tme seres depedet as well as depedet was the splt to two sets. About thrtee years ( ) of data are used for trag. Other four years ( ) are used for observato (testg). Accordg to Demyaov, 998, Brya ad Adams, 200, 2002, mportat aspect s to ormalze the data because etwor trag algorthms are lmted to the tervals 0 to ad de-ormalze t after the testg phase [4, 26]. To ormalze the data tme seres the equato R = (x + m (x ))/ (x + max (x )) s used ad other had the equato the equato x = (m (x ) - R max (x )) / (R -) s used to deormalze. Table. Iput Parameters No. Parameters (Prev. Year) CC Evaporato x Maxmum Temperature x M Temperature x Sushe x Vapor Pressure x Wd x Humdty x Rafall x III. ARCHITECTURE OF ANN Multlayer Bac Propagato Artfcal Neural Networ (BPANN) s show Fgure. The modfed archtecture of ths etwor as show Fgure 2 s used ths study. Where, t has put layer (at the bottom), oe hdde layer (at the mddle) ad output layer (o the top). It has put vectors at the put layer ( x... x... x ), p euros hdde layer z... z... z ) ad oe euro y ) ( p ( output ut to observe desred meteorologcal data as target varable. Bas o hdde ut.e. V o ad bas o output ut.e. w o wth p + p traable weghts are used the etwor. Output target value for the etwor s actual data to be predcted. The euros output ca be obtaed as f (x ). Where f s a trasfer fucto (axo), typcally the sgmod (logstc or taget hyperbolc) fucto. Sgmod fucto = f ( x), where δ δ +η + e x determes the slope ad η s the threshold. I the proposed model δ =, η =0 s cosdered such that + ± I, the output of the euro wll be close terval [0, ] as show Fg. 3. Fg. : Archtecture of geeral multlayer BPANN Fg. 2 : Archtecture of BPANN Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 3

4 The etwor performace s determed through comparso betwee mea absolute devato (MAD) (% of mea) ad stadard devato (SD) (% of mea) as show Equato ad 2 respectvely. Where x s radom varable wth mea μ, ad p s predcted value. Fg. 3. Output of Sgmod Axo MAD = SD = = ( x p ) ( x μ ) = IV. DESIGN OF TRAINING ALGORITHM Rumelhart et al. (986) frst troduced BPANN based o gradet descet method (Kumar, 2007) [38]. Beg a gradet descet method, t mmzes the mea square error (MSE) of the output computed by the etwor durg the feed-forward ad bac-propagato process. I ths study, BPANN s traed by supervsed learg method. Supervsed trag s the process of provdg the etwor wth a seres of sample puts ad comparg the output wth the expected respose. The followg algorthm a has bee desged specfcally for ths applcato to tra BPANN. The am of ths trag was to tra the BPANN order to acheve a relatoshp betwee the putted depedet parameters x, x 2, x 8 (see Table ) ad the depedet parameter.e., TAR. Algorthm a: Desged ad mplemeted trag Algorthm of BPANN through Java for ths applcato where- Iput trag vector x ( x x ) : x Output target vector t ( t ) :... t m δ : Error at output ut y. α : Learg rate. V o : Bas o hdde ut. Z : Hdde ut. 2 w o : Bas o output ut. y : Output ut. Set tal weghts w such that ( 0 < ) w. < Cosder trag perod: m; Set umber of put vector ρ such that ρ < m. do{ { ( = ; ( m ρ + + ) for ); for( = ; ( ρ + ); + + ) { put vector x ; } /* Feed-Forward ad calculate target/output varable y...*/ Each put ut receves the put sgal x ad trasmts ths sgals to all uts the layer above.e., hdde uts. Each hdde ut ( z, =... p) sums ts weghted put sgals z = vo + = x v () applyg actvato fucto Z = f z ) ( ad seds ths sgal to all uts the layer above.e., output uts. Each output ut ( y, =... m) sum ts weghted put sgals y p = wo + = z w (2) Applyg actvato fucto y = f y ) ( Calculate error factor δ = actual(z) - target (y); Italze predcted value P ρ + = target (y); /* Bac-Propagato ad calculate ew weghts w */ Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 4

5 Each output ut ( y, =... m) receves a target patter correspodg to a put patter error formato term s calculated as δ = t y ) f ( y ) ( ( z = sums ts delta Each hdde ut,... ) puts from uts the layer above δ m = = δ w The error formato term s calculated as δ = δ f z ( /* Updatg of Weghts ad Bases */ Each output ut ( y, =... m) updates ts bas ad weghts ( = 0... p) The weghts correcto term s gve by ) Δ W = αδ z Ad the bas correcto term s gve by Δ W = αδ o Therefore, W W o ( ew) = W ( ew) = W o ( old) + ΔW ( old) + ΔW Each hdde ut (,... p) bas ad weghts ( = 0... ) the weghts correcto term Δ V z = updates ts = αδ x The bas correcto term o therefore, } V V o ( ew) = V Δ V o = αδ = V ( old) + ΔV, ( old) + ΔV Calculate MSE betwee seres m MSE = X P m = set = ; = ; } whle ( MSE < ); o X ad V. SELECTION OF BPANN PARAMETERS A. Ital Weghts o, P ; It wll fluece whether the etwor reaches a global (or oly a local) mma of the MSE ad f so how rapdly t coverges. It s foud that, f tal weght s too large the tal put sgals to each hdde or output ut wll fall the saturato rego where the dervatve of sgmod has very small value (f (etwor) = 0). If tal weghts are too small, the etwor output to a hdde or output ut wll approach zero, whch the causes extremely slow learg. To get the best result the tal weghts (ad bases) are set to radom umber betwee 0 ad. The tal weghts (bas) ca be doe radomly ad moreover there s a specfc approach. The faster learg of a BPANN ca be obtaed by usg Nguye-Wdrow (NW) talzato (Equato 3). Kumar, 2007 have foud ths method s desged to mprove the learg ablty of the hdde uts [39]. p β = 0.7( ) where, = umber of put uts, p = umber of hdde uts, β = scale factor. B. Learg Rate (α) It s foud that, a hgh learg rate α leads to rapd learg but the weghts may oscllate, whle a lower learg rate leads to slower learg. Kumar, 2007, suggested that tally set α betwee lower value 0 ad ad crease order to mprove performace. It s foud that, α = 0.3 s sutable for almost all of the cases ad ths study [39]. C. Number of Hdde Layers Phllp, 2003 foud that, early all problems, oe hdde layer s suffcet. Usg two hdde layers rarely mproves the model, ad t may troduce a greater rs of covergg to a local mma. Ad also there s o theoretcal reaso for usg more tha two hdde layers [39]. D. Number of put Vector () It s observed that, the MAD (% of mea) s versely proportoal to for all type of put data. MAD I ths study, = 8 s used to put eght clmate parameter.e. x, x 2, x 8 (see Table ). However, more parameter may used as put to detfy TMR as depedet parameter (armaar et al., 2008, 2009) [5-2]. Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 5

6 E. Neuros Hdde Layer (p) It has bee foud that, f umber of euros ( p) creases the hdde layer, the MAD (% of mea) betwee actual ad predcted value creases (Karmaar et al., 2008, 2009). I other words, the relato betwee euros (p) ad MAD (% of mea) s show as MAD p MAD = cp Where, c s error costat. It s verfed that, f p = 2 the t would provde two fudametal beefts () MAD betwee actual ad predcted values durg trag wll be least ad (2) Tme complexty of etwor trag process wll be ot as much of. Note that, more hdde euros creases more uow varables (.e., traable weghts w ) s requred addtoal process tme to optmzed, t ca be temporal tmdty. Thus, two euros p = 2 have bee used the PBANN. Fally, BPANN have bee developed to predct TAR as show followg Fgure 4. Where eght put vectors.e. x, x 2, x 8, put layer are used to put eght depedet varable. Two euros hdde layer z... ) are used. ( z2 VI. TRAINING OF BPANN: LOCAL AND GLOBAL MINIMA The mmzg mea square error (MSE) of the etwor called parallel process or epoch by usg above algorthm durg the trag perod s show followg Table 2 ad Fgure 5. The trag started wth tal set of weghts betwee 0 ad at pot P where MSE = E-04 usg algorthm. Mmum MSE = E- 04 s ecoutered at pot M L after 0,000 epochs. M L s called local mma. After ths pot the MSE s showg a costat tred. Geerally, scetsts are ofte stoppg trag process ths pot for ther specfc applcatos. Ths s the oly grouds of poor result. The ofte th that more trag wll ot mmze the MSE or may be dffcult or ot possble. Table 2 ad Fgure 5 show some observatos here. However It s cleared that day 3, after 50,00000 epochs, the MSE becomes e-04 mared by the pot M G (Fg. 5). Ths pot s called global mma called maxmum traed etwor pot. I the lterature the varous authors are clearly declared that, obtag ths pot s almost dffcult or temporal tmdty. But ths observato t s clear that ths cocept s ot true. No oe should tal about such type of mscocepto. After ths pot MSE s exhbtg a creasg tred ad s cosdered as over trag of the etwor. Ths expermet s doe wth oe GB RAM wth IBM Petum mache. tme requred to process s three days. The expermetal result s show Table 2 ad Fgure 5. The processes are developed usg Java mathematcal pacage. (5) Fg. 4 : Archtecture of Desged BPANN. Table 2. Observato of Reducg MSE durg Trag Perod Observato Tme MSE Day 4: E-04 5: E-04 Day 2 0: E-04 : E-04 2: E-04 : E-04 2: E-04 3: E-04 4: E-04 Day 3 0: E-04 2: E-04 2: E-04 VII. RESULTS AND DISCUSSIONS I order to chec the performaces of BPANN durg trag perod, t s traed wth the 3 years ( ) trag dataset. The performaces s show Table 3,5 ad Fgure 6. The BPANN presets low MAD (.e., 0.006) ad a hgh CC (.e., 0.86) betwee actual ad predcted values as show Fgure 6. Ths shows strog assocato betwee depedet total rafall, ad depedet parameters x, x 2, x 8.I order to chec the BPANN performace durg the Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 6

7 testg/depedet perod wth ew data, t was tested wth the 04 years ( ) of the test data. The performace s show Table 4,5 ad Fgure 7. The BPANN aga preseted low MAD ad a hgh CC betwee actual ad predcted values ths perod. The result shows strog assocato betwee depedet parameter rafall, ad depedet varables x, x 2, x 8 durg the testg perod as well. Other tha that, MAD at trag as well as testg perod exceptoally less tha the SD as show Table 5. Thus, t s cocluded that the proposed archtecture of BPANN ad ts optmzed weghts for the varable total rafall s very approprate teral dyamcs of total rafall varable. However, some lmtatos of BPANN durg the trag perod have bee depcted s preseted the followg secto. Fg. 5 : Mmzg MSE: Local Mma (M L ) ad Global Mma (M G ) Fg. 7 : Performace of the BPANN Idepedet Perod ( ) Table 3. Performace of the BPANN Trag Perod ( ) Year Actual rafall ( mm.) Normalzed Actual rafall ( mm.) Deormalzed Predcted Rafall ( mm.) Normalzed Predcted Rafall ( mm.) Deormalzed Fg. 6 : Performace of the BPANN Trag Perod ( ) Year Table 4. Performace of the Model Idepedet Perod ( ) Actual rafall ( mm.) Normalzed Actual rafall ( mm.) Deormalzed Predcted Rafall ( mm.) Normalze d Predcted Rafall ( mm.) Deormalzed Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 7

8 Table 5. Performace Tatg ad Idepedet Perod Trag Perod Idepedet /Testg Perod SD MAD CC SD MAD CC VIII. CONCLUSIONS Ths study focuses o the capabltes of ANN the predcto of hgh teral dyamcs log-rage rafall varables showg the advatages ad dsadvatages compled. The advatage of ths study s that t has bee cleared that ANN s suffcetly sutable for detfcato of teral dyamcs of hghly dyamc o lear system ad predctos. Dsadvatage s that, t requred may trag effort, possbly over fttg, ad a temporal ervousess. It s foud that, the bac-propagato usg gradet descet (algorthm) ofte coverges very slowly or ot at all. O large-scale problems ts success depeds o userspecfed learg rate ad mometum parameters. There s o automatc way to select these parameters, ad f correct values are specfed the covergece may be exceedgly slow, or t may ot coverge at all. Whle bac-propagato wth gradet descet stll s used the model developmet, t s o loger cosdered to be the best or fastest algorthm. Istead of gradet descet, cougate gradet algorthm ca be used as a future wor to adust weght values usg the gradet durg the bac-propagato of errors through the ANN. Compared to gradet descet; the cougate gradet algorthm taes a more drect path to the optmal set of weght values. Usually, cougate gradet s sgfcatly faster ad more robust tha gradet descet. Cougate gradet also does ot requre the user to specfy learg rate ad mometum parameters. I addto, performace of the RBFANN, GRANN ca also be compared wth the appled BPANN as a future wor. REFERENCES []. Jourel, A. G., Hubregts, C. J.,978: Mg geostatstcs. Academc Press, New Yor. [2]. Hor, K., Stchcombe, M., Whte, H., 989: Multlayer feedforward etwors are uversal approxmators. Neural Networs, 2, [3]. Goovaerts, P., 997: Geostatstcs for atural resources evaluato, Oxford Uversty Press, New Yor, Oxford. [4]. Demyaov, V., 998: Neural Networ Resdual Krgg Applcato for Clmatc Data, J. Geographc Iformato ad Decso Aalyss, 2 (2), [5]. Huag, Y., Wog, P. M. Gedeo, T. D., 998: Predcto of reservor permeablty usg geetc algorthms, AI Applcatos, 2(-3), pp [6]. Rcardo, M. T., Palutof, J.P., 999: Smulato of Daly Temperatures for Clmate Chage Scearos over Portugal: A Neural Networ Model Approach, Clmate research (Clm., Res.), 3, [7]. Guhathaurta, P., 998: A Hybrd Neural Networ Model for Log Rage Predcto of All Ida Summer Mosoo Rafall, Proc. WMO teratoal worshop o dyamcal exteded rage forecastg, Toulouse, Frace, November 7-2, 997, PWPR No., WMO/TD. 88, [8]. Guhathaurta, P., 999: Log Rage Forecastg Ida Summer Mosoo Rafall By Prcple Compoet Neural Networ Model, J. Meteor. & Atomos. Phys., 7, [9]. Guhathaurta, P., 999: A Short Term Predcto Model for Surface Ozoe At Pue: Neural Networ Approach, Vayu madal, 29(-4), [0]. Guhathaurta, P., 999 : A Neural Networ Model for Short Term Predcto of Surface Ozoe at Pue, Mausam, 50(), []. Guhathaurta, P., Raeeva, M., Thaplyal, V., 999: Log Rage Forecastg Ida Summer Mosoo Rafall by Hybrd Prcpal Compoet Neural Networ Model, Meteorology ad Atmospherc Physcs, Sprger-Verlag, Austra. [2]. Guhathaurta, P., 2000: New Models for Log Rage Forecasts of Summer Mosoo Rafall over North West ad Pesular Ida, Meteorology ad Atmospherc Physcs,73 (3), [3]. Guhathaurta, P., 2006: Log-Rage Mosoo Rafall Predcto of 2005 for the Dstrcts ad Sub-Dvso Kerala Wth Artfcal Neural Networ, Curret Scece, 90(6), [4]. Raeeva, M., Guhathaurta, P., Thaplyal, V., 2000, New Models for Log Rage Forecastg of Mosoo Rafall over Northwest ad Pesular Ida. Meteorology ad Atmospherc Physcs, 73, [5]. Karmaar, S., Kowar, M. K., Guhathaurta, P., 2009: Artfcal Neural Networ Seleto Determstc Forecast to Recogze Patter of TMRF Ambapur Dstrct, CSVTU Research Joural, 2(2), [6]. Karmaar, S., Kowar, M. K., Guhathaurta, P., 2009: Evolvg ad Evaluato of 3LP FFBP Determstc ANN Model for Dstrct Level Log Rage Mosoo Rafall Predcto, J. Evrometal Scece & Egeerg, 5(2), [7]. Karmaar, S., Kowar, M. K., Guhathaurta, P., 2008: Developmet of Artfcal Neural Networ Models for Log- Rage Meteorologcal Parameters Patter Recogto over the Smaller Scale Geographcal Rego-Dstrct, IEEE Xplore, IEEE Computer Socety. Washgto, DC, USA. [8]. Karmaar, S., Kowar, M. K., Guhathaurta, P., 2008: Developmet of a 8-Parameter Probablstc Artfcal Neural Networ Model for Log-Rage Mosoo Rafall Patter Recogto over the Smaller Scale Geographcal Rego Dstrct, IEEE Xplore, IEEE Computer Socety, Washgto, DC, USA. [9]. Karmaar, S., Kowar, M. K., Guhathaurta, P., Developmet of a 6 Parameter Artfcal Neural Networ Model for Log- Rage July Rafall Patter Recogto over the Smaller Scale Geographcal Rego Dstrct, CSVTU Research Joural, pp [20]. Karmaar, S., Kowar, M. K., Guhathaurta, P., 2009: Log- Rage Mosoo Rafall Patter Recogto & Predcto for the Subdvso EPMB Chhattsgarh Usg Determstc Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 8

9 & Probablstc Neural Networ, IEEE Xplore, IEEE Computer Socety, Washgto, DC, USA. [2]. Karmaar, S., Kowar M. K., Guhathaurta P., 2009, Spatal Iterpolato of Rafall Varables usg Artfcal Neural Networ, ACM DL, [22]. Sell, S. E., 2000, Spatal Iterpolato of Surface Ar Temperatures Usg Artfcal Neural Networs: Evaluatg Ther Use for Dowscalg GCMs, Joural of Clmate, 3, [23]. Atoć, O., Krža, J., Mar, A., Buovec, D., 200: Spatotemporal terpolato of clmatc varables over large rego of complex terra usg eural etwors, Ecologcal Modellg, 38, [24]. Rgol, J.P., Jarvs, C.H., Stuart, N., 200: Artfcal eural etwors as a tool for spatal terpolato, Iteratoal Joural of Geographcal Iformato Scece, 5, [25]. Koe, K., Matsuda, S., Gu, B., 200: Evaluato of Iterpolato Accuracy of Neural Krgg wth Applcato to Temperature-Dstrbuto Aalyss. Mathematcal Geology, 33(4), [26]. Brya, B.A., Adams, J.M., 200: Quattatve ad Qualtatve Assessmet of the Accuracy of Neuroterpolated Mea Precptato ad Temperature Surfaces for Cha, Cartography, 30 (2), Perth, Australa. [27]. Brya, B.A., Adams, J. M., 2002: Three-Dmesoal Neuroterpolato of Mea Precptato ad Temperature Surfaces for Cha, Geographcal Aalyss, 34 (2), 93-. [28]. L, B., 2002: Spatal Iterpolato of Weather Varable usg Artfcal eural Networ, MS Thess, Uversty of Georga. [29]. Iser, Y. G. C. Dady., Maer, R., Kawamura, A., Jo, K., 2002: Medum Term Forecastg of Rafall Usg Artfcal Neural Networs, Part bacgroud ad methodology, Joural of Hydrology, 30 (-4), [30]. Slva, A. P., :2003, Neural Networs Applcato to Spatal Iterpolato of Clmate Varables, Carred Out By, STSM o the Framewor of COST 79 ZAMG. [3]. Tmo, V., Saveleva, E., 2005: spatal predcto of radoactvty usg GRNN, Appled GIS, Moash Uversty Press, (2), -9. [32]. Attorre, F., Alfo, M., Sacts, M., Fracesco, F., Bruo, F., 2007: Comparso of terpolato methods for mappg clmatc ad boclmatc varables at regoal scale, It. J. Clmatol., Royal Meteorologcal Socety, Publshed ole Wley IterScece ( wley.com) DOI: 0.002/oc.495. [33]. Chattopadhyay, S., Chattopadhyay, G., 2008: Idetfcato of the best hdde layer sze for threelayered eural et predctg mosoo rafall Ida, J. Hydroformatcs, 0 (2), [34]. Hug, N. Q., Babel, M. S., Weesaul, S., Trpath N. K., 2009: A artfcal eural etwor model for rafall forecastg Bago, Thalad, Hydrology ad Earth System Sceces, 3, [35]. Medes, D., Marego, J., 200: South Amerca dowscalg: usg spatal artfcal eural etwor, Geophyscal Research Abstracts, 2, EGU [36]. Svapragasam, C., Aru, V.M., Grdhar, D., 200, A smple approach for mprovg spatal terpolato of Rafall usg ANN, Meteoro Atmos Phys, Sprger, 09, -7. [37]. Ghazafar, S., Alzadeh, A., Fard, A., Baaya, M., 20: Comparso the PERSIANN model wth terpolato methods to estmate daly precptato (A case study: North- Khorasa, Ira), Geophyscal Research Abstracts, 3, EGU [38]. Rumelhart, D., Hto, G. E., Wllams, R. J., 986: Learg Iteral Represetato By Error Propagato, R J Parallel Dstrbuted Processg: Explorato the Mcrostructure of Cogto, MIT Press Cambrdge,, [39]. Kumar, S., : Neural Networ Computer Egeerg Sere, The McGraw-Hll, New Delh, 2007, Iteratoal Joural of Computer Scece ad Iformatcs ISSN (PRINT): , Vol-, Iss-4, 202 9

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions

Estimation of Stress- Strength Reliability model using finite mixture of exponential distributions Iteratoal Joural of Computatoal Egeerg Research Vol, 0 Issue, Estmato of Stress- Stregth Relablty model usg fte mxture of expoetal dstrbutos K.Sadhya, T.S.Umamaheswar Departmet of Mathematcs, Lal Bhadur

More information

A Method for Damping Estimation Based On Least Square Fit

A Method for Damping Estimation Based On Least Square Fit Amerca Joural of Egeerg Research (AJER) 5 Amerca Joural of Egeerg Research (AJER) e-issn: 3-847 p-issn : 3-936 Volume-4, Issue-7, pp-5-9 www.ajer.org Research Paper Ope Access A Method for Dampg Estmato

More information

Functions of Random Variables

Functions of Random Variables Fuctos of Radom Varables Chapter Fve Fuctos of Radom Varables 5. Itroducto A geeral egeerg aalyss model s show Fg. 5.. The model output (respose) cotas the performaces of a system or product, such as weght,

More information

A New Family of Transformations for Lifetime Data

A New Family of Transformations for Lifetime Data Proceedgs of the World Cogress o Egeerg 4 Vol I, WCE 4, July - 4, 4, Lodo, U.K. A New Famly of Trasformatos for Lfetme Data Lakhaa Watthaacheewakul Abstract A famly of trasformatos s the oe of several

More information

Analysis of Variance with Weibull Data

Analysis of Variance with Weibull Data Aalyss of Varace wth Webull Data Lahaa Watthaacheewaul Abstract I statstcal data aalyss by aalyss of varace, the usual basc assumptos are that the model s addtve ad the errors are radomly, depedetly, ad

More information

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean

Comparison of Dual to Ratio-Cum-Product Estimators of Population Mean Research Joural of Mathematcal ad Statstcal Sceces ISS 30 6047 Vol. 1(), 5-1, ovember (013) Res. J. Mathematcal ad Statstcal Sc. Comparso of Dual to Rato-Cum-Product Estmators of Populato Mea Abstract

More information

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best

best estimate (mean) for X uncertainty or error in the measurement (systematic, random or statistical) best Error Aalyss Preamble Wheever a measuremet s made, the result followg from that measuremet s always subject to ucertaty The ucertaty ca be reduced by makg several measuremets of the same quatty or by mprovg

More information

Chapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn:

Chapter Business Statistics: A First Course Fifth Edition. Learning Objectives. Correlation vs. Regression. In this chapter, you learn: Chapter 3 3- Busess Statstcs: A Frst Course Ffth Edto Chapter 2 Correlato ad Smple Lear Regresso Busess Statstcs: A Frst Course, 5e 29 Pretce-Hall, Ic. Chap 2- Learg Objectves I ths chapter, you lear:

More information

Simple Linear Regression

Simple Linear Regression Statstcal Methods I (EST 75) Page 139 Smple Lear Regresso Smple regresso applcatos are used to ft a model descrbg a lear relatoshp betwee two varables. The aspects of least squares regresso ad correlato

More information

CS 2750 Machine Learning. Lecture 8. Linear regression. CS 2750 Machine Learning. Linear regression. is a linear combination of input components x

CS 2750 Machine Learning. Lecture 8. Linear regression. CS 2750 Machine Learning. Linear regression. is a linear combination of input components x CS 75 Mache Learg Lecture 8 Lear regresso Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 75 Mache Learg Lear regresso Fucto f : X Y s a lear combato of put compoets f + + + K d d K k - parameters

More information

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades

Multiple Regression. More than 2 variables! Grade on Final. Multiple Regression 11/21/2012. Exam 2 Grades. Exam 2 Re-grades STAT 101 Dr. Kar Lock Morga 11/20/12 Exam 2 Grades Multple Regresso SECTIONS 9.2, 10.1, 10.2 Multple explaatory varables (10.1) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (10.2) Trasformatos

More information

Summary of the lecture in Biostatistics

Summary of the lecture in Biostatistics Summary of the lecture Bostatstcs Probablty Desty Fucto For a cotuos radom varable, a probablty desty fucto s a fucto such that: 0 dx a b) b a dx A probablty desty fucto provdes a smple descrpto of the

More information

Objectives of Multiple Regression

Objectives of Multiple Regression Obectves of Multple Regresso Establsh the lear equato that best predcts values of a depedet varable Y usg more tha oe eplaator varable from a large set of potetal predctors {,,... k }. Fd that subset of

More information

Analysis of Lagrange Interpolation Formula

Analysis of Lagrange Interpolation Formula P IJISET - Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue, December 4. www.jset.com ISS 348 7968 Aalyss of Lagrage Iterpolato Formula Vjay Dahya PDepartmet of MathematcsMaharaja Surajmal

More information

Bayes (Naïve or not) Classifiers: Generative Approach

Bayes (Naïve or not) Classifiers: Generative Approach Logstc regresso Bayes (Naïve or ot) Classfers: Geeratve Approach What do we mea by Geeratve approach: Lear p(y), p(x y) ad the apply bayes rule to compute p(y x) for makg predctos Ths s essetally makg

More information

Journal of Water and Soil Vol. 26, No. 1, Mar-Apr 2012, p Kriging. (

Journal of Water and Soil Vol. 26, No. 1, Mar-Apr 2012, p Kriging. ( Joural of Water ad Sol Vol. 26, No. 1, Mar-Apr 212, p. 53-64 ( ) 53-64. 1391 1 26 *2 1-89/7/26: 9/8/15:.. (1386-87 1361-62) 26 32.. (GPI) (IDW). (Co-Krgg) (Krgg) (RBF) (LPI) 64/46 6/49 77/2 66/86 IDW RBF.

More information

Supervised learning: Linear regression Logistic regression

Supervised learning: Linear regression Logistic regression CS 57 Itroducto to AI Lecture 4 Supervsed learg: Lear regresso Logstc regresso Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 57 Itro to AI Data: D { D D.. D D Supervsed learg d a set of eamples s

More information

ABOUT ONE APPROACH TO APPROXIMATION OF CONTINUOUS FUNCTION BY THREE-LAYERED NEURAL NETWORK

ABOUT ONE APPROACH TO APPROXIMATION OF CONTINUOUS FUNCTION BY THREE-LAYERED NEURAL NETWORK ABOUT ONE APPROACH TO APPROXIMATION OF CONTINUOUS FUNCTION BY THREE-LAYERED NEURAL NETWORK Ram Rzayev Cyberetc Isttute of the Natoal Scece Academy of Azerbaa Republc ramrza@yahoo.com Aygu Alasgarova Khazar

More information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information

Bayes Estimator for Exponential Distribution with Extension of Jeffery Prior Information Malaysa Joural of Mathematcal Sceces (): 97- (9) Bayes Estmator for Expoetal Dstrbuto wth Exteso of Jeffery Pror Iformato Hadeel Salm Al-Kutub ad Noor Akma Ibrahm Isttute for Mathematcal Research, Uverst

More information

Regresso What s a Model? 1. Ofte Descrbe Relatoshp betwee Varables 2. Types - Determstc Models (o radomess) - Probablstc Models (wth radomess) EPI 809/Sprg 2008 9 Determstc Models 1. Hypothesze

More information

Multiple Linear Regression Analysis

Multiple Linear Regression Analysis LINEA EGESSION ANALYSIS MODULE III Lecture - 4 Multple Lear egresso Aalyss Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur Cofdece terval estmato The cofdece tervals multple

More information

Lecture 16: Backpropogation Algorithm Neural Networks with smooth activation functions

Lecture 16: Backpropogation Algorithm Neural Networks with smooth activation functions CO-511: Learg Theory prg 2017 Lecturer: Ro Lv Lecture 16: Bacpropogato Algorthm Dsclamer: These otes have ot bee subected to the usual scruty reserved for formal publcatos. They may be dstrbuted outsde

More information

Unsupervised Learning and Other Neural Networks

Unsupervised Learning and Other Neural Networks CSE 53 Soft Computg NOT PART OF THE FINAL Usupervsed Learg ad Other Neural Networs Itroducto Mture Destes ad Idetfablty ML Estmates Applcato to Normal Mtures Other Neural Networs Itroducto Prevously, all

More information

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines

Solving Constrained Flow-Shop Scheduling. Problems with Three Machines It J Cotemp Math Sceces, Vol 5, 2010, o 19, 921-929 Solvg Costraed Flow-Shop Schedulg Problems wth Three Maches P Pada ad P Rajedra Departmet of Mathematcs, School of Advaced Sceces, VIT Uversty, Vellore-632

More information

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution

Comparing Different Estimators of three Parameters for Transmuted Weibull Distribution Global Joural of Pure ad Appled Mathematcs. ISSN 0973-768 Volume 3, Number 9 (207), pp. 55-528 Research Ida Publcatos http://www.rpublcato.com Comparg Dfferet Estmators of three Parameters for Trasmuted

More information

A Robust Total Least Mean Square Algorithm For Nonlinear Adaptive Filter

A Robust Total Least Mean Square Algorithm For Nonlinear Adaptive Filter A Robust otal east Mea Square Algorthm For Nolear Adaptve Flter Ruxua We School of Electroc ad Iformato Egeerg X'a Jaotog Uversty X'a 70049, P.R. Cha rxwe@chare.com Chogzhao Ha, azhe u School of Electroc

More information

Chapter 14 Logistic Regression Models

Chapter 14 Logistic Regression Models Chapter 4 Logstc Regresso Models I the lear regresso model X β + ε, there are two types of varables explaatory varables X, X,, X k ad study varable y These varables ca be measured o a cotuous scale as

More information

ESS Line Fitting

ESS Line Fitting ESS 5 014 17. Le Fttg A very commo problem data aalyss s lookg for relatoshpetwee dfferet parameters ad fttg les or surfaces to data. The smplest example s fttg a straght le ad we wll dscuss that here

More information

Study on a Fire Detection System Based on Support Vector Machine

Study on a Fire Detection System Based on Support Vector Machine Sesors & Trasducers, Vol. 8, Issue, November 04, pp. 57-6 Sesors & Trasducers 04 by IFSA Publshg, S. L. http://www.sesorsportal.com Study o a Fre Detecto System Based o Support Vector Mache Ye Xaotg, Wu

More information

Lecture 8: Linear Regression

Lecture 8: Linear Regression Lecture 8: Lear egresso May 4, GENOME 56, Sprg Goals Develop basc cocepts of lear regresso from a probablstc framework Estmatg parameters ad hypothess testg wth lear models Lear regresso Su I Lee, CSE

More information

Bootstrap Method for Testing of Equality of Several Coefficients of Variation

Bootstrap Method for Testing of Equality of Several Coefficients of Variation Cloud Publcatos Iteratoal Joural of Advaced Mathematcs ad Statstcs Volume, pp. -6, Artcle ID Sc- Research Artcle Ope Access Bootstrap Method for Testg of Equalty of Several Coeffcets of Varato Dr. Navee

More information

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971))

Part 4b Asymptotic Results for MRR2 using PRESS. Recall that the PRESS statistic is a special type of cross validation procedure (see Allen (1971)) art 4b Asymptotc Results for MRR usg RESS Recall that the RESS statstc s a specal type of cross valdato procedure (see Alle (97)) partcular to the regresso problem ad volves fdg Y $,, the estmate at the

More information

Statistics MINITAB - Lab 5

Statistics MINITAB - Lab 5 Statstcs 10010 MINITAB - Lab 5 PART I: The Correlato Coeffcet Qute ofte statstcs we are preseted wth data that suggests that a lear relatoshp exsts betwee two varables. For example the plot below s of

More information

Introduction to local (nonparametric) density estimation. methods

Introduction to local (nonparametric) density estimation. methods Itroducto to local (oparametrc) desty estmato methods A slecture by Yu Lu for ECE 66 Sprg 014 1. Itroducto Ths slecture troduces two local desty estmato methods whch are Parze desty estmato ad k-earest

More information

Chapter 13 Student Lecture Notes 13-1

Chapter 13 Student Lecture Notes 13-1 Chapter 3 Studet Lecture Notes 3- Basc Busess Statstcs (9 th Edto) Chapter 3 Smple Lear Regresso 4 Pretce-Hall, Ic. Chap 3- Chapter Topcs Types of Regresso Models Determg the Smple Lear Regresso Equato

More information

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design

Application of Calibration Approach for Regression Coefficient Estimation under Two-stage Sampling Design Authors: Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud Applcato of Calbrato Approach for Regresso Coeffcet Estmato uder Two-stage Samplg Desg Pradp Basak, Kaustav Adtya, Hukum Chadra ad U.C. Sud

More information

Multiple Choice Test. Chapter Adequacy of Models for Regression

Multiple Choice Test. Chapter Adequacy of Models for Regression Multple Choce Test Chapter 06.0 Adequac of Models for Regresso. For a lear regresso model to be cosdered adequate, the percetage of scaled resduals that eed to be the rage [-,] s greater tha or equal to

More information

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions.

Ordinary Least Squares Regression. Simple Regression. Algebra and Assumptions. Ordary Least Squares egresso. Smple egresso. Algebra ad Assumptos. I ths part of the course we are gog to study a techque for aalysg the lear relatoshp betwee two varables Y ad X. We have pars of observatos

More information

Regression and the LMS Algorithm

Regression and the LMS Algorithm CSE 556: Itroducto to Neural Netorks Regresso ad the LMS Algorthm CSE 556: Regresso 1 Problem statemet CSE 556: Regresso Lear regresso th oe varable Gve a set of N pars of data {, d }, appromate d b a

More information

Median as a Weighted Arithmetic Mean of All Sample Observations

Median as a Weighted Arithmetic Mean of All Sample Observations Meda as a Weghted Arthmetc Mea of All Sample Observatos SK Mshra Dept. of Ecoomcs NEHU, Shllog (Ida). Itroducto: Iumerably may textbooks Statstcs explctly meto that oe of the weakesses (or propertes) of

More information

L5 Polynomial / Spline Curves

L5 Polynomial / Spline Curves L5 Polyomal / Sple Curves Cotets Coc sectos Polyomal Curves Hermte Curves Bezer Curves B-Sples No-Uform Ratoal B-Sples (NURBS) Mapulato ad Represetato of Curves Types of Curve Equatos Implct: Descrbe a

More information

Module 7: Probability and Statistics

Module 7: Probability and Statistics Lecture 4: Goodess of ft tests. Itroducto Module 7: Probablty ad Statstcs I the prevous two lectures, the cocepts, steps ad applcatos of Hypotheses testg were dscussed. Hypotheses testg may be used to

More information

Systematic Selection of Parameters in the development of Feedforward Artificial Neural Network Models through Conventional and Intelligent Algorithms

Systematic Selection of Parameters in the development of Feedforward Artificial Neural Network Models through Conventional and Intelligent Algorithms THALES Project No. 65/3 Systematc Selecto of Parameters the developmet of Feedforward Artfcal Neural Network Models through Covetoal ad Itellget Algorthms Research Team G.-C. Vosakos, T. Gaakaks, A. Krmpes,

More information

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model

12.2 Estimating Model parameters Assumptions: ox and y are related according to the simple linear regression model 1. Estmatg Model parameters Assumptos: ox ad y are related accordg to the smple lear regresso model (The lear regresso model s the model that says that x ad y are related a lear fasho, but the observed

More information

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture)

Feature Selection: Part 2. 1 Greedy Algorithms (continued from the last lecture) CSE 546: Mache Learg Lecture 6 Feature Selecto: Part 2 Istructor: Sham Kakade Greedy Algorthms (cotued from the last lecture) There are varety of greedy algorthms ad umerous amg covetos for these algorthms.

More information

Econometric Methods. Review of Estimation

Econometric Methods. Review of Estimation Ecoometrc Methods Revew of Estmato Estmatg the populato mea Radom samplg Pot ad terval estmators Lear estmators Ubased estmators Lear Ubased Estmators (LUEs) Effcecy (mmum varace) ad Best Lear Ubased Estmators

More information

Source-Channel Prediction in Error Resilient Video Coding

Source-Channel Prediction in Error Resilient Video Coding Source-Chael Predcto Error Reslet Vdeo Codg Hua Yag ad Keeth Rose Sgal Compresso Laboratory ECE Departmet Uversty of Calfora, Sata Barbara Outle Itroducto Source-chael predcto Smulato results Coclusos

More information

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model

Lecture 7. Confidence Intervals and Hypothesis Tests in the Simple CLR Model Lecture 7. Cofdece Itervals ad Hypothess Tests the Smple CLR Model I lecture 6 we troduced the Classcal Lear Regresso (CLR) model that s the radom expermet of whch the data Y,,, K, are the outcomes. The

More information

ENGI 3423 Simple Linear Regression Page 12-01

ENGI 3423 Simple Linear Regression Page 12-01 ENGI 343 mple Lear Regresso Page - mple Lear Regresso ometmes a expermet s set up where the expermeter has cotrol over the values of oe or more varables X ad measures the resultg values of aother varable

More information

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE

THE ROYAL STATISTICAL SOCIETY HIGHER CERTIFICATE THE ROYAL STATISTICAL SOCIETY 00 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE PAPER I STATISTICAL THEORY The Socety provdes these solutos to assst caddates preparg for the examatos future years ad for the

More information

Chapter Two. An Introduction to Regression ( )

Chapter Two. An Introduction to Regression ( ) ubject: A Itroducto to Regresso Frst tage Chapter Two A Itroducto to Regresso (018-019) 1 pg. ubject: A Itroducto to Regresso Frst tage A Itroducto to Regresso Regresso aalss s a statstcal tool for the

More information

Sequential Approach to Covariance Correction for P-Field Simulation

Sequential Approach to Covariance Correction for P-Field Simulation Sequetal Approach to Covarace Correcto for P-Feld Smulato Chad Neufeld ad Clayto V. Deutsch Oe well kow artfact of the probablty feld (p-feld smulato algorthm s a too large covarace ear codtog data. Prevously,

More information

Confidence Intervals for Double Exponential Distribution: A Simulation Approach

Confidence Intervals for Double Exponential Distribution: A Simulation Approach World Academy of Scece, Egeerg ad Techology Iteratoal Joural of Physcal ad Mathematcal Sceces Vol:6, No:, 0 Cofdece Itervals for Double Expoetal Dstrbuto: A Smulato Approach M. Alrasheed * Iteratoal Scece

More information

9.1 Introduction to the probit and logit models

9.1 Introduction to the probit and logit models EC3000 Ecoometrcs Lecture 9 Probt & Logt Aalss 9. Itroducto to the probt ad logt models 9. The logt model 9.3 The probt model Appedx 9. Itroducto to the probt ad logt models These models are used regressos

More information

Study of Correlation using Bayes Approach under bivariate Distributions

Study of Correlation using Bayes Approach under bivariate Distributions Iteratoal Joural of Scece Egeerg ad Techolog Research IJSETR Volume Issue Februar 4 Stud of Correlato usg Baes Approach uder bvarate Dstrbutos N.S.Padharkar* ad. M.N.Deshpade** *Govt.Vdarbha Isttute of

More information

Comparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates

Comparison of Parameters of Lognormal Distribution Based On the Classical and Posterior Estimates Joural of Moder Appled Statstcal Methods Volume Issue Artcle 8 --03 Comparso of Parameters of Logormal Dstrbuto Based O the Classcal ad Posteror Estmates Raja Sulta Uversty of Kashmr, Sragar, Ida, hamzasulta8@yahoo.com

More information

13. Parametric and Non-Parametric Uncertainties, Radial Basis Functions and Neural Network Approximations

13. Parametric and Non-Parametric Uncertainties, Radial Basis Functions and Neural Network Approximations Lecture 7 3. Parametrc ad No-Parametrc Ucertates, Radal Bass Fuctos ad Neural Network Approxmatos he parameter estmato algorthms descrbed prevous sectos were based o the assumpto that the system ucertates

More information

Bayesian Classification. CS690L Data Mining: Classification(2) Bayesian Theorem: Basics. Bayesian Theorem. Training dataset. Naïve Bayes Classifier

Bayesian Classification. CS690L Data Mining: Classification(2) Bayesian Theorem: Basics. Bayesian Theorem. Training dataset. Naïve Bayes Classifier Baa Classfcato CS6L Data Mg: Classfcato() Referece: J. Ha ad M. Kamber, Data Mg: Cocepts ad Techques robablstc learg: Calculate explct probabltes for hypothess, amog the most practcal approaches to certa

More information

Generative classification models

Generative classification models CS 75 Mache Learg Lecture Geeratve classfcato models Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square Data: D { d, d,.., d} d, Classfcato represets a dscrete class value Goal: lear f : X Y Bar classfcato

More information

SPATIAL RAINFALL FIELD SIMULATION WITH RANDOM CASCADE INTRODUCING OROGRAPHIC EFFECTS ON RAINFAL

SPATIAL RAINFALL FIELD SIMULATION WITH RANDOM CASCADE INTRODUCING OROGRAPHIC EFFECTS ON RAINFAL Proc. of the d Asa Pacfc Assocato of Hydrology ad Water Resources (APHW) Coferece, July 5-8, 4, Sutec Sgapore Iteratoal Coveto Exhbto Cetre, Sgapore, vol., pp. 67-64, 4 SPATIAL RAINFALL FIELD SIMULATION

More information

A Helmholtz energy equation of state for calculating the thermodynamic properties of fluid mixtures

A Helmholtz energy equation of state for calculating the thermodynamic properties of fluid mixtures A Helmholtz eergy equato of state for calculatg the thermodyamc propertes of flud mxtures Erc W. Lemmo, Reer Tller-Roth Abstract New Approach based o hghly accurate EOS for the pure compoets combed at

More information

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter

The number of observed cases The number of parameters. ith case of the dichotomous dependent variable. the ith case of the jth parameter LOGISTIC REGRESSION Notato Model Logstc regresso regresses a dchotomous depedet varable o a set of depedet varables. Several methods are mplemeted for selectg the depedet varables. The followg otato s

More information

A tighter lower bound on the circuit size of the hardest Boolean functions

A tighter lower bound on the circuit size of the hardest Boolean functions Electroc Colloquum o Computatoal Complexty, Report No. 86 2011) A tghter lower boud o the crcut sze of the hardest Boolea fuctos Masak Yamamoto Abstract I [IPL2005], Fradse ad Mlterse mproved bouds o the

More information

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study

Bayes Interval Estimation for binomial proportion and difference of two binomial proportions with Simulation Study IJIEST Iteratoal Joural of Iovatve Scece, Egeerg & Techology, Vol. Issue 5, July 04. Bayes Iterval Estmato for bomal proporto ad dfferece of two bomal proportos wth Smulato Study Masoud Gaj, Solmaz hlmad

More information

Simulation Output Analysis

Simulation Output Analysis Smulato Output Aalyss Summary Examples Parameter Estmato Sample Mea ad Varace Pot ad Iterval Estmato ermatg ad o-ermatg Smulato Mea Square Errors Example: Sgle Server Queueg System x(t) S 4 S 4 S 3 S 5

More information

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5

THE ROYAL STATISTICAL SOCIETY 2016 EXAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 THE ROYAL STATISTICAL SOCIETY 06 EAMINATIONS SOLUTIONS HIGHER CERTIFICATE MODULE 5 The Socety s provdg these solutos to assst cadtes preparg for the examatos 07. The solutos are teded as learg ads ad should

More information

Bias Correction in Estimation of the Population Correlation Coefficient

Bias Correction in Estimation of the Population Correlation Coefficient Kasetsart J. (Nat. Sc.) 47 : 453-459 (3) Bas Correcto Estmato of the opulato Correlato Coeffcet Juthaphor Ssomboothog ABSTRACT A estmator of the populato correlato coeffcet of two varables for a bvarate

More information

Principal Components. Analysis. Basic Intuition. A Method of Self Organized Learning

Principal Components. Analysis. Basic Intuition. A Method of Self Organized Learning Prcpal Compoets Aalss A Method of Self Orgazed Learg Prcpal Compoets Aalss Stadard techque for data reducto statstcal patter matchg ad sgal processg Usupervsed learg: lear from examples wthout a teacher

More information

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods

Unimodality Tests for Global Optimization of Single Variable Functions Using Statistical Methods Malaysa Umodalty Joural Tests of Mathematcal for Global Optmzato Sceces (): of 05 Sgle - 5 Varable (007) Fuctos Usg Statstcal Methods Umodalty Tests for Global Optmzato of Sgle Varable Fuctos Usg Statstcal

More information

To use adaptive cluster sampling we must first make some definitions of the sampling universe:

To use adaptive cluster sampling we must first make some definitions of the sampling universe: 8.3 ADAPTIVE SAMPLING Most of the methods dscussed samplg theory are lmted to samplg desgs hch the selecto of the samples ca be doe before the survey, so that oe of the decsos about samplg deped ay ay

More information

A Combination of Adaptive and Line Intercept Sampling Applicable in Agricultural and Environmental Studies

A Combination of Adaptive and Line Intercept Sampling Applicable in Agricultural and Environmental Studies ISSN 1684-8403 Joural of Statstcs Volume 15, 008, pp. 44-53 Abstract A Combato of Adaptve ad Le Itercept Samplg Applcable Agrcultural ad Evrometal Studes Azmer Kha 1 A adaptve procedure s descrbed for

More information

Simple Linear Regression - Scalar Form

Simple Linear Regression - Scalar Form Smple Lear Regresso - Scalar Form Q.. Model Y X,..., p..a. Derve the ormal equatos that mmze Q. p..b. Solve for the ordary least squares estmators, p..c. Derve E, V, E, V, COV, p..d. Derve the mea ad varace

More information

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution:

{ }{ ( )} (, ) = ( ) ( ) ( ) Chapter 14 Exercises in Sampling Theory. Exercise 1 (Simple random sampling): Solution: Chapter 4 Exercses Samplg Theory Exercse (Smple radom samplg: Let there be two correlated radom varables X ad A sample of sze s draw from a populato by smple radom samplg wthout replacemet The observed

More information

2006 Jamie Trahan, Autar Kaw, Kevin Martin University of South Florida United States of America

2006 Jamie Trahan, Autar Kaw, Kevin Martin University of South Florida United States of America SOLUTION OF SYSTEMS OF SIMULTANEOUS LINEAR EQUATIONS Gauss-Sedel Method 006 Jame Traha, Autar Kaw, Kev Mart Uversty of South Florda Uted States of Amerca kaw@eg.usf.edu Itroducto Ths worksheet demostrates

More information

Dimensionality reduction Feature selection

Dimensionality reduction Feature selection CS 750 Mache Learg Lecture 3 Dmesoalty reducto Feature selecto Mlos Hauskrecht mlos@cs.ptt.edu 539 Seott Square CS 750 Mache Learg Dmesoalty reducto. Motvato. Classfcato problem eample: We have a put data

More information

Chapter 8: Statistical Analysis of Simulated Data

Chapter 8: Statistical Analysis of Simulated Data Marquette Uversty MSCS600 Chapter 8: Statstcal Aalyss of Smulated Data Dael B. Rowe, Ph.D. Departmet of Mathematcs, Statstcs, ad Computer Scece Copyrght 08 by Marquette Uversty MSCS600 Ageda 8. The Sample

More information

A New Method for Decision Making Based on Soft Matrix Theory

A New Method for Decision Making Based on Soft Matrix Theory Joural of Scetfc esearch & eports 3(5): 0-7, 04; rtcle o. JS.04.5.00 SCIENCEDOMIN teratoal www.scecedoma.org New Method for Decso Mag Based o Soft Matrx Theory Zhmg Zhag * College of Mathematcs ad Computer

More information

Journal of Chemical and Pharmaceutical Research, 2014, 6(7): Research Article

Journal of Chemical and Pharmaceutical Research, 2014, 6(7): Research Article Avalable ole www.jocpr.com Joural of Chemcal ad Pharmaceutcal Research, 04, 6(7):4-47 Research Artcle ISSN : 0975-7384 CODEN(USA) : JCPRC5 Predcto of CNG automoble owershp by usg the combed model Ku Huag,

More information

Taylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific

Taylor s Series and Interpolation. Interpolation & Curve-fitting. CIS Interpolation. Basic Scenario. Taylor Series interpolates at a specific CIS 54 - Iterpolato Roger Crawfs Basc Scearo We are able to prod some fucto, but do ot kow what t really s. Ths gves us a lst of data pots: [x,f ] f(x) f f + x x + August 2, 25 OSU/CIS 54 3 Taylor s Seres

More information

Nonlinear Blind Source Separation Using Hybrid Neural Networks*

Nonlinear Blind Source Separation Using Hybrid Neural Networks* Nolear Bld Source Separato Usg Hybrd Neural Networks* Chu-Hou Zheg,2, Zh-Ka Huag,2, chael R. Lyu 3, ad Tat-g Lok 4 Itellget Computg Lab, Isttute of Itellget aches, Chese Academy of Sceces, P.O.Box 3, Hefe,

More information

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity

ECONOMETRIC THEORY. MODULE VIII Lecture - 26 Heteroskedasticity ECONOMETRIC THEORY MODULE VIII Lecture - 6 Heteroskedastcty Dr. Shalabh Departmet of Mathematcs ad Statstcs Ida Isttute of Techology Kapur . Breusch Paga test Ths test ca be appled whe the replcated data

More information

Kernel-based Methods and Support Vector Machines

Kernel-based Methods and Support Vector Machines Kerel-based Methods ad Support Vector Maches Larr Holder CptS 570 Mache Learg School of Electrcal Egeerg ad Computer Scece Washgto State Uverst Refereces Muller et al. A Itroducto to Kerel-Based Learg

More information

Correlation and Regression Analysis

Correlation and Regression Analysis Chapter V Correlato ad Regresso Aalss R. 5.. So far we have cosdered ol uvarate dstrbutos. Ma a tme, however, we come across problems whch volve two or more varables. Ths wll be the subject matter of the

More information

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits

Block-Based Compact Thermal Modeling of Semiconductor Integrated Circuits Block-Based Compact hermal Modelg of Semcoductor Itegrated Crcuts Master s hess Defese Caddate: Jg Ba Commttee Members: Dr. Mg-Cheg Cheg Dr. Daqg Hou Dr. Robert Schllg July 27, 2009 Outle Itroducto Backgroud

More information

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic

Convergence of the Desroziers scheme and its relation to the lag innovation diagnostic Covergece of the Desrozers scheme ad ts relato to the lag ovato dagostc chard Méard Evromet Caada, Ar Qualty esearch Dvso World Weather Ope Scece Coferece Motreal, August 9, 04 o t t O x x x y x y Oservato

More information

Maximum Likelihood Estimation

Maximum Likelihood Estimation Marquette Uverst Maxmum Lkelhood Estmato Dael B. Rowe, Ph.D. Professor Departmet of Mathematcs, Statstcs, ad Computer Scece Coprght 08 b Marquette Uverst Maxmum Lkelhood Estmato We have bee sag that ~

More information

(Monte Carlo) Resampling Technique in Validity Testing and Reliability Testing

(Monte Carlo) Resampling Technique in Validity Testing and Reliability Testing Iteratoal Joural of Computer Applcatos (0975 8887) (Mote Carlo) Resamplg Techque Valdty Testg ad Relablty Testg Ad Setawa Departmet of Mathematcs, Faculty of Scece ad Mathematcs, Satya Wacaa Chrsta Uversty

More information

Generating Multivariate Nonnormal Distribution Random Numbers Based on Copula Function

Generating Multivariate Nonnormal Distribution Random Numbers Based on Copula Function 7659, Eglad, UK Joural of Iformato ad Computg Scece Vol. 2, No. 3, 2007, pp. 9-96 Geeratg Multvarate Noormal Dstrbuto Radom Numbers Based o Copula Fucto Xaopg Hu +, Jam He ad Hogsheg Ly School of Ecoomcs

More information

Radial Basis Function Networks

Radial Basis Function Networks Radal Bass Fucto Netorks Radal Bass Fucto Netorks A specal types of ANN that have three layers Iput layer Hdde layer Output layer Mappg from put to hdde layer s olear Mappg from hdde to output layer s

More information

CSE 5526: Introduction to Neural Networks Linear Regression

CSE 5526: Introduction to Neural Networks Linear Regression CSE 556: Itroducto to Neural Netorks Lear Regresso Part II 1 Problem statemet Part II Problem statemet Part II 3 Lear regresso th oe varable Gve a set of N pars of data , appromate d by a lear fucto

More information

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger

Example: Multiple linear regression. Least squares regression. Repetition: Simple linear regression. Tron Anders Moger Example: Multple lear regresso 5000,00 4000,00 Tro Aders Moger 0.0.007 brthweght 3000,00 000,00 000,00 0,00 50,00 00,00 50,00 00,00 50,00 weght pouds Repetto: Smple lear regresso We defe a model Y = β0

More information

Lecture 1 Review of Fundamental Statistical Concepts

Lecture 1 Review of Fundamental Statistical Concepts Lecture Revew of Fudametal Statstcal Cocepts Measures of Cetral Tedecy ad Dsperso A word about otato for ths class: Idvduals a populato are desgated, where the dex rages from to N, ad N s the total umber

More information

Statistics: Unlocking the Power of Data Lock 5

Statistics: Unlocking the Power of Data Lock 5 STAT 0 Dr. Kar Lock Morga Exam 2 Grades: I- Class Multple Regresso SECTIONS 9.2, 0., 0.2 Multple explaatory varables (0.) Parttog varablty R 2, ANOVA (9.2) Codtos resdual plot (0.2) Exam 2 Re- grades Re-

More information

Research on SVM Prediction Model Based on Chaos Theory

Research on SVM Prediction Model Based on Chaos Theory Advaced Scece ad Techology Letters Vol.3 (SoftTech 06, pp.59-63 http://dx.do.org/0.457/astl.06.3.3 Research o SVM Predcto Model Based o Chaos Theory Sog Lagog, Wu Hux, Zhag Zezhog 3, College of Iformato

More information

Dimensionality Reduction and Learning

Dimensionality Reduction and Learning CMSC 35900 (Sprg 009) Large Scale Learg Lecture: 3 Dmesoalty Reducto ad Learg Istructors: Sham Kakade ad Greg Shakharovch L Supervsed Methods ad Dmesoalty Reducto The theme of these two lectures s that

More information

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations

Derivation of 3-Point Block Method Formula for Solving First Order Stiff Ordinary Differential Equations Dervato of -Pot Block Method Formula for Solvg Frst Order Stff Ordary Dfferetal Equatos Kharul Hamd Kharul Auar, Kharl Iskadar Othma, Zara Bb Ibrahm Abstract Dervato of pot block method formula wth costat

More information

The internal structure of natural numbers, one method for the definition of large prime numbers, and a factorization test

The internal structure of natural numbers, one method for the definition of large prime numbers, and a factorization test Fal verso The teral structure of atural umbers oe method for the defto of large prme umbers ad a factorzato test Emmaul Maousos APM Isttute for the Advacemet of Physcs ad Mathematcs 3 Poulou str. 53 Athes

More information

The OK weights define the best linear unbiased predictor (BLUP). The OK prediction, z ( x ), is defined as: (2) given.

The OK weights define the best linear unbiased predictor (BLUP). The OK prediction, z ( x ), is defined as: (2) given. JSR data archve materal for HOW POROSITY AND PERMEABILITY VARY SPATIALLY WITH GRAIN SIZE, SORTING, CEMENT VOLUME AND MINERAL DISSOLUTION IN FLUVIAL TRIASSIC SANDSTONES: THE VALUE OF GEOSTATISTICS AND LOCAL

More information

13. Artificial Neural Networks for Function Approximation

13. Artificial Neural Networks for Function Approximation Lecture 7 3. Artfcal eural etworks for Fucto Approxmato Motvato. A typcal cotrol desg process starts wth modelg, whch s bascally the process of costructg a mathematcal descrpto (such as a set of ODE-s)

More information

Lecture 3. Sampling, sampling distributions, and parameter estimation

Lecture 3. Sampling, sampling distributions, and parameter estimation Lecture 3 Samplg, samplg dstrbutos, ad parameter estmato Samplg Defto Populato s defed as the collecto of all the possble observatos of terest. The collecto of observatos we take from the populato s called

More information