ARTIFICIAL NEURAL NETWORK MODELS FOR ESTIMATION OF SEDIMENT LOAD IN AN ALLUVIAL RIVER IN INDIA

Size: px
Start display at page:

Download "ARTIFICIAL NEURAL NETWORK MODELS FOR ESTIMATION OF SEDIMENT LOAD IN AN ALLUVIAL RIVER IN INDIA"

Transcription

1 JOURNAL OF ENVIRONMENTAL HYDROLOGY The Electroic Joural of the Iteratioal Associatio for Evirometal Hydrology O the World Wide Web at VOLUME ARTIFICIAL NEURAL NETWORK MODELS FOR ESTIMATION OF SEDIMENT LOAD IN AN ALLUVIAL RIVER IN INDIA Archaa Sarkar Rakesh Kumar Sajay K. Jai R.D. Sigh Natioal Istitute of Hydrology Roorkee, Idia. The magitude of sedimet trasport by rivers is a major cocer for water resources plaig ad maagemet. The methods available for sedimet estimatio are largely empirical, with sedimet ratig curves beig the most widely used i Idia. I this study, sedimet ratig curve ad artificial eural etwork (ANN) techiques have bee applied to model the sedimetdischarge relatioship of a alluvial river. Daily data of sedimet load ad discharge of the Kosi River i Idia have bee used. A compariso has bee made betwee the results obtaied usig ANNs ad sedimet ratig curves. The sedimet load estimatios i the river obtaied by ANNs have bee foud to be sigificatly superior to the correspodig classical sedimet ratig curve oes. Also, a ANN approach ca give iformatio about the structure of evets (e.g., hysteresis i the sedimet-discharge relatioship) which is ot possible to achieve with sedimet ratig curves. Joural of Evirometal Hydrology

2 INTRODUCTION The sedimet outflow from the watershed is iduced by processes of detachmet, trasportatio ad depositio of soil materials by raifall ad ruoff. The assessmet of the volume of sedimets beig trasported by a river is required i a wide spectrum of problems such as the desig of reservoirs ad dams; trasport of sedimet ad pollutats i rivers, lakes ad estuaries; desig of stable chaels, dams ad debris basis; udertakig cleaup followig floods; determiatio of the effects of watershed maagemet; ad evirometal impact assessmet. Fie sedimet has log bee idetified as a importat factor for the trasport of utriets ad cotamiats such as heavy metals ad micro-orgaics. Suspeded sedimet is importat i its ow right, sice its presece or absece exerts a importat cotrol o geomorphological ad biological processes i rivers ad estuaries (Morris ad Fa, 997). Sedimet ratig curves are widely used to estimate the sedimet load beig trasported by a river. Sedimet load is defied as the sedimet flow i a river measurable at a poit of referece durig a specified period of time. A sedimet ratig curve is a relatio betwee the sedimet ad river discharges. Such a relatioship is usually established by a regressio aalysis, ad the curves are geerally expressed i the form of a power equatio. Ratig curves are developed o the premise that a stable relatioship betwee cocetratio ad discharge ca be developed which, although exhibitig scatter, will allow the mea sedimet yield to be determied o the basis of the discharge history. A problem iheret i the ratig curve techique is the high degree of scatter, which may be reduced but ot elimiated. Cocetratio does ot ecessarily icrease as a fuctio of discharge. Mathematically, a ratig curve may be costructed by log-trasformig all data ad usig a liear least squares regressio to determie the lie of best fit. The log-log relatioship betwee load ad discharge is of the form (Morris ad Fa, 997) S = aq b () ad the log-trasformed form will plot as a straight lie o log-log paper log S =log a + b log (Q) (2) where, S = sedimet load, Q = discharge, log a ad b are regressio costats. A regressio equatio will miimize the sum of squared deviatios from the log-trasformed data, which is ot the same as miimizig the sum of squared deviatios from the origial dataset ad which itroduces a bias that uderestimates the load at ay discharge. Ferguso (986) reports that this bias may result i uderestimatio by as much as 50 percet. Ferguso ad others have suggested bias correctio factors, but their appropriateess is ucertai (Wallig ad Webb, 988). The ratig curve techique is ot adequate i view of the complexity of the problem. O the other had, the applicatio of physics-based distributed process computer simulatio offers aother possible method of sedimet predictio. But the applicatio of these complex software programs is ofte problematic, due to the use of idealized sedimetatio compoets, or the eed for massive amouts of detailed spatial ad temporal data which are ot available. Simpler approaches are therefore required i the form of coceptual solutios or black-box modellig techiques. Neurocomputig provides oe possible aswer to the problematic task of sedimet trasfer predictio. Recetly, artificial eural etworks (ANN) have emerged as powerful tools to model oliear processes. The artificial eural etworks operate i a maer Joural of Evirometal Hydrology 2

3 aalogous to that of biological euro systems ad offer several advatages over covetioal computig methods. A ANN is a computig system made up of a highly itercoected set of simple iformatio processig elemets, aalogous to a euro, called uits. The euro collects iputs from both a sigle ad multiple sources ad produces output i accordace with a predetermied oliear fuctio. A ANN model is created by itercoectio of may of the euros i a kow cofiguratio. The primary elemets characterizig the eural etwork are the distributed represetatio of iformatio, local operatios ad oliear processig. Figure shows the geeral structure of a three layer back propagatio ANN. The theory of ANN has bee described i may textbooks such as Hayki (994). The mai priciple of eural computig is the decompositio of the iput-output relatioship ito series of liearly separable steps usig hidde layers (Hayki, 994). Geerally there are four distict steps i developig a ANN-based solutio. The first step is the data trasformatio or scalig. The secod step is the etwork architecture defiitio, where the umber of hidde layers, the umber of euros i each layer, ad the coectivity betwee the euros are set. I the third step, a learig algorithm is used to trai the etwork to respod correctly to a give set of iputs. Lastly, comes the validatio step i which the performace of the traied ANN model is tested through some selected statistical criteria. There are umerous studies related to the applicatio of ANNs to various problems frequetly ecoutered i water resources (ASCE Task Committee, 2000). But the applicatio of the ANN approach for modellig sedimet-discharge process is very recet, ad has already produced very ecouragig results. I a research project by Rosebaum (2000), ANN techique has bee used to predict sedimet distributio i Swedish harbors. Jai (200) used the ANN approach to establish a itegrated stage-discharge-sedimet cocetratio relatio for two sites o the Mississippi River. Based o the compariso of results for two gaugig sites, he has show that the ANN results Figure. Structure of a multi-layer Feed Forward Artificial Neural Network Model. Joural of Evirometal Hydrology 3

4 are much closer to the observed values tha the covetioal techique. I a study by Nagy et al. (2002), a ANN is used to estimate the atural sedimet discharge i rivers i terms of sedimet cocetratio. They have addressed the importace of choosig a appropriate eural etwork structure ad providig field data to that etwork for the traiig purpose ad foud that the ANN approach gives better results compared to several commoly used formulas of sedimet discharge. Yitia ad Gu (2003) applied the ANN techique to modellig daily discharge ad aual sedimet discharges i the Jigjiag reach of the Yagtze River ad Dogtig Lake, Chia. The authors demostrated that the ANN techique is a powerful tool for real-time predictio of flow ad sedimet trasport i a complex etwork of rivers. Agarwal et al. (2004) developed daily, weekly, te-daily ad mothly sedimet yield ANN models for the Vamsadhara River basi i Idia. Raghuwashi et al. (2006) also developed ANN models to predict ruoff ad sedimet yield o a daily ad weekly basis for a small agricultural watershed i the upper Siwae River i Idia. The authors foud the performace of ANN models superior to regressio models. Cigizoglu ad Alp (2007) used the geeralized regressio eural etwork techique for river suspeded sedimet estimatio i the Juiata Catchmet i the USA. The authors foud ANN estimatios sigificatly superior to covetioal method results. I the preset study, the ANN techique alog with the covetioal sedimet ratig curve techique has bee applied to model the sedimet-discharge relatioship of the Kosi River i Idia usig daily data of sedimet load ad discharge at the Birpur gaugig site. PERFORMANCE EVALUATION CRITERIA The statistical ad hydrological evaluatio criteria used i the preset study are root mea square error (RMSE), correlatio coefficiet (r), coefficiet of efficiecy (CE) or coefficiet of determiatio (r 2 ) ad volumetric error (EV). Root Mea Square Error (RMSE) It yields the residual error i terms of the mea square error expressed as (Yu, 994) RMSE = residual variace = (Y 2 j Ŷ j) / /2 (3) where, Y ad Ŷ are the observed ad estimated values respectively ad is the umber of observatios. Correlatio Coefficiet (r) It is expressed as (Haa, 977) r = ) {( Yj - Y )( Yj - Ŷ) } 2 2 ( Yj - Y) ( Ŷj - Ŷ) / 2 x 00 (4) where, $ Y ad $ Y are the meas of observed ad estimated values. Joural of Evirometal Hydrology 4

5 Coefficiet of Efficiecy (CE) Based o the stadardizatio of residual variace with iitial variace, the coefficiet of efficiecy ca be used to effectively compare the relative performace of the two approaches (Nash ad Sutcliffe, 970). It is expressed as CE = { - residual variace } x 00 = { - iitial variace (Y Ŷ ) j (Y Y) j j 2 2 } x 00 (5) The coefficiet of efficiecy is also commoly kow as the coefficiet of determiatio (r 2 ) which may be writte i a umber of ways ad represets the fractio of variace that is explaied by regressio. The closer this ratio is to uity, the better is the regressio relatio (Haa, 977). Volumetric Error (EV) This is also called relative absolute error i volume (Yu, 994) ad is estimated as EV = { ( Ŷj Y j) / (Yj) } x 00 (6) THE STUDY AREA AND DATA AVAILABILITY I the preset study, time series data of sedimet load for oe gaugig statio o the Kosi River i the state of Bihar i Idia has bee used. Kosi is a large alluvial river with low gradiets ad wide flood plais. Meaderig or lateral shiftig of alluvial rivers produces cutoff meaders, oxbow lakes ad distictive ladforms. Tectoic ad evirometal chages ca cause aggradatios ad degradatio i alluvial rivers ad lead to high soil erosio ad meaderig. The Kosi River carries a mea aual discharge of.6x0 3 m 3 /sec, with mosoo discharge 0 times the lea period discharge. The river carries a very high cocetratio of suspeded sedimet load durig the mosoo moths. The ormal flood discharge of the Kosi usually varies from.5 to 2.0 millio cusecs. About 75 to 84 percet of the total ruoff occurs i the mosoo moths of Jue to October. O a average total sedimets are 0.20 percet of the total ruoff. About 95 percet of the silt load comes dow the river durig the mosoo floods ad oly 5 percet of the sedimets come dow i the remaiig o-mosoo moths. The total ruoff durig the o-mosoo moths, however is o a average about 9 percet of the total aual ruoff. For the preset study, discharge ad sedimet load data for a period of five years ( ) have bee used. However, durig this period some of the data are missig ad therefore data of 502 days have bee used. These data are available at the Birpur gaugig site. There is a barrage at Ido-Nepal border ear Birpur. The uit of discharge data is cusec while sedimet load data is i cubic feet (cft) per day. Ratig Curve Aalysis METHODOLOGY I this study, a regressio aalysis has bee carried out to develop the sedimet ratig equatio for the Kosi river at the Birpur gaugig site. For this purpose, the available data have bee Joural of Evirometal Hydrology 5

6 cosidered i two parts. The first part is used to calibrate the mathematical equatio for sedimet ratig ad the secod, to validate it. Out of 502 days of data, 002 days data were used for the calibratio of the ratig curve ad the remaiig 500 days data for validatio. The sedimet ratig equatio betwee sedimet load ad discharge for Kosi River at Birpur site is developed i the form of Equatio () S = Q (7) where S = Sedimet load i the River Kosi at the Birpur site i 0 3 cft. Q= Discharge i the River Kosi at the Birpur site i 0 3 cusec. Artificial Neural Network Aalysis For the developmet of ANN models the total data have bee divided ito traiig ad testig periods of 002 days ad 500 days respectively. The models provide the sedimet load at time step t, with S t as output. It has bee show by may ivestigators that the curret sedimet load ca be better mapped by cosiderig, i additio to the curret value of discharge, the sedimet ad discharge at previous times. Therefore, i additio to Q t, i.e., discharge at time step t, other variables such as Q t-, Q t-2, etc. ad S t-, S t-2, etc were cosidered as the iput. Various combiatios of iput variables cosidered for traiig of ANN i the preset study are give i Table together with the output variables. From the may differet types of ANNs that have bee developed with differet objectives, the multilayer perceptro was chose for applicatio i this research, as it is particularly suited to regressio problems ad is the most commo type of etwork applied to modellig of various hydrological problems (Hsu et al., 995). These ANNs model complex multivariate oliear fuctios, such as the sigmoid fuctio. The composite fuctio is fitted to the data by modifyig the shape-defiig parameters of the compoet oliear fuctios i a iterative traiig process, which miimizes the error betwee the estimated outputs ad the target outputs. I the course of this ivestigatio, eural etwork aalysis was coducted usig the Neural Power-2.5 ANN package (NeuralPower, 2003). A back-propagatio ANN with the geeralized delta rule as the traiig algorithm has bee employed i this study. The structure for all simulatio models are three layer BPANN which utilizes a oliear sigmoid activatio fuctio uiformly betwee the layers. Nodes i the iput layer are equal to umber of iput variables, odes i hidde layer are varied from the default value by the NP package (2 to 7) for various ANN models to approximately double of iput odes (Zhu et al., 994) ad the odes i the output layer is oe as the models provide sigle output. The modellig of ANN started with the ormalizatio (re-scalig) of all iputs ad output with the maximum value of respective variable reducig the data i the rage 0 to to avoid ay Table. Descriptio of various ANN models for traiig. ANN Model Iput Variables Output Variables ANN - Q t S t ANN - 2 Q t, Q t-, S t- S t ANN - 3 Q t, Q t-, Q t-2, S t-, S t-2 S t ANN - 4 Q t, Q t-, Q t-2, Q t-3, S t-, S t-2, S t-3 S t ANN - 5 Q t, Q t-, Q t-2, Q t-3, Q t-4, S t-, S t-2, S t-3, S t-4 S t Joural of Evirometal Hydrology 6

7 saturatio effect that may be caused by the use of sigmoid fuctio (accomplished through the Neural Power package). All itercoectig liks betwee odes of successive layers were assiged radom values called weights. A costat value of 0.5 ad 0.8 respectively has bee cosidered for the learig rate µ ad the mometum term α which were selected after hit ad miss trials. The quick propagatio (QP) learig algorithm has bee adopted for the traiig of all the ANN models. QP is a heuristic modificatio of the stadard back propagatio ad is very fast (NeuralPower, 2003). The etwork weights were updated after presetig each patter from the learig data set, rather tha oce per iteratio. The criterio selected to avoid over traiig was geeralizatio of ANN through crossvalidatio (Hayki, 994). For this purpose, the traiig data set for all the models was further divided i two subsets. First subset (800 datasets) for estimatio of weights of the ANN model ad secod subset (202 dataset) for evaluatio of the performace of ANN model with data of first subset. Traiig was stopped whe the error for the secod subset started icreasig. I this way, the traiig set has bee used to assess the performace of various cadidate model structures, ad thereby choose the best oe. The particular ANN model with the best performig parameter values was the traied o the full traiig data set (502 daily data), ad the geeralized performace of the resultig etwork has bee measured o the test data set (500 daily data) to which it has ever before bee exposed. The performace of the model was tested through the statistical criterio discussed earlier. DISCUSSION OF RESULTS The values of the performace criteria from various ANN models as well a ratig curve for both traiig (calibratio) ad testig (validatio) data sets are preseted i Table 2. The traiig ad testig results are discussed separately. Calibratio (Traiig) Results It ca be see from Table 2 that all the ANN models have outperformed the covetioal sedimet ratig curve techique i terms of various performace criteria. I terms of root mea Table 2. Comparative performace of various ANN models ad covetioal sedimet ratig curve. Model Calibratio (Traiig) Validatio (Testig) RMSE r CE/r 2 EV RMSE r CE/r 2 EV ANN Model (Iput, Hidde, Output) ANN (,2,) ANN (3,3,) ANN (5,4,) ANN (7,6,) ANN 5 (9,7,) Covetioal Procedure Sedimet Ratig Curve Joural of Evirometal Hydrology 7

8 square error (RMSE), ratig curve model performed the worst (8038.7), whereas, ANN-4 model performed the best (2802.). The correlatio coefficiet (r) ad coefficiet of determiatio (R 2 ) for various ANN models have bee higher tha the covetioal sedimet ratig curve techique. However, both the values have bee highest for ANN-4 model (r = 98.%, r 2 = 96.2%), whereas the values for ratig curve are oly 92.6% ad 85.7% respectively. I terms of volumetric error (EV), the performace of ANN-4 model has bee the best with the least error (9.24), whereas the ratig curve model performed the worst with highest value of error 40.68) which is almost double the ANN error. Validatio (Testig) Results All the ANN models have outperformed the covetioal sedimet ratig curve techique i terms of various performace criteria durig testig/validatio also. I terms of RMSE, agai the ratig curve model performed the worst (5252.2), whereas, ANN-4 model performed the best (2965.6). I terms of r ad r 2, ANN-4 model performed the best (97.6% ad 95.2% respectively). The ratig curve model performed the worst for r ad R 2 also (95.7% ad 9.6% respectively). The volumetric error (EV) has bee lowest for ANN-2 model (2.8), whereas, it has bee highest for the ratig curve model (39.4). The best performig ANN model i other criteria, i.e., ANN-4 model has also got a low value of EV (23.3). Therefore, it ca be observed from the results of calibratio as well as validatio that the performace of ANN-4 model has bee the best except i terms of volumetric error durig validatio. However, i terms of EV also, its performace has bee very close to the best oe. It ca be oted that by the iclusio of iput variables of previous time steps, the model performace improves up to the previous three days iputs. Beyod that, i.e., whe the iputs of previous fourth day are icluded i the model, the performace starts deterioratig. It implies that beyod the previous three days values, o ew iformatio is actually supplied to the ANN model for traiig. Ad with higher umber of iput variables, the etwork becomes more complicated ad may overfit the data. The plots betwee observed sedimet load ad estimated sedimet load (usig the covetioal ad ANN approach) for the calibratio as well as validatio period have bee illustrated i Figure 2 (a), (b), (c) ad (d) respectively. It is observed that the ANN (ANN-4) estimates show a better match with the observed values. It is also see from the graph that there is a large variatio i the covetioal approach estimates (for both calibratio ad validatio period). However, the ANN estimates (for both calibratio & validatio period) show a fairly good agreemet with the observed values eve at the high extremes. The temporal variatio of observed sedimet load ad the estimate usig the covetioal techique ad ANN (ANN 4 model) for the calibratio period is plotted i Figure 3. It is see from the compariso of the graphs that the ANN estimates of sedimet load very closely follow the observed curve, whereas the covetioal approach has sigificat mismatch, particularly ear the peaks. Usig the weights obtaied i the traiig phase for each combiatio, the performace or i other words, the geeralizatio capability of the ANN was tested usig the validatio period data. Figure 4 cotais the graphical presetatio of the results of the validatio phase. Compariso of the sedimet load estimates with the observed oes usig the covetioal approach ad ANN approach are show i the figure. Agai here the ANN estimates are closer to the correspodig observed oes. The covetioal approach estimates agai show sigificat deviatios from the correspodig observed oes. Joural of Evirometal Hydrology 8

9 Figure 2. Plot betwee observed ad estimated sedimet load Oserved Ratig curve ANN - 4 Sedimet load (cft) Time (days) Figure 3. Compariso of observed ad estimated sedimet load durig calibratio. To be able to test whether the ANN approach ca give iformatio about the structure of evets, the hysteresis i the sedimet load obtaied by ANNs ad the sedimet ratig relatio are compared with the correspodig observed oes i Figure 5 for all the 502 data sets. It ca be see that the hysteresis estimated by ANNs is almost the same as the observed oe. Joural of Evirometal Hydrology 9

10 Based o these results, it is clear that the sedimet load estimatios obtaied by the ANN techique are sigificatly superior to the correspodig classical sedimet ratig curve oes. It may also be added that as a result of traiig, a set of weights that represets the kowledge of ANN is obtaied ad oe does ot get a explicit equatio to work with. The weight distributios for the traied ANN-4 model are show i Figure 6. CONCLUSIONS The ANN techique has bee utilized for modellig the sedimet-discharge process i a alluvial river. The data of the Birpur gaugig site of the River Kosi i Idia have bee used for the aalysis. The results of the ANN have bee compared with those of the covetioal sedimet ratig curve approach. The ANN results have bee foud to be much closer to the observed values tha the covetioal techique. The study shows that the ANN techique ca be successfully applied for the developmet of reliable relatioships betwee sedimet ad discharge i a river Observed Ratig curve ANN Sedimet load (cft) Time(days) Figure 4. Compariso of observed ad estimated sedimet load durig validatio Observed sedimet Estimated sedimet(ratig curve) Estimated sedimet (ANN) Sedimet Load (cft) Discharge (cusec) Figure 5. Compariso of the observed hysteresis with the estimated hysteresis. Joural of Evirometal Hydrology 0

11 Weight Values Weight Numbers Figure 6. Weights distributio for the ANN-4 model. whe other approaches caot succeed due to the high o-liearity i the relatioship, especially i alluvial rivers. A sigificat advatage of usig the ANN approach is that it ca successfully model the hysteresis effect i the sedimet-discharge relatioship. Moreover, the ANN techique has preferece over the covetioal methods as ANNs ca accept ay umber of effective variables as iput parameters without omissio or simplificatio as is commoly doe i the covetioal methods. The preseted ANN models have bee developed by usig oly field river data, ad they have o boudary coditios i applicatio. The oly restrictio is that the models caot estimate accurately the sedimet load for data out of the rage of the traiig patter data. Such a problem ca easily be overcome by feedig the traiig patters with a wide rage of data. Site egieers ca calculate sedimet load usig the ANN without prior kowledge of the sedimet trasport theories, provided they kow the bouds of the data used to geerate the ANN. ACKNOWLEDGMENTS The authors are thakful to the two reviewers, Dr. Naya Sharma, Professor, Dept of Water Resources Developmet ad Maagemet, Idia Istitute of Techology, Roorkee, Idia ad Dr. S. P. Agarwal, Scietist E, Water Resources Divisio, Idia Istitute of Remote Sesig, Dehradu, Idia. Their valuable suggestios helped to improve the quality of paper. REFERENCES Agarwal, A., R.D. Sigh, S.K. Mishra, ad P.K. Bhuya ANN-based sedimet yield models for Vamsadhara River basi (Idia). Water SA, Vol. 3(), pp ASCE Task Committee o Applicatio of Artificial Neural Networks i Hydrology Artificial eural etworks i hydrology II: Hydrologic applicatios. Joural of Hydrologic Egieerig, ASCE, Vol. 5(2), pp Cigizoglu, H.K., ad M. Alp Geeralized regressio eural etwork i modellig river sedimet yield. Advaces i Egieerig Software, Vol. 37, Issue 2, pp Ferguso, R.I River loads uderestimated by ratig curves. Water Resources Research, Vol. 22(), pp Joural of Evirometal Hydrology

12 Haa, C.T Statistical methods i hydrology. The Iowa State Uiversity Press, USA. Hayki, S Neural etworks - A comprehesive foudatio. Macmilla, New York. Hsu, K., H.V. Gupta, ad S. Sorooshia Artificial eural etwork modellig of the raifall-ruoff process. Water Resources Research, Vol. 3(0), pp Jai, S.K Developmet of itegrated sedimet ratig curves usig ANNs. Joural of Hydraulic Egieerig, ASCE, Vol. 27(), pp Karuaithi, N., W.J. Greey, D. Whitley, ad K. Bovee Neural Networks for River Flow Predictio. Joural of Computig i Civil Egieerig, ASCE, Vol. 8(2), pp Morris, G.L., ad J. Fa Reservoir sedimetatio hadbook. McGraw-Hill, New York. Nagy, H.M., B. Wataabe, ad M. Hirao Predictio of sedimet load cocetratio i rivers usig artificial eural etwork model. Joural of Hydraulic Egieerig, ASCE, Vol. 28(6), pp Nash, J.E, ad J.V. Sutcliffe River flow forecastig through coceptual models. Joural of Hydrology, Vol.0, pp NeuralPower Neural etworks professioal versio 2.5. CPC-X Software, Copyright: , Demo versio from the iteret, Raghuwashi, N.S., R. Sigh, ad L.S. Reddy Ruoff ad sedimet yield modellig usig artificial eural etworks: Upper Siwae River, Idia. Joural of Hydrologic Egieerig, ASCE, Vol. (), pp Rosebaum, M Harbours - siltig ad evirometal sedimetology (H-SENSE). Fial Report, Dept. of Civil & Structural Egieerig, The Nottigham Tret Uiversity, Nottigham, UK. HSese/ Rumelhart, De.E., G.E. Hito, ad R.J. Williams Learig represetatio by back propagatig errors. Nature, Vol. 323(9), pp Wallig, D.E., ad B.W. Webb The reliability of ratig curve estimates of suspeded sedimet yield: some further commets. Sedimet Budgets, IAHS Publ. 74, Walligford, U.K., pp Yitia, L., ad R.R. Gu Modellig flow ad sedimet trasport i a river system usig a artificial eural etwork. Evirometal Maagemet, Vol. 3(), pp Yu, P.S., C.L. Liu, ad T.Y. Lee Applicatio of a trasfer fuctio model to a storage ruoff process. Stochastic ad Statistical Methods i Hydrology ad Evirometal Egieerig, Vol. 3, K.W. Hipel et al., eds., Kluwer, Dordrecht, The Netherlads, pp Zhu, M., M. Fujita, ad N. Hashimoto Applicatio of eural etworks to ruoff predictio. Stochastic ad Statistical Method i Hydrology ad Evirometal Egieerig, Vol. 3, K.W. Hipel et al., eds., Kluwer, Dordrecht, The Netherlads, pp ADDRESS FOR CORRESPONDENCE Archaa Sarkar Natioal Istitute of Hydrology Roorkee Idia archaa_ih@yahoo.co.i Joural of Evirometal Hydrology 2

Evapotranspiration Estimation Using Support Vector Machines and Hargreaves-Samani Equation for St. Johns, FL, USA

Evapotranspiration Estimation Using Support Vector Machines and Hargreaves-Samani Equation for St. Johns, FL, USA Evirometal Egieerig 0th Iteratioal Coferece eissn 2029-7092 / eisbn 978-609-476-044-0 Vilius Gedimias Techical Uiversity Lithuaia, 27 28 April 207 Article ID: eviro.207.094 http://eviro.vgtu.lt DOI: https://doi.org/0.3846/eviro.207.094

More information

Intermittent demand forecasting by using Neural Network with simulated data

Intermittent demand forecasting by using Neural Network with simulated data Proceedigs of the 011 Iteratioal Coferece o Idustrial Egieerig ad Operatios Maagemet Kuala Lumpur, Malaysia, Jauary 4, 011 Itermittet demad forecastig by usig Neural Network with simulated data Nguye Khoa

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

ANALYSIS OF EXPERIMENTAL ERRORS

ANALYSIS OF EXPERIMENTAL ERRORS ANALYSIS OF EXPERIMENTAL ERRORS All physical measuremets ecoutered i the verificatio of physics theories ad cocepts are subject to ucertaities that deped o the measurig istrumets used ad the coditios uder

More information

ECON 3150/4150, Spring term Lecture 3

ECON 3150/4150, Spring term Lecture 3 Itroductio Fidig the best fit by regressio Residuals ad R-sq Regressio ad causality Summary ad ext step ECON 3150/4150, Sprig term 2014. Lecture 3 Ragar Nymoe Uiversity of Oslo 21 Jauary 2014 1 / 30 Itroductio

More information

Discrete Orthogonal Moment Features Using Chebyshev Polynomials

Discrete Orthogonal Moment Features Using Chebyshev Polynomials Discrete Orthogoal Momet Features Usig Chebyshev Polyomials R. Mukuda, 1 S.H.Og ad P.A. Lee 3 1 Faculty of Iformatio Sciece ad Techology, Multimedia Uiversity 75450 Malacca, Malaysia. Istitute of Mathematical

More information

Linear Regression Demystified

Linear Regression Demystified Liear Regressio Demystified Liear regressio is a importat subject i statistics. I elemetary statistics courses, formulae related to liear regressio are ofte stated without derivatio. This ote iteds to

More information

Properties and Hypothesis Testing

Properties and Hypothesis Testing Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.

More information

Response Variable denoted by y it is the variable that is to be predicted measure of the outcome of an experiment also called the dependent variable

Response Variable denoted by y it is the variable that is to be predicted measure of the outcome of an experiment also called the dependent variable Statistics Chapter 4 Correlatio ad Regressio If we have two (or more) variables we are usually iterested i the relatioship betwee the variables. Associatio betwee Variables Two variables are associated

More information

There is no straightforward approach for choosing the warmup period l.

There is no straightforward approach for choosing the warmup period l. B. Maddah INDE 504 Discrete-Evet Simulatio Output Aalysis () Statistical Aalysis for Steady-State Parameters I a otermiatig simulatio, the iterest is i estimatig the log ru steady state measures of performace.

More information

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A) REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data

More information

Modified Ratio Estimators Using Known Median and Co-Efficent of Kurtosis

Modified Ratio Estimators Using Known Median and Co-Efficent of Kurtosis America Joural of Mathematics ad Statistics 01, (4): 95-100 DOI: 10.593/j.ajms.01004.05 Modified Ratio s Usig Kow Media ad Co-Efficet of Kurtosis J.Subramai *, G.Kumarapadiya Departmet of Statistics, Podicherry

More information

Week 1, Lecture 2. Neural Network Basics. Announcements: HW 1 Due on 10/8 Data sets for HW 1 are online Project selection 10/11. Suggested reading :

Week 1, Lecture 2. Neural Network Basics. Announcements: HW 1 Due on 10/8 Data sets for HW 1 are online Project selection 10/11. Suggested reading : ME 537: Learig-Based Cotrol Week 1, Lecture 2 Neural Network Basics Aoucemets: HW 1 Due o 10/8 Data sets for HW 1 are olie Proect selectio 10/11 Suggested readig : NN survey paper (Zhag Chap 1, 2 ad Sectios

More information

11 Correlation and Regression

11 Correlation and Regression 11 Correlatio Regressio 11.1 Multivariate Data Ofte we look at data where several variables are recorded for the same idividuals or samplig uits. For example, at a coastal weather statio, we might record

More information

1 Review of Probability & Statistics

1 Review of Probability & Statistics 1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

DERIVING THE 12-LEAD ECG FROM EASI ELECTRODES VIA NONLINEAR REGRESSION

DERIVING THE 12-LEAD ECG FROM EASI ELECTRODES VIA NONLINEAR REGRESSION DERIVING THE 1-LEAD ECG FROM EASI ELECTRODES VIA NONLINEAR REGRESSION 1 PIROON KAEWFOONGRUNGSI, DARANEE HORMDEE 1, Departmet of Computer Egieerig, Faculty of Egieerig, Kho Kae Uiversity 4, Thailad E-mail:

More information

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to:

OBJECTIVES. Chapter 1 INTRODUCTION TO INSTRUMENTATION FUNCTION AND ADVANTAGES INTRODUCTION. At the end of this chapter, students should be able to: OBJECTIVES Chapter 1 INTRODUCTION TO INSTRUMENTATION At the ed of this chapter, studets should be able to: 1. Explai the static ad dyamic characteristics of a istrumet. 2. Calculate ad aalyze the measuremet

More information

TEACHER CERTIFICATION STUDY GUIDE

TEACHER CERTIFICATION STUDY GUIDE COMPETENCY 1. ALGEBRA SKILL 1.1 1.1a. ALGEBRAIC STRUCTURES Kow why the real ad complex umbers are each a field, ad that particular rigs are ot fields (e.g., itegers, polyomial rigs, matrix rigs) Algebra

More information

Support vector machine revisited

Support vector machine revisited 6.867 Machie learig, lecture 8 (Jaakkola) 1 Lecture topics: Support vector machie ad kerels Kerel optimizatio, selectio Support vector machie revisited Our task here is to first tur the support vector

More information

(all terms are scalars).the minimization is clearer in sum notation:

(all terms are scalars).the minimization is clearer in sum notation: 7 Multiple liear regressio: with predictors) Depedet data set: y i i = 1, oe predictad, predictors x i,k i = 1,, k = 1, ' The forecast equatio is ŷ i = b + Use matrix otatio: k =1 b k x ik Y = y 1 y 1

More information

Multilayer perceptrons

Multilayer perceptrons Multilayer perceptros If traiig set is ot liearly separable, a etwork of McCulloch-Pitts uits ca give a solutio If o loop exists i etwork, called a feedforward etwork (else, recurret etwork) A two-layer

More information

Time-Domain Representations of LTI Systems

Time-Domain Representations of LTI Systems 2.1 Itroductio Objectives: 1. Impulse resposes of LTI systems 2. Liear costat-coefficiets differetial or differece equatios of LTI systems 3. Bloc diagram represetatios of LTI systems 4. State-variable

More information

RAINFALL PREDICTION BY WAVELET DECOMPOSITION

RAINFALL PREDICTION BY WAVELET DECOMPOSITION RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,

More information

First, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So,

First, note that the LS residuals are orthogonal to the regressors. X Xb X y = 0 ( normal equations ; (k 1) ) So, 0 2. OLS Part II The OLS residuals are orthogoal to the regressors. If the model icludes a itercept, the orthogoality of the residuals ad regressors gives rise to three results, which have limited practical

More information

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering

CEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio

More information

SNAP Centre Workshop. Basic Algebraic Manipulation

SNAP Centre Workshop. Basic Algebraic Manipulation SNAP Cetre Workshop Basic Algebraic Maipulatio 8 Simplifyig Algebraic Expressios Whe a expressio is writte i the most compact maer possible, it is cosidered to be simplified. Not Simplified: x(x + 4x)

More information

II. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation

II. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation II. Descriptive Statistics D. Liear Correlatio ad Regressio I this sectio Liear Correlatio Cause ad Effect Liear Regressio 1. Liear Correlatio Quatifyig Liear Correlatio The Pearso product-momet correlatio

More information

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter

Mechatronics. Time Response & Frequency Response 2 nd -Order Dynamic System 2-Pole, Low-Pass, Active Filter Time Respose & Frequecy Respose d -Order Dyamic System -Pole, Low-Pass, Active Filter R 4 R 7 C 5 e i R 1 C R 3 - + R 6 - + e out Assigmet: Perform a Complete Dyamic System Ivestigatio of the Two-Pole,

More information

DECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS. Park Road, Islamabad, Pakistan

DECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS. Park Road, Islamabad, Pakistan Mathematical ad Computatioal Applicatios, Vol. 9, No. 3, pp. 30-40, 04 DECOMPOSITION METHOD FOR SOLVING A SYSTEM OF THIRD-ORDER BOUNDARY VALUE PROBLEMS Muhammad Aslam Noor, Khalida Iayat Noor ad Asif Waheed

More information

ME 539, Fall 2008: Learning-Based Control

ME 539, Fall 2008: Learning-Based Control ME 539, Fall 2008: Learig-Based Cotrol Neural Network Basics 10/1/2008 & 10/6/2008 Uiversity Orego State Neural Network Basics Questios??? Aoucemet: Homework 1 has bee posted Due Friday 10/10/08 at oo

More information

Assessment of extreme discharges of the Vltava River in Prague

Assessment of extreme discharges of the Vltava River in Prague Flood Recovery, Iovatio ad Respose I 05 Assessmet of extreme discharges of the Vltava River i Prague M. Holický, K. Jug & M. Sýkora Kloker Istitute, Czech Techical Uiversity i Prague, Czech Republic Abstract

More information

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

Sequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet

More information

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution

Double Stage Shrinkage Estimator of Two Parameters. Generalized Exponential Distribution Iteratioal Mathematical Forum, Vol., 3, o. 3, 3-53 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/.9/imf.3.335 Double Stage Shrikage Estimator of Two Parameters Geeralized Expoetial Distributio Alaa M.

More information

Chapter 4. Fourier Series

Chapter 4. Fourier Series Chapter 4. Fourier Series At this poit we are ready to ow cosider the caoical equatios. Cosider, for eample the heat equatio u t = u, < (4.) subject to u(, ) = si, u(, t) = u(, t) =. (4.) Here,

More information

Simple Linear Regression

Simple Linear Regression Chapter 2 Simple Liear Regressio 2.1 Simple liear model The simple liear regressio model shows how oe kow depedet variable is determied by a sigle explaatory variable (regressor). Is is writte as: Y i

More information

1 Inferential Methods for Correlation and Regression Analysis

1 Inferential Methods for Correlation and Regression Analysis 1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet

More information

A Unified Approach on Fast Training of Feedforward and Recurrent Networks Using EM Algorithm

A Unified Approach on Fast Training of Feedforward and Recurrent Networks Using EM Algorithm 2270 IEEE TRASACTIOS O SIGAL PROCESSIG, VOL. 46, O. 8, AUGUST 1998 [12] Q. T. Zhag, K. M. Wog, P. C. Yip, ad J. P. Reilly, Statistical aalysis of the performace of iformatio criteria i the detectio of

More information

MATHEMATICS. The assessment objectives of the Compulsory Part are to test the candidates :

MATHEMATICS. The assessment objectives of the Compulsory Part are to test the candidates : MATHEMATICS INTRODUCTION The public assessmet of this subject is based o the Curriculum ad Assessmet Guide (Secodary 4 6) Mathematics joitly prepared by the Curriculum Developmet Coucil ad the Hog Kog

More information

Stochastic Simulation

Stochastic Simulation Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso

More information

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015

ECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015 ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],

More information

Control Charts for Mean for Non-Normally Correlated Data

Control Charts for Mean for Non-Normally Correlated Data Joural of Moder Applied Statistical Methods Volume 16 Issue 1 Article 5 5-1-017 Cotrol Charts for Mea for No-Normally Correlated Data J. R. Sigh Vikram Uiversity, Ujjai, Idia Ab Latif Dar School of Studies

More information

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 +

62. Power series Definition 16. (Power series) Given a sequence {c n }, the series. c n x n = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + 62. Power series Defiitio 16. (Power series) Give a sequece {c }, the series c x = c 0 + c 1 x + c 2 x 2 + c 3 x 3 + is called a power series i the variable x. The umbers c are called the coefficiets of

More information

Estimation of Population Mean Using Co-Efficient of Variation and Median of an Auxiliary Variable

Estimation of Population Mean Using Co-Efficient of Variation and Median of an Auxiliary Variable Iteratioal Joural of Probability ad Statistics 01, 1(4: 111-118 DOI: 10.593/j.ijps.010104.04 Estimatio of Populatio Mea Usig Co-Efficiet of Variatio ad Media of a Auxiliary Variable J. Subramai *, G. Kumarapadiya

More information

Linear Associator Linear Layer

Linear Associator Linear Layer Hebbia Learig opic 6 Note: lecture otes by Michael Negevitsky (uiversity of asmaia) Bob Keller (Harvey Mudd College CA) ad Marti Haga (Uiversity of Colorado) are used Mai idea: learig based o associatio

More information

Output Analysis (2, Chapters 10 &11 Law)

Output Analysis (2, Chapters 10 &11 Law) B. Maddah ENMG 6 Simulatio Output Aalysis (, Chapters 10 &11 Law) Comparig alterative system cofiguratio Sice the output of a simulatio is radom, the comparig differet systems via simulatio should be doe

More information

Example 3.3: Rainfall reported at a group of five stations (see Fig. 3.7) is as follows. Kundla. Sabli

Example 3.3: Rainfall reported at a group of five stations (see Fig. 3.7) is as follows. Kundla. Sabli 3.4.4 Spatial Cosistecy Check Raifall data exhibit some spatial cosistecy ad this forms the basis of ivestigatig the observed raifall values. A estimate of the iterpolated raifall value at a statio is

More information

Mixtures of Gaussians and the EM Algorithm

Mixtures of Gaussians and the EM Algorithm Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity

More information

An Introduction to Randomized Algorithms

An Introduction to Randomized Algorithms A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis

More information

The AMSU Observation Bias Correction and Its Application Retrieval Scheme, and Typhoon Analysis

The AMSU Observation Bias Correction and Its Application Retrieval Scheme, and Typhoon Analysis The AMSU Observatio Bias Correctio ad Its Applicatio Retrieval Scheme, ad Typhoo Aalysis Chie-Be Chou, Kug-Hwa Wag Cetral Weather Bureau, Taipei, Taiwa, R.O.C. Abstract Sice most of AMSU chaels have a

More information

CS284A: Representations and Algorithms in Molecular Biology

CS284A: Representations and Algorithms in Molecular Biology CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by

More information

Recurrence Relations

Recurrence Relations Recurrece Relatios Aalysis of recursive algorithms, such as: it factorial (it ) { if (==0) retur ; else retur ( * factorial(-)); } Let t be the umber of multiplicatios eeded to calculate factorial(). The

More information

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2

subject to A 1 x + A 2 y b x j 0, j = 1,,n 1 y j = 0 or 1, j = 1,,n 2 Additioal Brach ad Boud Algorithms 0-1 Mixed-Iteger Liear Programmig The brach ad boud algorithm described i the previous sectios ca be used to solve virtually all optimizatio problems cotaiig iteger variables,

More information

6.003 Homework #3 Solutions

6.003 Homework #3 Solutions 6.00 Homework # Solutios Problems. Complex umbers a. Evaluate the real ad imagiary parts of j j. π/ Real part = Imagiary part = 0 e Euler s formula says that j = e jπ/, so jπ/ j π/ j j = e = e. Thus the

More information

New Correlation for Calculating Critical Pressure of Petroleum Fractions

New Correlation for Calculating Critical Pressure of Petroleum Fractions IARJSET ISSN (Olie) 2393-8021 ISSN (Prit) 2394-1588 Iteratioal Advaced Research Joural i Sciece, Egieerig ad Techology New Correlatio for Calculatig Critical Pressure of Petroleum Fractios Sayed Gomaa,

More information

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,

3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense, 3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [

More information

Accuracy assessment methods and challenges

Accuracy assessment methods and challenges Accuracy assessmet methods ad challeges Giles M. Foody School of Geography Uiversity of Nottigham giles.foody@ottigham.ac.uk Backgroud Need for accuracy assessmet established. Cosiderable progress ow see

More information

Number of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day

Number of fatalities X Sunday 4 Monday 6 Tuesday 2 Wednesday 0 Thursday 3 Friday 5 Saturday 8 Total 28. Day LECTURE # 8 Mea Deviatio, Stadard Deviatio ad Variace & Coefficiet of variatio Mea Deviatio Stadard Deviatio ad Variace Coefficiet of variatio First, we will discuss it for the case of raw data, ad the

More information

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence

A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as

More information

Machine Learning Assignment-1

Machine Learning Assignment-1 Uiversity of Utah, School Of Computig Machie Learig Assigmet-1 Chadramouli, Shridhara sdhara@cs.utah.edu 00873255) Sigla, Sumedha sumedha.sigla@utah.edu 00877456) September 10, 2013 1 Liear Regressio a)

More information

Forecasting SO 2 air pollution in Salamanca, Mexico using an ADALINE.

Forecasting SO 2 air pollution in Salamanca, Mexico using an ADALINE. Iovative Productio Machies ad Systems D.T. Pham, E.E. Eldukhri ad A.J. Soroka (eds) 2008 MEC. Cardiff Uiversity, UK. Forecastig SO 2 air pollutio i Salamaca, Mexico usig a ADALINE. M.G. Cortia a, U.S.

More information

3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials

3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered

More information

Castiel, Supernatural, Season 6, Episode 18

Castiel, Supernatural, Season 6, Episode 18 13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

Algebra of Least Squares

Algebra of Least Squares October 19, 2018 Algebra of Least Squares Geometry of Least Squares Recall that out data is like a table [Y X] where Y collects observatios o the depedet variable Y ad X collects observatios o the k-dimesioal

More information

NUMERICAL METHODS FOR SOLVING EQUATIONS

NUMERICAL METHODS FOR SOLVING EQUATIONS Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:

More information

The axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c.

The axial dispersion model for tubular reactors at steady state can be described by the following equations: dc dz R n cn = 0 (1) (2) 1 d 2 c. 5.4 Applicatio of Perturbatio Methods to the Dispersio Model for Tubular Reactors The axial dispersio model for tubular reactors at steady state ca be described by the followig equatios: d c Pe dz z =

More information

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS

THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS R775 Philips Res. Repts 26,414-423, 1971' THE SYSTEMATIC AND THE RANDOM. ERRORS - DUE TO ELEMENT TOLERANCES OF ELECTRICAL NETWORKS by H. W. HANNEMAN Abstract Usig the law of propagatio of errors, approximated

More information

Rainfall-Runoff Modelling using Modified NRCS-CN,RS and GIS -A Case Study

Rainfall-Runoff Modelling using Modified NRCS-CN,RS and GIS -A Case Study P.Sudara Kumar It. Joural of Egieerig Research ad Applicatios RESEARCH ARTICLE OPEN ACCESS Raifall-Ruoff Modellig usig Modified NRCS-CN,RS ad GIS -A Case Study P.Sudara Kumar*, T.V.Pravee**, M.A.Prasad***

More information

1 of 7 7/16/2009 6:06 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 6. Order Statistics Defiitios Suppose agai that we have a basic radom experimet, ad that X is a real-valued radom variable

More information

Correlation Regression

Correlation Regression Correlatio Regressio While correlatio methods measure the stregth of a liear relatioship betwee two variables, we might wish to go a little further: How much does oe variable chage for a give chage i aother

More information

Evaluation of Accuracy and Efficiency of some Simulation and Sampling Methods in Structural Reliability Analysis

Evaluation of Accuracy and Efficiency of some Simulation and Sampling Methods in Structural Reliability Analysis Waye State Uiversity Civil ad Evirometal Egieerig Faculty Research Publicatios Civil ad Evirometal Egieerig 7-5-2005 Evaluatio of Accuracy ad Efficiecy of some Simulatio ad Samplig Methods i Structural

More information

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course

EE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL

More information

U8L1: Sec Equations of Lines in R 2

U8L1: Sec Equations of Lines in R 2 MCVU U8L: Sec. 8.9. Equatios of Lies i R Review of Equatios of a Straight Lie (-D) Cosider the lie passig through A (-,) with slope, as show i the diagram below. I poit slope form, the equatio of the lie

More information

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random

10. Comparative Tests among Spatial Regression Models. Here we revisit the example in Section 8.1 of estimating the mean of a normal random Part III. Areal Data Aalysis 0. Comparative Tests amog Spatial Regressio Models While the otio of relative likelihood values for differet models is somewhat difficult to iterpret directly (as metioed above),

More information

Robust Default Correlation for Cost Risk Analysis

Robust Default Correlation for Cost Risk Analysis Robust Default Correlatio for Cost Risk Aalysis Christia Smart, Ph.D., CCEA Director, Cost Estimatig ad Aalysis Missile Defese Agecy Preseted at the 03 ICEAA Professioal Developmet ad Traiig Workshop Jue,

More information

Introduction to Signals and Systems, Part V: Lecture Summary

Introduction to Signals and Systems, Part V: Lecture Summary EEL33: Discrete-Time Sigals ad Systems Itroductio to Sigals ad Systems, Part V: Lecture Summary Itroductio to Sigals ad Systems, Part V: Lecture Summary So far we have oly looked at examples of o-recursive

More information

Lecture 2: Monte Carlo Simulation

Lecture 2: Monte Carlo Simulation STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Linear Regression Models

Linear Regression Models Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect

More information

The improvement of the volume ratio measurement method in static expansion vacuum system

The improvement of the volume ratio measurement method in static expansion vacuum system Available olie at www.sciecedirect.com Physics Procedia 32 (22 ) 492 497 8 th Iteratioal Vacuum Cogress The improvemet of the volume ratio measuremet method i static expasio vacuum system Yu Hogya*, Wag

More information

6.867 Machine learning

6.867 Machine learning 6.867 Machie learig Mid-term exam October, ( poits) Your ame ad MIT ID: Problem We are iterested here i a particular -dimesioal liear regressio problem. The dataset correspodig to this problem has examples

More information

6.867 Machine learning, lecture 7 (Jaakkola) 1

6.867 Machine learning, lecture 7 (Jaakkola) 1 6.867 Machie learig, lecture 7 (Jaakkola) 1 Lecture topics: Kerel form of liear regressio Kerels, examples, costructio, properties Liear regressio ad kerels Cosider a slightly simpler model where we omit

More information

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE

Provläsningsexemplar / Preview TECHNICAL REPORT INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE TECHNICAL REPORT CISPR 16-4-3 2004 AMENDMENT 1 2006-10 INTERNATIONAL SPECIAL COMMITTEE ON RADIO INTERFERENCE Amedmet 1 Specificatio for radio disturbace ad immuity measurig apparatus ad methods Part 4-3:

More information

µ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion

µ and π p i.e. Point Estimation x And, more generally, the population proportion is approximately equal to a sample proportion Poit Estimatio Poit estimatio is the rather simplistic (ad obvious) process of usig the kow value of a sample statistic as a approximatio to the ukow value of a populatio parameter. So we could for example

More information

Statistical Fundamentals and Control Charts

Statistical Fundamentals and Control Charts Statistical Fudametals ad Cotrol Charts 1. Statistical Process Cotrol Basics Chace causes of variatio uavoidable causes of variatios Assigable causes of variatio large variatios related to machies, materials,

More information

Chain ratio-to-regression estimators in two-phase sampling in the presence of non-response

Chain ratio-to-regression estimators in two-phase sampling in the presence of non-response ProbStat Forum, Volume 08, July 015, Pages 95 10 ISS 0974-335 ProbStat Forum is a e-joural. For details please visit www.probstat.org.i Chai ratio-to-regressio estimators i two-phase samplig i the presece

More information

CS / MCS 401 Homework 3 grader solutions

CS / MCS 401 Homework 3 grader solutions CS / MCS 401 Homework 3 grader solutios assigmet due July 6, 016 writte by Jāis Lazovskis maximum poits: 33 Some questios from CLRS. Questios marked with a asterisk were ot graded. 1 Use the defiitio of

More information

Mechanical Efficiency of Planetary Gear Trains: An Estimate

Mechanical Efficiency of Planetary Gear Trains: An Estimate Mechaical Efficiecy of Plaetary Gear Trais: A Estimate Dr. A. Sriath Professor, Dept. of Mechaical Egieerig K L Uiversity, A.P, Idia E-mail: sriath_me@klce.ac.i G. Yedukodalu Assistat Professor, Dept.

More information

Probability and statistics: basic terms

Probability and statistics: basic terms Probability ad statistics: basic terms M. Veeraraghava August 203 A radom variable is a rule that assigs a umerical value to each possible outcome of a experimet. Outcomes of a experimet form the sample

More information

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0.

THE SOLUTION OF NONLINEAR EQUATIONS f( x ) = 0. THE SOLUTION OF NONLINEAR EQUATIONS f( ) = 0. Noliear Equatio Solvers Bracketig. Graphical. Aalytical Ope Methods Bisectio False Positio (Regula-Falsi) Fied poit iteratio Newto Raphso Secat The root of

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

CS322: Network Analysis. Problem Set 2 - Fall 2009

CS322: Network Analysis. Problem Set 2 - Fall 2009 Due October 9 009 i class CS3: Network Aalysis Problem Set - Fall 009 If you have ay questios regardig the problems set, sed a email to the course assistats: simlac@staford.edu ad peleato@staford.edu.

More information

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ.

w (1) ˆx w (1) x (1) /ρ and w (2) ˆx w (2) x (2) /ρ. 2 5. Weighted umber of late jobs 5.1. Release dates ad due dates: maximimizig the weight of o-time jobs Oce we add release dates, miimizig the umber of late jobs becomes a sigificatly harder problem. For

More information

Polynomial Functions and Their Graphs

Polynomial Functions and Their Graphs Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively

More information

Infinite Sequences and Series

Infinite Sequences and Series Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet

More information

IP Reference guide for integer programming formulations.

IP Reference guide for integer programming formulations. IP Referece guide for iteger programmig formulatios. by James B. Orli for 15.053 ad 15.058 This documet is iteded as a compact (or relatively compact) guide to the formulatio of iteger programs. For more

More information

GUIDELINES ON REPRESENTATIVE SAMPLING

GUIDELINES ON REPRESENTATIVE SAMPLING DRUGS WORKING GROUP VALIDATION OF THE GUIDELINES ON REPRESENTATIVE SAMPLING DOCUMENT TYPE : REF. CODE: ISSUE NO: ISSUE DATE: VALIDATION REPORT DWG-SGL-001 002 08 DECEMBER 2012 Ref code: DWG-SGL-001 Issue

More information

Summary: CORRELATION & LINEAR REGRESSION. GC. Students are advised to refer to lecture notes for the GC operations to obtain scatter diagram.

Summary: CORRELATION & LINEAR REGRESSION. GC. Students are advised to refer to lecture notes for the GC operations to obtain scatter diagram. Key Cocepts: 1) Sketchig of scatter diagram The scatter diagram of bivariate (i.e. cotaiig two variables) data ca be easily obtaied usig GC. Studets are advised to refer to lecture otes for the GC operatios

More information

Chapter 12 - Quality Cotrol Example: The process of llig 12 ouce cas of Dr. Pepper is beig moitored. The compay does ot wat to uderll the cas. Hece, a target llig rate of 12.1-12.5 ouces was established.

More information