Application of the radial basis function neural network to the prediction of log properties from seismic attributes

Size: px
Start display at page:

Download "Application of the radial basis function neural network to the prediction of log properties from seismic attributes"

Transcription

1 Applicaion of he RBF Applicaion of he radial basis funcion neural newor o he predicion of log properies from seismic aribues Brian H. Russell, Laurence R. Lines, and Daniel P. Hampson ABSTRACT In his paper, we use he radial basis funcion neural newor, or RBF, o predic reservoir log properies from seismic aribues. We also compare he resuls of his approach wih he use of he generalized regression neural newor, GR, for he same problem, as proposed by Hampson e al (00). We discuss boh he heory behind hese mehods and he mehodology involved in applying neural newors o seismic aribues. We hen illusrae he mehod using he Blacfoo 3D seismic volume, a channel sand example from Albera. ITRODUCTIO The predicion of reservoir parameers from seismic daa has radiionally been done using deerminisic mehods, in which we assume a mahemaical model ha relaes our observed seismic daa o he reservoir parameer of ineres, and apply an inverse ransform o our seismic daa based on his model. Such mehods include deconvoluion, pos-sac race inversion, and linearized pre-sac race inversion, or AVO. These mehods are limied by a number of facors, including noise in he seismic daa, incorrec scaling of he seismic daa, and limiing assumpions in he model (for example, we ofen ignore he fac he seismic wavele is ime-varying). There is also a fundamenal ambiguiy in he derivaion of he long period componen of he earh properies if we use he seismic daa alone. To ry o avoid he las problem, we may use inversion mehods which are model-based, in ha hey use an iniial model of he earh compued from more deailed well log measuremens, and hen perurb his model o fi he seismic observaions. In more recen approaches, a saisical, raher han deerminisic, mehod is used o loo for a relaionship beween he seismic daa and he reservoir parameers. These mehods are based on radiional muli-regression, or on neural newors. For example, Ronen e al. (994) proposed he use of he radial basis funcion neural newor (RBF) for he seismic-guided esimaion of log properies. They applied he RBF o averaged inervals from log daa and he corresponding averaged inervals from he 3D seismic daa volumes which were ied by hese logs. In more recen wor (Hampson e al, 00), neural newors were used o predic reservoir log properies from he complee 3D seismic volume, using each log sample over he zone of ineres in he raining phase. In his laer approach, he generalized regression neural newor, or GR, was used for he predicion of log properies, alhough his mehod was referred o in his paper as he probabilisic neural newor, or P. (As we will see in he following heory secion he P approach is a classificaion echnique which is he basis upon which he GR mehod is buil). In his paper, we exend he RBF mehod o he compuaion of log properies from he full 3D seismic volume, and show he relaionship beween he RBF and GR mehods. Alhough boh mehods are based on he applicaion of Gaussian Hampson-Russell Sofware Services Ld, 50, 75 5 h Avenue SW, Calgary, Albera, TP X6 CREWES Research Repor Volume 4 (00)

2 Russell, Lines, and Hirsche weighing funcions o disances measured in muliple seismic aribue space, hey are quie disinc in heir calculaion of he final resul. Following a discussion of he heory behind he neural newor echniques used here, we will discuss he mehodology for applying he mehods o seismic daa and hen illusrae he mehods wih a channel sand case sudy from Albera. ITRODUCTIO TO EURAL ETWORKS Firs of all, wha is a neural newor? The simples answer is ha a neural newor is a mahemaical algorihm ha can be rained o solve a problem ha would normally require human inervenion. Alhough here are many differen ypes of neural newors, here are wo ways in which hey are caegorized: by he ype of problem ha hey can solve and by heir ype of learning. eural newor applicaions in seismic daa analysis generally fall ino one of wo caegories: he classificaion problem, or he predicion problem. In he classificaion problem, we assign an inpu sample o one of several oupu classes, such as sand, shale, limesone ec, whereas in he predicion problem we assign a specific value o he oupu sample, such as a porosiy value. A companion paper in his volume (Russell e al, 00) discusses he applicaion of wo differen neural newors, he muli-layer percepron (MLP) and he radial basis funcion neural newor (RBF) o a sraighforward AVO classificaion problem. In his paper, we will be concerned wih he predicion problem, specifically he predicion of P-wave velociy from seismic aribues. eural newors can also be classified by he way hey are rained, using eiher supervised or unsupervised learning. In supervised learning he neural newor sars wih a raining daase for which we now boh he inpu and oupu values. The neural newor algorihm hen learns he relaionship beween he inpu and oupu from his raining daase, and finally applies he learned relaionship o a larger daase for which we do no now he oupu values. Examples of he supervised learning approach are he MLP, he P, he GR, and he RBF, of which he laer hree mehods will be used oday. In unsupervised learning, we presen he neural newor wih a series of inpus and le he neural newor loo for paerns iself. Tha is, he specific oupus are no required. The advanage of his approach is ha we do no need o now he answer in advance. This disadvanage is ha i is ofen difficul o inerpre he oupu. An example of his ype of unsupervised echnique is he Kohonen Self Organizing Map (KSOM) (Kohonen, 00). THEORY As menioned in he las secion, in his paper we will be using neural newors o perform he supervised predicion of reservoir parameers. Our raining daase will consis of a se of nown raining samples i, which in our case will be some well log derived reservoir parameer such as V P, SP, S W, ec. Each raining sample, which is a scalar quaniy, is in urn dependan on a vecor of L seismic aribue values, correlaed in ime wih he raining samples. (The issues of which seismic aribues o use and how o opimize he correlaion beween he raining samples and he seismic daa are CREWES Research Repor Volume 4 (00)

3 Applicaion of he RBF hemselves difficul problems, and will be deal wih in he nex secion.) These seismic aribue vecors can be wrien s i (s i, s i,, s il ) T, i,,,. The obecive of our neural newor is o find some funcion y such ha: y(s i ) i, i,,, () Once his funcion has been found, i can be applied o an arbirary se of M seismic aribue vecors x,,,, M, where he aribues in he x vecors are idenical o hose in he s i vecors. This is illusraed in Figure for wo arbirary raining samples and a single applicaion sample. The ey poin o noe is ha we now he oupu sample for he raining vecors, bu are predicing an oupu sample for he applicaion vecors. (We have chosen o use a differen leer o represen he raining and applicaion daa vecors o emphasize he fundamenal difference beween hem, and also o laer clarify he difference beween RBF and GR mehods. In mos exboos his is handled simply by varying he subscrips on he daa vecors.) FIG. : A schemaic illusraion of he differences beween he raining vecors, s i and s, in which he oupu samples i and are nown and are used in he raining process, and he applicaion vecor x, in which he oupu sample y is no nown. Before discussing he RBF and GR algorihms, we will firs discuss he simpler P algorihm. The P algorihm is based on he concep of disance in aribue space. To beer undersand his concep, consider Figure, in which we have drawn, in graphical form, he hree arbirary wo-dimensional seismic aribue vecors shown in Figure. oe ha disance on hese graphs is aribue ampliude raher han Caresian disance. Recall ha wo of hese vecors are from he raining daase (s i and s ) and one is from he applicaion daase (x ). CREWES Research Repor Volume 4 (00) 3

4 Russell, Lines, and Hirsche FIG. : A schemaic graph of he vecors, s i, s, and x, from Figure, where he coordinae axes represen aribue ampliude raher han Caresian disance. We can define he hree possible disances beween hese vecors, as displayed in Figure. These are given by d i i s ( si s ) + ( si s ) s, and d d i i x si x ) + ( si x ) s, x ( s x ) + ( s x ) s. I is imporan o disinguish wo fundamenally differen ypes of aribue disance in he above equaions. The d i disance can be called he iner-raining disance and he d i and d disances can be called applicaion disances. (oe ha his erminology is unique o his paper, since we feel ha his concep is crucial o he undersanding of he hree mehods of P, GR, and RBF.) A second imporan concep is ha i is no he disances hemselves ha will be used in our neural newor applicaions, bu some funcion of he disances, ϕ(d), called a basis funcion. Alhough here have been a number of forms proposed for he basis funcion (Bishop, 995), he mos common form, and he one we will be using in his paper, is he Gaussian funcion, which can be wrien as d ( d ) exp, () σ where σ is a smoohness parameer. oice ha σ can also be inerpreed as he variance of a Gaussian disribuion cenered on d. Thus, as we decrease σ, he widh of he 4 CREWES Research Repor Volume 4 (00)

5 Applicaion of he RBF disribuion becomes narrower. The P is hen defined for each of he x poins as he sum over all he possible ( d ) funcions, or x s p ( x ) exp,,,, M (3) σ If we use all he poins in he raining daase, P will resul in a single number, which will be used laer as a normalizing facor in he GR mehod, bu does no on is own give us a very useful discriminaion echnique. However, if we brea he raining poins ino a number of classes, P becomes a very good classificaion mehod. In fac, i can be hough of as an implemenaion of Bayes Theorem. Le s consider he simples case, ha of wo classes. If we have class C wih poins, and class C wih poins, where +, hen we can define and p x (4) ( ), p x. (5) ( ) The p values can be inerpreed as he probabiliy of membership in a class. Tha is, if p (x ) > p (x ), hen x is a member of class C, or, if p (x ) < p (x ), hen x is a member of class C. This can be generalized o any number of classes. ex, we will see how he GR can be hough of as an exension of P. A well nown resul from saisical heory is ha he condiional expecaion of a coninuous scalar variable y given a coninuous vecor x can be wrien as - EY X ( x ) (6) f ( x, y )dy - yf X Y X Y ( x, y )dy Transforming he coninuous form seen in equaion (6) o he discree form of he probabiliy funcion ha we are using here (Masers, 995), gives x s x s exp exp σ σ y( x ),,,,M, (7) x p( ) s x exp σ Equaion (7) is nown in saisical esimaion heory as he adaraya-wason esimaor (adaraya, 964; Wason, 964), and was re-discovered in he conex of neural newors by Spech (990) and named he generalized regression neural newor, CREWES Research Repor Volume 4 (00) 5

6 Russell, Lines, and Hirsche or GR. This name is due o he fac ha he raining values hemselves are weigh values and hus his is indeed a ype of generalized regression. oe ha he normalizaion facor in he denominaor of equaion (7) is he P esimae of he complee raining daase. We can also observe how well his equaion wors on he raining daa by re-wriing equaion (7) using he raining daa, or si s exp σ y( s i ), i,,,. (8) p( s ) i s s exp σ i i oice ha he fi will be quie good since, when i, exp[ 0] Anoher way o chec he effeciveness of his mehod is by cross-validaion, where we leave each well in urn ou of he predicion, predic is values blindly, and hen compue he error wih he nown values. This will be discussed more fully in he nex secion. Equaion (8) also gives us a saring poin for undersanding he RBF approach, which was originally developed as a mehod for performing exac inerpolaion of a se of daa poins in muli-dimensional space (Powell, 987). In his mehod, we also use Gaussian basis funcions. However, insead of calculaing he weighing values on he fly using he raining samples, we compue he weighs iniially from he raining daa using he equaion s i s ( s i ) w exp w i, i,,,. (9) σ Equaion (9) can be derived from basic principles using he heory of regularizaion, which also involves he inroducion of pseudo-differenial operaors (Poggio and Girosi, 990), bu will no be derived here. To solve equaion (9), noice ha i can be wrien as a se of equaions in unnowns, or. w w w + w + w + w + + w + + w + + w (0) Equaion (0) can be wrien more compacly as he marix equaion: Φ w, () 6 CREWES Research Repor Volume 4 (00)

7 Applicaion of he RBF CREWES Research Repor Volume 4 (00) 7 where and, w w, # $ # Φ w. The soluion o equaion () is simply he marix inverse [ ], λ w + Ι Φ () where λ is a pre-whiening facor and I is he ideniy marix. This equaion can be solved efficienly by noing ha he marix is symmeric. Once he weighs have been compued, hey are applied o he applicaion daase using,m,,, σ exp w ) y( s x x. (3) oe ha equaion (3) can be hough of as he general form of boh RBF and GR if we rewrie he weighs in he GR case as ) p( σ exp w x s x. (4) This observaion will allow us o examine he relaionship beween RBF and GR. If we assume ha he scaling facors σ are he same in boh mehods and ha p(x ), hen, o equae he wo mehods, we simply need o loo a he relaionship beween and w.. By expanding equaion (), we ge λ λ λ w w w # $ # # # $ # # (5) where i i σ exp s s, and i is an elemen of he invered marix. Thus, we find ha: i w (6)

8 Russell, Lines, and Hirsche In oher words, w is a weighed sum of all he raining values. If he invered marix consised only of values along he main diagonal, we could rewrie he above equaion as w (7) If his is he case,φ would consis only of he values along he main diagonal. Bu noe ha s s exp σ Thus, Φ I, he ideniy marix, and Φ I also. Therefore, for his rivial case, he RBF and GR mehods are idenical o a scale facor. This would occur in wo siuaions: () si s 0, for all i and, and () σ 0 In he more general case, he off-diagonal elemens in he covariance marix are all non-zero. Indeed, hey will only be equal o zero for he case in which he seismic aribues are saisically independen. Thus, we can hin of he GR mehod as a subse of he RBF mehod for he case of saisical independence of he aribues. We would herefore expec he RBF mehod o give a more high resoluion resul han he GR mehod, since he off-diagonal covariance elemens are being used. As we shall see in our case sudy, his is indeed he case. METHODOLOGY The mehodology for reservoir predicion using muliple seismic aribues has been exensively covered by Hampson e al (00) and will only be briefly reviewed here. The wo ey problems in he analysis can be summarized as follows: which aribues should we use, and which of hese aribues are saisically significan? To sar he process, we compue as many aribues as possible. These aribues can be he classical insananeous aribues of Taner e al. (974), frequency and absorpion aribues based on windowed esimaes along he seismic race, inegraed seismic ampliudes, model-based race inversion, or AVO inercep and gradien. Once hese aribues have been compued and sored, we measure a goodness of fi beween he aribues and he raining samples from he logs. Using he noaion of he previous secion, we can compue his goodness of fi by minimizing he leas-squares error given by E ( i w0 wsi wlsli ). (8) i oe ha he weighs can also be convoluional, as discussed by Hampson e al. (00), which is equivalen o inroducing a new se of ime-shifed aribues. The aribues o use in he neural newor compuaions, and heir order is hen found by a echnique called sepwise regression, which consiss of he following seps: 8 CREWES Research Repor Volume 4 (00)

9 Applicaion of he RBF () Find he bes aribue by an exhausive search of all he aribues, using equaion () o compue he predicion error for each aribue (i.e. L ) and choosing he aribue wih he lowes error. () Find he bes pair of aribues from all combinaions of he firs aribue and one oher. Again, he bes pair is he pair ha has he lowes predicion error from equaion (8), wih L. (3) Find he bes riple, using he pair from sep () and combining hem wih each oher aribue. (4) Coninue he process as long as desired. This will give us a se of aribues ha is guaraneed o reduce he oal error as he number of aribues goes up. So, when do we sop? This is done using a echnique called cross-validaion, in which we leave ou a raining sample and hen predic i from he oher samples. We hen re-compue he error using equaion (8), bu his ime from he raining sample ha was lef ou. We repea his procedure for all he raining samples, and average he error, giving us a oal validaion error. This compuaion is done as a funcion of he number of aribues, and he resuling graph usually shows an increase in validaion error pas some small number of aribues such as five or six. In acual fac, we do no perform his procedure for all samples, bu raher on a well by well basis. The nex secion will give an illusraion of his procedure. One final poin o discuss is he opimizaion of he sigma values. The firs poin o observe is ha, in genera, he opimum sigma value for he GR mehod will be differen han he opimum value for he RBF mehod. A second imporan poin is ha, for he GR mehod, we also deermine a differen sigma value for each aribue. This could be inroduced in equaion (3) or (7) by changing he erm o ( x s ) ( x s ) ( x s ) L L exp + + +, σ σ σ L where L is equal o he number of aribues. The opimizaion echnique used for GR is described by Masers (995). A CHAEL SAD CASE STUDY We will now illusrae our mehodology using a channel sand case sudy from Albera, as discussed earlier by Russell e al. (00). This sudy involved he predicion of porosiy in he Blacfoo field of cenral Albera. A 3C-3D seismic survey was recorded in Ocober 995, wih he primary arge being he Glauconiic member of he Mannville group. The reservoir occurs a a deph of around 550 m, where Glauconiic sand and shale fill valleys incised ino he regional Mannville sraigraphy. The obecives of he survey were o delineae he channel and disinguish beween sand-fill and shale-fill. The well log inpu consised of welve wells, each wih sonic, densiy, and calculaed porosiy logs, shown in Figure 3. CREWES Research Repor Volume 4 (00) 9

10 Russell, Lines, and Hirsche FIG 3: The figure above shows he disribuion of wells wihin he 3D seismic survey, as well as seismic inline 95, shown in Figure 4. One of he lines from he 3D survey, inline 95, is indicaed on Figure 3, and shown in Figure 4. Figure 4(a) shows he saced seismic daa iself, and Figure 4(b) shows he invered impedance, which was invered using a model-based inversion approach. The P-wave sonic log from well has been insered a cross-line 5, and shows he exra resoluion presen in a well log. We are going o use he P-wave sonic as our arge on which o rain he seismic aribues. This daase was also used by Hampson e al. (00) o illusrae heir approach o muli-aribue predicion using he GR neural newor. They obained excellen resuls using all welve wells in heir analysis. However, in his sudy, we wish o also see how he use of a subse of he oal number of wells will affec he final resul. We will sar by using all he wells in he raining, as well as a convoluional operaor lengh of seven poins and seven possible aribues. The resuls of he raining are shown in Figure 5, where Figure 5(a) shows he aribues ha were seleced by he raining procedure. oe ha, as we would expec, he inversion aribue has he bes correlaion. Figure 5(b) hen shows he resuls of cross-validaion. This ells us ha only he firs 4 aribues are saisically significan. 0 CREWES Research Repor Volume 4 (00)

11 Applicaion of he RBF (a) FIG. 4: The figure above shows inline 95 from he 3D seismic survey, wih he P-wave sonic from well overlain a cross-line 5 (see Figure 3), where (a) shows he final CDP sac, and (b) shows he invered impedance inversion. (b) CREWES Research Repor Volume 4 (00)

12 Russell, Lines, and Hirsche (a) FIG 5: The figure above shows he resul of raining he muli-aribue algorihm using all welve wells, where (a) shows he bes seven aribues, as chosen by sep-wise regression, and (b) shows he resul of cross-validaion, which indicaes ha only he firs four aribues are saisically significan. (b) ex, we will use he GR and RBF algorihms o predic he P-wave velociy. Figure 6 shows he resul of applying he GR algorihm he predicion of P-wave velociy, using all welve wells in he raining. From he analysis shown in Figure 5; his involved using he firs four aribues from he able in Figure 5(a). In Figure 6, which shows only four of he welve wells, noice ha we see an excellen fi beween he original and modeled logs. As seen a he op of he figure, we ge an excellen correlaion coefficien of and an average error of 79 m/s. Figure 7 hen shows he resul of applying he RBF algorihm o he same se of four aribues used in he GR approach, again using all welve wells in he raining. The resul is close o ha seen in Figure 6, alhough he fi is no quie as good, eiher visually or in erms of he correlaion coefficien (0.836) or he average error (96 m/s). CREWES Research Repor Volume 4 (00)

13 Applicaion of he RBF FIG. 6: Applicaion of he GR algorihm o four of he P-wave sonic logs in he welve log suie, where all he raining samples are used in he predicion. FIG. 7: Applicaion of he RBF algorihm o four of he P-wave sonic logs in he welve log suie, where all he raining samples are used in he predicion. ex, we loo a he cross-validaion plos, in which we will leave he prediced well ou of he raining. This is shown in Figure 8 for he GR algorihm and in Figure 9 for he RBF algorihm. In boh plos, he fi is no as good as i was when we used all he wells in he raining, as we would expec. Again, we also see a slighly beer resul for he GR algorihm, boh visually and analyically. oe ha correlaion coefficien for CREWES Research Repor Volume 4 (00) 3

14 Russell, Lines, and Hirsche GR is , compared wih a value of for RBF, and he average error is 73 m/s compared wih 90 m/s. FIG. 8: Validaion of he four P-wave sonic logs from Figure 6 using he GR algorihm, where he prediced well has been lef ou of he raining. FIG. 9: Validaion of he four P-wave sonic logs from Figure 7 using he RBF algorihm, where he prediced well has been lef ou of he raining. Alhough i would appear ha GR has done a slighly beer ob han RBF form our analysis of he predicion of he well logs, le s see how he algorihms compare when 4 CREWES Research Repor Volume 4 (00)

15 Applicaion of he RBF we loo a he applicaion o real seismic daa. This is shown in Figures 0 and, where Figure 0 shows he applicaion of he GR algorihm and Figure shows he applicaion of he RBF algorihm. I is clear from hese figures ha he RBF approach has inroduced a lo more frequency conen ino he final resul han he GR approach. And his high frequency conen appears o be realisic, since here is laeral coninuiy o he exra evens ha appear on he secion. FIG. 0: Applicaion of he GR algorihm o line 95 of he 3D volume, afer raining using all he wells. FIG. : Applicaion of he RBF algorihm o line 95 of he 3D volume, afer raining wih all he wells. ex, le us repea he same analysis, bu using fewer wells in he raining. Figure shows he resuls of he raining, where Figure (a) shows he bes five aribues chosen by he sep-wise regression algorihm discussed earlier, and Figure (b) shows ha only CREWES Research Repor Volume 4 (00) 5

16 Russell, Lines, and Hirsche he firs four aribues are saisically significan, based on cross-validaion. Wha is ineresing o noe in Figure (b) is ha he error on he las aribue shoos up almos verically. I is herefore imporan o only use he firs four aribues. (a) (b) FIG. : The figure above shows he resul of raining he muli-aribue algorihm using only hree wells, where (a) shows he bes five aribues, as chosen by sep-wise regression, and (b) shows he resul of cross-validaion, which indicaes ha only he firs four aribues are saisically significan. We will now loo a he resuls of applying he raining from all hree wells o he wells hemselves, which is shown in Figure 3 for he GR algorihm and in Figure 4 for he RBF algorihm. oe ha he visual mach is almos he same for boh mehods, as are he correlaion coefficiens and average error. I acual fac, RBF has done slighly beer han GR in he average error (30.7 m/s vs 34. m/s) and slighly worse for he correlaion coefficien (0.760 vs 0.763). However, when we loo a he validaion resuls in Figures 5 and 6, RBF has definiely done beer han GR, wih an average error of m/s agains 63.89, and a correlaion coefficien of 0.68 agains for GR.. 6 CREWES Research Repor Volume 4 (00)

17 Applicaion of he RBF FIG. 3: Applicaion of he GR algorihm o he hree P-wave sonic logs used in he raining, where all he raining samples are used in he predicion. FIG. 4: Applicaion of he RBF algorihm o he hree P-wave sonic logs used in he raining, where all he raining samples are used in he predicion. CREWES Research Repor Volume 4 (00) 7

18 Russell, Lines, and Hirsche FIG. 5: Validaion of he GR algorihm o he hree P-wave sonic logs used in he raining, where he each log has been lef ou of he raining. FIG. 6: Validaion of he RBF algorihm o he hree P-wave sonic logs used in he raining, where he each log has been lef ou of he raining. Finally, we will apply he resuls of he raining o he 3D seismic daase iself. Figure 7 shows he applicaion of he GR mehod o he seismic daa. oice ha he frequency conen of he resul is very low. However, when we apply he RBF mehod, as shown in Figure 8, much more high frequency deail has come hrough. We would 8 CREWES Research Repor Volume 4 (00)

19 Applicaion of he RBF herefore conclude ha, as he number of wells in our raining daase goes down, he RBF algorihm becomes preferable o he GR algorihm FIG. 7: Applicaion of he GR algorihm o line 95 of he 3D volume, afer raining using only hree of he wells. FIG. 8: Applicaion of he RBF algorihm o line 95 of he 3D volume, afer raining using only hree of he wells. COCLUSIOS In his paper, we have compared several neural newor approaches for he predicion of log properies using muliple seismic aribues. These mehods consised of he generalized regression neural newor, or GR, and he radial basis funcion neural newor, or RBF. In he heory secion, we showed how boh of hese mehods are based on Gaussian basis funcions of disance in aribue space, and boh can be developed from he probabilisic neural newor, or P. The ey difference beween CREWES Research Repor Volume 4 (00) 9

20 Russell, Lines, and Hirsche GR and RBF is ha he GR predicion is a weighed sum of he basis funcions and he raining values, whereas in he RBF he weighs are pre-compued using a generalized marix inversion of he basis funcions weighed by he raining values. Afer a discussion of he mehodology used in finding he bes se of aribues, and hose aribues ha are saisically significan, we applied he wo mehods o a channel sand case sudy from Albera. We firs did he raining using all welve wells in he sudy area. The resuls of he raining showed he GR was marginally beer han RBF in predicing he well log values, boh using all he raining wells and in he cross-validaion ess. This was quanified by looing a he raining error and correlaion coefficien values. However, when we applied he raining o he seismic daase, he RBF mehod produced high frequency resuls han he GR mehod, wih good laeral coninuiy. We hen applied he mehods using only hree of he wells in he raining phase, he resuls were differen. In his case, he RBF mehod was quaniaively beer han he GR mehod, for boh he full applicaion and cross-validaion resuls. Tha is, he raining error was smaller and correlaion coefficien larger. The effec on he seismic daa was even more dramaic. The applicaion of he RBF mehod displayed much higher frequency conen on he seismic daa han he applicaion of he GR mehod. Our conclusion is herefore ha, as he number of wells in he raining daase goes down, RBF provides a beer echnique for predicing log properies from seismic aribues, boh in he fi a he raining wells and in he applicaion o he seismic. As he number of wells increases, he wo mehods produce fairly consisen resuls, wih GR doing a slighly beer ob of predicing he raining wells, and RBF doing a beer ob of brining ou he high frequencies in he seismic daa. FUTURE WORK Fuure wor will involve research ino alernae forms of neural newors ha can be applied o his problem, and a search for a faser algorihm o solve for he opimum sigma value in he RBF mehod. ACKOWLEDGEMETS We wish o han our colleagues a he CREWES Proec and a Hampson-Russell Sofware for heir suppor and ideas, as well as he sponsors of he CREWES Proec. REFERECES Bishop, C.M., 995, eural ewors for Paern Recogniion: Oxford Universiy Press, Oxford, UK. Hampson, D., Schuele, J.S., and Quirein, J.A., 00, Use of muliaribue ransforms o predic log properies from seismic daa: Geophysics, 66, 0-3. Kohonen, T., 00, Self Organizing Maps: Springer Series in Informaion Sciences, 0, Springer Verlag, Berlin. Masers, T., 995, Advance Algorihms for eural ewors, John Wiley and Sons, Inc. adaraya, E.A., 964, On esimaing regression: Theory of Probabiliy and is Applicaions 9 (), CREWES Research Repor Volume 4 (00)

21 Applicaion of he RBF Poggio, T., and Girosi, F., 990, ewors for approximaion and learning: Proceedings of he IEEE 78 (9), Powell, M.J.D., 987, Radial basis funcions for mulivariable inerpolaion: a review. In J.C. Mason and M.G. Cox (Eds.), Algorihms for Approximaion, Oxford: Clarendon Press. Ronen, S., Schulz, P.S., Haori, M., and Corbe, C., 994, Seismic-guided esimaion of log properies, Pars,, and 3: The Leading Edge, 3, , , and Russell, B., Hampson D.P., Lines L.R., and Todorov, T., 00 Combining geosaisics and muliaribue ransforms A channel sand case sudy, CREWES Research Repor 3, Russell, B.H, Lines, L.R., and Ross, C.P., 00, AVO classificaion using neural newors: A comparison of wo mehods: CREWES Research Repor 4, his volume. Spech, D.F., 990, Probabilisic neural newors: eural ewors 3 (), Taner, M. T., Koehler, F. and Sheriff, R. E., 979, Complex seismic race analysis: Geophysics, 44, Wason, G.S., 964, Smooh regression analysis: Sanhya, he Indian Journal of Saisics. Series A 6, CREWES Research Repor Volume 4 (00)

Vehicle Arrival Models : Headway

Vehicle Arrival Models : Headway Chaper 12 Vehicle Arrival Models : Headway 12.1 Inroducion Modelling arrival of vehicle a secion of road is an imporan sep in raffic flow modelling. I has imporan applicaion in raffic flow simulaion where

More information

GMM - Generalized Method of Moments

GMM - Generalized Method of Moments GMM - Generalized Mehod of Momens Conens GMM esimaion, shor inroducion 2 GMM inuiion: Maching momens 2 3 General overview of GMM esimaion. 3 3. Weighing marix...........................................

More information

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles

Diebold, Chapter 7. Francis X. Diebold, Elements of Forecasting, 4th Edition (Mason, Ohio: Cengage Learning, 2006). Chapter 7. Characterizing Cycles Diebold, Chaper 7 Francis X. Diebold, Elemens of Forecasing, 4h Ediion (Mason, Ohio: Cengage Learning, 006). Chaper 7. Characerizing Cycles Afer compleing his reading you should be able o: Define covariance

More information

Notes on Kalman Filtering

Notes on Kalman Filtering Noes on Kalman Filering Brian Borchers and Rick Aser November 7, Inroducion Daa Assimilaion is he problem of merging model predicions wih acual measuremens of a sysem o produce an opimal esimae of he curren

More information

Georey E. Hinton. University oftoronto. Technical Report CRG-TR February 22, Abstract

Georey E. Hinton. University oftoronto.   Technical Report CRG-TR February 22, Abstract Parameer Esimaion for Linear Dynamical Sysems Zoubin Ghahramani Georey E. Hinon Deparmen of Compuer Science Universiy oftorono 6 King's College Road Torono, Canada M5S A4 Email: zoubin@cs.orono.edu Technical

More information

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H.

ACE 562 Fall Lecture 5: The Simple Linear Regression Model: Sampling Properties of the Least Squares Estimators. by Professor Scott H. ACE 56 Fall 005 Lecure 5: he Simple Linear Regression Model: Sampling Properies of he Leas Squares Esimaors by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Inference in he Simple

More information

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II

Zürich. ETH Master Course: L Autonomous Mobile Robots Localization II Roland Siegwar Margaria Chli Paul Furgale Marco Huer Marin Rufli Davide Scaramuzza ETH Maser Course: 151-0854-00L Auonomous Mobile Robos Localizaion II ACT and SEE For all do, (predicion updae / ACT),

More information

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle

Physics 235 Chapter 2. Chapter 2 Newtonian Mechanics Single Particle Chaper 2 Newonian Mechanics Single Paricle In his Chaper we will review wha Newon s laws of mechanics ell us abou he moion of a single paricle. Newon s laws are only valid in suiable reference frames,

More information

Linear Response Theory: The connection between QFT and experiments

Linear Response Theory: The connection between QFT and experiments Phys540.nb 39 3 Linear Response Theory: The connecion beween QFT and experimens 3.1. Basic conceps and ideas Q: How do we measure he conduciviy of a meal? A: we firs inroduce a weak elecric field E, and

More information

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin

ACE 562 Fall Lecture 4: Simple Linear Regression Model: Specification and Estimation. by Professor Scott H. Irwin ACE 56 Fall 005 Lecure 4: Simple Linear Regression Model: Specificaion and Esimaion by Professor Sco H. Irwin Required Reading: Griffihs, Hill and Judge. "Simple Regression: Economic and Saisical Model

More information

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t

R t. C t P t. + u t. C t = αp t + βr t + v t. + β + w t Exercise 7 C P = α + β R P + u C = αp + βr + v (a) (b) C R = α P R + β + w (c) Assumpions abou he disurbances u, v, w : Classical assumions on he disurbance of one of he equaions, eg. on (b): E(v v s P,

More information

STATE-SPACE MODELLING. A mass balance across the tank gives:

STATE-SPACE MODELLING. A mass balance across the tank gives: B. Lennox and N.F. Thornhill, 9, Sae Space Modelling, IChemE Process Managemen and Conrol Subjec Group Newsleer STE-SPACE MODELLING Inroducion: Over he pas decade or so here has been an ever increasing

More information

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé

Bias in Conditional and Unconditional Fixed Effects Logit Estimation: a Correction * Tom Coupé Bias in Condiional and Uncondiional Fixed Effecs Logi Esimaion: a Correcion * Tom Coupé Economics Educaion and Research Consorium, Naional Universiy of Kyiv Mohyla Academy Address: Vul Voloska 10, 04070

More information

Dimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2

Dimitri Solomatine. D.P. Solomatine. Data-driven modelling (part 2). 2 Daa-driven modelling. Par. Daa-driven Arificial di Neural modelling. Newors Par Dimiri Solomaine Arificial neural newors D.P. Solomaine. Daa-driven modelling par. 1 Arificial neural newors ANN: main pes

More information

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms

L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS. NA568 Mobile Robotics: Methods & Algorithms L07. KALMAN FILTERING FOR NON-LINEAR SYSTEMS NA568 Mobile Roboics: Mehods & Algorihms Today s Topic Quick review on (Linear) Kalman Filer Kalman Filering for Non-Linear Sysems Exended Kalman Filer (EKF)

More information

Matlab and Python programming: how to get started

Matlab and Python programming: how to get started Malab and Pyhon programming: how o ge sared Equipping readers he skills o wrie programs o explore complex sysems and discover ineresing paerns from big daa is one of he main goals of his book. In his chaper,

More information

Lecture 33: November 29

Lecture 33: November 29 36-705: Inermediae Saisics Fall 2017 Lecurer: Siva Balakrishnan Lecure 33: November 29 Today we will coninue discussing he boosrap, and hen ry o undersand why i works in a simple case. In he las lecure

More information

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis

Speaker Adaptation Techniques For Continuous Speech Using Medium and Small Adaptation Data Sets. Constantinos Boulis Speaker Adapaion Techniques For Coninuous Speech Using Medium and Small Adapaion Daa Ses Consaninos Boulis Ouline of he Presenaion Inroducion o he speaker adapaion problem Maximum Likelihood Sochasic Transformaions

More information

Chapter 2. First Order Scalar Equations

Chapter 2. First Order Scalar Equations Chaper. Firs Order Scalar Equaions We sar our sudy of differenial equaions in he same way he pioneers in his field did. We show paricular echniques o solve paricular ypes of firs order differenial equaions.

More information

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source

Multi-scale 2D acoustic full waveform inversion with high frequency impulsive source Muli-scale D acousic full waveform inversion wih high frequency impulsive source Vladimir N Zubov*, Universiy of Calgary, Calgary AB vzubov@ucalgaryca and Michael P Lamoureux, Universiy of Calgary, Calgary

More information

Two Coupled Oscillators / Normal Modes

Two Coupled Oscillators / Normal Modes Lecure 3 Phys 3750 Two Coupled Oscillaors / Normal Modes Overview and Moivaion: Today we ake a small, bu significan, sep owards wave moion. We will no ye observe waves, bu his sep is imporan in is own

More information

10. State Space Methods

10. State Space Methods . Sae Space Mehods. Inroducion Sae space modelling was briefly inroduced in chaper. Here more coverage is provided of sae space mehods before some of heir uses in conrol sysem design are covered in he

More information

Some Basic Information about M-S-D Systems

Some Basic Information about M-S-D Systems Some Basic Informaion abou M-S-D Sysems 1 Inroducion We wan o give some summary of he facs concerning unforced (homogeneous) and forced (non-homogeneous) models for linear oscillaors governed by second-order,

More information

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes

23.2. Representing Periodic Functions by Fourier Series. Introduction. Prerequisites. Learning Outcomes Represening Periodic Funcions by Fourier Series 3. Inroducion In his Secion we show how a periodic funcion can be expressed as a series of sines and cosines. We begin by obaining some sandard inegrals

More information

An introduction to the theory of SDDP algorithm

An introduction to the theory of SDDP algorithm An inroducion o he heory of SDDP algorihm V. Leclère (ENPC) Augus 1, 2014 V. Leclère Inroducion o SDDP Augus 1, 2014 1 / 21 Inroducion Large scale sochasic problem are hard o solve. Two ways of aacking

More information

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t...

t is a basis for the solution space to this system, then the matrix having these solutions as columns, t x 1 t, x 2 t,... x n t x 2 t... Mah 228- Fri Mar 24 5.6 Marix exponenials and linear sysems: The analogy beween firs order sysems of linear differenial equaions (Chaper 5) and scalar linear differenial equaions (Chaper ) is much sronger

More information

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED

0.1 MAXIMUM LIKELIHOOD ESTIMATION EXPLAINED 0.1 MAXIMUM LIKELIHOOD ESTIMATIO EXPLAIED Maximum likelihood esimaion is a bes-fi saisical mehod for he esimaion of he values of he parameers of a sysem, based on a se of observaions of a random variable

More information

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD

PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD PENALIZED LEAST SQUARES AND PENALIZED LIKELIHOOD HAN XIAO 1. Penalized Leas Squares Lasso solves he following opimizaion problem, ˆβ lasso = arg max β R p+1 1 N y i β 0 N x ij β j β j (1.1) for some 0.

More information

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds

Kriging Models Predicting Atrazine Concentrations in Surface Water Draining Agricultural Watersheds 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Kriging Models Predicing Arazine Concenraions in Surface Waer Draining Agriculural Waersheds Paul L. Mosquin, Jeremy Aldworh, Wenlin Chen Supplemenal Maerial Number

More information

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LTU, decision

More information

15. Vector Valued Functions

15. Vector Valued Functions 1. Vecor Valued Funcions Up o his poin, we have presened vecors wih consan componens, for example, 1, and,,4. However, we can allow he componens of a vecor o be funcions of a common variable. For example,

More information

Analyze patterns and relationships. 3. Generate two numerical patterns using AC

Analyze patterns and relationships. 3. Generate two numerical patterns using AC envision ah 2.0 5h Grade ah Curriculum Quarer 1 Quarer 2 Quarer 3 Quarer 4 andards: =ajor =upporing =Addiional Firs 30 Day 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 andards: Operaions and Algebraic Thinking

More information

INTRODUCTION TO MACHINE LEARNING 3RD EDITION

INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN The MIT Press, 2014 Lecure Slides for INTRODUCTION TO MACHINE LEARNING 3RD EDITION alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/~ehem/i2ml3e CHAPTER 2: SUPERVISED LEARNING Learning a Class

More information

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important

Non-parametric techniques. Instance Based Learning. NN Decision Boundaries. Nearest Neighbor Algorithm. Distance metric important on-parameric echniques Insance Based Learning AKA: neares neighbor mehods, non-parameric, lazy, memorybased, or case-based learning Copyrigh 2005 by David Helmbold 1 Do no fi a model (as do LDA, logisic

More information

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H.

ACE 562 Fall Lecture 8: The Simple Linear Regression Model: R 2, Reporting the Results and Prediction. by Professor Scott H. ACE 56 Fall 5 Lecure 8: The Simple Linear Regression Model: R, Reporing he Resuls and Predicion by Professor Sco H. Irwin Required Readings: Griffihs, Hill and Judge. "Explaining Variaion in he Dependen

More information

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients

Section 3.5 Nonhomogeneous Equations; Method of Undetermined Coefficients Secion 3.5 Nonhomogeneous Equaions; Mehod of Undeermined Coefficiens Key Terms/Ideas: Linear Differenial operaor Nonlinear operaor Second order homogeneous DE Second order nonhomogeneous DE Soluion o homogeneous

More information

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still.

Lecture 2-1 Kinematics in One Dimension Displacement, Velocity and Acceleration Everything in the world is moving. Nothing stays still. Lecure - Kinemaics in One Dimension Displacemen, Velociy and Acceleraion Everyhing in he world is moving. Nohing says sill. Moion occurs a all scales of he universe, saring from he moion of elecrons in

More information

20. Applications of the Genetic-Drift Model

20. Applications of the Genetic-Drift Model 0. Applicaions of he Geneic-Drif Model 1) Deermining he probabiliy of forming any paricular combinaion of genoypes in he nex generaion: Example: If he parenal allele frequencies are p 0 = 0.35 and q 0

More information

Article from. Predictive Analytics and Futurism. July 2016 Issue 13

Article from. Predictive Analytics and Futurism. July 2016 Issue 13 Aricle from Predicive Analyics and Fuurism July 6 Issue An Inroducion o Incremenal Learning By Qiang Wu and Dave Snell Machine learning provides useful ools for predicive analyics The ypical machine learning

More information

Robust estimation based on the first- and third-moment restrictions of the power transformation model

Robust estimation based on the first- and third-moment restrictions of the power transformation model h Inernaional Congress on Modelling and Simulaion, Adelaide, Ausralia, 6 December 3 www.mssanz.org.au/modsim3 Robus esimaion based on he firs- and hird-momen resricions of he power ransformaion Nawaa,

More information

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8)

Econ107 Applied Econometrics Topic 7: Multicollinearity (Studenmund, Chapter 8) I. Definiions and Problems A. Perfec Mulicollineariy Econ7 Applied Economerics Topic 7: Mulicollineariy (Sudenmund, Chaper 8) Definiion: Perfec mulicollineariy exiss in a following K-variable regression

More information

1 Review of Zero-Sum Games

1 Review of Zero-Sum Games COS 5: heoreical Machine Learning Lecurer: Rob Schapire Lecure #23 Scribe: Eugene Brevdo April 30, 2008 Review of Zero-Sum Games Las ime we inroduced a mahemaical model for wo player zero-sum games. Any

More information

Christos Papadimitriou & Luca Trevisan November 22, 2016

Christos Papadimitriou & Luca Trevisan November 22, 2016 U.C. Bereley CS170: Algorihms Handou LN-11-22 Chrisos Papadimiriou & Luca Trevisan November 22, 2016 Sreaming algorihms In his lecure and he nex one we sudy memory-efficien algorihms ha process a sream

More information

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits

Exponential Weighted Moving Average (EWMA) Chart Under The Assumption of Moderateness And Its 3 Control Limits DOI: 0.545/mjis.07.5009 Exponenial Weighed Moving Average (EWMA) Char Under The Assumpion of Moderaeness And Is 3 Conrol Limis KALPESH S TAILOR Assisan Professor, Deparmen of Saisics, M. K. Bhavnagar Universiy,

More information

KINEMATICS IN ONE DIMENSION

KINEMATICS IN ONE DIMENSION KINEMATICS IN ONE DIMENSION PREVIEW Kinemaics is he sudy of how hings move how far (disance and displacemen), how fas (speed and velociy), and how fas ha how fas changes (acceleraion). We say ha an objec

More information

Final Spring 2007

Final Spring 2007 .615 Final Spring 7 Overview The purpose of he final exam is o calculae he MHD β limi in a high-bea oroidal okamak agains he dangerous n = 1 exernal ballooning-kink mode. Effecively, his corresponds o

More information

Ensamble methods: Bagging and Boosting

Ensamble methods: Bagging and Boosting Lecure 21 Ensamble mehods: Bagging and Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Ensemble mehods Mixure of expers Muliple base models (classifiers, regressors), each covers a differen par

More information

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature

On Measuring Pro-Poor Growth. 1. On Various Ways of Measuring Pro-Poor Growth: A Short Review of the Literature On Measuring Pro-Poor Growh 1. On Various Ways of Measuring Pro-Poor Growh: A Shor eview of he Lieraure During he pas en years or so here have been various suggesions concerning he way one should check

More information

Air Traffic Forecast Empirical Research Based on the MCMC Method

Air Traffic Forecast Empirical Research Based on the MCMC Method Compuer and Informaion Science; Vol. 5, No. 5; 0 ISSN 93-8989 E-ISSN 93-8997 Published by Canadian Cener of Science and Educaion Air Traffic Forecas Empirical Research Based on he MCMC Mehod Jian-bo Wang,

More information

Sequential Importance Resampling (SIR) Particle Filter

Sequential Importance Resampling (SIR) Particle Filter Paricle Filers++ Pieer Abbeel UC Berkeley EECS Many slides adaped from Thrun, Burgard and Fox, Probabilisic Roboics 1. Algorihm paricle_filer( S -1, u, z ): 2. Sequenial Imporance Resampling (SIR) Paricle

More information

5 The fitting methods used in the normalization of DSD

5 The fitting methods used in the normalization of DSD The fiing mehods used in he normalizaion of DSD.1 Inroducion Sempere-Torres e al. 1994 presened a general formulaion for he DSD ha was able o reproduce and inerpre all previous sudies of DSD. The mehodology

More information

4.1 Other Interpretations of Ridge Regression

4.1 Other Interpretations of Ridge Regression CHAPTER 4 FURTHER RIDGE THEORY 4. Oher Inerpreaions of Ridge Regression In his secion we will presen hree inerpreaions for he use of ridge regression. The firs one is analogous o Hoerl and Kennard reasoning

More information

Echocardiography Project and Finite Fourier Series

Echocardiography Project and Finite Fourier Series Echocardiography Projec and Finie Fourier Series 1 U M An echocardiagram is a plo of how a porion of he hear moves as he funcion of ime over he one or more hearbea cycles If he hearbea repeas iself every

More information

Stable block Toeplitz matrix for the processing of multichannel seismic data

Stable block Toeplitz matrix for the processing of multichannel seismic data Indian Journal of Marine Sciences Vol. 33(3), Sepember 2004, pp. 215-219 Sable block Toepliz marix for he processing of mulichannel seismic daa Kiri Srivasava* & V P Dimri Naional Geophysical Research

More information

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1.

Robotics I. April 11, The kinematics of a 3R spatial robot is specified by the Denavit-Hartenberg parameters in Tab. 1. Roboics I April 11, 017 Exercise 1 he kinemaics of a 3R spaial robo is specified by he Denavi-Harenberg parameers in ab 1 i α i d i a i θ i 1 π/ L 1 0 1 0 0 L 3 0 0 L 3 3 able 1: able of DH parameers of

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

RC, RL and RLC circuits

RC, RL and RLC circuits Name Dae Time o Complee h m Parner Course/ Secion / Grade RC, RL and RLC circuis Inroducion In his experimen we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors.

More information

Introduction to Numerical Analysis. In this lesson you will be taken through a pair of techniques that will be used to solve the equations of.

Introduction to Numerical Analysis. In this lesson you will be taken through a pair of techniques that will be used to solve the equations of. Inroducion o Nuerical Analysis oion In his lesson you will be aen hrough a pair of echniques ha will be used o solve he equaions of and v dx d a F d for siuaions in which F is well nown, and he iniial

More information

Lecture 4 Kinetics of a particle Part 3: Impulse and Momentum

Lecture 4 Kinetics of a particle Part 3: Impulse and Momentum MEE Engineering Mechanics II Lecure 4 Lecure 4 Kineics of a paricle Par 3: Impulse and Momenum Linear impulse and momenum Saring from he equaion of moion for a paricle of mass m which is subjeced o an

More information

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H.

ACE 564 Spring Lecture 7. Extensions of The Multiple Regression Model: Dummy Independent Variables. by Professor Scott H. ACE 564 Spring 2006 Lecure 7 Exensions of The Muliple Regression Model: Dumm Independen Variables b Professor Sco H. Irwin Readings: Griffihs, Hill and Judge. "Dumm Variables and Varing Coefficien Models

More information

From Complex Fourier Series to Fourier Transforms

From Complex Fourier Series to Fourier Transforms Topic From Complex Fourier Series o Fourier Transforms. Inroducion In he previous lecure you saw ha complex Fourier Series and is coeciens were dened by as f ( = n= C ne in! where C n = T T = T = f (e

More information

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK

CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 175 CHAPTER 10 VALIDATION OF TEST WITH ARTIFICAL NEURAL NETWORK 10.1 INTRODUCTION Amongs he research work performed, he bes resuls of experimenal work are validaed wih Arificial Neural Nework. From he

More information

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data

Chapter 2. Models, Censoring, and Likelihood for Failure-Time Data Chaper 2 Models, Censoring, and Likelihood for Failure-Time Daa William Q. Meeker and Luis A. Escobar Iowa Sae Universiy and Louisiana Sae Universiy Copyrigh 1998-2008 W. Q. Meeker and L. A. Escobar. Based

More information

Demodulation of Digitally Modulated Signals

Demodulation of Digitally Modulated Signals Addiional maerial for TSKS1 Digial Communicaion and TSKS2 Telecommunicaion Demodulaion of Digially Modulaed Signals Mikael Olofsson Insiuionen för sysemeknik Linköpings universie, 581 83 Linköping November

More information

CONFIDENCE LIMITS AND THEIR ROBUSTNESS

CONFIDENCE LIMITS AND THEIR ROBUSTNESS CONFIDENCE LIMITS AND THEIR ROBUSTNESS Rajendran Raja Fermi Naional Acceleraor laboraory Baavia, IL 60510 Absrac Confidence limis are common place in physics analysis. Grea care mus be aken in heir calculaion

More information

Ensamble methods: Boosting

Ensamble methods: Boosting Lecure 21 Ensamble mehods: Boosing Milos Hauskrech milos@cs.pi.edu 5329 Senno Square Schedule Final exam: April 18: 1:00-2:15pm, in-class Term projecs April 23 & April 25: a 1:00-2:30pm in CS seminar room

More information

1.6. Slopes of Tangents and Instantaneous Rate of Change

1.6. Slopes of Tangents and Instantaneous Rate of Change 1.6 Slopes of Tangens and Insananeous Rae of Change When you hi or kick a ball, he heigh, h, in meres, of he ball can be modelled by he equaion h() 4.9 2 v c. In his equaion, is he ime, in seconds; c represens

More information

Time series Decomposition method

Time series Decomposition method Time series Decomposiion mehod A ime series is described using a mulifacor model such as = f (rend, cyclical, seasonal, error) = f (T, C, S, e) Long- Iner-mediaed Seasonal Irregular erm erm effec, effec,

More information

Object tracking: Using HMMs to estimate the geographical location of fish

Object tracking: Using HMMs to estimate the geographical location of fish Objec racking: Using HMMs o esimae he geographical locaion of fish 02433 - Hidden Markov Models Marin Wæver Pedersen, Henrik Madsen Course week 13 MWP, compiled June 8, 2011 Objecive: Locae fish from agging

More information

Forecasting optimally

Forecasting optimally I) ile: Forecas Evaluaion II) Conens: Evaluaing forecass, properies of opimal forecass, esing properies of opimal forecass, saisical comparison of forecas accuracy III) Documenaion: - Diebold, Francis

More information

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter

State-Space Models. Initialization, Estimation and Smoothing of the Kalman Filter Sae-Space Models Iniializaion, Esimaion and Smoohing of he Kalman Filer Iniializaion of he Kalman Filer The Kalman filer shows how o updae pas predicors and he corresponding predicion error variances when

More information

Random Walk with Anti-Correlated Steps

Random Walk with Anti-Correlated Steps Random Walk wih Ani-Correlaed Seps John Noga Dirk Wagner 2 Absrac We conjecure he expeced value of random walks wih ani-correlaed seps o be exacly. We suppor his conjecure wih 2 plausibiliy argumens and

More information

5.2. The Natural Logarithm. Solution

5.2. The Natural Logarithm. Solution 5.2 The Naural Logarihm The number e is an irraional number, similar in naure o π. Is non-erminaing, non-repeaing value is e 2.718 281 828 59. Like π, e also occurs frequenly in naural phenomena. In fac,

More information

) were both constant and we brought them from under the integral.

) were both constant and we brought them from under the integral. YIELD-PER-RECRUIT (coninued The yield-per-recrui model applies o a cohor, bu we saw in he Age Disribuions lecure ha he properies of a cohor do no apply in general o a collecion of cohors, which is wha

More information

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17

Designing Information Devices and Systems I Spring 2019 Lecture Notes Note 17 EES 16A Designing Informaion Devices and Sysems I Spring 019 Lecure Noes Noe 17 17.1 apaciive ouchscreen In he las noe, we saw ha a capacior consiss of wo pieces on conducive maerial separaed by a nonconducive

More information

Solutions from Chapter 9.1 and 9.2

Solutions from Chapter 9.1 and 9.2 Soluions from Chaper 9 and 92 Secion 9 Problem # This basically boils down o an exercise in he chain rule from calculus We are looking for soluions of he form: u( x) = f( k x c) where k x R 3 and k is

More information

Chapter 6. Systems of First Order Linear Differential Equations

Chapter 6. Systems of First Order Linear Differential Equations Chaper 6 Sysems of Firs Order Linear Differenial Equaions We will only discuss firs order sysems However higher order sysems may be made ino firs order sysems by a rick shown below We will have a sligh

More information

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems

Recursive Least-Squares Fixed-Interval Smoother Using Covariance Information based on Innovation Approach in Linear Continuous Stochastic Systems 8 Froniers in Signal Processing, Vol. 1, No. 1, July 217 hps://dx.doi.org/1.2266/fsp.217.112 Recursive Leas-Squares Fixed-Inerval Smooher Using Covariance Informaion based on Innovaion Approach in Linear

More information

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power

Learning a Class from Examples. Training set X. Class C 1. Class C of a family car. Output: Input representation: x 1 : price, x 2 : engine power Alpaydin Chaper, Michell Chaper 7 Alpaydin slides are in urquoise. Ehem Alpaydin, copyrigh: The MIT Press, 010. alpaydin@boun.edu.r hp://www.cmpe.boun.edu.r/ ehem/imle All oher slides are based on Michell.

More information

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes

23.5. Half-Range Series. Introduction. Prerequisites. Learning Outcomes Half-Range Series 2.5 Inroducion In his Secion we address he following problem: Can we find a Fourier series expansion of a funcion defined over a finie inerval? Of course we recognise ha such a funcion

More information

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates

Biol. 356 Lab 8. Mortality, Recruitment, and Migration Rates Biol. 356 Lab 8. Moraliy, Recruimen, and Migraion Raes (modified from Cox, 00, General Ecology Lab Manual, McGraw Hill) Las week we esimaed populaion size hrough several mehods. One assumpion of all hese

More information

Lecture 20: Riccati Equations and Least Squares Feedback Control

Lecture 20: Riccati Equations and Least Squares Feedback Control 34-5 LINEAR SYSTEMS Lecure : Riccai Equaions and Leas Squares Feedback Conrol 5.6.4 Sae Feedback via Riccai Equaions A recursive approach in generaing he marix-valued funcion W ( ) equaion for i for he

More information

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing

Application of a Stochastic-Fuzzy Approach to Modeling Optimal Discrete Time Dynamical Systems by Using Large Scale Data Processing Applicaion of a Sochasic-Fuzzy Approach o Modeling Opimal Discree Time Dynamical Sysems by Using Large Scale Daa Processing AA WALASZE-BABISZEWSA Deparmen of Compuer Engineering Opole Universiy of Technology

More information

OBJECTIVES OF TIME SERIES ANALYSIS

OBJECTIVES OF TIME SERIES ANALYSIS OBJECTIVES OF TIME SERIES ANALYSIS Undersanding he dynamic or imedependen srucure of he observaions of a single series (univariae analysis) Forecasing of fuure observaions Asceraining he leading, lagging

More information

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality

Matrix Versions of Some Refinements of the Arithmetic-Geometric Mean Inequality Marix Versions of Some Refinemens of he Arihmeic-Geomeric Mean Inequaliy Bao Qi Feng and Andrew Tonge Absrac. We esablish marix versions of refinemens due o Alzer ], Carwrigh and Field 4], and Mercer 5]

More information

Chapter 3 Boundary Value Problem

Chapter 3 Boundary Value Problem Chaper 3 Boundary Value Problem A boundary value problem (BVP) is a problem, ypically an ODE or a PDE, which has values assigned on he physical boundary of he domain in which he problem is specified. Le

More information

References are appeared in the last slide. Last update: (1393/08/19)

References are appeared in the last slide. Last update: (1393/08/19) SYSEM IDEIFICAIO Ali Karimpour Associae Professor Ferdowsi Universi of Mashhad References are appeared in he las slide. Las updae: 0..204 393/08/9 Lecure 5 lecure 5 Parameer Esimaion Mehods opics o be

More information

Class Meeting # 10: Introduction to the Wave Equation

Class Meeting # 10: Introduction to the Wave Equation MATH 8.5 COURSE NOTES - CLASS MEETING # 0 8.5 Inroducion o PDEs, Fall 0 Professor: Jared Speck Class Meeing # 0: Inroducion o he Wave Equaion. Wha is he wave equaion? The sandard wave equaion for a funcion

More information

A Bayesian Approach to Spectral Analysis

A Bayesian Approach to Spectral Analysis Chirped Signals A Bayesian Approach o Specral Analysis Chirped signals are oscillaing signals wih ime variable frequencies, usually wih a linear variaion of frequency wih ime. E.g. f() = A cos(ω + α 2

More information

Morning Time: 1 hour 30 minutes Additional materials (enclosed):

Morning Time: 1 hour 30 minutes Additional materials (enclosed): ADVANCED GCE 78/0 MATHEMATICS (MEI) Differenial Equaions THURSDAY JANUARY 008 Morning Time: hour 30 minues Addiional maerials (enclosed): None Addiional maerials (required): Answer Bookle (8 pages) Graph

More information

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should

In this chapter the model of free motion under gravity is extended to objects projected at an angle. When you have completed it, you should Cambridge Universiy Press 978--36-60033-7 Cambridge Inernaional AS and A Level Mahemaics: Mechanics Coursebook Excerp More Informaion Chaper The moion of projeciles In his chaper he model of free moion

More information

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1

Vectorautoregressive Model and Cointegration Analysis. Time Series Analysis Dr. Sevtap Kestel 1 Vecorauoregressive Model and Coinegraion Analysis Par V Time Series Analysis Dr. Sevap Kesel 1 Vecorauoregression Vecor auoregression (VAR) is an economeric model used o capure he evoluion and he inerdependencies

More information

Lab 10: RC, RL, and RLC Circuits

Lab 10: RC, RL, and RLC Circuits Lab 10: RC, RL, and RLC Circuis In his experimen, we will invesigae he behavior of circuis conaining combinaions of resisors, capaciors, and inducors. We will sudy he way volages and currens change in

More information

2. Nonlinear Conservation Law Equations

2. Nonlinear Conservation Law Equations . Nonlinear Conservaion Law Equaions One of he clear lessons learned over recen years in sudying nonlinear parial differenial equaions is ha i is generally no wise o ry o aack a general class of nonlinear

More information

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model

Modal identification of structures from roving input data by means of maximum likelihood estimation of the state space model Modal idenificaion of srucures from roving inpu daa by means of maximum likelihood esimaion of he sae space model J. Cara, J. Juan, E. Alarcón Absrac The usual way o perform a forced vibraion es is o fix

More information

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes

2.7. Some common engineering functions. Introduction. Prerequisites. Learning Outcomes Some common engineering funcions 2.7 Inroducion This secion provides a caalogue of some common funcions ofen used in Science and Engineering. These include polynomials, raional funcions, he modulus funcion

More information

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation

Mathcad Lecture #8 In-class Worksheet Curve Fitting and Interpolation Mahcad Lecure #8 In-class Workshee Curve Fiing and Inerpolaion A he end of his lecure, you will be able o: explain he difference beween curve fiing and inerpolaion decide wheher curve fiing or inerpolaion

More information

Announcements: Warm-up Exercise:

Announcements: Warm-up Exercise: Fri Apr 13 7.1 Sysems of differenial equaions - o model muli-componen sysems via comparmenal analysis hp//en.wikipedia.org/wiki/muli-comparmen_model Announcemens Warm-up Exercise Here's a relaively simple

More information

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017

Two Popular Bayesian Estimators: Particle and Kalman Filters. McGill COMP 765 Sept 14 th, 2017 Two Popular Bayesian Esimaors: Paricle and Kalman Filers McGill COMP 765 Sep 14 h, 2017 1 1 1, dx x Bel x u x P x z P Recall: Bayes Filers,,,,,,, 1 1 1 1 u z u x P u z u x z P Bayes z = observaion u =

More information

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon

3.1.3 INTRODUCTION TO DYNAMIC OPTIMIZATION: DISCRETE TIME PROBLEMS. A. The Hamiltonian and First-Order Conditions in a Finite Time Horizon 3..3 INRODUCION O DYNAMIC OPIMIZAION: DISCREE IME PROBLEMS A. he Hamilonian and Firs-Order Condiions in a Finie ime Horizon Define a new funcion, he Hamilonian funcion, H. H he change in he oal value of

More information