On the Contractive Nature of Autoencoders: Application to Missing Sensor Restoration
|
|
- Rafe Jefferson
- 5 years ago
- Views:
Transcription
1 On the Contactive Natue of Autoencodes: Application to Missing Senso Restoation Benjain B. Thopson, Robet J. Maks II, and Mohaed A. El-Shakawi Coputational Intelligence Applications (CIA) Laboatoy, Depatent of Electical Engineeing, Univesity of Washington, Seattle, WA Abstact The neual netwok autoencode is a useful tool fo the estoation of issing sensos when enough known sensos with soe elation to those issing ae available. Though the idea of a contaction apping, this pape povides soe insight into the convegence of seveal iteative ethods of senso estoation using the autoencode to soe unique answe given a specific opeating point (i.e., the known senso values), egadless of how the issing senso values ae initialized I. Intoduction Pevious wok has established the ability of the autoassociative neual netwok encode (o siply autoencode ) to aid in the estoation of senso data which ay be issing o coupt, given soe sot of coelation between the nueic outputs of the vaious sensos in a syste. [1], [2] Naayanan et al. [1] descibe a ethod by which the issing senso data ay be econstucted using an iteative appoach; in this pape we show that, unde a set of conditions elating to the specific paaetes of the neual netwok, we can povide a sufficient condition fo the convegence of the iteative appoach to senso estoation. We appoach this though the idea of a contaction apping. Moeove, we will show copelling evidence that thee exists a unique point of convegence fo a fully tained autoencode given an opeating point defined by the set of known sensos, and that this convegence point should be eached egadless of how the issing sensos ae initialized. II. Contaction A contactive apping is defined [3],[4] as a apping O:X X on a coplete etic space (X, d) in which, fo any x and y in that space: ( Ox, Oy) k d( x, y) d 0 k < 1 (1) o, oe clealy, a contaction apping is one in which the output distance between two points is less than the input distance. Now let us look at this popety in R 1, whee ou etic is siply the Euclidean no, and O is siply soe functional apping f(x): f ( x) f ( y) k x y (2) Now, suppose we eplace y with x+dx, yielding, with soe ino eaangeent: f ( x) f ( x + dx) dx k the liit of which as dx 0 gives us, as a less stict equieent fo contaction ( x) df dx < 1 This idea is deonstated clealy in Figue 1. It would then be sufficient to show that, fo soe function f: R 1 R 1, the deivative of f is less than unity fo all x. Conside the Banach Fixed-Point Theoe: If f is a contactive apping, then thee exists a unique fixed point x 0 fo which f(x 0 ) = x 0. Moeove, the sequence {x n }, fo which any eleent x n+1 = f(x n ), conveges, and that convegent point is x o. With this theoe, it becoes uch cleae how any contactive tendency of the autoencode can help us show whethe o not the senso estoation pocess will convege to soe unique value. III. Missing Senso Restoation with Autoencodes Thee ae thee ethods that we will exaine fo the estoation of issing sensos. The fist is a siple application of altenating pojections onto convex sets (POCS). The second and the thid both eploy seach (3) (4) /03/$ IEEE 3011
2 f(x) d(ov,oy) d(ow,oz) d(v,y) d(w,z) Figue 1 - Fo a function whose deivative is less than unity, the input distance of two points will always be geate than the output distance (the distances pojected onto the hoizontal and vetical axes, espectively). Fo a deivative geate than one, we achieve expansion athe than contaction. Note that points v and y exist whee df(x)/dx <1, and w and z exist whee df(x)/dx >1. x v y w z W 1, W 2 W 3, x,..., { x x,..., x, x, x x } T 1, 2 M k1 k 2 kk (5) whee M is the nube of issing sensos, K is the nube of known sensos, and of couse K+M = N. Likewise, on the outputs, we have: x xˆ, xˆ,..., xˆ, xˆ, xˆ,..., xˆ (6) { } T ˆ 1 2 M k1 k 2 Figue 2 shows a single-hidden-laye autoencode with the appopiate labels. Given that the encode x is tained as a feedfowad ultilayeed pecepton (MLP) [3] we also have the following eleents: W 1,k is the atix of weights whose (i, j) th eleent is the weight connecting the i th known senso value to the j th neuon in the fist hidden laye; W 1, is the coesponding atix fo the issing sensos, b l is the vecto of bias weights fo the l th laye; W 2 is the weight atix connecting the fist hidden laye to the second; and finally, W 3,k and W 3, ae the countepats to W 1,k and W 1, on the output. Note that these can easily be extended fo an encode with oe than a single hidden laye. kk A. POCS x k b 1 W 1,k b 2 b 3 W 3,k Figue 2 - a diaga of a geneic 2-laye autoencode, with appopiate labels, as descibed in the text. techniques; the fist involves siply iniizing the eo between the issing senso inputs and outputs on the autoencode, while the second looks at the eo between the entie input patten and output patten (both issing and known sensos) to achieve a final answe. The eits of each ae discussed below. Fist, howeve, a few definitions ae in ode. The input to the neual netwok is copised of two concatenated vectos whose total diension is N, the input diension (and necessaily the output diension as well). The fist vecto, x k, can be thought of as the opeating point of the estoation pocess, and is defined as the set of known senso values fo a given input patten. The second vecto is then x, the set of issing senso values. Without loss of geneality, let us foulate the input as soe vecto x: As descibed by Naayanan et al. [1], a staightfowad ethod fo issing senso estoation using a tained autoencode is the use of POCS [5] to achieve a convegent value. Unde the assuption of convexity, ou two sets ae then a) the space defined as the output of the autoencode, and b) the set of all input pattens to the neual netwok containing x k, the known sensos, and an abitay x. While the second set is definitely convex, the fist equies the assuption of convexity. By choosing soe initial x to ceate an input vecto x, we then obtain xˆ, the output of the autoencode. This coesponds to a pojection onto the fist set, the opeato fo which we will denote P 1. We then change the outputs xˆ to x k k to pefo the pojection onto the fist set, denoted as P 2. If we altenate between these pojections, unde the assuption of convexity, the seies will convege to an answe epesenting the intesection of the two sets. Thus, a single iteation of this pocess is defined as the successive application of P 1 and then P 2. B. Unconstained Seach Because of the potential lack of convexity and othe pefoance issues, we ae otivated to find a bette ethod fo discoveing the tue point of convegence. In this case, ou iteative opeato O u is siply a single iteation of any seach algoith which seeks to iniize the eo between the issing senso values and the 3012
3 Figue 4 - a histoga of the k-values based on the taining data. Note the dynaic ange of the plot is [0.966, 1.015]. outputs of the autoencode coesponding to those issing senso values, o: ag in x xˆ (7) x This ethod allows fo geate efineent of the issing senso values ove the POCS ethod descibed above; oeove, it should be noted that, if the assuption of convexity wee tue, O u and O p would convege to the sae value, assuing the two sets intesect. C. Constained Seach A notable shotcoing of both POCS and the unconstained seach is that neithe one uses the infoation contained in x ˆ k to bette efine the final answe. Thus, we define a thid opeato, O c, which is siila to O u except that it coesponds to a seach algoith which seeks to iniize the entie output eo of the autoencode; naely: ag in x xˆ (8) x ecalling that x is a vecto coposed of x and x k. This way, we actually ensue a soothe atch between the input and the output, which can help eliinate spuious answes that, while iniizing the eo between consecutive iteations on x, tend not to ake sense in the context of the known sensos. IV. Analysis Results Figue 3 - a histoga of the k-values associated with ou autoencode as a whole, fo a andoly geneated data set. The scale of the x-axis is fo 0.2 to 1. Note that the lagest tail value is actually less than unity. x be contactive. Recall that, by definition, a pefectly tained autoencode is one fo which we have the following elationship: O ( x NN ) = x x C (9) whee O NN is the neual netwok teated as an opeato, and C is the set of all taining data. Thus, except in the case of an autoencode tained on a single patten, a pefectly tained autoencode guaantees that the Banach Fixed- Point Theoe cannot hold, and thus the opeato is not contactive. An opeato is nonexpansive in (10) when, instead of k<1, we allow k 1. A convex set othogonal pojection opeato is nonexpansive [6] so this is a esult to be expected fo the autoencode. If O is nonexpansive, the opeation x n+1 = O(x n ) will convege to a fixed point. This point, howeve, is not unique and is dependent on initialization. A. Contaction of the Entie Autoencode While we have shown that the autoencode itself is neithe stictly contactive no nonexpansive, it is infoative to see how closely it appoaches these conditions. As descibed in (3), thee is a k-value associated with a set of two inputs and thei coesponding outputs. If, fo a vey lage set of input pais, we can show that that k-value is less than o equal to one, then we have justification fo teating the opeato as nealy nonexpansive We exaine the k-values fo a specific exaple of a tained autoencode. Fo the puposes of this 3013
4 Figue 5 - aveage deivat ive of ou oveall estoat ion opeato fo a single issing senso using andolyinit ialized opeat ing point s x k pape, we have tained an autoencode on Mackey-Glass chaos, defined by the nonlinea diffeence equation [7]: x [] t [ t τ ] [ t τ ] n A θ x = + 1 n n θ + x ( B) x[] t (10) whee A, B, n, θ, and τ ae defined paaetes, along with soe x[0] value. We geneate a data set using this function, and tain a autoencode using input pattens taken as consecutive 40-point windows of the data set. All data is noalized to the inteval [0,1] befoe taining. The autoencode thus tained, we then geneate a lage (on the ode of 10 5 pattens) set of andoly geneated input vectos (fo a unifo distibution on [0,1]). We then select, at ando, two diffeent vectos fo this set as vectos x and y as pe equation (3). Fo this, we can calculate a coesponding k-value. With a sufficiently lage nube of these k-values, we can ceate estiate the pobability density function of k, to exaine how it behaves, paticulaly aound the value of 1. Figue 3 shows the esult of this expeient. Clealy we have that, fo a andoly geneated data set, we neve even appoach the liits of being contactive; that is, ou autoencode behaves statistically as though it wee in fact contactive. The lagest k-value it achieves in this siulation, in fact, is , well below the theshold beyond which it would no longe be contactive. While this deonstates the behavio of the autoencode towads andoly geneated data, we next pefo a oe inteesting expeient. Given that the autoencode is tained such that the output ios the input as closely as possible, we would expect the k-values fo the actual taining data to be vey nea 1 fo each taining patten (ecall that, fo a pefectly tained Figue 6 - sae as Fig. 5 with taining data used instead of andolyinitialized x k autoencode, k would be exactly unity fo evey single one). Thus, we have otivation to epeat the above expeient, eplacing the andoly-geneated data with the taining data itself. We see the esult of this expeient in Figue 4. Fo this histoga, we have poof that ou initial conjectue holds tue even fo this ipefect autoencode due to the k-values above 1, the opeato is not stictly nonexpansive. Howeve, it would clealy be fai to say that, fo the evidence pesented in this figue, ou opeato is nealy nonexpansive, since k neve deviates fo unity by oe than B. Contaction of Subsets of the Autoencode At this point, we then want to show that, while the autoencode as a whole is neithe stictly contactive no nonexapnsive, the autoencode at soe opeating point ay be contactive as it opeates on a subset of the input vecto; naely, x. At this point, it is useful to wite out the functional fo of the neual netwok as an opeato. Let us foulate this fo a two-hidden laye neual netwok as descibed in Figue 2, although it can easily be genealized fo geate o fewe diensions: f xˆ ( x xk ) = σ W3, σ( W2 σ( = ( 1, x xˆ k, W ) + b 2 ) 3 ) + W (11) 1, k x k + b1 + b whee σ is a vecto opeato that iposes a sigoid nonlineaity on each eleent of the applied vecto, and all othe paaetes ae as descibed above. This function 3014
5 (a) (c) (e) (g) (i) Figue 7 - histogas of k-values vaious cobinations of issing sensos. Figs. (a)-(j) coespond to 1, 5, 9, 13, 17, 21, 25, 29, 33, and 37 issing sensos, espectively. The specific issing sensos wee chosen at aondo, and the opeating point, selected fo the taining data, was the sae fo each case. epesents the functional fo of ou opeato O 1, as descibed above. Likewise, we can define out opeato O 2 as: g xˆ ( xˆ, x k ) = = T xˆ + B x k x k whee T is an N N atix in which: (12) 1 i = j M T i, j = (13) 0 else and B is an N K atix defined as: 0M K B = (14) I K Thus, cobining equations (11) and (12) yields ou opeato O p : O x, x k = T f x, x k + B x (15) p ( ) ( ) k With this, we have a faewok fo which we can exaine the contactiveness of the entie pocess. Specifically, we can look at the case in which only one senso is issing. (b) (d) (f) (h) (j) If this is the case, then x is a scala, and equation (4) can be applied. Explicitly calculating the deivative of O p is a cubesoe task, paticulaly if x is not scala. Fo the puposes of this pape, we again apply a andoly initialized siulation to show that the deivative tends to be less than one fo vaious x k opeating points. We pefo this expeient using the sae Mackey-Glass autoencode as used above. Fist, we exaine all foty senso values by andoly geneating x k (as a vecto of unifo ando vaiables on [0,1]) and calculating the coesponding deivatives. Figue 5 shows the ovelaid plot of the deivatives fo each of the foty sensos. Each cuve epesents an aveage ove ultiple ealizations of x k. The axiu standad deviation at any point fo any of the sets of cuves was as sall as , giving us a geat deal of confidence that, fo ando x k, and a single issing senso, we will always convege to a unique answe, since the less-than-unity deivative iplies contactiveness of the sub-opeato as it acts aound a fixed point. Next, we pefo the sae expeient, again eplacing the andoly initialized potion (in this case, the value of the fixed point x k ) with the actual taining data. Figue 6 displays the esults clealy, in a fo identical to Figue 5. In this case, the axiu standad deviation fo any value of x ove any set of the cuves was , which gives us even geate confidence of ou conclusion. Copaing Fig. 5 to Fig. 6, we see that they ae alost copletely indistinguishable. No diffeence is gaphically discenable. This gives us substantial eason to believe that the deivative is lagely insensitive to the actual value of the opeating point (as long as the opeating point is within the unit-cube in K diensions which is easonable since it is possible to define the valid ange of sensos to be within that liit). Finally, we pefo an expeient to deonstate the contactive chaacteistics of situations in which oe than a single senso ae issing. Fo this, we calculate a seies of k-values as above, the exception being that soe fixed-point x k is chosen, and the eaining sensos x ae andoly initialized as above. We then pefo this fo a vaiety of issing-senso configuations (obviously, all the possible peutations would take a pohibitive aount of tie to calculate even fo a elatively sall autoencode, and even oe so fo ou situation using the Mackey-Glass autoencode). Figue 7 displays these esults, fo 10 diffeent cases coesponding to 1, 5, 9, 13, 17, 21, 25, 29, 33, and 37 issing sensos. The specific sensos in each case wee selected at ando fo the 40 possible sensos. We note that, in evey single plot, we ae well below the unity theshold equied fo contaction. Moeove, it is inteesting to note that the uppe liit of the k-value sees to appoach unity gadually as the nube of issing 3015
6 sensos inceases (iplying that the opeation is oe contactive fo fewe issing sensos).. V. Conclusions [7] Glass, L. and M. C. Mackey, Fo Clocks to Chaos, The Rhyths of Life, Pinceton Univesity Pess, Pinceton, NJ, By deonstating the contactive natue of the autoencode as a ethod fo estoing issing sensos, we have given copelling evidence that such iteative pocedues will, fo the case exained, convege to a unique answe dependent only on the neual netwok autoencode itself, and the opeating point (the known senso values) about which the pocess is ipleented. We have shown that the autoencode itself is nealy nonexpansive to ost types of data, the aginal exception being the taining data itself. Finally, we have povided eason to believe that, the fewe sensos that ae issing, the oe likely the autoencode-ethod of estoing issing sensos is to have such a unique value of convegence. VI. Refeences [1] Naayanan, S., R.J. Maks II, J. L. Vian, J.J. Choi, M.A. El-Shakawi & B. B. Thopson, "Set Constaint Discovey: Missing Senso Data Restoation Using Auto-Associative Regession Machines", Poceedings of the 2002 Intenational Joint Confeence on Neual Netwoks, 2002 IEEE Wold Congess on Coputational Intelligence, May12-17, 2002, Honolulu, pp [2] Reed, R. D. and R.J. Maks II, Neual Sithing: Supevised Leaning in Feedfowad Atificial Neual Netwoks, MIT Pess, Cabidge, MA, [3] Naylo, A. W., and G. R. Sell Linea Opeato Theoy in Engineeing and Science, Spinge, New Yok City, NY, [4] Luenbege, D. G., Optiization by Vecto Space Methods, John Wiley & Sons, Apil 1997 [5] Maks, R.J. II, "Altenating Pojections onto Convex Sets", in Deconvolution of Iages and Specta, edited by Pete A. Jansson, (Acadeic Pess, San Diego, 1997), pp [6] Goldbug, M.H. and R.J. Maks II, "Signal synthesis in the pesence of an inconsistent set of constaints", IEEE Tansactions on Cicuits and Systes, vol. CAS-32 pp (1985). 3016
30 The Electric Field Due to a Continuous Distribution of Charge on a Line
hapte 0 The Electic Field Due to a ontinuous Distibution of hage on a Line 0 The Electic Field Due to a ontinuous Distibution of hage on a Line Evey integal ust include a diffeential (such as d, dt, dq,
More informationSome Remarks on the Boundary Behaviors of the Hardy Spaces
Soe Reaks on the Bounday Behavios of the Hady Spaces Tao Qian and Jinxun Wang In eoy of Jaie Kelle Abstact. Soe estiates and bounday popeties fo functions in the Hady spaces ae given. Matheatics Subject
More information4/18/2005. Statistical Learning Theory
Statistical Leaning Theoy Statistical Leaning Theoy A model of supevised leaning consists of: a Envionment - Supplying a vecto x with a fixed but unknown pdf F x (x b Teache. It povides a desied esponse
More informationQueuing Network Approximation Technique for Evaluating Performance of Computer Systems with Hybrid Input Source
Int'l Conf. cientific Coputing CC'7 3 Queuing Netwok Appoxiation Technique fo Evaluating Pefoance of Copute ystes with Hybid Input ouce Nozoi iyaoto, Daisuke iyake, Kaoi Katsuata, ayuko Hiose, Itau Koike,
More informationJORDAN CANONICAL FORM AND ITS APPLICATIONS
JORDAN CANONICAL FORM AND ITS APPLICATIONS Shivani Gupta 1, Kaajot Kau 2 1,2 Matheatics Depatent, Khalsa College Fo Woen, Ludhiana (India) ABSTRACT This pape gives a basic notion to the Jodan canonical
More informationOptimum Settings of Process Mean, Economic Order Quantity, and Commission Fee
Jounal of Applied Science and Engineeing, Vol. 15, No. 4, pp. 343 352 (2012 343 Optiu Settings of Pocess Mean, Econoic Ode Quantity, and Coission Fee Chung-Ho Chen 1 *, Chao-Yu Chou 2 and Wei-Chen Lee
More informationVLSI IMPLEMENTATION OF PARALLEL- SERIAL LMS ADAPTIVE FILTERS
VLSI IMPLEMENTATION OF PARALLEL- SERIAL LMS ADAPTIVE FILTERS Run-Bo Fu, Paul Fotie Dept. of Electical and Copute Engineeing, Laval Univesity Québec, Québec, Canada GK 7P4 eail: fotie@gel.ulaval.ca Abstact
More informationMULTILAYER PERCEPTRONS
Last updated: Nov 26, 2012 MULTILAYER PERCEPTRONS Outline 2 Combining Linea Classifies Leaning Paametes Outline 3 Combining Linea Classifies Leaning Paametes Implementing Logical Relations 4 AND and OR
More informationATMO 551a Fall 08. Diffusion
Diffusion Diffusion is a net tanspot of olecules o enegy o oentu o fo a egion of highe concentation to one of lowe concentation by ando olecula) otion. We will look at diffusion in gases. Mean fee path
More informationInduction Motor Identification Using Elman Neural Network
Poceedings of the 5th WSEAS Int Conf on Signal Pocessing, Robotics and Autoation, Madid, Spain, Febuay 15-17, 2006 (pp153-157) Induction Moto Identification Using Elan Neual Netwok AA AKBARI 1, K RAHBAR
More informationTemporal-Difference Learning
.997 Decision-Making in Lage-Scale Systems Mach 17 MIT, Sping 004 Handout #17 Lectue Note 13 1 Tempoal-Diffeence Leaning We now conside the poblem of computing an appopiate paamete, so that, given an appoximation
More informationGame Study of the Closed-loop Supply Chain with Random Yield and Random Demand
, pp.105-110 http://dx.doi.og/10.14257/astl.2014.53.24 Gae Study of the Closed-loop Supply Chain with ando Yield and ando Deand Xiuping Han, Dongyan Chen, Dehui Chen, Ling Hou School of anageent, Habin
More informationStudy on GPS Common-view Observation Data with Multiscale Kalman Filter. based on correlation Structure of the Discrete Wavelet Coefficients
Study on GPS Coon-view Obsevation Data with ultiscale Kalan Filte based on coelation Stuctue of the Discete Wavelet Coefficients Ou Xiaouan Zhou Wei Yu Jianguo Dept. of easueent and Instuentation, Xi dian
More informationA Bijective Approach to the Permutational Power of a Priority Queue
A Bijective Appoach to the Pemutational Powe of a Pioity Queue Ia M. Gessel Kuang-Yeh Wang Depatment of Mathematics Bandeis Univesity Waltham, MA 02254-9110 Abstact A pioity queue tansfoms an input pemutation
More informationVortex Initialization in HWRF/HMON Models
Votex Initialization in HWRF/HMON Models HWRF Tutoial Januay 018 Pesented by Qingfu Liu NOAA/NCEP/EMC 1 Outline 1. Oveview. HWRF cycling syste 3. Bogus sto 4. Sto elocation 5. Sto size coection 6. Sto
More informationPearson s Chi-Square Test Modifications for Comparison of Unweighted and Weighted Histograms and Two Weighted Histograms
Peason s Chi-Squae Test Modifications fo Compaison of Unweighted and Weighted Histogams and Two Weighted Histogams Univesity of Akueyi, Bogi, v/noduslód, IS-6 Akueyi, Iceland E-mail: nikolai@unak.is Two
More informationResearch Article Approximation of Signals (Functions) by Trigonometric Polynomials in L p -Norm
Intenational Matheatics and Matheatical Sciences, Aticle ID 267383, 6 pages http://dx.doi.og/.55/24/267383 Reseach Aticle Appoxiation of Signals (Functions) by Tigonoetic Polynoials in L p -No M. L. Mittal
More informationAn Adaptive Diagonal Loading Covariance Matrix Estimator in Spatially Heterogeneous Sea Clutter Yanling Shi, Xiaoyan Xie
nd Intenational Wokshop on ateials Engineeing and Copute Sciences (IWECS 05) An Adaptive Diagonal oading Covaiance atix Estiato in Spatially eteogeneous Sea Clutte Yanling Shi, Xiaoyan Xie College of elecounications
More informationKANTOROVICH TYPE INEQUALITIES FOR THE DIFFERENCE WITH TWO NEGATIVE PARAMETERS. Received April 13, 2010; revised August 18, 2010
Scientiae Matheaticae Japonicae Online, e-200, 427 439 427 KANTOROVICH TYPE INEQUALITIES FOR THE DIFFERENCE WITH TWO NEGATIVE PARAMETERS Young Ok Ki, Jun Ichi Fujii, Masatoshi Fujii + and Yuki Seo ++ Received
More informationLINEAR MOMENTUM Physical quantities that we have been using to characterize the motion of a particle
LINEAR MOMENTUM Physical quantities that we have been using to chaacteize the otion of a paticle v Mass Velocity v Kinetic enegy v F Mechanical enegy + U Linea oentu of a paticle (1) is a vecto! Siple
More informationAMACHINE-to-machine (M2M) communication system
Optial Access Class Baing fo Stationay Machine Type Counication Devices with Tiing Advance Infoation Zehua Wang Student Mebe IEEE and Vincent W.S. Wong Senio Mebe IEEE Abstact The cuent wieless cellula
More informationHandout: IS/LM Model
Econ 32 - IS/L odel Notes Handout: IS/L odel IS Cuve Deivation Figue 4-4 in the textbook explains one deivation of the IS cuve. This deivation uses the Induced Savings Function fom Chapte 3. Hee, I descibe
More informationON INDEPENDENT SETS IN PURELY ATOMIC PROBABILITY SPACES WITH GEOMETRIC DISTRIBUTION. 1. Introduction. 1 r r. r k for every set E A, E \ {0},
ON INDEPENDENT SETS IN PURELY ATOMIC PROBABILITY SPACES WITH GEOMETRIC DISTRIBUTION E. J. IONASCU and A. A. STANCU Abstact. We ae inteested in constucting concete independent events in puely atomic pobability
More informationAdsorption and Desorption Kinetics for Diffusion Controlled Systems with a Strongly Concentration Dependent Diffusivity
The Open-Access Jounal fo the Basic Pinciples of Diffusion Theoy, Expeient and Application Adsoption and Desoption Kinetics fo Diffusion Contolled Systes with a Stongly Concentation Dependent Diffusivity
More informationt is bounded. Thus, the state derivative x t is bounded. Let y Cx represent the system output. Then y
Lectue 3 Eaple 6.3 Conside an LI syste A Bu with a Huwitz ati A and a unifoly ounded in tie input ut. hese two facts iply that the state t is ounded. hus, the state deivative t is ounded. Let y C epesent
More informationOSCILLATIONS AND GRAVITATION
1. SIMPLE HARMONIC MOTION Simple hamonic motion is any motion that is equivalent to a single component of unifom cicula motion. In this situation the velocity is always geatest in the middle of the motion,
More informationOrbital Angular Momentum Eigenfunctions
Obital Angula Moentu Eigenfunctions Michael Fowle 1/11/08 Intoduction In the last lectue we established that the opeatos J Jz have a coon set of eigenkets j J j = j( j+ 1 ) j Jz j = j whee j ae integes
More informationThe Substring Search Problem
The Substing Seach Poblem One algoithm which is used in a vaiety of applications is the family of substing seach algoithms. These algoithms allow a use to detemine if, given two chaacte stings, one is
More informationALOIS PANHOLZER AND HELMUT PRODINGER
ASYMPTOTIC RESULTS FOR THE NUMBER OF PATHS IN A GRID ALOIS PANHOLZER AND HELMUT PRODINGER Abstact. In two ecent papes, Albecht and White, and Hischhon, espectively, consideed the poble of counting the
More informationCSCE 478/878 Lecture 4: Experimental Design and Analysis. Stephen Scott. 3 Building a tree on the training set Introduction. Outline.
In Homewok, you ae (supposedly) Choosing a data set 2 Extacting a test set of size > 3 3 Building a tee on the taining set 4 Testing on the test set 5 Repoting the accuacy (Adapted fom Ethem Alpaydin and
More informationCentral limit theorem for functions of weakly dependent variables
Int. Statistical Inst.: Poc. 58th Wold Statistical Congess, 2011, Dublin (Session CPS058 p.5362 Cental liit theoe fo functions of weakly dependent vaiables Jensen, Jens Ledet Aahus Univesity, Depatent
More information8-3 Magnetic Materials
11/28/24 section 8_3 Magnetic Mateials blank 1/2 8-3 Magnetic Mateials Reading Assignent: pp. 244-26 Recall in dielectics, electic dipoles wee ceated when and E-field was applied. Q: Theefoe, we defined
More information3.1 Random variables
3 Chapte III Random Vaiables 3 Random vaiables A sample space S may be difficult to descibe if the elements of S ae not numbes discuss how we can use a ule by which an element s of S may be associated
More informationChapter 5 Linear Equations: Basic Theory and Practice
Chapte 5 inea Equations: Basic Theoy and actice In this chapte and the next, we ae inteested in the linea algebaic equation AX = b, (5-1) whee A is an m n matix, X is an n 1 vecto to be solved fo, and
More informationOn the velocity autocorrelation function of a Brownian particle
Co. Dept. Che., ulg. Acad. Sci. 4 (1991) 576-58 [axiv 15.76] On the velocity autocoelation of a ownian paticle Rouen Tsekov and oyan Radoev Depatent of Physical Cheisty, Univesity of Sofia, 1164 Sofia,
More informationCentral Coverage Bayes Prediction Intervals for the Generalized Pareto Distribution
Statistics Reseach Lettes Vol. Iss., Novembe Cental Coveage Bayes Pediction Intevals fo the Genealized Paeto Distibution Gyan Pakash Depatment of Community Medicine S. N. Medical College, Aga, U. P., India
More informationEM Boundary Value Problems
EM Bounday Value Poblems 10/ 9 11/ By Ilekta chistidi & Lee, Seung-Hyun A. Geneal Desciption : Maxwell Equations & Loentz Foce We want to find the equations of motion of chaged paticles. The way to do
More informationDistributed Adaptive Networks: A Graphical Evolutionary Game-Theoretic View
Distibuted Adaptive Netwoks: A Gaphical Evolutionay Gae-Theoetic View Chunxiao Jiang, Mebe, IEEE, Yan Chen, Mebe, IEEE, and K. J. Ray Liu, Fellow, IEEE axiv:.45v [cs.gt] Sep 3 Abstact Distibuted adaptive
More informationINTRODUCTION. 2. Vectors in Physics 1
INTRODUCTION Vectos ae used in physics to extend the study of motion fom one dimension to two dimensions Vectos ae indispensable when a physical quantity has a diection associated with it As an example,
More informationThe Concept of the Effective Mass Tensor in GR. Clocks and Rods
The Concept of the Effective Mass Tenso in GR Clocks and Rods Miosław J. Kubiak Zespół Szkół Technicznych, Gudziądz, Poland Abstact: In the pape [] we pesented the concept of the effective ass tenso (EMT)
More informationClass 6 - Circular Motion and Gravitation
Class 6 - Cicula Motion and Gavitation pdf vesion [http://www.ic.sunysb.edu/class/phy141d/phy131pdfs/phy131class6.pdf] Fequency and peiod Fequency (evolutions pe second) [ o ] Peiod (tie fo one evolution)
More informationMulti-relational Weighted Tensor Decomposition
Multi-elational Weighted Tenso Decoposition Ben London, Theodoos Rekatsinas, Bet Huang, and Lise Getoo Depatent of Copute Science Univesity of Mayland, College Pak College Pak, MD 20742 {blondon,thodek,bet,getoo}@cs.ud.edu
More informationProbability Distribution (Probability Model) Chapter 2 Discrete Distributions. Discrete Random Variable. Random Variable. Why Random Variable?
Discete Distibutions - Chapte Discete Distibutions Pobability Distibution (Pobability Model) If a balanced coin is tossed, Head and Tail ae equally likely to occu, P(Head) = = / and P(Tail) = = /. Rando
More informationSome Ideal Convergent Sequence Spaces Defined by a Sequence of Modulus Functions Over n-normed Spaces
MATEMATIKA, 203, Volue 29, Nube 2, 87 96 c Depatent of Matheatical Sciences, UTM. Soe Ideal Convegent Sequence Spaces Defined by a Sequence of Modulus Functions Ove n-noed Spaces Kuldip Raj and 2 Sunil
More informationAbsorption Rate into a Small Sphere for a Diffusing Particle Confined in a Large Sphere
Applied Mathematics, 06, 7, 709-70 Published Online Apil 06 in SciRes. http://www.scip.og/jounal/am http://dx.doi.og/0.46/am.06.77065 Absoption Rate into a Small Sphee fo a Diffusing Paticle Confined in
More informationResearch Article On Alzer and Qiu s Conjecture for Complete Elliptic Integral and Inverse Hyperbolic Tangent Function
Abstact and Applied Analysis Volume 011, Aticle ID 697547, 7 pages doi:10.1155/011/697547 Reseach Aticle On Alze and Qiu s Conjectue fo Complete Elliptic Integal and Invese Hypebolic Tangent Function Yu-Ming
More informationA question of Gol dberg concerning entire functions with prescribed zeros
A question of Gol dbeg concening entie functions with pescibed zeos Walte Begweile Abstact Let (z j ) be a sequence of coplex nubes satisfying z j as j and denote by n() the nube of z j satisfying z j.
More informationEstimation of the Correlation Coefficient for a Bivariate Normal Distribution with Missing Data
Kasetsat J. (Nat. Sci. 45 : 736-74 ( Estimation of the Coelation Coefficient fo a Bivaiate Nomal Distibution with Missing Data Juthaphon Sinsomboonthong* ABSTRACT This study poposes an estimato of the
More informationyou of a spring. The potential energy for a spring is given by the parabola U( x)
Small oscillations The theoy of small oscillations is an extemely impotant topic in mechanics. Conside a system that has a potential enegy diagam as below: U B C A x Thee ae thee points of stable equilibium,
More information19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007
9 th INERNAIONAL CONGRESS ON ACOUSICS MADRID, -7 SEPEMBER 007 BAYESIAN ANALYSIS IN CHARACERIZING SOUND ENERGY DECAY: A QUANIAIVE HEORY OF INFERENCE IN ROOM ACOUSICS PACS: 43.55.B; 43.55.Mc Xiang, Ning
More information5th International Conference on Advanced Materials and Computer Science (ICAMCS 2016)
5th Intenational Confeence on Advanced Mateials and Copute Science (ICAMCS 016) Design and Siulation of Finite-tie Convegence with Ipact angle constaint Sliding-ode Guidance Law Kai Zhang, Suo-chang Yang,
More informationMany Electron Atoms. Electrons can be put into approximate orbitals and the properties of the many electron systems can be catalogued
Many Electon Atoms The many body poblem cannot be solved analytically. We content ouselves with developing appoximate methods that can yield quite accuate esults (but usually equie a compute). The electons
More informationA generalization of the Bernstein polynomials
A genealization of the Benstein polynomials Halil Ouç and Geoge M Phillips Mathematical Institute, Univesity of St Andews, Noth Haugh, St Andews, Fife KY16 9SS, Scotland Dedicated to Philip J Davis This
More informationQuadratic Harmonic Number Sums
Applied Matheatics E-Notes, (), -7 c ISSN 67-5 Available fee at io sites of http//www.ath.nthu.edu.tw/aen/ Quadatic Haonic Nube Sus Anthony Sofo y and Mehdi Hassani z Received July Abstact In this pape,
More information6 PROBABILITY GENERATING FUNCTIONS
6 PROBABILITY GENERATING FUNCTIONS Cetain deivations pesented in this couse have been somewhat heavy on algeba. Fo example, detemining the expectation of the Binomial distibution (page 5.1 tuned out to
More informationLECTURE 15. Phase-amplitude variables. Non-linear transverse motion
LETURE 5 Non-linea tansvese otion Phase-aplitude vaiables Second ode (quadupole-diven) linea esonances Thid-ode (sextupole-diven) non-linea esonances // USPAS Lectue 5 Phase-aplitude vaiables Although
More informationChaotic Analysis on Precipitation Time Series of Sichuan Middle Part in Upper Region of Yangtze
Natue and Science, (), 4, en, iang and Zhao, Chaotic Analysis on Pecipitation Tie Seies Chaotic Analysis on Pecipitation Tie Seies of Sichuan iddle Pat in Uppe Region of angtze Baohui en,, Chuan iang,
More informationRigid Body Dynamics 2. CSE169: Computer Animation Instructor: Steve Rotenberg UCSD, Winter 2018
Rigid Body Dynamics 2 CSE169: Compute Animation nstucto: Steve Rotenbeg UCSD, Winte 2018 Coss Poduct & Hat Opeato Deivative of a Rotating Vecto Let s say that vecto is otating aound the oigin, maintaining
More informationEncapsulation theory: radial encapsulation. Edmund Kirwan *
Encapsulation theoy: adial encapsulation. Edmund Kiwan * www.edmundkiwan.com Abstact This pape intoduces the concept of adial encapsulation, wheeby dependencies ae constained to act fom subsets towads
More informationOn generalized Laguerre matrix polynomials
Acta Univ. Sapientiae, Matheatica, 6, 2 2014 121 134 On genealized Laguee atix polynoials Raed S. Batahan Depatent of Matheatics, Faculty of Science, Hadhaout Univesity, 50511, Mukalla, Yeen eail: batahan@hotail.co
More informationRobust Spectrum Decision Protocol against Primary User Emulation Attacks in Dynamic Spectrum Access Networks
Robust Spectu Decision Potocol against Piay Use Eulation Attacks in Dynaic Spectu Access Netwoks Z. Jin, S. Anand and K. P. Subbalakshi Depatent of Electical and Copute Engineeing Stevens Institute of
More informationDuality between Statical and Kinematical Engineering Systems
Pape 00, Civil-Comp Ltd., Stiling, Scotland Poceedings of the Sixth Intenational Confeence on Computational Stuctues Technology, B.H.V. Topping and Z. Bittna (Editos), Civil-Comp Pess, Stiling, Scotland.
More informationFeature Extraction for Incomplete Data via Low-rank Tensor Decomposition with Feature Regularization
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS. ACCEPTED: TNNLS-208-P-9324. Featue Extaction fo Incoplete Data via Low-ank Tenso Decoposition with Featue Regulaization Qiquan Shi, Student Mebe,
More informationBOUNDEDNESS AND APERIODICITY OF COMMERCIAL SIGMA DELTA MODULATORS
BOUNDEDNESS AND APERIODICITY OF COMMERCIAL SIGMA DELTA MODULATORS Heni Huijbets, Alexey Pavlov, Josh Reiss 3 Depatent of Engineeing, 3 Depatent of Electonic Engineeing Queen May, Univesity of London Mile
More informationPROBLEM SET #1 SOLUTIONS by Robert A. DiStasio Jr.
POBLM S # SOLUIONS by obet A. DiStasio J. Q. he Bon-Oppenheime appoximation is the standad way of appoximating the gound state of a molecula system. Wite down the conditions that detemine the tonic and
More information1 Random Variable. Why Random Variable? Discrete Random Variable. Discrete Random Variable. Discrete Distributions - 1 DD1-1
Rando Vaiable Pobability Distibutions and Pobability Densities Definition: If S is a saple space with a pobability easue and is a eal-valued function defined ove the eleents of S, then is called a ando
More informationMath 2263 Solutions for Spring 2003 Final Exam
Math 6 Solutions fo Sping Final Exam ) A staightfowad appoach to finding the tangent plane to a suface at a point ( x, y, z ) would be to expess the cuve as an explicit function z = f ( x, y ), calculate
More informationMoment-free numerical approximation of highly oscillatory integrals with stationary points
Moment-fee numeical appoximation of highly oscillatoy integals with stationay points Sheehan Olve Abstact We pesent a method fo the numeical quadatue of highly oscillatoy integals with stationay points.
More informationA scaling-up methodology for co-rotating twin-screw extruders
A scaling-up methodology fo co-otating twin-scew extudes A. Gaspa-Cunha, J. A. Covas Institute fo Polymes and Composites/I3N, Univesity of Minho, Guimaães 4800-058, Potugal Abstact. Scaling-up of co-otating
More informationStanford University CS259Q: Quantum Computing Handout 8 Luca Trevisan October 18, 2012
Stanfod Univesity CS59Q: Quantum Computing Handout 8 Luca Tevisan Octobe 8, 0 Lectue 8 In which we use the quantum Fouie tansfom to solve the peiod-finding poblem. The Peiod Finding Poblem Let f : {0,...,
More informationA NEW VARIABLE STIFFNESS SPRING USING A PRESTRESSED MECHANISM
Poceedings of the ASME 2010 Intenational Design Engineeing Technical Confeences & Computes and Infomation in Engineeing Confeence IDETC/CIE 2010 August 15-18, 2010, Monteal, Quebec, Canada DETC2010-28496
More informationA Converse to Low-Rank Matrix Completion
A Convese to Low-Rank Matix Completion Daniel L. Pimentel-Alacón, Robet D. Nowak Univesity of Wisconsin-Madison Abstact In many pactical applications, one is given a subset Ω of the enties in a d N data
More informationCOLLAPSING WALLS THEOREM
COLLAPSING WALLS THEOREM IGOR PAK AND ROM PINCHASI Abstact. Let P R 3 be a pyamid with the base a convex polygon Q. We show that when othe faces ae collapsed (otated aound the edges onto the plane spanned
More informationBounds on the performance of back-to-front airplane boarding policies
Bounds on the pefomance of bac-to-font aiplane boading policies Eitan Bachmat Michael Elin Abstact We povide bounds on the pefomance of bac-to-font aiplane boading policies. In paticula, we show that no
More informationVanishing lines in generalized Adams spectral sequences are generic
ISSN 364-0380 (on line) 465-3060 (pinted) 55 Geomety & Topology Volume 3 (999) 55 65 Published: 2 July 999 G G G G T T T G T T T G T G T GG TT G G G G GG T T T TT Vanishing lines in genealized Adams spectal
More informationSurveillance Points in High Dimensional Spaces
Société de Calcul Mathématique SA Tools fo decision help since 995 Suveillance Points in High Dimensional Spaces by Benad Beauzamy Januay 06 Abstact Let us conside any compute softwae, elying upon a lage
More informationUnobserved Correlation in Ascending Auctions: Example And Extensions
Unobseved Coelation in Ascending Auctions: Example And Extensions Daniel Quint Univesity of Wisconsin Novembe 2009 Intoduction In pivate-value ascending auctions, the winning bidde s willingness to pay
More informationCentripetal Force OBJECTIVE INTRODUCTION APPARATUS THEORY
Centipetal Foce OBJECTIVE To veify that a mass moving in cicula motion expeiences a foce diected towad the cente of its cicula path. To detemine how the mass, velocity, and adius affect a paticle's centipetal
More informationNew Approach to Predict the Micromechanical. Behavior of a Multiphase Composite Material
Advanced Studies in Theoetical Physics Vol. 8, 2014, no. 20, 869-873 HIKARI Ltd, www.-hikai.co http://dx.doi.og/10.12988/astp.2014.4677 New Appoach to Pedict the Micoechanical Behavio of a Multiphase oposite
More informationPulse Neutron Neutron (PNN) tool logging for porosity Some theoretical aspects
Pulse Neuton Neuton (PNN) tool logging fo poosity Some theoetical aspects Intoduction Pehaps the most citicism of Pulse Neuton Neuon (PNN) logging methods has been chage that PNN is to sensitive to the
More informationRevision of Lecture Eight
Revision of Lectue Eight Baseband equivalent system and equiements of optimal tansmit and eceive filteing: (1) achieve zeo ISI, and () maximise the eceive SNR Thee detection schemes: Theshold detection
More informationLight Time Delay and Apparent Position
Light Time Delay and ppaent Position nalytical Gaphics, Inc. www.agi.com info@agi.com 610.981.8000 800.220.4785 Contents Intoduction... 3 Computing Light Time Delay... 3 Tansmission fom to... 4 Reception
More informationAn Adaptive Neural-Network Model-Following Speed Control of PMSM Drives for Electric Vehicle Applications
Poceedings of the 9th WSEAS Intenational Confeence on Applied Mathematics, Istanbul, Tuey, May 27-29, 2006 (pp412-417) An Adaptive Neual-Netwo Model-Following Speed Contol of PMSM Dives fo Electic Vehicle
More informationANALYSIS OF QUANTUM EIGENSTATES IN A 3-MODE SYSTEM
AAYSIS OF QUATUM EIGESTATES I A 3-MODE SYSTEM SRIHARI KESHAVAMURTHY AD GREGORY S. EZRA Depatment of Chemisty, Bake aboatoy Conell Univesity, Ithaca, Y 14853, USA. Abstact. We study the quantum eigenstates
More informationINFORMATION GEOMETRY OF PROPAGATION ALGORITHMS AND APPROXIMATE INFERENCE
2nd Intenational Symposium on Infomation Geomety and its Applications Decembe 12-16, 2005, Tokyo Pages 000 000 INFORMATION GEOMETRY OF PROPAGATION ALGORITHMS AND APPROXIMATE INFERENCE SHIRO IKEDA 1 intoduction
More informationTopic 4a Introduction to Root Finding & Bracketing Methods
/8/18 Couse Instucto D. Raymond C. Rumpf Office: A 337 Phone: (915) 747 6958 E Mail: cumpf@utep.edu Topic 4a Intoduction to Root Finding & Backeting Methods EE 4386/531 Computational Methods in EE Outline
More informationVerified Solution for a Statically Determinate Truss Structure with Uncertain Node Locations
Nov. 00, Volue, No. (Seial No. 6 Jounal of Civil Engineeing and Achitectue, ISSN 9-79, USA Veified Solution fo a Statically Deteinate Tuss Stuctue with Uncetain Node Locations Andew P. Sith, Jügen Galoff
More informationTHE LEAST COMMON MULTIPLE OF RANDOM SETS OF POSITIVE INTEGERS. 1. Introduction
THE LEAST COMMON MULTIPLE OF RANDOM SETS OF POSITIVE INTEGERS JAVIER CILLERUELO, JUANJO RUÉ, PAULIUS ŠARKA, AND ANA ZUMALACÁRREGUI Abstact. We study the typical behavio of the least coon ultiple of the
More informationLead field theory and the spatial sensitivity of scalp EEG Thomas Ferree and Matthew Clay July 12, 2000
Lead field theoy and the spatial sensitivity of scalp EEG Thomas Feee and Matthew Clay July 12, 2000 Intoduction Neuonal population activity in the human cotex geneates electic fields which ae measuable
More informationPhysics 2B Chapter 22 Notes - Magnetic Field Spring 2018
Physics B Chapte Notes - Magnetic Field Sping 018 Magnetic Field fom a Long Staight Cuent-Caying Wie In Chapte 11 we looked at Isaac Newton s Law of Gavitation, which established that a gavitational field
More informationLiquid gas interface under hydrostatic pressure
Advances in Fluid Mechanics IX 5 Liquid gas inteface unde hydostatic pessue A. Gajewski Bialystok Univesity of Technology, Faculty of Civil Engineeing and Envionmental Engineeing, Depatment of Heat Engineeing,
More informationMotion in One Dimension
Motion in One Dimension Intoduction: In this lab, you will investigate the motion of a olling cat as it tavels in a staight line. Although this setup may seem ovesimplified, you will soon see that a detailed
More informationClassical Worm algorithms (WA)
Classical Wom algoithms (WA) WA was oiginally intoduced fo quantum statistical models by Pokof ev, Svistunov and Tupitsyn (997), and late genealized to classical models by Pokof ev and Svistunov (200).
More informationAnalytical Solutions for Confined Aquifers with non constant Pumping using Computer Algebra
Poceedings of the 006 IASME/SEAS Int. Conf. on ate Resouces, Hydaulics & Hydology, Chalkida, Geece, May -3, 006 (pp7-) Analytical Solutions fo Confined Aquifes with non constant Pumping using Compute Algeba
More informationLecture 23: Central Force Motion
Lectue 3: Cental Foce Motion Many of the foces we encounte in natue act between two paticles along the line connecting the Gavity, electicity, and the stong nuclea foce ae exaples These types of foces
More informationMutually unbiased bases, orthogonal Latin squares, and hidden-variable models
Mutually unbiased bases, othogonal Latin squaes, and hidden-vaiable odels Toasz Pateek, 1 Boivoje Dakić, 1,2 and Časlav Bukne 1,2 1 Institute fo Quantu Optics and Quantu Infoation, Austian Acadey of Sciences,
More informationTHE JEU DE TAQUIN ON THE SHIFTED RIM HOOK TABLEAUX. Jaejin Lee
Koean J. Math. 23 (2015), No. 3, pp. 427 438 http://dx.doi.og/10.11568/kjm.2015.23.3.427 THE JEU DE TAQUIN ON THE SHIFTED RIM HOOK TABLEAUX Jaejin Lee Abstact. The Schensted algoithm fist descibed by Robinson
More informationHammerstein Model Identification Based On Instrumental Variable and Least Square Methods
Intenational Jounal of Emeging Tends & Technology in Compute Science (IJETTCS) Volume 2, Issue, Januay Febuay 23 ISSN 2278-6856 Hammestein Model Identification Based On Instumental Vaiable and Least Squae
More informationThree-dimensional Quantum Cellular Neural Network and Its Application to Image Processing *
Thee-dimensional Quantum Cellula Neual Netwok and Its Application to Image Pocessing * Sen Wang, Li Cai, Huanqing Cui, Chaowen Feng, Xiaokuo Yang Science College, Ai Foce Engineeing Univesity Xi an 701,
More informationDESIGN AND IMPLEMENTATION OF SPLIT RADIX ALGORITHM FOR LENGTH - 6 M DFT USING VLSI AND FPGA
ITERATIOAL JOURAL OF RESEARCH I COMPUTER APPLICATIOS AD ROBOTICS www.ijca.co Vol. Issue.7, Pg.: -45 ITERATIOAL JOURAL OF RESEARCH I COMPUTER APPLICATIOS AD ROBOTICS ISS -745 DESIG AD IMPLEMETATIO OF SPLIT
More information