Best approximation by linear combinations of characteristic functions of half-spaces
|
|
- Helen Lewis
- 5 years ago
- Views:
Transcription
1 Best aroximation by linear combinations of characteristic functions of half-saces Paul C. Kainen Deartment of Mathematics Georgetown University Washington, D.C , USA Věra Kůrková Institute of Comuter Science, Academy of Sciences of the Czech Reublic Prague 8, Czech Reublic Andrew Vogt Deartment of Mathematics Georgetown University Washington, D.C , USA Journal of Aroximation Theory, Volume 122, Number 2, June 2003,
2 Proosed running head: Half-sace characteristic functions Name and address of corresonding author: Andrew Vogt Deartment of Mathematics Georgetown University Washington, D.C , USA 2
3 Abstract It is shown that for any ositive integer n and any function in L ([0, 1] d ) with [1, ) there exists a best aroximation by linear combinations of n characteristic functions of half-saces. Further, sequences of such linear combinations converging in distance to the best aroximation distance have subsequences converging to the best aroximation, i.e., these linear combinations are an aroximatively comact set. Keywords. Best aroximation, roximinal, aroximatively comact, boundedly comact, Heaviside ercetron networks, lane waves. 3
4 1 Introduction An imortant tye of nonlinear aroximation is variable-basis aroximation, where the set of aroximating functions is formed by linear combinations of n functions from a given set. This aroximation scheme has been widely investigated: it includes slines with free nodes, trigonometric olynomials with free frequencies, sums of wavelets, and feedforward neural networks. To estimate rates of variable-basis aroximation, it is helful to study roerties like existence, uniqueness, and continuity of corresonding aroximation oerators. Here we investigate the existence roerty for one-hidden-layer Heaviside ercetron networks, i.e., aroximations by linear combinations of characteristic functions of closed half-saces. Such functions are obtained by comosing the Heaviside function with affine functions. We show that for all ositive integers n, d in L ([0, 1] d ) with [1, ) there exists a best aroximation maing to the set of functions comutable by Heaviside ercetron networks with n hidden and d inut units. Thus for any -integrable function on [0, 1] d there is a linear combination of n characteristic functions of closed half-saces that is nearest in the L -norm. A related roosition is roved by Chui, Li, and Mhaskar in [1], where certain sequences are shown to have subsequences that converge a. e. These authors work in R d rather than [0, 1] d and show a. e. convergence rather than L convergence. 2 Heaviside ercetron networks Feedforward networks comute arametrized sets of functions deendent both on the tye of comutational units and their interconnections. Comutational units comute functions of two vector variables: an inut vector and a arameter vector. A standard tye of comutational unit is the ercetron. A ercetron with an activation function ψ : R R (where R denotes the set of real numbers) comutes real-valued functions on R d R d+1 of the form ψ(v x + b), where x R d is an inut vector, v R d is an inut weight vector, and b R is a bias. The most common activation functions are sigmoidals, i.e., functions with ess-shaed grah. Both continuous and discontinuous sigmoidals are used. Here we study networks based on the archetyal discontinuous sigmoidal, namely, the Heaviside function ϑ defined by ϑ(t) = 0 for t < 0 and ϑ(t) = 1 for t 0. Let H d denote the set of functions on [0, 1] d comutable by Heaviside ercetrons, i.e., H d = {f : [0, 1] d R : f(x) = ϑ(v x + b), v R d, b R}. H d is the set of characteristic functions of closed half-saces of R d restricted to [0, 1] d, which is a subset of the set of lane waves (see, e.g., Courant and Hilbert [2, ]). For A R d we denote by ξ A the characteristic function of A, i.e., ξ A (x) = 1 for x A and χ A (x) = 0 for x / A. The simlest tye of multilayer feedforward network has one hidden layer and one linear outut. Such networks with Heaviside ercetrons in the hidden layer comute functions of the form n w i ϑ(v i x + b i ), i=1 where n is the number of hidden units, w i R are outut weights, and v i R d and b i R are inut weights and biases resectively. 4
5 The set of all such functions is the set of all linear combinations of n elements of H d and is denoted by san n H d. It is known that for all ositive integers d, n N+ san n H d (where N + denotes the set of all ositive integers) is dense in (C([0, 1] d ),. C ), the linear sace of all continuous functions on [0, 1] d with the suremum norm, as well as in (L ([0, 1] d ),. ) with [1, ] (see, e.g., Mhaskar and Micchelli [10] or Leshno et al. [9]). We study best aroximation in san n H d for a fixed n. 3 Existence of a best aroximation Existence of a best aroximation has been formalized in aroximation theory by the concet of roximinal set (sometimes also called existence set). A subset M of a normed linear sace (X,. ) is called roximinal if for every f X the distance f M = inf g M f g is achieved for some element of M, i.e., f M = min g M f g (Singer [13]). Clearly a roximinal subset must be closed. A sufficient condition for roximinality of a subset M of a normed linear sace (X,. ) is comactness (i.e., each sequence of elements of M has a subsequence convergent to an element of M). Indeed, for each f X the functional e {f} : M R defined by e {f} (m) = m f is continuous [13,. 391] and hence must achieve its minimum on any comact set M. Gurvits and Koiran [5] have shown that for all ositive integers d the set of characteristic functions of half-saces H d is comact in (L ([0, 1] d ),. ) with [1, ). This can be easily verified once the set H d is rearametrized by elements of the unit shere S d in R d+1. Indeed, a function ϑ(v x + b), with the vector (v 1,..., v d, b) R d+1 nonzero, is equal to ϑ(ˆv x + ˆb), where (ˆv 1,..., ˆv d, ˆb) S d is obtained from (v 1,..., v d, b) R d+1 by normalization. Strictly seaking, H d is arametrized by equivalence classes in S d since different arametrizations may reresent the same member of H d when restricted to [0, 1] d. Since S d is comact, and the quotient sace formed by the equivalence classes is likewise, so is H d. However, by extending H d into san n H d for any ositive integer n we lose comactness since the norms are not bounded. Nevertheless comactness can be relaced by a weaker roerty that requires only some sequences to have convergent subsequences. A subset M of a normed linear sace (X,. ) is called aroximatively comact if for each f X and any sequence {g i : i N + } in M such that i f g i = f M, there exists g M such that {g i : i N + } converges subsequentially to g [13,.368]. The following theorem shows that san n H d is aroximatively comact in L -saces. It extends a weaker result by Kůrková [8], who showed that san n H d is closed in L -saces with (1, ). Theorem 3.1 For every n, d ositive integers and for every [1, ) san n H d is an aroximatively comact subset of (L ([0, 1] d,. ). To rove the theorem we need the following lemma. For a set A P(A) denotes the set of all subsets of A. Lemma 3.2 Let m be a ositive integer, { : k N +, j = 1,..., m} be m sequences of real numbers, and S P({1,..., m}) be such that for each S S j S = c S for some c S R. Then there exist real numbers {a j : j = 1,..., m} such that for each S S j S a j = c S. 5
6 Proof. Let = card S and let S = {S 1,..., S }. Define T : R m R by T (x 1,..., x m ) = ( j S 1 x j,..., j S x j ). Then T is linear, and hence its range is a subsace of R and so is a closed set. Since (c S1,..., c S ) cl T (R m ) = T (R m ), there exists (a 1,..., a m ) R m with (c S1,..., c S ) = T (a 1,..., a m ). Proof of Theorem 3.1 Let f L ([0, 1] d ) and let { n j=1 g jk : k N + } be a sequence of elements of san n H d such that f n j=1 g jk = f san n H d. Since H d is comact, by assing to suitable subsequences we can assume that for all j = 1,..., n, there exist g j H d such that g jk = g j (here and in the sequel, we use the notation to mean a it of a suitable subsequence). We shall show that there exist real numbers a 1,..., a n such that f san n H d = f n a j g j. (1) Then using (1) we shall show even that { n j=1 g jk : k N + } converges to n j=1 a jg j in. subsequentially. Decomose {1,..., n} into two disjoint subsets I and J such that I consists of those j for which the sequences { : k N + } have convergent subsequences, and J of those j for which the sequences { : k N + } diverge. Again, by assing to suitable subsequences we can assume that for all j I, = a j. Thus { j I g jk : k N + } converges subsequentially to j I a jg j. Set h = f j I a jg j. Since for all j I, the chosen subsequences { : k N + } and {g jk : k N + } are bounded, we have f san n H d = f n j=1 g jk = h j J g jk. Let S denotes the set of all subsets of J. Decomose S into two disjoint subsets S 1 and S 2 such that S 1 consists of those S S for which by assage to suitable subsequences j S = c S for some c S R, and S 2 consists of those S S for which j S =. Note that the emty set is in S 1 with the convention j = 0. Using Lemma 3.2, for all j S 1, we get a j R such that for all S S 1, j S a j = c S. For j J S 1, set a j = 0. j=1 a jg j and thus to Since n j=1 a jg j san n H d, we have f san n H d f n rove (1), it is sufficient to show that f san n H d f n [0,1] d h g jk dµ j J j=1 [0,1] d j=1 a jg j or equivalently h a j g j dµ (2) j J where µ is Lebesgue measure on [0, 1] d. To verify (2), for each k N + we shall decomose the integration over [0, 1] d into sum of integrals over convex regions where the functions j J g jk are constant. To describe such regions, we shall define artitions of [0, 1] d determined by families of characteristic functions {g jk : j J, k N + }, and {g j : j J}. The artitions are indexed by the elements of the set S of all subsets of J. For k N +, a artition { : S S} is defined by = {x [0, 1] d : (g jk (x) = 1 j S)}, and similarly a artition {T (S) : S S} is defined by T (S) = {x [0, 1] d : g j (x) = 1 j S}. Notice that since for all j = 1,..., n, 6
7 g jk = g j in L ([0, 1] d ), we have µ() = µ(t (S)) for all S S. Indeed, the characteristic function of equals the roduct j S g jk j / S (1 g jk) and converges in L ([0, 1] d ) to the characteristic function of T (S), the latter equal to j S g j j / S (1 g j). Using the definition of (in articular its roerty guaranteeing that for all S S, is just the region where for all j S and no other j J, g jk is equal to 1), we get [0,1] d h g jk dµ = j J h dµ = 1 h dµ + 2 h dµ h dµ. (3) Since for all S S, µ() = µ(t (S)) and for all S S 1, j S = c S = j S a j, we have 1 h dµ = 1 h a j dµ = T (S) h a j dµ. For all S S, by the triangle inequality in L () h j S j S dµ dµ 1/ 1/ ( ) 1/ + h dµ [0,1] d h g jk dµ j J 1/ + ( [0,1] d h dµ ) 1/ = f san n H d + h. Thus for all S S, j S dµ is finite. In articular this is true when S S 2, for which j S =, and so µ() = 0 = µ(t (S)) for S S 2. Thus we can relace the integration over 1 T (S) by the integration over the whole of [0, 1] d and so we obtain 7
8 T (S) h j S a j dµ = [0,1] d h a j g j dµ, j J which roves (2). Moreover, as a byroduct we even get that h dµ = 0, (4) 2 since in (3) the left hand side is equal to the right hand side (both are equal to f san n H d ). So we have shown that san n H d is roximinal. Now we shall verify that it is even aroximatively comact by showing that { j J g jk : k N + } converges subsequentially to j J a jg j, or equivalently ( g jk a j g j ) dµ = 0. (5) [0,1] d j J As above, we start by decomosing the integration into sum of integrals over convex regions. The left hand side of (5) is equal to ( a j g j ) dµ + ( a j g j ) dµ. j S 2 Using the triangle inequality, (4), and µ() = 0 for all S S 2, we get ( a j g j ) dµ 2 j S 2 h dµ + 2 h a j g j dµ = h a j g j dµ = T (S) h a j g j dµ = 0 2 since µ(t (S)) = 0 for S S 2. Thus 2 j S ( a j g j ) dµ = 0, which imlies that the left hand side of (5) is equal to j S 2 ( a j g j ) dµ = T (S) j S j S a j g j a j g j dµ = 0 because ( j S g jk )χ Tk (S) = ( j S )χ Tk (S) converges to c S χ T (S) = ( j S a jg j )χ T (S) in L ([0, 1] d ). 8
9 So j J g jk = j J a jg j, the same is already known to be true when J is relaced by I, and hence also n j=1 g jk = n j=1 a jg j subsequentially in L ([0, 1] d ). Theorem 3.1 shows that a function in L ([0, 1] d ) has a best aroximation among functions comutable by one-hidden-layer networks with a single linear outut unit and n Heaviside ercetrons in the hidden layer. In other words, in the sace of arameters of networks of this tye, there exists a global minimum of the error functional defined as L -distance from the function to be aroximated. Combining Theorem 3.1 with results from [7], we get the following corollary. Corollary 3.3 In (L ([0, 1] d ),. ) with (1, ) for all n, d ositive integers there exists a best aroximation maing from L ([0, 1] d ) to san n H d, but no such maing is continuous. 4 Discussion In Proosition 3.3 of [1] the authors show that any sequence {P k } in san n H d, with the roerty that su k P k L1 (K) 1 for every comact set K in R d, has a subsequence converging a. e. in R d to a member of san n H d. Although the roof techniques in [1] do have some overla with those used here, the results there are different. A. e. convergence need not imly L convergence for [1, ): the sequence P k = (k) 1 χ[0, 1 k ] converges a. e. in L (R 1 ) but has no convergent subsequence in the L -norm. Since this sequence is bounded and has no convergent subsequences, it also illustrates that san n H d is not boundedly comact. Another examle of an aroximatively comact set that is not boundedly comact is any closed infinite-dimensional subsace of a uniformly convex Banach sace. Theorem 3.1 cannot be extended to ercetron networks with differentiable activation functions, e.g., the logistic sigmoid or hyerbolic tangent. For such functions, sets san n P d (ψ) (where P d (ψ) = {f : [0, 1] d R : f(x) = ψ(v x + b), v R d, b R}) are not closed and hence cannot be roximinal. This was first observed by Girosi and Poggio [4] and later exloited by Leschno et al. [9] for a roof of the universal aroximation roerty. Theorem 3.1 does not offer any information on the error of the best aroximation. Estimates in the literature (DeVore, Howard, and Micchelli [3], Pinkus [11], Pinkus [12]) that give lower bounds on such errors and deend on continuity of best aroximation oerators are not alicable because of Corollary 3.3. Acknowledgment V. Kůrková was artially suorted by GA ČR grants 201/99/0092 and 201/02/0428. Collaboration of V. Kůrková and P. C. Kainen was suorted in art by an NRC COBASE grant. References [1] C. K. Chui, X. Li, and H. N. Mhaskar, Neural networks for localized aroximation. Math. of Comutation 63 (1994),
10 [2] R. Courant and D. Hilbert, Methods of Mathematical Physics, vol. II, Wiley, New York, [3] R. DeVore, R. Howard, and C. Micchelli, Otimal nonlinear aroximation. Manuscrita Math. 63 (1989), [4] F. Girosi and T. Poggio, Networks and the best aroximation roerty, Biological Cybernetics 63 (1990), [5] L. Gurvits and P. Koiran, Aroximation and learning of convex suerositions. J. of Comuter and System Sciences 55, (1997), [6] P. C. Kainen, V. Kůrková, and A. Vogt, Aroximation by neural networks is not continuous. Neurocomuting 29 (1999), [7] P. C. Kainen, V. Kůrková, and A. Vogt, Geometry and toology of continuous best and near best aroximations. J. Arox. Theory 105 (2000), [8] V. Kůrková, Aroximation of functions by ercetron networks with bounded number of hidden units. Neural Networks 8 (1995), [9] M. Leschno, V. Y. Lin, A. Pinkus, and S. Schocken, Multilayer feedforward networks with a nonolynomial activation can aroximate any function. Neural Networks 6 (1993), [10] H. N. Mhaskar and C. Micchelli, Aroximation by suerosition of sigmoidal and radial basis functions. Advances in Alied Math. 13 (1992), [11] A. Pinkus, n-width in Aroximation Theory, Sringer-Verlag, Berlin, [12] A. Pinkus, Aroximation theory of the MLP model in neural networks. Acta Numerica 8 (1999), [13] I. Singer, Best Aroximation in Normed Linear Saces by Elements of Linear Subsaces, Sringer-Verlag, Berlin,
Geometry and topology of continuous best and near best approximations
Journal of Approximation Theory 105: 252 262, Geometry and topology of continuous best and near best approximations Paul C. Kainen Dept. of Mathematics Georgetown University Washington, D.C. 20057 Věra
More informationGENERICITY OF INFINITE-ORDER ELEMENTS IN HYPERBOLIC GROUPS
GENERICITY OF INFINITE-ORDER ELEMENTS IN HYPERBOLIC GROUPS PALLAVI DANI 1. Introduction Let Γ be a finitely generated grou and let S be a finite set of generators for Γ. This determines a word metric on
More informationElementary theory of L p spaces
CHAPTER 3 Elementary theory of L saces 3.1 Convexity. Jensen, Hölder, Minkowski inequality. We begin with two definitions. A set A R d is said to be convex if, for any x 0, x 1 2 A x = x 0 + (x 1 x 0 )
More informationHaar type and Carleson Constants
ariv:0902.955v [math.fa] Feb 2009 Haar tye and Carleson Constants Stefan Geiss October 30, 208 Abstract Paul F.. Müller For a collection E of dyadic intervals, a Banach sace, and,2] we assume the uer l
More informationMATH 6210: SOLUTIONS TO PROBLEM SET #3
MATH 6210: SOLUTIONS TO PROBLEM SET #3 Rudin, Chater 4, Problem #3. The sace L (T) is searable since the trigonometric olynomials with comlex coefficients whose real and imaginary arts are rational form
More informationON THE NORM OF AN IDEMPOTENT SCHUR MULTIPLIER ON THE SCHATTEN CLASS
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Number 0, Pages 000 000 S 000-9939XX)0000-0 ON THE NORM OF AN IDEMPOTENT SCHUR MULTIPLIER ON THE SCHATTEN CLASS WILLIAM D. BANKS AND ASMA HARCHARRAS
More informationApproximating min-max k-clustering
Aroximating min-max k-clustering Asaf Levin July 24, 2007 Abstract We consider the roblems of set artitioning into k clusters with minimum total cost and minimum of the maximum cost of a cluster. The cost
More informationExtremal Polynomials with Varying Measures
International Mathematical Forum, 2, 2007, no. 39, 1927-1934 Extremal Polynomials with Varying Measures Rabah Khaldi Deartment of Mathematics, Annaba University B.P. 12, 23000 Annaba, Algeria rkhadi@yahoo.fr
More informationLEIBNIZ SEMINORMS IN PROBABILITY SPACES
LEIBNIZ SEMINORMS IN PROBABILITY SPACES ÁDÁM BESENYEI AND ZOLTÁN LÉKA Abstract. In this aer we study the (strong) Leibniz roerty of centered moments of bounded random variables. We shall answer a question
More informationMultiplicity of weak solutions for a class of nonuniformly elliptic equations of p-laplacian type
Nonlinear Analysis 7 29 536 546 www.elsevier.com/locate/na Multilicity of weak solutions for a class of nonuniformly ellitic equations of -Lalacian tye Hoang Quoc Toan, Quô c-anh Ngô Deartment of Mathematics,
More informationGENERALIZED NORMS INEQUALITIES FOR ABSOLUTE VALUE OPERATORS
International Journal of Analysis Alications ISSN 9-8639 Volume 5, Number (04), -9 htt://www.etamaths.com GENERALIZED NORMS INEQUALITIES FOR ABSOLUTE VALUE OPERATORS ILYAS ALI, HU YANG, ABDUL SHAKOOR Abstract.
More informationMollifiers and its applications in L p (Ω) space
Mollifiers and its alications in L () sace MA Shiqi Deartment of Mathematics, Hong Kong Batist University November 19, 2016 Abstract This note gives definition of mollifier and mollification. We illustrate
More informationCONSTRUCTIVE APPROXIMATION
Constr. Arox. (1998) 14: 1 26 CONSTRUCTIVE APPROXIMATION 1998 Sringer-Verlag New York Inc. Hyerbolic Wavelet Aroximation R. A. DeVore, S. V. Konyagin, and V. N. Temlyakov Abstract. We study the multivariate
More informationIMPROVED BOUNDS IN THE SCALED ENFLO TYPE INEQUALITY FOR BANACH SPACES
IMPROVED BOUNDS IN THE SCALED ENFLO TYPE INEQUALITY FOR BANACH SPACES OHAD GILADI AND ASSAF NAOR Abstract. It is shown that if (, ) is a Banach sace with Rademacher tye 1 then for every n N there exists
More informationCommutators on l. D. Dosev and W. B. Johnson
Submitted exclusively to the London Mathematical Society doi:10.1112/0000/000000 Commutators on l D. Dosev and W. B. Johnson Abstract The oerators on l which are commutators are those not of the form λi
More informationRIEMANN-STIELTJES OPERATORS BETWEEN WEIGHTED BERGMAN SPACES
RIEMANN-STIELTJES OPERATORS BETWEEN WEIGHTED BERGMAN SPACES JIE XIAO This aer is dedicated to the memory of Nikolaos Danikas 1947-2004) Abstract. This note comletely describes the bounded or comact Riemann-
More informationResearch Article An iterative Algorithm for Hemicontractive Mappings in Banach Spaces
Abstract and Alied Analysis Volume 2012, Article ID 264103, 11 ages doi:10.1155/2012/264103 Research Article An iterative Algorithm for Hemicontractive Maings in Banach Saces Youli Yu, 1 Zhitao Wu, 2 and
More informationElementary Analysis in Q p
Elementary Analysis in Q Hannah Hutter, May Szedlák, Phili Wirth November 17, 2011 This reort follows very closely the book of Svetlana Katok 1. 1 Sequences and Series In this section we will see some
More informationON UNIFORM BOUNDEDNESS OF DYADIC AVERAGING OPERATORS IN SPACES OF HARDY-SOBOLEV TYPE. 1. Introduction
ON UNIFORM BOUNDEDNESS OF DYADIC AVERAGING OPERATORS IN SPACES OF HARDY-SOBOLEV TYPE GUSTAVO GARRIGÓS ANDREAS SEEGER TINO ULLRICH Abstract We give an alternative roof and a wavelet analog of recent results
More informationIntroduction to Banach Spaces
CHAPTER 8 Introduction to Banach Saces 1. Uniform and Absolute Convergence As a rearation we begin by reviewing some familiar roerties of Cauchy sequences and uniform limits in the setting of metric saces.
More informationSOME TRACE INEQUALITIES FOR OPERATORS IN HILBERT SPACES
Kragujevac Journal of Mathematics Volume 411) 017), Pages 33 55. SOME TRACE INEQUALITIES FOR OPERATORS IN HILBERT SPACES SILVESTRU SEVER DRAGOMIR 1, Abstract. Some new trace ineualities for oerators in
More informationSobolev Spaces with Weights in Domains and Boundary Value Problems for Degenerate Elliptic Equations
Sobolev Saces with Weights in Domains and Boundary Value Problems for Degenerate Ellitic Equations S. V. Lototsky Deartment of Mathematics, M.I.T., Room 2-267, 77 Massachusetts Avenue, Cambridge, MA 02139-4307,
More informationBest Simultaneous Approximation in L p (I,X)
nt. Journal of Math. Analysis, Vol. 3, 2009, no. 24, 57-68 Best Simultaneous Aroximation in L (,X) E. Abu-Sirhan Deartment of Mathematics, Tafila Technical University Tafila, Jordan Esarhan@ttu.edu.jo
More informationVarious Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various Families of R n Norms and Some Open Problems
Int. J. Oen Problems Comt. Math., Vol. 3, No. 2, June 2010 ISSN 1998-6262; Coyright c ICSRS Publication, 2010 www.i-csrs.org Various Proofs for the Decrease Monotonicity of the Schatten s Power Norm, Various
More informationSTRONG TYPE INEQUALITIES AND AN ALMOST-ORTHOGONALITY PRINCIPLE FOR FAMILIES OF MAXIMAL OPERATORS ALONG DIRECTIONS IN R 2
STRONG TYPE INEQUALITIES AND AN ALMOST-ORTHOGONALITY PRINCIPLE FOR FAMILIES OF MAXIMAL OPERATORS ALONG DIRECTIONS IN R 2 ANGELES ALFONSECA Abstract In this aer we rove an almost-orthogonality rincile for
More informationConvex Analysis and Economic Theory Winter 2018
Division of the Humanities and Social Sciences Ec 181 KC Border Conve Analysis and Economic Theory Winter 2018 Toic 16: Fenchel conjugates 16.1 Conjugate functions Recall from Proosition 14.1.1 that is
More informationRadial Basis Function Networks: Algorithms
Radial Basis Function Networks: Algorithms Introduction to Neural Networks : Lecture 13 John A. Bullinaria, 2004 1. The RBF Maing 2. The RBF Network Architecture 3. Comutational Power of RBF Networks 4.
More informationFeedback-error control
Chater 4 Feedback-error control 4.1 Introduction This chater exlains the feedback-error (FBE) control scheme originally described by Kawato [, 87, 8]. FBE is a widely used neural network based controller
More informationarxiv:math/ v4 [math.gn] 25 Nov 2006
arxiv:math/0607751v4 [math.gn] 25 Nov 2006 On the uniqueness of the coincidence index on orientable differentiable manifolds P. Christoher Staecker October 12, 2006 Abstract The fixed oint index of toological
More information1 Riesz Potential and Enbeddings Theorems
Riesz Potential and Enbeddings Theorems Given 0 < < and a function u L loc R, the Riesz otential of u is defined by u y I u x := R x y dy, x R We begin by finding an exonent such that I u L R c u L R for
More informationSums of independent random variables
3 Sums of indeendent random variables This lecture collects a number of estimates for sums of indeendent random variables with values in a Banach sace E. We concentrate on sums of the form N γ nx n, where
More informationJournal of Mathematical Analysis and Applications
J. Math. Anal. Al. 44 (3) 3 38 Contents lists available at SciVerse ScienceDirect Journal of Mathematical Analysis and Alications journal homeage: www.elsevier.com/locate/jmaa Maximal surface area of a
More informationLORENZO BRANDOLESE AND MARIA E. SCHONBEK
LARGE TIME DECAY AND GROWTH FOR SOLUTIONS OF A VISCOUS BOUSSINESQ SYSTEM LORENZO BRANDOLESE AND MARIA E. SCHONBEK Abstract. In this aer we analyze the decay and the growth for large time of weak and strong
More informationON MINKOWSKI MEASURABILITY
ON MINKOWSKI MEASURABILITY F. MENDIVIL AND J. C. SAUNDERS DEPARTMENT OF MATHEMATICS AND STATISTICS ACADIA UNIVERSITY WOLFVILLE, NS CANADA B4P 2R6 Abstract. Two athological roerties of Minkowski content
More informationGreediness of higher rank Haar wavelet bases in L p w(r) spaces
Stud. Univ. Babeş-Bolyai Math. 59(2014), No. 2, 213 219 Greediness of higher rank Haar avelet bases in L (R) saces Ekaterine Kaanadze Abstract. We rove that higher rank Haar avelet systems are greedy in
More informationProducts of Composition, Multiplication and Differentiation between Hardy Spaces and Weighted Growth Spaces of the Upper-Half Plane
Global Journal of Pure and Alied Mathematics. ISSN 0973-768 Volume 3, Number 9 (207),. 6303-636 Research India Publications htt://www.riublication.com Products of Comosition, Multilication and Differentiation
More informationETNA Kent State University
Electronic Transactions on Numerical Analysis. Volume 9,. 29-36, 25. Coyright 25,. ISSN 68-963. ETNA ASYMPTOTICS FOR EXTREMAL POLYNOMIALS WITH VARYING MEASURES M. BELLO HERNÁNDEZ AND J. MíNGUEZ CENICEROS
More informationON FREIMAN S 2.4-THEOREM
ON FREIMAN S 2.4-THEOREM ØYSTEIN J. RØDSETH Abstract. Gregory Freiman s celebrated 2.4-Theorem says that if A is a set of residue classes modulo a rime satisfying 2A 2.4 A 3 and A < /35, then A is contained
More informationHEAT AND LAPLACE TYPE EQUATIONS WITH COMPLEX SPATIAL VARIABLES IN WEIGHTED BERGMAN SPACES
Electronic Journal of ifferential Equations, Vol. 207 (207), No. 236,. 8. ISSN: 072-669. URL: htt://ejde.math.txstate.edu or htt://ejde.math.unt.edu HEAT AN LAPLACE TYPE EQUATIONS WITH COMPLEX SPATIAL
More informationCombinatorics of topmost discs of multi-peg Tower of Hanoi problem
Combinatorics of tomost discs of multi-eg Tower of Hanoi roblem Sandi Klavžar Deartment of Mathematics, PEF, Unversity of Maribor Koroška cesta 160, 000 Maribor, Slovenia Uroš Milutinović Deartment of
More informationJournal of Inequalities in Pure and Applied Mathematics
Journal of Inequalities in Pure and Alied Mathematics htt://jiam.vu.edu.au/ Volume 3, Issue 5, Article 8, 22 REVERSE CONVOLUTION INEQUALITIES AND APPLICATIONS TO INVERSE HEAT SOURCE PROBLEMS SABUROU SAITOH,
More informationFactorizations Of Functions In H p (T n ) Takahiko Nakazi
Factorizations Of Functions In H (T n ) By Takahiko Nakazi * This research was artially suorted by Grant-in-Aid for Scientific Research, Ministry of Education of Jaan 2000 Mathematics Subject Classification
More informationA Numerical Radius Version of the Arithmetic-Geometric Mean of Operators
Filomat 30:8 (2016), 2139 2145 DOI 102298/FIL1608139S Published by Faculty of Sciences and Mathematics, University of Niš, Serbia vailable at: htt://wwwmfniacrs/filomat Numerical Radius Version of the
More informationRecursive Estimation of the Preisach Density function for a Smart Actuator
Recursive Estimation of the Preisach Density function for a Smart Actuator Ram V. Iyer Deartment of Mathematics and Statistics, Texas Tech University, Lubbock, TX 7949-142. ABSTRACT The Preisach oerator
More informationMaxisets for μ-thresholding rules
Test 008 7: 33 349 DOI 0.007/s749-006-0035-5 ORIGINAL PAPER Maxisets for μ-thresholding rules Florent Autin Received: 3 January 005 / Acceted: 8 June 006 / Published online: March 007 Sociedad de Estadística
More informationCHAPTER 2: SMOOTH MAPS. 1. Introduction In this chapter we introduce smooth maps between manifolds, and some important
CHAPTER 2: SMOOTH MAPS DAVID GLICKENSTEIN 1. Introduction In this chater we introduce smooth mas between manifolds, and some imortant concets. De nition 1. A function f : M! R k is a smooth function if
More information1. Introduction In this note we prove the following result which seems to have been informally conjectured by Semmes [Sem01, p. 17].
A REMARK ON POINCARÉ INEQUALITIES ON METRIC MEASURE SPACES STEPHEN KEITH AND KAI RAJALA Abstract. We show that, in a comlete metric measure sace equied with a doubling Borel regular measure, the Poincaré
More informationApplications to stochastic PDE
15 Alications to stochastic PE In this final lecture we resent some alications of the theory develoed in this course to stochastic artial differential equations. We concentrate on two secific examles:
More informationOn the capacity of the general trapdoor channel with feedback
On the caacity of the general tradoor channel with feedback Jui Wu and Achilleas Anastasooulos Electrical Engineering and Comuter Science Deartment University of Michigan Ann Arbor, MI, 48109-1 email:
More informationNumbers and functions. Introduction to Vojta s analogy
Numbers and functions. Introduction to Vojta s analogy Seminar talk by A. Eremenko, November 23, 1999, Purdue University. Absolute values. Let k be a field. An absolute value v is a function k R, x x v
More informationWAVELETS, PROPERTIES OF THE SCALAR FUNCTIONS
U.P.B. Sci. Bull. Series A, Vol. 68, No. 4, 006 WAVELETS, PROPERTIES OF THE SCALAR FUNCTIONS C. PANĂ * Pentru a contrui o undină convenabilă Ψ este necesară şi suficientă o analiză multirezoluţie. Analiza
More informationImprovement on the Decay of Crossing Numbers
Grahs and Combinatorics 2013) 29:365 371 DOI 10.1007/s00373-012-1137-3 ORIGINAL PAPER Imrovement on the Decay of Crossing Numbers Jakub Černý Jan Kynčl Géza Tóth Received: 24 Aril 2007 / Revised: 1 November
More informationp-adic Measures and Bernoulli Numbers
-Adic Measures and Bernoulli Numbers Adam Bowers Introduction The constants B k in the Taylor series exansion t e t = t k B k k! k=0 are known as the Bernoulli numbers. The first few are,, 6, 0, 30, 0,
More informationON JOINT CONVEXITY AND CONCAVITY OF SOME KNOWN TRACE FUNCTIONS
ON JOINT CONVEXITY ND CONCVITY OF SOME KNOWN TRCE FUNCTIONS MOHMMD GHER GHEMI, NHID GHRKHNLU and YOEL JE CHO Communicated by Dan Timotin In this aer, we rovide a new and simle roof for joint convexity
More informationSOME INEQUALITIES FOR (α, β)-normal OPERATORS IN HILBERT SPACES. 1. Introduction
SOME INEQUALITIES FOR (α, β)-normal OPERATORS IN HILBERT SPACES SEVER S. DRAGOMIR 1 AND MOHAMMAD SAL MOSLEHIAN Abstract. An oerator T is called (α, β)-normal (0 α 1 β) if α T T T T β T T. In this aer,
More informationOn the Properties for Iteration of a Compact Operator with Unstructured Perturbation
On the Proerties for Iteration of a Comact Oerator with Unstructured Perturbation Jarmo Malinen Helsinki University of Technology Institute of Mathematics Research Reorts A360 (1996) 1 2 Jarmo Malinen:
More informationSome Unitary Space Time Codes From Sphere Packing Theory With Optimal Diversity Product of Code Size
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 5, NO., DECEMBER 4 336 Some Unitary Sace Time Codes From Shere Packing Theory With Otimal Diversity Product of Code Size Haiquan Wang, Genyuan Wang, and Xiang-Gen
More informationSpectral Properties of Schrödinger-type Operators and Large-time Behavior of the Solutions to the Corresponding Wave Equation
Math. Model. Nat. Phenom. Vol. 8, No., 23,. 27 24 DOI:.5/mmn/2386 Sectral Proerties of Schrödinger-tye Oerators and Large-time Behavior of the Solutions to the Corresonding Wave Equation A.G. Ramm Deartment
More informationMEAN AND WEAK CONVERGENCE OF FOURIER-BESSEL SERIES by J. J. GUADALUPE, M. PEREZ, F. J. RUIZ and J. L. VARONA
MEAN AND WEAK CONVERGENCE OF FOURIER-BESSEL SERIES by J. J. GUADALUPE, M. PEREZ, F. J. RUIZ and J. L. VARONA ABSTRACT: We study the uniform boundedness on some weighted L saces of the artial sum oerators
More informationInequalities for the L 1 Deviation of the Empirical Distribution
Inequalities for the L 1 Deviation of the Emirical Distribution Tsachy Weissman, Erik Ordentlich, Gadiel Seroussi, Sergio Verdu, Marcelo J. Weinberger June 13, 2003 Abstract We derive bounds on the robability
More informationSolving Support Vector Machines in Reproducing Kernel Banach Spaces with Positive Definite Functions
Solving Suort Vector Machines in Reroducing Kernel Banach Saces with Positive Definite Functions Gregory E. Fasshauer a, Fred J. Hickernell a, Qi Ye b, a Deartment of Alied Mathematics, Illinois Institute
More informationCR extensions with a classical Several Complex Variables point of view. August Peter Brådalen Sonne Master s Thesis, Spring 2018
CR extensions with a classical Several Comlex Variables oint of view August Peter Brådalen Sonne Master s Thesis, Sring 2018 This master s thesis is submitted under the master s rogramme Mathematics, with
More informationPETER J. GRABNER AND ARNOLD KNOPFMACHER
ARITHMETIC AND METRIC PROPERTIES OF -ADIC ENGEL SERIES EXPANSIONS PETER J. GRABNER AND ARNOLD KNOPFMACHER Abstract. We derive a characterization of rational numbers in terms of their unique -adic Engel
More informationSCHUR S LEMMA AND BEST CONSTANTS IN WEIGHTED NORM INEQUALITIES. Gord Sinnamon The University of Western Ontario. December 27, 2003
SCHUR S LEMMA AND BEST CONSTANTS IN WEIGHTED NORM INEQUALITIES Gord Sinnamon The University of Western Ontario December 27, 23 Abstract. Strong forms of Schur s Lemma and its converse are roved for mas
More informationOn the approximation of a polytope by its dual L p -centroid bodies
On the aroximation of a olytoe by its dual L -centroid bodies Grigoris Paouris and Elisabeth M. Werner Abstract We show that the rate of convergence on the aroximation of volumes of a convex symmetric
More informationDifference of Convex Functions Programming for Reinforcement Learning (Supplementary File)
Difference of Convex Functions Programming for Reinforcement Learning Sulementary File Bilal Piot 1,, Matthieu Geist 1, Olivier Pietquin,3 1 MaLIS research grou SUPELEC - UMI 958 GeorgiaTech-CRS, France
More informationJUHA KINNUNEN. Sobolev spaces
JUHA KINNUNEN Sobolev saces Deartment of Mathematics and Systems Analysis, Aalto University 217 Contents 1 SOBOLEV SPACES 1 1.1 Weak derivatives.............................. 1 1.2 Sobolev saces...............................
More informationCorrespondence Between Fractal-Wavelet. Transforms and Iterated Function Systems. With Grey Level Maps. F. Mendivil and E.R.
1 Corresondence Between Fractal-Wavelet Transforms and Iterated Function Systems With Grey Level Mas F. Mendivil and E.R. Vrscay Deartment of Alied Mathematics Faculty of Mathematics University of Waterloo
More informationANALYTIC NUMBER THEORY AND DIRICHLET S THEOREM
ANALYTIC NUMBER THEORY AND DIRICHLET S THEOREM JOHN BINDER Abstract. In this aer, we rove Dirichlet s theorem that, given any air h, k with h, k) =, there are infinitely many rime numbers congruent to
More informationHIGHER ORDER NONLINEAR DEGENERATE ELLIPTIC PROBLEMS WITH WEAK MONOTONICITY
2005-Oujda International Conference on Nonlinear Analysis. Electronic Journal of Differential Equations, Conference 4, 2005,. 53 7. ISSN: 072-669. URL: htt://ejde.math.txstate.edu or htt://ejde.math.unt.edu
More informationHölder s and Minkowski s Inequality
Hölder s and Minkowski s Inequality James K. Peterson Deartment of Biological Sciences and Deartment of Mathematical Sciences Clemson University Setember 10, 2018 Outline 1 Conjugate Exonents 2 Hölder
More informationOn Isoperimetric Functions of Probability Measures Having Log-Concave Densities with Respect to the Standard Normal Law
On Isoerimetric Functions of Probability Measures Having Log-Concave Densities with Resect to the Standard Normal Law Sergey G. Bobkov Abstract Isoerimetric inequalities are discussed for one-dimensional
More informationArithmetic and Metric Properties of p-adic Alternating Engel Series Expansions
International Journal of Algebra, Vol 2, 2008, no 8, 383-393 Arithmetic and Metric Proerties of -Adic Alternating Engel Series Exansions Yue-Hua Liu and Lu-Ming Shen Science College of Hunan Agriculture
More informationStochastic integration II: the Itô integral
13 Stochastic integration II: the Itô integral We have seen in Lecture 6 how to integrate functions Φ : (, ) L (H, E) with resect to an H-cylindrical Brownian motion W H. In this lecture we address the
More informationLocation of solutions for quasi-linear elliptic equations with general gradient dependence
Electronic Journal of Qualitative Theory of Differential Equations 217, No. 87, 1 1; htts://doi.org/1.14232/ejqtde.217.1.87 www.math.u-szeged.hu/ejqtde/ Location of solutions for quasi-linear ellitic equations
More informationOn the minimax inequality and its application to existence of three solutions for elliptic equations with Dirichlet boundary condition
ISSN 1 746-7233 England UK World Journal of Modelling and Simulation Vol. 3 (2007) No. 2. 83-89 On the minimax inequality and its alication to existence of three solutions for ellitic equations with Dirichlet
More informationA CHARACTERIZATION OF THE LEINERT PROPERTY
PROCEEDINGS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 125, Number 11, November 1997, Pages 3423 3431 S 0002-9939(97)03966-X A CHARACTERIZATION OF THE LEINERT PROPERTY FRANZ LEHNER (Communicated by Palle
More informationDUAL NUMBERS, WEIGHTED QUIVERS, AND EXTENDED SOMOS AND GALE-ROBINSON SEQUENCES. To Alexandre Alexandrovich Kirillov on his 3 4 th anniversary
DUAL NUMBERS, WEIGHTED QUIVERS, AND EXTENDED SOMOS AND GALE-ROBINSON SEQUENCES VALENTIN OVSIENKO AND SERGE TABACHNIKOV Abstract. We investigate a general method that allows one to construct new integer
More informationOn the continuity property of L p balls and an application
J. Math. Anal. Al. 335 007) 347 359 www.elsevier.com/locate/jmaa On the continuity roerty of L balls and an alication Kh.G. Guseinov, A.S. Nazliinar Anadolu University, Science Faculty, Deartment of Mathematics,
More informationApplications of the course to Number Theory
Alications of the course to Number Theory Rational Aroximations Theorem (Dirichlet) If ξ is real and irrational then there are infinitely many distinct rational numbers /q such that ξ q < q. () 2 Proof
More information3 Properties of Dedekind domains
18.785 Number theory I Fall 2016 Lecture #3 09/15/2016 3 Proerties of Dedekind domains In the revious lecture we defined a Dedekind domain as a noetherian domain A that satisfies either of the following
More informationOn the Interplay of Regularity and Decay in Case of Radial Functions I. Inhomogeneous spaces
On the Interlay of Regularity and Decay in Case of Radial Functions I. Inhomogeneous saces Winfried Sickel, Leszek Skrzyczak and Jan Vybiral July 29, 2010 Abstract We deal with decay and boundedness roerties
More informationA CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS. 1. Abstract
A CONCRETE EXAMPLE OF PRIME BEHAVIOR IN QUADRATIC FIELDS CASEY BRUCK 1. Abstract The goal of this aer is to rovide a concise way for undergraduate mathematics students to learn about how rime numbers behave
More informationA viability result for second-order differential inclusions
Electronic Journal of Differential Equations Vol. 00(00) No. 76. 1 1. ISSN: 107-6691. URL: htt://ejde.math.swt.edu or htt://ejde.math.unt.edu ft ejde.math.swt.edu (login: ft) A viability result for second-order
More informationLECTURE 7 NOTES. x n. d x if. E [g(x n )] E [g(x)]
LECTURE 7 NOTES 1. Convergence of random variables. Before delving into the large samle roerties of the MLE, we review some concets from large samle theory. 1. Convergence in robability: x n x if, for
More informationarxiv:math/ v1 [math.mg] 20 May 1996
arxiv:math/9605223v1 [math.mg] 20 May 1996 COVERING NUMBERS AND LOW M -ESTIMATE FOR QUASI-CONVEX BODIES A. E. LITVAK, V. D. MILMAN, AND A. PAJOR Abstract. This article gives estimates on covering numbers
More informationEstimation of the large covariance matrix with two-step monotone missing data
Estimation of the large covariance matrix with two-ste monotone missing data Masashi Hyodo, Nobumichi Shutoh 2, Takashi Seo, and Tatjana Pavlenko 3 Deartment of Mathematical Information Science, Tokyo
More informationHolder Continuity of Local Minimizers. Giovanni Cupini, Nicola Fusco, and Raffaella Petti
Journal of Mathematical Analysis and Alications 35, 578597 1999 Article ID jmaa199964 available online at htt:wwwidealibrarycom on older Continuity of Local Minimizers Giovanni Cuini, icola Fusco, and
More informationB8.1 Martingales Through Measure Theory. Concept of independence
B8.1 Martingales Through Measure Theory Concet of indeendence Motivated by the notion of indeendent events in relims robability, we have generalized the concet of indeendence to families of σ-algebras.
More informationImproved Bounds on Bell Numbers and on Moments of Sums of Random Variables
Imroved Bounds on Bell Numbers and on Moments of Sums of Random Variables Daniel Berend Tamir Tassa Abstract We rovide bounds for moments of sums of sequences of indeendent random variables. Concentrating
More informationOn the existence of principal values for the Cauchy integral on weighted Lebesgue spaces for non-doubling measures.
On the existence of rincial values for the auchy integral on weighted Lebesgue saces for non-doubling measures. J.García-uerva and J.M. Martell Abstract Let T be a alderón-zygmund oerator in a non-homogeneous
More informationDependence on Initial Conditions of Attainable Sets of Control Systems with p-integrable Controls
Nonlinear Analysis: Modelling and Control, 2007, Vol. 12, No. 3, 293 306 Deendence on Initial Conditions o Attainable Sets o Control Systems with -Integrable Controls E. Akyar Anadolu University, Deartment
More informationDiscrete Calderón s Identity, Atomic Decomposition and Boundedness Criterion of Operators on Multiparameter Hardy Spaces
J Geom Anal (010) 0: 670 689 DOI 10.1007/s10-010-913-6 Discrete Calderón s Identity, Atomic Decomosition and Boundedness Criterion of Oerators on Multiarameter Hardy Saces Y. Han G. Lu K. Zhao Received:
More informationInterpolatory curl-free wavelets on bounded domains and characterization of Besov spaces
Jiang Journal of Inequalities and Alications 0 0:68 htt://wwwournalofinequalitiesandalicationscom/content/0//68 RESEARCH Oen Access Interolatory curl-free wavelets on bounded domains and characterization
More information1-way quantum finite automata: strengths, weaknesses and generalizations
1-way quantum finite automata: strengths, weaknesses and generalizations arxiv:quant-h/9802062v3 30 Se 1998 Andris Ambainis UC Berkeley Abstract Rūsiņš Freivalds University of Latvia We study 1-way quantum
More informationPseudodifferential operators with homogeneous symbols
Pseudodifferential oerators with homogeneous symbols Loukas Grafakos Deartment of Mathematics University of Missouri Columbia, MO 65211 Rodolfo H. Torres Deartment of Mathematics University of Kansas Lawrence,
More informationVERTICAL LIMITS OF GRAPH DOMAINS
VERTICAL LIMITS OF GRAPH DOMAINS HRANT HAKOBYAN AND DRAGOMIR ŠARIĆ Abstract. We consider the limiting behavior of Teichmüller geodesics in the universal Teichmüller sace T (H). Our main result states that
More informationPOINTS ON CONICS MODULO p
POINTS ON CONICS MODULO TEAM 2: JONGMIN BAEK, ANAND DEOPURKAR, AND KATHERINE REDFIELD Abstract. We comute the number of integer oints on conics modulo, where is an odd rime. We extend our results to conics
More informationChapter 5 Approximating Multivariable Functions by Feedforward Neural Nets
Chapter 5 Approximating Multivariable Functions by Feedforward Neural Nets Paul C. Kainen, Věra Kůrková, and Marcello Sanguineti Abstract. Theoretical results on approximation of multivariable functions
More informationLINEAR FRACTIONAL COMPOSITION OPERATORS OVER THE HALF-PLANE
LINEAR FRACTIONAL COMPOSITION OPERATORS OVER THE HALF-PLANE BOO RIM CHOE, HYUNGWOON KOO, AND WAYNE SMITH Abstract. In the setting of the Hardy saces or the standard weighted Bergman saces over the unit
More information