initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Featur
|
|
- Myrtle Smith
- 5 years ago
- Views:
Transcription
1 Cdewrd Distributin fr Frequency Sensitive Cmpetitive Learning with One Dimensinal Input Data Aristides S. Galanpuls and Stanley C. Ahalt Department f Electrical Engineering The Ohi State University Abstract We study the cdewrd distributin fr a cnsciense type cmpetitive learning algrithm, Frequency Sensitive Cmpetitive Learning (FSCL), using ne dimensinal input data. We prve that the asympttic cdewrd density in the limit f large number f cdewrds is given by a pwer law f the frm Q(x) = C P (x), where P (x) is the input data density and depends n the algrithm and the frm f the distrtin measure t be minimized. The algrithm can be adjusted t minimize any L p distrtin measure with p ranging in (0; 2]. I. Intrductin Cmpetitive learning type algrithms are used fr vectr quantizatin and pattern recgnitin amng ther applicatins. Cmpared t batch algrithms, like the well knwn LBG algrithm [], they er the advantage f perating n-line and being adaptive. They are als atractive when implemented in parallel neural netwrk architectures, thus increasing the speed f encding/decding peratins. Simple Cmpetitive Learning (CL), even thugh cmputatinally very ecient, is knwn t suer frm the prblem f cdewrd underutilizatin, that is cdewrds
2 initially lcated away frm the data set never win the cmpetitin, resulting in a nnptimal nal cdebk, [2] [3] [4] and [5]. Khnen's Self Organizing Feature Map (KSFM) [6] [7] mre succesfully appraches the ptimal cdebk design and vercmes the underutilizatin prblem. Hwever it is cmputatinally mre intensive and its prperties depend n the selectin f an apprpriate neighbrhd functin, which is nt an easy prblem especially fr multi-dimensinal data spaces. A mre recent algrithm, the Frequency Sensitive Cmpetitive Learning (FSCL) [8], vercmes the cdewrd underutilizatin prblem and it is cnsiderably simpler than KSFM. In simulatin studies it has been shwn t perfrm at least as gd as the previus CL-type algrithms with respect t the ptimality f the cdebk design and the speed f cnvergence t the equilibrium state. The characterizatin f the equilibrium state f the CL type algrithms, and mre specically the asympttic cdewrd distributin fr large number f cdewrds, is a generally pen prblem fr data spaces with tw r mre dimensins. The prblem has nly been cmpletely slved fr simple CL, by Zadr [9]. Fr KSFM analytical results have been btained nly in the case f ne dimensinal data space [0]. In this brief paper we analyze the asympttic cdewrd distributin fr the FSCL algrithm in the case f ne dimensinal data. We shw that the algrithm can be adjusted t minimize a cntinuus range f distrtin measures. The results have direct appplicatin t the prblem f prbability density estimatin. 2
3 II. FSCL algrithm and equilibrium cnditins The FSCL algrithm belngs t the class f cnscience type cmpetitive learning algrithms. In FSCL, N units r cdewrds are assigned crrespnding psitins fw i g N i= and update frequencies ff i g N i=, where the update frequencies are dened as f i = c i t with the (cunt) c i being the number f times that unit i has been updated up t time t. Clearly, P i f i (t) = t. At time t, an input data vectr x(t) is presented t the netwrk and the winner unit is selected as the ne that minimizes the prduct f a fairness functin F, which is an increasing functin f the update frequency, times the distance (distrtin measure) frm the input data vectr, i.e., F (f i (t))kw i (t)? x(t)k. Only the winner unit j is updated using w j (t + ) = w j (t) + (t)(x(t)? w j (t)): The underutilizatin prblem is slved because frequent winners are \penalized" s that eventually all units win the cmpetitin sme prtin f the time. At equilibrium, each unit i wins the cmpetitin fr all input data inside a neighbrhd (cell) C i f w i and w i is the centrid w i = Z up (u)du C Z i : P (u)du C i where P (u) is the input data prbability density functin and the equilibrium update frequencies are given by Z f i = P (u)du: C i Fr the calculatin f the equilibrium psitins, given any number f cdewrds, 3
4 we can use a mdicatin f the Llyd-Max iterative algrithm [] fr scalar quantizer design. If the input data prbability density is nnzer nly n a cntinuus interval, the algrithm cnsists f a search fr the rst cdewrd psitin. The algrithm begins by assuming a psitin fr the rst cdewrd. If we knw the psitins f the rst n? cdewrds then we can exactly determine the psitin f the n th cdewrd s that the equilibrium cnditins are satised. After each iteratin thrugh the set f cdewrds we crrect the rst cdewrd's psitin depending n the errr assciated with the last cdewrd's previus psitin. III. Asympttic cdewrd density We assume ne dimensinal input data distributed with a prbability density functin P (x). We cnsider fairness functins f the frm F (f i ) = f i and we prve the fllwing therem. Therem. The asympttic cdewrd density Q(x), fr large number f cdewrds is given as 3 + Q(x) = C P (x) where C is a nrmalizing cnstant. Prf. Let fw i g N i= be the cdewrd psitins and fl i g N i=0 the bundaries dening the partitin f the real line int quantizer intervals (cells), at equilibrium. Psitin w i is given as the centrid w i = Z li l i? Z li l i? up (u)du P (u)du () 4
5 and, frm the winner cnditin, the bundaries must satisfy F (f i )(l i? w i ) = F (f i+ )(w i+? l i ) (2) where f i = Z li l i? P (u)du: Let u n = l n? + l n 2 we can apprximate and n = l n? l n?. In the limit f large number f cdewrds Thus, equatin () takes the frm P (u n + x) P (u n ) + xp 0 (u n ): (3) w n = u n + P 0 (u n ) 2 n P (u n ) 2 (4) and equatin (2) becmes + n? "? P 0 (l n? ) P (l n? ) = + n n? 2 " (? ) + P 0 (l n ) P (l n ) # " P 0 (l n? )? P (l n? ) P (l n?) 2 # n? 3 n 2 (? ) # " + P 0 (l n ) P (l n ) Ignring higher rder terms and nticing that P 0 (l n ) P 0 (l n?) P (l n ) the abve equatin P (l n? ) becmes P 0 (l n? ) 3 + = + n?? + n : (5) P (l n? ) 6 +2 n? + n +2 In terms f the cdewrd density Q(x) we have the apprximatins = Q(l n? ) + Q 0 (l n? ) n n 2 = Q(l n? )? Q 0 (l n? ) n? n? 2 2 n 3 # : 5
6 Keeping the leading rder terms we have P 0 (l n? ) 3 + P (l n? ) 6 = n? + n 2 n? n Q(l n? ) + Q 0 (l n? ) 2 Q(l n? ) (6) and bserving that Q(l n? ) 2 n? + n! (7) we btain Q 0 (l n? ) Q(l n ) = 3 + P 0 (l n?) P (l n? ) (8) which implies that 3 + Q(x) = CP (x) Q.E.D. (9) The case where = 0 describes the cdewrd density fr simple CL, which is a stchastic gradient descent minimizatin f the mean square errr, i.e., the L 2 distrtin measure as is the case in the Llyd-Max quantizer. Our result, a =3 pwer law, is in agreement with the asympttic density f the Llyd-Max quantizer presented in [9]. We ntice that FSCL generates a cdewrd distributin clser t the data prbability density, while simple Cmpetitive Learning assigns relatively mre cdewrds t regins f small data density and less cdewrds t regins f large data density. Cdewrd distributins that bey input data prbability density pwer laws crrespnd t asympttically ptimal quantizers as shwn by Zadr [9]; a distributin pwer f r=(r + d), with r the dimensin f the data space, minimizes the L d distrtin measure. Frm ur therem, we can cnclude that FSCL generates a scalar quantizer that minimizes the L 2=(3 + ) distrtin measure. Thus, by adjusting the 6
7 parameter we can design an asympttically ptimal quantizer fr the L p distrtin with p taking any value in the interval (0; 2]. By cmparisn, Khnen' s Self-Organizing Feature Map (KSFM) can design scalar quantizers that asympttically minimize the L p distrtin measure with p taking values 0:5 +, n = 0; ; 2; : : : [0]. Thus, FSCL ers greater exibility, 3 2 2(2n + ) e.g., FSCL with = 0:5 minimizes the L distrtin, which cannt be minimized using KSFM (with rectangular-type neighbrhds as have been analyzed s far). IV. Simulatin Results The cdewrd density predicted frm ur theretical results very clsely describes the actual cdewrd distributin even fr a mderate number f cdewrds. We simulated the FSCL algrithm using 30 cdewrds and a training set f 00,000 input data samples btained frm a gaussian distributin truncated in a nite interval. The initial cdewrd psitins were selected randmly inside the data interval. We plt the cumulative cdewrd distributin as btained by simulatin versus the theretically predicted cumulative distributin. In Fig. we shw the results fr = 0 and in Fig. 2 we shw the results fr = 4. In practice, the parameter is usually a functin f time; a large initial is used t slve the cdewrd underutilizatin prblem and subsequently cnverges t the value that minimizes the desired distrtin measure. References [] Y. Linde, A. Buz, and R. M. Gray, \An algrithm fr vectr quantizer design," IEEE Transactins n Cmmunicatins, vl. 28(), pp. 84{95,
8 [2] S. Grssberg, \Adaptive pattern classicatin and universal recding: I. parallel develpment and cding f neural feature detectrs," Bilgical Cybernetics, vl. 23, pp. 2{34, 976. [3] S. Grssberg, \Adaptive pattern classicatin and universal recding: II. feedback, expectatin, lfactin, illusins.," Bilgical Cybernetics, vl. 23, pp. 87{ 202, 976. [4] D. E. Rumelhart and D. Zipser, \Feature discvery by cmpetitive learning," Cgnitive Science, vl. 9, pp. 75{2, 985. [5] S. Grssberg, \Cmpetitive learning: Frm interactive activatin t adaptive resnance," Cgnitive Science, vl., pp. 23{63, 987. [6] T. Khnen, \Self-rganized frmatin f tplgically crrect feature maps," Bilgical Cybernetics, vl. 43, pp. 59{69, 982. [7] T. Khnen, Self-rganizatin and assciative memry. Berlin: Springer-Verlag, 984. [8] S. C. Ahalt, A. K. Krisnamurthy, P. Chen, and D. E. Meltn, \Cmpetitive learning algrithms fr vectr quantizatin," Neural Netwrks, vl. 3, pp. 277{ 290, 990. [9] P. L. Zadr, \Asympttic quantizatin errr f cntinuus signals and the quantizatin dimensin," IEEE Transactins n Infrmatin Thery, vl. IT-28, pp. 39{49, March 982. [0] H. Ritter, \Asympttic level density fr a class f vectr quantizatin prcesses," IEEE Transactins n Neural Netwrks, vl. 2, January 99. [] J. Max, \Quantizing fr minimum distrtin," IRE Transactins n Infrmatin Thery, vl. 6,
9 Cumulative cdewrd distributin : theretical : simulatin beta=0, Gaussian pdf psitin x Figure : Cdewrd distributin fr Gaussian data and = 0. 9
10 Cumulative cdewrd distributin : theretical : simulatin beta=4, Gaussian pdf psitin x Figure 2: Cdewrd distributin fr Gaussian data and = 4. 0
Quantization. Quantization is the realization of the lossy part of source coding Typically allows for a trade-off between signal fidelity and bit rate
Quantizatin Quantizatin is the realizatin f the lssy part f surce cding Typically allws fr a trade-ff between signal fidelity and bit rate s! s! Quantizer Quantizatin is a functinal mapping f a (cntinuus
More informationthe results to larger systems due to prop'erties of the projection algorithm. First, the number of hidden nodes must
M.E. Aggune, M.J. Dambrg, M.A. El-Sharkawi, R.J. Marks II and L.E. Atlas, "Dynamic and static security assessment f pwer systems using artificial neural netwrks", Prceedings f the NSF Wrkshp n Applicatins
More informationLeast Squares Optimal Filtering with Multirate Observations
Prc. 36th Asilmar Cnf. n Signals, Systems, and Cmputers, Pacific Grve, CA, Nvember 2002 Least Squares Optimal Filtering with Multirate Observatins Charles W. herrien and Anthny H. Hawes Department f Electrical
More informationThe blessing of dimensionality for kernel methods
fr kernel methds Building classifiers in high dimensinal space Pierre Dupnt Pierre.Dupnt@ucluvain.be Classifiers define decisin surfaces in sme feature space where the data is either initially represented
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationMATHEMATICS SYLLABUS SECONDARY 5th YEAR
Eurpean Schls Office f the Secretary-General Pedaggical Develpment Unit Ref. : 011-01-D-8-en- Orig. : EN MATHEMATICS SYLLABUS SECONDARY 5th YEAR 6 perid/week curse APPROVED BY THE JOINT TEACHING COMMITTEE
More informationLyapunov Stability Stability of Equilibrium Points
Lyapunv Stability Stability f Equilibrium Pints 1. Stability f Equilibrium Pints - Definitins In this sectin we cnsider n-th rder nnlinear time varying cntinuus time (C) systems f the frm x = f ( t, x),
More informationChapter 3: Cluster Analysis
Chapter 3: Cluster Analysis } 3.1 Basic Cncepts f Clustering 3.1.1 Cluster Analysis 3.1. Clustering Categries } 3. Partitining Methds 3..1 The principle 3.. K-Means Methd 3..3 K-Medids Methd 3..4 CLARA
More informationV. Balakrishnan and S. Boyd. (To Appear in Systems and Control Letters, 1992) Abstract
On Cmputing the WrstCase Peak Gain f Linear Systems V Balakrishnan and S Byd (T Appear in Systems and Cntrl Letters, 99) Abstract Based n the bunds due t Dyle and Byd, we present simple upper and lwer
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationA Scalable Recurrent Neural Network Framework for Model-free
A Scalable Recurrent Neural Netwrk Framewrk fr Mdel-free POMDPs April 3, 2007 Zhenzhen Liu, Itamar Elhanany Machine Intelligence Lab Department f Electrical and Cmputer Engineering The University f Tennessee
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationEric Klein and Ning Sa
Week 12. Statistical Appraches t Netwrks: p1 and p* Wasserman and Faust Chapter 15: Statistical Analysis f Single Relatinal Netwrks There are fur tasks in psitinal analysis: 1) Define Equivalence 2) Measure
More informationSlide04 (supplemental) Haykin Chapter 4 (both 2nd and 3rd ed): Multi-Layer Perceptrons
Slide04 supplemental) Haykin Chapter 4 bth 2nd and 3rd ed): Multi-Layer Perceptrns CPSC 636-600 Instructr: Ynsuck Che Heuristic fr Making Backprp Perfrm Better 1. Sequential vs. batch update: fr large
More informationAnalysis on the Stability of Reservoir Soil Slope Based on Fuzzy Artificial Neural Network
Research Jurnal f Applied Sciences, Engineering and Technlgy 5(2): 465-469, 2013 ISSN: 2040-7459; E-ISSN: 2040-7467 Maxwell Scientific Organizatin, 2013 Submitted: May 08, 2012 Accepted: May 29, 2012 Published:
More informationThe standards are taught in the following sequence.
B L U E V A L L E Y D I S T R I C T C U R R I C U L U M MATHEMATICS Third Grade In grade 3, instructinal time shuld fcus n fur critical areas: (1) develping understanding f multiplicatin and divisin and
More informationAdmissibility Conditions and Asymptotic Behavior of Strongly Regular Graphs
Admissibility Cnditins and Asympttic Behavir f Strngly Regular Graphs VASCO MOÇO MANO Department f Mathematics University f Prt Oprt PORTUGAL vascmcman@gmailcm LUÍS ANTÓNIO DE ALMEIDA VIEIRA Department
More informationPure adaptive search for finite global optimization*
Mathematical Prgramming 69 (1995) 443-448 Pure adaptive search fr finite glbal ptimizatin* Z.B. Zabinskya.*, G.R. Wd b, M.A. Steel c, W.P. Baritmpa c a Industrial Engineering Prgram, FU-20. University
More information1996 Engineering Systems Design and Analysis Conference, Montpellier, France, July 1-4, 1996, Vol. 7, pp
THE POWER AND LIMIT OF NEURAL NETWORKS T. Y. Lin Department f Mathematics and Cmputer Science San Jse State University San Jse, Califrnia 959-003 tylin@cs.ssu.edu and Bereley Initiative in Sft Cmputing*
More informationFebruary 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA
February 28, 2013 COMMENTS ON DIFFUSION, DIFFUSIVITY AND DERIVATION OF HYPERBOLIC EQUATIONS DESCRIBING THE DIFFUSION PHENOMENA Mental Experiment regarding 1D randm walk Cnsider a cntainer f gas in thermal
More informationEnhancing Performance of MLP/RBF Neural Classifiers via an Multivariate Data Distribution Scheme
Enhancing Perfrmance f / Neural Classifiers via an Multivariate Data Distributin Scheme Halis Altun, Gökhan Gelen Nigde University, Electrical and Electrnics Engineering Department Nigde, Turkey haltun@nigde.edu.tr
More informationPhysical Layer: Outline
18-: Intrductin t Telecmmunicatin Netwrks Lectures : Physical Layer Peter Steenkiste Spring 01 www.cs.cmu.edu/~prs/nets-ece Physical Layer: Outline Digital Representatin f Infrmatin Characterizatin f Cmmunicatin
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins
More informationResampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017
Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with
More informationEXPERIMENTAL STUDY ON DISCHARGE COEFFICIENT OF OUTFLOW OPENING FOR PREDICTING CROSS-VENTILATION FLOW RATE
EXPERIMENTAL STUD ON DISCHARGE COEFFICIENT OF OUTFLOW OPENING FOR PREDICTING CROSS-VENTILATION FLOW RATE Tmnbu Gt, Masaaki Ohba, Takashi Kurabuchi 2, Tmyuki End 3, shihik Akamine 4, and Tshihir Nnaka 2
More informationSection I5: Feedback in Operational Amplifiers
Sectin I5: eedback in Operatinal mplifiers s discussed earlier, practical p-amps hae a high gain under dc (zer frequency) cnditins and the gain decreases as frequency increases. This frequency dependence
More informationAdmin. MDP Search Trees. Optimal Quantities. Reinforcement Learning
Admin Reinfrcement Learning Cntent adapted frm Berkeley CS188 MDP Search Trees Each MDP state prjects an expectimax-like search tree Optimal Quantities The value (utility) f a state s: V*(s) = expected
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationMethods for Determination of Mean Speckle Size in Simulated Speckle Pattern
0.478/msr-04-004 MEASUREMENT SCENCE REVEW, Vlume 4, N. 3, 04 Methds fr Determinatin f Mean Speckle Size in Simulated Speckle Pattern. Hamarvá, P. Šmíd, P. Hrváth, M. Hrabvský nstitute f Physics f the Academy
More informationCOMP 551 Applied Machine Learning Lecture 11: Support Vector Machines
COMP 551 Applied Machine Learning Lecture 11: Supprt Vectr Machines Instructr: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted fr this curse
More informationModule 4: General Formulation of Electric Circuit Theory
Mdule 4: General Frmulatin f Electric Circuit Thery 4. General Frmulatin f Electric Circuit Thery All electrmagnetic phenmena are described at a fundamental level by Maxwell's equatins and the assciated
More informationB. Definition of an exponential
Expnents and Lgarithms Chapter IV - Expnents and Lgarithms A. Intrductin Starting with additin and defining the ntatins fr subtractin, multiplicatin and divisin, we discvered negative numbers and fractins.
More information5 th grade Common Core Standards
5 th grade Cmmn Cre Standards In Grade 5, instructinal time shuld fcus n three critical areas: (1) develping fluency with additin and subtractin f fractins, and develping understanding f the multiplicatin
More informationSupport-Vector Machines
Supprt-Vectr Machines Intrductin Supprt vectr machine is a linear machine with sme very nice prperties. Haykin chapter 6. See Alpaydin chapter 13 fr similar cntent. Nte: Part f this lecture drew material
More informationand the Doppler frequency rate f R , can be related to the coefficients of this polynomial. The relationships are:
Algrithm fr Estimating R and R - (David Sandwell, SIO, August 4, 2006) Azimith cmpressin invlves the alignment f successive eches t be fcused n a pint target Let s be the slw time alng the satellite track
More informationTransform Coding. coefficient vectors u = As. vectors u into decoded source vectors s = Bu. 2D Transform: Rotation by ϕ = 45 A = Transform Coding
Transfrm Cding Transfrm Cding Anther cncept fr partially expliting the memry gain f vectr quantizatin Used in virtually all lssy image and vide cding applicatins Samples f surce s are gruped int vectrs
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More informationEDA Engineering Design & Analysis Ltd
EDA Engineering Design & Analysis Ltd THE FINITE ELEMENT METHOD A shrt tutrial giving an verview f the histry, thery and applicatin f the finite element methd. Intrductin Value f FEM Applicatins Elements
More informationCS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007
CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is
More informationPerformance Bounds for Detect and Avoid Signal Sensing
Perfrmance unds fr Detect and Avid Signal Sensing Sam Reisenfeld Real-ime Infrmatin etwrks, University f echnlgy, Sydney, radway, SW 007, Australia samr@uts.edu.au Abstract Detect and Avid (DAA) is a Cgnitive
More informationAP Statistics Notes Unit Two: The Normal Distributions
AP Statistics Ntes Unit Tw: The Nrmal Distributins Syllabus Objectives: 1.5 The student will summarize distributins f data measuring the psitin using quartiles, percentiles, and standardized scres (z-scres).
More informationZeros of Sections of the Zeta Function. I
Zers f Sectins f the Zeta Functin. I By Rbert Spira 1. Intrductin. The sectins f the title are the Dirichlet plynmials: (1) U(s) = n"5 n = l We write s = a -f- it, and take M ^ 3. Turan [1], [2] shwed
More informationPerturbation approach applied to the asymptotic study of random operators.
Perturbatin apprach applied t the asympttic study f rm peratrs. André MAS, udvic MENNETEAU y Abstract We prve that, fr the main mdes f stchastic cnvergence (law f large numbers, CT, deviatins principles,
More informationCombining Dialectical Optimization and Gradient Descent Methods for Improving the Accuracy of Straight Line Segment Classifiers
Cmbining Dialectical Optimizatin and Gradient Descent Methds fr Imprving the Accuracy f Straight Line Segment Classifiers Rsari A. Medina Rdriguez and Rnald Fumi Hashimt University f Sa Paul Institute
More informationDifferentiation Applications 1: Related Rates
Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm
More informationCollocation Map for Overcoming Data Sparseness
Cllcatin Map fr Overcming Data Sparseness Mnj Kim, Yung S. Han, and Key-Sun Chi Department f Cmputer Science Krea Advanced Institute f Science and Technlgy Taejn, 305-701, Krea mj0712~eve.kaist.ac.kr,
More informationA new Type of Fuzzy Functions in Fuzzy Topological Spaces
IOSR Jurnal f Mathematics (IOSR-JM e-issn: 78-578, p-issn: 39-765X Vlume, Issue 5 Ver I (Sep - Oct06, PP 8-4 wwwisrjurnalsrg A new Type f Fuzzy Functins in Fuzzy Tplgical Spaces Assist Prf Dr Munir Abdul
More informationx 1 Outline IAML: Logistic Regression Decision Boundaries Example Data
Outline IAML: Lgistic Regressin Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester Lgistic functin Lgistic regressin Learning lgistic regressin Optimizatin The pwer f nn-linear basis functins Least-squares
More informationA New Evaluation Measure. J. Joiner and L. Werner. The problems of evaluation and the needed criteria of evaluation
III-l III. A New Evaluatin Measure J. Jiner and L. Werner Abstract The prblems f evaluatin and the needed criteria f evaluatin measures in the SMART system f infrmatin retrieval are reviewed and discussed.
More informationFall 2013 Physics 172 Recitation 3 Momentum and Springs
Fall 03 Physics 7 Recitatin 3 Mmentum and Springs Purpse: The purpse f this recitatin is t give yu experience wrking with mmentum and the mmentum update frmula. Readings: Chapter.3-.5 Learning Objectives:.3.
More informationModeling the Nonlinear Rheological Behavior of Materials with a Hyper-Exponential Type Function
www.ccsenet.rg/mer Mechanical Engineering Research Vl. 1, N. 1; December 011 Mdeling the Nnlinear Rhelgical Behavir f Materials with a Hyper-Expnential Type Functin Marc Delphin Mnsia Département de Physique,
More informationOn Huntsberger Type Shrinkage Estimator for the Mean of Normal Distribution ABSTRACT INTRODUCTION
Malaysian Jurnal f Mathematical Sciences 4(): 7-4 () On Huntsberger Type Shrinkage Estimatr fr the Mean f Nrmal Distributin Department f Mathematical and Physical Sciences, University f Nizwa, Sultanate
More informationVerification of Quality Parameters of a Solar Panel and Modification in Formulae of its Series Resistance
Verificatin f Quality Parameters f a Slar Panel and Mdificatin in Frmulae f its Series Resistance Sanika Gawhane Pune-411037-India Onkar Hule Pune-411037- India Chinmy Kulkarni Pune-411037-India Ojas Pandav
More informationPressure And Entropy Variations Across The Weak Shock Wave Due To Viscosity Effects
Pressure And Entrpy Variatins Acrss The Weak Shck Wave Due T Viscsity Effects OSTAFA A. A. AHOUD Department f athematics Faculty f Science Benha University 13518 Benha EGYPT Abstract:-The nnlinear differential
More informationDetermining the Accuracy of Modal Parameter Estimation Methods
Determining the Accuracy f Mdal Parameter Estimatin Methds by Michael Lee Ph.D., P.E. & Mar Richardsn Ph.D. Structural Measurement Systems Milpitas, CA Abstract The mst cmmn type f mdal testing system
More informationCAPACITY OF MULTI-ANTENNA ARRAY SYSTEMS IN INDOOR WIRELESS ENVIRONMENT
CAPACITY OF MULTI-ANTENNA ARRAY SYSTEMS IN INDOOR WIRELESS ENVIRONMENT Chen-Nee Chuah, Jseph M. Kahn and David Tse -7 Cry Hall, University f Califrnia Berkeley, CA 947 e-mail: {chuah, jmk, dtse}@eecs.berkeley.edu
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical
More informationInterference is when two (or more) sets of waves meet and combine to produce a new pattern.
Interference Interference is when tw (r mre) sets f waves meet and cmbine t prduce a new pattern. This pattern can vary depending n the riginal wave directin, wavelength, amplitude, etc. The tw mst extreme
More information* o * * o o 1.5. o o. o * 0.5 * * o * * o. o o. oo o. * * * o * 0.5. o o * * * o o. * * oo. o o o o. * o * * o* o
Pseudinverse Learning Algrithm fr Feedfrward Neural Netwrs Λ PING GUO and MICHAEL R. LYU Department f Cmputer Science and Engineering, The Chinese University f Hng Kng, Shatin, NT, Hng Kng. SAR f P.R.
More informationNumerical Simulation of the Thermal Resposne Test Within the Comsol Multiphysics Environment
Presented at the COMSOL Cnference 2008 Hannver University f Parma Department f Industrial Engineering Numerical Simulatin f the Thermal Respsne Test Within the Cmsl Multiphysics Envirnment Authr : C. Crradi,
More informationSource Coding and Compression
Surce Cding and Cmpressin Heik Schwarz Cntact: Dr.-Ing. Heik Schwarz heik.schwarz@hhi.fraunhfer.de Heik Schwarz Surce Cding and Cmpressin September 22, 2013 1 / 60 PartI: Surce Cding Fundamentals Heik
More information22.54 Neutron Interactions and Applications (Spring 2004) Chapter 11 (3/11/04) Neutron Diffusion
.54 Neutrn Interactins and Applicatins (Spring 004) Chapter (3//04) Neutrn Diffusin References -- J. R. Lamarsh, Intrductin t Nuclear Reactr Thery (Addisn-Wesley, Reading, 966) T study neutrn diffusin
More informationREPRESENTATIONS OF sp(2n; C ) SVATOPLUK KR YSL. Abstract. In this paper we have shown how a tensor product of an innite dimensional
ON A DISTINGUISHED CLASS OF INFINITE DIMENSIONAL REPRESENTATIONS OF sp(2n; C ) SVATOPLUK KR YSL Abstract. In this paper we have shwn hw a tensr prduct f an innite dimensinal representatin within a certain
More informationCOMP 551 Applied Machine Learning Lecture 4: Linear classification
COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted
More informationPart 3 Introduction to statistical classification techniques
Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms
More informationSections 15.1 to 15.12, 16.1 and 16.2 of the textbook (Robbins-Miller) cover the materials required for this topic.
Tpic : AC Fundamentals, Sinusidal Wavefrm, and Phasrs Sectins 5. t 5., 6. and 6. f the textbk (Rbbins-Miller) cver the materials required fr this tpic.. Wavefrms in electrical systems are current r vltage
More informationNUMBERS, MATHEMATICS AND EQUATIONS
AUSTRALIAN CURRICULUM PHYSICS GETTING STARTED WITH PHYSICS NUMBERS, MATHEMATICS AND EQUATIONS An integral part t the understanding f ur physical wrld is the use f mathematical mdels which can be used t
More informationON-LINE PROCEDURE FOR TERMINATING AN ACCELERATED DEGRADATION TEST
Statistica Sinica 8(1998), 207-220 ON-LINE PROCEDURE FOR TERMINATING AN ACCELERATED DEGRADATION TEST Hng-Fwu Yu and Sheng-Tsaing Tseng Natinal Taiwan University f Science and Technlgy and Natinal Tsing-Hua
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More informationModelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA
Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationCopyright Paul Tobin 63
DT, Kevin t. lectric Circuit Thery DT87/ Tw-Prt netwrk parameters ummary We have seen previusly that a tw-prt netwrk has a pair f input terminals and a pair f utput terminals figure. These circuits were
More informationBLAST / HIDDEN MARKOV MODELS
CS262 (Winter 2015) Lecture 5 (January 20) Scribe: Kat Gregry BLAST / HIDDEN MARKOV MODELS BLAST CONTINUED HEURISTIC LOCAL ALIGNMENT Use Cmmnly used t search vast bilgical databases (n the rder f terabases/tetrabases)
More informationIntroduction: A Generalized approach for computing the trajectories associated with the Newtonian N Body Problem
A Generalized apprach fr cmputing the trajectries assciated with the Newtnian N Bdy Prblem AbuBar Mehmd, Syed Umer Abbas Shah and Ghulam Shabbir Faculty f Engineering Sciences, GIK Institute f Engineering
More informationKinetic Model Completeness
5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins
More informationHow do scientists measure trees? What is DBH?
Hw d scientists measure trees? What is DBH? Purpse Students develp an understanding f tree size and hw scientists measure trees. Students bserve and measure tree ckies and explre the relatinship between
More information7.0 Heat Transfer in an External Laminar Boundary Layer
7.0 Heat ransfer in an Eternal Laminar Bundary Layer 7. Intrductin In this chapter, we will assume: ) hat the fluid prperties are cnstant and unaffected by temperature variatins. ) he thermal & mmentum
More informationEngineering Approach to Modelling Metal THz Structures
Terahertz Science and Technlgy, ISSN 1941-7411 Vl.4, N.1, March 11 Invited Paper ngineering Apprach t Mdelling Metal THz Structures Stepan Lucyszyn * and Yun Zhu Department f, Imperial Cllege Lndn, xhibitin
More informationRevision: August 19, E Main Suite D Pullman, WA (509) Voice and Fax
.7.4: Direct frequency dmain circuit analysis Revisin: August 9, 00 5 E Main Suite D Pullman, WA 9963 (509) 334 6306 ice and Fax Overview n chapter.7., we determined the steadystate respnse f electrical
More informationParticle Size Distributions from SANS Data Using the Maximum Entropy Method. By J. A. POTTON, G. J. DANIELL AND B. D. RAINFORD
3 J. Appl. Cryst. (1988). 21,3-8 Particle Size Distributins frm SANS Data Using the Maximum Entrpy Methd By J. A. PTTN, G. J. DANIELL AND B. D. RAINFRD Physics Department, The University, Suthamptn S9
More informationDavid HORN and Irit OPHER. School of Physics and Astronomy. Raymond and Beverly Sackler Faculty of Exact Sciences
Cmplex Dynamics f Neurnal Threshlds David HORN and Irit OPHER Schl f Physics and Astrnmy Raymnd and Beverly Sackler Faculty f Exact Sciences Tel Aviv University, Tel Aviv 69978, Israel hrn@neurn.tau.ac.il
More informationENG2410 Digital Design Sequential Circuits: Part A
ENG2410 Digital Design Sequential Circuits: Part A Fall 2017 S. Areibi Schl f Engineering University f Guelph Week #6 Tpics Sequential Circuit Definitins Latches Flip-Flps Delays in Sequential Circuits
More informationELECTRON CYCLOTRON HEATING OF AN ANISOTROPIC PLASMA. December 4, PLP No. 322
ELECTRON CYCLOTRON HEATING OF AN ANISOTROPIC PLASMA by J. C. SPROTT December 4, 1969 PLP N. 3 These PLP Reprts are infrmal and preliminary and as such may cntain errrs nt yet eliminated. They are fr private
More informationCurriculum Development Overview Unit Planning for 8 th Grade Mathematics MA10-GR.8-S.1-GLE.1 MA10-GR.8-S.4-GLE.2
Unit Title It s All Greek t Me Length f Unit 5 weeks Fcusing Lens(es) Cnnectins Standards and Grade Level Expectatins Addressed in this Unit MA10-GR.8-S.1-GLE.1 MA10-GR.8-S.4-GLE.2 Inquiry Questins (Engaging-
More information^YawataR&D Laboratory, Nippon Steel Corporation, Tobata, Kitakyushu, Japan
Detectin f fatigue crack initiatin frm a ntch under a randm lad C. Makabe," S. Nishida^C. Urashima,' H. Kaneshir* "Department f Mechanical Systems Engineering, University f the Ryukyus, Nishihara, kinawa,
More informationCurrent/voltage-mode third order quadrature oscillator employing two multiple outputs CCIIs and grounded capacitors
Indian Jurnal f Pure & Applied Physics Vl. 49 July 20 pp. 494-498 Current/vltage-mde third rder quadrature scillatr emplying tw multiple utputs CCIIs and grunded capacitrs Jiun-Wei Hrng Department f Electrnic
More informationSequential Allocation with Minimal Switching
In Cmputing Science and Statistics 28 (1996), pp. 567 572 Sequential Allcatin with Minimal Switching Quentin F. Stut 1 Janis Hardwick 1 EECS Dept., University f Michigan Statistics Dept., Purdue University
More informationMODULE 1. e x + c. [You can t separate a demominator, but you can divide a single denominator into each numerator term] a + b a(a + b)+1 = a + b
. REVIEW OF SOME BASIC ALGEBRA MODULE () Slving Equatins Yu shuld be able t slve fr x: a + b = c a d + e x + c and get x = e(ba +) b(c a) d(ba +) c Cmmn mistakes and strategies:. a b + c a b + a c, but
More informationAn Introduction to Complex Numbers - A Complex Solution to a Simple Problem ( If i didn t exist, it would be necessary invent me.
An Intrductin t Cmple Numbers - A Cmple Slutin t a Simple Prblem ( If i didn t eist, it wuld be necessary invent me. ) Our Prblem. The rules fr multiplying real numbers tell us that the prduct f tw negative
More informationSource Coding Fundamentals
Surce Cding Fundamentals Surce Cding Fundamentals Thmas Wiegand Digital Image Cmmunicatin 1 / 54 Surce Cding Fundamentals Outline Intrductin Lssless Cding Huffman Cding Elias and Arithmetic Cding Rate-Distrtin
More informationANALYTICAL SOLUTIONS TO THE PROBLEM OF EDDY CURRENT PROBES
ANALYTICAL SOLUTIONS TO THE PROBLEM OF EDDY CURRENT PROBES CONSISTING OF LONG PARALLEL CONDUCTORS B. de Halleux, O. Lesage, C. Mertes and A. Ptchelintsev Mechanical Engineering Department Cathlic University
More informationMath Foundations 20 Work Plan
Math Fundatins 20 Wrk Plan Units / Tpics 20.8 Demnstrate understanding f systems f linear inequalities in tw variables. Time Frame December 1-3 weeks 6-10 Majr Learning Indicatrs Identify situatins relevant
More informationRECHERCHES Womcodes constructed with projective geometries «Womcodes» construits à partir de géométries projectives Frans MERKX (') École Nationale Su
Wmcdes cnstructed with prjective gemetries «Wmcdes» cnstruits à partir de gémétries prjectives Frans MERKX (') Écle Natinale Supérieure de Télécmmunicatins (ENST), 46, rue Barrault, 75013 PARIS Étudiant
More informationVideo Encoder Control
Vide Encder Cntrl Thmas Wiegand Digital Image Cmmunicatin 1 / 41 Outline Intrductin Encder Cntrl using Lagrange multipliers Lagrangian ptimizatin Lagrangian bit allcatin Lagrangian Optimizatin in Hybrid
More informationSection 6-2: Simplex Method: Maximization with Problem Constraints of the Form ~
Sectin 6-2: Simplex Methd: Maximizatin with Prblem Cnstraints f the Frm ~ Nte: This methd was develped by Gerge B. Dantzig in 1947 while n assignment t the U.S. Department f the Air Frce. Definitin: Standard
More informationSOLUTION OF THREE-CONSTRAINT ENTROPY-BASED VELOCITY DISTRIBUTION
SOLUTION OF THREECONSTRAINT ENTROPYBASED VELOCITY DISTRIBUTION By D. E. Barbe,' J. F. Cruise, 2 and V. P. Singh, 3 Members, ASCE ABSTRACT: A twdimensinal velcity prfile based upn the principle f maximum
More informationPredictive Coding. U n " S n
Intrductin Predictive Cding The better the future f a randm prcess is predicted frm the past and the mre redundancy the signal cntains, the less new infrmatin is cntributed by each successive bservatin
More informationA Frequency-Based Find Algorithm in Mobile Wireless Computing Systems
A Frequency-Based Find Algrithm in Mbile Wireless Cmputing Systems Seung-yun Kim and Waleed W Smari Department f Electrical Cmputer Engineering University f Daytn 300 Cllege Park Daytn, OH USA 45469 Abstract
More information