The Dynamics of Learning Vector Quantization
|
|
- Norma Grant
- 6 years ago
- Views:
Transcription
1 The Dynamic of Learning Vector Quantization Barbara Hammer TU Clauthal-Zellerfeld Intitute of Computing Science Michael Biehl, Anarta Ghoh Rijkuniveriteit Groningen Mathematic and Computing Science
2 Introduction prototype-baed learning from example data: repreentation, claification Vector Quantization (VQ) Learning Vector Quantization (LVQ) The dynamic of learning a model ituation: randomized data learning algorithm for VQ und LVQ analyi and comparion: dynamic, ucce of learning Summary Outlook
3 Vector Quantization (VQ) aim: repreentation of large amount of data by (few) prototype vector example: identification and grouping in cluter of imilar data aignment of feature vector ξ to the cloet prototype w (imilarity or ditance meaure, e.g. Euclidean ditance )
4 unupervied competitive learning initialize K prototype vector preent a ingle example identify the cloet prototype, i.e the o-called winner move the winner even cloer toward the example intuitively clear, plauible procedure - place prototype in area with high denity of data - identifie the mot relevant combination of feature - (tochatic) on-line gradient decent with repect to the cot function...
5 quantization error H VQ K P K = j j= 1 = 1 k j ( ) 2 ( ) ξ w Θ d d k j here: Euclidean ditance prototype data d w j j i the winner! aim: faithful repreentation (in general: clutering ) Reult depend on - the number of prototype vector - the ditance meaure / metric ued
6 Learning Vector Quantization (LVQ) aim: claification of data learning from example example itutation: 3 clae, 3 prototype claification: aignment of a vector ξ to the cla of the cloet prototype w Learning: choice of prototype according to example data aim : generalization ability, i.e. correct claification of novel data after training
7 motly: heuritically motivated variation of competitive learning prominent example [Kohonen]: LVQ 2.1. initialize prototype vector (for different clae) preent a ingle example identify the cloet correct and the cloet wrong prototype move the correponding winner toward / away from the example known convergence / tability problem, e.g. for infrequent clae
8 LVQ algorithm... - appear plauible, intuitive, flexible - are fat, eay to implement - are frequently applied in a variety of problem involving the claification of tructured data, a few example: - real time peech recognition - medical diagnoi, e.g. from hitological data - gene expreion data analyi - texture recognition and claification -...
9 illutration: microcopic image of (pig) emen cell after freezing and torage, c/o Lidia Sanchez-Gonzalez, Leon/Spain
10 illutration: microcopic image of (pig) emen cell after freezing and torage, c/o Lidia Sanchez-Gonzalez, Leon/Spain healthy cell damaged cell prototype obtained by LVQ (1)
11 LVQ algorithm... - are often baed on purely heuritic argument, or derived from a cot function with unclear relation to the generalization ability - almot excluively ue the Euclidean ditance meaure, inappropriate for heterogeneou data - lack, in general, a thorough theoretical undertanding of dynamic, convergence propertie, performance w.r.t. generalization, etc.
12 In the following: analyi of LVQ algorithm w.r.t. - dynamic of the learning proce - performance, i.e. generalization ability - aymptotic behavior in the limit of many example typical behavior in a model ituation - randomized, high-dimenional data - eential feature of LVQ learning aim: - contribute to the theoretical undertanding - develop efficient LVQ cheme - tet in application
13 model ituation: two cluter of N-dimenional data random vector ξ R N according to P( ξ) = p P( ξ σ) mixture of two Gauian: σ=± 1 ( 2π) σ ( ) ξ -l 1 1 P( ξ σ) exp Β N/2 2 2 = σ orthonormal center vector: B +, B - R N, ( B σ ) 2 =1, B + B - =0 (p - ) prior weight of clae p +, p - p + + p - = 1 eparation l B - l B + independent component: ξ = l j B σ σ, j (p + ) ξ 2 j σ 2 j σ = 1 ξ ξ 2 = N j= 1 ξ 2 j = N + l 2
14 high-dimenional data (formally: N ) 400 example ξ R N, N=200, l=1, p + =0.6 projection into the plane of center vector B +, B - projection in two independent random direction w 1,2 (240) (160) (240) (160) y = B ξ x =w ξ 2 2 y + = B + ξ x1 =w ξ 1 Note: model for tudying typical behavior of LVQ algorithm, not: denity-etimation baed claification
15 dynamic of on-line training equence of independent random data ( = 1,2,3,... ) ( ) ξ acc. to P ξ update of prototype vector: w -1 η = w + f -... N [ ] ( -1 ) d, d, S,σ, ξ w S,σ= ± 1 d = 1 ( ξ w ) 2 learning rate, tep ize competition, direction of update etc. change of prototype toward or away from the current data above example: Vector Quantization [ ] ( ) f... Θ d d unupervied Vector Quantization = The Winner Take It All (clae irrelevant/unknown) + 1 ( correct cla) f 1 ( wrong cla ) Learning Vector Quantization 2.1. [ ] {... = S σ = here: two prototype, no explicit competition
16 mathematical analyi of the learning dynamic 1. decription in term of a few characteritic quantititie R σ = w B projection in the (B +, B - )-plane σ Q t = w w length and relative poition of prototype t (,t,σ { 1+, 1} ) ( here: R 2N R 7 ) w [ ] ( -1) d d, S,σ, ξ w -1 η = w + f... N, - recurion R Q σ t R 1/N Q 1/N -1 σ -1 t = = η f η f [ ] ( -1)... y R σ [ ] ( -1) [ ] ( -1) 2... x Q + η f... x Q + η f [...] f [...] + Ο( 1 ) t σ t t t t Ν random vector ξ enter only in the form of projection x -1 = w ξ yτ = Bτ ξ ditance ( ) 2 ( ) ξ w 1 = ξ 2 2x Q -1 d = +
17 2. average over the current example random vector acc. to P( ξ σ) in the thermodynamic limit N correlated Gauian random quantitie x y τ = = w B -1 τ ξ ξ completely pecified in term of firt and econd moment (w/o indice ) x σ N w,j ξj j= 1 = = l w,jbσ,j = σ N j= 1 l R σ y τ σ = l δ σ = 0 l if S= σ ele y ρ y τ σ - y ρ σ y τ σ = δ ρτ x xt - x σ x σ t = Q σ t x yτ - x σ y σ τ = R σ τ averaged recurion L = pσ L σ cloed in { R σ, Q t } σ=± 1
18 3. elf-averaging propertie characteritic quantitie Qt, R σ - depend on the random equence of example data - their variance vanihe with N (here: N -1 ) learning dynamic i completely decribed in term of average 4. continuou learning time α= N # of example # of learning tep per degree of freedom recurion coupled, ordinary differential equation evolution of projection Q t ( α ), R σ ( α )
19 5. learning curve probability for miclaification of a novel example ε g ( d+ d ) + p Θ( ) + d = p+ Θ d+ L = p + Φ 2 ( R R ) Q Q 2 ( R R ) 1 Q Q 2l l Q 2Q + Q 2 Q 2Q + Q p Φ generalization error ε g (α) after training with α N example invetigation and comparion of given algorithm - repulive/attractive fixed point of the dynamic - aymptotic behavior for α - dependence on learning rate, eparation, initialization -... optimization and development of new precription - time-dependent learning rate η(α) maximize - variational optimization w.r.t. f [...] -... d ε g d α
20 optimal claification with minimal generalization error in the model ituation (equal variance of cluter): eparation of clae by the plane with p P( ξ σ= 1) = p+ P( ξ σ= + 1) (p + ) l B + B - (p - >p + ) exce error 0.50 ε g l=0 minimal ε g a a function of prior weight l= l= p + 1.0
21 LVQ 2.1. update the correct and wrong winner [Seo, Obermeyer]: LVQ2.1. ս cot function (likelihood ratio) w = w -1 + η N σ S ( -1) ξ w p σ = (1+m σ ) / 2 (m>0) (analytical) integration for w (0) = 0 R R ++ = = l m l m 1+ m 2 1 m 2 η m α l 1 m ηm α ( 1 e ) R = ( 1 e ) + m η m α l 1+ m + η m α ( 1 e + ) R = ( 1 e ) K K + m 2 2 Q ++ = K theory and imulation (N=100) p + =0.8, l=1, η=0.5 average over 100 independent run R ++, R +, Q ++ remain finite 6 0 Q R Q + + R + + R + R, R +, Q, Q + with α - 6 Q + R α
22 problem: intability of the algorithm due to repulion of wrong prototype (p + > p - ) trivial claification für α : ε g = max { p +,p - } (p - ) trategie: - election of data in a window cloe to the current deciion boundary low down the repulion, ytem remain intable - Soft Robut Learning Vector Quantization [Seo & Obermayer] denity-etimation baed cot function limiting cae Learning from mitake: LVQ2.1-tep only, if the example i currently miclaified low learning, poor generalization
23 The winner take it all [ ] ( ) LVQ 1 [Kohonen] -1 η -1 w w + Θd d σ S ξ w I) LVQ 1 = S only the winner i updated according to the cla memberhip N S winner w ±1 numerical integration for w (0)=0 R Q R -- R S+ w + l B + w - Q +- R -+ Q -- R -- w - l B - α theory and imulation (N=200) p + =0.2, l=1.2, η=1.2 averaged over 100 indep. run R S- trajectorie in the (B +,B - )-plane ( ) α=20,40, optimal deciion boundary aymptotic poition
24 learning curve (p+=0.2, l=1.2) ε0.26 g ε g 0.22 η=1.2 η - role of the learning rate - tationary tate: ε g (α ) grow lin. with η η 0 - variable rate η(α)!? α α well-defined aymptotic: ε g 0.22 η 0 η 0, α ( η α ) 0.18 (ODE linear in η) uboptimal min. ε g (η α)
25 The winner take it all II ) LVQ+ ( only poitive tep without repulion) w η N -1 = w + Θ S [ ] ( ) ( -1) d d δ σ, S ξ w S winner correct (w updated only from cla S) w + l B + α aymptotic configuration ymmetric about l (B + +B - )/2 l B - w - p+=0.2, l=1.2, η=1.2 claification cheme and the achieved generalization error are independent of the prior weight p ± (and optimal for p ± = 1/2 ) LVQ+ VQ within the clae
26 ε g p+=0.2, l=1.0, η=1.0 learning curve LVQ+ LVQ1 α ε g min {p +,p - } aymptotic: η 0, (ηα) - LVQ 2.1. trivial aignment to the more frequent cla optimal claification p + - LVQ 1 here: cloe to optimal claification - LVQ+ min-max olution p ± -independent claification
27 Vector Quantization [ ] ( ) competitive learning -1 η -1 w = w + Θ d d ξ w N S S w winner numerical integration for w (0) 0 ( p + =0.2, l=1.0, η=1.2 ) cla memberhip i unknown or identical for all data ε g 1.0 LVQ+ VQ R -- R ++ R +- ytem i invariant under exchange of the prototype weakly repulive fixed point 0 0 α α LVQ1 R -+ α
28 interpretation: - VQ, unupervied learning unlabelled data - LVQ, two prototype of the ame cla, identical label - LVQ, different clae, but label are not ued in training ε g aymptotic (α,η 0, ηα ) p + 0 p + p low quantization error - high gen. error ε g
29 Summary prototype prototype-baed learning Vector Quantization and Learning Vector Quantization a model cenario: two cluter, two prototype dynamic of online training comparion of algorithm: LVQ 2.1.: intability, trivial (tationary) claification LVQ 1 : cloe to optimal aymptotic generalization LVQ + : min-max olution w.r.t. aymptotic generalization VQ : ymmetry breaking, repreentation work in progre, outlook regularization of LVQ 2.1, Robut Soft LVQ [Seo, Obermayer] model: different cluter variance, more cluter/prototype optimized procedure: learning rate chedule, variational approach / denity etimation / Baye optimal on-line everal clae and prototype
30 Perpective Generalized Relevance LVQ [Hammer & Villmann] N λ ( i= 1 ( ) adaptive metric, e.g. ditance meaure i d w,ξ) = λi ξ i w Self Self-Organizing Map (SOM) (many) N-dim. prototype form a (low) d-dimenional grid repreentation of data in a topology preerving map training 2 neighborhood preerving SOM Neural Ga (ditance baed) application
Confusion matrices. True / False positives / negatives. INF 4300 Classification III Anne Solberg The agenda today: E.g., testing for cancer
INF 4300 Claification III Anne Solberg 29.10.14 The agenda today: More on etimating claifier accuracy Cure of dimenionality knn-claification K-mean clutering x i feature vector for pixel i i- The cla label
More informationClustering Methods without Given Number of Clusters
Clutering Method without Given Number of Cluter Peng Xu, Fei Liu Introduction A we now, mean method i a very effective algorithm of clutering. It mot powerful feature i the calability and implicity. However,
More informationA FUNCTIONAL BAYESIAN METHOD FOR THE SOLUTION OF INVERSE PROBLEMS WITH SPATIO-TEMPORAL PARAMETERS AUTHORS: CORRESPONDENCE: ABSTRACT
A FUNCTIONAL BAYESIAN METHOD FOR THE SOLUTION OF INVERSE PROBLEMS WITH SPATIO-TEMPORAL PARAMETERS AUTHORS: Zenon Medina-Cetina International Centre for Geohazard / Norwegian Geotechnical Intitute Roger
More informationConnectivity in large mobile ad-hoc networks
Weiertraß-Intitut für Angewandte Analyi und Stochatik Connectivity in large mobile ad-hoc network WOLFGANG KÖNIG (WIAS und U Berlin) joint work with HANNA DÖRING (Onabrück) and GABRIEL FARAUD (Pari) Mohrentraße
More informationFactor Analysis with Poisson Output
Factor Analyi with Poion Output Gopal Santhanam Byron Yu Krihna V. Shenoy, Department of Electrical Engineering, Neurocience Program Stanford Univerity Stanford, CA 94305, USA {gopal,byronyu,henoy}@tanford.edu
More informationSimple Observer Based Synchronization of Lorenz System with Parametric Uncertainty
IOSR Journal of Electrical and Electronic Engineering (IOSR-JEEE) ISSN: 78-676Volume, Iue 6 (Nov. - Dec. 0), PP 4-0 Simple Oberver Baed Synchronization of Lorenz Sytem with Parametric Uncertainty Manih
More informationStochastic Optimization with Inequality Constraints Using Simultaneous Perturbations and Penalty Functions
Stochatic Optimization with Inequality Contraint Uing Simultaneou Perturbation and Penalty Function I-Jeng Wang* and Jame C. Spall** The John Hopkin Univerity Applied Phyic Laboratory 11100 John Hopkin
More informationSMALL-SIGNAL STABILITY ASSESSMENT OF THE EUROPEAN POWER SYSTEM BASED ON ADVANCED NEURAL NETWORK METHOD
SMALL-SIGNAL STABILITY ASSESSMENT OF THE EUROPEAN POWER SYSTEM BASED ON ADVANCED NEURAL NETWORK METHOD S.P. Teeuwen, I. Erlich U. Bachmann Univerity of Duiburg, Germany Department of Electrical Power Sytem
More informationMulti-dimensional Fuzzy Euler Approximation
Mathematica Aeterna, Vol 7, 2017, no 2, 163-176 Multi-dimenional Fuzzy Euler Approximation Yangyang Hao College of Mathematic and Information Science Hebei Univerity, Baoding 071002, China hdhyywa@163com
More informationAlternate Dispersion Measures in Replicated Factorial Experiments
Alternate Diperion Meaure in Replicated Factorial Experiment Neal A. Mackertich The Raytheon Company, Sudbury MA 02421 Jame C. Benneyan Northeatern Univerity, Boton MA 02115 Peter D. Krau The Raytheon
More informationOptimal Coordination of Samples in Business Surveys
Paper preented at the ICES-III, June 8-, 007, Montreal, Quebec, Canada Optimal Coordination of Sample in Buine Survey enka Mach, Ioana Şchiopu-Kratina, Philip T Rei, Jean-Marc Fillion Statitic Canada New
More informationOne Class of Splitting Iterative Schemes
One Cla of Splitting Iterative Scheme v Ciegi and V. Pakalnytė Vilniu Gedimina Technical Univerity Saulėtekio al. 11, 2054, Vilniu, Lithuania rc@fm.vtu.lt Abtract. Thi paper deal with the tability analyi
More informationBy Xiaoquan Wen and Matthew Stephens University of Michigan and University of Chicago
Submitted to the Annal of Applied Statitic SUPPLEMENTARY APPENDIX TO BAYESIAN METHODS FOR GENETIC ASSOCIATION ANALYSIS WITH HETEROGENEOUS SUBGROUPS: FROM META-ANALYSES TO GENE-ENVIRONMENT INTERACTIONS
More informationThe continuous time random walk (CTRW) was introduced by Montroll and Weiss 1.
1 I. CONTINUOUS TIME RANDOM WALK The continuou time random walk (CTRW) wa introduced by Montroll and Wei 1. Unlike dicrete time random walk treated o far, in the CTRW the number of jump n made by the walker
More informationTHE IDENTIFICATION OF THE OPERATING REGIMES OF THE CONTROLLERS BY THE HELP OF THE PHASE TRAJECTORY
Mariu M. B LA Aurel Vlaicu Univerity of Arad, Engineering Faculty Bd. Revolu iei nr. 77, 3030, Arad, Romania, E-mail: mariu.bala@ieee.org THE IDENTIFICATION OF THE OPERATING REGIMES OF THE CONTROLLERS
More informationLearning Multiplicative Interactions
CSC2535 2011 Lecture 6a Learning Multiplicative Interaction Geoffrey Hinton Two different meaning of multiplicative If we take two denity model and multiply together their probability ditribution at each
More informationMATEMATIK Datum: Tid: eftermiddag. A.Heintz Telefonvakt: Anders Martinsson Tel.:
MATEMATIK Datum: 20-08-25 Tid: eftermiddag GU, Chalmer Hjälpmedel: inga A.Heintz Telefonvakt: Ander Martinon Tel.: 073-07926. Löningar till tenta i ODE och matematik modellering, MMG5, MVE6. Define what
More informationCHEAP CONTROL PERFORMANCE LIMITATIONS OF INPUT CONSTRAINED LINEAR SYSTEMS
Copyright 22 IFAC 5th Triennial World Congre, Barcelona, Spain CHEAP CONTROL PERFORMANCE LIMITATIONS OF INPUT CONSTRAINED LINEAR SYSTEMS Tritan Pérez Graham C. Goodwin Maria M. Serón Department of Electrical
More informationA Simplified Methodology for the Synthesis of Adaptive Flight Control Systems
A Simplified Methodology for the Synthei of Adaptive Flight Control Sytem J.ROUSHANIAN, F.NADJAFI Department of Mechanical Engineering KNT Univerity of Technology 3Mirdamad St. Tehran IRAN Abtract- A implified
More informationControl of Delayed Integrating Processes Using Two Feedback Controllers R MS Approach
Proceeding of the 7th WSEAS International Conference on SYSTEM SCIENCE and SIMULATION in ENGINEERING (ICOSSSE '8) Control of Delayed Integrating Procee Uing Two Feedback Controller R MS Approach LIBOR
More informationCHAPTER 4 DESIGN OF STATE FEEDBACK CONTROLLERS AND STATE OBSERVERS USING REDUCED ORDER MODEL
98 CHAPTER DESIGN OF STATE FEEDBACK CONTROLLERS AND STATE OBSERVERS USING REDUCED ORDER MODEL INTRODUCTION The deign of ytem uing tate pace model for the deign i called a modern control deign and it i
More informationSOLVING THE KONDO PROBLEM FOR COMPLEX MESOSCOPIC SYSTEMS
SOLVING THE KONDO POBLEM FO COMPLEX MESOSCOPIC SYSTEMS V. DINU and M. ÞOLEA National Intitute of Material Phyic, Bucharet-Magurele P.O. Box MG-7, omania eceived February 21, 2005 Firt we preent the calculation
More informationChapter Landscape of an Optimization Problem. Local Search. Coping With NP-Hardness. Gradient Descent: Vertex Cover
Coping With NP-Hardne Chapter 12 Local Search Q Suppoe I need to olve an NP-hard problem What hould I do? A Theory ay you're unlikely to find poly-time algorithm Mut acrifice one of three deired feature
More informationNetwork based Sensor Localization in Multi-Media Application of Precision Agriculture Part 2: Time of Arrival
Network baed Senor Localization in Multi-Media Application of Preciion Agriculture Part : Time of Arrival Herman Sahota IBM, Silicon Valley Laboratory Email: hahota@u.ibm.com Ratneh Kumar, IEEE Fellow
More informationMassless fermions living in a non-abelian QCD vortex based on arxiv: [hep-ph]
Male fermion living in a non-abelian QCD vortex baed on arxiv:1001.3730 [hep-ph] Collaborator : S.Yaui KEK and M. Nitta Keio U. K. Itakura KEK Theory Center, IPNS, KEK New frontier in QCD @ Kyoto March
More informationDetermination of the local contrast of interference fringe patterns using continuous wavelet transform
Determination of the local contrat of interference fringe pattern uing continuou wavelet tranform Jong Kwang Hyok, Kim Chol Su Intitute of Optic, Department of Phyic, Kim Il Sung Univerity, Pyongyang,
More informationComparing Means: t-tests for Two Independent Samples
Comparing ean: t-tet for Two Independent Sample Independent-eaure Deign t-tet for Two Independent Sample Allow reearcher to evaluate the mean difference between two population uing data from two eparate
More informationGain and Phase Margins Based Delay Dependent Stability Analysis of Two- Area LFC System with Communication Delays
Gain and Phae Margin Baed Delay Dependent Stability Analyi of Two- Area LFC Sytem with Communication Delay Şahin Sönmez and Saffet Ayaun Department of Electrical Engineering, Niğde Ömer Halidemir Univerity,
More informationINTEGRATION OF A PHENOMENOLOGICAL RADAR SENSOR MODELL IN IPG CARMAKER FOR SIMULATION OF ACC AND AEB SYSTEMS
INTEGRATION OF A PHENOMENOLOGICAL RADAR SENSOR MODELL IN IPG CARMAKER FOR SIMULATION OF ACC AND AEB SYSTEMS Dr. A. Eichberger*, S. Bernteiner *, Z. Magoi *, D. Lindvai-Soo **, * Intitute of Automotive
More informationDYNAMIC MODELS FOR CONTROLLER DESIGN
DYNAMIC MODELS FOR CONTROLLER DESIGN M.T. Tham (996,999) Dept. of Chemical and Proce Engineering Newcatle upon Tyne, NE 7RU, UK.. INTRODUCTION The problem of deigning a good control ytem i baically that
More informationOnline supplementary information
Electronic Supplementary Material (ESI) for Soft Matter. Thi journal i The Royal Society of Chemitry 15 Online upplementary information Governing Equation For the vicou flow, we aume that the liquid thickne
More informationPredicting the Performance of Teams of Bounded Rational Decision-makers Using a Markov Chain Model
The InTITuTe for ytem reearch Ir TechnIcal report 2013-14 Predicting the Performance of Team of Bounded Rational Deciion-maer Uing a Marov Chain Model Jeffrey Herrmann Ir develop, applie and teache advanced
More informationCenter Manifolds Optimal Regularity for Nonuniformly Hyperbolic Dynamics 1
São Paulo Journal of Mathematical Science 5, 1 (2011), 1 22 Center Manifold Optimal Regularity for Nonuniformly Hyperbolic Dynamic 1 Lui Barreira and Claudia Vall Abtract. For ufficiently mall perturbation
More informationMathematical modeling of control systems. Laith Batarseh. Mathematical modeling of control systems
Chapter two Laith Batareh Mathematical modeling The dynamic of many ytem, whether they are mechanical, electrical, thermal, economic, biological, and o on, may be decribed in term of differential equation
More informationSource slideplayer.com/fundamentals of Analytical Chemistry, F.J. Holler, S.R.Crouch. Chapter 6: Random Errors in Chemical Analysis
Source lideplayer.com/fundamental of Analytical Chemitry, F.J. Holler, S.R.Crouch Chapter 6: Random Error in Chemical Analyi Random error are preent in every meaurement no matter how careful the experimenter.
More informationSome Sets of GCF ϵ Expansions Whose Parameter ϵ Fetch the Marginal Value
Journal of Mathematical Reearch with Application May, 205, Vol 35, No 3, pp 256 262 DOI:03770/jin:2095-26520503002 Http://jmredluteducn Some Set of GCF ϵ Expanion Whoe Parameter ϵ Fetch the Marginal Value
More informationRandom vs. Deterministic Deployment of Sensors in the Presence of Failures and Placement Errors
Random v. Determinitic Deployment of Senor in the Preence of Failure and Placement Error Paul Baliter Univerity of Memphi pbalitr@memphi.edu Santoh Kumar Univerity of Memphi antoh.kumar@memphi.edu Abtract
More informationSuggested Answers To Exercises. estimates variability in a sampling distribution of random means. About 68% of means fall
Beyond Significance Teting ( nd Edition), Rex B. Kline Suggeted Anwer To Exercie Chapter. The tatitic meaure variability among core at the cae level. In a normal ditribution, about 68% of the core fall
More informationSecretary problems with competing employers
Secretary problem with competing employer Nicole Immorlica 1, Robert Kleinberg 2, and Mohammad Mahdian 1 1 Microoft Reearch, One Microoft Way, Redmond, WA. {nickle,mahdian}@microoft.com 2 UC Berkeley Computer
More informationarxiv: v1 [cs.sy] 9 Aug 2017
Trade-Off in Stochatic Event-Triggered Control Burak Demirel, Alex S Leong, Vijay Gupta and Daniel E Quevedo arxiv:70802756v csy 9 Aug 207 Abtract Thi paper tudie the optimal output-feedback control of
More informationSUPPLEMENTARY INFORMATION
DOI: 10.1038/NPHOTON.014.108 Supplementary Information "Spin angular momentum and tunable polarization in high harmonic generation" Avner Fleicher, Ofer Kfir, Tzvi Dikin, Pavel Sidorenko, and Oren Cohen
More informationLinear Quadratic Stochastic Differential Games under Asymmetric Value of Information
Preprint of the 2th World Congre The International Federation of Automatic Control Touloue, France, July 9-4, 27 Linear Quadratic Stochatic Differential Game under Aymmetric Value of Information Dipankar
More informationControl Systems Engineering ( Chapter 7. Steady-State Errors ) Prof. Kwang-Chun Ho Tel: Fax:
Control Sytem Engineering ( Chapter 7. Steady-State Error Prof. Kwang-Chun Ho kwangho@hanung.ac.kr Tel: 0-760-453 Fax:0-760-4435 Introduction In thi leon, you will learn the following : How to find the
More informationarxiv:hep-ex/ v1 4 Jun 2001
T4 Production at Intermediate Energie and Lund Area Law Haiming Hu, An Tai arxiv:hep-ex/00607v 4 Jun 00 Abtract The Lund area law wa developed into a onte Carlo program LUARLW. The important ingredient
More informationIntegration of RTO with MPC through the gradient of a convex function
Preprint of the 8th IFAC Sympoium on Advanced Control of Chemical Procee he International Federation of Automatic Control Furama Riverfront, Singapore, July 1-13, 1 Integration of RO with MPC through the
More informationEFFECT ON PERSISTENCE OF INTRA-SPECIFIC COMPETITION IN COMPETITION MODELS
Electronic Journal of Differential Equation, Vol. 2007(2007, No. 25, pp. 0. ISSN: 072-669. URL: http://ejde.math.txtate.edu or http://ejde.math.unt.edu ftp ejde.math.txtate.edu (login: ftp EFFECT ON PERSISTENCE
More informationStability. ME 344/144L Prof. R.G. Longoria Dynamic Systems and Controls/Lab. Department of Mechanical Engineering The University of Texas at Austin
Stability The tability of a ytem refer to it ability or tendency to eek a condition of tatic equilibrium after it ha been diturbed. If given a mall perturbation from the equilibrium, it i table if it return.
More informationMassachusetts Institute of Technology Dynamics and Control II
I E Maachuett Intitute of Technology Department of Mechanical Engineering 2.004 Dynamic and Control II Laboratory Seion 5: Elimination of Steady-State Error Uing Integral Control Action 1 Laboratory Objective:
More informationQUENCHED LARGE DEVIATION FOR SUPER-BROWNIAN MOTION WITH RANDOM IMMIGRATION
Infinite Dimenional Analyi, Quantum Probability and Related Topic Vol., No. 4 28) 627 637 c World Scientific Publihing Company QUENCHED LARGE DEVIATION FOR SUPER-BROWNIAN MOTION WITH RANDOM IMMIGRATION
More informationReinforcement Learning
Reinforcement Learning Yihay Manour Google Inc. & Tel-Aviv Univerity Outline Goal of Reinforcement Learning Mathematical Model (MDP) Planning Learning Current Reearch iue 2 Goal of Reinforcement Learning
More informationQuark-Gluon Plasma in Proton-Proton Scattering at the LHC?
Quark-Gluon Plama in Proton-Proton Scattering at the LHC? K. Werner (a), Iu. Karpenko (b), T. Pierog (c) (a) SUBATECH, Univerity of Nante INP/CNRS EMN, Nante, France (b) Bogolyubov Intitute for Theoretical
More informationNONLINEAR CONTROLLER DESIGN FOR A SHELL AND TUBE HEAT EXCHANGER AN EXPERIMENTATION APPROACH
International Journal of Electrical, Electronic and Data Communication, ISSN: 232-284 Volume-3, Iue-8, Aug.-25 NONLINEAR CONTROLLER DESIGN FOR A SHELL AND TUBE HEAT EXCHANGER AN EXPERIMENTATION APPROACH
More informationEvolutionary Algorithms Based Fixed Order Robust Controller Design and Robustness Performance Analysis
Proceeding of 01 4th International Conference on Machine Learning and Computing IPCSIT vol. 5 (01) (01) IACSIT Pre, Singapore Evolutionary Algorithm Baed Fixed Order Robut Controller Deign and Robutne
More informationSTOCHASTIC DIFFERENTIAL GAMES:THE LINEAR QUADRATIC ZERO SUM CASE
Sankhyā : he Indian Journal of Statitic 1995, Volume 57, Serie A, Pt. 1, pp.161 165 SOCHASIC DIFFERENIAL GAMES:HE LINEAR QUADRAIC ZERO SUM CASE By R. ARDANUY Univeridad de Salamanca SUMMARY. hi paper conider
More informationCodes Correcting Two Deletions
1 Code Correcting Two Deletion Ryan Gabry and Frederic Sala Spawar Sytem Center Univerity of California, Lo Angele ryan.gabry@navy.mil fredala@ucla.edu Abtract In thi work, we invetigate the problem of
More informationEXTENDED STABILITY MARGINS ON CONTROLLER DESIGN FOR NONLINEAR INPUT DELAY SYSTEMS. Otto J. Roesch, Hubert Roth, Asif Iqbal
EXTENDED STABILITY MARGINS ON CONTROLLER DESIGN FOR NONLINEAR INPUT DELAY SYSTEMS Otto J. Roech, Hubert Roth, Aif Iqbal Intitute of Automatic Control Engineering Univerity Siegen, Germany {otto.roech,
More informationMultiple Sequence Alignment. Progressive Alignment Iterative Pairwise Guide Tree ClustalW Co-linearity Multiple Sequence Alignment Editors
Yverdon Le Bain Introduction to Bioinformatic Introduction to Bioinformatic ami Khuri Department of Computer cience an Joé tate Univerity an Joé, California, UA khuri@c.ju.edu www.c.ju.edu/faculty/khuri
More informationAsymptotic Values and Expansions for the Correlation Between Different Measures of Spread. Anirban DasGupta. Purdue University, West Lafayette, IN
Aymptotic Value and Expanion for the Correlation Between Different Meaure of Spread Anirban DaGupta Purdue Univerity, Wet Lafayette, IN L.R. Haff UCSD, La Jolla, CA May 31, 2003 ABSTRACT For iid ample
More informationPARAMETRIC ESTIMATION OF HAZARD FUNCTIONS WITH STOCHASTIC COVARIATE PROCESSES
Sankhyā : The Indian Journal of Statitic 1999, Volume 61, Serie A, Pt. 2, pp. 174-188 PARAMETRIC ESTIMATION OF HAZARD FUNCTIONS WITH STOCHASTIC COVARIATE PROCESSES By SIMEON M. BERMAN Courant Intitute
More informationA generalized mathematical framework for stochastic simulation and forecast of hydrologic time series
WATER RESOURCES RESEARCH, VOL. 36, NO. 6, PAGES 1519 1533, JUNE 2000 A generalized mathematical framework for tochatic imulation and forecat of hydrologic time erie Demetri Koutoyianni Department of Water
More informationOverflow from last lecture: Ewald construction and Brillouin zones Structure factor
Lecture 5: Overflow from lat lecture: Ewald contruction and Brillouin zone Structure factor Review Conider direct lattice defined by vector R = u 1 a 1 + u 2 a 2 + u 3 a 3 where u 1, u 2, u 3 are integer
More informationTHE EXPERIMENTAL PERFORMANCE OF A NONLINEAR DYNAMIC VIBRATION ABSORBER
Proceeding of IMAC XXXI Conference & Expoition on Structural Dynamic February -4 Garden Grove CA USA THE EXPERIMENTAL PERFORMANCE OF A NONLINEAR DYNAMIC VIBRATION ABSORBER Yung-Sheng Hu Neil S Ferguon
More informationarxiv:cond-mat/ v1 [cond-mat.soft] 5 Nov 2002
Simulation tudy of Non-ergodicity Tranition: Gelation in Colloidal Sytem with Short Range Attraction Antonio M. Puerta Department of Phyic, Univerity of Almeria, 42 Almeria, Spain arxiv:cond-mat/287v [cond-mat.oft]
More informationc 2017 SIAM. Published by SIAM under the terms
SIAM J. SCI. COMPUT. Vol. 39, No. 1, pp. B76 B11 c 217 SIAM. Publihed by SIAM under the term of the Creative Common 4. licene ADM-CLE APPROACH FOR DETECTING SLOW VARIABLES IN CONTINUOUS TIME MARKOV CHAINS
More informationCISE302: Linear Control Systems
Term 8 CISE: Linear Control Sytem Dr. Samir Al-Amer Chapter 7: Root locu CISE_ch 7 Al-Amer8 ١ Learning Objective Undertand the concept of root locu and it role in control ytem deign Be able to ketch root
More informationStreaming Calculations using the Point-Kernel Code RANKERN
Streaming Calculation uing the Point-Kernel Code RANKERN Steve CHUCAS, Ian CURL AEA Technology, Winfrith Technology Centre, Dorcheter, Doret DT2 8DH, UK RANKERN olve the gamma-ray tranport equation in
More informationANALYSIS OF DECISION BOUNDARIES IN LINEARLY COMBINED NEURAL CLASSIFIERS
ANALYSIS OF DECISION BOUNDARIES IN LINEARLY COMBINED NEURAL CLASSIFIERS Kagan Tumer and Joydeep Ghoh Department of Electrical and Computer Engineering, Univerity of Texa, Autin, TX 7871-1084 E-mail: kagan@pine.ece.utexa.edu
More informationBeta Burr XII OR Five Parameter Beta Lomax Distribution: Remarks and Characterizations
Marquette Univerity e-publication@marquette Mathematic, Statitic and Computer Science Faculty Reearch and Publication Mathematic, Statitic and Computer Science, Department of 6-1-2014 Beta Burr XII OR
More informationDeparture Time and Route Choices with Bottleneck Congestion: User Equilibrium under Risk and Ambiguity
Departure Time and Route Choice with Bottleneck Congetion: Uer Equilibrium under Rik and Ambiguity Yang Liu, Yuanyuan Li and Lu Hu Department of Indutrial Sytem Engineering and Management National Univerity
More informationTHE HAUSDORFF MEASURE OF SIERPINSKI CARPETS BASING ON REGULAR PENTAGON
Anal. Theory Appl. Vol. 28, No. (202), 27 37 THE HAUSDORFF MEASURE OF SIERPINSKI CARPETS BASING ON REGULAR PENTAGON Chaoyi Zeng, Dehui Yuan (Hanhan Normal Univerity, China) Shaoyuan Xu (Gannan Normal Univerity,
More informationLecture 10 Filtering: Applied Concepts
Lecture Filtering: Applied Concept In the previou two lecture, you have learned about finite-impule-repone (FIR) and infinite-impule-repone (IIR) filter. In thee lecture, we introduced the concept of filtering
More informationON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION. Xiaoqun Wang
Proceeding of the 2008 Winter Simulation Conference S. J. Maon, R. R. Hill, L. Mönch, O. Roe, T. Jefferon, J. W. Fowler ed. ON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION Xiaoqun Wang
More informationThe Use of MDL to Select among Computational Models of Cognition
The Ue of DL to Select among Computational odel of Cognition In J. yung, ark A. Pitt & Shaobo Zhang Vijay Balaubramanian Department of Pychology David Rittenhoue Laboratorie Ohio State Univerity Univerity
More informationCONGESTION control is a key functionality in modern
IEEE TRANSACTIONS ON INFORMATION TEORY, VOL. X, NO. X, XXXXXXX 2008 On the Connection-Level Stability of Congetion-Controlled Communication Network Xiaojun Lin, Member, IEEE, Ne B. Shroff, Fellow, IEEE,
More informationPDF hosted at the Radboud Repository of the Radboud University Nijmegen
PDF hoted at the Radboud Repoitory of the Radboud Univerity Nijmegen The following full text i an author' verion which may differ from the publiher' verion. For additional information about thi publication
More informationSymmetry Lecture 9. 1 Gellmann-Nishijima relation
Symmetry Lecture 9 1 Gellmann-Nihijima relation In the lat lecture we found that the Gell-mann and Nihijima relation related Baryon number, charge, and the third component of iopin. Q = [(1/2)B + T 3 ]
More informationμ + = σ = D 4 σ = D 3 σ = σ = All units in parts (a) and (b) are in V. (1) x chart: Center = μ = 0.75 UCL =
Our online Tutor are available 4*7 to provide Help with Proce control ytem Homework/Aignment or a long term Graduate/Undergraduate Proce control ytem Project. Our Tutor being experienced and proficient
More informationTransient Vibration Signal Analysis for Bedload Transport Monitoring Systems
Tranient Vibration Signal Analyi for Bedload Tranport Monitoring Sytem Gabriel Vaile, Guy D Uro, Elena Lungu To cite thi verion: Gabriel Vaile, Guy D Uro, Elena Lungu. Tranient Vibration Signal Analyi
More informationA Constraint Propagation Algorithm for Determining the Stability Margin. The paper addresses the stability margin assessment for linear systems
A Contraint Propagation Algorithm for Determining the Stability Margin of Linear Parameter Circuit and Sytem Lubomir Kolev and Simona Filipova-Petrakieva Abtract The paper addree the tability margin aement
More informationarxiv: v2 [nucl-th] 3 May 2018
DAMTP-207-44 An Alpha Particle Model for Carbon-2 J. I. Rawlinon arxiv:72.05658v2 [nucl-th] 3 May 208 Department of Applied Mathematic and Theoretical Phyic, Univerity of Cambridge, Wilberforce Road, Cambridge
More informationNon-stationary phase of the MALA algorithm
Stoch PDE: Anal Comp 018) 6:446 499 http://doi.org/10.1007/4007-018-0113-1 on-tationary phae of the MALA algorithm Juan Kuntz 1 Michela Ottobre Andrew M. Stuart 3 Received: 3 Augut 017 / Publihed online:
More informationarxiv: v1 [math.ds] 29 Dec 2015
Non-mooth addle-node bifurcation III: trange attractor in continuou time G. Fuhrmann arxiv:1512.8763v1 [math.ds] 29 Dec 215 8th November 218 Non-mooth addle-node bifurcation give rie to minimal et of intereting
More informationDISCRETE ROUGH PATHS AND LIMIT THEOREMS
DISCRETE ROUGH PATHS AND LIMIT THEOREMS YANGHUI LIU AND SAMY TINDEL Abtract. In thi article, we conider it theorem for ome weighted type random um (or dicrete rough integral). We introduce a general tranfer
More informationCHAPTER 10 CHEMICAL BONDING II: MOLECULAR GEOMETRY AND HYBRIDIZATION OF ATOMIC ORBITALS
APTER 10 EMIAL BNDING II: MLEULAR GEMETRY AND YBRIDIZATIN ATMI RBITALS 10.7 (a) The Lewi tructure of P 3 i hown below. Since in the VSEPR method the number of bonding pair and lone pair of electron around
More informationEfficient Methods of Doppler Processing for Coexisting Land and Weather Clutter
Efficient Method of Doppler Proceing for Coexiting Land and Weather Clutter Ça gatay Candan and A Özgür Yılmaz Middle Eat Technical Univerity METU) Ankara, Turkey ccandan@metuedutr, aoyilmaz@metuedutr
More informationDesign spacecraft external surfaces to ensure 95 percent probability of no mission-critical failures from particle impact.
PREFERRED RELIABILITY PAGE 1 OF 6 PRACTICES METEOROIDS & SPACE DEBRIS Practice: Deign pacecraft external urface to enure 95 percent probability of no miion-critical failure from particle impact. Benefit:
More informationSTUDY OF THE INFLUENCE OF CONVECTIVE EFFECTS IN INCIDENT RADIATIVE HEAT FLUX DENSITY MEASUREMENT UNCERTAINTY
XIX IMEKO World Congre Fundamental and Applied Metrology September 6, 009, Libon, Portugal SUDY OF HE INFLUENCE OF CONVECIVE EFFECS IN INCIDEN RADIAIVE HEA FLUX DENSIY MEASUREMEN UNCERAINY L. Lage Martin,
More informationSupplementary Figures
Supplementary Figure Supplementary Figure S1: Extraction of the SOF. The tandard deviation of meaured V xy at aturated tate (between 2.4 ka/m and 12 ka/m), V 2 d Vxy( H, j, hm ) Vxy( H, j, hm ) 2. The
More informationMultivariate class labeling in Robust Soft LVQ
Multivariate class labeling in Robust Soft LVQ Petra Schneider, Tina Geweniger 2, Frank-Michael Schleif 3, Michael Biehl 4 and Thomas Villmann 2 - School of Clinical and Experimental Medicine - University
More informationExtending MFM Function Ontology for Representing Separation and Conversion in Process Plant
Downloaded from orbit.dtu.dk on: Oct 05, 2018 Extending MFM Function Ontology for Repreenting Separation and Converion in Proce Plant Zhang, Xinxin; Lind, Morten; Jørgenen, Sten Bay; Wu, Jing; Karnati,
More informationAdvanced D-Partitioning Analysis and its Comparison with the Kharitonov s Theorem Assessment
Journal of Multidiciplinary Engineering Science and Technology (JMEST) ISSN: 59- Vol. Iue, January - 5 Advanced D-Partitioning Analyi and it Comparion with the haritonov Theorem Aement amen M. Yanev Profeor,
More informationMRAC + H Fault Tolerant Control for Linear Parameter Varying Systems
Conference on Control and Tolerant Sytem Nice, France, October 68, WeA4. MRAC + H Tolerant Control for Linear Parameter Varying Sytem Adriana VargaMartínez, Vicenç Puig, Lui E. GarzaCatañón and Ruben MoraleMenendez
More informationCHAPTER 8 OBSERVER BASED REDUCED ORDER CONTROLLER DESIGN FOR LARGE SCALE LINEAR DISCRETE-TIME CONTROL SYSTEMS
CHAPTER 8 OBSERVER BASED REDUCED ORDER CONTROLLER DESIGN FOR LARGE SCALE LINEAR DISCRETE-TIME CONTROL SYSTEMS 8.1 INTRODUCTION 8.2 REDUCED ORDER MODEL DESIGN FOR LINEAR DISCRETE-TIME CONTROL SYSTEMS 8.3
More informationFair Game Review. Chapter 7 A B C D E Name Date. Complete the number sentence with <, >, or =
Name Date Chapter 7 Fair Game Review Complete the number entence with , or =. 1. 3.4 3.45 2. 6.01 6.1 3. 3.50 3.5 4. 0.84 0.91 Find three decimal that make the number entence true. 5. 5.2 6. 2.65 >
More informationRNA Secondary Structure Prediction by MFT Neural Networks
N econdary tructure Prediction by MFT Neural Network B. POLLONI, L. LOTOTO,. MOPUO,. ZNBONI Dipartimento di cienze dell Informazione Univerità degli tudi di Milano Via omelico 39, 035 Milano ITLY btract:
More informationNumerical algorithm for the analysis of linear and nonlinear microstructure fibres
Numerical algorithm for the anali of linear and nonlinear microtructure fibre Mariuz Zdanowicz *, Marian Marciniak, Marek Jaworki, Igor A. Goncharenko National Intitute of Telecommunication, Department
More informationJul 4, 2005 turbo_code_primer Revision 0.0. Turbo Code Primer
Jul 4, 5 turbo_code_primer Reviion. Turbo Code Primer. Introduction Thi document give a quick tutorial on MAP baed turbo coder. Section develop the background theory. Section work through a imple numerical
More informationAvailable online Journal of Scientific and Engineering Research, 2018, 5(6):1-9. Research Article
Available online www.jaer.com 8 5(6):-9 Reearch Article SSN: 394-63 CODEN(USA): JSERBR Mathematical Model for Laa Fever and Senitivity Analyi Akinpelu FO Akinwande R Department of Pure and Applied Mathematic;
More informationResearch Article Least-Mean-Square Receding Horizon Estimation
Mathematical Problem in Engineering Volume 212, Article ID 631759, 19 page doi:1.1155/212/631759 Reearch Article Leat-Mean-Square Receding Horizon Etimation Bokyu Kwon 1 and Soohee Han 2 1 Department of
More informationAMS 212B Perturbation Methods Lecture 20 Part 1 Copyright by Hongyun Wang, UCSC. is the kinematic viscosity and ˆp = p ρ 0
Lecture Part 1 Copyright by Hongyun Wang, UCSC Prandtl boundary layer Navier-Stoke equation: Conervation of ma: ρ t + ( ρ u) = Balance of momentum: u ρ t + u = p+ µδ u + ( λ + µ ) u where µ i the firt
More information