A High Throughput String Matching Architecture for Intrusion Detection and Prevention
|
|
- Eileen Mitchell
- 5 years ago
- Views:
Transcription
1 A Hig Trougput tring Matcing Arcitecture for Intruion Detection and Prevention Lin Tan, Timoty erwood Appeared in ICA 25 Preented by: aile Kumar Dicuion Leader: Max Podleny
2 Overview Overview of ID/IP ytem» tring matcing and regular expreion matcing tring matcing algoritm» Ao-Coraick algoritm Overview of te propoed arcitecture Analyi of te propoed arcitecture Concluion 2 - aile Kumar - 2/8/25
3 ID Overview Intruion detection ytem, ID mut be capable of ditinguiing between normal (not ecurity-critical) and abnormal uer activitie» However tranlating te uer beavior into a ecurity-related deciion i often not tat eay One approac i anomaly detection» Anomaly detector contruct profile tat repreent normal uage» If profile of current data doen t matc te normal profile => a poible attack» Typically reult in ig fale poitive and few negative too» An intelligent intruder can train te ytem to beave oterwie Normal Unpredictable Abnormal 3 - aile Kumar - 2/8/25
4 ID Overview Anoter approac i ome kind of ignature detection Mibeavior ignature fall into two categorie:» Attack ignature action pattern tat may poe a ecurity treat. Typically preented a a erie of activitie interleaved (may be) wit neutral one E.g. equence of flag et on ome pecific equence of packet» elected text tring ignature to matc text tring wic look for upiciou action (e.g. calling /etc/pawd). Effective againt attack tat exploit programming flaw. Effective but not immune to novel attack» Difficultie in updating information on new type of attack» till mot widely ued 4 - aile Kumar - 2/8/25
5 5 - aile Kumar - 2/8/25 ID Overview At te eart of mot ignature baed ID ytem, lie a tring (regular expreion) matcing engine» ince ti engine a to can every byte of data, it migt become te trougput bottleneck Ti paper preent a ig trougput tring matcing arcitecture Advantage of propoed ceme:» Claimed to be pace efficient Entire rule et can be tored on-cip» Claimed to be able to acieve ig trougput Limitation (will cover later)» New ytem do regex matcing, FM i typically too large to fit on cip, even wit te propoed ceme.» imple FM compreion ceme may beat te propoed idea
6 tring Matcing Algoritm (Ao-Coraick) For a et P of pattern, it build a DFA, wic accept all pattern in P. 6 - aile Kumar - 2/8/25
7 7 - aile Kumar - 2/8/25 tring Matcing Algoritm (Ao-Coraick) Let ay, P i {e, e, i, er} e i e r Initial tate Accepting tate tate Tranition Function i r Example from Lin Tan et. al.
8 8 - aile Kumar - 2/8/25 Propertie of DFA created by Ao-Coraick Conume one caracter per tate traveral» A modified automaton i alo ued in many ytem, wic recan a caracter if tere i no outgoing edge for it (fail ptr) Reduce te DFA ize tremendouly e i e r i r e i e r Example from Lin Tan et. al.
9 How to implement efficiently on-cip Problem: ize too big to be on-cip» ~, node for NORT rule et wit ~ tring» 256 out edge per node» Require,*256*4 = ~5MB 256 next tate pointer : <4>-bit <4>-bit <4>-bit <4>-bit... <4>-bit 9999 olution: partition eac tate macine into mall tate macine uc tat» Eac macine andle a ubet of tring only» Alo, eac macine a few outgoing edge only 9 - aile Kumar - 2/8/25
10 Bit-plitting Algoritm Overview Bit-plit tring Matcing Algoritm» Reduce out edge from 256 to 2. Partition te rule et P into maller et P to P n Build AC tate-macine for eac ubet P i For eac P i, rip it DFA apart into 8 tiny tatemacine, B i troug B i7 Eac binary FM operate on bit of te 8 bit input caracter» A matc i announced only if all 8 macine find a matc - aile Kumar - 2/8/25
11 Bit-plitting tring Matcing Arcitecture Let ay we ave 4 tring in P {e, e, i, er} Conider FM 3» It look at 3 rd bit of te input car and make tate tranition baed upon weter it i or Example, let ay our input tream i xe Example from Lin Tan et. al. - aile Kumar - 2/8/25
12 Bit FM Contruction Ue ubet contruction algoritm to build bit FM P B e r i 6 7 i r 3 4 e 5 b {} b {, } b2 {,3 } b3 {,,2,6} b4{,,4} {,3 } b6{,,2,5,6} b3{,,2,6} b5{,3,7,8} Example from Lin Tan et. al. b7{,3,9} 2 - aile Kumar - 2/8/25
13 3 - aile Kumar - 2/8/25 Bit FM Contruction Remove te non-accepting tate from te mall FM Example from Lin Tan et. al e i e r i r b { } P Pruned B 3 b { } b2 { } b3{ 2 } b4 { } b6{ 2,5 } b5{7} b7{9}
14 Bit-plitting tring Matcing Arcitecture Build all bit FM B i Matc announced, if all bit FM announce a matc 4 - aile Kumar - 2/8/25 Example from Lin Tan et. al.
15 An Example Matcing xe 2 e r 8 9 P B 3 i 6 7 i 5 - aile Kumar - 2/8/25 r 3 4 e 5 B 4 b {} b {} b{} b2{} b2{} b{} b4{2} b4 {} b3 {} b6{2,5} b6{2,5} b5 {} b3{2} b8{2,7} b5{7} b7 {} b7{9} b9{9} Only if all te tate macine agree, i tere actually a matc. Example from Lin Tan et. al.
16 How to map it to ardware efficiently Problem:» Every tate in te bit-fm B i migt ave up to accepting tate of te original FM D. Note tat # accepting of tate = # of tring =» Even if we keep bit-vector to repreent te accepting tate of te original D, we will need -bit per tate of B i.» i typically >, o not practical olution:» Partition te rule et P into maller ubet P i eac wit g rule Build FM D i for eac P i and bit-plice D i into B i, B i7» Now every tate in B ij can ave at mot g accepting tate, ence only g-bit are needed 6 - aile Kumar - 2/8/25
17 How to map it to ardware efficiently Alo note tat any D FM can be ripped into 2 or 4 bit-fm a well» Wen ripped into 4 different bit-fm, eac one conume 2- bit of te input caracter» Wen ripped into 2 different bit-fm, eac one conume 4- bit 7 - aile Kumar - 2/8/25
18 g = 6 Eac tate Macine Tile # of tate = 256 (8-bit tate encoding) D FM i ripped into 4 FM (eac accept 2-bit I/P) 8 - aile Kumar - 2/8/25 Example from Lin Tan et. al.
19 Hardware Implementation 9 - aile Kumar - 2/8/25 Example from Lin Tan et. al.
20 Non Interrupting Update Iue:» Mut copy te tate of every flip-flop of te affected module onto te replacement module E.g. te current tate pointer of te affected module mut be copied into te replacement module Tee iue are not mentioned in te paper 2 - aile Kumar - 2/8/25
21 Optimal partitioning Tere are two type of partition.» One i te partition of te et of tring» Anoter i te partition of eac D FM into multiple bit FM 8 binary partition i clearly eay to undertand However, it i poible to partition into 2 or 4 partition, and eac partition conume 4 and 2 input bit of te input caracter repectively. Terminology» = total # of tring» g = # of tring per group (# of partition = /g)» n = # of partition of tate macine (, 2, 4, 8)» L = Average # of caracter per tring How to cooe g and n?» wic conume minimum area 2 - aile Kumar - 2/8/25
22 Optimal partitioning Total number of bit needed i: # of FM partition # of bit to encode tate # of partial matc bit # of outgoing edge per tate Total # of tate in eac bit-fm Total # of module (tring et partition) 22 - aile Kumar - 2/8/25
23 Optimal partitioning Plot from te review of Mike Wilon ( ignature, average lengt 2)» Typical optimal # of FM partition = 2, aile Kumar - 2/8/25
24 Partitioning tring et In te analyi preented in te paper, it i claimed tat partitioning tring et alway reduce pace» Not quite rigt wen tere i overlap among te tring P = {e, er, er}, If we partition into 3 et e e e r r e 2 r Wit overlapping tring, fewer tate are needed w/o partitioning aile Kumar - 2/8/25
25 Performance Reult - Memory 25 - aile Kumar - 2/8/25 From Lin Tan et. al.
26 Performance Reult - Trougput 26 - aile Kumar - 2/8/25 From Lin Tan et. al.
27 trengt of te Algoritm Can be very effective for dene DFA, wen tere are plenty of outgoing edge from every tate In ti cae, pat compreion will not elp a lot However, ripping apart te tate macine into bit tate macine will reduce te number of outgoing edge to 6» (2 edge x 8 FM) or (4 edge x 4 FM)» For dene grap, upto 6 time reduction in tate pace 27 - aile Kumar - 2/8/25
28 ome Iue Tuck [3] ued bitmap compreion and pat compreion to reduce te amount of memory needed for NORT rule to.mb Note tat, Tuck didn t do any tring et partitioning» w/o any partitioning, bit-plitting will conume >2 MB 28 - aile Kumar - 2/8/25 From Lin Tan et. al.
29 Concluion Novel Bit-plit tring Matcing Algoritm» Reduce out edge from 256 to 2» Can be extremely effective for dene grap Performance/area beat te bet tecnique by a factor of or more..4mb and Gbp for nort rule et ( >, caracter) 29 - aile Kumar - 2/8/25
30 3 - aile Kumar - 2/8/25 Tank you and Quetion
Inference for Two Stage Cluster Sampling: Equal SSU per PSU. Projections of SSU Random Variables on Each SSU selection.
Inference for Two Stage Cluter Sampling: Equal SSU per PSU Projection of SSU andom Variable on Eac SSU election By Ed Stanek Introduction We review etimating equation for PSU mean in a two tage cluter
More informationVelocity or 60 km/h. a labelled vector arrow, v 1
11.7 Velocity en you are outide and notice a brik wind blowing, or you are riding in a car at 60 km/, you are imply conidering te peed of motion a calar quantity. ometime, owever, direction i alo important
More informationFinite Difference Formulae for Unequal Sub- Intervals Using Lagrange s Interpolation Formula
Int. Journal o Mat. Analyi, Vol., 9, no. 7, 85-87 Finite Dierence Formulae or Unequal Sub- Interval Uing Lagrange Interpolation Formula Aok K. Sing a and B. S. Badauria b Department o Matematic, Faculty
More informationNon-Computability of Consciousness
NeuroQuantolog December 2007 Vol 5 Iue 4 Page 382-39 Song D. Non-computabilit of concioune 382 Original Article Non-Computabilit of Concioune Daegene Song Abtract Wit te great ucce in imulating man intelligent
More informationHilbert-Space Integration
Hilbert-Space Integration. Introduction. We often tink of a PDE, like te eat equation u t u xx =, a an evolution equation a itorically wa done for ODE. In te eat equation example two pace derivative are
More informationBob Brown Math 251 Calculus 1 Chapter 3, Section 1 Completed 1 CCBC Dundalk
Bob Brown Mat 251 Calculus 1 Capter 3, Section 1 Completed 1 Te Tangent Line Problem Te idea of a tangent line first arises in geometry in te context of a circle. But before we jump into a discussion of
More informationLearning Multiplicative Interactions
CSC2535 2011 Lecture 6a Learning Multiplicative Interaction Geoffrey Hinton Two different meaning of multiplicative If we take two denity model and multiply together their probability ditribution at each
More informationNUMERICAL DIFFERENTIATION. James T. Smith San Francisco State University. In calculus classes, you compute derivatives algebraically: for example,
NUMERICAL DIFFERENTIATION James T Smit San Francisco State University In calculus classes, you compute derivatives algebraically: for example, f( x) = x + x f ( x) = x x Tis tecnique requires your knowing
More informationA Study on Simulating Convolutional Codes and Turbo Codes
A Study on Simulating Convolutional Code and Turbo Code Final Report By Daniel Chang July 27, 2001 Advior: Dr. P. Kinman Executive Summary Thi project include the deign of imulation of everal convolutional
More informationMath 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006
Mat 102 TEST CHAPTERS 3 & 4 Solutions & Comments Fall 2006 f(x+) f(x) 10 1. For f(x) = x 2 + 2x 5, find ))))))))) and simplify completely. NOTE: **f(x+) is NOT f(x)+! f(x+) f(x) (x+) 2 + 2(x+) 5 ( x 2
More informationChapter Landscape of an Optimization Problem. Local Search. Coping With NP-Hardness. Gradient Descent: Vertex Cover
Coping With NP-Hardne Chapter 12 Local Search Q Suppoe I need to olve an NP-hard problem What hould I do? A Theory ay you're unlikely to find poly-time algorithm Mut acrifice one of three deired feature
More informationSocial Studies 201 Notes for November 14, 2003
1 Social Studie 201 Note for November 14, 2003 Etimation of a mean, mall ample ize Section 8.4, p. 501. When a reearcher ha only a mall ample ize available, the central limit theorem doe not apply to the
More informationPreemptive scheduling on a small number of hierarchical machines
Available online at www.ciencedirect.com Information and Computation 06 (008) 60 619 www.elevier.com/locate/ic Preemptive cheduling on a mall number of hierarchical machine György Dóa a, Leah Eptein b,
More informationSocial Studies 201 Notes for March 18, 2005
1 Social Studie 201 Note for March 18, 2005 Etimation of a mean, mall ample ize Section 8.4, p. 501. When a reearcher ha only a mall ample ize available, the central limit theorem doe not apply to the
More informationChapter 2 Sampling and Quantization. In order to investigate sampling and quantization, the difference between analog
Chapter Sampling and Quantization.1 Analog and Digital Signal In order to invetigate ampling and quantization, the difference between analog and digital ignal mut be undertood. Analog ignal conit of continuou
More informationLINEAR ALGEBRA METHOD IN COMBINATORICS. Theorem 1.1 (Oddtown theorem). In a town of n citizens, no more than n clubs can be formed under the rules
LINEAR ALGEBRA METHOD IN COMBINATORICS 1 Warming-up example Theorem 11 (Oddtown theorem) In a town of n citizen, no more tha club can be formed under the rule each club have an odd number of member each
More informationFundamentals of Concept Learning
Aims 09s: COMP947 Macine Learning and Data Mining Fundamentals of Concept Learning Marc, 009 Acknowledgement: Material derived from slides for te book Macine Learning, Tom Mitcell, McGraw-Hill, 997 ttp://www-.cs.cmu.edu/~tom/mlbook.tml
More informationIGC. 50 th. 50 th INDIAN GEOTECHNICAL CONFERENCE SEISMIC ACTIVE EARTH PRESSURE ON RETAINING WALL CONSIDERING SOIL AMPLIFICATION
INDIAN GEOTECHNICAL CONFERENCE SEISMIC ACTIVE EARTH PRESSURE ON RETAINING WALL CONSIDERING SOIL AMPLIFICATION Obaidur Raaman 1 and Priati Raycowdury 2 ABSTRACT Te quet for te realitic etimation of eimic
More informationPhysics 41 Homework Set 3 Chapter 17 Serway 7 th Edition
Pyic 41 Homework Set 3 Capter 17 Serway 7 t Edition Q: 1, 4, 5, 6, 9, 1, 14, 15 Quetion *Q17.1 Anwer. Te typically iger denity would by itelf make te peed of ound lower in a olid compared to a ga. Q17.4
More information7.2 INVERSE TRANSFORMS AND TRANSFORMS OF DERIVATIVES 281
72 INVERSE TRANSFORMS AND TRANSFORMS OF DERIVATIVES 28 and i 2 Show how Euler formula (page 33) can then be ued to deduce the reult a ( a) 2 b 2 {e at co bt} {e at in bt} b ( a) 2 b 2 5 Under what condition
More informationOn The Approximate Solution of Linear Fuzzy Volterra-Integro Differential Equations of the Second Kind
AUSTRALIAN JOURNAL OF BASIC AND APPLIED SCIENCES ISSN:99-878 EISSN: 39-8 Journal ome page: www.ajbaweb.com On Te Approimate Solution of Linear Fuzzy Volterra-Integro Differential Equation of te Second
More informationThis appendix derives Equations (16) and (17) from Equations (12) and (13).
Capital growt pat of te neoclaical growt model Online Supporting Information Ti appendix derive Equation (6) and (7) from Equation () and (3). Equation () and (3) owed te evolution of pyical and uman capital
More informationCS 170: Midterm Exam II University of California at Berkeley Department of Electrical Engineering and Computer Sciences Computer Science Division
1 1 April 000 Demmel / Shewchuk CS 170: Midterm Exam II Univerity of California at Berkeley Department of Electrical Engineering and Computer Science Computer Science Diviion hi i a cloed book, cloed calculator,
More informationRELIABILITY OF REPAIRABLE k out of n: F SYSTEM HAVING DISCRETE REPAIR AND FAILURE TIMES DISTRIBUTIONS
www.arpapre.com/volume/vol29iue1/ijrras_29_1_01.pdf RELIABILITY OF REPAIRABLE k out of n: F SYSTEM HAVING DISCRETE REPAIR AND FAILURE TIMES DISTRIBUTIONS Sevcan Demir Atalay 1,* & Özge Elmataş Gültekin
More informationInternet Appendix for Informational Frictions and Commodity Markets
Internet ppendix for Informational Friction and Commodity Market MICHEL SOCKIN and WEI XIONG In ti appendix, we preent in detail an extended model wit a future market, in upplement to te ummary of te model
More informationFunction Composition and Chain Rules
Function Composition and s James K. Peterson Department of Biological Sciences and Department of Matematical Sciences Clemson University Marc 8, 2017 Outline 1 Function Composition and Continuity 2 Function
More informationHardware Implementation of Canonic Signed Digit Recoding
IOSR Journal of VLSI and Signal Proceing (IOSR-JVSP) Volume 6, Iue 2, Ver. I (Mar. -Apr. 2016), PP 11-15 e-issn: 2319 4200, p-issn No. : 2319 4197 www.iorjournal.org Hardware Implementation of Canonic
More informationLEARNING FROM MISTAKES
AP Central Quetion of te Mont May 3 Quetion of te Mont By Lin McMullin LEARNING FROM MISTAKES Ti i te firt Quetion of te Mont tat ill appear on te Calculu ection of AP Central. Tee are not AP Exam quetion,
More information1 Limits and Continuity
1 Limits and Continuity 1.0 Tangent Lines, Velocities, Growt In tion 0.2, we estimated te slope of a line tangent to te grap of a function at a point. At te end of tion 0.3, we constructed a new function
More information4. The slope of the line 2x 7y = 8 is (a) 2/7 (b) 7/2 (c) 2 (d) 2/7 (e) None of these.
Mat 11. Test Form N Fall 016 Name. Instructions. Te first eleven problems are wort points eac. Te last six problems are wort 5 points eac. For te last six problems, you must use relevant metods of algebra
More informationProblem Set 8 Solutions
Deign and Analyi of Algorithm April 29, 2015 Maachuett Intitute of Technology 6.046J/18.410J Prof. Erik Demaine, Srini Devada, and Nancy Lynch Problem Set 8 Solution Problem Set 8 Solution Thi problem
More informationExact Solutions for Fixed-Fixed Anisotropic Beams under Uniform Load by Using Maple
Eact Solution for Fied-Fied Aniotropic Beam under Uniform Load b Uing Maple Department of Civil Engineering, Ho Ci Min Cit Univerit of Arcitecture, Vietnam ABSTRACT Te approimate olution of tree and diplacement
More informationDerivatives. By: OpenStaxCollege
By: OpenStaxCollege Te average teen in te United States opens a refrigerator door an estimated 25 times per day. Supposedly, tis average is up from 10 years ago wen te average teenager opened a refrigerator
More informationCalculus I Homework: The Derivative as a Function Page 1
Calculus I Homework: Te Derivative as a Function Page 1 Example (2.9.16) Make a careful sketc of te grap of f(x) = sin x and below it sketc te grap of f (x). Try to guess te formula of f (x) from its grap.
More informationIntroduction to Derivatives
Introduction to Derivatives 5-Minute Review: Instantaneous Rates and Tangent Slope Recall te analogy tat we developed earlier First we saw tat te secant slope of te line troug te two points (a, f (a))
More informationOne Class of Splitting Iterative Schemes
One Cla of Splitting Iterative Scheme v Ciegi and V. Pakalnytė Vilniu Gedimina Technical Univerity Saulėtekio al. 11, 2054, Vilniu, Lithuania rc@fm.vtu.lt Abtract. Thi paper deal with the tability analyi
More informationThe machines in the exercise work as follows:
Tik-79.148 Spring 2001 Introduction to Theoretical Computer Science Tutorial 9 Solution to Demontration Exercie 4. Contructing a complex Turing machine can be very laboriou. With the help of machine chema
More informationNCAAPMT Calculus Challenge Challenge #3 Due: October 26, 2011
NCAAPMT Calculu Challenge 011 01 Challenge #3 Due: October 6, 011 A Model of Traffic Flow Everyone ha at ome time been on a multi-lane highway and encountered road contruction that required the traffic
More informationOverflow from last lecture: Ewald construction and Brillouin zones Structure factor
Lecture 5: Overflow from lat lecture: Ewald contruction and Brillouin zone Structure factor Review Conider direct lattice defined by vector R = u 1 a 1 + u 2 a 2 + u 3 a 3 where u 1, u 2, u 3 are integer
More informationlecture 26: Richardson extrapolation
43 lecture 26: Ricardson extrapolation 35 Ricardson extrapolation, Romberg integration Trougout numerical analysis, one encounters procedures tat apply some simple approximation (eg, linear interpolation)
More information8-4 P 2. = 12 kw. AIR T = const. Therefore, Q &
8-4 8-4 Air i compreed teadily by a compreor. e air temperature i mataed contant by eat rejection to te urroundg. e rate o entropy cange o air i to be determed. Aumption i i a teady-low proce ce tere i
More informationPythagorean Triple Updated 08--5 Drlnoordzij@leennoordzijnl wwwleennoordzijme Content A Roadmap for generating Pythagorean Triple Pythagorean Triple 3 Dicuion Concluion 5 A Roadmap for generating Pythagorean
More informationStepped-Impedance Low-Pass Filters
4/23/27 Stepped Impedance Low Pass Filters 1/14 Stepped-Impedance Low-Pass Filters Say we know te impedance matrix of a symmetric two-port device: 11 21 = 21 11 Regardless of te construction of tis two
More informationSuggested Answers To Exercises. estimates variability in a sampling distribution of random means. About 68% of means fall
Beyond Significance Teting ( nd Edition), Rex B. Kline Suggeted Anwer To Exercie Chapter. The tatitic meaure variability among core at the cae level. In a normal ditribution, about 68% of the core fall
More informationReinforcement Learning
Reinforcement Learning Yihay Manour Google Inc. & Tel-Aviv Univerity Outline Goal of Reinforcement Learning Mathematical Model (MDP) Planning Learning Current Reearch iue 2 Goal of Reinforcement Learning
More informationIntroduction to Laplace Transform Techniques in Circuit Analysis
Unit 6 Introduction to Laplace Tranform Technique in Circuit Analyi In thi unit we conider the application of Laplace Tranform to circuit analyi. A relevant dicuion of the one-ided Laplace tranform i found
More informationNatural Language Understanding. Recap: probability, language models, and feedforward networks. Lecture 12: Recurrent Neural Networks and LSTMs
Natural Language Understanding Lecture 12: Recurrent Neural Networks and LSTMs Recap: probability, language models, and feedforward networks Simple Recurrent Networks Adam Lopez Credits: Mirella Lapata
More informationPreface. Here are a couple of warnings to my students who may be here to get a copy of what happened on a day that you missed.
Preface Here are my online notes for my course tat I teac ere at Lamar University. Despite te fact tat tese are my class notes, tey sould be accessible to anyone wanting to learn or needing a refreser
More informationDigital Filter Structures
Digital Filter Structures Te convolution sum description of an LTI discrete-time system can, in principle, be used to implement te system For an IIR finite-dimensional system tis approac is not practical
More informationControl Systems Analysis and Design by the Root-Locus Method
6 Control Sytem Analyi and Deign by the Root-Locu Method 6 1 INTRODUCTION The baic characteritic of the tranient repone of a cloed-loop ytem i cloely related to the location of the cloed-loop pole. If
More informationCHAPTER 10 CHEMICAL BONDING II: MOLECULAR GEOMETRY AND HYBRIDIZATION OF ATOMIC ORBITALS
APTER 10 EMIAL BNDING II: MLEULAR GEMETRY AND YBRIDIZATIN ATMI RBITALS 10.7 (a) The Lewi tructure of P 3 i hown below. Since in the VSEPR method the number of bonding pair and lone pair of electron around
More informationIntroduction to Machine Learning. Recitation 8. w 2, b 2. w 1, b 1. z 0 z 1. The function we want to minimize is the loss over all examples: f =
Introduction to Macine Learning Lecturer: Regev Scweiger Recitation 8 Fall Semester Scribe: Regev Scweiger 8.1 Backpropagation We will develop and review te backpropagation algoritm for neural networks.
More informationFrames of Reference and Relative Velocity
1.5 frame of reference coordinate ytem relative to which motion i oberved Frame of Reference and Relative Velocity Air how provide element of both excitement and danger. When high-peed airplane fly in
More informationIntermediate Math Circles November 5, 2008 Geometry II
1 Univerity of Waterloo Faculty of Matematic Centre for Education in Matematic and Computing Intermediate Mat Circle November 5, 2008 Geometry II Geometry 2-D Figure Two-dimenional ape ave a perimeter
More informationCodes Correcting Two Deletions
1 Code Correcting Two Deletion Ryan Gabry and Frederic Sala Spawar Sytem Center Univerity of California, Lo Angele ryan.gabry@navy.mil fredala@ucla.edu Abtract In thi work, we invetigate the problem of
More information1. Which one of the following expressions is not equal to all the others? 1 C. 1 D. 25x. 2. Simplify this expression as much as possible.
004 Algebra Pretest answers and scoring Part A. Multiple coice questions. Directions: Circle te letter ( A, B, C, D, or E ) net to te correct answer. points eac, no partial credit. Wic one of te following
More informationPsychrometrics. PV = N R u T (9.01) PV = N M R T (9.02) Pv = R T (9.03) PV = m R T (9.04)
Pycrometric Abtract. Ti capter include baic coverage of pycrometric propertie and pycrometric procee. Empai i upon propertie and procee relative to te environment and to proceing of biological material.
More informationNonlinear Single-Particle Dynamics in High Energy Accelerators
Nonlinear Single-Particle Dynamic in High Energy Accelerator Part 6: Canonical Perturbation Theory Nonlinear Single-Particle Dynamic in High Energy Accelerator Thi coure conit of eight lecture: 1. Introduction
More informationHow to Find the Derivative of a Function: Calculus 1
Introduction How to Find te Derivative of a Function: Calculus 1 Calculus is not an easy matematics course Te fact tat you ave enrolled in suc a difficult subject indicates tat you are interested in te
More informationMarch 18, 2014 Academic Year 2013/14
POLITONG - SHANGHAI BASIC AUTOMATIC CONTROL Exam grade March 8, 4 Academic Year 3/4 NAME (Pinyin/Italian)... STUDENT ID Ue only thee page (including the back) for anwer. Do not ue additional heet. Ue of
More informationSolution for the Homework 4
Solution for te Homework 4 Problem 6.5: In tis section we computed te single-particle translational partition function, tr, by summing over all definite-energy wavefunctions. An alternative approac, owever,
More informationLecture 21. The Lovasz splitting-off lemma Topics in Combinatorial Optimization April 29th, 2004
18.997 Topic in Combinatorial Optimization April 29th, 2004 Lecture 21 Lecturer: Michel X. Goeman Scribe: Mohammad Mahdian 1 The Lovaz plitting-off lemma Lovaz plitting-off lemma tate the following. Theorem
More information(4.2) -Richardson Extrapolation
(.) -Ricardson Extrapolation. Small-O Notation: Recall tat te big-o notation used to define te rate of convergence in Section.: Suppose tat lim G 0 and lim F L. Te function F is said to converge to L as
More informationTime (hours) Morphine sulfate (mg)
Mat Xa Fall 2002 Review Notes Limits and Definition of Derivative Important Information: 1 According to te most recent information from te Registrar, te Xa final exam will be eld from 9:15 am to 12:15
More informationBogoliubov Transformation in Classical Mechanics
Bogoliubov Tranformation in Claical Mechanic Canonical Tranformation Suppoe we have a et of complex canonical variable, {a j }, and would like to conider another et of variable, {b }, b b ({a j }). How
More informationA = h w (1) Error Analysis Physics 141
Introduction In all brances of pysical science and engineering one deals constantly wit numbers wic results more or less directly from experimental observations. Experimental observations always ave inaccuracies.
More informationMathematics 105 Calculus I. Exam 1. February 13, Solution Guide
Matematics 05 Calculus I Exam February, 009 Your Name: Solution Guide Tere are 6 total problems in tis exam. On eac problem, you must sow all your work, or oterwise torougly explain your conclusions. Tere
More informationConfusion matrices. True / False positives / negatives. INF 4300 Classification III Anne Solberg The agenda today: E.g., testing for cancer
INF 4300 Claification III Anne Solberg 29.10.14 The agenda today: More on etimating claifier accuracy Cure of dimenionality knn-claification K-mean clutering x i feature vector for pixel i i- The cla label
More informationManprit Kaur and Arun Kumar
CUBIC X-SPLINE INTERPOLATORY FUNCTIONS Manprit Kaur and Arun Kumar manpreet2410@gmail.com, arun04@rediffmail.com Department of Mathematic and Computer Science, R. D. Univerity, Jabalpur, INDIA. Abtract:
More information8.6 Order-Recursive LS s[n]
8.6 Order-Recurive LS [] Motivate ti idea wit Curve Fittig Give data: 0,,,..., - [0], [],..., [-] Wat to fit a polyomial to data.., but wic oe i te rigt model?! Cotat! Quadratic! Liear! Cubic, Etc. ry
More informationSeries Sytem of Pipes Parallel Sytem of Pipes
ANALYSIS OF VISCOUS FLOW IN PIPES Te vicou flow in pipe ytem may be analyzed by claifiying tem in te following manner: i) Serie ytem of pipe, ii) Parallel ytem of pipe, iii) Pipe network, iv) Interconnected
More informationFringe integral equations for the 2-D wedges with soft and hard boundaries. r Fringe Wave Integral Equation
RESEARCH ARTICLE Key Point: An alternative approac baed on te integral euation derived directly for tefringecurrentipreented A MoM-baed algoritm i developed for direct modeling of fringe wave around oft
More informationNotes on Neural Networks
Artificial neurons otes on eural etwors Paulo Eduardo Rauber 205 Consider te data set D {(x i y i ) i { n} x i R m y i R d } Te tas of supervised learning consists on finding a function f : R m R d tat
More informationProbabilistic Graphical Models Homework 1: Due January 29, 2014 at 4 pm
Probabilistic Grapical Models 10-708 Homework 1: Due January 29, 2014 at 4 pm Directions. Tis omework assignment covers te material presented in Lectures 1-3. You must complete all four problems to obtain
More informationZ a>2 s 1n = X L - m. X L = m + Z a>2 s 1n X L = The decision rule for this one-tail test is
M09_BERE8380_12_OM_C09.QD 2/21/11 3:44 PM Page 1 9.6 The Power of a Tet 9.6 The Power of a Tet 1 Section 9.1 defined Type I and Type II error and their aociated rik. Recall that a repreent the probability
More informationMTH-112 Quiz 1 Name: # :
MTH- Quiz Name: # : Please write our name in te provided space. Simplif our answers. Sow our work.. Determine weter te given relation is a function. Give te domain and range of te relation.. Does te equation
More informationAvoiding Forbidden Submatrices by Row Deletions
Avoiding Forbidden Submatrice by Row Deletion Sebatian Wernicke, Jochen Alber, Jen Gramm, Jiong Guo, and Rolf Niedermeier Wilhelm-Schickard-Intitut für Informatik, niverität Tübingen, Sand 13, D-72076
More information1. State whether the function is an exponential growth or exponential decay, and describe its end behaviour using limits.
Questions 1. State weter te function is an exponential growt or exponential decay, and describe its end beaviour using its. (a) f(x) = 3 2x (b) f(x) = 0.5 x (c) f(x) = e (d) f(x) = ( ) x 1 4 2. Matc te
More information9 Lorentz Invariant phase-space
9 Lorentz Invariant phae-space 9. Cro-ection The cattering amplitude M q,q 2,out p, p 2,in i the amplitude for a tate p, p 2 to make a tranition into the tate q,q 2. The tranition probability i the quare
More informationClustering Methods without Given Number of Clusters
Clutering Method without Given Number of Cluter Peng Xu, Fei Liu Introduction A we now, mean method i a very effective algorithm of clutering. It mot powerful feature i the calability and implicity. However,
More informationDesign of Robust PI Controller for Counter-Current Tubular Heat Exchangers
Deign of Robut PI Controller for Counter-Current Tubular Heat Excanger Jana Závacká Monika Bakošová Intitute of Information Engineering Automation Matematic Faculty of Cemical Food Tecnology STU in Bratilava
More informationMoment of Inertia of an Equilateral Triangle with Pivot at one Vertex
oment of nertia of an Equilateral Triangle with Pivot at one Vertex There are two wa (at leat) to derive the expreion f an equilateral triangle that i rotated about one vertex, and ll how ou both here.
More informationSOLUTIONS TO ALGEBRAIC GEOMETRY AND ARITHMETIC CURVES BY QING LIU. I will collect my solutions to some of the exercises in this book in this document.
SOLUTIONS TO ALGEBRAIC GEOMETRY AND ARITHMETIC CURVES BY QING LIU CİHAN BAHRAN I will collect my olution to ome of the exercie in thi book in thi document. Section 2.1 1. Let A = k[[t ]] be the ring of
More informationSection 3: The Derivative Definition of the Derivative
Capter 2 Te Derivative Business Calculus 85 Section 3: Te Derivative Definition of te Derivative Returning to te tangent slope problem from te first section, let's look at te problem of finding te slope
More informationMATEMATIK Datum: Tid: eftermiddag. A.Heintz Telefonvakt: Anders Martinsson Tel.:
MATEMATIK Datum: 20-08-25 Tid: eftermiddag GU, Chalmer Hjälpmedel: inga A.Heintz Telefonvakt: Ander Martinon Tel.: 073-07926. Löningar till tenta i ODE och matematik modellering, MMG5, MVE6. Define what
More informationMulti-dimensional Fuzzy Euler Approximation
Mathematica Aeterna, Vol 7, 2017, no 2, 163-176 Multi-dimenional Fuzzy Euler Approximation Yangyang Hao College of Mathematic and Information Science Hebei Univerity, Baoding 071002, China hdhyywa@163com
More information. h I B. Average velocity can be interpreted as the slope of a tangent line. I C. The difference quotient program finds the exact value of f ( a)
Capter Review Packet (questions - ) KEY. In eac case determine if te information or statement is correct (C) or incorrect (I). If it is incorrect, include te correction. f ( a ) f ( a) I A. represents
More informationIEOR 3106: Fall 2013, Professor Whitt Topics for Discussion: Tuesday, November 19 Alternating Renewal Processes and The Renewal Equation
IEOR 316: Fall 213, Profeor Whitt Topic for Dicuion: Tueday, November 19 Alternating Renewal Procee and The Renewal Equation 1 Alternating Renewal Procee An alternating renewal proce alternate between
More informationlim 1 lim 4 Precalculus Notes: Unit 10 Concepts of Calculus
Syllabus Objectives: 1.1 Te student will understand and apply te concept of te limit of a function at given values of te domain. 1. Te student will find te limit of a function at given values of te domain.
More informationEvolutionary Algorithms Based Fixed Order Robust Controller Design and Robustness Performance Analysis
Proceeding of 01 4th International Conference on Machine Learning and Computing IPCSIT vol. 5 (01) (01) IACSIT Pre, Singapore Evolutionary Algorithm Baed Fixed Order Robut Controller Deign and Robutne
More informationON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION. Xiaoqun Wang
Proceeding of the 2008 Winter Simulation Conference S. J. Maon, R. R. Hill, L. Mönch, O. Roe, T. Jefferon, J. W. Fowler ed. ON THE APPROXIMATION ERROR IN HIGH DIMENSIONAL MODEL REPRESENTATION Xiaoqun Wang
More informationComputers and Mathematics with Applications. Sharp algebraic periodicity conditions for linear higher order
Computer and Mathematic with Application 64 (2012) 2262 2274 Content lit available at SciVere ScienceDirect Computer and Mathematic with Application journal homepage: wwweleviercom/locate/camwa Sharp algebraic
More informationSECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY
(Section 3.2: Derivative Functions and Differentiability) 3.2.1 SECTION 3.2: DERIVATIVE FUNCTIONS and DIFFERENTIABILITY LEARNING OBJECTIVES Know, understand, and apply te Limit Definition of te Derivative
More informationh=1 cm 1.03 g/cm 1.43 g/cm
ES 43/614: Introduction to Oceanograpy Solution Homeork # 1) Tere i uge lake it contant ater dept 1 cm and an extenion of 5 km. Te ater in te lake i till and unperturbed (noting move). No e drop object,
More informationChapter 1 Functions and Graphs. Section 1.5 = = = 4. Check Point Exercises The slope of the line y = 3x+ 1 is 3.
Capter Functions and Graps Section. Ceck Point Exercises. Te slope of te line y x+ is. y y m( x x y ( x ( y ( x+ point-slope y x+ 6 y x+ slope-intercept. a. Write te equation in slope-intercept form: x+
More informationSupplementary Figures
Supplementary Figure Supplementary Figure S1: Extraction of the SOF. The tandard deviation of meaured V xy at aturated tate (between 2.4 ka/m and 12 ka/m), V 2 d Vxy( H, j, hm ) Vxy( H, j, hm ) 2. The
More information2.11 That s So Derivative
2.11 Tat s So Derivative Introduction to Differential Calculus Just as one defines instantaneous velocity in terms of average velocity, we now define te instantaneous rate of cange of a function at a point
More information3.1 Extreme Values of a Function
.1 Etreme Values of a Function Section.1 Notes Page 1 One application of te derivative is finding minimum and maimum values off a grap. In precalculus we were only able to do tis wit quadratics by find
More informationDesign By Emulation (Indirect Method)
Deign By Emulation (Indirect Method he baic trategy here i, that Given a continuou tranfer function, it i required to find the bet dicrete equivalent uch that the ignal produced by paing an input ignal
More information1 The concept of limits (p.217 p.229, p.242 p.249, p.255 p.256) 1.1 Limits Consider the function determined by the formula 3. x since at this point
MA00 Capter 6 Calculus and Basic Linear Algebra I Limits, Continuity and Differentiability Te concept of its (p.7 p.9, p.4 p.49, p.55 p.56). Limits Consider te function determined by te formula f Note
More information