Optimization Criterion. Minimum Distance Minimum Time Minimum Acceleration Change Minimum Torque Change Minimum End Point Variance

Size: px
Start display at page:

Download "Optimization Criterion. Minimum Distance Minimum Time Minimum Acceleration Change Minimum Torque Change Minimum End Point Variance"

Transcription

1 Lecture XIV Trajectory Formatio through Otimizatio Cotets: Otimizatio Criterio Miimum istace Miimum Time Miimum Acceleratio Chage Miimum Torque Chage Miimum Ed Poit Variace Usig Motor Redudacies Efficietly Lecture XIV: MLSC - r. Sethu Vijayakumar 1

2 Trajectory Plaig Phases Trajectory geeratio Ivolves comutatio of the best trajectory for the object Force istributio Ivolves determiig the force distributio betwee differet actuators a.k.a. resolvig actuator redudacy Some of the aroaches solve the trajectory geeratio ad force distributio roblems searately i two hases. It has bee argued that solvig the two issues simultaeously as a global otimizatio roblem is suerior i may cases. Kiematics: refers to geometrical ad time-based roerties of motio; the variables of iterest are ositios e.g. joit agles or had Cartesia coordiates ad their corresodig velocities, acceleratios ad higher derivatives. yamics: refers to the forces required to roduce motio ad is therefore itimately liked to the roerties of the object such as it s mass, iertia ad stiffess. Lecture XIV: MLSC - r. Sethu Vijayakumar 2

3 Some Simle Cost Fuctios Shortest istace Refer: F.C.Park ad R.W.Brockett, Kiematic exterity of robot mechaisms, It. Joural of Robotic Research, 1391,. 1-15, 1994 Miimum Acceleratio Refer: L. Noakes, G. Heiziger, ad B. ade, Cubic slies o curved surfaces, IMA Joural of Mathematical Cotrol & Iformatio, 6, , Miimum Time Bag-Bag Cotrol Refer: Z. Shiller, Time Eergy otimal cotrol of articulated systems with geometric ath costraits, I. Proc. of 1994 Itl. Coferece o Robotics ad Automatio, , Sa iego, CA, x ẋ.. x t t t Lecture XIV: MLSC - r. Sethu Vijayakumar 3

4 Miimum Jerk Trajectory Plaig Proosed by Flash & Hoga 1985 Otimizatio Criterio miimizes the jerk i the trajectory T d x d y CJ dt dt dt For movemet i x-y lae The miimum-jerk solutio ca be writte as: x t y t where x y x 0 + y 0 tˆ t / t y f x f 15ˆ t f ad 15ˆ t x 4 0 4, 6ˆ t 6ˆ t y ˆ t 3 10ˆ t 3 are iitial coordiate s at t 0. eeds oly o the kiematics of the task ad is ideedet of the hysical structure or dyamics of the lat Predicts bell shaed velocity rofiles Lecture XIV: MLSC - r. Sethu Vijayakumar 4

5 Miimum Torque Chage Plaig Proosed by Uo, Kawato & Suzuki 1989 Otimizatio Criterio miimizes the chage of torque T d d CT dt dt dt τ1 τ For two joit arm or robot The Mi. Jerk ad Mi. Torque chage cost fuctios are closely related sice acceleratio is roortioal to torque at zero seed. No Aalytical solutio ossible for Mi. Torque chage criterio but iterative solutio is ossible. Like Mi. Jerk, redicts bell shaed velocity rofiles. But also redicts that the form of the trajectory should vary across the arm s worksace. Lecture XIV: MLSC - r. Sethu Vijayakumar 5

6 Mi. Jerk vs Mi. Torque Chage Oe way of resolvig how humas la their movemet is by settig u a exerimet which ca distiguish betwee the kiematic vs dyamic las Lecture XIV: MLSC - r. Sethu Vijayakumar 6

7 Mi. Jerk vs Mi. Torque Chage II No erturbatios at the start & ed. Most studies suggest that trajectories are laed i visually-based kiematic coordiates Lecture XIV: MLSC - r. Sethu Vijayakumar 7

8 Miimum Edoit Variace Plaig Proosed by Harris & Wolert 1998 Also called TOPS Trajectory Otimizatio i the Presece of Sigal deedet oise Basic Theory: Sigle hysiological assumtio that eural sigals are corruted by oise whose variace icreases with the size of the cotrol sigal. I the resece of such oise, the shae of the trajectory is selected to miimize the variace of the fial ed-oit ositio. Biologically more lausible sice we do have access to ed oit errors as oosed to comlex otimizatio rocesses mi. jerk ad mi. torque chage itegrated over the etire movemet that other otimizatio criterio suggest the brai has to solve. Refer: Harris & Wolert, Sigal-deedet oise determies motor laig, Nature, vol. 394, Lecture XIV: MLSC - r. Sethu Vijayakumar 8

9 Testig the Iteral Model Learig Hyothesis Lecture XIV: MLSC - r. Sethu Vijayakumar 9

10 Learig of Iteral Models Usig the force maiuladum, oe ca create a iterestig exerimet i which you modify the dyamics of your arm movemet i oly the x-y lae. Humas are very adet at learig these chaged dyamic fields ad adat at a relatively short time scale. Whe we remove these effects, after effects of learig ca be felt for some time before re-adatatio, rovidig evidece that we lear iteral models ad use them i a redictive feedforward fashio Lecture XIV: MLSC - r. Sethu Vijayakumar 10

11 Multile Model Hyothesis Lecture XIV: MLSC - r. Sethu Vijayakumar 11

12 Lecture XIV: MLSC - r. Sethu Vijayakumar 12 Recursive Bayes Estimatio d k k 1 x If we exlicitly idex the idividual exerieces by, i.e., Ð {x 1,,x }, 1 x where d x x We get Py x Px ypy Px Usig

13 Multile model hyothesis II Multile Paired Forward-Iverse Models MPFIM Lecture XIV: MLSC - r. Sethu Vijayakumar 13

14 Resolvig Motor Redudacies Iverse Kiematics 4 7 x f eye +head : R R x x x y y T R L R L Head1 Head 2 Head 3 Retial islacemet T EyeLP EyeLT EyeRP EyeRT Eye $ Head dislacemets Lecture XIV: MLSC - r. Sethu Vijayakumar 14

15 Resolvig kiematics with RMRC Resolved Motio Rate Cotrol with locality i joit ositios x J Itegrate over small icremets where liearity holds to get comlete trajectory Based o collected traiig data forward kiematics i velocity sace was almost comletely liear, irresective of joit ositio x & J & Hece, i this case, we ca use seudo-iversio with the costat Jacobia!! Lecture XIV: MLSC - r. Sethu Vijayakumar 15

16 Pseudoiverse & Null Sace maiulatio Give x & J &, what is? & & J k L # # J x& + I - J J ull, i J T JJ T 1 2 L ot curret, i 1 # k ull : Pseudoiverse wi curret, i default, i Otimizatio based o gradiet descet i Null sace 2 ot mi w i curret, i default, i Otimizatio criterio Lecture XIV: MLSC - r. Sethu Vijayakumar 16 Iertial Weightig for each joit

Dipartimento di Elettronica e Informazione e Bioingegneria Robotics

Dipartimento di Elettronica e Informazione e Bioingegneria Robotics Diartimeto di Elettroica e Iformaioe e Bioigegeria Robotics arm iverse kiematics @ 5 IK ad robot rogrammig amera Tool gras referece sstem o the object the had has to reach the gras referece: T gras IK

More information

Two or more points can be used to describe a rigid body. This will eliminate the need to define rotational coordinates for the body!

Two or more points can be used to describe a rigid body. This will eliminate the need to define rotational coordinates for the body! OINTCOORDINATE FORMULATION Two or more poits ca be used to describe a rigid body. This will elimiate the eed to defie rotatioal coordiates for the body i z r i i, j r j j rimary oits: The coordiates of

More information

15.093J Optimization Methods. Lecture 22: Barrier Interior Point Algorithms

15.093J Optimization Methods. Lecture 22: Barrier Interior Point Algorithms 1593J Otimizatio Methods Lecture : Barrier Iterior Poit Algorithms 1 Outlie 1 Barrier Methods Slide 1 The Cetral Path 3 Aroximatig the Cetral Path 4 The Primal Barrier Algorithm 5 The Primal-Dual Barrier

More information

ECONOMIC OPERATION OF POWER SYSTEMS

ECONOMIC OPERATION OF POWER SYSTEMS ECOOMC OEATO OF OWE SYSTEMS TOUCTO Oe of the earliest applicatios of o-lie cetralized cotrol was to provide a cetral facility, to operate ecoomically, several geeratig plats supplyig the loads of the system.

More information

Week 1, Lecture 2. Neural Network Basics. Announcements: HW 1 Due on 10/8 Data sets for HW 1 are online Project selection 10/11. Suggested reading :

Week 1, Lecture 2. Neural Network Basics. Announcements: HW 1 Due on 10/8 Data sets for HW 1 are online Project selection 10/11. Suggested reading : ME 537: Learig-Based Cotrol Week 1, Lecture 2 Neural Network Basics Aoucemets: HW 1 Due o 10/8 Data sets for HW 1 are olie Proect selectio 10/11 Suggested readig : NN survey paper (Zhag Chap 1, 2 ad Sectios

More information

ME 539, Fall 2008: Learning-Based Control

ME 539, Fall 2008: Learning-Based Control ME 539, Fall 2008: Learig-Based Cotrol Neural Network Basics 10/1/2008 & 10/6/2008 Uiversity Orego State Neural Network Basics Questios??? Aoucemet: Homework 1 has bee posted Due Friday 10/10/08 at oo

More information

1. Linearization of a nonlinear system given in the form of a system of ordinary differential equations

1. Linearization of a nonlinear system given in the form of a system of ordinary differential equations . Liearizatio of a oliear system give i the form of a system of ordiary differetial equatios We ow show how to determie a liear model which approximates the behavior of a time-ivariat oliear system i a

More information

Machine Learning Regression I Hamid R. Rabiee [Slides are based on Bishop Book] Spring

Machine Learning Regression I Hamid R. Rabiee [Slides are based on Bishop Book] Spring Machie Learig Regressio I Hamid R. Rabiee [Slides are based o Bishop Book] Sprig 015 http://ce.sharif.edu/courses/93-94//ce717-1 Liear Regressio Liear regressio: ivolves a respose variable ad a sigle predictor

More information

NYU Center for Data Science: DS-GA 1003 Machine Learning and Computational Statistics (Spring 2018)

NYU Center for Data Science: DS-GA 1003 Machine Learning and Computational Statistics (Spring 2018) NYU Ceter for Data Sciece: DS-GA 003 Machie Learig ad Computatioal Statistics (Sprig 208) Brett Berstei, David Roseberg, Be Jakubowski Jauary 20, 208 Istructios: Followig most lab ad lecture sectios, we

More information

Systems of Particles: Angular Momentum and Work Energy Principle

Systems of Particles: Angular Momentum and Work Energy Principle 1 2.003J/1.053J Dyamics ad Cotrol I, Sprig 2007 Professor Thomas Peacock 2/20/2007 Lecture 4 Systems of Particles: Agular Mometum ad Work Eergy Priciple Systems of Particles Agular Mometum (cotiued) τ

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week Lecture: Cocept Check Exercises Starred problems are optioal. Statistical Learig Theory. Suppose A = Y = R ad X is some other set. Furthermore, assume P X Y is a discrete

More information

Lecture 4. Hw 1 and 2 will be reoped after class for every body. New deadline 4/20 Hw 3 and 4 online (Nima is lead)

Lecture 4. Hw 1 and 2 will be reoped after class for every body. New deadline 4/20 Hw 3 and 4 online (Nima is lead) Lecture 4 Homework Hw 1 ad 2 will be reoped after class for every body. New deadlie 4/20 Hw 3 ad 4 olie (Nima is lead) Pod-cast lecture o-lie Fial projects Nima will register groups ext week. Email/tell

More information

The Blood Testing Problem

The Blood Testing Problem Teachig Cotemorary Mathematics Coferece Feb 6-7, 00 The Blood Testig Problem Suose that you have a large oulatio that you wish to test for a certai characteristic i their blood or urie (for examle, testig

More information

Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts

Basics of Inference. Lecture 21: Bayesian Inference. Review - Example - Defective Parts, cont. Review - Example - Defective Parts Basics of Iferece Lecture 21: Sta230 / Mth230 Coli Rudel Aril 16, 2014 U util this oit i the class you have almost exclusively bee reseted with roblems where we are usig a robability model where the model

More information

Problem Set 4 Due Oct, 12

Problem Set 4 Due Oct, 12 EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios

More information

( ) = is larger than. the variance of X V

( ) = is larger than. the variance of X V Stat 400, sectio 6. Methods of Poit Estimatio otes by Tim Pilachoski A oit estimate of a arameter is a sigle umber that ca be regarded as a sesible value for The selected statistic is called the oit estimator

More information

Nonequilibrium Excess Carriers in Semiconductors

Nonequilibrium Excess Carriers in Semiconductors Lecture 8 Semicoductor Physics VI Noequilibrium Excess Carriers i Semicoductors Noequilibrium coditios. Excess electros i the coductio bad ad excess holes i the valece bad Ambiolar trasort : Excess electros

More information

BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH

BIOSTATISTICAL METHODS FOR TRANSLATIONAL & CLINICAL RESEARCH BIOSAISICAL MEHODS FOR RANSLAIONAL & CLINICAL RESEARCH Direct Bioassays: REGRESSION APPLICAIONS COMPONENS OF A BIOASSAY he subject is usually a aimal, a huma tissue, or a bacteria culture, he aget is usually

More information

Chapter 6: BINOMIAL PROBABILITIES

Chapter 6: BINOMIAL PROBABILITIES Charles Bocelet, Probability, Statistics, ad Radom Sigals," Oxford Uiversity Press, 016. ISBN: 978-0-19-00051-0 Chater 6: BINOMIAL PROBABILITIES Sectios 6.1 Basics of the Biomial Distributio 6. Comutig

More information

ECE 442. Spring, Lecture - 4

ECE 442. Spring, Lecture - 4 ECE 44 Power Semicoductor Devices ad Itegrated circuits Srig, 6 Uiversity of Illiois at Chicago Lecture - 4 ecombiatio, geeratio, ad cotiuity equatio 1. Geeratio thermal, electrical, otical. ecombiatio

More information

Notes The Incremental Motion Model:

Notes The Incremental Motion Model: The Icremetal Motio Model: The Jacobia Matrix I the forward kiematics model, we saw that it was possible to relate joit agles θ, to the cofiguratio of the robot ed effector T I this sectio, we will see

More information

Regenerative Property

Regenerative Property DESIGN OF LOGIC FAMILIES Some desirable characteristics to have: 1. Low ower dissiatio. High oise margi (Equal high ad low margis) 3. High seed 4. Low area 5. Low outut resistace 6. High iut resistace

More information

Optimization Methods MIT 2.098/6.255/ Final exam

Optimization Methods MIT 2.098/6.255/ Final exam Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short

More information

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5

CS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5 CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio

More information

ECE534, Spring 2018: Final Exam

ECE534, Spring 2018: Final Exam ECE534, Srig 2018: Fial Exam Problem 1 Let X N (0, 1) ad Y N (0, 1) be ideedet radom variables. variables V = X + Y ad W = X 2Y. Defie the radom (a) Are V, W joitly Gaussia? Justify your aswer. (b) Comute

More information

( ) = p and P( i = b) = q.

( ) = p and P( i = b) = q. MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of

More information

Expectation maximization

Expectation maximization Motivatio Expectatio maximizatio Subhrasu Maji CMSCI 689: Machie Learig 14 April 015 Suppose you are builig a aive Bayes spam classifier. After your are oe your boss tells you that there is o moey to label

More information

Bayesian Methods: Introduction to Multi-parameter Models

Bayesian Methods: Introduction to Multi-parameter Models Bayesia Methods: Itroductio to Multi-parameter Models Parameter: θ = ( θ, θ) Give Likelihood p(y θ) ad prior p(θ ), the posterior p proportioal to p(y θ) x p(θ ) Margial posterior ( θ, θ y) is Iterested

More information

10-701/ Machine Learning Mid-term Exam Solution

10-701/ Machine Learning Mid-term Exam Solution 0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it

More information

Classification of DT signals

Classification of DT signals Comlex exoetial A discrete time sigal may be comlex valued I digital commuicatios comlex sigals arise aturally A comlex sigal may be rereseted i two forms: jarg { z( ) } { } z ( ) = Re { z ( )} + jim {

More information

Stable Gait Synthesis and Analysis of a 12-degree of Freedom Biped Robot in Sagittal and Frontal Planes

Stable Gait Synthesis and Analysis of a 12-degree of Freedom Biped Robot in Sagittal and Frontal Planes Stable Gait Sythesis ad Aalysis of a 12-degree of Freedom Biped Robot i Sagittal ad Frotal Plaes Submitted: 1 th March 2012, accepted: 22 d August 2012 A.P. Sudheer, R. Vijayakumar, K.P. Mohada Abstract:

More information

Pharmacogenomics. Yossi Levy Yossi Levy. Central Dogma of Molecular Biology

Pharmacogenomics. Yossi Levy Yossi Levy. Central Dogma of Molecular Biology harmacogeomics Yossi Levy Cetral ogma of Molecular Biology Yossi Levy 0 Geome ad NA Geome cotais all biological iformatio Biological iformatio is ecoded i NA NA is divided to discrete uits called Gees

More information

[ 47 ] then T ( m ) is true for all n a. 2. The greatest integer function : [ ] is defined by selling [ x]

[ 47 ] then T ( m ) is true for all n a. 2. The greatest integer function : [ ] is defined by selling [ x] [ 47 ] Number System 1. Itroductio Pricile : Let { T ( ) : N} be a set of statemets, oe for each atural umber. If (i), T ( a ) is true for some a N ad (ii) T ( k ) is true imlies T ( k 1) is true for all

More information

Outline. Linear regression. Regularization functions. Polynomial curve fitting. Stochastic gradient descent for regression. MLE for regression

Outline. Linear regression. Regularization functions. Polynomial curve fitting. Stochastic gradient descent for regression. MLE for regression REGRESSION 1 Outlie Liear regressio Regularizatio fuctios Polyomial curve fittig Stochastic gradiet descet for regressio MLE for regressio Step-wise forward regressio Regressio methods Statistical techiques

More information

Castiel, Supernatural, Season 6, Episode 18

Castiel, Supernatural, Season 6, Episode 18 13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio

More information

Special Modeling Techniques

Special Modeling Techniques Colorado School of Mies CHEN43 Secial Modelig Techiques Secial Modelig Techiques Summary of Toics Deviatio Variables No-Liear Differetial Equatios 3 Liearizatio of ODEs for Aroximate Solutios 4 Coversio

More information

2.2 One-dimensional Elastodynamics

2.2 One-dimensional Elastodynamics Sectio.. Oe-dimesioal Elastodyamics I rigid body dyamics, it is assumed that whe a force is alied to oe oit of a object, every other oit i the object is set i motio simultaeously. O the other had, i static

More information

Dimension of a Maximum Volume

Dimension of a Maximum Volume Dimesio of a Maximum Volume Robert Kreczer Deartmet of Mathematics ad Comutig Uiversity of Wiscosi-Steves Poit Steves Poit, WI 54481 Phoe: (715) 346-3754 Email: rkrecze@uwsmail.uws.edu 1. INTRODUCTION.

More information

Data Analysis and Statistical Methods Statistics 651

Data Analysis and Statistical Methods Statistics 651 Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio

More information

Machine Learning Theory (CS 6783)

Machine Learning Theory (CS 6783) Machie Learig Theory (CS 6783) Lecture 2 : Learig Frameworks, Examples Settig up learig problems. X : istace space or iput space Examples: Computer Visio: Raw M N image vectorized X = 0, 255 M N, SIFT

More information

Boosting. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 1, / 32

Boosting. Professor Ameet Talwalkar. Professor Ameet Talwalkar CS260 Machine Learning Algorithms March 1, / 32 Boostig Professor Ameet Talwalkar Professor Ameet Talwalkar CS260 Machie Learig Algorithms March 1, 2017 1 / 32 Outlie 1 Admiistratio 2 Review of last lecture 3 Boostig Professor Ameet Talwalkar CS260

More information

arxiv: v2 [cs.lg] 20 May 2010

arxiv: v2 [cs.lg] 20 May 2010 Olie Learig of Noisy Data with Kerels Nicolò Cesa-Biachi Uiversità degli Studi di Milao cesa-biachi@dsiuimiit Shai Shalev Shwartz he Hebrew Uiversity shais@cshujiacil Ohad Shamir he Hebrew Uiversity ohadsh@cshujiacil

More information

Recursive Updating Fixed Parameter

Recursive Updating Fixed Parameter Recursive Udatig Fixed Parameter So far we ve cosidered the sceario where we collect a buch of data ad the use that (ad the rior PDF) to comute the coditioal PDF from which we ca the get the MAP, or ay

More information

As metioed earlier, directly forecastig o idividual product demads usually result i a far-off forecast that ot oly impairs the quality of subsequet ma

As metioed earlier, directly forecastig o idividual product demads usually result i a far-off forecast that ot oly impairs the quality of subsequet ma Semicoductor Product-mix Estimate with Dyamic Weightig Scheme Argo Che, Ziv Hsia ad Kyle Yag Graduate Istitute of Idustrial Egieerig, Natioal Taiwa Uiversity Roosevelt Rd. Sec. 4, Taipei, Taiwa, 6 ache@tu.edu.tw

More information

ln(i G ) 26.1 Review 26.2 Statistics of multiple breakdowns M Rows HBD SBD N Atoms Time

ln(i G ) 26.1 Review 26.2 Statistics of multiple breakdowns M Rows HBD SBD N Atoms Time EE650R: Reliability Physics of Naoelectroic Devices Lecture 26: TDDB: Statistics of Multiple Breadows Date: Nov 17, 2006 ClassNotes: Jaydeep P. Kulari Review: Pradeep R. Nair 26.1 Review I the last class

More information

MATH 10550, EXAM 3 SOLUTIONS

MATH 10550, EXAM 3 SOLUTIONS MATH 155, EXAM 3 SOLUTIONS 1. I fidig a approximate solutio to the equatio x 3 +x 4 = usig Newto s method with iitial approximatio x 1 = 1, what is x? Solutio. Recall that x +1 = x f(x ) f (x ). Hece,

More information

Maximum Likelihood Estimation and Complexity Regularization

Maximum Likelihood Estimation and Complexity Regularization ECE90 Sprig 004 Statistical Regularizatio ad Learig Theory Lecture: 4 Maximum Likelihood Estimatio ad Complexity Regularizatio Lecturer: Rob Nowak Scribe: Pam Limpiti Review : Maximum Likelihood Estimatio

More information

CHAPTER 10 INFINITE SEQUENCES AND SERIES

CHAPTER 10 INFINITE SEQUENCES AND SERIES CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece

More information

Machine Learning Brett Bernstein

Machine Learning Brett Bernstein Machie Learig Brett Berstei Week 2 Lecture: Cocept Check Exercises Starred problems are optioal. Excess Risk Decompositio 1. Let X = Y = {1, 2,..., 10}, A = {1,..., 10, 11} ad suppose the data distributio

More information

HE ATOM & APPROXIMATION METHODS MORE GENERAL VARIATIONAL TREATMENT. Examples:

HE ATOM & APPROXIMATION METHODS MORE GENERAL VARIATIONAL TREATMENT. Examples: 5.6 4 Lecture #3-4 page HE ATOM & APPROXIMATION METHODS MORE GENERAL VARIATIONAL TREATMENT Do t restrict the wavefuctio to a sigle term! Could be a liear combiatio of several wavefuctios e.g. two terms:

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Class 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Class 23. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700 Class 23 Daiel B. Rowe, Ph.D. Departmet of Mathematics, Statistics, ad Computer Sciece Copyright 2017 by D.B. Rowe 1 Ageda: Recap Chapter 9.1 Lecture Chapter 9.2 Review Exam 6 Problem Solvig Sessio. 2

More information

Chapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian

Chapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde

More information

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE

Run-length & Entropy Coding. Redundancy Removal. Sampling. Quantization. Perform inverse operations at the receiver EEE Geeral e Image Coder Structure Motio Video (s 1,s 2,t) or (s 1,s 2 ) Natural Image Samplig A form of data compressio; usually lossless, but ca be lossy Redudacy Removal Lossless compressio: predictive

More information

Lecture 6 Simple alternatives and the Neyman-Pearson lemma

Lecture 6 Simple alternatives and the Neyman-Pearson lemma STATS 00: Itroductio to Statistical Iferece Autum 06 Lecture 6 Simple alteratives ad the Neyma-Pearso lemma Last lecture, we discussed a umber of ways to costruct test statistics for testig a simple ull

More information

PC5215 Numerical Recipes with Applications - Review Problems

PC5215 Numerical Recipes with Applications - Review Problems PC55 Numerical Recipes with Applicatios - Review Problems Give the IEEE 754 sigle precisio bit patter (biary or he format) of the followig umbers: 0 0 05 00 0 00 Note that it has 8 bits for the epoet,

More information

Microscale Modelling of the Frequency Dependent Resistivity of Porous Media

Microscale Modelling of the Frequency Dependent Resistivity of Porous Media Preseted at the COMSOL Coferece 2008 Haover Microscale Modellig of the Frequecy Deedet Resistivity of Porous Media J.Volkma, N.Klitzsch, O.Mohke ad R.Blaschek Alied Geohysics ad Geothermal Eergy, E.ON

More information

Announcements, Nov. 19 th

Announcements, Nov. 19 th Aoucemets, Nov. 9 th Lecture PRS Quiz topic: results Chemical through Kietics July 9 are posted o the course website. Chec agaist Kietics LabChec agaist Kietics Lab O Fial Exam, NOT 3 Review Exam 3 ad

More information

Hypothesis Testing, Model Selection, and Prediction in Least Squares and Maximum Likelihood Estimation

Hypothesis Testing, Model Selection, and Prediction in Least Squares and Maximum Likelihood Estimation Hyothesis Testig, Model Selectio, ad Predictio i Least Squares ad Maximum Likelihood Estimatio Greee Ch.5, 4; Keedy Ch. 4 R scrit mod3sa, mod3sb, mod3sc Testig for Restrictios i a LS Model Liear Restrictios

More information

Introductory statistics

Introductory statistics CM9S: Machie Learig for Bioiformatics Lecture - 03/3/06 Itroductory statistics Lecturer: Sriram Sakararama Scribe: Sriram Sakararama We will provide a overview of statistical iferece focussig o the key

More information

Perceptron. Inner-product scalar Perceptron. XOR problem. Gradient descent Stochastic Approximation to gradient descent 5/10/10

Perceptron. Inner-product scalar Perceptron. XOR problem. Gradient descent Stochastic Approximation to gradient descent 5/10/10 Perceptro Ier-product scalar Perceptro Perceptro learig rule XOR problem liear separable patters Gradiet descet Stochastic Approximatio to gradiet descet LMS Adalie 1 Ier-product et =< w, x >= w x cos(θ)

More information

Linear Associator Linear Layer

Linear Associator Linear Layer Hebbia Learig opic 6 Note: lecture otes by Michael Negevitsky (uiversity of asmaia) Bob Keller (Harvey Mudd College CA) ad Marti Haga (Uiversity of Colorado) are used Mai idea: learig based o associatio

More information

2 One-Dimensional Elasticity

2 One-Dimensional Elasticity Oe-Dimesioal Elasticity There are two tyes of oe-dimesioal roblems, the elastostatic roblem ad the elastodyamic roblem. The elastostatic roblem gives rise to a secod order differetial equatio i dislacemet

More information

Adaptive Control: CDS 270 I

Adaptive Control: CDS 270 I Lecture Adative Cotrol: CDS 7 I CALIFORNIA INSTITUTE OF TECHNOLOGY Eugee Lavretsky Srig Robust ad Adative Cotrol Worksho Adative Cotrol: Itroductio, Overview, ad Alicatios E. Lavretsky Motivatig Eamle:

More information

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting

Lecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would

More information

Machine Learning. Logistic Regression -- generative verses discriminative classifier. Le Song /15-781, Spring 2008

Machine Learning. Logistic Regression -- generative verses discriminative classifier. Le Song /15-781, Spring 2008 Machie Learig 070/578 Srig 008 Logistic Regressio geerative verses discrimiative classifier Le Sog Lecture 5 Setember 4 0 Based o slides from Eric Xig CMU Readig: Cha. 3..34 CB Geerative vs. Discrimiative

More information

Using the IML Procedure to Examine the Efficacy of a New Control Charting Technique

Using the IML Procedure to Examine the Efficacy of a New Control Charting Technique Paper 2894-2018 Usig the IML Procedure to Examie the Efficacy of a New Cotrol Chartig Techique Austi Brow, M.S., Uiversity of Norther Colorado; Bryce Whitehead, M.S., Uiversity of Norther Colorado ABSTRACT

More information

State Space Representation

State Space Representation Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof.

More information

Kinetics of Complex Reactions

Kinetics of Complex Reactions Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet

More information

Algorithms for Clustering

Algorithms for Clustering CR2: Statistical Learig & Applicatios Algorithms for Clusterig Lecturer: J. Salmo Scribe: A. Alcolei Settig: give a data set X R p where is the umber of observatio ad p is the umber of features, we wat

More information

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D.

Sample Size Estimation in the Proportional Hazards Model for K-sample or Regression Settings Scott S. Emerson, M.D., Ph.D. ample ie Estimatio i the Proportioal Haards Model for K-sample or Regressio ettigs cott. Emerso, M.D., Ph.D. ample ie Formula for a Normally Distributed tatistic uppose a statistic is kow to be ormally

More information

Mixtures of Gaussians and the EM Algorithm

Mixtures of Gaussians and the EM Algorithm Mixtures of Gaussias ad the EM Algorithm CSE 6363 Machie Learig Vassilis Athitsos Computer Sciece ad Egieerig Departmet Uiversity of Texas at Arligto 1 Gaussias A popular way to estimate probability desity

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Design Sensitivity Analysis and Optimization of Nonlinear Transient Dynamics

Design Sensitivity Analysis and Optimization of Nonlinear Transient Dynamics Desig Sesitivity Aalysis ad Otimizatio of Noliear Trasiet Dyamics 8th AIAA/USAF/NASA/ISSOMO Symosium o Multidisciliary Aalysis ad Otimizatio Nam Ho Kim ad Kyug Kook Choi Ceter for Comuter-Aided Desig The

More information

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance

Hypothesis Testing. Evaluation of Performance of Learned h. Issues. Trade-off Between Bias and Variance Hypothesis Testig Empirically evaluatig accuracy of hypotheses: importat activity i ML. Three questios: Give observed accuracy over a sample set, how well does this estimate apply over additioal samples?

More information

Dept. of Biomed. Eng. BME801: Inverse Problems in Bioengineering Kyung Hee Univ.

Dept. of Biomed. Eng. BME801: Inverse Problems in Bioengineering Kyung Hee Univ. Dept of Biomed Eg BME801: Iverse Problems i Bioegieerig Kyug ee Uiv Adaptive Filters - Statistical digital sigal processig: i may problems of iterest, the sigals exhibit some iheret variability plus additive

More information

Question1 Multiple choices (circle the most appropriate one):

Question1 Multiple choices (circle the most appropriate one): Philadelphia Uiversity Studet Name: Faculty of Egieerig Studet Number: Dept. of Computer Egieerig Fial Exam, First Semester: 2014/2015 Course Title: Digital Sigal Aalysis ad Processig Date: 01/02/2015

More information

Lecture 3. Electron and Hole Transport in Semiconductors

Lecture 3. Electron and Hole Transport in Semiconductors Lecture 3 lectro ad Hole Trasort i Semicoductors I this lecture you will lear: How electros ad holes move i semicoductors Thermal motio of electros ad holes lectric curret via lectric curret via usio Semicoductor

More information

Statistical Inference Based on Extremum Estimators

Statistical Inference Based on Extremum Estimators T. Rotheberg Fall, 2007 Statistical Iferece Based o Extremum Estimators Itroductio Suppose 0, the true value of a p-dimesioal parameter, is kow to lie i some subset S R p : Ofte we choose to estimate 0

More information

Correlation Regression

Correlation Regression Correlatio Regressio While correlatio methods measure the stregth of a liear relatioship betwee two variables, we might wish to go a little further: How much does oe variable chage for a give chage i aother

More information

The Expectation-Maximization (EM) Algorithm

The Expectation-Maximization (EM) Algorithm The Expectatio-Maximizatio (EM) Algorithm Readig Assigmets T. Mitchell, Machie Learig, McGraw-Hill, 997 (sectio 6.2, hard copy). S. Gog et al. Dyamic Visio: From Images to Face Recogitio, Imperial College

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

Lecture 9. NMOS Field Effect Transistor (NMOSFET or NFET)

Lecture 9. NMOS Field Effect Transistor (NMOSFET or NFET) ecture 9 MOS Field ffect Trasistor (MOSFT or FT) this lecture you will lear: The oeratio ad workig of the MOS trasistor A MOS aacitor with a hael otact ( Si) metal cotact Si Si GB B versio layer PSi substrate

More information

Optimally Sparse SVMs

Optimally Sparse SVMs A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but

More information

Generalized Semi- Markov Processes (GSMP)

Generalized Semi- Markov Processes (GSMP) Geeralized Semi- Markov Processes (GSMP) Summary Some Defiitios Markov ad Semi-Markov Processes The Poisso Process Properties of the Poisso Process Iterarrival times Memoryless property ad the residual

More information

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1

EECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1 EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum

More information

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A)

REGRESSION (Physics 1210 Notes, Partial Modified Appendix A) REGRESSION (Physics 0 Notes, Partial Modified Appedix A) HOW TO PERFORM A LINEAR REGRESSION Cosider the followig data poits ad their graph (Table I ad Figure ): X Y 0 3 5 3 7 4 9 5 Table : Example Data

More information

Lecture 7: Linear Classification Methods

Lecture 7: Linear Classification Methods Homeork Homeork Lecture 7: Liear lassificatio Methods Fial rojects? Grous Toics Proosal eek 5 Lecture is oster sessio, Jacobs Hall Lobb, sacks Fial reort 5 Jue. What is liear classificatio? lassificatio

More information

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution

Mathematical Modeling of Optimum 3 Step Stress Accelerated Life Testing for Generalized Pareto Distribution America Joural of Theoretical ad Applied Statistics 05; 4(: 6-69 Published olie May 8, 05 (http://www.sciecepublishiggroup.com/j/ajtas doi: 0.648/j.ajtas.05040. ISSN: 6-8999 (Prit; ISSN: 6-9006 (Olie Mathematical

More information

Fast preconditioned solution of Navier-Stokes equations for compressible flows with physics

Fast preconditioned solution of Navier-Stokes equations for compressible flows with physics Fast recoditioed solutio of Navier-Stoes equatios for comressible flows with hysics Eli Turel & Ore Peles Deartmet of Mathematics, Tel Aviv Uiversity Mathematics, Comutig & Desig Jameso 80 th Birthday

More information

Topic 9: Sampling Distributions of Estimators

Topic 9: Sampling Distributions of Estimators Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be

More information

LECTURE 17: Linear Discriminant Functions

LECTURE 17: Linear Discriminant Functions LECURE 7: Liear Discrimiat Fuctios Perceptro leari Miimum squared error (MSE) solutio Least-mea squares (LMS) rule Ho-Kashyap procedure Itroductio to Patter Aalysis Ricardo Gutierrez-Osua exas A&M Uiversity

More information

Vector Quantization: a Limiting Case of EM

Vector Quantization: a Limiting Case of EM . Itroductio & defiitios Assume that you are give a data set X = { x j }, j { 2,,, }, of d -dimesioal vectors. The vector quatizatio (VQ) problem requires that we fid a set of prototype vectors Z = { z

More information

Appendix: The Laplace Transform

Appendix: The Laplace Transform Appedix: The Laplace Trasform The Laplace trasform is a powerful method that ca be used to solve differetial equatio, ad other mathematical problems. Its stregth lies i the fact that it allows the trasformatio

More information

Topics Machine learning: lecture 3. Linear regression. Linear regression. Linear regression. Linear regression

Topics Machine learning: lecture 3. Linear regression. Linear regression. Linear regression. Linear regression 6.867 Machie learig: lecture 3 Tommi S. Jaakkola MIT CSAIL tommi@csail.mit.edu Topics Beod liear regressio models additive regressio models, eamples geeralizatio ad cross-validatio populatio miimizer Statistical

More information

Putnam Training Exercise Counting, Probability, Pigeonhole Principle (Answers)

Putnam Training Exercise Counting, Probability, Pigeonhole Principle (Answers) Putam Traiig Exercise Coutig, Probability, Pigeohole Pricile (Aswers) November 24th, 2015 1. Fid the umber of iteger o-egative solutios to the followig Diohatie equatio: x 1 + x 2 + x 3 + x 4 + x 5 = 17.

More information

Songklanakarin Journal of Science and Technology SJST R1 Teerapabolarn

Songklanakarin Journal of Science and Technology SJST R1 Teerapabolarn Soglaaari Joural of Sciece ad Techology SJST--.R Teeraabolar A No-uiform Boud o Biomial Aroimatio to the Beta Biomial Cumulative Distributio Fuctio Joural: Soglaaari Joural of Sciece ad Techology For Review

More information

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise)

Lecture 22: Review for Exam 2. 1 Basic Model Assumptions (without Gaussian Noise) Lecture 22: Review for Exam 2 Basic Model Assumptios (without Gaussia Noise) We model oe cotiuous respose variable Y, as a liear fuctio of p umerical predictors, plus oise: Y = β 0 + β X +... β p X p +

More information

Appendix A: Mathematical Formulae and Statistical Tables

Appendix A: Mathematical Formulae and Statistical Tables Aedi A: Mathematical Formulae ad Statistical Tables Pure Mathematics Mesuratio Surface area of shere = r Area of curved surface of coe = r J slat height Trigoometry a * b & c ' bc cos A Arithmetic Series

More information