Maximum A Posteriori (MAP) CS 109 Lecture 22 May 16th, 2016
|
|
- Rosa Lambert
- 6 years ago
- Views:
Transcription
1 Maximum A Psteriri (MAP) CS 109 Lecture 22 May 16th, 2016
2 Previusly in CS109
3 Game f Estimatrs Maximum Likelihd Nn spiler: this didn t happen
4 Side Plt argmax argmax f lg Mther f ptimizatins?
5 Reviving an Old Stry Line The Multinmial Distributin Mult(p1,, pk) n! p(x1,..., xk ) = px pxkk x1!... xk!
6 Machine Learning S Far
7 Maximum Likelihd f Data Cnsider n I.I.D. randm variables X 1, X 2,..., X n X i is a sample frm density functin f(x i θ) n L( θ ) = f ( θ ) i= 1 X i n i= 1 LL( θ ) = lg L( θ ) = lg f ( X θ ) = lg f ( X θ ) i n i= 1 i MLE = argmaxll( )
8 MLE t Linear Regressin Hw d yu fit this line? Assume: Y Y = X + Z Z N(0, 2 ) Calculate MLE f ˆ = argmin mx (Y i X i ) 2 i=1 X This is an algrithm called linear regressin. Learn mre abut it later
9 Watch it Online
10 Episde 22 The Sng f The Last Estimatr
11 The Sng f the Last Estimatr
12 Smething rtten in the wrld f MLE
13 Freshadwing..
14 Need a Vlunteer S gd t see yu again!
15 I have tw envelpes, will allw yu t have ne One cntains $X, the ther cntains $2X Select an envelpe Open it! Nw, wuld yu like t switch fr ther envelpe? T help yu decide, cmpute E[$ in ther envelpe] Let Y = $ in envelpe yu selected 1 Y 1 E $in ther envelpe] = Befre pening envelpe, think either equally gd S, what happened by pening envelpe? Tw Envelpes [ Y = And des it really make sense t switch? 5 4 Y
16 Thinking Deeper Abut Tw Envelpes The tw envelpes prblem set-up Tw envelpes: ne cntains $X, ther cntains $2X Yu select an envelpe and pen it Let Y = $ in envelpe yu selected Let Z = $ in ther envelpe 1 Y 1 5 E[ Z Y] = Y = 4 Y E[Z Y] abve assumes all values X (where 0 < X < ) are equally likely Nte: there are infinitely many values f X S, nt true prbability distributin ver X (desn t integrate t 1)
17 All Values are Equally Likely? p(x) Infinite pwers f tw X
18 Subjectivity f Prbability Belief abut cntents f envelpes Since implied distributin ver X is nt a true prbability distributin, what is ur distributin ver X? Frequentist: play game infinitely many times and see hw ften different values cme up. Prblem: I nly allw yu t play the game nce Bayesian prbability Have prir belief f distributin fr X (r anything fr that matter) Prir belief is a subjective prbability By extensin, all prbabilities are subjective Allws us t answer questin when we have n/limited data E.g., prbability a cin yu ve never flipped lands n heads As we get mre data, prir belief is swamped by data
19 Subjectivity f Prbability p(x) X
20 The Envelpe, Please Bayesian: have prir distributin ver X, P(X) Let Y = $ in envelpe yu selected Let Z = $ in ther envelpe Open yur envelpe t determine Y If Y > E[Z Y], keep yur envelpe, therwise switch N incnsistency! Opening envelpe prvides data t cmpute P(X Y) and thereby cmpute E[Z Y] Of curse, there s the issue f hw yu determined yur prir distributin ver X Bayesian: Desn t matter hw yu determined prir, but yu must have ne (whatever it is) Imagine if envelpe yu pened cntained $20.01
21 The Dreaded Half Cent
22 Envelpe Summary: Prbabilities are beliefs Incrprating prir beliefs is useful
23 Especially fr ne sht learning
24 One Sht Learning Single training example: Test set:
25 Prirs fr Parameter Estimatin?
26 Flash Back: Bayes Therem Bayes Therem (θ = mdel parameters, D = data): Psterir Likelihd Prir Likelihd: yu ve seen this befre (in cntext f MLE) Prbability f data given prbability mdel (parameter θ) Prir: befre seeing any data, what is belief abut mdel I.e., what is distributin ver parameters θ Psterir: after seeing data, what is belief abut mdel P(θ D) = P(D θ) P(θ) P(D) After data D bserved, have psterir distributin p(θ D) ver parameters θ cnditined n data. Use this t predict new data.
27 Cmputing P(θ D) Bayes Therem (θ = mdel parameters, D = data): P(θ D) = P(D θ) P(θ) P(D) We have prir P(θ) and can cmpute P(D θ) But hw d we calculate P(D)? Cmplicated answer: P ( D) = P( D θ) P( θ) dθ Easy answer: It des nt depend n θ, s ignre it Just a cnstant that frces P(θ D) t integrate t 1
28 Mst imprtant slide f tday
29 Recall Maximum Likelihd Estimatr (MLE) f θ Maximum A Psteriri (MAP) estimatr f θ: where g(θ) is prir distributin f θ. As befre, can ften be mre cnvenient t use lg: MAP estimate is the mde f the psterir distributin = = n i MLE X i f 1 ) ( max arg θ θ θ ),...,, ( ) ( ),...,, ( arg max ),...,, ( arg max n n n MAP X X X h g X X X f X X X f θ θ θ θ θ θ = = + = = n i MAP X i f g 1 )) ( lg( )) ( lg( max arg θ θ θ θ ) ( ) ( arg max ),...,, ( ) ( ) ( arg max = = = = n i i n n i i X f g X X X h g X f θ θ θ θ θ θ Maximum A Psteriri
30 Maximum A Psteriri Estimated parameter Lg prir MAP =argmax lg(g( )) + nx i=1 lg(f(x i ))! Chse the value f theta that maximizes: Sum f lg likelihd
31 Gtta get that intuitin
32 l Prir: θ ~ Beta(a, b);; D = {n heads, m tails} l Estimate p l By definitin, f(θ D) is Beta(a + n, b + m) ) ( ) ( ) ( ) ( D f p f p D f D p f D D D = = = = θ θ θ θ θ θ ) (1 + + = b m a n p p C ) (1 ) (1 ) (1 ) (1 = = + + b a m n b a m n p p p p C C C C p p p p n m n n m n P(θ D) Fr Beta and Bernulli MAP = argmax f( D) = argmax (n + a 1) lg +(m + b 1) lg(1 )
33 Hyper Parameters a b Hyperparameter a, b are fixed p Prir p Beta(a, b) Data distributin X i Bern(p) X 1 X 2 X n MAP will estimate the mst likely value f p fr this mdel
34 Where d Ya Get Them P(θ)? l l l θ is the prbability a cin turns up heads Mdel θ with 2 different prirs: l l P 1 (θ) is Beta(3,8) (blue) P 2 (θ) is Beta(7,4) (red) They lk pretty different! l Nw flip 100 cins;; get 58 heads and 42 tails l What d psterirs lk like?
35 It s Like Having Twins argmax returns the mde l As lng as we cllect enugh data, psterirs will cnverge t the true value!
36 Cnjugate Distributins Withut Tears Just fr review Have cin with unknwn prbability θ f heads Our prir (subjective) belief is that θ ~ Beta(a, b) Nw flip cin k = n + m times, getting n heads, m tails Psterir density: (θ n heads, m tails) ~Beta(a+n, b+\m) Beta is cnjugate fr Bernulli, Binmial, Gemetric, and Negative Binmial a and b are called hyperparameters Saw (a + b 2) imaginary trials, f thse (a 1) are successes Fr a cin yu never flipped befre, use Beta(x, x) t dente yu think cin likely t be fair Hw strngly yu feel cin is fair is a functin f x
37 M Beta
38 Gnna Need Prirs Parameter Bernulli p Binmial p Pissn Expnential Multinmial p i Nrmal µ Distributin fr Parameter Beta Beta Gamma Gamma Dirichlet Nrmal Nrmal 2 Inverse Gamma Dn t need t knw Inverse Gamma. But it will knw yu
39 Multinmial is Multiple Times the Fun Dirichlet(a 1, a 2,..., a m ) distributin Cnjugate fr Multinmial Dirichlet generalizes Beta in same way Multinmial generalizes Bernulli f(x 1 = x 1,X 2 = x 2,...,X m = x m )=K Intuitive understanding f hyperparameters: Saw a i m imaginary trials, with (a i 1) f utcme i Updating t get the psterir distributin m i= 1 After bserving n 1 + n n m, new trials with n i f utcme i psterir distributin is Dirichlet(a 1 + n 1, a 2 + n 2,..., a m + n m ) my i=1 x a i 1 i
40 Best Shrt Film in the Dirichlet Categry And nw a cl animatin f Dirichlet(a, a, a) This is actually lg density (but yu get the idea ) Thanks Wikipedia!
41 Example: Estimating Die Parameters
42 Yur Happy Laplace Recall example f 6-sides die rlls: X ~ Multinmial(p 1, p 2, p 3, p 4, p 5, p 6 ) Rll n = 12 times Result: 3 nes, 2 tws, 0 threes, 3 furs, 1 fives, 3 sixes MLE: p 1 =3/12, p 2 =2/12, p 3 =0/12, p 4 =3/12, p 5 =1/12, p 6 =3/12 Dirichlet prir allws us t pretend we saw each X i utcme k times befre. MAP estimate: p = + k i n + mk Laplace s law f successin : idea abve with k = 1 X i + 1 Laplace estimate: pi = n + m Laplace: p 1 =4/18, p 2 =3/18, p 3 =1/18, p 4 =4/18, p 5 =2/18, p 6 =4/18 N lnger have 0 prbability f rlling a three!
43 Gd Times with Gamma Gamma(k, θ) distributin Cnjugate fr Pissn Als cnjugate fr Expnential, but we wn t delve int that Intuitive understanding f hyperparameters: Saw k ttal imaginary events during θ prir time perids Updating t get the psterir distributin After bserving n events during next t time perids psterir distributin is Gamma(k + n, θ + t) Example: Gamma(10, 5) Saw 10 events in 5 time perids. Like bserving at rate = 2 Nw see 11 events in next 2 time perids à Gamma(21, 7) Equivalent t updated rate = 3
44 Is Peer Grading Accurate Enugh? Peer Grading n Cursera HCI. 31,067 peer grades fr 3,607 students. Tuned Mdels f Peer Assessment. C Piech, J Huang, A Ng, D Kller
45 Is Peer Grading Accurate Enugh? 1. Defined randm variables fr: True grade (s i ) fr assignment i Observed (z ij ) scre fr assign i Bias (b j ) fr each grader j Variance (r j ) fr each grader j 2. Designed a prbabilistic mdel that defined the distributins fr all randm variables z j i N (µ = s i + b j, = p r j ) s i N(µ 0, 0) b i N(0, 0 ) = hyperparameter r i InvGamma( 0, 0 ) Tuned Mdels f Peer Assessment. C Piech, J Huang, A Ng, D Kller
46 Is Peer Grading Accurate Enugh? 1. Defined randm variables fr: True grade (s i ) fr assignment i Observed (z ij ) scre fr assign i Bias (b j ) fr each grader j Variance (r j ) fr each grader j 2. Designed a prbabilistic mdel that defined the distributins fr all randm variables 3. Fund variable assignments using MAP estimatin given the bserved data Tuned Mdels f Peer Assessment. C Piech, J Huang, A Ng, D Kller
47 The last estimatr has risen
48 Next time: Machine Learning algrithms
49
50
51 It s Nrmal t Be Nrmal Nrmal(µ 0, σ 02 ) distributin Cnjugate fr Nrmal (with unknwn µ, knwn σ 2 ) Intuitive understanding f hyperparameters: A priri, believe true µ distributed ~ N(µ 0, σ 02 ) Updating t get the psterir distributin After bserving n data pints psterir distributin fr µ is: = , 1 σ σ σ σ σ σ µ n n x N n i i
x 1 Outline IAML: Logistic Regression Decision Boundaries Example Data
Outline IAML: Lgistic Regressin Charles Suttn and Victr Lavrenk Schl f Infrmatics Semester Lgistic functin Lgistic regressin Learning lgistic regressin Optimizatin The pwer f nn-linear basis functins Least-squares
More informationThe Law of Total Probability, Bayes Rule, and Random Variables (Oh My!)
The Law f Ttal Prbability, Bayes Rule, and Randm Variables (Oh My!) Administrivia Hmewrk 2 is psted and is due tw Friday s frm nw If yu didn t start early last time, please d s this time. Gd Milestnes:
More informationCS 109 Lecture 23 May 18th, 2016
CS 109 Lecture 23 May 18th, 2016 New Datasets Heart Ancestry Netflix Our Path Parameter Estimatin Machine Learning: Frmally Many different frms f Machine Learning We fcus n the prblem f predictin Want
More informationCOMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification
COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551
More informationBootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >
Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);
More informationCAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank
CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal
More informationSimple Linear Regression (single variable)
Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins
More informationModule 3: Gaussian Process Parameter Estimation, Prediction Uncertainty, and Diagnostics
Mdule 3: Gaussian Prcess Parameter Estimatin, Predictin Uncertainty, and Diagnstics Jerme Sacks and William J Welch Natinal Institute f Statistical Sciences and University f British Clumbia Adapted frm
More informationCHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came.
MATH 1342 Ch. 24 April 25 and 27, 2013 Page 1 f 5 CHAPTER 24: INFERENCE IN REGRESSION Chapters 4 and 5: Relatinships between tw quantitative variables. Be able t Make a graph (scatterplt) Summarize the
More informationAdmin. MDP Search Trees. Optimal Quantities. Reinforcement Learning
Admin Reinfrcement Learning Cntent adapted frm Berkeley CS188 MDP Search Trees Each MDP state prjects an expectimax-like search tree Optimal Quantities The value (utility) f a state s: V*(s) = expected
More informationDistributions, spatial statistics and a Bayesian perspective
Distributins, spatial statistics and a Bayesian perspective Dug Nychka Natinal Center fr Atmspheric Research Distributins and densities Cnditinal distributins and Bayes Thm Bivariate nrmal Spatial statistics
More informationInternal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.
Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.
More informationCOMP 551 Applied Machine Learning Lecture 11: Support Vector Machines
COMP 551 Applied Machine Learning Lecture 11: Supprt Vectr Machines Instructr: (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted fr this curse
More informationMedium Scale Integrated (MSI) devices [Sections 2.9 and 2.10]
EECS 270, Winter 2017, Lecture 3 Page 1 f 6 Medium Scale Integrated (MSI) devices [Sectins 2.9 and 2.10] As we ve seen, it s smetimes nt reasnable t d all the design wrk at the gate-level smetimes we just
More informationThis section is primarily focused on tools to aid us in finding roots/zeros/ -intercepts of polynomials. Essentially, our focus turns to solving.
Sectin 3.2: Many f yu WILL need t watch the crrespnding vides fr this sectin n MyOpenMath! This sectin is primarily fcused n tls t aid us in finding rts/zers/ -intercepts f plynmials. Essentially, ur fcus
More informationLecture 13: Markov Chain Monte Carlo. Gibbs sampling
Lecture 13: Markv hain Mnte arl Gibbs sampling Gibbs sampling Markv chains 1 Recall: Apprximate inference using samples Main idea: we generate samples frm ur Bayes net, then cmpute prbabilities using (weighted)
More informationChapter 8: The Binomial and Geometric Distributions
Sectin 8.1: The Binmial Distributins Chapter 8: The Binmial and Gemetric Distributins A randm variable X is called a BINOMIAL RANDOM VARIABLE if it meets ALL the fllwing cnditins: 1) 2) 3) 4) The MOST
More informationLecture 7: Damped and Driven Oscillations
Lecture 7: Damped and Driven Oscillatins Last time, we fund fr underdamped scillatrs: βt x t = e A1 + A csω1t + i A1 A sinω1t A 1 and A are cmplex numbers, but ur answer must be real Implies that A 1 and
More information, which yields. where z1. and z2
The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationLecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff
Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised
More informationWe can see from the graph above that the intersection is, i.e., [ ).
MTH 111 Cllege Algebra Lecture Ntes July 2, 2014 Functin Arithmetic: With nt t much difficulty, we ntice that inputs f functins are numbers, and utputs f functins are numbers. S whatever we can d with
More informationCHM112 Lab Graphing with Excel Grading Rubric
Name CHM112 Lab Graphing with Excel Grading Rubric Criteria Pints pssible Pints earned Graphs crrectly pltted and adhere t all guidelines (including descriptive title, prperly frmatted axes, trendline
More informationResampling Methods. Cross-validation, Bootstrapping. Marek Petrik 2/21/2017
Resampling Methds Crss-validatin, Btstrapping Marek Petrik 2/21/2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins in R (Springer, 2013) with
More informationIntroduction to Regression
Intrductin t Regressin Administrivia Hmewrk 6 psted later tnight. Due Friday after Break. 2 Statistical Mdeling Thus far we ve talked abut Descriptive Statistics: This is the way my sample is Inferential
More informationExperiment #3. Graphing with Excel
Experiment #3. Graphing with Excel Study the "Graphing with Excel" instructins that have been prvided. Additinal help with learning t use Excel can be fund n several web sites, including http://www.ncsu.edu/labwrite/res/gt/gt-
More informationProfessional Development. Implementing the NGSS: High School Physics
Prfessinal Develpment Implementing the NGSS: High Schl Physics This is a dem. The 30-min vide webinar is available in the full PD. Get it here. Tday s Learning Objectives NGSS key cncepts why this is different
More informationFive Whys How To Do It Better
Five Whys Definitin. As explained in the previus article, we define rt cause as simply the uncvering f hw the current prblem came int being. Fr a simple causal chain, it is the entire chain. Fr a cmplex
More information[COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t o m a k e s u r e y o u a r e r e a d y )
(Abut the final) [COLLEGE ALGEBRA EXAM I REVIEW TOPICS] ( u s e t h i s t m a k e s u r e y u a r e r e a d y ) The department writes the final exam s I dn't really knw what's n it and I can't very well
More informationINSTRUMENTAL VARIABLES
INSTRUMENTAL VARIABLES Technical Track Sessin IV Sergi Urzua University f Maryland Instrumental Variables and IE Tw main uses f IV in impact evaluatin: 1. Crrect fr difference between assignment f treatment
More informationPhysics 2010 Motion with Constant Acceleration Experiment 1
. Physics 00 Mtin with Cnstant Acceleratin Experiment In this lab, we will study the mtin f a glider as it accelerates dwnhill n a tilted air track. The glider is supprted ver the air track by a cushin
More informationSUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical model for microarray data analysis
SUPPLEMENTARY MATERIAL GaGa: a simple and flexible hierarchical mdel fr micrarray data analysis David Rssell Department f Bistatistics M.D. Andersn Cancer Center, Hustn, TX 77030, USA rsselldavid@gmail.cm
More informationComputational modeling techniques
Cmputatinal mdeling techniques Lecture 2: Mdeling change. In Petre Department f IT, Åb Akademi http://users.ab.fi/ipetre/cmpmd/ Cntent f the lecture Basic paradigm f mdeling change Examples Linear dynamical
More informationPublic Key Cryptography. Tim van der Horst & Kent Seamons
Public Key Cryptgraphy Tim van der Hrst & Kent Seamns Last Updated: Oct 5, 2017 Asymmetric Encryptin Why Public Key Crypt is Cl Has a linear slutin t the key distributin prblem Symmetric crypt has an expnential
More informationSection 5.8 Notes Page Exponential Growth and Decay Models; Newton s Law
Sectin 5.8 Ntes Page 1 5.8 Expnential Grwth and Decay Mdels; Newtn s Law There are many applicatins t expnential functins that we will fcus n in this sectin. First let s lk at the expnential mdel. Expnential
More informationPart 3 Introduction to statistical classification techniques
Part 3 Intrductin t statistical classificatin techniques Machine Learning, Part 3, March 07 Fabi Rli Preamble ØIn Part we have seen that if we knw: Psterir prbabilities P(ω i / ) Or the equivalent terms
More informationPhys. 344 Ch 7 Lecture 8 Fri., April. 10 th,
Phys. 344 Ch 7 Lecture 8 Fri., April. 0 th, 009 Fri. 4/0 8. Ising Mdel f Ferrmagnets HW30 66, 74 Mn. 4/3 Review Sat. 4/8 3pm Exam 3 HW Mnday: Review fr est 3. See n-line practice test lecture-prep is t
More informationWhat is Statistical Learning?
What is Statistical Learning? Sales 5 10 15 20 25 Sales 5 10 15 20 25 Sales 5 10 15 20 25 0 50 100 200 300 TV 0 10 20 30 40 50 Radi 0 20 40 60 80 100 Newspaper Shwn are Sales vs TV, Radi and Newspaper,
More information15-381/781 Bayesian Nets & Probabilistic Inference
15-381/781 Bayesian Nets & Prbabilistic Inference Emma Brunskill (this time) Ariel Prcaccia With thanks t Dan Klein (Berkeley), Percy Liang (Stanfrd) and Past 15-381 Instructrs fr sme slide cntent, and
More informationLHS Mathematics Department Honors Pre-Calculus Final Exam 2002 Answers
LHS Mathematics Department Hnrs Pre-alculus Final Eam nswers Part Shrt Prblems The table at the right gives the ppulatin f Massachusetts ver the past several decades Using an epnential mdel, predict the
More informationActivity Guide Loops and Random Numbers
Unit 3 Lessn 7 Name(s) Perid Date Activity Guide Lps and Randm Numbers CS Cntent Lps are a relatively straightfrward idea in prgramming - yu want a certain chunk f cde t run repeatedly - but it takes a
More informationAP Statistics Notes Unit Two: The Normal Distributions
AP Statistics Ntes Unit Tw: The Nrmal Distributins Syllabus Objectives: 1.5 The student will summarize distributins f data measuring the psitin using quartiles, percentiles, and standardized scres (z-scres).
More informationFall 2013 Physics 172 Recitation 3 Momentum and Springs
Fall 03 Physics 7 Recitatin 3 Mmentum and Springs Purpse: The purpse f this recitatin is t give yu experience wrking with mmentum and the mmentum update frmula. Readings: Chapter.3-.5 Learning Objectives:.3.
More informationAP Physics Kinematic Wrap Up
AP Physics Kinematic Wrap Up S what d yu need t knw abut this mtin in tw-dimensin stuff t get a gd scre n the ld AP Physics Test? First ff, here are the equatins that yu ll have t wrk with: v v at x x
More informationPattern Recognition 2014 Support Vector Machines
Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft
More informationIf (IV) is (increased, decreased, changed), then (DV) will (increase, decrease, change) because (reason based on prior research).
Science Fair Prject Set Up Instructins 1) Hypthesis Statement 2) Materials List 3) Prcedures 4) Safety Instructins 5) Data Table 1) Hw t write a HYPOTHESIS STATEMENT Use the fllwing frmat: If (IV) is (increased,
More informationTrigonometric Ratios Unit 5 Tentative TEST date
1 U n i t 5 11U Date: Name: Trignmetric Ratis Unit 5 Tentative TEST date Big idea/learning Gals In this unit yu will extend yur knwledge f SOH CAH TOA t wrk with btuse and reflex angles. This extensin
More informationCS 477/677 Analysis of Algorithms Fall 2007 Dr. George Bebis Course Project Due Date: 11/29/2007
CS 477/677 Analysis f Algrithms Fall 2007 Dr. Gerge Bebis Curse Prject Due Date: 11/29/2007 Part1: Cmparisn f Srting Algrithms (70% f the prject grade) The bjective f the first part f the assignment is
More informationModelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA
Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview
More informationAccelerated Chemistry POGIL: Half-life
Name: Date: Perid: Accelerated Chemistry POGIL: Half-life Why? Every radiistpe has a characteristic rate f decay measured by its half-life. Half-lives can be as shrt as a fractin f a secnd r as lng as
More informationYou need to be able to define the following terms and answer basic questions about them:
CS440/ECE448 Sectin Q Fall 2017 Midterm Review Yu need t be able t define the fllwing terms and answer basic questins abut them: Intr t AI, agents and envirnments Pssible definitins f AI, prs and cns f
More informationk-nearest Neighbor How to choose k Average of k points more reliable when: Large k: noise in attributes +o o noise in class labels
Mtivating Example Memry-Based Learning Instance-Based Learning K-earest eighbr Inductive Assumptin Similar inputs map t similar utputs If nt true => learning is impssible If true => learning reduces t
More informationCOMP 551 Applied Machine Learning Lecture 4: Linear classification
COMP 551 Applied Machine Learning Lecture 4: Linear classificatin Instructr: Jelle Pineau (jpineau@cs.mcgill.ca) Class web page: www.cs.mcgill.ca/~jpineau/cmp551 Unless therwise nted, all material psted
More informationNAME: Prof. Ruiz. 1. [5 points] What is the difference between simple random sampling and stratified random sampling?
CS4445 ata Mining and Kwledge iscery in atabases. B Term 2014 Exam 1 Nember 24, 2014 Prf. Carlina Ruiz epartment f Cmputer Science Wrcester Plytechnic Institute NAME: Prf. Ruiz Prblem I: Prblem II: Prblem
More informationTuring Machines. Human-aware Robotics. 2017/10/17 & 19 Chapter 3.2 & 3.3 in Sipser Ø Announcement:
Turing Machines Human-aware Rbtics 2017/10/17 & 19 Chapter 3.2 & 3.3 in Sipser Ø Annuncement: q q q q Slides fr this lecture are here: http://www.public.asu.edu/~yzhan442/teaching/cse355/lectures/tm-ii.pdf
More informationComparing Several Means: ANOVA. Group Means and Grand Mean
STAT 511 ANOVA and Regressin 1 Cmparing Several Means: ANOVA Slide 1 Blue Lake snap beans were grwn in 12 pen-tp chambers which are subject t 4 treatments 3 each with O 3 and SO 2 present/absent. The ttal
More informationFlipping Physics Lecture Notes: Simple Harmonic Motion Introduction via a Horizontal Mass-Spring System
Flipping Physics Lecture Ntes: Simple Harmnic Mtin Intrductin via a Hrizntal Mass-Spring System A Hrizntal Mass-Spring System is where a mass is attached t a spring, riented hrizntally, and then placed
More informationMidwest Big Data Summer School: Machine Learning I: Introduction. Kris De Brabanter
Midwest Big Data Summer Schl: Machine Learning I: Intrductin Kris De Brabanter kbrabant@iastate.edu Iwa State University Department f Statistics Department f Cmputer Science June 24, 2016 1/24 Outline
More informationMath 10 - Exam 1 Topics
Math 10 - Exam 1 Tpics Types and Levels f data Categrical, Discrete r Cntinuus Nminal, Ordinal, Interval r Rati Descriptive Statistics Stem and Leaf Graph Dt Plt (Interpret) Gruped Data Relative and Cumulative
More informationhttps://goo.gl/eaqvfo SUMMER REV: Half-Life DUE DATE: JULY 2 nd
NAME: DUE DATE: JULY 2 nd AP Chemistry SUMMER REV: Half-Life Why? Every radiistpe has a characteristic rate f decay measured by its half-life. Half-lives can be as shrt as a fractin f a secnd r as lng
More informationBLAST / HIDDEN MARKOV MODELS
CS262 (Winter 2015) Lecture 5 (January 20) Scribe: Kat Gregry BLAST / HIDDEN MARKOV MODELS BLAST CONTINUED HEURISTIC LOCAL ALIGNMENT Use Cmmnly used t search vast bilgical databases (n the rder f terabases/tetrabases)
More informationReinforcement Learning" CMPSCI 383 Nov 29, 2011!
Reinfrcement Learning" CMPSCI 383 Nv 29, 2011! 1 Tdayʼs lecture" Review f Chapter 17: Making Cmple Decisins! Sequential decisin prblems! The mtivatin and advantages f reinfrcement learning.! Passive learning!
More informationKinetic Model Completeness
5.68J/10.652J Spring 2003 Lecture Ntes Tuesday April 15, 2003 Kinetic Mdel Cmpleteness We say a chemical kinetic mdel is cmplete fr a particular reactin cnditin when it cntains all the species and reactins
More informationPhysics 2B Chapter 23 Notes - Faraday s Law & Inductors Spring 2018
Michael Faraday lived in the Lndn area frm 1791 t 1867. He was 29 years ld when Hand Oersted, in 1820, accidentally discvered that electric current creates magnetic field. Thrugh empirical bservatin and
More informationIn the OLG model, agents live for two periods. they work and divide their labour income between consumption and
1 The Overlapping Generatins Mdel (OLG) In the OLG mdel, agents live fr tw perids. When ung the wrk and divide their labur incme between cnsumptin and savings. When ld the cnsume their savings. As the
More informationAP Literature and Composition. Summer Reading Packet. Instructions and Guidelines
AP Literature and Cmpsitin Summer Reading Packet Instructins and Guidelines Accrding t the Cllege Bard Advanced Placement prgram: "The AP English curse in Literature and Cmpsitin shuld engage students
More information1b) =.215 1c).080/.215 =.372
Practice Exam 1 - Answers 1. / \.1/ \.9 (D+) (D-) / \ / \.8 / \.2.15/ \.85 (T+) (T-) (T+) (T-).080.020.135.765 1b).080 +.135 =.215 1c).080/.215 =.372 2. The data shwn in the scatter plt is the distance
More informationLesson Plan. Recode: They will do a graphic organizer to sequence the steps of scientific method.
Lessn Plan Reach: Ask the students if they ever ppped a bag f micrwave ppcrn and nticed hw many kernels were unppped at the bttm f the bag which made yu wnder if ther brands pp better than the ne yu are
More informationMATCHING TECHNIQUES. Technical Track Session VI. Emanuela Galasso. The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Emanuela Galass The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Emanuela Galass fr the purpse f this wrkshp When can we use
More informationDifferentiation Applications 1: Related Rates
Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm
More information4th Indian Institute of Astrophysics - PennState Astrostatistics School July, 2013 Vainu Bappu Observatory, Kavalur. Correlation and Regression
4th Indian Institute f Astrphysics - PennState Astrstatistics Schl July, 2013 Vainu Bappu Observatry, Kavalur Crrelatin and Regressin Rahul Ry Indian Statistical Institute, Delhi. Crrelatin Cnsider a tw
More informationGetting Involved O. Responsibilities of a Member. People Are Depending On You. Participation Is Important. Think It Through
f Getting Invlved O Literature Circles can be fun. It is exciting t be part f a grup that shares smething. S get invlved, read, think, and talk abut bks! Respnsibilities f a Member Remember a Literature
More informationHypothesis Tests for One Population Mean
Hypthesis Tests fr One Ppulatin Mean Chapter 9 Ala Abdelbaki Objective Objective: T estimate the value f ne ppulatin mean Inferential statistics using statistics in rder t estimate parameters We will be
More informationLogistic Regression. and Maximum Likelihood. Marek Petrik. Feb
Lgistic Regressin and Maximum Likelihd Marek Petrik Feb 09 2017 S Far in ML Regressin vs Classificatin Linear regressin Bias-variance decmpsitin Practical methds fr linear regressin Simple Linear Regressin
More informationNUMBERS, MATHEMATICS AND EQUATIONS
AUSTRALIAN CURRICULUM PHYSICS GETTING STARTED WITH PHYSICS NUMBERS, MATHEMATICS AND EQUATIONS An integral part t the understanding f ur physical wrld is the use f mathematical mdels which can be used t
More informationA Matrix Representation of Panel Data
web Extensin 6 Appendix 6.A A Matrix Representatin f Panel Data Panel data mdels cme in tw brad varieties, distinct intercept DGPs and errr cmpnent DGPs. his appendix presents matrix algebra representatins
More informationECE 5318/6352 Antenna Engineering. Spring 2006 Dr. Stuart Long. Chapter 6. Part 7 Schelkunoff s Polynomial
ECE 538/635 Antenna Engineering Spring 006 Dr. Stuart Lng Chapter 6 Part 7 Schelkunff s Plynmial 7 Schelkunff s Plynmial Representatin (fr discrete arrays) AF( ψ ) N n 0 A n e jnψ N number f elements in
More informationENSC Discrete Time Systems. Project Outline. Semester
ENSC 49 - iscrete Time Systems Prject Outline Semester 006-1. Objectives The gal f the prject is t design a channel fading simulatr. Upn successful cmpletin f the prject, yu will reinfrce yur understanding
More informationChapter 3 Kinematics in Two Dimensions; Vectors
Chapter 3 Kinematics in Tw Dimensins; Vectrs Vectrs and Scalars Additin f Vectrs Graphical Methds (One and Tw- Dimensin) Multiplicatin f a Vectr b a Scalar Subtractin f Vectrs Graphical Methds Adding Vectrs
More informationPhysics 212. Lecture 12. Today's Concept: Magnetic Force on moving charges. Physics 212 Lecture 12, Slide 1
Physics 1 Lecture 1 Tday's Cncept: Magnetic Frce n mving charges F qv Physics 1 Lecture 1, Slide 1 Music Wh is the Artist? A) The Meters ) The Neville rthers C) Trmbne Shrty D) Michael Franti E) Radiatrs
More informationEASTERN ARIZONA COLLEGE Introduction to Statistics
EASTERN ARIZONA COLLEGE Intrductin t Statistics Curse Design 2014-2015 Curse Infrmatin Divisin Scial Sciences Curse Number PSY 220 Title Intrductin t Statistics Credits 3 Develped by Adam Stinchcmbe Lecture/Lab
More informationResampling Methods. Chapter 5. Chapter 5 1 / 52
Resampling Methds Chapter 5 Chapter 5 1 / 52 1 51 Validatin set apprach 2 52 Crss validatin 3 53 Btstrap Chapter 5 2 / 52 Abut Resampling An imprtant statistical tl Pretending the data as ppulatin and
More informationLecture 6: Phase Space and Damped Oscillations
Lecture 6: Phase Space and Damped Oscillatins Oscillatins in Multiple Dimensins The preius discussin was fine fr scillatin in a single dimensin In general, thugh, we want t deal with the situatin where:
More informationPSU GISPOPSCI June 2011 Ordinary Least Squares & Spatial Linear Regression in GeoDa
There are tw parts t this lab. The first is intended t demnstrate hw t request and interpret the spatial diagnstics f a standard OLS regressin mdel using GeDa. The diagnstics prvide infrmatin abut the
More informationCOMP 551 Applied Machine Learning Lecture 9: Support Vector Machines (cont d)
COMP 551 Applied Machine Learning Lecture 9: Supprt Vectr Machines (cnt d) Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Class web page: www.cs.mcgill.ca/~hvanh2/cmp551 Unless therwise
More informationThe standards are taught in the following sequence.
B L U E V A L L E Y D I S T R I C T C U R R I C U L U M MATHEMATICS Third Grade In grade 3, instructinal time shuld fcus n fur critical areas: (1) develping understanding f multiplicatin and divisin and
More informationT Algorithmic methods for data mining. Slide set 6: dimensionality reduction
T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,
More informationWho is the Holy Spirit?
ill at w w this h t h in SS est abut erence u O q L G ka iff hink : As m t t es a d K S k A the n ma. wn help rmati ur Jesus. y f t u inf e life ab h iple in t alk a disc f T : RE ce as ece t i A p SH
More informationLecture 5: Equilibrium and Oscillations
Lecture 5: Equilibrium and Oscillatins Energy and Mtin Last time, we fund that fr a system with energy cnserved, v = ± E U m ( ) ( ) One result we see immediately is that there is n slutin fr velcity if
More informationAP Statistics Practice Test Unit Three Exploring Relationships Between Variables. Name Period Date
AP Statistics Practice Test Unit Three Explring Relatinships Between Variables Name Perid Date True r False: 1. Crrelatin and regressin require explanatry and respnse variables. 1. 2. Every least squares
More informationKeysight Technologies Understanding the Kramers-Kronig Relation Using A Pictorial Proof
Keysight Technlgies Understanding the Kramers-Krnig Relatin Using A Pictrial Prf By Clin Warwick, Signal Integrity Prduct Manager, Keysight EEsf EDA White Paper Intrductin In principle, applicatin f the
More informationELT COMMUNICATION THEORY
ELT 41307 COMMUNICATION THEORY Matlab Exercise #2 Randm variables and randm prcesses 1 RANDOM VARIABLES 1.1 ROLLING A FAIR 6 FACED DICE (DISCRETE VALIABLE) Generate randm samples fr rlling a fair 6 faced
More informationThree charges, all with a charge of 10 C are situated as shown (each grid line is separated by 1 meter).
Three charges, all with a charge f 0 are situated as shwn (each grid line is separated by meter). ) What is the net wrk needed t assemble this charge distributin? a) +0.5 J b) +0.8 J c) 0 J d) -0.8 J e)
More informationHiding in plain sight
Hiding in plain sight Principles f stegangraphy CS349 Cryptgraphy Department f Cmputer Science Wellesley Cllege The prisners prblem Stegangraphy 1-2 1 Secret writing Lemn juice is very nearly clear s it
More information37 Maxwell s Equations
37 Maxwell s quatins In this chapter, the plan is t summarize much f what we knw abut electricity and magnetism in a manner similar t the way in which James Clerk Maxwell summarized what was knwn abut
More informationEcology 302 Lecture III. Exponential Growth (Gotelli, Chapter 1; Ricklefs, Chapter 11, pp )
Eclgy 302 Lecture III. Expnential Grwth (Gtelli, Chapter 1; Ricklefs, Chapter 11, pp. 222-227) Apcalypse nw. The Santa Ana Watershed Prject Authrity pulls n punches in prtraying its missin in apcalyptic
More informationSIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST. Mark C. Otto Statistics Research Division, Bureau of the Census Washington, D.C , U.S.A.
SIZE BIAS IN LINE TRANSECT SAMPLING: A FIELD TEST Mark C. Ott Statistics Research Divisin, Bureau f the Census Washingtn, D.C. 20233, U.S.A. and Kenneth H. Pllck Department f Statistics, Nrth Carlina State
More informationI. Analytical Potential and Field of a Uniform Rod. V E d. The definition of electric potential difference is
Length L>>a,b,c Phys 232 Lab 4 Ch 17 Electric Ptential Difference Materials: whitebards & pens, cmputers with VPythn, pwer supply & cables, multimeter, crkbard, thumbtacks, individual prbes and jined prbes,
More informationCOMP90051 Statistical Machine Learning
COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Trevor Cohn 2. Statistical Schools Adapted from slides by Ben Rubinstein Statistical Schools of Thought Remainder of lecture is to provide
More informationMATCHING TECHNIQUES Technical Track Session VI Céline Ferré The World Bank
MATCHING TECHNIQUES Technical Track Sessin VI Céline Ferré The Wrld Bank When can we use matching? What if the assignment t the treatment is nt dne randmly r based n an eligibility index, but n the basis
More information