Statistical modeling with stochastic processes. Alexandre Bouchard-Côté Lecture 11, Monday April 4

Size: px
Start display at page:

Download "Statistical modeling with stochastic processes. Alexandre Bouchard-Côté Lecture 11, Monday April 4"

Transcription

1 Sttistil mdeling with sthsti presses Alexndre Buhrd-Côté Leture 11, Mndy April 4 1

2 Prgrm fr tdy Bet, Pissn nd Gmm presses DDP nd sequene memizer 2

3 Pitmn-Yr press Pitmn-Yr press: Strt with the CRP, nd bst the prbbility f tble retin while preserving exhngebility This hs the sme nrmliztin s the DP: α0 + n New ustmer... n1 - d nt - d α0 + t d Jin tble #1, with lredy n1 peple sitting there Jin tble # t, with lredy nt peple sitting there Crete new tble Disunt: d [0, 1] 3

4 PY: stik breking nstrutin Dirihlet press: defined G = f(β, θ) fr n iid sequene f θi ~ G0 nd: βi ~ Bet(1, α0), Pitmn-Yr: Sme but nw bet s re nt identilly dist.: βi ~ Bet(1 - d, α0 + i d) 4

5 The infinite HMM Infinite HMMs: π Trnsitin prmeters π x x1 x2 x3 Emissin prmeters θ x x=1.. y1 y2 y3 5

6 Feture bsed representtins Stte-split Feture xi 2 F sttes (1) xi (2) xi 2 sttes 2 sttes... yi (F) xi 2 sttes yi Hw mny fetures? Will see sn slutin: Bet press 6

7 Ltent Feture Mdels Bet press DP: Ltent Feture Mdels DP: Mixture inditr prirs: Dtpint index z1 z2 z1 zz3 2 zz34 zz45 z56 φ1 φ2 φ3 φ4 φ5 φ6 φ7 φ8 φ9 Cluster index φ1 φ2 φ3 φ4 φ5 φ6 φ7 φ8 φ9 Dirihlet press; Pitmn-Yr press z6 Desired: Feture index φ φ φ φ φ φ φ Desired: 1 Feture inditr prirs: Dtpint index z1 zz12 z2 z3 z3 zz4 4 zz5 5 zz φ8 φ9 φ1 φ2 φ3 φ4 φ5 φ6 φ7 φ8 φ9 Bet press 7

8 Preditive distributin: resturnt metphr Insted f sit-dwn resturnt, think f buffet with n infinite sequene f dishes θi smpled by ustmers Custmer #1 Custmer #2... z 1 z 2 z 3 z 4 z 5 z 6 θ1... θ2θ3θ4 Obvius: rder f the lumns nt imprtnt/exhngeble (beuse the θi s will be generted iid) Less bvius: hw t mke the rder f the rws exhngeble 8

9 Preditive distributin: resturnt metphr First ustmer:... Smple Pissn(α) number f dishes. Furth ustmer:... Smple Pissn(α/i) number f new dishes. Smple previusly tried dishes in prprtin t the number f peple wh hve previusly tried them. (Exmple n the brd) Slide frm Kurt Miller 9

10 Bet press: stik breking representtin Interprettin f the sequene f stiks (πj)j=1.. πj is the prir prbbility f piking rw j Cnsequene: the stiks n lnger sum t ne! Cnstrutin (will me bk t it lter): Bet press: β k Bet(1, α) k π k = (1 β l ) l=1 Cf.: Dirihlet press β k Bet(1, α) k 1 π k = β k l=1 (1 β l ) 10

11 Pissn presses 11

12 Pissn presses Anther rndm disrete mesure, but unnrmlized: Let P0 be distributin n smple spe Ω (the bse distributin) nd (A1,..., Ak) be prtitin f Ω. We sy P PP(P 0 ) i.e., P is Pissn Press, if fr ll prtitins nd ll k. ind. P (A 1 ) Pi(P 0 (A 1 )) A1 A2 12

13 Cf: Dirihlet Press Let G0 be distributin n smple spe Ω (the bse distributin) α0 be psitive rel number (the nentrtin), nd (A1,..., Ak) be prtitin f Ω. We sy i.e., G is Dirihlet Press, if fr ll prtitins nd ll k. G DP(α 0,G 0 ) (G(A 1 ),..., G(A k )) Dir(α 0 G 0 (A 1 ),..., α 0 G 0 (A k )) 13

14 Cnsisteny/existene Let P0 be distributin n smple spe Ω (the bse distributin) nd (A1,..., Ak) be prtitin f Ω. We sy i.e., P is Pissn Press, if fr ll prtitins nd ll k. P PP(P 0 ) ind. P (A 1 ) Pi(P 0 (A 1 )) A1 A2 B1 B2 B3 14

15 Cmpbell s therem Assume P0 is prbbility mesure, f is bunded, nd P ~ PP(P0). Let ls: Σ = X P f(x) { } Then: E [ e itσ] = exp (e itf(x) 1)P 0 (dx) Ω 15

16 Sequene memizer 16

17 Bk t hierrhil mdels Hyper-prir ver wrds---nt speifi t prefix Distributin ver wrds in text dtset Distributin ver wht fllws fter the prefix Distributin ver wht fllws fter the prefix Fix... Distributin ver wht fllws fter the prefix fix

18 Mre elbrte exmple Trining: BEG END H G[BEG] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [ END () Prefix trie fr. 18

19 Mrginliztin Trining: BEG END H G[BEG] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [ END () Prefix trie fr. 19

20 Anlyti mrginliztin H Trining: BEG END ] G[BEG] G [] G [] G [] G [] G [] G [] G [] G d G d G [] END Anlytilly pssible when: G s G σ(s) PY(α σ(s) d s,d s ) 20

21 Cnditin fr nlyti mrginliztin H G[BEG] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [] G [ END () Prefix trie fr. 21

A Stochastic Memoizer for Sequence Data

A Stochastic Memoizer for Sequence Data A Sthsti Memizer fr Sequene Dt Frnk Wd fwd@gtsby.ul..uk Cédri Arhmbeu.rhmbeu@s.ul..uk Jn Gsthus j.gsthus@gtsby.ul..uk Lnelt Jmes lnelt@ust.hk Yee Whye Teh ywteh@gtsby.ul..uk Gtsby Cmputtinl Neursiene Unit

More information

MAT 1275: Introduction to Mathematical Analysis

MAT 1275: Introduction to Mathematical Analysis MAT 75: Intrdutin t Mthemtil Anlysis Dr. A. Rzenlyum Trignmetri Funtins fr Aute Angles Definitin f six trignmetri funtins Cnsider the fllwing girffe prlem: A girffe s shdw is 8 meters. Hw tll is the girffe

More information

***SECTION 12.1*** Tests about a Population Mean

***SECTION 12.1*** Tests about a Population Mean ***SECTION 12.1*** Tests but Ppultin Men CHAPTER 12 ~ Significnce Tests in Prctice We begin by drpping the ssumptin tht we knw the ppultin stndrd devitin when testing clims but ppultin men. As with cnfidence

More information

11.2. Infinite Series

11.2. Infinite Series .2 Infinite Series 76.2 Infinite Series An infinite series is the sum f n infinite seuence f numbers + 2 + 3 + Á + n + Á The gl f this sectin is t understnd the mening f such n infinite sum nd t develp

More information

On-Line Construction. of Suffix Trees. Overview. Suffix Trees. Notations. goo. Suffix tries

On-Line Construction. of Suffix Trees. Overview. Suffix Trees. Notations. goo. Suffix tries On-Line Cnstrutin Overview Suffix tries f Suffix Trees E. Ukknen On-line nstrutin f suffix tries in qudrti time Suffix trees On-line nstrutin f suffix trees in liner time Applitins 1 2 Suffix Trees A suffix

More information

Computational modeling techniques

Computational modeling techniques Cmputatinal mdeling techniques Lecture 4: Mdel checing fr ODE mdels In Petre Department f IT, Åb Aademi http://www.users.ab.fi/ipetre/cmpmd/ Cntent Stichimetric matrix Calculating the mass cnservatin relatins

More information

Modern Physics. Unit 6: Hydrogen Atom - Radiation Lecture 6.1: The Radial Probability Density. Ron Reifenberger Professor of Physics Purdue University

Modern Physics. Unit 6: Hydrogen Atom - Radiation Lecture 6.1: The Radial Probability Density. Ron Reifenberger Professor of Physics Purdue University Mdern Physics Unit 6: Hydrgen Atm - Rditin Lecture 6.1: The Rdil Prbbility Density Rn Reifenberger Prfessr f Physics Purdue University 1 Prbbility Density Prbbility Density * ΨΨ = Ψ In 1-D, the prbbility

More information

1 Probability Density Functions

1 Probability Density Functions Lis Yn CS 9 Continuous Distributions Lecture Notes #9 July 6, 28 Bsed on chpter by Chris Piech So fr, ll rndom vribles we hve seen hve been discrete. In ll the cses we hve seen in CS 9, this ment tht our

More information

We partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b.

We partition C into n small arcs by forming a partition of [a, b] by picking s i as follows: a = s 0 < s 1 < < s n = b. Mth 255 - Vector lculus II Notes 4.2 Pth nd Line Integrls We begin with discussion of pth integrls (the book clls them sclr line integrls). We will do this for function of two vribles, but these ides cn

More information

Joint distribution. Joint distribution. Marginal distributions. Joint distribution

Joint distribution. Joint distribution. Marginal distributions. Joint distribution Joint distribution To specify the joint distribution of n rndom vribles X 1,...,X n tht tke vlues in the smple spces E 1,...,E n we need probbility mesure, P, on E 1... E n = {(x 1,...,x n ) x i E i, i

More information

Improper Integrals, and Differential Equations

Improper Integrals, and Differential Equations Improper Integrls, nd Differentil Equtions October 22, 204 5.3 Improper Integrls Previously, we discussed how integrls correspond to res. More specificlly, we sid tht for function f(x), the region creted

More information

The area under the graph of f and above the x-axis between a and b is denoted by. f(x) dx. π O

The area under the graph of f and above the x-axis between a and b is denoted by. f(x) dx. π O 1 Section 5. The Definite Integrl Suppose tht function f is continuous nd positive over n intervl [, ]. y = f(x) x The re under the grph of f nd ove the x-xis etween nd is denoted y f(x) dx nd clled the

More information

OVERVIEW Using Similarity and Proving Triangle Theorems G.SRT.4

OVERVIEW Using Similarity and Proving Triangle Theorems G.SRT.4 OVRVIW Using Similrity nd Prving Tringle Therems G.SRT.4 G.SRT.4 Prve therems ut tringles. Therems include: line prllel t ne side f tringle divides the ther tw prprtinlly, nd cnversely; the Pythgren Therem

More information

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms

Chapter Summary. Mathematical Induction Strong Induction Recursive Definitions Structural Induction Recursive Algorithms Chapter 5 1 Chapter Summary Mathematical Inductin Strng Inductin Recursive Definitins Structural Inductin Recursive Algrithms Sectin 5.1 3 Sectin Summary Mathematical Inductin Examples f Prf by Mathematical

More information

Riemann is the Mann! (But Lebesgue may besgue to differ.)

Riemann is the Mann! (But Lebesgue may besgue to differ.) Riemnn is the Mnn! (But Lebesgue my besgue to differ.) Leo Livshits My 2, 2008 1 For finite intervls in R We hve seen in clss tht every continuous function f : [, b] R hs the property tht for every ɛ >

More information

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives

Properties of Integrals, Indefinite Integrals. Goals: Definition of the Definite Integral Integral Calculations using Antiderivatives Block #6: Properties of Integrls, Indefinite Integrls Gols: Definition of the Definite Integrl Integrl Clcultions using Antiderivtives Properties of Integrls The Indefinite Integrl 1 Riemnn Sums - 1 Riemnn

More information

(2) Even if such a value of k was possible, the neutrons multiply

(2) Even if such a value of k was possible, the neutrons multiply CHANGE OF REACTOR Nuclear Thery - Curse 227 POWER WTH REACTVTY CHANGE n this lessn, we will cnsider hw neutrn density, neutrn flux and reactr pwer change when the multiplicatin factr, k, r the reactivity,

More information

Solution for Assignment 1 : Intro to Probability and Statistics, PAC learning

Solution for Assignment 1 : Intro to Probability and Statistics, PAC learning Solution for Assignment 1 : Intro to Probbility nd Sttistics, PAC lerning 10-701/15-781: Mchine Lerning (Fll 004) Due: Sept. 30th 004, Thursdy, Strt of clss Question 1. Bsic Probbility ( 18 pts) 1.1 (

More information

38 Riemann sums and existence of the definite integral.

38 Riemann sums and existence of the definite integral. 38 Riemnn sums nd existence of the definite integrl. In the clcultion of the re of the region X bounded by the grph of g(x) = x 2, the x-xis nd 0 x b, two sums ppered: ( n (k 1) 2) b 3 n 3 re(x) ( n These

More information

CMPSCI 250: Introduction to Computation. Lecture #31: What DFA s Can and Can t Do David Mix Barrington 9 April 2014

CMPSCI 250: Introduction to Computation. Lecture #31: What DFA s Can and Can t Do David Mix Barrington 9 April 2014 CMPSCI 250: Introduction to Computtion Lecture #31: Wht DFA s Cn nd Cn t Do Dvid Mix Brrington 9 April 2014 Wht DFA s Cn nd Cn t Do Deterministic Finite Automt Forml Definition of DFA s Exmples of DFA

More information

, which yields. where z1. and z2

, which yields. where z1. and z2 The Gaussian r Nrmal PDF, Page 1 The Gaussian r Nrmal Prbability Density Functin Authr: Jhn M Cimbala, Penn State University Latest revisin: 11 September 13 The Gaussian r Nrmal Prbability Density Functin

More information

Continuous Random Variables

Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 217 Néhémy Lim Continuous Rndom Vribles Nottion. The indictor function of set S is rel-vlued function defined by : { 1 if x S 1 S (x) if x S Suppose tht

More information

NFAs continued, Closure Properties of Regular Languages

NFAs continued, Closure Properties of Regular Languages Algorithms & Models of Computtion CS/ECE 374, Fll 2017 NFAs continued, Closure Properties of Regulr Lnguges Lecture 5 Tuesdy, Septemer 12, 2017 Sriel Hr-Peled (UIUC) CS374 1 Fll 2017 1 / 31 Regulr Lnguges,

More information

Landau Theory. Many phase transitions exhibit similar behaviors: critical temperature, order parameter

Landau Theory. Many phase transitions exhibit similar behaviors: critical temperature, order parameter Lndu ery Intrdutin Mny pse trnsitins exibit simir bevirs: riti temperture, rder prmeter n ne find rter simpe unifying tery tt gives gener penmengi verview f pse trnsitins? Sever ppres : Meur fied (Weiss

More information

CS311 Computational Structures Regular Languages and Regular Grammars. Lecture 6

CS311 Computational Structures Regular Languages and Regular Grammars. Lecture 6 CS311 Computtionl Strutures Regulr Lnguges nd Regulr Grmmrs Leture 6 1 Wht we know so fr: RLs re losed under produt, union nd * Every RL n e written s RE, nd every RE represents RL Every RL n e reognized

More information

7.2 The Definite Integral

7.2 The Definite Integral 7.2 The Definite Integrl the definite integrl In the previous section, it ws found tht if function f is continuous nd nonnegtive, then the re under the grph of f on [, b] is given by F (b) F (), where

More information

FINITE BOOLEAN ALGEBRA. 1. Deconstructing Boolean algebras with atoms. Let B = <B,,,,,0,1> be a Boolean algebra and c B.

FINITE BOOLEAN ALGEBRA. 1. Deconstructing Boolean algebras with atoms. Let B = <B,,,,,0,1> be a Boolean algebra and c B. FINITE BOOLEAN ALGEBRA 1. Decnstructing Blean algebras with atms. Let B = be a Blean algebra and c B. The ideal generated by c, (c], is: (c] = {b B: b c} The filter generated by c, [c), is:

More information

Chapter 5 Plan-Space Planning

Chapter 5 Plan-Space Planning Lecture slides for Automted Plnning: Theory nd Prctice Chpter 5 Pln-Spce Plnning Dn S. Nu CMSC 722, AI Plnning University of Mrylnd, Spring 2008 1 Stte-Spce Plnning Motivtion g 1 1 g 4 4 s 0 g 5 5 g 2

More information

The Law of Total Probability, Bayes Rule, and Random Variables (Oh My!)

The Law of Total Probability, Bayes Rule, and Random Variables (Oh My!) The Law f Ttal Prbability, Bayes Rule, and Randm Variables (Oh My!) Administrivia Hmewrk 2 is psted and is due tw Friday s frm nw If yu didn t start early last time, please d s this time. Gd Milestnes:

More information

Countdown: 9 Weeks. 3. Kimi has posted3 x 3,.3 " 3 puppyphotos on a social network. 6.EE.1. [-l. rhe power i.l-le. Course{. Countdown.

Countdown: 9 Weeks. 3. Kimi has posted3 x 3,.3  3 puppyphotos on a social network. 6.EE.1. [-l. rhe power i.l-le. Course{. Countdown. Cuntwn: 9 Weeks AT PRIO Lin stke fruit t sell t mrket. The rti f pples t rnges is 1:4. Lin stke n mre thn 200 f eh type f fruit. 6.RP.3,6.RP.3 Pqrt A: Cmplete the tble t etermine hw mny pples n rnges Lin

More information

2. Caryn needs to ship a box that is 14 high, 12 inches deep and 24 inches long. After sealing the box, she tied it with twine as shown:

2. Caryn needs to ship a box that is 14 high, 12 inches deep and 24 inches long. After sealing the box, she tied it with twine as shown: Perimeter Mtters 1. Mrt wnts t tie rin rund the sides f hexgnl x nd then tie w. ch side f the x is 4 inches lng. She needs 14 inches fr the w. Is ne yrd f rin enugh? xlin. hen stte exctly hw lng the rin

More information

n f(x i ) x. i=1 In section 4.2, we defined the definite integral of f from x = a to x = b as n f(x i ) x; f(x) dx = lim i=1

n f(x i ) x. i=1 In section 4.2, we defined the definite integral of f from x = a to x = b as n f(x i ) x; f(x) dx = lim i=1 The Fundmentl Theorem of Clculus As we continue to study the re problem, let s think bck to wht we know bout computing res of regions enclosed by curves. If we wnt to find the re of the region below the

More information

Statistics, Numerical Models and Ensembles

Statistics, Numerical Models and Ensembles Statistics, Numerical Mdels and Ensembles Duglas Nychka, Reinhard Furrer,, Dan Cley Claudia Tebaldi, Linda Mearns, Jerry Meehl and Richard Smith (UNC). Spatial predictin and data assimilatin Precipitatin

More information

Student Activity 3: Single Factor ANOVA

Student Activity 3: Single Factor ANOVA MATH 40 Student Activity 3: Single Fctor ANOVA Some Bsic Concepts In designed experiment, two or more tretments, or combintions of tretments, is pplied to experimentl units The number of tretments, whether

More information

The Fundamental Theorem of Calculus, Particle Motion, and Average Value

The Fundamental Theorem of Calculus, Particle Motion, and Average Value The Fundmentl Theorem of Clculus, Prticle Motion, nd Averge Vlue b Three Things to Alwys Keep In Mind: (1) v( dt p( b) p( ), where v( represents the velocity nd p( represents the position. b (2) v ( dt

More information

CS667 Lecture 6: Monte Carlo Integration 02/10/05

CS667 Lecture 6: Monte Carlo Integration 02/10/05 CS667 Lecture 6: Monte Crlo Integrtion 02/10/05 Venkt Krishnrj Lecturer: Steve Mrschner 1 Ide The min ide of Monte Crlo Integrtion is tht we cn estimte the vlue of n integrl by looking t lrge number of

More information

The Wave Equation I. MA 436 Kurt Bryan

The Wave Equation I. MA 436 Kurt Bryan 1 Introduction The Wve Eqution I MA 436 Kurt Bryn Consider string stretching long the x xis, of indeterminte (or even infinite!) length. We wnt to derive n eqution which models the motion of the string

More information

practice How would you find: e x + e x e 2x e x 1 dx 1 e today: improper integrals

practice How would you find: e x + e x e 2x e x 1 dx 1 e today: improper integrals prctice How would you find: dx e x + e x e 2x e x 1 dx e 2x 1 e x dx 1. Let u=e^x. Then dx=du/u. Ans = rctn ( e^x ) + C 2. Let u=e^x. Becomes u du / (u-1), divide to get u/(u-1)=1+1/(u-1) Ans = e^x + ln

More information

ENGI 4430 Parametric Vector Functions Page 2-01

ENGI 4430 Parametric Vector Functions Page 2-01 ENGI 4430 Parametric Vectr Functins Page -01. Parametric Vectr Functins (cntinued) Any nn-zer vectr r can be decmpsed int its magnitude r and its directin: r rrˆ, where r r 0 Tangent Vectr: dx dy dz dr

More information

4.4 Areas, Integrals and Antiderivatives

4.4 Areas, Integrals and Antiderivatives . res, integrls nd ntiderivtives 333. Ares, Integrls nd Antiderivtives This section explores properties of functions defined s res nd exmines some connections mong res, integrls nd ntiderivtives. In order

More information

PHYS 314 HOMEWORK #3

PHYS 314 HOMEWORK #3 PHYS 34 HOMEWORK #3 Due : 8 Feb. 07. A unifrm chain f mass M, lenth L and density λ (measured in k/m) hans s that its bttm link is just tuchin a scale. The chain is drpped frm rest nt the scale. What des

More information

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus

Unit #9 : Definite Integral Properties; Fundamental Theorem of Calculus Unit #9 : Definite Integrl Properties; Fundmentl Theorem of Clculus Gols: Identify properties of definite integrls Define odd nd even functions, nd reltionship to integrl vlues Introduce the Fundmentl

More information

Ch. 2.3 Counting Sample Points. Cardinality of a Set

Ch. 2.3 Counting Sample Points. Cardinality of a Set Ch..3 Counting Smple Points CH 8 Crdinlity of Set Let S e set. If there re extly n distint elements in S, where n is nonnegtive integer, we sy S is finite set nd n is the rdinlity of S. The rdinlity of

More information

Five Whys How To Do It Better

Five Whys How To Do It Better Five Whys Definitin. As explained in the previus article, we define rt cause as simply the uncvering f hw the current prblem came int being. Fr a simple causal chain, it is the entire chain. Fr a cmplex

More information

Lecture 6: Coding theory

Lecture 6: Coding theory Leture 6: Coing theory Biology 429 Crl Bergstrom Ferury 4, 2008 Soures: This leture loosely follows Cover n Thoms Chpter 5 n Yeung Chpter 3. As usul, some of the text n equtions re tken iretly from those

More information

Chapter 0. What is the Lebesgue integral about?

Chapter 0. What is the Lebesgue integral about? Chpter 0. Wht is the Lebesgue integrl bout? The pln is to hve tutoril sheet ech week, most often on Fridy, (to be done during the clss) where you will try to get used to the ides introduced in the previous

More information

10. AREAS BETWEEN CURVES

10. AREAS BETWEEN CURVES . AREAS BETWEEN CURVES.. Ares etween curves So res ove the x-xis re positive nd res elow re negtive, right? Wrong! We lied! Well, when you first lern out integrtion it s convenient fiction tht s true in

More information

x = a To determine the volume of the solid, we use a definite integral to sum the volumes of the slices as we let!x " 0 :

x = a To determine the volume of the solid, we use a definite integral to sum the volumes of the slices as we let!x  0 : Clculus II MAT 146 Integrtion Applictions: Volumes of 3D Solids Our gol is to determine volumes of vrious shpes. Some of the shpes re the result of rotting curve out n xis nd other shpes re simply given

More information

Differentiation Applications 1: Related Rates

Differentiation Applications 1: Related Rates Differentiatin Applicatins 1: Related Rates 151 Differentiatin Applicatins 1: Related Rates Mdel 1: Sliding Ladder 10 ladder y 10 ladder 10 ladder A 10 ft ladder is leaning against a wall when the bttm

More information

Chapter 5 : Continuous Random Variables

Chapter 5 : Continuous Random Variables STAT/MATH 395 A - PROBABILITY II UW Winter Qurter 216 Néhémy Lim Chpter 5 : Continuous Rndom Vribles Nottions. N {, 1, 2,...}, set of nturl numbers (i.e. ll nonnegtive integers); N {1, 2,...}, set of ll

More information

Definite integral. Mathematics FRDIS MENDELU

Definite integral. Mathematics FRDIS MENDELU Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová Brno 1 Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function defined on [, b]. Wht is the re of the

More information

Module 2: Rate Law & Stoichiomtery (Chapter 3, Fogler)

Module 2: Rate Law & Stoichiomtery (Chapter 3, Fogler) CHE 309: Chemicl Rection Engineering Lecture-8 Module 2: Rte Lw & Stoichiomtery (Chpter 3, Fogler) Topics to be covered in tody s lecture Thermodynmics nd Kinetics Rection rtes for reversible rections

More information

Ph2b Quiz - 1. Instructions

Ph2b Quiz - 1. Instructions Ph2b Winter 217-18 Quiz - 1 Due Dte: Mondy, Jn 29, 218 t 4pm Ph2b Quiz - 1 Instructions 1. Your solutions re due by Mondy, Jnury 29th, 218 t 4pm in the quiz box outside 21 E. Bridge. 2. Lte quizzes will

More information

Alpha Algorithm: Limitations

Alpha Algorithm: Limitations Proess Mining: Dt Siene in Ation Alph Algorithm: Limittions prof.dr.ir. Wil vn der Alst www.proessmining.org Let L e n event log over T. α(l) is defined s follows. 1. T L = { t T σ L t σ}, 2. T I = { t

More information

A NOTE ON THE EQUIVAImCE OF SOME TEST CRITERIA. v. P. Bhapkar. University of Horth Carolina. and

A NOTE ON THE EQUIVAImCE OF SOME TEST CRITERIA. v. P. Bhapkar. University of Horth Carolina. and ~ A NOTE ON THE EQUVAmCE OF SOME TEST CRTERA by v. P. Bhapkar University f Hrth Carlina University f Pna nstitute f Statistics Mime Series N. 421 February 1965 This research was supprted by the Mathematics

More information

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018

Finite Automata Theory and Formal Languages TMV027/DIT321 LP4 2018 Finite Automt Theory nd Forml Lnguges TMV027/DIT321 LP4 2018 Lecture 10 An Bove April 23rd 2018 Recp: Regulr Lnguges We cn convert between FA nd RE; Hence both FA nd RE ccept/generte regulr lnguges; More

More information

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) >

Bootstrap Method > # Purpose: understand how bootstrap method works > obs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(obs) > Btstrap Methd > # Purpse: understand hw btstrap methd wrks > bs=c(11.96, 5.03, 67.40, 16.07, 31.50, 7.73, 11.10, 22.38) > n=length(bs) > mean(bs) [1] 21.64625 > # estimate f lambda > lambda = 1/mean(bs);

More information

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA

Modelling of Clock Behaviour. Don Percival. Applied Physics Laboratory University of Washington Seattle, Washington, USA Mdelling f Clck Behaviur Dn Percival Applied Physics Labratry University f Washingtn Seattle, Washingtn, USA verheads and paper fr talk available at http://faculty.washingtn.edu/dbp/talks.html 1 Overview

More information

MAT 1275: Introduction to Mathematical Analysis

MAT 1275: Introduction to Mathematical Analysis 1 MT 1275: Intrdutin t Mtemtil nlysis Dr Rzenlyum Slving Olique Tringles Lw f Sines Olique tringles tringles tt re nt neessry rigt tringles We re ging t slve tem It mens t find its si elements sides nd

More information

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9.

Internal vs. external validity. External validity. This section is based on Stock and Watson s Chapter 9. Sectin 7 Mdel Assessment This sectin is based n Stck and Watsn s Chapter 9. Internal vs. external validity Internal validity refers t whether the analysis is valid fr the ppulatin and sample being studied.

More information

For the percentage of full time students at RCC the symbols would be:

For the percentage of full time students at RCC the symbols would be: Mth 17/171 Chpter 7- ypothesis Testing with One Smple This chpter is s simple s the previous one, except it is more interesting In this chpter we will test clims concerning the sme prmeters tht we worked

More information

Expectation and Variance

Expectation and Variance Expecttion nd Vrince : sum of two die rolls P(= P(= = 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12 P(=2) = 1/36 P(=3) = 1/18 P(=4) = 1/12 P(=5) = 1/9 P(=7) = 1/6 P(=13) =? 2 1/36 3 1/18 4 1/12 5 1/9 6 5/36 7 1/6

More information

Formal Language and Automata Theory (CS21004)

Formal Language and Automata Theory (CS21004) Forml Lnguge nd Automt Forml Lnguge nd Automt Theory (CS21004) Khrgpur Khrgpur Khrgpur Forml Lnguge nd Automt Tle of Contents Forml Lnguge nd Automt Khrgpur 1 2 3 Khrgpur Forml Lnguge nd Automt Forml Lnguge

More information

Definite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30

Definite integral. Mathematics FRDIS MENDELU. Simona Fišnarová (Mendel University) Definite integral MENDELU 1 / 30 Definite integrl Mthemtics FRDIS MENDELU Simon Fišnrová (Mendel University) Definite integrl MENDELU / Motivtion - re under curve Suppose, for simplicity, tht y = f(x) is nonnegtive nd continuous function

More information

Exponentials - Grade 10 [CAPS] *

Exponentials - Grade 10 [CAPS] * OpenStx-CNX module: m859 Exponentils - Grde 0 [CAPS] * Free High School Science Texts Project Bsed on Exponentils by Rory Adms Free High School Science Texts Project Mrk Horner Hether Willims This work

More information

Chapter 3 Kinematics in Two Dimensions; Vectors

Chapter 3 Kinematics in Two Dimensions; Vectors Chapter 3 Kinematics in Tw Dimensins; Vectrs Vectrs and Scalars Additin f Vectrs Graphical Methds (One and Tw- Dimensin) Multiplicatin f a Vectr b a Scalar Subtractin f Vectrs Graphical Methds Adding Vectrs

More information

B. Definition of an exponential

B. Definition of an exponential Expnents and Lgarithms Chapter IV - Expnents and Lgarithms A. Intrductin Starting with additin and defining the ntatins fr subtractin, multiplicatin and divisin, we discvered negative numbers and fractins.

More information

Bases for Vector Spaces

Bases for Vector Spaces Bses for Vector Spces 2-26-25 A set is independent if, roughly speking, there is no redundncy in the set: You cn t uild ny vector in the set s liner comintion of the others A set spns if you cn uild everything

More information

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction

T Algorithmic methods for data mining. Slide set 6: dimensionality reduction T-61.5060 Algrithmic methds fr data mining Slide set 6: dimensinality reductin reading assignment LRU bk: 11.1 11.3 PCA tutrial in mycurses (ptinal) ptinal: An Elementary Prf f a Therem f Jhnsn and Lindenstrauss,

More information

along the vector 5 a) Find the plane s coordinate after 1 hour. b) Find the plane s coordinate after 2 hours. c) Find the plane s coordinate

along the vector 5 a) Find the plane s coordinate after 1 hour. b) Find the plane s coordinate after 2 hours. c) Find the plane s coordinate L8 VECTOR EQUATIONS OF LINES HL Mth - Sntowski Vector eqution of line 1 A plne strts journey t the point (4,1) moves ech hour long the vector. ) Find the plne s coordinte fter 1 hour. b) Find the plne

More information

PRINCE SULTAN UNIVERSITY Department of Mathematical Sciences Final Examination First Semester ( ) STAT 271.

PRINCE SULTAN UNIVERSITY Department of Mathematical Sciences Final Examination First Semester ( ) STAT 271. PRINCE SULTAN UNIVERSITY Deprtment f Mthemticl Sciences Finl Exmintin First Semester (007 008) STAT 71 Student Nme: Mrk Student Number: Sectin Number: Techer Nme: Time llwed is ½ hurs. Attendnce Number:

More information

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification

COMP 551 Applied Machine Learning Lecture 5: Generative models for linear classification COMP 551 Applied Machine Learning Lecture 5: Generative mdels fr linear classificatin Instructr: Herke van Hf (herke.vanhf@mail.mcgill.ca) Slides mstly by: Jelle Pineau Class web page: www.cs.mcgill.ca/~hvanh2/cmp551

More information

Project 6: Minigoals Towards Simplifying and Rewriting Expressions

Project 6: Minigoals Towards Simplifying and Rewriting Expressions MAT 51 Wldis Projet 6: Minigols Towrds Simplifying nd Rewriting Expressions The distriutive property nd like terms You hve proly lerned in previous lsses out dding like terms ut one prolem with the wy

More information

Maximum A Posteriori (MAP) CS 109 Lecture 22 May 16th, 2016

Maximum A Posteriori (MAP) CS 109 Lecture 22 May 16th, 2016 Maximum A Psteriri (MAP) CS 109 Lecture 22 May 16th, 2016 Previusly in CS109 Game f Estimatrs Maximum Likelihd Nn spiler: this didn t happen Side Plt argmax argmax f lg Mther f ptimizatins? Reviving an

More information

1. For each of the following theorems, give a two or three sentence sketch of how the proof goes or why it is not true.

1. For each of the following theorems, give a two or three sentence sketch of how the proof goes or why it is not true. York University CSE 2 Unit 3. DFA Clsses Converting etween DFA, NFA, Regulr Expressions, nd Extended Regulr Expressions Instructor: Jeff Edmonds Don t chet y looking t these nswers premturely.. For ech

More information

CS 330 Formal Methods and Models

CS 330 Formal Methods and Models CS 330 Forml Methods nd Models Dn Richrds, George Mson University, Spring 2017 Quiz Solutions Quiz 1, Propositionl Logic Dte: Ferury 2 1. Prove ((( p q) q) p) is tutology () (3pts) y truth tle. p q p q

More information

Simple Linear Regression (single variable)

Simple Linear Regression (single variable) Simple Linear Regressin (single variable) Intrductin t Machine Learning Marek Petrik January 31, 2017 Sme f the figures in this presentatin are taken frm An Intrductin t Statistical Learning, with applicatins

More information

QUB XRD Course. The crystalline state. The Crystalline State

QUB XRD Course. The crystalline state. The Crystalline State QUB XRD Course Introduction to Crystllogrphy 1 The crystlline stte Mtter Gseous Stte Solid stte Liquid Stte Amorphous (disordered) Crystlline (ordered) 2 The Crystlline Stte A crystl is constructed by

More information

Chapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1

Chapter Five: Nondeterministic Finite Automata. Formal Language, chapter 5, slide 1 Chpter Five: Nondeterministic Finite Automt Forml Lnguge, chpter 5, slide 1 1 A DFA hs exctly one trnsition from every stte on every symol in the lphet. By relxing this requirement we get relted ut more

More information

Lifting a Lion: Using Proportions

Lifting a Lion: Using Proportions Overview Students will wrk in cperative grups t slve a real-wrd prblem by using the bk Hw D yu Lift a Lin? Using a ty lin and a lever, students will discver hw much wrk is needed t raise the ty lin. They

More information

Pattern Recognition 2014 Support Vector Machines

Pattern Recognition 2014 Support Vector Machines Pattern Recgnitin 2014 Supprt Vectr Machines Ad Feelders Universiteit Utrecht Ad Feelders ( Universiteit Utrecht ) Pattern Recgnitin 1 / 55 Overview 1 Separable Case 2 Kernel Functins 3 Allwing Errrs (Sft

More information

NOTE ON APPELL POLYNOMIALS

NOTE ON APPELL POLYNOMIALS NOTE ON APPELL POLYNOMIALS I. M. SHEFFER An interesting characterizatin f Appell plynmials by means f a Stieltjes integral has recently been given by Thrne. 1 We prpse t give a secnd such representatin,

More information

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank

CAUSAL INFERENCE. Technical Track Session I. Phillippe Leite. The World Bank CAUSAL INFERENCE Technical Track Sessin I Phillippe Leite The Wrld Bank These slides were develped by Christel Vermeersch and mdified by Phillippe Leite fr the purpse f this wrkshp Plicy questins are causal

More information

Lecture 21: Order statistics

Lecture 21: Order statistics Lecture : Order sttistics Suppose we hve N mesurements of sclr, x i =, N Tke ll mesurements nd sort them into scending order x x x 3 x N Define the mesured running integrl S N (x) = 0 for x < x = i/n for

More information

UNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction

UNIT 1 FUNCTIONS AND THEIR INVERSES Lesson 1.4: Logarithmic Functions as Inverses Instruction Lesson : Logrithmic Functions s Inverses Prerequisite Skills This lesson requires the use of the following skills: determining the dependent nd independent vribles in n exponentil function bsed on dt from

More information

Pipetting 101 Developed by BSU CityLab

Pipetting 101 Developed by BSU CityLab Discver the Micrbes Within: The Wlbachia Prject Pipetting 101 Develped by BSU CityLab Clr Cmparisns Pipetting Exercise #1 STUDENT OBJECTIVES Students will be able t: Chse the crrect size micrpipette fr

More information

NFAs continued, Closure Properties of Regular Languages

NFAs continued, Closure Properties of Regular Languages lgorithms & Models of omputtion S/EE 374, Spring 209 NFs continued, losure Properties of Regulr Lnguges Lecture 5 Tuesdy, Jnury 29, 209 Regulr Lnguges, DFs, NFs Lnguges ccepted y DFs, NFs, nd regulr expressions

More information

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA.

A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM. Department of Mathematics, Penn State University University Park, PA16802, USA. A PLETHORA OF MULTI-PULSED SOLUTIONS FOR A BOUSSINESQ SYSTEM MIN CHEN Department f Mathematics, Penn State University University Park, PA68, USA. Abstract. This paper studies traveling-wave slutins f the

More information

This section is primarily focused on tools to aid us in finding roots/zeros/ -intercepts of polynomials. Essentially, our focus turns to solving.

This section is primarily focused on tools to aid us in finding roots/zeros/ -intercepts of polynomials. Essentially, our focus turns to solving. Sectin 3.2: Many f yu WILL need t watch the crrespnding vides fr this sectin n MyOpenMath! This sectin is primarily fcused n tls t aid us in finding rts/zers/ -intercepts f plynmials. Essentially, ur fcus

More information

CHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came.

CHAPTER 24: INFERENCE IN REGRESSION. Chapter 24: Make inferences about the population from which the sample data came. MATH 1342 Ch. 24 April 25 and 27, 2013 Page 1 f 5 CHAPTER 24: INFERENCE IN REGRESSION Chapters 4 and 5: Relatinships between tw quantitative variables. Be able t Make a graph (scatterplt) Summarize the

More information

Learning Partially Observable Markov Models from First Passage Times

Learning Partially Observable Markov Models from First Passage Times Lerning Prtilly Oservle Mrkov s from First Pssge s Jérôme Cllut nd Pierre Dupont Europen Conferene on Mhine Lerning (ECML) 8 Septemer 7 Outline. FPT in models nd sequenes. Prtilly Oservle Mrkov s (POMMs).

More information

Lecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014

Lecture 17. Integration: Gauss Quadrature. David Semeraro. University of Illinois at Urbana-Champaign. March 20, 2014 Lecture 17 Integrtion: Guss Qudrture Dvid Semerro University of Illinois t Urbn-Chmpign Mrch 0, 014 Dvid Semerro (NCSA) CS 57 Mrch 0, 014 1 / 9 Tody: Objectives identify the most widely used qudrture method

More information

5.1 Properties of Inverse Trigonometric Functions.

5.1 Properties of Inverse Trigonometric Functions. Inverse Trignmetricl Functins The inverse f functin f( ) f ( ) f : A B eists if f is ne-ne nt ie, ijectin nd is given Cnsider the e functin with dmin R nd rnge [, ] Clerl this functin is nt ijectin nd

More information

x x

x x Mdeling the Dynamics f Life: Calculus and Prbability fr Life Scientists Frederick R. Adler cfrederick R. Adler, Department f Mathematics and Department f Bilgy, University f Utah, Salt Lake City, Utah

More information

Introduction to Three-phase Circuits. Balanced 3-phase systems Unbalanced 3-phase systems

Introduction to Three-phase Circuits. Balanced 3-phase systems Unbalanced 3-phase systems Intrductin t Three-hse Circuits Blnced 3-hse systems Unblnced 3-hse systems 1 Intrductin t 3-hse systems Single-hse tw-wire system: Single surce cnnected t ld using tw-wire system Single-hse three-wire

More information

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams

Chapter 4 Contravariance, Covariance, and Spacetime Diagrams Chpter 4 Contrvrince, Covrince, nd Spcetime Digrms 4. The Components of Vector in Skewed Coordintes We hve seen in Chpter 3; figure 3.9, tht in order to show inertil motion tht is consistent with the Lorentz

More information

Name Solutions to Test 3 November 8, 2017

Name Solutions to Test 3 November 8, 2017 Nme Solutions to Test 3 November 8, 07 This test consists of three prts. Plese note tht in prts II nd III, you cn skip one question of those offered. Some possibly useful formuls cn be found below. Brrier

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff

Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeoff Lecture 2: Supervised vs. unsupervised learning, bias-variance tradeff Reading: Chapter 2 STATS 202: Data mining and analysis September 27, 2017 1 / 20 Supervised vs. unsupervised learning In unsupervised

More information