Refinements. New notes follow on next page. 1 of 8. Equilibrium path. Belief needed
|
|
- Gervase Pitts
- 6 years ago
- Views:
Transcription
1 efiemets Itro from ECO 744 Notes efiemets i Strategic Form: Elimiate Weakly Domiated Strategies - throwig out strictly domiated strategies (eve iteratively ever elimiates a Nash equilibrium (because Nash equilibrium ever has player usig a strictly domiated strategy; goal is to elimiate weakly domiated strategies to get a better defied equilibrium Tremblig Had Perfect - cosider possibility that players make radom errors; look at limit of probabilities of errors to get subset of origial Nash equilibria Theorem - fiite, player game, tremblig had perfect ad elimiatig weakly domiated strategies are the same efiemets i Extesive Form: Tree ules - a little more i depth o the details behid extesive form Successor - odes that ca be reached from a give ode by followig arrows Immediate Successor - ode that's at ed of ay arrow leadig away from a give ode Predecessor - aalogous to successors except we trace backward through the tree; also applies to immediate predecessor Path - sequece of odes that ( starts with the iitial ode, ( eds with a termial ode, ad ( has the property that successive odes i the sequece are immediate successors of each other ule - every ode is a successor of the iitial ode, ad the iitial ode is the oly oe with this property ule - each ode except the iitial ode has exactly oe immediate predecessor; the iitial ode has o predecessors ule - multiple braches extedig from the same ode have differet actio labels ule 4 - each iformatio set cotais decisio odes for oly oe of the players; if this were't the case, at some poit i the game, the players wo't kow who is to make a decisio ule 5 - all odes i a give iformatio set must have the same umber of immediate successors ad they must have the same set of actio labels o the braches leadig to these successors; if this were't the case, the player would be able to distiguish betwee the odes Equilibrium Path - what we observe if we watch the game Subgame - ca't break up a iformatio set ad has to start from a sigle ode Subgame Perfect - if game comes to iitial ode of a subgame, the game will progress as if it were the subgame so we should fid Nash equilibria to all subgames (do't believe people will do irratioal thigs; closely related to throwig out weakly domiated strategies Sequetial atioality - players ought to demostrate ratioality wheever they are called o to make decisios; optimal strategy for a player should maximize his or her expected payoff, coditioal o every iformatio set at which this player has the move; closely related to tremblig had New otes follow o ext page Belief eeded Equilibrium path of 8
2 Sequetial Equilibrium - builds o subgame perfectio Nash Equilibrium - oly addresses the equilibrium path Subgame Perfectio - says all subgames have equilbrium play Kreps & Wilso - apply equilibrium play to all other areas (icludig those where there are o subgames; coditioal o gettig to ay poit i the tree, players procede with optimizig behavior Actios & Beliefs - have to specify actios ad beliefs at each ode; actios are optimizig with respect to beleifs; beleifs must be cosistet with structure of the game Nash eq. says B does't care about play i this subgame B A U A U D D A prefers D, but oly if B plays B No subgames B prefers whe A plays D Fidig Nash Equilibria - easier to do i strategic form (for fiite games; it's easy to overlook a Nash equilibrium i extesive form Player Example - Cosider this simple, -player game: Put it i strategic form ad we see there are (,,, Nash equilibria: ad,, Which is better? (, (, I strategic form, player has weakly domiated by so we toss the equilibrium I extesive form, is ot subgame perfect (if player fids himself at the decisio after player chooses, player would be irratioal to pick over Player Player,,,, Weakly Domiated Commitmet - if player ca figure out a way to commit to, he ca force player to choose (istead of so player would get a payoff of istead of ; views o commitmet: (a some say it's idepedet of the game tree (b commitmet must be built ito the game tree... we'll use this Example - modify example by allowig player to post a bod for commitmet prior to player 's decisio (i.e., player decides whether or ot to post a bod; if he does (C, he pays a small fee (ε ad icurs a large pealty for choosig... effectively, the bod allows player to chage his payoffs for his treat of playig is credible Put this tree i strategic form to fid all the equilibria Note : player 's strategies are listed as XY, where X is the strategy played if player chooses C ad Y is the strategy played if player chooses N Note : we're igorig ε i the payoffs to save space There are 5 of Nash equilibria of 8 (, (, Player (, Player (, (, Subgame Perfectio (,-(,-ε Player N N C C,,, -,,,,,,,, -,,,,, C (,-ε N (, (, (,
3 "Best Equilibrium" (i.e., the most likely or most logical, ot ecessarily the Pareto optimal I strategic form, we ca use iterated weak domiace to fid that (,C is the best Player Extesive form agai uses subgame perfectio to get the same result Complicatio - if ca commit, ca also commit? If so, game tree should show it; we ca also (,-ε (, have multiple levels of commitmet so this (,-(,-ε (, (, method ca get very complicated Commitmet i Game Tree - oce the game tree is writte, do't talk about actios that are't reflected i the tree (i.e., if a player does't have commitmet devices show i the tree, do't talk about the player usig commitmet to get to his preferred equilibrium Problem with Subgame Perfectio - (we're leadig up to sequetial equilibrium, subgame perfect does't apply if there are o proper subgames as i example Example - there are o subgames so every Nash equilibrium is subgame perfect Strategic form - Slutsky did this o the fly ad admitted that his choice was ot the best to work with (i.e., makig player the row player, the colum player ad the matrix player; there are two equilibria: a, b, ad b, b, ( a Player N N C C,,, -,,,,,,,, -,,,,, ( b Player a b a,,,, b,,,, Matrix (plr payoff Colum (plr payoff ow (plr payoff Player Kreps & Wilso - argue that ot all Nash equilibria are equally compellig; look for players doig thigs off the equilibrium path that are irratioal (a, b, a Equilibrium - player is't o the equilibrium path, so check if he's ratioal playig b give his belief that player plays a ad player plays a ; the oly way player gets to make a decisio is if player deviates (i.e., plays b istead of a ; there's o reaso to thik player chages (he does't kow player deviated, so give player gets his choice ad he expects player to play a, player is best off playig a (payoff of 4 istead of of 8 Player Weak Domiace N over N C over C Iterated Weak Domiace over (with N goe over (with C goe a b Player C N Player a b a 4,4,,, b,,,, C (, N (, Subgame Perfectio a b a b a b a b 4 4
4 Tremblig Had - the strategic form versio of what Kreps & Wilso argued (sort of (a, b, a Equilibrium - we should be able to elimiate this; defie: ε = Pr[player deviates] (i.e., plays b istead of a δ = Pr[player deviates] (i.e., plays b istead of a Assume ε ad δ are small Cosider gai to player by playig deviatig (i.e., plays a istead of b : (Note: "deviatio" for player's & are radom errors, but for player it's a choice Coditio Prob Payoff & do't deviate ( ε ( δ = deviates ( does't ε ( δ 4 = deviates ( does't ( ε δ = & deviate εδ = Expected Gai ε ( δ εδ = ε εδ εδ = ε 4εδ = ε ( 4δ player gais if 4δ > δ < / 4 We assumed ε ad δ are small so player will prefer to deviate ad a, b, ( a is ot a tremblig had perfect equilibrium Note: & deviate is "secod order small" (εδ so that loss is't a big deal (b, b, b Equilibrium - defie: ε = Pr[player deviates] (i.e., plays a istead of b δ = Pr[player deviates] (i.e., plays a istead of b Assume ε ad δ are small Cosider gai to player by playig deviatig (i.e., plays a istead of b : Coditio Prob Payoff & do't deviate ( ε ( δ = deviates ( does't ε ( δ = deviates ( does't ( ε δ 4 = & deviate εδ = Expected Gai ( ε ( δ + ( ε δ = ( ε [ + δ + δ ] = ( ε ( + 4δ player gais if + 4δ > δ > / 4 We assumed ε ad δ are small so player will ot prefer to deviate Note: we oly have to fid oe player that wats to deviate so for the a, b, ( a equilibrium we were able to stop; for this equilibrium we still have to check if player or player wat to deviate Check player ; defie: ε = Pr[player deviates] (i.e., plays a istead of b δ = Pr[player deviates] (i.e., plays a istead of b Assume ε ad δ are small Cosider gai to player by playig deviatig (i.e., plays a istead of b : a b a b a b a b of 8
5 Coditio Prob Payoff & do't deviate ( ε ( δ = deviates ( does't ε ( δ = deviates ( does't ( ε δ = & deviate εδ = Expected Gai ε ( δ ( ε δ + εδ = ε εδ δ + εδ + εδ = ε δ + εδ player gais if ε δ > ε > δ / So if player is more tha twice as likely to make a error as player the player will gai by deviatig... ot exactly cocrete; eed to kow player 's beliefs about ε ad δ a b a b a b a b 4 4 Tremblig Had Perfect - basic idea is itroducig a little oise to the game; differet ways to do it (strategic vs. extesive form; players have beliefs i what oppoets will do based o Nash equilibrium, but they also cosider the chace of mistakes i Error - defie error as a mixed strategy E where some positive probability is assiged to every strategy of player i ; by assumptio this error does ot deped o the player's equilibrium strategy; examples where errors are depedet: Football - ca choose strategy to pass or ru; errors are differet (icomplete pass or iterceptio if player passes; fumble if player rus Darts - aim at ad probability of hittig (error is more tha if player aims at 9 Chace of Error - with some small probability ε, player i makes a error (i.e., plays the i i mixed strategy E istead of his Nash equilibrium strategy X Sequece - look at error as a sequece ε with lim ε = Not Serious - ot takig errors seriously; ot modelig it ad do't care what causes it because ε is small Overall Mixed Strategy - pick a ε (or some i the sequece; combiig player's equilibrium strategy ad error results is the mixed strategy i i ( ε X + ε E (ote limit i as is equal to X Example - assume player has three strategies x, x, x ad player has pure strategy equilibrium x ; overall mixed strategy is: E + ε εe ( ε + εe = εe E εe New Equilibrium - this overall mixed strategy game that results from icorporatig errors satisfies the assumptios of the Nash theorem so we ca fid a ew Nash equilibrium usig errors for all the players NE(, E, where: is matrix of all error probability sequeces for each player E is matrix of all mixed strategy vectors for each player Geeral Case - this formulatio allows errors to affect everyoe; Zelto's origial work had player's ow errors affect rivals oly (ot himself 9 5 of 8
6 Tremblig Had Perfect Equilibria - for some i the sequece lim NE(, E NE( set of tremblig had perfect equilibria is lim NE(, E NE( E Subgame Perfect - sice everythig has some positive probability i the error, tremblig had perfect equilibria looks at player decisios at every ode; that meas these equilibria are subgame perfect Sequetial Equilibrium - similar to tremblig had, but ot exactly the same; start with Nash equilibrium ad use equilibrium strategies to defie beliefs at all odes (icludig those ot o the equilibrium path ad those with zero probability of occurrig; there are lots of rules for how to do this Chagig Beliefs - oce deviatio is observed (i.e., ed up o o-equilibrium path cosider how a player's beliefs chage Cosistecy - beliefs must be cosistet with equilibrium strategies, icludig subgame perfect equilibrium strategies (if they get you to that iformatio set; if player is o a ode that's ot part of ay equilibrium path, the beliefs ca be arbitrary Beliefs (,, Beliefs (/,/,/ Beliefs (, Set of cosistet beliefs: lim Beliefs(, E E Mixed Strategies - if a player is usig a mixed strategy i equilibrium, beliefs must be cosistet with that strategy.9. Player must have beliefs cosistet with player 's strategy beliefs are (.9,. Give player 's domiat strategy, player would ever expect to be here durig the game (zero probability evet; still has to be cosistet with player 's iformatio set (add errors for player ad take limit of error goig to zero Beliefs (.9,. Differece - Tremblig had puts i errors, fids NE, the takes limit of equilibria Sequetial puts i errors, puts i beliefs, takes limit of beliefs, the fid equilibrium Their both very similar, but examples ca be costructed where they're differet Tremblig had imposes more restrictios so TH Seq NE Beefit of Seq - emphasizes usig actios ad beliefs (TH does too, but ot explicitly; this is a good bridge to icomplete iformatio Example - shows the differece betwee sequetial ad tremblig had Tremblig Had - effectively geerates a ew payoff Player matrix based o what strategies the players ited to U D play (i this case we have to check (D, ad (U, U,, 6 of 8,,, -, - Player D, -, -
7 Expected Payoff - defie ( x, y as the expected payoff vector whe player plays mixed strategy x ad player plays mixed strategy vector y I this case, we do't really eed to solve all the boxes (it gets very tedious i larger problems; we ca just examie each Nash equilibrium to see if it's still a equilibrium (U, - determie if player really prefers playig : EV = ( δ ( + δ ( = δ EV = ( δ ( + δ ( = δ EV > EV so player actually prefers... (U, is ot tremblig had perfect (D, - determie if player really prefers playig : EV = δ ( + ( δ ( = δ EV = δ ( + ( δ ( = δ EV > EV (recall δ [,] because it's a probability, but it's assumed to be small so player does prefer ; ow check for row player: U EV = ( ε ( + ε ( = EV Player D = ( ε ( + ε ( = ε D U EV > EV (as log as ε < / so player does prefer D (D, is tremblig had perfect imit of Equilibria - effectively took limit (wrt error probabilities of equilibria Gets Hard - with more tha two strategies, eed to look at uio of all distributios of errors Sequetial - takes limit of beliefs (usually easier tha TH Belief - let π (x be sequece of beliefs of colum player about row player choosig strategy x, ad θ ( y be sequece of beliefs of row player about colum player choosig strategy y Cosistet, Not Equilibrium - beliefs to do ot have to be equilibrium beliefs, but have to be cosistet i the limit (i.e., as, the beliefs have to agree with equilibrium For this case, cosider: π ( U = θ ( = / Player Aim at Aim at ( δ U + δd,( ε + ε ( δ U + δd,( ε + ε Aim at U ( ( Aim at D (( δ D + δu,( ε + ε ( ( δ D + δu,( ε + ε / π ( D = / θ ( = / imits as : π ( U =, π ( D = θ ( =, θ ( = This is cosistet because (U, is a Nash equilibrium Sequetial Equilibrium - specifies two thigs: actios ad beliefs: SE = ((U,; π (U =, θ ( =... actio: (U.; beliefs π ( U = & θ ( = atioality - give belief (take at the limit, is actio a Nash equilibrium Cosistecy - limit of beliefs could result from fully mixed errors 7 of 8
8 I this case, sequetial does othig because (D, ad (U, are sequet equilibria Kreps & Wilso Theorem - paraphrased by Slutsky: typically, sequetial ad tremblig had equilibria are the same; for small sets of games ("measure zero" they're ot the same; i those cases, tremblig had elimiates more tha sequetial (TH Seq Nash; theorem is very hard to prove Summary - For players: IWD TH = WD Seq Nash - TH is exactly equivalet to sigle roud of elimiatig weakly domiated strategies - Iteratively elimiatig weakly domiated strategies elimiates more tha TH More tha players: TH WD Nash; TH Seq Nash; ca't compare WD & Seq or aythig with IWD - TH elimiates more equilibria tha a sigle roud of elimiatig weakly domiated strategies Aside - classic game theory movies: Dr. Stragelove - credibility The Maltese Falco - the book by Dashiell Hammett has a sub-plot about husbad disappearig (ot i the movie that deals with tremblig had (error does't mea game is chaged 8 of 8
Infinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationA sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece,, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet as
More informationLecture 2: April 3, 2013
TTIC/CMSC 350 Mathematical Toolkit Sprig 203 Madhur Tulsiai Lecture 2: April 3, 203 Scribe: Shubhedu Trivedi Coi tosses cotiued We retur to the coi tossig example from the last lecture agai: Example. Give,
More informationINTEGRATION BY PARTS (TABLE METHOD)
INTEGRATION BY PARTS (TABLE METHOD) Suppose you wat to evaluate cos d usig itegratio by parts. Usig the u dv otatio, we get So, u dv d cos du d v si cos d si si d or si si d We see that it is ecessary
More informationInduction: Solutions
Writig Proofs Misha Lavrov Iductio: Solutios Wester PA ARML Practice March 6, 206. Prove that a 2 2 chessboard with ay oe square removed ca always be covered by shaped tiles. Solutio : We iduct o. For
More informationSequences A sequence of numbers is a function whose domain is the positive integers. We can see that the sequence
Sequeces A sequece of umbers is a fuctio whose domai is the positive itegers. We ca see that the sequece 1, 1, 2, 2, 3, 3,... is a fuctio from the positive itegers whe we write the first sequece elemet
More informationRefinements - change set of equilibria to find "better" set of equilibria by eliminating some that are less plausible
efinements efinements - change set of equilibria to find "better" set of equilibria by eliminating some that are less plausible Strategic Form Eliminate Weakly Dominated Strategies - Purpose - throwing
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationCS284A: Representations and Algorithms in Molecular Biology
CS284A: Represetatios ad Algorithms i Molecular Biology Scribe Notes o Lectures 3 & 4: Motif Discovery via Eumeratio & Motif Represetatio Usig Positio Weight Matrix Joshua Gervi Based o presetatios by
More informationRandom Models. Tusheng Zhang. February 14, 2013
Radom Models Tusheg Zhag February 14, 013 1 Radom Walks Let me describe the model. Radom walks are used to describe the motio of a movig particle (object). Suppose that a particle (object) moves alog the
More informationMeasures of Spread: Standard Deviation
Measures of Spread: Stadard Deviatio So far i our study of umerical measures used to describe data sets, we have focused o the mea ad the media. These measures of ceter tell us the most typical value of
More informationIntro to Learning Theory
Lecture 1, October 18, 2016 Itro to Learig Theory Ruth Urer 1 Machie Learig ad Learig Theory Comig soo 2 Formal Framework 21 Basic otios I our formal model for machie learig, the istaces to be classified
More information( ) = p and P( i = b) = q.
MATH 540 Radom Walks Part 1 A radom walk X is special stochastic process that measures the height (or value) of a particle that radomly moves upward or dowward certai fixed amouts o each uit icremet of
More informationNUMERICAL METHODS FOR SOLVING EQUATIONS
Mathematics Revisio Guides Numerical Methods for Solvig Equatios Page 1 of 11 M.K. HOME TUITION Mathematics Revisio Guides Level: GCSE Higher Tier NUMERICAL METHODS FOR SOLVING EQUATIONS Versio:. Date:
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER / Statistics
ACCESS TO SCIENCE, ENGINEERING AND AGRICULTURE: MATHEMATICS 1 MATH00030 SEMESTER 1 018/019 DR. ANTHONY BROWN 8. Statistics 8.1. Measures of Cetre: Mea, Media ad Mode. If we have a series of umbers the
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationFinal Review for MATH 3510
Fial Review for MATH 50 Calculatio 5 Give a fairly simple probability mass fuctio or probability desity fuctio of a radom variable, you should be able to compute the expected value ad variace of the variable
More information1 Review of Probability & Statistics
1 Review of Probability & Statistics a. I a group of 000 people, it has bee reported that there are: 61 smokers 670 over 5 960 people who imbibe (drik alcohol) 86 smokers who imbibe 90 imbibers over 5
More informationProperties and Tests of Zeros of Polynomial Functions
Properties ad Tests of Zeros of Polyomial Fuctios The Remaider ad Factor Theorems: Sythetic divisio ca be used to fid the values of polyomials i a sometimes easier way tha substitutio. This is show by
More informationStatistics 511 Additional Materials
Cofidece Itervals o mu Statistics 511 Additioal Materials This topic officially moves us from probability to statistics. We begi to discuss makig ifereces about the populatio. Oe way to differetiate probability
More information(b) What is the probability that a particle reaches the upper boundary n before the lower boundary m?
MATH 529 The Boudary Problem The drukard s walk (or boudary problem) is oe of the most famous problems i the theory of radom walks. Oe versio of the problem is described as follows: Suppose a particle
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationSequences I. Chapter Introduction
Chapter 2 Sequeces I 2. Itroductio A sequece is a list of umbers i a defiite order so that we kow which umber is i the first place, which umber is i the secod place ad, for ay atural umber, we kow which
More information1 Games in Normal Form (Strategic Form)
1 Games i Normal Form Strategic Form) A Game i Normal strategic) Form cosists of three compoets: 1 A set of players For each player, a set of strategies called actios i textbook) The iterpretatio is that
More informationMA131 - Analysis 1. Workbook 2 Sequences I
MA3 - Aalysis Workbook 2 Sequeces I Autum 203 Cotets 2 Sequeces I 2. Itroductio.............................. 2.2 Icreasig ad Decreasig Sequeces................ 2 2.3 Bouded Sequeces..........................
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2016 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationOPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES
OPTIMAL ALGORITHMS -- SUPPLEMENTAL NOTES Peter M. Maurer Why Hashig is θ(). As i biary search, hashig assumes that keys are stored i a array which is idexed by a iteger. However, hashig attempts to bypass
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationsubcaptionfont+=small,labelformat=parens,labelsep=space,skip=6pt,list=0,hypcap=0 subcaption ALGEBRAIC COMBINATORICS LECTURE 8 TUESDAY, 2/16/2016
subcaptiofot+=small,labelformat=pares,labelsep=space,skip=6pt,list=0,hypcap=0 subcaptio ALGEBRAIC COMBINATORICS LECTURE 8 TUESDAY, /6/06. Self-cojugate Partitios Recall that, give a partitio λ, we may
More informationIntermediate Math Circles November 4, 2009 Counting II
Uiversity of Waterloo Faculty of Mathematics Cetre for Educatio i Mathematics ad Computig Itermediate Math Circles November 4, 009 Coutig II Last time, after lookig at the product rule ad sum rule, we
More informationLecture 9: Hierarchy Theorems
IAS/PCMI Summer Sessio 2000 Clay Mathematics Udergraduate Program Basic Course o Computatioal Complexity Lecture 9: Hierarchy Theorems David Mix Barrigto ad Alexis Maciel July 27, 2000 Most of this lecture
More informationData Analysis and Statistical Methods Statistics 651
Data Aalysis ad Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasii/teachig.html Suhasii Subba Rao Review of testig: Example The admistrator of a ursig home wats to do a time ad motio
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationRegression, Part I. A) Correlation describes the relationship between two variables, where neither is independent or a predictor.
Regressio, Part I I. Differece from correlatio. II. Basic idea: A) Correlatio describes the relatioship betwee two variables, where either is idepedet or a predictor. - I correlatio, it would be irrelevat
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationOnce we have a sequence of numbers, the next thing to do is to sum them up. Given a sequence (a n ) n=1
. Ifiite Series Oce we have a sequece of umbers, the ext thig to do is to sum them up. Give a sequece a be a sequece: ca we give a sesible meaig to the followig expressio? a = a a a a While summig ifiitely
More informationPUTNAM TRAINING PROBABILITY
PUTNAM TRAINING PROBABILITY (Last udated: December, 207) Remark. This is a list of exercises o robability. Miguel A. Lerma Exercises. Prove that the umber of subsets of {, 2,..., } with odd cardiality
More information6.883: Online Methods in Machine Learning Alexander Rakhlin
6.883: Olie Methods i Machie Learig Alexader Rakhli LECTURES 5 AND 6. THE EXPERTS SETTING. EXPONENTIAL WEIGHTS All the algorithms preseted so far halluciate the future values as radom draws ad the perform
More informationChapter 8: Estimating with Confidence
Chapter 8: Estimatig with Cofidece Sectio 8.2 The Practice of Statistics, 4 th editio For AP* STARNES, YATES, MOORE Chapter 8 Estimatig with Cofidece 8.1 Cofidece Itervals: The Basics 8.2 8.3 Estimatig
More informationDS 100: Principles and Techniques of Data Science Date: April 13, Discussion #10
DS 00: Priciples ad Techiques of Data Sciece Date: April 3, 208 Name: Hypothesis Testig Discussio #0. Defie these terms below as they relate to hypothesis testig. a) Data Geeratio Model: Solutio: A set
More informationAssignment 5: Solutions
McGill Uiversity Departmet of Mathematics ad Statistics MATH 54 Aalysis, Fall 05 Assigmet 5: Solutios. Let y be a ubouded sequece of positive umbers satisfyig y + > y for all N. Let x be aother sequece
More informationFrequentist Inference
Frequetist Iferece The topics of the ext three sectios are useful applicatios of the Cetral Limit Theorem. Without kowig aythig about the uderlyig distributio of a sequece of radom variables {X i }, for
More informationPutnam Training Exercise Counting, Probability, Pigeonhole Principle (Answers)
Putam Traiig Exercise Coutig, Probability, Pigeohole Pricile (Aswers) November 24th, 2015 1. Fid the umber of iteger o-egative solutios to the followig Diohatie equatio: x 1 + x 2 + x 3 + x 4 + x 5 = 17.
More informationCHAPTER 10 INFINITE SEQUENCES AND SERIES
CHAPTER 10 INFINITE SEQUENCES AND SERIES 10.1 Sequeces 10.2 Ifiite Series 10.3 The Itegral Tests 10.4 Compariso Tests 10.5 The Ratio ad Root Tests 10.6 Alteratig Series: Absolute ad Coditioal Covergece
More informationDesign and Analysis of Algorithms
Desig ad Aalysis of Algorithms Probabilistic aalysis ad Radomized algorithms Referece: CLRS Chapter 5 Topics: Hirig problem Idicatio radom variables Radomized algorithms Huo Hogwei 1 The hirig problem
More informationAxioms of Measure Theory
MATH 532 Axioms of Measure Theory Dr. Neal, WKU I. The Space Throughout the course, we shall let X deote a geeric o-empty set. I geeral, we shall ot assume that ay algebraic structure exists o X so that
More information3.2 Properties of Division 3.3 Zeros of Polynomials 3.4 Complex and Rational Zeros of Polynomials
Math 60 www.timetodare.com 3. Properties of Divisio 3.3 Zeros of Polyomials 3.4 Complex ad Ratioal Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered
More informationThe Growth of Functions. Theoretical Supplement
The Growth of Fuctios Theoretical Supplemet The Triagle Iequality The triagle iequality is a algebraic tool that is ofte useful i maipulatig absolute values of fuctios. The triagle iequality says that
More informationMath 257: Finite difference methods
Math 257: Fiite differece methods 1 Fiite Differeces Remember the defiitio of a derivative f f(x + ) f(x) (x) = lim 0 Also recall Taylor s formula: (1) f(x + ) = f(x) + f (x) + 2 f (x) + 3 f (3) (x) +...
More informationThe Boolean Ring of Intervals
MATH 532 Lebesgue Measure Dr. Neal, WKU We ow shall apply the results obtaied about outer measure to the legth measure o the real lie. Throughout, our space X will be the set of real umbers R. Whe ecessary,
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationII. Descriptive Statistics D. Linear Correlation and Regression. 1. Linear Correlation
II. Descriptive Statistics D. Liear Correlatio ad Regressio I this sectio Liear Correlatio Cause ad Effect Liear Regressio 1. Liear Correlatio Quatifyig Liear Correlatio The Pearso product-momet correlatio
More informationApproximations and more PMFs and PDFs
Approximatios ad more PMFs ad PDFs Saad Meimeh 1 Approximatio of biomial with Poisso Cosider the biomial distributio ( b(k,,p = p k (1 p k, k λ: k Assume that is large, ad p is small, but p λ at the limit.
More informationLecture 1 Probability and Statistics
Wikipedia: Lecture 1 Probability ad Statistics Bejami Disraeli, British statesma ad literary figure (1804 1881): There are three kids of lies: lies, damed lies, ad statistics. popularized i US by Mark
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Sprig 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationChapter 3. Strong convergence. 3.1 Definition of almost sure convergence
Chapter 3 Strog covergece As poited out i the Chapter 2, there are multiple ways to defie the otio of covergece of a sequece of radom variables. That chapter defied covergece i probability, covergece i
More informationIntegrable Functions. { f n } is called a determining sequence for f. If f is integrable with respect to, then f d does exist as a finite real number
MATH 532 Itegrable Fuctios Dr. Neal, WKU We ow shall defie what it meas for a measurable fuctio to be itegrable, show that all itegral properties of simple fuctios still hold, ad the give some coditios
More informationTable 12.1: Contingency table. Feature b. 1 N 11 N 12 N 1b 2 N 21 N 22 N 2b. ... a N a1 N a2 N ab
Sectio 12 Tests of idepedece ad homogeeity I this lecture we will cosider a situatio whe our observatios are classified by two differet features ad we would like to test if these features are idepedet
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTheorem: Let A n n. In this case that A does reduce to I, we search for A 1 as the solution matrix X to the matrix equation A X = I i.e.
Theorem: Let A be a square matrix The A has a iverse matrix if ad oly if its reduced row echelo form is the idetity I this case the algorithm illustrated o the previous page will always yield the iverse
More informationZeros of Polynomials
Math 160 www.timetodare.com 4.5 4.6 Zeros of Polyomials I these sectios we will study polyomials algebraically. Most of our work will be cocered with fidig the solutios of polyomial equatios of ay degree
More informationPRACTICE PROBLEMS FOR THE FINAL
PRACTICE PROBLEMS FOR THE FINAL Math 36Q Fall 25 Professor Hoh Below is a list of practice questios for the Fial Exam. I would suggest also goig over the practice problems ad exams for Exam ad Exam 2 to
More informationLecture 12: November 13, 2018
Mathematical Toolkit Autum 2018 Lecturer: Madhur Tulsiai Lecture 12: November 13, 2018 1 Radomized polyomial idetity testig We will use our kowledge of coditioal probability to prove the followig lemma,
More informationMathematical Induction
Mathematical Iductio Itroductio Mathematical iductio, or just iductio, is a proof techique. Suppose that for every atural umber, P() is a statemet. We wish to show that all statemets P() are true. I a
More informationAn Introduction to Randomized Algorithms
A Itroductio to Radomized Algorithms The focus of this lecture is to study a radomized algorithm for quick sort, aalyze it usig probabilistic recurrece relatios, ad also provide more geeral tools for aalysis
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationSeries Review. a i converges if lim. i=1. a i. lim S n = lim i=1. 2 k(k + 2) converges. k=1. k=1
Defiitio: We say that the series S = Series Review i= a i is the sum of the first terms. i= a i coverges if lim S exists ad is fiite, where The above is the defiitio of covergece for series. order to see
More informationCS434a/541a: Pattern Recognition Prof. Olga Veksler. Lecture 5
CS434a/54a: Patter Recogitio Prof. Olga Veksler Lecture 5 Today Itroductio to parameter estimatio Two methods for parameter estimatio Maimum Likelihood Estimatio Bayesia Estimatio Itroducto Bayesia Decisio
More information5.6 Absolute Convergence and The Ratio and Root Tests
5.6 Absolute Covergece ad The Ratio ad Root Tests Bria E. Veitch 5.6 Absolute Covergece ad The Ratio ad Root Tests Recall from our previous sectio that diverged but ( ) coverged. Both of these sequeces
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationHomework 5 Solutions
Homework 5 Solutios p329 # 12 No. To estimate the chace you eed the expected value ad stadard error. To do get the expected value you eed the average of the box ad to get the stadard error you eed the
More informationThe Binomial Theorem
The Biomial Theorem Robert Marti Itroductio The Biomial Theorem is used to expad biomials, that is, brackets cosistig of two distict terms The formula for the Biomial Theorem is as follows: (a + b ( k
More information1 Review and Overview
CS9T/STATS3: Statistical Learig Theory Lecturer: Tegyu Ma Lecture #6 Scribe: Jay Whag ad Patrick Cho October 0, 08 Review ad Overview Recall i the last lecture that for ay family of scalar fuctios F, we
More informationTests of Hypotheses Based on a Single Sample (Devore Chapter Eight)
Tests of Hypotheses Based o a Sigle Sample Devore Chapter Eight MATH-252-01: Probability ad Statistics II Sprig 2018 Cotets 1 Hypothesis Tests illustrated with z-tests 1 1.1 Overview of Hypothesis Testig..........
More informationCS 330 Discussion - Probability
CS 330 Discussio - Probability March 24 2017 1 Fudametals of Probability 11 Radom Variables ad Evets A radom variable X is oe whose value is o-determiistic For example, suppose we flip a coi ad set X =
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationThe Random Walk For Dummies
The Radom Walk For Dummies Richard A Mote Abstract We look at the priciples goverig the oe-dimesioal discrete radom walk First we review five basic cocepts of probability theory The we cosider the Beroulli
More informationConfidence intervals summary Conservative and approximate confidence intervals for a binomial p Examples. MATH1005 Statistics. Lecture 24. M.
MATH1005 Statistics Lecture 24 M. Stewart School of Mathematics ad Statistics Uiversity of Sydey Outlie Cofidece itervals summary Coservative ad approximate cofidece itervals for a biomial p The aïve iterval
More informationKinetics of Complex Reactions
Kietics of Complex Reactios by Flick Colema Departmet of Chemistry Wellesley College Wellesley MA 28 wcolema@wellesley.edu Copyright Flick Colema 996. All rights reserved. You are welcome to use this documet
More informationPolynomial Functions and Their Graphs
Polyomial Fuctios ad Their Graphs I this sectio we begi the study of fuctios defied by polyomial expressios. Polyomial ad ratioal fuctios are the most commo fuctios used to model data, ad are used extesively
More informationBHW #13 1/ Cooper. ENGR 323 Probabilistic Analysis Beautiful Homework # 13
BHW # /5 ENGR Probabilistic Aalysis Beautiful Homework # Three differet roads feed ito a particular freeway etrace. Suppose that durig a fixed time period, the umber of cars comig from each road oto the
More informationStatistical Inference (Chapter 10) Statistical inference = learn about a population based on the information provided by a sample.
Statistical Iferece (Chapter 10) Statistical iferece = lear about a populatio based o the iformatio provided by a sample. Populatio: The set of all values of a radom variable X of iterest. Characterized
More informationMath F215: Induction April 7, 2013
Math F25: Iductio April 7, 203 Iductio is used to prove that a collectio of statemets P(k) depedig o k N are all true. A statemet is simply a mathematical phrase that must be either true or false. Here
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationOptimally Sparse SVMs
A. Proof of Lemma 3. We here prove a lower boud o the umber of support vectors to achieve geeralizatio bouds of the form which we cosider. Importatly, this result holds ot oly for liear classifiers, but
More informationLecture 3: August 31
36-705: Itermediate Statistics Fall 018 Lecturer: Siva Balakrisha Lecture 3: August 31 This lecture will be mostly a summary of other useful expoetial tail bouds We will ot prove ay of these i lecture,
More informationDiscrete Mathematics for CS Spring 2007 Luca Trevisan Lecture 22
CS 70 Discrete Mathematics for CS Sprig 2007 Luca Trevisa Lecture 22 Aother Importat Distributio The Geometric Distributio Questio: A biased coi with Heads probability p is tossed repeatedly util the first
More informationThe Borel hierarchy classifies subsets of the reals by their topological complexity. Another approach is to classify them by size.
Lecture 7: Measure ad Category The Borel hierarchy classifies subsets of the reals by their topological complexity. Aother approach is to classify them by size. Filters ad Ideals The most commo measure
More informationSequences, Series, and All That
Chapter Te Sequeces, Series, ad All That. Itroductio Suppose we wat to compute a approximatio of the umber e by usig the Taylor polyomial p for f ( x) = e x at a =. This polyomial is easily see to be 3
More informationCHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS
CHAPTR 5 SOM MINIMA AND SADDL POINT THORMS 5. INTRODUCTION Fied poit theorems provide importat tools i game theory which are used to prove the equilibrium ad eistece theorems. For istace, the fied poit
More informationChapter 22. Comparing Two Proportions. Copyright 2010, 2007, 2004 Pearson Education, Inc.
Chapter 22 Comparig Two Proportios Copyright 2010, 2007, 2004 Pearso Educatio, Ic. Comparig Two Proportios Read the first two paragraphs of pg 504. Comparisos betwee two percetages are much more commo
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationCSE 202 Homework 1 Matthias Springer, A Yes, there does always exist a perfect matching without a strong instability.
CSE 0 Homework 1 Matthias Spriger, A9950078 1 Problem 1 Notatio a b meas that a is matched to b. a < b c meas that b likes c more tha a. Equality idicates a tie. Strog istability Yes, there does always
More informationSquare-Congruence Modulo n
Square-Cogruece Modulo Abstract This paper is a ivestigatio of a equivalece relatio o the itegers that was itroduced as a exercise i our Discrete Math class. Part I - Itro Defiitio Two itegers are Square-Cogruet
More informationPower and Type II Error
Statistical Methods I (EXST 7005) Page 57 Power ad Type II Error Sice we do't actually kow the value of the true mea (or we would't be hypothesizig somethig else), we caot kow i practice the type II error
More information