Brief Review of Functions of Several Variables
|
|
- Alfred Howard
- 6 years ago
- Views:
Transcription
1 Brief Review of Fuctios of Several Variables
2 Differetiatio Differetiatio Recall, a fuctio f : R R is differetiable at x R if ( ) ( ) lim f x f x 0 exists df ( x) Whe this limit exists we call it or f( x). dx Now, whe f : R R what do we mea by differetiability at x R? NOE : whe f : R R we ca restate the above defiitio as follows: f is differetiable at x R if there is a umber, ( x), so that f( x ) f( x) ( x) lim 0 0 ad, clearly, ( x) f( x). 2
3 Differetiatio he -dimesioal aalogue follows. Def : he fuctio f : R R is said to be differetiable at x R if there is a vector η( x) (-dimesioal of course) so that f( xh) f( x) η ( xh ) lim 0 h0 h where h is a -vector ad η ( xh ) deotes the ier product of these two vectors. HW9 : Show that if f : R R is differetiable at x the η( x) is uique. 3
4 Partial Derivatives Partial Derivatives Def : f : R R is said to have a partial derivative at x with respect to xi if lim 0 f i ( xe ) f( x) e i i exists. (ote : e ) i where e ( ) i the i-th locatio; the i-th uit vector Equivaletly, we may say f : R R has a partial derivative at x with respect to x if there is a umber ( x) so that i i f( xe ) f( x) i ( x) lim 0 0 f ( x) (of course, we the write i ( x) ) x i i 4
5 Partial Derivatives Fact : If f : R R is differetiable at x the f has partial derivatives at x i Proof : Sice f is differetiable at x the, o matter how the vectors h approach 0, we have that there is a vector η( x) so that f( xh) f( x) η ( xh ) lim 0 h0 h i herefore, let these h vectors be of the form h( ) e ad the h( ) 0 as 0. he i i f( xe ) f( x) i ( x) e lim 0 0 implies, by uiqueess, that ( x) η ( xe ) i. i 5
6 Partial Derivatives, Gradiets f ( x) Sice i ( x ), this shows that the i-th compoet of η( x) is, i xi f ( x) fact,, the i-th partial derivative at x. herefore, i what follows we xi will replace η( x) with f( x) f( x) f ( x) f ( x) x x2 x the vector of partial derivatives (sometimes called the gradiet vector at x ). 6
7 Directioal Derivatives 2 HW0 : Cosider the fuctio f : R R defied as follows: f( x, x ) 2 3 x 2 2, if x 0, or x2 0 x x2 0, if x x2 0 Show that f has partial derivatives at x (0,0) but that f is ot differetiable at x. Directioal Derivatives Let f : R R Def : f is said to be differetiable at x i the directio d if ( ) ( ) lim f xd f x d 0 exists 7
8 Directioal Derivatives Whe this limit exists, we will write it as D() x which is said to be a directioal derivative i the directio d. i f ( x) [Note : Whe d e, we have D() d x ] x d i d x xd for 0 Fact 2 : Let f : R R be differetiable at x. Let d 0 be ay directio. he, D() x d f ( x) d d 8
9 0 Directioal Derivatives Proof : Sice f is differetiable at x we kow that f( xh) f( x) f( x) h lim 0 h0 h o matter how the vectors h approach 0. Now let h( ) d; the h 0 as 0. herefore, f( xd) f( x) f( x) d lim 0 d or, equivaletly, f( xd) f( x) D d( x) d lim 0 d 0 herefore, by uiqueess, we must have f ( x) d D d( x) d 9
10 aylor s heorem aylor s heorem for f : R R Recall, aylor s heorem (for f : R R ) : Let f : R R have a - th derivative ad assume the (-)-st derivative is cotiuous. Let x x. he there exists a [0,] so that x x ( xx ) ad k ( k) ( xx ) ( ) ( xx ) f( x) f( x ) f ( x ) f ( x) k!! k We ow wat to derive some form of this result for fuctios of several variables, f : R R aylor s st ad 2 d order results i R : Let f : R R have cotiuous st partial derivatives. he, for ay two poits x, x so that x x, there exists a [0,] so that (i) f( x) f( x ) f x( ) x ( xx ) 0
11 aylor s heorem [NOE : For two vectors x, x, the lie through these two poits is y R, y = x( x he lie segmet joiig these two poits is y 0,, y = x( x x x x x
12 aylor s heorem ad if, i additio, has cotiuous 2d partials, f f x f x f x xx xx Hx x xx 2 (ii) ( ) ( ) ( ) ( ) ( ) ( ) ( ) where H( z) is the Hessia matrix for f, evaluated at z. hat is H( z) f ( z) f ( z) f ( z) 2 z zz2 zz f ( z) f ( z) f ( z) 2 z z zz2 z 2
13 Proof : aylor s heorem (i) Let g( f x( ) x for [0,]. he g() f( x) ad g(0) f( x ). Usig aylor s heorem o R we get or, by the Chai rule, g() g(0) g'( f( x) f( x ) f x( ) x ( xx ) 3
14 (ii) (Recall, by cotiuity we have aylor s heorem 2 2 f( x) f( x) x x x x i j j i i.e., Hx ( ) is a symmetric matrix.) Usig aylor s heorem o we have g() g(0) g'(0 g''( 2 for some [0,], or, by the chai rule, f x f x f x xx xx Hx x xx 2 ( ) ( ) ( ) ( ) ( ) ( ) ( ) R 4
15 Approximatio Usig aylor s Series Defiitio : For a differetiable fuctio f : R R the first order approximatio at x is defied to be f ( x ) f( x ) ( xx ) Defiitio : For f : R R with cotiuous 2d partials, the secod order approximatio at x is defied to be f ( x ) f( x ) ( xx ) ( xx ) H( x )( xx ) 2 5
16 Necessary Coditios for Local Miima Cosider the optimizatio problem mi f ( x ) xf (P) where f : R R, F R Defiitio : (feasible directio) : he vector d R, d 0, is said to be a feasible directio at x F if there is a umber 0 so that the vector x d F for all [0, ] 6
17 Necessary Coditios for Local Miima We let DxF ( ; ) deote the set of feasible directios at x F. heorem 4 : (st order ecessary coditio (FONC) for local miimum): Let F R ad let f : R R be differetiable. If x F is a local miimum the, for all d D x F ( ; ) we must have f x d ( ) 0 7
18 Necessary Coditios for Local Miima Proof : If there is a d D( x ; F) so that 0 f ( x ) d we must the have ( x d ) ( x ) 0 lim f f 0 0 so that f( x d ) f( x ) for all [0, ]. But d D( x ; F) 0 so that x d F all [0, ]. Let ad we the have f( x d) f( x ) all [0, ˆ ] x dfx ot a local miimum. ˆ mi {, } ad such 8
19 Necessary Coditios for Local Miima Corollary : If x it F, the f ( x ) 0. Proof : x it F D( x ; F) R 0. f ( x ) d0, for all d 0 f ( x ) 0. HW : Show whether or ot (for x F ) f ( x ) d 0, for all d D x F ( ; ) implies x is a local miimum. 9
20 Necessary Coditios for Local Miima heorem 5 : (2d order ecessary coditios for local miimum (SONC)) Let f : R R have cotiuous 2d partials ad let x F be a local miimum. he for ay d D( x ; F) we have (i) f ( x ) d 0 ad (ii) if f ( x ) d 0, the dhx ( ) d 0. Proof : (i) is just a restatemet of heorem 4. herefore, assume d D( x ; F) By aylor s heorem, is such that f ( x ) d 0. Let x( x d for 0. f( x( f( x ) f( x ) d d H( x d ) d
21 Necessary Coditios for Local Miima Now, if d H( x ) d 0 we see, by cotiuity of the secod partials, there exists a ˆ so that d H( x d ) d 0 for all [0, ˆ ], ad the, for such s, f( x( f( x ). But, agai, d D( x ; F) there is a so that x d F for all [0, ]. By lettig mi ˆ we see that x caot be a local miimum. Corollary : Let x be a iterior poit of F. he, (i) f ( ) x 0 ad for all (ii) dhx ( ) d 0 d R (i.e., Hx ( ) is a positive semi-defiite matrix which we abbreviate as PSD). 2
22 Proof : Necessary Coditios for Local Miima Dx F ( ; ) R 0 Defiitio : A matrix A is said to be positive semi-defiite (PSD) if for all x R xax 0. A matrix A is said to be positive defiite if for all x R, x 0, xax 0 A matrix A is said to be egative semi-defiite (NSD) if A is PSD (i.e., for all x R, xax 0 ). A matrix A is said to be egative defiite (ND) if A is PD (i.e., for all x R, x 0, xax0). 22
23 Necessary Coditios for Local Miima [Note : he corollary of heorem 5 states that if x it F is a local miimum for mi f ( x), the f ( x ) 0 ad Hx ( ) is PSD.] xf HW2 : Show whether the followig is true. If x F is such f ( ) x 0 that ad Hx ( ) is PSD the x is a local miimum. HW3 : Costruct a simple example to show that whe a local miimum is o the boudary of F the it may be that Hx ( ) is ot PSD. x 23
24 Sufficiet Coditios for Local Miima Defiitio : x F is a strict local miimum for mi f ( x) if there is a xf 0 so that for all x F N( x, ), x x, we have f( x) f( x) heorem 6 : (2 d order sufficiet coditio for local miimum) Let f : R R have cotiuous 2 d partials ad let x F. If (i) f ( ) x 0 ad (ii) Hx ( ) is PD. the x is a strict local miimum. 24
25 Sufficiet Coditios for Local Miima Proof : Suppose x is ot a strict local miimum. he for all 0 there is a x FN( x, ) so that f( x ) f( x ). Let k for k, k k k iteger-valued. he f( x ) f( x ) for all k, where x x. By aylor s heorem, for each k, f x f x x x H x x x x 2 k k k k ( ) ( ) ( ) ( k ( k) )( ) for some k [0, ].herefore, for each k, k k k ( x x ) H( k x ( k) x )( x x ) 0 k ad this implies that Hx ( ) caot be PD. 25
26 Sufficiet Coditios for Local Miima HW4 : Show this latter claim. HW5 : Costruct a example where a iterior poit it F is a strict local miimum but Hx ( ) is PSD ad ot PD. (i.e, the coditios of heorem 6 are ot ecessary for a strict local Miimum). x 26
27 Brief Review of Quadratic Forms Recall, for fuctios f : R R with cotiuous secod partials, we have 2 2 f( x) f( x) x x x x i j j i ad, therefore, Hx ( ) H ( x) (i.e., the Hessia matrix is symmetric). HW6 : (a) If A is PD show that a 0, i,,. (a) If A is PSD show that a 0, i,,. ii ii HW7 : Let A be PD. Show that A is a osigular matrix 27
28 Brief Review of Quadratic Forms Note: xax i j xa x i ij j 2 ax ii i axx ij i j i i ji if A is also symmetric, we may write 2 ax ii i 2 xax i ij j i i ji xax Example : Let A a a a 2 a 2 22 ad A 2 2 he. xax a x 2a x x a x Now, assume a 0. he A 28
29 Brief Review of Quadratic Forms xax a x a 2 x x a x a a 2 2 a a a a x x x a a a a x x x 2 2 a 2 aa22 a a a 29
30 Brief Review of Quadratic Forms 2 Now, if a ad A a a a we see that xax0for all 0 x 0. hat is, for a 2 x 2 symmetric matrix we see that a sufficiet coditio for A to be PD is that a, A 0. We ow show that this coditio is also ecessary. Sice A 0.Now, a 0 2 a A 2 2 a x x2 x2 a a xax (HW6) we eed oly show a2 if A 0 choose x x, x2 as follows : x2, x x2. he a A xax 0, x 0, ad A is ot PD ; cotradictio. a 30
31 Brief Review of Quadratic Forms he above motivates the ext heorem which we state without proof. heorem 7 : Let A be a matrix which is also symmetric (i.e., A A ). he is PD if, ad oly if, a a a 2 3 a a a2 a22 a3 a23 a33 a 0, 0, a a a 0,..., A 0, ad therefore (sice A ( ) A ), A is ND if, ad oly if, a a a 2 3 a a a2 a22 a3 a23 a33 a 0, 0, a a a 0,..., ( ) A 0 3
32 Brief Review of Quadratic Forms HW8 : Let A be a matrix which is PSD. For each 0 0 defie A( ) AI, where I. Show that A( ) is PD. 0 As a result of HW8, we have the followig Corollary to heorem 7 whe A is also symmetric. 32
33 Brief Review of Quadratic Forms Corollary : If A is a symmetric matrix which is also PSD the a a a a 0, 0, a a a 0,..., A a a a2 a22 a3 a23 a33 Proof : Sice A( ) ( ( )) is PD we must have a ij a a a A a a 2 0, 0,, ( ) But the determiat is a cotiuous fuctio of the elemets of the matrix ad, therefore, by lettig 0 we have a a a 2 0, 0,, A 0 a a
34 Brief Review of Quadratic Forms HW9 : Provide a simple example of a symmetric matrix with the above property which is also ot PSD. Note : Let A be a matrix ad defie the quadratic fuctio Q : R R by Q( x) x Ax he Q( x) 0 for all x 0 A is PD ad similarly for PSD, ND, ad NSD. I fact, this is the motivatio for the term positive defiite. hat is, if Q( x) is positive, we say A is PD ad coversely. 34
35 Brief Review of Quadratic Forms Also ote that whe we are talkig about quadratic forms Q( x) x Ax we may assume, without loss of geerality, that A is symmetric. I particular, if A is ot symmetric, we may replace A by A ˆ ( AA 2 ) ad we see that Q( x) Qˆ( x) xax ˆ for all x R, ad  is symmetric. 35
36 Brief Review of Quadratic Forms So far we have developed a ecessary ad sufficiet coditio for a symmetric matrix A to be PD (ND); but we have developed oly a ecessary coditio for a symmetric matrix A to be PSD (NSD). We therefore ow sketch a coditio which is both ecessary ad sufficiet for a symmetric matrix to be PSD. We first proceed somewhat abstractly as follows: Let A be a matrix. Assume there is a matrix B so that B B 36
37 Brief Review of Quadratic Forms (i.e., is a orthogoal matrix) ad there is a -vector so that B AB λi λ,, Now, for ay x R defie y B x. he ( ) - 2 iyi i xax By ABy ybaby ybaby y(λi)y x 0 We therefore see that, xax0, all if, ad oly if, Similarly, we see that xax0, all x 0 if, ad oly if, i i 0, 0 i,, i,, HW20 : Prove this last claim We ow eed to discuss the existece of such a matrix B ad such a vector λ. 37
38 Brief Review of Quadratic Forms,,..., HW2 : Let 2 be distict eigevalues of the symmetric i j matrix A. Let x ad x be eigevectors associated with ad i j, i j. i j Show that ( x ) x 0. herefore, if we ormalize the eigevectors x,..., x i ( i.e., x ) we the get ( usig the Euclidea orm ) where ij ( x ) x i j ij, i j 0, i j Now show that x,, x are liearly idepedet (ad therefore B= [ x,, x ] is a orthoormal basis for R ). Now show that B =B ad B AB λi. 38
39 Brief Review of Quadratic Forms Now coclude that A is PD (PSD) if, ad oly if, all eigevalues of A are positive (oegative) ad, A is ND (NSD) if, ad oly if, all the eigevalues of A are egative (opositive). Also, what happes to the above if ot all eigevalues are distict? HW22 : Provide a example which shows that a osymmetric matrix may have oegative eigevalues ad A is ot PSD. A heorem 6 provided a sufficiet coditio for a poit x to be a strict local miimum. I particular it is required i that theorem that H(x ) be PD. he above results o PD, PSD, etc., provided coditios uder which, i some cases, H(x ) ca be checked for PD. However, there is a stregtheig of the hypotheses of heorem 6 which is sufficiet for x to be a local miimum (ot ecessarily strict) but this hypothesis is seldom checkable. 39
40 Brief Review of Quadratic Forms HW23 : Let have cotiuous d f : R R 2 partials ad let x F. If (i) f ( x ) 0 ad (ii) H(x) is PSD o some eighborhood of x the x is a local miimum. [ Note: H(x) PSD o some eighborhood of x meas ε > 0, for all x N( x, ε) the matrix H(x) is PSD.] 40
41 Itroductio to Covexity Perhaps the most importat aalytic tool i the theory of optimizatio is the otio of covexity. his cocept is so fudametal that a good deal of time must be spet o this subject i order to fully appreciate the structure of optimizatio problems ad associated results. I what follows we use the followig otatio: Let x, x R. We defie ad [ xx, ] { y [0,] yx( ) x} ( xx, ) { y (0,) yx( ) x} Note that [ xx, ] [ xx, ] ad ( xx, ) ( xx, ). Defiitio : A set 2 C R is covex if for all x, x C. We also have 2 [, ] x x C 4
42 Itroductio to Covexity Defiitio : Let C R be a covex set ( C ). A fuctio f : C R is 2 covex if for all x, x C, we have for all [0,]. f f f 2 2 ( x ( ) x ) ( x ) ( ) ( x ) Defiitio : Let C be a covex subset of R. f : C R is cocave 2 if f is covex. hat is, for all, x, x C for all [0,]. f f f 2 2 ( x ( ) x ) ( x ) ( ) ( x ) Defiitio : Let C, C R, C covex. f : C R is strictly 2 covex if for all x, x C, x x 2, f f f 2 2 ( x ( ) x ) ( x ) ( ) ( x ) for all (0,). 42
43 Itroductio to Covexity HW24 : (here are o local miima which are ot global miima). Let C R be covex ad let f : C R be covex. If x is a local miimum for mi f ( x) the x is a global miimum. he level sets of covex fuctios have a importat property. xc heorem 8 : Let be covex, C R. Let f : C R be covex. he is covex for all C α R L (α) = { xc f ( x) α } f 43
44 Itroductio to Covexity 2 i Proof : Let α R ad let x, x L f (α). he f( x ) α, i, 2. 2 he, for [0, ], we have f( x ) ( ) f( x ) α ( )αα But, by covexity of f, we the have f 2 2 ( x ( ) x ) α x ( ) x L f (α) Note : he above shows that if f is cocave o C, the { xc f ( x) α } is covex for all α R. Note : A ocovex fuctio may have L (α) covex for all Proof : f α R. C [0, ) L (α) f 44
45 Itroductio to Covexity Defiitio : Let C R, C ad covex. Let f : C R. he lower epigraph of f is defied to be G f { ( x,α) CR f ( x) α } he upper epigraph is defied with the iequality reversed. heorem 9 : (relative covex sets ad fuctios). Let C R, C, covex, ad let f : C R. he f is covex if, ad oly if, the lower epigraph of f is a covex set. C 2 2 i Proof : Assume f is covex ad let ( x,α ), ( x,α ) G f. he, f ( x ) α i, 2 ad the 2 2 λ f( x ) (λ) f( x ) λ α (λ)α, λ [0,] i But covexity of f implies f(λ x (λ) x ) λ f( x ) (λ) f( x ) λ α (λ)α ( x ( ) x, ( ) ) G f 45
46 Itroductio to Covexity G f is covex. Now assume f is ot covex. he there exists 2 vectors x, x C, x x 2, ad (0,) so that f f f 2 2 ( x ( ) x ) ( x ) ( ) ( x ) Defie f ( x ) ad f ( x ). he ( x, ) G, but f ( x, ) G f 2 2 ( ( ), ( ) ) G f x x G f ot covex Above, we showed there are ocovex fuctios so that L is covex f ( ) for all R. Such fuctios have a ame Defiitio : Let C R, C, C covex. A fuctio f : C R is said to be quasi-covex if L ( ) is covex for all R. f 46
47 Itroductio to Covexity HW25 : Let C ad covex ad let f : C R. Show that f is quasicovex if, ad oly if, the followig property holds: For all x, x C ad all 2 [0,] f f f 2 2 ( x ( ) x ) max { ( x ), ( x )} [ Note : f is quasi-cocave o C covex if f is quasi-covex; i.e., { xc f ( x) } is covex for all R. herefore, the above HW states that f is quasi-cocave if, ad oly if, f f f 2 2 ( x ( ) x ) mi { ( x ), ( x )} HW26 : (simple facts about covexity) (a) Let f ad be two covex fuctios o a covex set C. Show that f 2f2is covex o C if. 0, 2 0 (b) he itersectio of ay collectio of covex sets, i R, is also covex. 47
48 C Itroductio to Covexity C (c) Let, C R. he is covex if, ad oly if, the followig 2 k coditio holds: For ay iteger k, let x, x,, x be members of ad let, 2,, k be k oegative umbers so that i. he j x x C j (d) Let, C C R, C covex. Let f : C R. he f is covex if, 2 k ad oly if, the followig holds: For ay iteger k, let x, x,, x be i C ad let be oegative umbers so that. he, 2,, k (e) Let, C C R, C covex. Let f : C R. he f is quasi-covex if, ad oly if, the followig property holds: For ay iteger k, let 2 x, x,, x k C ad let be oegative umbers so that, 2,, k. he k i 2 k f( ix ) max { f( x ), f( x ),, f( x )} i i f k k i i x i i i ( ) f( x ) i i C 48
49 Itroductio to Covexity A importat applicatio of covexity is the characterizatio of the set of feasible directios. Let C R be covex ad let xc. We wish to characterize DxC (, ). I the first place, let yc, y x. he y x is a feasible directio sice, by covexity of C, x ( yx) C for all [0,]. herefore, { y x yc, y x } D( x, C) O the other had, let dd( x, C). he there is a 0 so that xdc for all [0, ]. Defie y xd, the yc ad yx d which says the feasible directio d is proportioal to some y x where yc. Note also that sice oly directio is importat, there is essetially o differece betwee the directio d ad the directio d for all 0. herefore, we may state the followig 49
50 Itroductio to Covexity heorem 0 : Let C, C covex, C R. Let. he, the set of feasible directios at x, DxC (, ), may be take to be { y x yc, y x } HW27 : Is the followig true: Let C be a oempty covex subset of R ad let f : C R be quasi-covex. Let x C be a local miimum. he x is a global miimum for mi f ( x)? C xc Defiitio : Let ad covex. f : C R is strictly quasi-covex if 2 2 for all x, x C so that f( x ) f( x ), we also have f x x f x f x 2 2 ( ( ) ) max { ( ), ( )} HW28 : Let x be a local miimum for mi f ( ) where is covex ad xc is strictly quasi-covex. Show that x is a global miimum x C x C f 50
51 Itroductio to Covexity HW29 : Is a covex fuctio also strictly quasi-covex? Is a quasi-covex fuctio also strictly quasi-covex? Is a strictly quasi-covex fuctio also quasi-covex? Is a strictly covex fuctio also strictly quasi-covex? C HW30 : Let, C covex, ad let f : C R be quasi-covex. If is a strict local miimum the x is a global miimum (i fact, a uique global miimum). x C 5
Differentiable Convex Functions
Differetiable Covex Fuctios The followig picture motivates Theorem 11. f ( x) f ( x) f '( x)( x x) ˆx x 1 Theorem 11 : Let f : R R be differetiable. The, f is covex o the covex set C R if, ad oly if for
More informationChapter 3 Inner Product Spaces. Hilbert Spaces
Chapter 3 Ier Product Spaces. Hilbert Spaces 3. Ier Product Spaces. Hilbert Spaces 3.- Defiitio. A ier product space is a vector space X with a ier product defied o X. A Hilbert space is a complete ier
More informationb i u x i U a i j u x i u x j
M ath 5 2 7 Fall 2 0 0 9 L ecture 1 9 N ov. 1 6, 2 0 0 9 ) S ecod- Order Elliptic Equatios: Weak S olutios 1. Defiitios. I this ad the followig two lectures we will study the boudary value problem Here
More informationSequences and Series of Functions
Chapter 6 Sequeces ad Series of Fuctios 6.1. Covergece of a Sequece of Fuctios Poitwise Covergece. Defiitio 6.1. Let, for each N, fuctio f : A R be defied. If, for each x A, the sequece (f (x)) coverges
More informationIntroduction to Optimization Techniques
Itroductio to Optimizatio Techiques Basic Cocepts of Aalysis - Real Aalysis, Fuctioal Aalysis 1 Basic Cocepts of Aalysis Liear Vector Spaces Defiitio: A vector space X is a set of elemets called vectors
More informationMath Solutions to homework 6
Math 175 - Solutios to homework 6 Cédric De Groote November 16, 2017 Problem 1 (8.11 i the book): Let K be a compact Hermitia operator o a Hilbert space H ad let the kerel of K be {0}. Show that there
More informationHomework Set #3 - Solutions
EE 15 - Applicatios of Covex Optimizatio i Sigal Processig ad Commuicatios Dr. Adre Tkaceko JPL Third Term 11-1 Homework Set #3 - Solutios 1. a) Note that x is closer to x tha to x l i the Euclidea orm
More informationConvergence of random variables. (telegram style notes) P.J.C. Spreij
Covergece of radom variables (telegram style otes).j.c. Spreij this versio: September 6, 2005 Itroductio As we kow, radom variables are by defiitio measurable fuctios o some uderlyig measurable space
More informationPAPER : IIT-JAM 2010
MATHEMATICS-MA (CODE A) Q.-Q.5: Oly oe optio is correct for each questio. Each questio carries (+6) marks for correct aswer ad ( ) marks for icorrect aswer.. Which of the followig coditios does NOT esure
More informationlim za n n = z lim a n n.
Lecture 6 Sequeces ad Series Defiitio 1 By a sequece i a set A, we mea a mappig f : N A. It is customary to deote a sequece f by {s } where, s := f(). A sequece {z } of (complex) umbers is said to be coverget
More informationReal Numbers R ) - LUB(B) may or may not belong to B. (Ex; B= { y: y = 1 x, - Note that A B LUB( A) LUB( B)
Real Numbers The least upper boud - Let B be ay subset of R B is bouded above if there is a k R such that x k for all x B - A real umber, k R is a uique least upper boud of B, ie k = LUB(B), if () k is
More information6 Integers Modulo n. integer k can be written as k = qn + r, with q,r, 0 r b. So any integer.
6 Itegers Modulo I Example 2.3(e), we have defied the cogruece of two itegers a,b with respect to a modulus. Let us recall that a b (mod ) meas a b. We have proved that cogruece is a equivalece relatio
More informationMath 61CM - Solutions to homework 3
Math 6CM - Solutios to homework 3 Cédric De Groote October 2 th, 208 Problem : Let F be a field, m 0 a fixed oegative iteger ad let V = {a 0 + a x + + a m x m a 0,, a m F} be the vector space cosistig
More informationMath 220B Final Exam Solutions March 18, 2002
Math 0B Fial Exam Solutios March 18, 00 1. (1 poits) (a) (6 poits) Fid the Gree s fuctio for the tilted half-plae {(x 1, x ) R : x 1 + x > 0}. For x (x 1, x ), y (y 1, y ), express your Gree s fuctio G(x,
More informationSupplemental Material: Proofs
Proof to Theorem Supplemetal Material: Proofs Proof. Let be the miimal umber of traiig items to esure a uique solutio θ. First cosider the case. It happes if ad oly if θ ad Rak(A) d, which is a special
More informationLecture Notes for Analysis Class
Lecture Notes for Aalysis Class Topological Spaces A topology for a set X is a collectio T of subsets of X such that: (a) X ad the empty set are i T (b) Uios of elemets of T are i T (c) Fiite itersectios
More informationACO Comprehensive Exam 9 October 2007 Student code A. 1. Graph Theory
1. Graph Theory Prove that there exist o simple plaar triagulatio T ad two distict adjacet vertices x, y V (T ) such that x ad y are the oly vertices of T of odd degree. Do ot use the Four-Color Theorem.
More information2 Banach spaces and Hilbert spaces
2 Baach spaces ad Hilbert spaces Tryig to do aalysis i the ratioal umbers is difficult for example cosider the set {x Q : x 2 2}. This set is o-empty ad bouded above but does ot have a least upper boud
More informationCHAPTER 5. Theory and Solution Using Matrix Techniques
A SERIES OF CLASS NOTES FOR 2005-2006 TO INTRODUCE LINEAR AND NONLINEAR PROBLEMS TO ENGINEERS, SCIENTISTS, AND APPLIED MATHEMATICIANS DE CLASS NOTES 3 A COLLECTION OF HANDOUTS ON SYSTEMS OF ORDINARY DIFFERENTIAL
More informationDefinition 4.2. (a) A sequence {x n } in a Banach space X is a basis for X if. unique scalars a n (x) such that x = n. a n (x) x n. (4.
4. BASES I BAACH SPACES 39 4. BASES I BAACH SPACES Sice a Baach space X is a vector space, it must possess a Hamel, or vector space, basis, i.e., a subset {x γ } γ Γ whose fiite liear spa is all of X ad
More information( ) (( ) ) ANSWERS TO EXERCISES IN APPENDIX B. Section B.1 VECTORS AND SETS. Exercise B.1-1: Convex sets. are convex, , hence. and. (a) Let.
Joh Riley 8 Jue 03 ANSWERS TO EXERCISES IN APPENDIX B Sectio B VECTORS AND SETS Exercise B-: Covex sets (a) Let 0 x, x X, X, hece 0 x, x X ad 0 x, x X Sice X ad X are covex, x X ad x X The x X X, which
More informationOptimization Methods MIT 2.098/6.255/ Final exam
Optimizatio Methods MIT 2.098/6.255/15.093 Fial exam Date Give: December 19th, 2006 P1. [30 pts] Classify the followig statemets as true or false. All aswers must be well-justified, either through a short
More informationChapter 6 Infinite Series
Chapter 6 Ifiite Series I the previous chapter we cosidered itegrals which were improper i the sese that the iterval of itegratio was ubouded. I this chapter we are goig to discuss a topic which is somewhat
More informationProduct measures, Tonelli s and Fubini s theorems For use in MAT3400/4400, autumn 2014 Nadia S. Larsen. Version of 13 October 2014.
Product measures, Toelli s ad Fubii s theorems For use i MAT3400/4400, autum 2014 Nadia S. Larse Versio of 13 October 2014. 1. Costructio of the product measure The purpose of these otes is to preset the
More informationCHAPTER 5 SOME MINIMAX AND SADDLE POINT THEOREMS
CHAPTR 5 SOM MINIMA AND SADDL POINT THORMS 5. INTRODUCTION Fied poit theorems provide importat tools i game theory which are used to prove the equilibrium ad eistece theorems. For istace, the fied poit
More informationCommon Coupled Fixed Point of Mappings Satisfying Rational Inequalities in Ordered Complex Valued Generalized Metric Spaces
IOSR Joural of Mathematics (IOSR-JM) e-issn: 78-578, p-issn:319-765x Volume 10, Issue 3 Ver II (May-Ju 014), PP 69-77 Commo Coupled Fixed Poit of Mappigs Satisfyig Ratioal Iequalities i Ordered Complex
More informationLINEAR PROGRAMMING II
LINEAR PROGRAMMING II Patrik Forssé Office: 2404 Phoe: 08/47 29 66 E-mail: patrik@tdb.uu.se HE LINEAR PROGRAMMING PROBLEM (LP) A LP-problem ca be formulated as: mi c subject a + am + g + g p + + + c to
More information2.1. The Algebraic and Order Properties of R Definition. A binary operation on a set F is a function B : F F! F.
CHAPTER 2 The Real Numbers 2.. The Algebraic ad Order Properties of R Defiitio. A biary operatio o a set F is a fuctio B : F F! F. For the biary operatios of + ad, we replace B(a, b) by a + b ad a b, respectively.
More informationIf a subset E of R contains no open interval, is it of zero measure? For instance, is the set of irrationals in [0, 1] is of measure zero?
2 Lebesgue Measure I Chapter 1 we defied the cocept of a set of measure zero, ad we have observed that every coutable set is of measure zero. Here are some atural questios: If a subset E of R cotais a
More information16 Riemann Sums and Integrals
16 Riema Sums ad Itegrals Defiitio: A partitio P of a closed iterval [a, b], (b >a)isasetof 1 distict poits x i (a, b) togetherwitha = x 0 ad b = x, together with the covetio that i>j x i >x j. Defiitio:
More informationChapter 2. Periodic points of toral. automorphisms. 2.1 General introduction
Chapter 2 Periodic poits of toral automorphisms 2.1 Geeral itroductio The automorphisms of the two-dimesioal torus are rich mathematical objects possessig iterestig geometric, algebraic, topological ad
More information6.3 Testing Series With Positive Terms
6.3. TESTING SERIES WITH POSITIVE TERMS 307 6.3 Testig Series With Positive Terms 6.3. Review of what is kow up to ow I theory, testig a series a i for covergece amouts to fidig the i= sequece of partial
More informationMathematical Foundations -1- Sets and Sequences. Sets and Sequences
Mathematical Foudatios -1- Sets ad Sequeces Sets ad Sequeces Methods of proof 2 Sets ad vectors 13 Plaes ad hyperplaes 18 Liearly idepedet vectors, vector spaces 2 Covex combiatios of vectors 21 eighborhoods,
More information1. By using truth tables prove that, for all statements P and Q, the statement
Author: Satiago Salazar Problems I: Mathematical Statemets ad Proofs. By usig truth tables prove that, for all statemets P ad Q, the statemet P Q ad its cotrapositive ot Q (ot P) are equivalet. I example.2.3
More informationSingular value decomposition. Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaine
Lecture 11 Sigular value decompositio Mathématiques appliquées (MATH0504-1) B. Dewals, Ch. Geuzaie V1.2 07/12/2018 1 Sigular value decompositio (SVD) at a glace Motivatio: the image of the uit sphere S
More information(A sequence also can be thought of as the list of function values attained for a function f :ℵ X, where f (n) = x n for n 1.) x 1 x N +k x N +4 x 3
MATH 337 Sequeces Dr. Neal, WKU Let X be a metric space with distace fuctio d. We shall defie the geeral cocept of sequece ad limit i a metric space, the apply the results i particular to some special
More informationChapter Vectors
Chapter 4. Vectors fter readig this chapter you should be able to:. defie a vector. add ad subtract vectors. fid liear combiatios of vectors ad their relatioship to a set of equatios 4. explai what it
More informationPRACTICE FINAL/STUDY GUIDE SOLUTIONS
Last edited December 9, 03 at 4:33pm) Feel free to sed me ay feedback, icludig commets, typos, ad mathematical errors Problem Give the precise meaig of the followig statemets i) a f) L ii) a + f) L iii)
More informationPRELIM PROBLEM SOLUTIONS
PRELIM PROBLEM SOLUTIONS THE GRAD STUDENTS + KEN Cotets. Complex Aalysis Practice Problems 2. 2. Real Aalysis Practice Problems 2. 4 3. Algebra Practice Problems 2. 8. Complex Aalysis Practice Problems
More informationSingular Continuous Measures by Michael Pejic 5/14/10
Sigular Cotiuous Measures by Michael Peic 5/4/0 Prelimiaries Give a set X, a σ-algebra o X is a collectio of subsets of X that cotais X ad ad is closed uder complemetatio ad coutable uios hece, coutable
More informationState Space Representation
Optimal Cotrol, Guidace ad Estimatio Lecture 2 Overview of SS Approach ad Matrix heory Prof. Radhakat Padhi Dept. of Aerospace Egieerig Idia Istitute of Sciece - Bagalore State Space Represetatio Prof.
More informationIntroduction to Optimization Techniques. How to Solve Equations
Itroductio to Optimizatio Techiques How to Solve Equatios Iterative Methods of Optimizatio Iterative methods of optimizatio Solutio of the oliear equatios resultig form a optimizatio problem is usually
More informationAdvanced Analysis. Min Yan Department of Mathematics Hong Kong University of Science and Technology
Advaced Aalysis Mi Ya Departmet of Mathematics Hog Kog Uiversity of Sciece ad Techology September 3, 009 Cotets Limit ad Cotiuity 7 Limit of Sequece 8 Defiitio 8 Property 3 3 Ifiity ad Ifiitesimal 8 4
More informationMath 451: Euclidean and Non-Euclidean Geometry MWF 3pm, Gasson 204 Homework 3 Solutions
Math 451: Euclidea ad No-Euclidea Geometry MWF 3pm, Gasso 204 Homework 3 Solutios Exercises from 1.4 ad 1.5 of the otes: 4.3, 4.10, 4.12, 4.14, 4.15, 5.3, 5.4, 5.5 Exercise 4.3. Explai why Hp, q) = {x
More informationThe Borel hierarchy classifies subsets of the reals by their topological complexity. Another approach is to classify them by size.
Lecture 7: Measure ad Category The Borel hierarchy classifies subsets of the reals by their topological complexity. Aother approach is to classify them by size. Filters ad Ideals The most commo measure
More informationLecture 8: Convergence of transformations and law of large numbers
Lecture 8: Covergece of trasformatios ad law of large umbers Trasformatio ad covergece Trasformatio is a importat tool i statistics. If X coverges to X i some sese, we ofte eed to check whether g(x ) coverges
More informationALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES.
ALGEBRAIC GEOMETRY COURSE NOTES, LECTURE 5: SINGULARITIES. ANDREW SALCH 1. The Jacobia criterio for osigularity. You have probably oticed by ow that some poits o varieties are smooth i a sese somethig
More informationSeunghee Ye Ma 8: Week 5 Oct 28
Week 5 Summary I Sectio, we go over the Mea Value Theorem ad its applicatios. I Sectio 2, we will recap what we have covered so far this term. Topics Page Mea Value Theorem. Applicatios of the Mea Value
More informationLecture 19: Convergence
Lecture 19: Covergece Asymptotic approach I statistical aalysis or iferece, a key to the success of fidig a good procedure is beig able to fid some momets ad/or distributios of various statistics. I may
More informationRiemann Sums y = f (x)
Riema Sums Recall that we have previously discussed the area problem I its simplest form we ca state it this way: The Area Problem Let f be a cotiuous, o-egative fuctio o the closed iterval [a, b] Fid
More information5 Many points of continuity
Tel Aviv Uiversity, 2013 Measure ad category 40 5 May poits of cotiuity 5a Discotiuous derivatives.............. 40 5b Baire class 1 (classical)............... 42 5c Baire class 1 (moder)...............
More informationMath 220A Fall 2007 Homework #2. Will Garner A
Math 0A Fall 007 Homewor # Will Garer Pg 3 #: Show that {cis : a o-egative iteger} is dese i T = {z œ : z = }. For which values of q is {cis(q): a o-egative iteger} dese i T? To show that {cis : a o-egative
More information} is said to be a Cauchy sequence provided the following condition is true.
Math 4200, Fial Exam Review I. Itroductio to Proofs 1. Prove the Pythagorea theorem. 2. Show that 43 is a irratioal umber. II. Itroductio to Logic 1. Costruct a truth table for the statemet ( p ad ~ r
More informationMathematical Methods for Physics and Engineering
Mathematical Methods for Physics ad Egieerig Lecture otes Sergei V. Shabaov Departmet of Mathematics, Uiversity of Florida, Gaiesville, FL 326 USA CHAPTER The theory of covergece. Numerical sequeces..
More informationEigenvalues and Eigenvectors
5 Eigevalues ad Eigevectors 5.3 DIAGONALIZATION DIAGONALIZATION Example 1: Let. Fid a formula for A k, give that P 1 1 = 1 2 ad, where Solutio: The stadard formula for the iverse of a 2 2 matrix yields
More informationLesson 10: Limits and Continuity
www.scimsacademy.com Lesso 10: Limits ad Cotiuity SCIMS Academy 1 Limit of a fuctio The cocept of limit of a fuctio is cetral to all other cocepts i calculus (like cotiuity, derivative, defiite itegrals
More informationThe inverse eigenvalue problem for symmetric doubly stochastic matrices
Liear Algebra ad its Applicatios 379 (004) 77 83 www.elsevier.com/locate/laa The iverse eigevalue problem for symmetric doubly stochastic matrices Suk-Geu Hwag a,,, Sug-Soo Pyo b, a Departmet of Mathematics
More information5.1. The Rayleigh s quotient. Definition 49. Let A = A be a self-adjoint matrix. quotient is the function. R(x) = x,ax, for x = 0.
40 RODICA D. COSTIN 5. The Rayleigh s priciple ad the i priciple for the eigevalues of a self-adjoit matrix Eigevalues of self-adjoit matrices are easy to calculate. This sectio shows how this is doe usig
More informationIt is always the case that unions, intersections, complements, and set differences are preserved by the inverse image of a function.
MATH 532 Measurable Fuctios Dr. Neal, WKU Throughout, let ( X, F, µ) be a measure space ad let (!, F, P ) deote the special case of a probability space. We shall ow begi to study real-valued fuctios defied
More informationLecture 2. The Lovász Local Lemma
Staford Uiversity Sprig 208 Math 233A: No-costructive methods i combiatorics Istructor: Ja Vodrák Lecture date: Jauary 0, 208 Origial scribe: Apoorva Khare Lecture 2. The Lovász Local Lemma 2. Itroductio
More informationPROBLEM SET I (Suggested Solutions)
Eco3-Fall3 PROBLE SET I (Suggested Solutios). a) Cosider the followig: x x = x The quadratic form = T x x is the required oe i matrix form. Similarly, for the followig parts: x 5 b) x = = x c) x x x x
More informationAPPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS
APPLICATION OF YOUNG S INEQUALITY TO VOLUMES OF CONVEX SETS 1. Itroductio Let C be a bouded, covex subset of. Thus, by defiitio, with every two poits i the set, the lie segmet coectig these two poits is
More informationApply change-of-basis formula to rewrite x as a linear combination of eigenvectors v j.
Eigevalue-Eigevector Istructor: Nam Su Wag eigemcd Ay vector i real Euclidea space of dimesio ca be uiquely epressed as a liear combiatio of liearly idepedet vectors (ie, basis) g j, j,,, α g α g α g α
More information1 Introduction to reducing variance in Monte Carlo simulations
Copyright c 010 by Karl Sigma 1 Itroductio to reducig variace i Mote Carlo simulatios 11 Review of cofidece itervals for estimatig a mea I statistics, we estimate a ukow mea µ = E(X) of a distributio by
More informationNotes for Lecture 11
U.C. Berkeley CS78: Computatioal Complexity Hadout N Professor Luca Trevisa 3/4/008 Notes for Lecture Eigevalues, Expasio, ad Radom Walks As usual by ow, let G = (V, E) be a udirected d-regular graph with
More informationOn n-collinear elements and Riesz theorem
Available olie at www.tjsa.com J. Noliear Sci. Appl. 9 (206), 3066 3073 Research Article O -colliear elemets ad Riesz theorem Wasfi Shataawi a, Mihai Postolache b, a Departmet of Mathematics, Hashemite
More informationMatrix Algebra from a Statistician s Perspective BIOS 524/ Scalar multiple: ka
Matrix Algebra from a Statisticia s Perspective BIOS 524/546. Matrices... Basic Termiology a a A = ( aij ) deotes a m matrix of values. Whe =, this is a am a m colum vector. Whe m= this is a row vector..2.
More informationThe log-behavior of n p(n) and n p(n)/n
Ramauja J. 44 017, 81-99 The log-behavior of p ad p/ William Y.C. Che 1 ad Ke Y. Zheg 1 Ceter for Applied Mathematics Tiaji Uiversity Tiaji 0007, P. R. Chia Ceter for Combiatorics, LPMC Nakai Uivercity
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationSOLVED EXAMPLES
Prelimiaries Chapter PELIMINAIES Cocept of Divisibility: A o-zero iteger t is said to be a divisor of a iteger s if there is a iteger u such that s tu I this case we write t s (i) 6 as ca be writte as
More informationBETWEEN QUASICONVEX AND CONVEX SET-VALUED MAPPINGS. 1. Introduction. Throughout the paper we denote by X a linear space and by Y a topological linear
BETWEEN QUASICONVEX AND CONVEX SET-VALUED MAPPINGS Abstract. The aim of this paper is to give sufficiet coditios for a quasicovex setvalued mappig to be covex. I particular, we recover several kow characterizatios
More informationThe Method of Least Squares. To understand least squares fitting of data.
The Method of Least Squares KEY WORDS Curve fittig, least square GOAL To uderstad least squares fittig of data To uderstad the least squares solutio of icosistet systems of liear equatios 1 Motivatio Curve
More informationREAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS
REAL ANALYSIS II: PROBLEM SET 1 - SOLUTIONS 18th Feb, 016 Defiitio (Lipschitz fuctio). A fuctio f : R R is said to be Lipschitz if there exists a positive real umber c such that for ay x, y i the domai
More informationFUNDAMENTALS OF REAL ANALYSIS by
FUNDAMENTALS OF REAL ANALYSIS by Doğa Çömez Backgroud: All of Math 450/1 material. Namely: basic set theory, relatios ad PMI, structure of N, Z, Q ad R, basic properties of (cotiuous ad differetiable)
More informationTopics in Eigen-analysis
Topics i Eige-aalysis Li Zajiag 28 July 2014 Cotets 1 Termiology... 2 2 Some Basic Properties ad Results... 2 3 Eige-properties of Hermitia Matrices... 5 3.1 Basic Theorems... 5 3.2 Quadratic Forms & Noegative
More informationOn Random Line Segments in the Unit Square
O Radom Lie Segmets i the Uit Square Thomas A. Courtade Departmet of Electrical Egieerig Uiversity of Califoria Los Ageles, Califoria 90095 Email: tacourta@ee.ucla.edu I. INTRODUCTION Let Q = [0, 1] [0,
More informationInfinite Sequences and Series
Chapter 6 Ifiite Sequeces ad Series 6.1 Ifiite Sequeces 6.1.1 Elemetary Cocepts Simply speakig, a sequece is a ordered list of umbers writte: {a 1, a 2, a 3,...a, a +1,...} where the elemets a i represet
More informationMcGill University Math 354: Honors Analysis 3 Fall 2012 Solutions to selected problems
McGill Uiversity Math 354: Hoors Aalysis 3 Fall 212 Assigmet 3 Solutios to selected problems Problem 1. Lipschitz fuctios. Let Lip K be the set of all fuctios cotiuous fuctios o [, 1] satisfyig a Lipschitz
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More information1 Last time: similar and diagonalizable matrices
Last time: similar ad diagoalizable matrices Let be a positive iteger Suppose A is a matrix, v R, ad λ R Recall that v a eigevector for A with eigevalue λ if v ad Av λv, or equivaletly if v is a ozero
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationNotes 27 : Brownian motion: path properties
Notes 27 : Browia motio: path properties Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces:[Dur10, Sectio 8.1], [MP10, Sectio 1.1, 1.2, 1.3]. Recall: DEF 27.1 (Covariace) Let X = (X
More information1 Introduction. 1.1 Notation and Terminology
1 Itroductio You have already leared some cocepts of calculus such as limit of a sequece, limit, cotiuity, derivative, ad itegral of a fuctio etc. Real Aalysis studies them more rigorously usig a laguage
More informationA detailed proof of the irrationality of π
Matthew Straugh Math 4 Midterm A detailed proof of the irratioality of The proof is due to Iva Nive (1947) ad essetial to the proof are Lemmas ad 3 due to Charles Hermite (18 s) First let us itroduce some
More informationSeveral properties of new ellipsoids
Appl. Math. Mech. -Egl. Ed. 008 9(7):967 973 DOI 10.1007/s10483-008-0716-y c Shaghai Uiversity ad Spriger-Verlag 008 Applied Mathematics ad Mechaics (Eglish Editio) Several properties of ew ellipsoids
More informationOn Nonsingularity of Saddle Point Matrices. with Vectors of Ones
Iteratioal Joural of Algebra, Vol. 2, 2008, o. 4, 197-204 O Nosigularity of Saddle Poit Matrices with Vectors of Oes Tadeusz Ostrowski Istitute of Maagemet The State Vocatioal Uiversity -400 Gorzów, Polad
More informationSolutions to HW Assignment 1
Solutios to HW: 1 Course: Theory of Probability II Page: 1 of 6 Uiversity of Texas at Austi Solutios to HW Assigmet 1 Problem 1.1. Let Ω, F, {F } 0, P) be a filtered probability space ad T a stoppig time.
More informationΜια εισαγωγή στα Μαθηματικά για Οικονομολόγους
Μια εισαγωγή στα Μαθηματικά για Οικονομολόγους Κυρτά σύνολα (covex sets) στον S είναι κυρτό σύνολο εάν για κάθε 1 x S και 2 x S 1 2 tx t x S t [ ] + (1 ), 0,1 Μια συνάρτηση f : A B λέγεται 1-1 ή αμφιμονοσήμαντη,
More informationLecture 23: Minimal sufficiency
Lecture 23: Miimal sufficiecy Maximal reductio without loss of iformatio There are may sufficiet statistics for a give problem. I fact, X (the whole data set) is sufficiet. If T is a sufficiet statistic
More informationProperties of Fuzzy Length on Fuzzy Set
Ope Access Library Joural 206, Volume 3, e3068 ISSN Olie: 2333-972 ISSN Prit: 2333-9705 Properties of Fuzzy Legth o Fuzzy Set Jehad R Kider, Jaafar Imra Mousa Departmet of Mathematics ad Computer Applicatios,
More informationA Proof of Birkhoff s Ergodic Theorem
A Proof of Birkhoff s Ergodic Theorem Joseph Hora September 2, 205 Itroductio I Fall 203, I was learig the basics of ergodic theory, ad I came across this theorem. Oe of my supervisors, Athoy Quas, showed
More informationAppendix A. Nabla and Friends
Appedix A Nabla ad Frieds A1 Notatio for Derivatives The partial derivative u u(x + he i ) u(x) (x) = lim x i h h of a scalar fuctio u : R R is writte i short otatio as Similarly we have for the higher
More information1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.
.3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(
More informationNotes #3 Sequences Limit Theorems Monotone and Subsequences Bolzano-WeierstraßTheorem Limsup & Liminf of Sequences Cauchy Sequences and Completeness
Notes #3 Sequeces Limit Theorems Mootoe ad Subsequeces Bolzao-WeierstraßTheorem Limsup & Limif of Sequeces Cauchy Sequeces ad Completeess This sectio of otes focuses o some of the basics of sequeces of
More informationLecture 6: Integration and the Mean Value Theorem. slope =
Math 8 Istructor: Padraic Bartlett Lecture 6: Itegratio ad the Mea Value Theorem Week 6 Caltech 202 The Mea Value Theorem The Mea Value Theorem abbreviated MVT is the followig result: Theorem. Suppose
More informationEECS564 Estimation, Filtering, and Detection Hwk 2 Solns. Winter p θ (z) = (2θz + 1 θ), 0 z 1
EECS564 Estimatio, Filterig, ad Detectio Hwk 2 Sols. Witer 25 4. Let Z be a sigle observatio havig desity fuctio where. p (z) = (2z + ), z (a) Assumig that is a oradom parameter, fid ad plot the maximum
More informationIntroduction to Extreme Value Theory Laurens de Haan, ISM Japan, Erasmus University Rotterdam, NL University of Lisbon, PT
Itroductio to Extreme Value Theory Laures de Haa, ISM Japa, 202 Itroductio to Extreme Value Theory Laures de Haa Erasmus Uiversity Rotterdam, NL Uiversity of Lisbo, PT Itroductio to Extreme Value Theory
More informationMeasure and Measurable Functions
3 Measure ad Measurable Fuctios 3.1 Measure o a Arbitrary σ-algebra Recall from Chapter 2 that the set M of all Lebesgue measurable sets has the followig properties: R M, E M implies E c M, E M for N implies
More informationMATH 413 FINAL EXAM. f(x) f(y) M x y. x + 1 n
MATH 43 FINAL EXAM Math 43 fial exam, 3 May 28. The exam starts at 9: am ad you have 5 miutes. No textbooks or calculators may be used durig the exam. This exam is prited o both sides of the paper. Good
More information