Stochastic Structural Dynamics. Lecture-28. Monte Carlo simulation approach-4
|
|
- Austin Bell
- 5 years ago
- Views:
Transcription
1 Stochastic Structural Dyamics Lecture-8 Mote Carlo simulatio approach-4 Dr C S Maohar Departmet of Civil Egieerig Professor of Structural Egieerig Idia Istitute of Sciece Bagalore 56 Idia maohar@civil.iisc.eret.i
2 Recall Pseudoradom umber geerator Simulatio of radom variables Scalar/vector Gaussia/o-Gaussia Completely specified/partially specified Methods Trasformatio method Accept-Reject method
3 ourier represetatio of a Gaussia radom process Let X t be a zero mea, statioary, Gaussia radom process defied as X t a cos tb si t; Assumptios Here a ~,, b ~,, aa k, bb k ab k k,,,, k k, X t a cos t b si t 3 3
4 X t X t a cos tb si t a cos tb si t a cos t b si ta cos t b si t m RXX cos 4 4
5 ourier represetatio of a Gaussia radom process (cotiued) Cosider the psd fuctio S S XX R S cos XX R S cos XX 5 5
6 Compare this with R XX cos By choosig S two AC-s coicide., we see that the 6 6
7 By discretizig the psd fuctio as show we ca simulate samples of X( t) usig the ourier represetatio.5 cos si ; X t a t b t psd. Area S frequecy rad/s 7 7
8 Example Simulate samples of a zero mea statioary Gaussia radom process with followig properties: I S exp ; I ; 6 X t a cos t b si t i T 5 s; ; ;.53 rad/s max max rad/s. t.49 s 8
9 .4. cotiuous discrete..8 psd w rad/s 9
10 target measamples.5.5 a sample mea std dev target stdev x(t) time s
11 samples.9.8 simulatio target.7.6 PD x
12 x(t) time s
13 mu c u x k u x u u u x x Let y S I yy g b g b u I g g g g g b g b 4 g 4 g g g 4 g g ; 8 rad/s;.6 g g 3
14 Target Simulatio PSD (m/s ) /(rad/s) requecy rad/s 4
15 Accl m/s Time s 5
16 Simulatio ormal PD Probability R exp cos ; ; ; x x exp ; Accl m/s p X x 6
17 samples.5 Target ad Simulated PSD Simulatio5Target PSD requecy (rad/s) 7
18 Probability distributio fuctio of X(t).9.8 Target Simulatio.7.6 Probability Level 8
19 x(t) x(t) x(t) x(t) x(t) 5 Samples of the radom process X(t) Time (s) 9
20 Simulatio of partially specified o - Gaussia radom processes : ataf's trasformatio Let Xt ( ) be a radom process whose first order pdf ad the AC fuctios are available. o further iformatio about the process is available. X t eed ot be statioary. How to simulate samples of X( t)? t &. X t mx t Defie Y t so that Y t Y t X Itroduce a ew radom process Z(t) through the trasformatio Z t P Y t Y t Here PD of, radom variable. Z is a zero mea Gaussia radom process with a ukow covariace fuctio.
21 Z t P Y t Y Y t PY Z t * Y Y, ;, Y t Y t P z P z z z dzdz * XX t, t PY zp Y z z, z;, t, t dzdz Remarks * t t * t, t & t, t RHS is kow ad, is ot kow XX * z, z ;, t, t Steps * t Solve for t, t Simulate Z t Simulate Y ad hece X( t).
22 Probability distributio fuctio of X(t) R exp ; ;.833 ~.5,.5 p x U X Simulatio Target Probability Level
23 samples.35 Target ad Simulated PSD PSD..5.3 Target.5 Simulatio requecy (rad/s) 3
24 x(t) x(t) x(t) x(t) x(t).5 Samples of the radom process X(t)
25 Probability distributio fuctio of X(t).9.8 Probability R exp ; ; ;.768 Simulatio Target x x px x exp ; x x 5
26 Simulatio5samples Target ad Simulated PSD Target PSD - - requecy (rad/s) 6
27 x(t) x(t) x(t) x(t) x(t) 5 Samples of the radom process X(t)
28 Simulatio of vector Gaussia radom process t Let X t ad Y be two joitly statioary, zero mea Gaussia processes with R X t X t R Y t Y t ote: XY XY YY XX R X t Y t XY R X t Y t Y t X t R R X t Y t Y t X t R R R R XX YX R R XY YY YX YX 8
29 RXX SXX exp id; SXX RXX expid RYY SXX exp id; SYY RYY expid RXY SXY exp id; SXY RXY expid RYX SYX exp id; SYX RYX expid S XY XY i * exp exp XY ; S R i d R i d S XY XY YX YX 9
30 RXY SXY expid S i XY XY XY si ; RXY XY ixy cos isi d XY cos XY sid i XY si XY cosd R XY is real valued XY The above is true if XY cosd & XY XY XY XY 3
31 R sid cos XY XY XY & XY XY XY XY R cos si d XY XY XY 3
32 SXX lim XT XT T T * S lim YY YT YT T T * S lim XY XT YT T T * S lim YX YT XT T T S * S S XX YX S S XY YY 3
33 ourier represetatios X t a cos tb si t; Y t c cos td si t; k Assumptios a ~,, b ~,, aa k, bb k, ab k,,,, X t a cos t b si t k k k k k X X k k k X t X t X cos 33
34 Y t c cos td si t; k Assumptios k k k k k c ~,, d ~,, Y Y c c k, d d k, c d, k,,, k k k Y t c cos t d si t cos Y t Y t Y 34
35 X t a cos tb si t; Y t c cos td si t; k X t Y t acostbsitck cosk tdk sik t k k k k k k a cos t b si tc cos t d si t ac k k k k k k cos tcos t a d cos tsi t k k k bc si tcos t bd si tsi t k k k k 35
36 X t Y t k ac cos tcos t ad cos tsi t bc si tcos t bd si tsi t Take k k k k k k k k ac ; ad ; bc ; bd k ac k k ad k k bc k k bd k cos cos cos si R t t t t XY ac ad k bc si tcos t si tsi t k bd k urthermore, assume & ac bd ad bc cos si R XY ac ad 36
37 R R R cos XX X cos YY Y cos si 3 XY ac ad Cosider S S XX XX R XX SXX expid SXX cosd SXX cosd 37
38 R R cos XX X XX S YY YY SXX cos 4 SXX Select X so that RXX R XX Similarly defie S ad SYY select Y so that RYY R YY. 38
39 RXY SXY expid cos si XY ixy i d XY cos XY sid Cosider XY XY XY XY & 39
40 R cosd XY XY XY sid XY XY cos si Compare this with R cos si XY ac ad If we select ac R XY XY R XY & ad XY 4
41 Summary X t a cos tb si t; Y t c cos td si t; k k k k k k a ~,, b ~,, X X a a k, b b k, a b, k,,, k k k c ~,, d ~,, Y Y cc k, dd k, cd k,,,, k k k ac ; ad ; bc ; bd k ac k k ad k k bc k k bd k & ac bd ad bc 4
42 Summary (cotiued) X ac bc a b X bc ac ~, c ac bc Y d bc ac Y S S ; ; XX YY X Y ac XY & XY bc 4
43 Summary (cotiued) R R R XX X cos YY Y cos cos si XY ac ad 43
44 otes X t Y t Y t X t R R Y t X t R R R R cos si XY ac ad R YX R XY YX YX cos si XY ac ad XY XY 44
45 Exercise : Simulatio of spatially varyig earthquake groud acceleratio Cosider X t ad Y( t) to be two radom processes represetig groud acceleratios i the horizotal directio at two statios separated by a distace. X t ad Y( t) ca be take to be joitly statioary, Gaussia ad zero mea radom processes. The auto-psd fuctios of X t ad Y( t)may be take to be of the form S I H H d XY 45
46 S I H H with i g f H & H i i g g f f The above psd is fashioed after the Kaai-Tajimi psd fuctio i which a additoal filter H is itroduced to esure that the groud displacemet is well behaved at low frequecies. The coherecy fuctio ca be take to be give by d XY XY exp dxy exp i V Develop a code to simulate samples of Xt ( ) ad Yt ( ). 46
47 The coherecy fuctio ca be take to be give by d XY XY exp dxy exp i V Develop a code to simulate samples of Xt ( ) ad Yt ( ). Assume f g 5.6 rad/s, =.6, I= (m/s/s),.8 rads/, =.5, d m, =. /m, XY ad V =5 m/s. rom the esemble of time histories geerated estimate the psd ad cross psd fuctios ad compare them with the target values. 47
48 Geeralizatio X t a cos tb si t; Y t c cos td si t; k k Z t e cos t f si t; m m k k k k k m m m m m a ~,, b ~,, X X aa k, bb k, ab k,,,, k k k c ~,, d ~,, Y Y cc k k, d d k, c d, k,,, k k e ~,, f ~,, Z Z e e k, f f k, e f, k,,, k k k 48
49 Geeralizatio (cotiued) ac ; ad ; bc ; bd k ac k k ad k k bc k k bd k ae ; a f ; be ; b f k ae k k af k k be k k bf k ce ; c f ; de ; d f k ce k k cf k k de k k df k & ac bd ad bc & ae bf af be & ce df cf de 49
50 Simulatio of a multi - parameter radom process Let f x, t be a radom process evolvig i x ad t. Let f x, t &,,, f x t f x t R Rff, S ff, expidd 4 f x, t A cos tcos xb k A B C D, ff k cos tsi x k + C si tcos x D si tsi x k k,,, zero mea Gaussia radom variables. k k k k k 5
51 A, B, C, D zero mea Gaussia radom variables. k k k k k, A A k rs Ak r ks B B k rs Bk r ks C C k rs Ck r ks D D k rs Dk r ks A B A C A D, k, r, s, k rs k rs k rs BkCrs Bk Drs, k, r, s, C D, k, rs,, k rs 5
52 f xt, f x, t [ A cos tcos xb cos tsi x r s k + C si tcos x D si tsi x] k k [ A cos t cos x B cos t si x C si tcos xd si tsi x] Thisca be reduced to the form R k k rs r s rs r s rs r s rs r s, x cos cos ff k k with S, k k 4 5
53 Markov process approach for simulatio of o - Gaussia radom processes Let Xt ( ) be a statioary Gaussia radom process defied o x, x. x Let p be the first order desity fuctio ad the psd fuctio X (for the purpose of illustratio) be S XX Here is the measquare value of ( ). Cosider the SDE ; dx t Xdt D X db t The psd of respose i the steady state is obtaiable. The steady state solutio to the goverig PK equatio is obtaiable. Demad that these solutios match with the target psd ad pdf. Determie drift ad diffusio coefficiets so that this becomes possible. Xt l r 53
54 Multiply the above equatio by X t ad take the esemble average: dx t Xdt D X db t X t dx t X t X t dt X t DX t db t dr d Aexp Select. exp R R Remark DX t A has o ifluece o psd of Xt ( ). 54
55 dx t Xdt D X db t p xp x D x p x t x x Steady state d d xp x D x p x dx dx d xp x D x p x dx ote : Sice p x is specified, the above equatio eeds to be viewed as a equatio for the ukow D x. 55
56 d xp x D x p x dx x D x up u du x with D x up u du. Summary To geerate samples of Xt ( ) with pdf px ( ) ad psd S p x dx t Xdt D X db t x p x l, obtai steady state solutios of the SDE x l 56
57 VARIACE REDUCTIO 57
58 g( x) ai i g Xi i ( ) Pf px x dx I g x px x dx Ig X a Var I g( X i i i i i i a Ig X P a Select a is a ubiased estimator Var i i i i ( ( ) ( ) I g X P g X P g X P 58
59 Var I g( X P P i i P a Var i Var ap( ) Select i is Miimized subject to a. i Lai P( P) ai i i L ap k ( P) ; k,,, a k a k P ( P ) i 59
60 6 5/3/ 6 ( ) ( ) ( ) ( ) ( ) Var ( ) ( ) i i k i a P P P P P P a P P P P P P P P
61 Illustratio P P Coefficiet of variatio ζ σ P m P P ζ P P P (for small P ) Suppose.& P 5 7 umber of samples eeded. Similarly, for., P 9 umber of samples eeded. 5 6
62 Remarks P( P) () Variace of estimator = is idepedet of size of basic radom variable vector X. () If this variace is large, the utility of estimator becomes questioable. (3) It appears that, i order to reduce the variace of the estimator we eed to icrease sample size. (4) Questio: Ca we reduce the variace of the estimator without icreasig? Variace reductio techiques. 6
63 roblofvariacereduo:hithouticreasigsamplesize P ( ) I g x px x dx This is re-writte as Ig( x) p X x P PhV x dx h x V x where h is a valid pdf ad satisfies the coditio p X emv ctiowtoreducew? x h x. V Var Θ 63
64 P ( x) h x dx where ( ) I g x px x ( x). h P h X V V x h x ote: at this stage the fuctio h is yet udefied ad eeds to be suitably selected. V V x Expectatio defied with respect to the pdf h. 64
65 Let J V where V i i are draw from h. i V x i We have show that J is a ubiased estimator for which miimzes the samplig variace with the lowest samplig variace beig Var V ( ) Var J. Var V ( ) I g V px V h V V P P 65
66 v v We ow select h v such that Var ( V) is miimized. Clearly if we select h V Igv px v P it follows Var V ( ). This would mea that eve with oe sample we will get the exact estimate of P. The pdf h V V is called the ideal importace samplig desity fuctio (ispdf). 66
Expectation and Variance of a random variable
Chapter 11 Expectatio ad Variace of a radom variable The aim of this lecture is to defie ad itroduce mathematical Expectatio ad variace of a fuctio of discrete & cotiuous radom variables ad the distributio
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science. BACKGROUND EXAM September 30, 2004.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Departmet of Electrical Egieerig ad Computer Sciece 6.34 Discrete Time Sigal Processig Fall 24 BACKGROUND EXAM September 3, 24. Full Name: Note: This exam is closed
More informationRandom Signals and Noise Winter Semester 2017 Problem Set 12 Wiener Filter Continuation
Radom Sigals ad Noise Witer Semester 7 Problem Set Wieer Filter Cotiuatio Problem (Sprig, Exam A) Give is the sigal W t, which is a Gaussia white oise with expectatio zero ad power spectral desity fuctio
More informationMatrix Representation of Data in Experiment
Matrix Represetatio of Data i Experimet Cosider a very simple model for resposes y ij : y ij i ij, i 1,; j 1,,..., (ote that for simplicity we are assumig the two () groups are of equal sample size ) Y
More informationLecture 7: Properties of Random Samples
Lecture 7: Properties of Radom Samples 1 Cotiued From Last Class Theorem 1.1. Let X 1, X,...X be a radom sample from a populatio with mea µ ad variace σ
More informationConfidence Level We want to estimate the true mean of a random variable X economically and with confidence.
Cofidece Iterval 700 Samples Sample Mea 03 Cofidece Level 095 Margi of Error 0037 We wat to estimate the true mea of a radom variable X ecoomically ad with cofidece True Mea μ from the Etire Populatio
More informationMonte Carlo method and application to random processes
Mote Carlo method ad applicatio to radom processes Lecture 3: Variace reductio techiques (8/3/2017) 1 Lecturer: Eresto Mordecki, Facultad de Ciecias, Uiversidad de la República, Motevideo, Uruguay Graduate
More informationReview Questions, Chapters 8, 9. f(y) = 0, elsewhere. F (y) = f Y(1) = n ( e y/θ) n 1 1 θ e y/θ = n θ e yn
Stat 366 Lab 2 Solutios (September 2, 2006) page TA: Yury Petracheko, CAB 484, yuryp@ualberta.ca, http://www.ualberta.ca/ yuryp/ Review Questios, Chapters 8, 9 8.5 Suppose that Y, Y 2,..., Y deote a radom
More informationProbability and Statistics
Probability ad Statistics Cotets. Multi-dimesioal Gaussia radom variable. Gaussia radom process 3. Wieer process Why we eed to discuss Gaussia Process The most commo Accordig to the cetral limit theorem,
More information1 Inferential Methods for Correlation and Regression Analysis
1 Iferetial Methods for Correlatio ad Regressio Aalysis I the chapter o Correlatio ad Regressio Aalysis tools for describig bivariate cotiuous data were itroduced. The sample Pearso Correlatio Coefficiet
More informationFundamental Concepts: Surfaces and Curves
UNDAMENTAL CONCEPTS: SURACES AND CURVES CHAPTER udametal Cocepts: Surfaces ad Curves. INTRODUCTION This chapter describes two geometrical objects, vi., surfaces ad curves because the pla a ver importat
More informationLecture 11 and 12: Basic estimation theory
Lecture ad 2: Basic estimatio theory Sprig 202 - EE 94 Networked estimatio ad cotrol Prof. Kha March 2 202 I. MAXIMUM-LIKELIHOOD ESTIMATORS The maximum likelihood priciple is deceptively simple. Louis
More informationLecture 33: Bootstrap
Lecture 33: ootstrap Motivatio To evaluate ad compare differet estimators, we eed cosistet estimators of variaces or asymptotic variaces of estimators. This is also importat for hypothesis testig ad cofidece
More informationLecture 16: UMVUE: conditioning on sufficient and complete statistics
Lecture 16: UMVUE: coditioig o sufficiet ad complete statistics The 2d method of derivig a UMVUE whe a sufficiet ad complete statistic is available Fid a ubiased estimator of ϑ, say U(X. Coditioig o a
More informationLecture 18: Sampling distributions
Lecture 18: Samplig distributios I may applicatios, the populatio is oe or several ormal distributios (or approximately). We ow study properties of some importat statistics based o a radom sample from
More informationSTAT Homework 1 - Solutions
STAT-36700 Homework 1 - Solutios Fall 018 September 11, 018 This cotais solutios for Homework 1. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better
More informationIIT JAM Mathematical Statistics (MS) 2006 SECTION A
IIT JAM Mathematical Statistics (MS) 6 SECTION A. If a > for ad lim a / L >, the which of the followig series is ot coverget? (a) (b) (c) (d) (d) = = a = a = a a + / a lim a a / + = lim a / a / + = lim
More informationSDS 321: Introduction to Probability and Statistics
SDS 321: Itroductio to Probability ad Statistics Lecture 23: Cotiuous radom variables- Iequalities, CLT Puramrita Sarkar Departmet of Statistics ad Data Sciece The Uiversity of Texas at Austi www.cs.cmu.edu/
More informationResampling Methods. X (1/2), i.e., Pr (X i m) = 1/2. We order the data: X (1) X (2) X (n). Define the sample median: ( n.
Jauary 1, 2019 Resamplig Methods Motivatio We have so may estimators with the property θ θ d N 0, σ 2 We ca also write θ a N θ, σ 2 /, where a meas approximately distributed as Oce we have a cosistet estimator
More informationECONOMETRIC THEORY. MODULE XIII Lecture - 34 Asymptotic Theory and Stochastic Regressors
ECONOMETRIC THEORY MODULE XIII Lecture - 34 Asymptotic Theory ad Stochastic Regressors Dr. Shalabh Departmet of Mathematics ad Statistics Idia Istitute of Techology Kapur Asymptotic theory The asymptotic
More informationDirection: This test is worth 250 points. You are required to complete this test within 50 minutes.
Term Test October 3, 003 Name Math 56 Studet Number Directio: This test is worth 50 poits. You are required to complete this test withi 50 miutes. I order to receive full credit, aswer each problem completely
More informationChapter 2 The Monte Carlo Method
Chapter 2 The Mote Carlo Method The Mote Carlo Method stads for a broad class of computatioal algorithms that rely o radom sampligs. It is ofte used i physical ad mathematical problems ad is most useful
More informationChapter 6 Principles of Data Reduction
Chapter 6 for BST 695: Special Topics i Statistical Theory. Kui Zhag, 0 Chapter 6 Priciples of Data Reductio Sectio 6. Itroductio Goal: To summarize or reduce the data X, X,, X to get iformatio about a
More informationFirst Year Quantitative Comp Exam Spring, Part I - 203A. f X (x) = 0 otherwise
First Year Quatitative Comp Exam Sprig, 2012 Istructio: There are three parts. Aswer every questio i every part. Questio I-1 Part I - 203A A radom variable X is distributed with the margial desity: >
More informationStat 421-SP2012 Interval Estimation Section
Stat 41-SP01 Iterval Estimatio Sectio 11.1-11. We ow uderstad (Chapter 10) how to fid poit estimators of a ukow parameter. o However, a poit estimate does ot provide ay iformatio about the ucertaity (possible
More informationECE 8527: Introduction to Machine Learning and Pattern Recognition Midterm # 1. Vaishali Amin Fall, 2015
ECE 8527: Itroductio to Machie Learig ad Patter Recogitio Midterm # 1 Vaishali Ami Fall, 2015 tue39624@temple.edu Problem No. 1: Cosider a two-class discrete distributio problem: ω 1 :{[0,0], [2,0], [2,2],
More information4. Partial Sums and the Central Limit Theorem
1 of 10 7/16/2009 6:05 AM Virtual Laboratories > 6. Radom Samples > 1 2 3 4 5 6 7 4. Partial Sums ad the Cetral Limit Theorem The cetral limit theorem ad the law of large umbers are the two fudametal theorems
More informationThis section is optional.
4 Momet Geeratig Fuctios* This sectio is optioal. The momet geeratig fuctio g : R R of a radom variable X is defied as g(t) = E[e tx ]. Propositio 1. We have g () (0) = E[X ] for = 1, 2,... Proof. Therefore
More informationLecture 3. Properties of Summary Statistics: Sampling Distribution
Lecture 3 Properties of Summary Statistics: Samplig Distributio Mai Theme How ca we use math to justify that our umerical summaries from the sample are good summaries of the populatio? Lecture Summary
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit Theorems Throughout this sectio we will assume a probability space (, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationEstimation of the Mean and the ACVF
Chapter 5 Estimatio of the Mea ad the ACVF A statioary process {X t } is characterized by its mea ad its autocovariace fuctio γ ), ad so by the autocorrelatio fuctio ρ ) I this chapter we preset the estimators
More informationhttp://www.xelca.l/articles/ufo_ladigsbaa_houte.aspx imulatio Output aalysis 3/4/06 This lecture Output: A simulatio determies the value of some performace measures, e.g. productio per hour, average queue
More informationMonte Carlo Integration
Mote Carlo Itegratio I these otes we first review basic umerical itegratio methods (usig Riema approximatio ad the trapezoidal rule) ad their limitatios for evaluatig multidimesioal itegrals. Next we itroduce
More informationRandom Variables, Sampling and Estimation
Chapter 1 Radom Variables, Samplig ad Estimatio 1.1 Itroductio This chapter will cover the most importat basic statistical theory you eed i order to uderstad the ecoometric material that will be comig
More informationCEE 522 Autumn Uncertainty Concepts for Geotechnical Engineering
CEE 5 Autum 005 Ucertaity Cocepts for Geotechical Egieerig Basic Termiology Set A set is a collectio of (mutually exclusive) objects or evets. The sample space is the (collectively exhaustive) collectio
More informationEcon 325/327 Notes on Sample Mean, Sample Proportion, Central Limit Theorem, Chi-square Distribution, Student s t distribution 1.
Eco 325/327 Notes o Sample Mea, Sample Proportio, Cetral Limit Theorem, Chi-square Distributio, Studet s t distributio 1 Sample Mea By Hiro Kasahara We cosider a radom sample from a populatio. Defiitio
More information10-701/ Machine Learning Mid-term Exam Solution
0-70/5-78 Machie Learig Mid-term Exam Solutio Your Name: Your Adrew ID: True or False (Give oe setece explaatio) (20%). (F) For a cotiuous radom variable x ad its probability distributio fuctio p(x), it
More informationLecture 7: Channel coding theorem for discrete-time continuous memoryless channel
Lecture 7: Chael codig theorem for discrete-time cotiuous memoryless chael Lectured by Dr. Saif K. Mohammed Scribed by Mirsad Čirkić Iformatio Theory for Wireless Commuicatio ITWC Sprig 202 Let us first
More informationAppendix to: Hypothesis Testing for Multiple Mean and Correlation Curves with Functional Data
Appedix to: Hypothesis Testig for Multiple Mea ad Correlatio Curves with Fuctioal Data Ao Yua 1, Hog-Bi Fag 1, Haiou Li 1, Coli O. Wu, Mig T. Ta 1, 1 Departmet of Biostatistics, Bioiformatics ad Biomathematics,
More informationA statistical method to determine sample size to estimate characteristic value of soil parameters
A statistical method to determie sample size to estimate characteristic value of soil parameters Y. Hojo, B. Setiawa 2 ad M. Suzuki 3 Abstract Sample size is a importat factor to be cosidered i determiig
More informationHOMEWORK I: PREREQUISITES FROM MATH 727
HOMEWORK I: PREREQUISITES FROM MATH 727 Questio. Let X, X 2,... be idepedet expoetial radom variables with mea µ. (a) Show that for Z +, we have EX µ!. (b) Show that almost surely, X + + X (c) Fid the
More information2. The volume of the solid of revolution generated by revolving the area bounded by the
IIT JAM Mathematical Statistics (MS) Solved Paper. A eigevector of the matrix M= ( ) is (a) ( ) (b) ( ) (c) ( ) (d) ( ) Solutio: (a) Eigevalue of M = ( ) is. x So, let x = ( y) be the eigevector. z (M
More informationLinear Regression Models
Liear Regressio Models Dr. Joh Mellor-Crummey Departmet of Computer Sciece Rice Uiversity johmc@cs.rice.edu COMP 528 Lecture 9 15 February 2005 Goals for Today Uderstad how to Use scatter diagrams to ispect
More informationA Note on Effi cient Conditional Simulation of Gaussian Distributions. April 2010
A Note o Effi ciet Coditioal Simulatio of Gaussia Distributios A D D C S S, U B C, V, BC, C April 2010 A Cosider a multivariate Gaussia radom vector which ca be partitioed ito observed ad uobserved compoetswe
More informationAMS570 Lecture Notes #2
AMS570 Lecture Notes # Review of Probability (cotiued) Probability distributios. () Biomial distributio Biomial Experimet: ) It cosists of trials ) Each trial results i of possible outcomes, S or F 3)
More informationLimit Theorems. Convergence in Probability. Let X be the number of heads observed in n tosses. Then, E[X] = np and Var[X] = np(1-p).
Limit Theorems Covergece i Probability Let X be the umber of heads observed i tosses. The, E[X] = p ad Var[X] = p(-p). L O This P x p NM QP P x p should be close to uity for large if our ituitio is correct.
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 19 11/17/2008 LAWS OF LARGE NUMBERS II THE STRONG LAW OF LARGE NUMBERS
MASSACHUSTTS INSTITUT OF TCHNOLOGY 6.436J/5.085J Fall 2008 Lecture 9 /7/2008 LAWS OF LARG NUMBRS II Cotets. The strog law of large umbers 2. The Cheroff boud TH STRONG LAW OF LARG NUMBRS While the weak
More informationProperties and Hypothesis Testing
Chapter 3 Properties ad Hypothesis Testig 3.1 Types of data The regressio techiques developed i previous chapters ca be applied to three differet kids of data. 1. Cross-sectioal data. 2. Time series data.
More informationECE 901 Lecture 14: Maximum Likelihood Estimation and Complexity Regularization
ECE 90 Lecture 4: Maximum Likelihood Estimatio ad Complexity Regularizatio R Nowak 5/7/009 Review : Maximum Likelihood Estimatio We have iid observatios draw from a ukow distributio Y i iid p θ, i,, where
More informationMaximum Likelihood Estimation and Complexity Regularization
ECE90 Sprig 004 Statistical Regularizatio ad Learig Theory Lecture: 4 Maximum Likelihood Estimatio ad Complexity Regularizatio Lecturer: Rob Nowak Scribe: Pam Limpiti Review : Maximum Likelihood Estimatio
More informationSTAT Homework 2 - Solutions
STAT-36700 Homework - Solutios Fall 08 September 4, 08 This cotais solutios for Homework. Please ote that we have icluded several additioal commets ad approaches to the problems to give you better isight.
More informationLet us give one more example of MLE. Example 3. The uniform distribution U[0, θ] on the interval [0, θ] has p.d.f.
Lecture 5 Let us give oe more example of MLE. Example 3. The uiform distributio U[0, ] o the iterval [0, ] has p.d.f. { 1 f(x =, 0 x, 0, otherwise The likelihood fuctio ϕ( = f(x i = 1 I(X 1,..., X [0,
More informationHauptman and Karle Joint and Conditional Probability Distributions. Robert H. Blessing, HWI/UB Structural Biology Department, January 2003 ( )
Hauptma ad Karle Joit ad Coditioal Probability Distributios Robert H Blessig HWI/UB Structural Biology Departmet Jauary 00 ormalized crystal structure factors are defied by E h = F h F h = f a hexp ihi
More information17. Joint distributions of extreme order statistics Lehmann 5.1; Ferguson 15
17. Joit distributios of extreme order statistics Lehma 5.1; Ferguso 15 I Example 10., we derived the asymptotic distributio of the maximum from a radom sample from a uiform distributio. We did this usig
More informationStochastic Simulation
Stochastic Simulatio 1 Itroductio Readig Assigmet: Read Chapter 1 of text. We shall itroduce may of the key issues to be discussed i this course via a couple of model problems. Model Problem 1 (Jackso
More informationDirection: This test is worth 150 points. You are required to complete this test within 55 minutes.
Term Test 3 (Part A) November 1, 004 Name Math 6 Studet Number Directio: This test is worth 10 poits. You are required to complete this test withi miutes. I order to receive full credit, aswer each problem
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationProblem Set 4 Due Oct, 12
EE226: Radom Processes i Systems Lecturer: Jea C. Walrad Problem Set 4 Due Oct, 12 Fall 06 GSI: Assae Gueye This problem set essetially reviews detectio theory ad hypothesis testig ad some basic otios
More informationThis exam contains 19 pages (including this cover page) and 10 questions. A Formulae sheet is provided with the exam.
Probability ad Statistics FS 07 Secod Sessio Exam 09.0.08 Time Limit: 80 Miutes Name: Studet ID: This exam cotais 9 pages (icludig this cover page) ad 0 questios. A Formulae sheet is provided with the
More informationDistribution of Random Samples & Limit theorems
STAT/MATH 395 A - PROBABILITY II UW Witer Quarter 2017 Néhémy Lim Distributio of Radom Samples & Limit theorems 1 Distributio of i.i.d. Samples Motivatig example. Assume that the goal of a study is to
More information[ ] ( ) ( ) [ ] ( ) 1 [ ] [ ] Sums of Random Variables Y = a 1 X 1 + a 2 X 2 + +a n X n The expected value of Y is:
PROBABILITY FUNCTIONS A radom variable X has a probabilit associated with each of its possible values. The probabilit is termed a discrete probabilit if X ca assume ol discrete values, or X = x, x, x 3,,
More informationEstimation for Complete Data
Estimatio for Complete Data complete data: there is o loss of iformatio durig study. complete idividual complete data= grouped data A complete idividual data is the oe i which the complete iformatio of
More information3. Z Transform. Recall that the Fourier transform (FT) of a DT signal xn [ ] is ( ) [ ] = In order for the FT to exist in the finite magnitude sense,
3. Z Trasform Referece: Etire Chapter 3 of text. Recall that the Fourier trasform (FT) of a DT sigal x [ ] is ω ( ) [ ] X e = j jω k = xe I order for the FT to exist i the fiite magitude sese, S = x [
More informationAMS 216 Stochastic Differential Equations Lecture 02 Copyright by Hongyun Wang, UCSC ( ( )) 2 = E X 2 ( ( )) 2
AMS 216 Stochastic Differetial Equatios Lecture 02 Copyright by Hogyu Wag, UCSC Review of probability theory (Cotiued) Variace: var X We obtai: = E X E( X ) 2 = E( X 2 ) 2E ( X )E X var( X ) = E X 2 Stadard
More information7.1 Convergence of sequences of random variables
Chapter 7 Limit theorems Throughout this sectio we will assume a probability space (Ω, F, P), i which is defied a ifiite sequece of radom variables (X ) ad a radom variable X. The fact that for every ifiite
More informationLecture 6 Chi Square Distribution (χ 2 ) and Least Squares Fitting
Lecture 6 Chi Square Distributio (χ ) ad Least Squares Fittig Chi Square Distributio (χ ) Suppose: We have a set of measuremets {x 1, x, x }. We kow the true value of each x i (x t1, x t, x t ). We would
More informationExponential Families and Bayesian Inference
Computer Visio Expoetial Families ad Bayesia Iferece Lecture Expoetial Families A expoetial family of distributios is a d-parameter family f(x; havig the followig form: f(x; = h(xe g(t T (x B(, (. where
More informationSolution to Chapter 2 Analytical Exercises
Nov. 25, 23, Revised Dec. 27, 23 Hayashi Ecoometrics Solutio to Chapter 2 Aalytical Exercises. For ay ε >, So, plim z =. O the other had, which meas that lim E(z =. 2. As show i the hit, Prob( z > ε =
More informationLecture 2: Monte Carlo Simulation
STAT/Q SCI 43: Itroductio to Resamplig ethods Sprig 27 Istructor: Ye-Chi Che Lecture 2: ote Carlo Simulatio 2 ote Carlo Itegratio Assume we wat to evaluate the followig itegratio: e x3 dx What ca we do?
More informationMATH 320: Probability and Statistics 9. Estimation and Testing of Parameters. Readings: Pruim, Chapter 4
MATH 30: Probability ad Statistics 9. Estimatio ad Testig of Parameters Estimatio ad Testig of Parameters We have bee dealig situatios i which we have full kowledge of the distributio of a radom variable.
More informationChapter 5. Inequalities. 5.1 The Markov and Chebyshev inequalities
Chapter 5 Iequalities 5.1 The Markov ad Chebyshev iequalities As you have probably see o today s frot page: every perso i the upper teth percetile ears at least 1 times more tha the average salary. I other
More informationClases 7-8: Métodos de reducción de varianza en Monte Carlo *
Clases 7-8: Métodos de reducció de variaza e Mote Carlo * 9 de septiembre de 27 Ídice. Variace reductio 2. Atithetic variates 2 2.. Example: Uiform radom variables................ 3 2.2. Example: Tail
More informationLecture 20: Multivariate convergence and the Central Limit Theorem
Lecture 20: Multivariate covergece ad the Cetral Limit Theorem Covergece i distributio for radom vectors Let Z,Z 1,Z 2,... be radom vectors o R k. If the cdf of Z is cotiuous, the we ca defie covergece
More informationIn this section we derive some finite-sample properties of the OLS estimator. b is an estimator of β. It is a function of the random sample data.
17 3. OLS Part III I this sectio we derive some fiite-sample properties of the OLS estimator. 3.1 The Samplig Distributio of the OLS Estimator y = Xβ + ε ; ε ~ N[0, σ 2 I ] b = (X X) 1 X y = f(y) ε is
More informationNotes 5 : More on the a.s. convergence of sums
Notes 5 : More o the a.s. covergece of sums Math 733-734: Theory of Probability Lecturer: Sebastie Roch Refereces: Dur0, Sectios.5; Wil9, Sectio 4.7, Shi96, Sectio IV.4, Dur0, Sectio.. Radom series. Three-series
More informationJacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3
No-Parametric Techiques Jacob Hays Amit Pillay James DeFelice 4.1, 4.2, 4.3 Parametric vs. No-Parametric Parametric Based o Fuctios (e.g Normal Distributio) Uimodal Oly oe peak Ulikely real data cofies
More informationRAINFALL PREDICTION BY WAVELET DECOMPOSITION
RAIFALL PREDICTIO BY WAVELET DECOMPOSITIO A. W. JAYAWARDEA Departmet of Civil Egieerig, The Uiversit of Hog Kog, Hog Kog, Chia P. C. XU Academ of Mathematics ad Sstem Scieces, Chiese Academ of Scieces,
More informationChapter 12 EM algorithms The Expectation-Maximization (EM) algorithm is a maximum likelihood method for models that have hidden variables eg. Gaussian
Chapter 2 EM algorithms The Expectatio-Maximizatio (EM) algorithm is a maximum likelihood method for models that have hidde variables eg. Gaussia Mixture Models (GMMs), Liear Dyamic Systems (LDSs) ad Hidde
More informationDepartment of Civil Engineering-I.I.T. Delhi CEL 899: Environmental Risk Assessment HW5 Solution
Departmet of Civil Egieerig-I.I.T. Delhi CEL 899: Evirometal Risk Assessmet HW5 Solutio Note: Assume missig data (if ay) ad metio the same. Q. Suppose X has a ormal distributio defied as N (mea=5, variace=
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationTopic 9: Sampling Distributions of Estimators
Topic 9: Samplig Distributios of Estimators Course 003, 2018 Page 0 Samplig distributios of estimators Sice our estimators are statistics (particular fuctios of radom variables), their distributio ca be
More informationLECTURE 8: ASYMPTOTICS I
LECTURE 8: ASYMPTOTICS I We are iterested i the properties of estimators as. Cosider a sequece of radom variables {, X 1}. N. M. Kiefer, Corell Uiversity, Ecoomics 60 1 Defiitio: (Weak covergece) A sequece
More informationStatisticians use the word population to refer the total number of (potential) observations under consideration
6 Samplig Distributios Statisticias use the word populatio to refer the total umber of (potetial) observatios uder cosideratio The populatio is just the set of all possible outcomes i our sample space
More information1.3 Convergence Theorems of Fourier Series. k k k k. N N k 1. With this in mind, we state (without proof) the convergence of Fourier series.
.3 Covergece Theorems of Fourier Series I this sectio, we preset the covergece of Fourier series. A ifiite sum is, by defiitio, a limit of partial sums, that is, a cos( kx) b si( kx) lim a cos( kx) b si(
More informationSimple Linear Regression
Simple Liear Regressio 1. Model ad Parameter Estimatio (a) Suppose our data cosist of a collectio of pairs (x i, y i ), where x i is a observed value of variable X ad y i is the correspodig observatio
More informationLecture 12: September 27
36-705: Itermediate Statistics Fall 207 Lecturer: Siva Balakrisha Lecture 2: September 27 Today we will discuss sufficiecy i more detail ad the begi to discuss some geeral strategies for costructig estimators.
More informationCastiel, Supernatural, Season 6, Episode 18
13 Differetial Equatios the aswer to your questio ca best be epressed as a series of partial differetial equatios... Castiel, Superatural, Seaso 6, Episode 18 A differetial equatio is a mathematical equatio
More informationLinear regression. Daniel Hsu (COMS 4771) (y i x T i β)2 2πσ. 2 2σ 2. 1 n. (x T i β y i ) 2. 1 ˆβ arg min. β R n d
Liear regressio Daiel Hsu (COMS 477) Maximum likelihood estimatio Oe of the simplest liear regressio models is the followig: (X, Y ),..., (X, Y ), (X, Y ) are iid radom pairs takig values i R d R, ad Y
More informationStatistical Pattern Recognition
Statistical Patter Recogitio Classificatio: No-Parametric Modelig Hamid R. Rabiee Jafar Muhammadi Sprig 2014 http://ce.sharif.edu/courses/92-93/2/ce725-2/ Ageda Parametric Modelig No-Parametric Modelig
More informationEE / EEE SAMPLE STUDY MATERIAL. GATE, IES & PSUs Signal System. Electrical Engineering. Postal Correspondence Course
Sigal-EE Postal Correspodece Course 1 SAMPLE STUDY MATERIAL Electrical Egieerig EE / EEE Postal Correspodece Course GATE, IES & PSUs Sigal System Sigal-EE Postal Correspodece Course CONTENTS 1. SIGNAL
More informationStatistical and Mathematical Methods DS-GA 1002 December 8, Sample Final Problems Solutions
Statistical ad Mathematical Methods DS-GA 00 December 8, 05. Short questios Sample Fial Problems Solutios a. Ax b has a solutio if b is i the rage of A. The dimesio of the rage of A is because A has liearly-idepedet
More informationSome Basic Probability Concepts. 2.1 Experiments, Outcomes and Random Variables
Some Basic Probability Cocepts 2. Experimets, Outcomes ad Radom Variables A radom variable is a variable whose value is ukow util it is observed. The value of a radom variable results from a experimet;
More informationMachine Learning Theory (CS 6783)
Machie Learig Theory (CS 6783) Lecture 2 : Learig Frameworks, Examples Settig up learig problems. X : istace space or iput space Examples: Computer Visio: Raw M N image vectorized X = 0, 255 M N, SIFT
More informationSolution of Linear Constant-Coefficient Difference Equations
ECE 38-9 Solutio of Liear Costat-Coefficiet Differece Equatios Z. Aliyazicioglu Electrical ad Computer Egieerig Departmet Cal Poly Pomoa Solutio of Liear Costat-Coefficiet Differece Equatios Example: Determie
More informationJanuary 25, 2017 INTRODUCTION TO MATHEMATICAL STATISTICS
Jauary 25, 207 INTRODUCTION TO MATHEMATICAL STATISTICS Abstract. A basic itroductio to statistics assumig kowledge of probability theory.. Probability I a typical udergraduate problem i probability, we
More informationCSE 527, Additional notes on MLE & EM
CSE 57 Lecture Notes: MLE & EM CSE 57, Additioal otes o MLE & EM Based o earlier otes by C. Grat & M. Narasimha Itroductio Last lecture we bega a examiatio of model based clusterig. This lecture will be
More informationQuick Review of Probability
Quick Review of Probability Berli Che Departmet of Computer Sciece & Iformatio Egieerig Natioal Taiwa Normal Uiversity Refereces: 1. W. Navidi. Statistics for Egieerig ad Scietists. Chapter & Teachig Material.
More informationMa 4121: Introduction to Lebesgue Integration Solutions to Homework Assignment 5
Ma 42: Itroductio to Lebesgue Itegratio Solutios to Homework Assigmet 5 Prof. Wickerhauser Due Thursday, April th, 23 Please retur your solutios to the istructor by the ed of class o the due date. You
More informationSTATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. Comments:
Recall: STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS Commets:. So far we have estimates of the parameters! 0 ad!, but have o idea how good these estimates are. Assumptio: E(Y x)! 0 +! x (liear coditioal
More information