ENVIRONMENTAL DATA ANALYSIS WILLIAM MENKE JOSHUA MENKE WITH MATLAB COPYRIGHT 2011 BY ELSEVIER, INC. ALL RIGHTS RESERVED.

Similar documents
Geophysical Data Analysis: Discrete Inverse Theory

SIO 210: Data analysis

SIO 210: Data analysis methods L. Talley, Fall Sampling and error 2. Basic statistical concepts 3. Time series analysis

Geostatistics for Seismic Data Integration in Earth Models

Time Series: Theory and Methods

Statistics Toolbox 6. Apply statistical algorithms and probability models

Section 4.1 Polynomial Functions and Models. Copyright 2013 Pearson Education, Inc. All rights reserved

Outline. Introduction to SpaceStat and ESTDA. ESTDA & SpaceStat. Learning Objectives. Space-Time Intelligence System. Space-Time Intelligence System

Statistical Analysis of fmrl Data

IDL Advanced Math & Stats Module

Geog 210C Spring 2011 Lab 6. Geostatistics in ArcMap

Chart types and when to use them

Subject CS1 Actuarial Statistics 1 Core Principles

COPYRIGHTED MATERIAL CONTENTS. Preface Preface to the First Edition

Index. Geostatistics for Environmental Scientists, 2nd Edition R. Webster and M. A. Oliver 2007 John Wiley & Sons, Ltd. ISBN:

BASIC DATA PROCESSING METHODS FOR OILFIELD GEOPHYSICS AND PETROPHYSICS

Computer Exercise 1 Estimation and Model Validation

Conditional simulation of spatially incoherent seismic ground motion using Gaussian process models.

ECE 3800 Probabilistic Methods of Signal and System Analysis

DATA IN SERIES AND TIME I. Several different techniques depending on data and what one wants to do

BME 50500: Image and Signal Processing in Biomedicine. Lecture 5: Correlation and Power-Spectrum CCNY

Adaptive Filtering. Squares. Alexander D. Poularikas. Fundamentals of. Least Mean. with MATLABR. University of Alabama, Huntsville, AL.

MATLAB for Brain and Cognitive Scientists

Some general observations.

Classic Time Series Analysis

Time-lapse filtering and improved repeatability with automatic factorial co-kriging. Thierry Coléou CGG Reservoir Services Massy

MATLAB for Engineers

Managing Uncertainty

Centre for Mathematical Sciences HT 2018 Mathematical Statistics

ANNEX A: ANALYSIS METHODOLOGIES

From Practical Data Analysis with JMP, Second Edition. Full book available for purchase here. About This Book... xiii About The Author...

Glossary. The ISI glossary of statistical terms provides definitions in a number of different languages:

Independent Component Analysis. Contents

Solving Poisson s Equations Using Buffered Fourier Spectral Method

Experimental Design and Data Analysis for Biologists

Advanced Machine Learning Practical 4b Solution: Regression (BLR, GPR & Gradient Boosting)

Course content (will be adapted to the background knowledge of the class):

Contents 1 Introduction 2 Statistical Tools and Concepts

Wavelet methods and null models for spatial pattern analysis

Linear Algebra and Probability

TIME SERIES ANALYSIS. Forecasting and Control. Wiley. Fifth Edition GWILYM M. JENKINS GEORGE E. P. BOX GREGORY C. REINSEL GRETA M.

Lesson 1. Optimal signalbehandling LTH. September Statistical Digital Signal Processing and Modeling, Hayes, M:

A GEOSTATISTICAL APPROACH TO PREDICTING A PHYSICAL VARIABLE THROUGH A CONTINUOUS SURFACE

Course in Data Science

STA 4273H: Statistical Machine Learning

Mathematical Tools for Neuroscience (NEU 314) Princeton University, Spring 2016 Jonathan Pillow. Homework 8: Logistic Regression & Information Theory

Multilevel Statistical Models: 3 rd edition, 2003 Contents

Better Simulation Metamodeling: The Why, What and How of Stochastic Kriging

Dynamics of the Otto Struve [2.1-Meter] Telescope

CS 6375 Machine Learning

A full scale, non stationary approach for the kriging of large spatio(-temporal) datasets

Centre for Mathematical Sciences HT 2017 Mathematical Statistics. Study chapters 6.1, 6.2 and in the course book.

Autonomous Navigation for Flying Robots

EEG- Signal Processing

Companion. Jeffrey E. Jones

Applied Regression Modeling

Statistical Methods in HYDROLOGY CHARLES T. HAAN. The Iowa State University Press / Ames

Signals and Systems Laboratory with MATLAB

Machine Learning 11. week

Computer Exercise 0 Simulation of ARMA-processes

Contents. Preface to Second Edition Preface to First Edition Abbreviations PART I PRINCIPLES OF STATISTICAL THINKING AND ANALYSIS 1

Statistícal Methods for Spatial Data Analysis

Correlation, discrete Fourier transforms and the power spectral density

Introduction to Signal Processing

Stochastic vs Deterministic Pre-stack Inversion Methods. Brian Russell

3 Joint Distributions 71

Algebra Readiness. Curriculum (445 topics additional topics)

Foundations of High School Math

SIO 210 CSP: Data analysis methods L. Talley, Fall Sampling and error 2. Basic statistical concepts 3. Time series analysis

STATISTICS-STAT (STAT)

Visualizing the Multivariate Normal, Lecture 9

Probability and Statistics for Final Year Engineering Students

Modeling of Atmospheric Effects on InSAR Measurements With the Method of Stochastic Simulation

Lab 4: Quantization, Oversampling, and Noise Shaping

Linear Regression. CSL603 - Fall 2017 Narayanan C Krishnan

Linear Regression. CSL465/603 - Fall 2016 Narayanan C Krishnan

Exam 2. Average: 85.6 Median: 87.0 Maximum: Minimum: 55.0 Standard Deviation: Numerical Methods Fall 2011 Lecture 20

Centre for Mathematical Sciences HT 2017 Mathematical Statistics

TAKEHOME FINAL EXAM e iω e 2iω e iω e 2iω

THE PRINCIPLES AND PRACTICE OF STATISTICS IN BIOLOGICAL RESEARCH. Robert R. SOKAL and F. James ROHLF. State University of New York at Stony Brook

Concepts and Applications of Kriging. Eric Krause Konstantin Krivoruchko

1 Introduction Overview of the Book How to Use this Book Introduction to R 10

Empirical Bayesian Kriging

Applied Probability and Stochastic Processes

Gaussian Process Regression Forecasting of Computer Network Conditions

BSM510 Numerical Analysis

Types of Spatial Data

Review: Probabilistic Matrix Factorization. Probabilistic Matrix Factorization (PMF)

Manual for a computer class in ML

Polynomials. p n (x) = a n x n + a n 1 x n 1 + a 1 x + a 0, where

Observed Brain Dynamics

A Reconstruction of Regional and Global Temperature for the Past 11,300 Years Marcott et al STUDENT ACTIVITY

WILEY. Differential Equations with MATLAB (Third Edition) Brian R. Hunt Ronald L. Lipsman John E. Osborn Jonathan M. Rosenberg

IV. Covariance Analysis

Linear Dynamical Systems

DFT & Fast Fourier Transform PART-A. 7. Calculate the number of multiplications needed in the calculation of DFT and FFT with 64 point sequence.

MACAU 2.0 User Manual

Sequential Importance Sampling for Rare Event Estimation with Computer Experiments

NumPy 1.5. open source. Beginner's Guide. v g I. performance, Python based free open source NumPy. An action-packed guide for the easy-to-use, high

Discrete-Time Systems

Transcription:

ENVIRONMENTAL DATA ANALYSIS WITH MATLAB WILLIAM MENKE PROFESSOR OF EARTH AND ENVIRONMENTAL SCIENCE COLUMBIA UNIVERSITY JOSHUA MENKE SOFTWARE ENGINEER JOM ASSOCIATES COPYRIGHT 2011 BY ELSEVIER, INC. ALL RIGHTS RESERVED.

CONTENTS CHAPTER 1: DATA ANALYSIS WITH MATLAB SECTION 1.1 WHY MATLAB? SECTION 1.2 GETTING STARTED WITH MATLAB. SECTION 1.3 GETTING ORGANIZED. SECTION 1.4 NAVIGATING FOLDERS. SECTION 1.5 SIMPLE ARITHMETIC AND ALGEGRA. SECTION 1.6 VECTORS AND MATRICES. SECTION 1.7 MULTIPLICATION OF VECTORS OF MATRICES SECTION 1.8 ELEMENT ACCESS. SECTION 1.9 TO LOOP OR NOT TO LOOP. SECTION 1.10 THE MATRIX INVERSE. SECTION 1.11 LOADING DATA FROM A FILE SECTION 1.12 PLOTTING DATA. SECTION 1.13 SAVING DATA TO A FILE. SECTION 1.14 SOME ADVICE ON WRITING SCRIPTS CHAPTER 2: A FIRST LOOK AT DATA SECTION 2.1 LOOK AT YOUR DATA! SECTION 2.2 MORE ON MATLAB GRAPHICS. SECTION 2.3 RATE INFORMATION. SECTION 2.4 SCATTER PLOTS AND THEIR LIMITATIONS CHAPTER 3: PROBABILITY AND WHAT IT HAS TO DO WITH DATA ANALYSIS SECTION 3.1 RANDOM VARIABLES. SECTION 3.2 MEAN, MEDIAN AND MODE. SECTION 3.3 VARIANCE. SECTION 3.4 TWO IMPORTANT PROBABILITY DENSITY FUNCTIONS SECTION 3.5 FUNCTIONS OF A RANDOM VARIABLE. SECTION 3.6 JOINT PROBABILITIES. SECTION 3.7 BAYESIAN INFERENCE SECTION 3.8 JOINT PROBABILITY DENSITY FUNCTIONS.

SECTION 3.9 COVARIANCE. SECTION 3.10 MULTIVARIATE DISTRIUBUTIONS. SECTION 3.11 THE MULTIVARIATE NORMAL DISTRIUBUTIONS. SECTION 3.12 LINEAR FUNCTIONS OF MULTIVATIATE DATA CHAPTER 4: THE POWER OF LINEAR MODELS SECTION 4.1 QUANTITATIVE MODELS, DATA AND MODEL PARAMETERS. SECTION 4.2 THE SIMPLEST OF QUANTITATIVE MODELS SECTION 4.3 CURVE FITTING SECTION 4.4. MIXTURES. SECTION 4.5. WEIGHTED AVERAGES. SECTION 4.6. EXAMINING ERROR. SECTION 4.7. LEAST SQUARES. SECTION 4.8. EXAMPLES. SECTION 4.9. COVARIANCE AND THE BEHAVIOR OF ERROR. CHAPTER 5:QUANTIFYING PRECONCEPTIONS SECTION 5.1 WHEN LEAST-SQUARE FAILS. SECTION 5.2 PRIOR INFORMATION. SECTION 5.3 BAYESIAN INFERENCE SECTION 5.4 THE PRODUCT OF NORMAL PROBABILITY DENSITY DISTRIBUTIONS. SECTION 5.5 GENERALIZED LEAST SQUARES. SECTION 5.6 THE ROLE OF THE COVARIANCE OF THE DATA SECTION 5.7. SMOOTHNESS AS PRIOR INFORMATION. SECTION 5.8. SPARSE MATRICES. SECTION 5.9 REORGANIZING GRIDS OF MODEL PARAMETERS CHAPTER 6: DETECTING PERIODICITIES SECTION 6.1 DESCRIBING SINUSOIDAL OSCILLATIONS SECTION 6.2 MODELS COMPOSED ONLY OF HARMONIC FUNCTIONS. SECTION 6.3 GOING COMPLEX SECTION 6.4 LESSONS LEARNED FROM THE INTEGRAL TRANSFORM SECTION 6.5. NORMAL CURVE. SECTION 6.6. SPIKES.

SECTION 6.7. AREA UNDER A FUNCTION. SECTION 6.8. TIME-DELAYED FUNCTION. SECTION 6.9. DERIVATIVE OF A FUNCTION. SECTION 6.10. INTEGRAL OF A FUNCTION SECTION 6.11. CONVOLUTION. SECTION 6.12. NON-TRANSIENT SIGNALS. CHAPTER 7: THE PAST INFLUENCES THE PRESENT SECTION 7.1 BEHAVIOR SENSITIVE TO PAST CONDITIONS. SECTION 7.2 FILTERING AS CONVOLUTION. SECTION 7.3 SOLVING PROBLEMS WITH FILTERS. SECTION 7.4 PREDICTION THE FUTURE SECTION 7.5 A PARALLEL BETWEEN FILTERS AND POLYNOMIALS SECTION 7.6 FILTER CASCADES AND INVERSE FILTERS SECTION 7.7 MAKING USE OF WHAT YOU KNOW. CHAPTER 8: PATTERNS SUGGESTED BY DATA SECTION 8.1 SAMPLES AS MIXTURES. SECTION 8.2 DETERMINING THE MINIMUM NUMBER OF FACTORS. SECTION 8.3. APPLICATION TO THE ATLANTIC ROCKS DATASET SECTION 8.4. SPIKY FACTORS SECTION 8.5. TIME-VARIABLE FUNCTIONS. CHAPTER 9: DETECTING CORRELATIONS AMONG DATA SECTION 9.1 CORRELATION IS COVARIANCE SECTION 9.2 COMPUTING AUTOCORRELATION BY HAND. SECTION 9.3 RELATIONSHIP TO CONVOLUTION AND POWER SPECTRAL DENSITY. SECTION 9.4. CROSS-CORRELATION. SECTION 9.5. USING THE CROSS-CORRELATION TO ALIGN TIME SERIES. SECTION 9.6 LEAST SQUARES ESTIMATION OF FILTERS SECTION 9.7. THE EFFECT OF SMOOTHING ON TIME SERIES. SECTION 9.8. BAND-PASS FILTERS. SECTION 9.9. FREQUENCY-DEPENDENT COHERENCE SECTION 9.10. WINDOWING BEFORE COMPUTING FOURIER TRANSFORMS.

SECTION 9.11. OPTIMAL WINDOW FUNCTIONS CHAPTER 10: FILLING IN MISSING DATA SECTION 10.1 INTERPOLATION REQUIRES PRIOR INFORMATION. SECTION 10.2 LINEAR INTERPOLATION SECTION 10.3 CUBIC INTERPOLATION SECTION 10.4 KRIGING SECTION 10.5 INTERPOLATION IN TWO DIMENSIONS SECTION 10.6. FOURIER TRANSFORMS IN TWO DIMENSIONS. CHAPTER 11: ARE MY RESULTS SIGNIFICANT? SECTION 11.1 THE DIFFERENCE IS DUE TO RANDOM VARIATION! SECTION 11.2. THE DISTRIBUTION OF THE TOTAL ERROR. SECTION 11.3. FOUR IMPORTANT PROBABILITY DENSITY FUNCTIONS. SECTION 11.4. A HYPOTHESIS TESTING SCENARIO. SECTION 11.5. TESTING IMPROVEMENT IN FIT. SECTION 11.6. TESTING THE SIGNIFICANCE OF A SPECTRAL PEAK SECTION 11.7. BOOTSTRAP CONFIDENCE INTERVALS. CHAPTER 12: NOTES