The Application of Discrete Tikhonov Regularization Inverse Problem in Seismic Tomography

Size: px
Start display at page:

Download "The Application of Discrete Tikhonov Regularization Inverse Problem in Seismic Tomography"

Transcription

1 The Application of Discrete Tikhonov Regularization Inverse Problem in Seismic Tomography KAMBIZ TEIMOORNEGAD, NEDA POROOHAN 2, Geology Department Islamic Azad University, Lahijan Branch 2 Islamic Azad University, Lahijan Branch P.O.BOX:66,Shaqayeq St.,Kashef St.,Lahijan,IRAN. tymoornegad@yahoo.com Abstract: - Because of instability, a solution called regularization had been used, considering some constraints in problem solving, that is useful in solving Ill Posed problems.in a cellular model, waves geometrical path was supposed to be straight. For this purpose, svd solution, zero order, first order and second order Tikhonov Regularization were applied. To implement the program, Matlab has been used and the results were obtained as contour map of velocity distribution. To solve Tikhonov inverse problem, the constraint of zero order was applied. Single digonal matrix and attenution parameters were used in different ways in none of which a proper solution was attained. In solving Tikhonov first order inverse problem, smoothing D matrix and regularization parameters of 000, 00, 0 and were used. Parameters of 00 and higher demonstrated good convergence. Key-Words: - Discrete inverse problem, Seismic tomography, Solution instability, Regularization, Svd. Introduction A lot of geophysical problems are mathematically ill-posed since they use incomplete data (Jackson, 972). Regularization is an approach that turns them into well- posed models by adding constraints on their models ( Angl et al.,996; Zhdanov, 2002). That developed by Tikhonov( 963) has been used in many geophysical problems such as travel time tomography(bube and Langan,999;Clapp etal.,2004), migration velocity analysis ( Woodward, et al. 988; Zhou et al.,2003), high resolution radon transform ( Trad et al., 2003), spectral resolution (Portniaguine & Castagna, 2004) and so on. Geophysical data inversion is aimed at taking quantitative information on subsurface structures from some limited indirect observation including noise.the present study tries to learn about structural distribution of wave velocity into a section involving two vertical wells. Any ray through all of the plane s cells and the presence of noise in data vector ( arrival time ) makes equations system coefficient matrix ( Kernel G matrix ) shapes as if it will be impossible to solve inverse problem using the usual method like the least square method in order to estimate model parameter ( i.e. wave path speed). Thus, the problem becomes unstable and some restraints of the problem need to be considered while trying to change it into a stable one. This leads us to use an approach, Tikhonov regularization approach with different solving orders. 2 Methods 2. Tikhonov regularization approach In effort to solve inverse problems, we have to bear in mind that in many such problems small changes in measurements such as a small noise in d= d true + n often brings about relatively big changes in the model estimated. As such, we ll face with unstable inverse problems which need some additional constraints to be considered in order to turn into stable ones. Regularization can provide a useful solution to solve ill-posed problems. Using Tikhonov regularization approach, there will be no need to minimize the following expression min Gm-d 2 (2.) but the expression below is minimized instead:min Gm-d 2 + m 2 (2.2) The first term is the data misfit, and the second is the regularization term. As shownhere, the two aspects of the minimization (make the data misfit small, make the modelnorm small) get equal weight.using regularization solution, λ factor, called Tikhonov parameter, is used to control balance[,2]. The structure of resulting model is dependent in this parameter. min Gm-d 2 + λ Dm 2 (2.3) Given that D n,n=0,,2, ISSN: ISBN:

2 n is a n order discrete difference operator.after that the expression (2.3) has been derived and regarded equal zero, the general expression will be as follows: ( G T G + λ D T D ) m λ = G T d (2.4) The answer to Tikhonov inverse problem which makes a balance between residual vector and model parameter vector will be as follows: m λ = ( G T G + λ D T D ) - G T d (2.5) If D=0 is zero matrix, the approach will be the linear least square. If D=I is (d) identity matrix, the resulting approach will be usual Tikhonov regularization or zero order Tikhonov.If D is (d2) matrix, the approach will be the first- order Tikhonov and if D is (d3) matrix, the approach will be the second- order Tikhonov approach[6]: d=... d2= d3= Singular values decomposition A general approach for solving the linear least square problem, especially unstableproblems and rank deficiency, issingular values decomposition.kernel matrix(g) is decomposed into three U, S, V matrices: G= USV T (2.6) U is an m by m orthogonal matrix with columns that are basis vectors Spanning the model space, R m. S is m x n diagonal matrix, elements of which in the order of value are as follows: S S 2 S 2 S min (m,n) 0 (2.7) V is an n by n orthogonal matrix with columns that are basis vectors Spanning the model space, R n. given that d=gm and singular values decomposition, we will have m T = VS - U T d (2.8) There are one or more zero singular or very small ( S i ) in unstable problems which are as follows: G= [ U p, U o ] [ ] [V p V 0 ] T (2.9) The compact formula of svd of Kernel matrix will be given below: T G= U p S p V p (2.0) The solution will lead to results that are less sensitive to noise data. When Tikhonov regularization approach is used, more constraints must be taken into consideration. The approach suggests that higher weights should be given to bigger singular values and lower weights to smaller singular values of svd[6]. 3 Seismic Tomography of arrival time A section (plane) into the ground involves two wells, sources and receivers. The wells were dug vertically on the ground located to 0 units far from each other. 40 sources and 40 receivers are located in the wells with the distance of 0.4 units. the plane is considered as having cells with 25 long by 25 wide.two primary models have been chosen in the research. One is a brick model of about 0 unit long by 0 unit wide (25 25 cells), background velocity Of V=0, anomaly velocity of V2=9, with 3 unit wide by 3 unit long in the middle ( Fig.).Another model is blob model with the size of 0 unit long by 0 unit wide (25 25 cells), background velocity of V= 0,Velocity anomaly was supposed as a gradual change of velocity from the center of a circle to outwards with V2 =r/3+9 pace. The circle has the diameter about r<3 unit( fig.2). Raypaths have been drawn directly from sources to receivers on the plane. For example, raypaths from 3 sources to all receivers are drawn ( fig.3). Fig. Brick model( background velocity v=0 and anomaly velocity v=9) ISSN: ISBN:

3 Fig.2 Blob model (background velocity v=0 and anomaly velocity v2=r/3+9) Well Raypath RAY PATH Receiver Source Well 2 Fig.3 Raypath, source and receiver location in wells A linear equation system is formed using all rays. t = l s + l 2 s 2... l n s n t 2 = l 2 s + l 22 s 2... l 2n s n t m =l m s + l m2 s 2... l mn s n (3.) t i =arrival time of ith ray s j = slowness of jth cell l ij = section of raypath of ith into the jth cell As follows, the linear equation system in matrix form will be: d=gm (3.2) In above formula, d is observation vector ( arrival time), G is coefficient matrix of Kernel matrix (pieces of raypath ) and m is model parameter s vector ( slowness). t l l... l s 2 n t l l 2... l n s2.,g=....,. d = d= (3..3) m m m m t l l 2... l n s n Generally speaking, any linear problem in is a special form of the following formula: D= d true + n (3.4) n vector is considered the noise of model parameter, d R m, G R m n and m true R n are data, direct discrete operator and actual model s parameters respectively ( m and n are the number of data and model parameter respectively). n stands for noise element of data consisting of two other elements one is related to random noises and another related to nonrandom noises. As is derived from definition, random noises include changes of data which are impossible to regenerate. Nonrandom noises include all laws taken for granted while modeling. It is, in fact, the rupture effect of direct operator. In the present research, it is assumed that all physical laws of problem were not included in the mode, thus, discrete surface is small enough so that the error resulted from discreteness is considerably small. It s why nonrandom element of noise is put aside. When the element is removed, it will be easier to solve equation 4. A problem arises when data include noises. The traveltimes is determined considering two initial velocity model and different sources and receiver coordinates of the two wells. After that using random order in MATLAB, 676 random data (for 676 ray) was generated and then added to the arrivaltime of each ray. Some synthetic data was achieved as observational data (fig. 4). Results of Tikhonov regularization approach is practically less sensitive to noisy data and are used to solve illposed discrete problems. Fig.4 Synthetic data obtained traveltimes and random noise ISSN: ISBN:

4 4 Conclusion Regarding every initial brick and blob models and produced synthetic data and using Tikhonov approach, a program in MATLAB has been used because of instability in solving reverse problem ( seismic tomography).the final results were obtained as distribution maps of velocity among the two wells ( fig. 5,6,7,8,9,0). Applying Tikhonov regularization approaches with different parameters of λ=,0,00,000 the following results were produced. Given all parameters mentioned above and zero-order Tikhonov regularization approach, final solution of estimated model was proved to be different from that of real model so that no appropriate solution was achieved. Using first order Tikhonov regularization parameter of 00 and more showed a well convergence toward the real model. After that second-order tikhonov regularization approach with parameter of 00 was used, distribution model of estimated velocity represented no closer convergence than first-order Tikhonov approach but with the parameter of 000, a rather good convergence was found. 5 Discussion Above results show that we can possess two options to shoes among in attempt to balance between object function or misfit and model parameter. They can either chose the appropriate D matrix with different orders or determine the optimum λ regularization parameter in order to get high convergence. When we tend to use the former method, depending on whether the velocity distribution model is homogenous or heterogeneous, we can decide either of them so that in the present study, first order regularization approach becomes closer to the solution thanks to the absence of velocity contrast. Using the second solution, it was found that for our selected models (brick and blob) in which regular contrast changes of velocity occurred we could approach the real model via increasing regularization parameter. Selection of an optimum matrix and regularization parameter in heterogeneous models with the aim of converging problem solving requires more studies which will be taken into consideration in future studies in details. References: [] A.N. Tikhonov, On the stability of inverse problems, Dokl. Akad Nauk SSSR., Vol.39, No.5, 943, pp [2] A.N. Tikhonov, Solution of incorrectly formulated problems and the regularization method, Soviet Math., No.4, 963, pp [3] D.L. Donoho, Nonlinear Solution of Linear Inverse Problems by Wavelet Vaguelette Decomposition, Appl. Compu Harmon., Vol.2, No.2, 995, pp [4] J.A.. Scale, M.L. Smith, Introductory Geophysical inverse theory, Samizdat Press, Colorado School of Mine Denver., 200. [5] P.C. Hansen, Rank-Deficient and Discrete Ill- Posed Problems, Textbook, SIAM. USA, 998. [6] RC. Aster, B. Borchers, C.Thurber, Parameter estimation and inverse problems, Textbook,New Mexico, Tech., [7] S. Fomel,, Shaping regularization in geophysical-estimation problems, Geophysics, Vol.72, No.2, 2007, pp [8] T. Sakamoto, G. Kitagawa,, Akaike information criterion statistics, D. Reidel, Holand., 986. [9] W.P. Gouviea,J.A. Scales, Resolution of seismic waveform inversion, Bayes versus Occams, Inverse Probl., No.3, 997, pp ISSN: ISBN:

5 Zero - order Second - order Fig.5 velocity distribution using zeroorder λ=,0, 00,000 and brick model. Fig.7 velocity distribution using secondorder λ=,0, 00,000 and brick model First - order Fig.6 velocity distribution using firstorder λ=,0, 00,000 and brick model ISSN: ISBN:

6 Zero - order Second - order Fig.8 velocity distribution using zeroorder λ=,0, 00,000 and blob model. First - order Fig.9 velocity distribution using secondorder λ=,0, 00,000 and blob model. Fig.0 velocity distribution using firstorder λ=,0, 00,000 and blob model. ISSN: ISBN:

Edge preserved denoising and singularity extraction from angles gathers

Edge preserved denoising and singularity extraction from angles gathers Edge preserved denoising and singularity extraction from angles gathers Felix Herrmann, EOS-UBC Martijn de Hoop, CSM Joint work Geophysical inversion theory using fractional spline wavelets: ffl Jonathan

More information

REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE

REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE Int. J. Appl. Math. Comput. Sci., 007, Vol. 17, No., 157 164 DOI: 10.478/v10006-007-0014-3 REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE DOROTA KRAWCZYK-STAŃDO,

More information

= (G T G) 1 G T d. m L2

= (G T G) 1 G T d. m L2 The importance of the Vp/Vs ratio in determining the error propagation and the resolution in linear AVA inversion M. Aleardi, A. Mazzotti Earth Sciences Department, University of Pisa, Italy Introduction.

More information

Linearized inverse Problems

Linearized inverse Problems Linearized inverse Problems (Weakly nonlinear problems) Using a Taylor expansion then away we go... Linearized inverse problems Nonlinear inverse problem d obs,i = g i (m) Choose a reference model m o

More information

GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS

GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS Methods in Geochemistry and Geophysics, 36 GEOPHYSICAL INVERSE THEORY AND REGULARIZATION PROBLEMS Michael S. ZHDANOV University of Utah Salt Lake City UTAH, U.S.A. 2OO2 ELSEVIER Amsterdam - Boston - London

More information

ECE295, Data Assimila0on and Inverse Problems, Spring 2015

ECE295, Data Assimila0on and Inverse Problems, Spring 2015 ECE295, Data Assimila0on and Inverse Problems, Spring 2015 1 April, Intro; Linear discrete Inverse problems (Aster Ch 1 and 2) Slides 8 April, SVD (Aster ch 2 and 3) Slides 15 April, RegularizaFon (ch

More information

estimator for determining the regularization parameter in

estimator for determining the regularization parameter in submitted to Geophys. J. Int. Application of the χ 2 principle and unbiased predictive risk estimator for determining the regularization parameter in 3D focusing gravity inversion Saeed Vatankhah, Vahid

More information

Application of the χ 2 principle and unbiased predictive risk estimator for determining the regularization parameter in 3D focusing gravity inversion

Application of the χ 2 principle and unbiased predictive risk estimator for determining the regularization parameter in 3D focusing gravity inversion Application of the χ principle and unbiased predictive risk estimator for determining the regularization parameter in 3D focusing gravity inversion arxiv:48.7v [math.na] 4 Aug 4 Saeed Vatankhah, Vahid

More information

SOEE3250/5675/5115 Inverse Theory Lecture 2; notes by G. Houseman

SOEE3250/5675/5115 Inverse Theory Lecture 2; notes by G. Houseman SOEE3250/5675/5115 Inverse Theory Lecture 2; notes by G. Houseman Topics covered in this lecture: Matrix diagonalisation Quadratic forms Examples from gravity and seismology Model parameterisation Model

More information

Regularization methods for large-scale, ill-posed, linear, discrete, inverse problems

Regularization methods for large-scale, ill-posed, linear, discrete, inverse problems Regularization methods for large-scale, ill-posed, linear, discrete, inverse problems Silvia Gazzola Dipartimento di Matematica - Università di Padova January 10, 2012 Seminario ex-studenti 2 Silvia Gazzola

More information

Singular value decomposition. If only the first p singular values are nonzero we write. U T o U p =0

Singular value decomposition. If only the first p singular values are nonzero we write. U T o U p =0 Singular value decomposition If only the first p singular values are nonzero we write G =[U p U o ] " Sp 0 0 0 # [V p V o ] T U p represents the first p columns of U U o represents the last N-p columns

More information

Discrete Ill Posed and Rank Deficient Problems. Alistair Boyle, Feb 2009, SYS5906: Directed Studies Inverse Problems 1

Discrete Ill Posed and Rank Deficient Problems. Alistair Boyle, Feb 2009, SYS5906: Directed Studies Inverse Problems 1 Discrete Ill Posed and Rank Deficient Problems Alistair Boyle, Feb 2009, SYS5906: Directed Studies Inverse Problems 1 Definitions Overview Inversion, SVD, Picard Condition, Rank Deficient, Ill-Posed Classical

More information

The i-stats: An Image-Based Effective-Medium Modeling of Near-Surface Anomalies Oz Yilmaz*, GeoTomo LLC, Houston, TX

The i-stats: An Image-Based Effective-Medium Modeling of Near-Surface Anomalies Oz Yilmaz*, GeoTomo LLC, Houston, TX The i-stats: An Image-Based Effective-Medium Modeling of Near-Surface Anomalies Oz Yilmaz*, GeoTomo LLC, Houston, TX Summary Near-surface modeling for statics corrections is an integral part of a land

More information

Inversion of Phase Data for a Phase Velocity Map 101. Summary for CIDER12 Non-Seismologists

Inversion of Phase Data for a Phase Velocity Map 101. Summary for CIDER12 Non-Seismologists Inversion of Phase Data for a Phase Velocity Map 101 Summary for CIDER12 Non-Seismologists 1. Setting up a Linear System of Equations This is a quick-and-dirty, not-peer reviewed summary of how a dataset

More information

Regularizing inverse problems. Damping and smoothing and choosing...

Regularizing inverse problems. Damping and smoothing and choosing... Regularizing inverse problems Damping and smoothing and choosing... 141 Regularization The idea behind SVD is to limit the degree of freedom in the model and fit the data to an acceptable level. Retain

More information

Singular Value Decomposition and Digital Image Compression

Singular Value Decomposition and Digital Image Compression Singular Value Decomposition and Digital Image Compression Chris Bingham December 1, 016 Page 1 of Abstract The purpose of this document is to be a very basic introduction to the singular value decomposition

More information

Residual statics analysis by LSQR

Residual statics analysis by LSQR Residual statics analysis by LSQR Residual statics analysis by LSQR Yan Yan, Zhengsheng Yao, Gary F. Margrave and R. James Brown ABSRAC Residual statics corrections can be formulated as a linear inverse

More information

Gravity Inversion Using Point Mass Distribution

Gravity Inversion Using Point Mass Distribution University of Stuttgart Institut of Geodesy Gravity Inversion Using Point Mass Distribution Master Thesis in study program GEOENGINE University of Stuttgart Yuchen Han Stuttgart, June 2017 Supervisor:

More information

COMPUTATIONAL ISSUES RELATING TO INVERSION OF PRACTICAL DATA: WHERE IS THE UNCERTAINTY? CAN WE SOLVE Ax = b?

COMPUTATIONAL ISSUES RELATING TO INVERSION OF PRACTICAL DATA: WHERE IS THE UNCERTAINTY? CAN WE SOLVE Ax = b? COMPUTATIONAL ISSUES RELATING TO INVERSION OF PRACTICAL DATA: WHERE IS THE UNCERTAINTY? CAN WE SOLVE Ax = b? Rosemary Renaut http://math.asu.edu/ rosie BRIDGING THE GAP? OCT 2, 2012 Discussion Yuen: Solve

More information

Traveltime sensitivity kernels: Banana-doughnuts or just plain bananas? a

Traveltime sensitivity kernels: Banana-doughnuts or just plain bananas? a Traveltime sensitivity kernels: Banana-doughnuts or just plain bananas? a a Published in SEP report, 103, 61-68 (2000) James Rickett 1 INTRODUCTION Estimating an accurate velocity function is one of the

More information

Parameter estimation: A new approach to weighting a priori information

Parameter estimation: A new approach to weighting a priori information c de Gruyter 27 J. Inv. Ill-Posed Problems 5 (27), 2 DOI.55 / JIP.27.xxx Parameter estimation: A new approach to weighting a priori information J.L. Mead Communicated by Abstract. We propose a new approach

More information

Numerical Methods for Inverse Kinematics

Numerical Methods for Inverse Kinematics Numerical Methods for Inverse Kinematics Niels Joubert, UC Berkeley, CS184 2008-11-25 Inverse Kinematics is used to pose models by specifying endpoints of segments rather than individual joint angles.

More information

Getting Started with Communications Engineering

Getting Started with Communications Engineering 1 Linear algebra is the algebra of linear equations: the term linear being used in the same sense as in linear functions, such as: which is the equation of a straight line. y ax c (0.1) Of course, if we

More information

THE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR

THE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR THE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR 1. Definition Existence Theorem 1. Assume that A R m n. Then there exist orthogonal matrices U R m m V R n n, values σ 1 σ 2... σ p 0 with p = min{m, n},

More information

15 Singular Value Decomposition

15 Singular Value Decomposition 15 Singular Value Decomposition For any high-dimensional data analysis, one s first thought should often be: can I use an SVD? The singular value decomposition is an invaluable analysis tool for dealing

More information

Inverse Theory. COST WaVaCS Winterschool Venice, February Stefan Buehler Luleå University of Technology Kiruna

Inverse Theory. COST WaVaCS Winterschool Venice, February Stefan Buehler Luleå University of Technology Kiruna Inverse Theory COST WaVaCS Winterschool Venice, February 2011 Stefan Buehler Luleå University of Technology Kiruna Overview Inversion 1 The Inverse Problem 2 Simple Minded Approach (Matrix Inversion) 3

More information

ISyE 691 Data mining and analytics

ISyE 691 Data mining and analytics ISyE 691 Data mining and analytics Regression Instructor: Prof. Kaibo Liu Department of Industrial and Systems Engineering UW-Madison Email: kliu8@wisc.edu Office: Room 3017 (Mechanical Engineering Building)

More information

Inverse Theory Methods in Experimental Physics

Inverse Theory Methods in Experimental Physics Inverse Theory Methods in Experimental Physics Edward Sternin PHYS 5P10: 2018-02-26 Edward Sternin Inverse Theory Methods PHYS 5P10: 2018-02-26 1 / 29 1 Introduction Indirectly observed data A new research

More information

3D Computer Vision - WT 2004

3D Computer Vision - WT 2004 3D Computer Vision - WT 2004 Singular Value Decomposition Darko Zikic CAMP - Chair for Computer Aided Medical Procedures November 4, 2004 1 2 3 4 5 Properties For any given matrix A R m n there exists

More information

Basic Linear Inverse Method Theory - DRAFT NOTES

Basic Linear Inverse Method Theory - DRAFT NOTES Basic Linear Inverse Method Theory - DRAFT NOTES Peter P. Jones 1 1 Centre for Compleity Science, University of Warwick, Coventry CV4 7AL, UK (Dated: 21st June 2012) BASIC LINEAR INVERSE METHOD THEORY

More information

Inverse Ill Posed Problems in Image Processing

Inverse Ill Posed Problems in Image Processing Inverse Ill Posed Problems in Image Processing Image Deblurring I. Hnětynková 1,M.Plešinger 2,Z.Strakoš 3 hnetynko@karlin.mff.cuni.cz, martin.plesinger@tul.cz, strakos@cs.cas.cz 1,3 Faculty of Mathematics

More information

Multiple Change Point Detection by Sparse Parameter Estimation

Multiple Change Point Detection by Sparse Parameter Estimation Multiple Change Point Detection by Sparse Parameter Estimation Department of Econometrics Fac. of Economics and Management University of Defence Brno, Czech Republic Dept. of Appl. Math. and Comp. Sci.

More information

Linear Algebra Review. Vectors

Linear Algebra Review. Vectors Linear Algebra Review 9/4/7 Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka http://cs.gmu.edu/~kosecka/cs682.html Virginia de Sa (UCSD) Cogsci 8F Linear Algebra review Vectors

More information

A MODIFIED TSVD METHOD FOR DISCRETE ILL-POSED PROBLEMS

A MODIFIED TSVD METHOD FOR DISCRETE ILL-POSED PROBLEMS A MODIFIED TSVD METHOD FOR DISCRETE ILL-POSED PROBLEMS SILVIA NOSCHESE AND LOTHAR REICHEL Abstract. Truncated singular value decomposition (TSVD) is a popular method for solving linear discrete ill-posed

More information

Why the QR Factorization can be more Accurate than the SVD

Why the QR Factorization can be more Accurate than the SVD Why the QR Factorization can be more Accurate than the SVD Leslie V. Foster Department of Mathematics San Jose State University San Jose, CA 95192 foster@math.sjsu.edu May 10, 2004 Problem: or Ax = b for

More information

An Analytical Expression for Degree of Determination of Geophysical Model Parameters

An Analytical Expression for Degree of Determination of Geophysical Model Parameters An Analytical Expression for Degree of Determination of Geophysical Model Parameters Wilson Mouzer Figueiró Universidade Federal da Bahia Centro de Pesquisa em Geofísica e Geologia Instituto de Geociências,

More information

14 Singular Value Decomposition

14 Singular Value Decomposition 14 Singular Value Decomposition For any high-dimensional data analysis, one s first thought should often be: can I use an SVD? The singular value decomposition is an invaluable analysis tool for dealing

More information

MATH 3795 Lecture 10. Regularized Linear Least Squares.

MATH 3795 Lecture 10. Regularized Linear Least Squares. MATH 3795 Lecture 10. Regularized Linear Least Squares. Dmitriy Leykekhman Fall 2008 Goals Understanding the regularization. D. Leykekhman - MATH 3795 Introduction to Computational Mathematics Linear Least

More information

Approximate Methods for Time-Reversal Processing of Large Seismic Reflection Data Sets. University of California, LLNL

Approximate Methods for Time-Reversal Processing of Large Seismic Reflection Data Sets. University of California, LLNL 147th Annual Meeting: Acoustical Society of America New York City, May 25, 2004 Approximate Methods for Time-Reversal Processing of Large Seismic Reflection Data Sets Speaker: James G. Berryman University

More information

ANGLE-DEPENDENT TOMOSTATICS. Abstract

ANGLE-DEPENDENT TOMOSTATICS. Abstract ANGLE-DEPENDENT TOMOSTATICS Lindsay M. Mayer, Kansas Geological Survey, University of Kansas, Lawrence, KS Richard D. Miller, Kansas Geological Survey, University of Kansas, Lawrence, KS Julian Ivanov,

More information

Discrete ill posed problems

Discrete ill posed problems Discrete ill posed problems Gérard MEURANT October, 2008 1 Introduction to ill posed problems 2 Tikhonov regularization 3 The L curve criterion 4 Generalized cross validation 5 Comparisons of methods Introduction

More information

The Improvement of 3D Traveltime Tomographic Inversion Method

The Improvement of 3D Traveltime Tomographic Inversion Method Advances in Petroleum Exploration and Development Vol. 5, No., 013, pp. 36-40 DOI:10.3968/j.aped.1955438013050.1368 ISSN 195-54X [Print] ISSN 195-5438 [Online] www.cscanada.net www.cscanada.org The Improvement

More information

A study on regularization parameter choice in Near-field Acoustical Holography

A study on regularization parameter choice in Near-field Acoustical Holography Acoustics 8 Paris A study on regularization parameter choice in Near-field Acoustical Holography J. Gomes a and P.C. Hansen b a Brüel & Kjær Sound and Vibration Measurement A/S, Skodsborgvej 37, DK-285

More information

MATH 612 Computational methods for equation solving and function minimization Week # 2

MATH 612 Computational methods for equation solving and function minimization Week # 2 MATH 612 Computational methods for equation solving and function minimization Week # 2 Instructor: Francisco-Javier Pancho Sayas Spring 2014 University of Delaware FJS MATH 612 1 / 38 Plan for this week

More information

Extended isochron rays in prestack depth (map) migration

Extended isochron rays in prestack depth (map) migration Extended isochron rays in prestack depth (map) migration A.A. Duchkov and M.V. de Hoop Purdue University, 150 N.University st., West Lafayette, IN, 47907 e-mail: aduchkov@purdue.edu (December 15, 2008)

More information

A Parameter-Choice Method That Exploits Residual Information

A Parameter-Choice Method That Exploits Residual Information A Parameter-Choice Method That Exploits Residual Information Per Christian Hansen Section for Scientific Computing DTU Informatics Joint work with Misha E. Kilmer Tufts University Inverse Problems: Image

More information

Fitting functions to data

Fitting functions to data 1 Fitting functions to data 1.1 Exact fitting 1.1.1 Introduction Suppose we have a set of real-number data pairs x i, y i, i = 1, 2,, N. These can be considered to be a set of points in the xy-plane. They

More information

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice

linearly indepedent eigenvectors as the multiplicity of the root, but in general there may be no more than one. For further discussion, assume matrice 3. Eigenvalues and Eigenvectors, Spectral Representation 3.. Eigenvalues and Eigenvectors A vector ' is eigenvector of a matrix K, if K' is parallel to ' and ' 6, i.e., K' k' k is the eigenvalue. If is

More information

Wenyong Pan and Lianjie Huang. Los Alamos National Laboratory, Geophysics Group, MS D452, Los Alamos, NM 87545, USA

Wenyong Pan and Lianjie Huang. Los Alamos National Laboratory, Geophysics Group, MS D452, Los Alamos, NM 87545, USA PROCEEDINGS, 44th Workshop on Geothermal Reservoir Engineering Stanford University, Stanford, California, February 11-13, 019 SGP-TR-14 Adaptive Viscoelastic-Waveform Inversion Using the Local Wavelet

More information

Lecture 6. Numerical methods. Approximation of functions

Lecture 6. Numerical methods. Approximation of functions Lecture 6 Numerical methods Approximation of functions Lecture 6 OUTLINE 1. Approximation and interpolation 2. Least-square method basis functions design matrix residual weighted least squares normal equation

More information

Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices

Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices Applications of Randomized Methods for Decomposing and Simulating from Large Covariance Matrices Vahid Dehdari and Clayton V. Deutsch Geostatistical modeling involves many variables and many locations.

More information

Effect of velocity uncertainty on amplitude information

Effect of velocity uncertainty on amplitude information Stanford Exploration Project, Report 111, June 9, 2002, pages 253 267 Short Note Effect of velocity uncertainty on amplitude information Robert G. Clapp 1 INTRODUCTION Risk assessment is a key component

More information

INDUSTRIAL MATHEMATICS INSTITUTE. B.S. Kashin and V.N. Temlyakov. IMI Preprint Series. Department of Mathematics University of South Carolina

INDUSTRIAL MATHEMATICS INSTITUTE. B.S. Kashin and V.N. Temlyakov. IMI Preprint Series. Department of Mathematics University of South Carolina INDUSTRIAL MATHEMATICS INSTITUTE 2007:08 A remark on compressed sensing B.S. Kashin and V.N. Temlyakov IMI Preprint Series Department of Mathematics University of South Carolina A remark on compressed

More information

Linear Inverse Problems

Linear Inverse Problems Linear Inverse Problems Ajinkya Kadu Utrecht University, The Netherlands February 26, 2018 Outline Introduction Least-squares Reconstruction Methods Examples Summary Introduction 2 What are inverse problems?

More information

Data Mining and Matrices

Data Mining and Matrices Data Mining and Matrices 05 Semi-Discrete Decomposition Rainer Gemulla, Pauli Miettinen May 16, 2013 Outline 1 Hunting the Bump 2 Semi-Discrete Decomposition 3 The Algorithm 4 Applications SDD alone SVD

More information

Krylov subspace iterative methods for nonsymmetric discrete ill-posed problems in image restoration

Krylov subspace iterative methods for nonsymmetric discrete ill-posed problems in image restoration Krylov subspace iterative methods for nonsymmetric discrete ill-posed problems in image restoration D. Calvetti a, B. Lewis b and L. Reichel c a Department of Mathematics, Case Western Reserve University,

More information

Mathematical Beer Goggles or The Mathematics of Image Processing

Mathematical Beer Goggles or The Mathematics of Image Processing How Mathematical Beer Goggles or The Mathematics of Image Processing Department of Mathematical Sciences University of Bath Postgraduate Seminar Series University of Bath 12th February 2008 1 How 2 How

More information

Geophysical Data Analysis: Discrete Inverse Theory

Geophysical Data Analysis: Discrete Inverse Theory Geophysical Data Analysis: Discrete Inverse Theory MATLAB Edition William Menke Lamont-Doherty Earth Observatory and Department of Earth and Environmental Sciences Columbia University. ' - Palisades, New

More information

Singular Value Decomposition. 1 Singular Value Decomposition and the Four Fundamental Subspaces

Singular Value Decomposition. 1 Singular Value Decomposition and the Four Fundamental Subspaces Singular Value Decomposition This handout is a review of some basic concepts in linear algebra For a detailed introduction, consult a linear algebra text Linear lgebra and its pplications by Gilbert Strang

More information

Answers in blue. If you have questions or spot an error, let me know. 1. Find all matrices that commute with A =. 4 3

Answers in blue. If you have questions or spot an error, let me know. 1. Find all matrices that commute with A =. 4 3 Answers in blue. If you have questions or spot an error, let me know. 3 4. Find all matrices that commute with A =. 4 3 a b If we set B = and set AB = BA, we see that 3a + 4b = 3a 4c, 4a + 3b = 3b 4d,

More information

Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story

Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story Observation of shear-wave splitting from microseismicity induced by hydraulic fracturing: A non-vti story Petr Kolinsky 1, Leo Eisner 1, Vladimir Grechka 2, Dana Jurick 3, Peter Duncan 1 Summary Shear

More information

1 Linearity and Linear Systems

1 Linearity and Linear Systems Mathematical Tools for Neuroscience (NEU 34) Princeton University, Spring 26 Jonathan Pillow Lecture 7-8 notes: Linear systems & SVD Linearity and Linear Systems Linear system is a kind of mapping f( x)

More information

Review of similarity transformation and Singular Value Decomposition

Review of similarity transformation and Singular Value Decomposition Review of similarity transformation and Singular Value Decomposition Nasser M Abbasi Applied Mathematics Department, California State University, Fullerton July 8 7 page compiled on June 9, 5 at 9:5pm

More information

Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name:

Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name: Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition Due date: Friday, May 4, 2018 (1:35pm) Name: Section Number Assignment #10: Diagonalization

More information

Time-to-depth conversion and seismic velocity estimation using time-migration velocity a

Time-to-depth conversion and seismic velocity estimation using time-migration velocity a Time-to-depth conversion and seismic velocity estimation using time-migration velocity a a Published in Geophysics, 73, no. 5, VE205-VE210, (2008) Maria Cameron, Sergey Fomel, and James Sethian ABSTRACT

More information

Linear Algebra and Matrices

Linear Algebra and Matrices Linear Algebra and Matrices 4 Overview In this chapter we studying true matrix operations, not element operations as was done in earlier chapters. Working with MAT- LAB functions should now be fairly routine.

More information

The Inversion Problem: solving parameters inversion and assimilation problems

The Inversion Problem: solving parameters inversion and assimilation problems The Inversion Problem: solving parameters inversion and assimilation problems UE Numerical Methods Workshop Romain Brossier romain.brossier@univ-grenoble-alpes.fr ISTerre, Univ. Grenoble Alpes Master 08/09/2016

More information

Chapter 1. Forward and Inverse Problem in Geophysics

Chapter 1. Forward and Inverse Problem in Geophysics Chapter. Forward and Inverse Problem in Geophysics Chapter. Forward and Inverse Problem in Geophysics.. Introduction Geophysical methods are based on the study of the propagation of different physical

More information

Linear Least Squares. Using SVD Decomposition.

Linear Least Squares. Using SVD Decomposition. Linear Least Squares. Using SVD Decomposition. Dmitriy Leykekhman Spring 2011 Goals SVD-decomposition. Solving LLS with SVD-decomposition. D. Leykekhman Linear Least Squares 1 SVD Decomposition. For any

More information

One Picture and a Thousand Words Using Matrix Approximtions October 2017 Oak Ridge National Lab Dianne P. O Leary c 2017

One Picture and a Thousand Words Using Matrix Approximtions October 2017 Oak Ridge National Lab Dianne P. O Leary c 2017 One Picture and a Thousand Words Using Matrix Approximtions October 2017 Oak Ridge National Lab Dianne P. O Leary c 2017 1 One Picture and a Thousand Words Using Matrix Approximations Dianne P. O Leary

More information

Computational Methods CMSC/AMSC/MAPL 460. EigenValue decomposition Singular Value Decomposition. Ramani Duraiswami, Dept. of Computer Science

Computational Methods CMSC/AMSC/MAPL 460. EigenValue decomposition Singular Value Decomposition. Ramani Duraiswami, Dept. of Computer Science Computational Methods CMSC/AMSC/MAPL 460 EigenValue decomposition Singular Value Decomposition Ramani Duraiswami, Dept. of Computer Science Hermitian Matrices A square matrix for which A = A H is said

More information

3D VTI traveltime tomography for near-surface imaging Lina Zhang*, Jie Zhang, Wei Zhang, University of Science and Technology of China (USTC)

3D VTI traveltime tomography for near-surface imaging Lina Zhang*, Jie Zhang, Wei Zhang, University of Science and Technology of China (USTC) Downloaded 01/03/14 to 16.01.198.34. Redistribution subject to SEG license or copyright; see Terms of Use at http://library.seg.org/ 3D VTI traveltime tomography for near-surface imaging Lina Zhang*, Jie

More information

The QR Factorization

The QR Factorization The QR Factorization How to Make Matrices Nicer Radu Trîmbiţaş Babeş-Bolyai University March 11, 2009 Radu Trîmbiţaş ( Babeş-Bolyai University) The QR Factorization March 11, 2009 1 / 25 Projectors A projector

More information

Inverse problems in statistics

Inverse problems in statistics Inverse problems in statistics Laurent Cavalier (Université Aix-Marseille 1, France) Yale, May 2 2011 p. 1/35 Introduction There exist many fields where inverse problems appear Astronomy (Hubble satellite).

More information

Math 3191 Applied Linear Algebra

Math 3191 Applied Linear Algebra Math 9 Applied Linear Algebra Lecture : Orthogonal Projections, Gram-Schmidt Stephen Billups University of Colorado at Denver Math 9Applied Linear Algebra p./ Orthonormal Sets A set of vectors {u, u,...,

More information

Linear Inverse Problems. A MATLAB Tutorial Presented by Johnny Samuels

Linear Inverse Problems. A MATLAB Tutorial Presented by Johnny Samuels Linear Inverse Problems A MATLAB Tutorial Presented by Johnny Samuels What do we want to do? We want to develop a method to determine the best fit to a set of data: e.g. The Plan Review pertinent linear

More information

1. The Polar Decomposition

1. The Polar Decomposition A PERSONAL INTERVIEW WITH THE SINGULAR VALUE DECOMPOSITION MATAN GAVISH Part. Theory. The Polar Decomposition In what follows, F denotes either R or C. The vector space F n is an inner product space with

More information

Dimension Reduction Techniques. Presented by Jie (Jerry) Yu

Dimension Reduction Techniques. Presented by Jie (Jerry) Yu Dimension Reduction Techniques Presented by Jie (Jerry) Yu Outline Problem Modeling Review of PCA and MDS Isomap Local Linear Embedding (LLE) Charting Background Advances in data collection and storage

More information

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works

CS168: The Modern Algorithmic Toolbox Lecture #8: How PCA Works CS68: The Modern Algorithmic Toolbox Lecture #8: How PCA Works Tim Roughgarden & Gregory Valiant April 20, 206 Introduction Last lecture introduced the idea of principal components analysis (PCA). The

More information

CS6964: Notes On Linear Systems

CS6964: Notes On Linear Systems CS6964: Notes On Linear Systems 1 Linear Systems Systems of equations that are linear in the unknowns are said to be linear systems For instance ax 1 + bx 2 dx 1 + ex 2 = c = f gives 2 equations and 2

More information

An Overview of Sparsity with Applications to Compression, Restoration, and Inverse Problems

An Overview of Sparsity with Applications to Compression, Restoration, and Inverse Problems An Overview of Sparsity with Applications to Compression, Restoration, and Inverse Problems Justin Romberg Georgia Tech, School of ECE ENS Winter School January 9, 2012 Lyon, France Applied and Computational

More information

Gopalkrishna Veni. Project 4 (Active Shape Models)

Gopalkrishna Veni. Project 4 (Active Shape Models) Gopalkrishna Veni Project 4 (Active Shape Models) Introduction Active shape Model (ASM) is a technique of building a model by learning the variability patterns from training datasets. ASMs try to deform

More information

This ensures that we walk downhill. For fixed λ not even this may be the case.

This ensures that we walk downhill. For fixed λ not even this may be the case. Gradient Descent Objective Function Some differentiable function f : R n R. Gradient Descent Start with some x 0, i = 0 and learning rate λ repeat x i+1 = x i λ f(x i ) until f(x i+1 ) ɛ Line Search Variant

More information

Seismic tomography with co-located soft data

Seismic tomography with co-located soft data Seismic tomography with co-located soft data Mohammad Maysami and Robert G. Clapp ABSTRACT There is a wide range of uncertainties present in seismic data. Limited subsurface illumination is also common,

More information

CS227-Scientific Computing. Lecture 4: A Crash Course in Linear Algebra

CS227-Scientific Computing. Lecture 4: A Crash Course in Linear Algebra CS227-Scientific Computing Lecture 4: A Crash Course in Linear Algebra Linear Transformation of Variables A common phenomenon: Two sets of quantities linearly related: y = 3x + x 2 4x 3 y 2 = 2.7x 2 x

More information

Approximation of Multivariate Functions

Approximation of Multivariate Functions Approximation of Multivariate Functions Vladimir Ya. Lin and Allan Pinkus Abstract. We discuss one approach to the problem of approximating functions of many variables which is truly multivariate in character.

More information

Linear inversion methods and generalized cross-validation

Linear inversion methods and generalized cross-validation Online supplement to Using generalized cross-validation to select parameters in inversions for regional caron fluxes Linear inversion methods and generalized cross-validation NIR Y. KRAKAUER AND TAPIO

More information

A new method for multi-exponential inversion of NMR relaxation measurements

A new method for multi-exponential inversion of NMR relaxation measurements Science in China Ser. G Physics, Mechanics & Astronomy 2004 Vol.47 No.3 265 276 265 A new method for multi-exponential inversion of NMR relaxation measurements WANG Zhongdong 1, 2, XIAO Lizhi 1 & LIU Tangyan

More information

5 Linear Algebra and Inverse Problem

5 Linear Algebra and Inverse Problem 5 Linear Algebra and Inverse Problem 5.1 Introduction Direct problem ( Forward problem) is to find field quantities satisfying Governing equations, Boundary conditions, Initial conditions. The direct problem

More information

Fundamentals of Linear Algebra. Marcel B. Finan Arkansas Tech University c All Rights Reserved

Fundamentals of Linear Algebra. Marcel B. Finan Arkansas Tech University c All Rights Reserved Fundamentals of Linear Algebra Marcel B. Finan Arkansas Tech University c All Rights Reserved 2 PREFACE Linear algebra has evolved as a branch of mathematics with wide range of applications to the natural

More information

Multiple Scenario Inversion of Reflection Seismic Prestack Data

Multiple Scenario Inversion of Reflection Seismic Prestack Data Downloaded from orbit.dtu.dk on: Nov 28, 2018 Multiple Scenario Inversion of Reflection Seismic Prestack Data Hansen, Thomas Mejer; Cordua, Knud Skou; Mosegaard, Klaus Publication date: 2013 Document Version

More information

A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition

A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition F Bozzoli 1,2, L Cattani 1,2, A Mocerino 1, S Rainieri 1,2, F S V Bazán 3

More information

7. Symmetric Matrices and Quadratic Forms

7. Symmetric Matrices and Quadratic Forms Linear Algebra 7. Symmetric Matrices and Quadratic Forms CSIE NCU 1 7. Symmetric Matrices and Quadratic Forms 7.1 Diagonalization of symmetric matrices 2 7.2 Quadratic forms.. 9 7.4 The singular value

More information

Principal Component Analysis. Applied Multivariate Statistics Spring 2012

Principal Component Analysis. Applied Multivariate Statistics Spring 2012 Principal Component Analysis Applied Multivariate Statistics Spring 2012 Overview Intuition Four definitions Practical examples Mathematical example Case study 2 PCA: Goals Goal 1: Dimension reduction

More information

Background Mathematics (2/2) 1. David Barber

Background Mathematics (2/2) 1. David Barber Background Mathematics (2/2) 1 David Barber University College London Modified by Samson Cheung (sccheung@ieee.org) 1 These slides accompany the book Bayesian Reasoning and Machine Learning. The book and

More information

Least squares: the big idea

Least squares: the big idea Notes for 2016-02-22 Least squares: the big idea Least squares problems are a special sort of minimization problem. Suppose A R m n where m > n. In general, we cannot solve the overdetermined system Ax

More information

DELFT UNIVERSITY OF TECHNOLOGY

DELFT UNIVERSITY OF TECHNOLOGY DELFT UNIVERSITY OF TECHNOLOGY REPORT 10-12 Large-Scale Eigenvalue Problems in Trust-Region Calculations Marielba Rojas, Bjørn H. Fotland, and Trond Steihaug ISSN 1389-6520 Reports of the Department of

More information

MARN 5898 Regularized Linear Least Squares.

MARN 5898 Regularized Linear Least Squares. MARN 5898 Regularized Linear Least Squares. Dmitriy Leykekhman Spring 2010 Goals Understanding the regularization. D. Leykekhman - MARN 5898 Parameter estimation in marine sciences Linear Least Squares

More information

DS-GA 1002 Lecture notes 10 November 23, Linear models

DS-GA 1002 Lecture notes 10 November 23, Linear models DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.

More information