A Nonlinear Sparsity Promoting Formulation and Algorithm for Full Waveform Inversion
|
|
- Scarlett Strickland
- 5 years ago
- Views:
Transcription
1 A Nonlinear Sparsity Prooting Forulation and Algorith for Full Wavefor Inversion Aleksandr Aravkin, Tristan van Leeuwen, Jaes V. Burke 2 and Felix Herrann Dept. of Earth and Ocean sciences University of British Colubia Vancouver, BC, Canada 2 Dept. of Matheatics University of Washington Seattle, WA January 4, 2 Abstract Full Wavefor Inversion (FWI) is a coputational procedure to extract ediu paraeters fro seisic data. FWI is typically forulated as a nonlinear least squares optiization proble, and various regularization techniques are used to guide the optiization because the proble is illposed. In this paper, we propose a novel sparse regularization which exploits the ability of curvelets to efficiently represent geophysical iages. We then forulate a corresponding sparsity prooting constrained optiization proble, which we call Nonlinear Basis Pursuit Denoise (NBPDN) and present an algorith to solve this proble to recover ediu paraeters. The utility of the NBPDN forulation and efficacy of the algorith are deonstrated on a stylized cross-well experient, where a sparse velocity perturbation is recovered with higher quality than the standard FWI forulation (solved with LBFGS). The NBPDN forulation and algorith can recover the sparse perturbation even when the data volue is copressed to 5% of the original size using rando superposition. Introduction Full Wavefor Inversion (FWI) is a data-fitting procedure based on full wavefield odeling designed to extract ediu paraeters (velocity and density) fro seisogras. Coputational ethods for wavefor inversion go back ore than 2 years (see, e.g, Tarantola (984)) and the proble has been consistently forulated as a nonlinear least squares or siilar type of optiization proble (Virieux and Operto (29)). It is useful at this point to provide an explicit fraework for a typical FWI approach: φ() := D PH[] Q 2 F () where 2 F is the Frobenius nor, is a vector of velocity paraeters in a 2D or 3D grid, D R k l contains results of l source experients (as k-diensional coluns), H[] is a discretization of the Helholtz operator with boundary conditions, Q R p l specifies l source experients, H []Q describes the solution of the Helholtz equation for the sources Q, and P is a restriction of this solution to the surface where the data was observed. FWI is widely known to be an ill-posed proble, and so regularization strategies are applied in practice (see Virieux and Operto (29) and sources within). A coon strategy is least squares regularization, where given reasonable guess of prior paraeters, one solves the proble φ()+( ) T W( ) (2) where W is soe weighting atrix that encodes the confidence in the prior guess as well as relationship (correlations) between the paraeters. Alternative odels using total variation (TV) regularization have also been proposed (see e.g. Vogel and Oan (996)). The ai of the present paper is to forulate an alternative regularization approach based on sparsity
2 5% of coeff. % of coeff. Figure Partial Maroussi odel in curvelets: 5% of the largest curvelet coefficients capture ost of the features of the full representation. prootion, to develop an algorith for the solution of the resulting optiization proble, and to show the results of the new algorith on a toy exaple. Sparsity prootion for seisic data using curvelets The curvelet frae was presented as an effective nonadaptive representation for objects with edges in the seal paper Candes and Donoho (2). The key result in that paper is that the curvelet frae provides a stable, efficient, and near-optial representation of otherwise sooth objects having discontinuities along sooth curves. While there ay be liitations to this characterization of geophysical iages, it is iportant to note that such iages are layered due to geological sedientation, and this feature allows for efficient representations using curvelets. Motivated by this observation, researchers have used curvelet representations in igration, diensionality reduction, siulation, and sparse sapling applications (see Hennenfent et al. (2); Herrann et al. (29, 28, 27)). See also Figure for a siple deonstration. The notion that velocity paraeters should be sparse (or at least copressible) in the curvelet representation leads to a sparse regularization of FWI (copare with eq. (2)): x φ(c x)+λ x, (3) where C denotes the curvelet basis and x is the vector of curvelet coefficients corresponding to the velocity paraeters, i.e. = C x, the ter x serves to proote sparsity in this representation, and λ is a paraeter that balances sparsity in curvelets vs. odel fit. While this is a reasonable forulation, λ ust be known ahead of tie, and it is not clear how to choose it. Rather than working with eq. (3), we go to a closely related constrained reforulation x x s.t. g(c x) σ, (4) where as before the objective x serves to proote sparsity in this representation, and the paraeter σ is a regularization paraeter that deteres the acceptable value of the residual D RH[C x] Q F (i.e. noise level in the data). Unlike λ in eq. (3), the paraeter σ in eq. (4) is likely to be known to scientists working with inverse probles in geophysics. Note that the forulation (4) is a natural nonlinear extension to the Basis Pursuit Denoise (BPDN) forulation used in copressive sensing literature to for sparse signal recovery fro under-sapled noisy data (see van den Berg and Friedlander (28)). The optiization forulation (4) is harder to solve then (), and requires a custo algorith. The ain contribution of this paper is to describe such an algorith and deonstrate its perforance on a siplified proble of the for s.t. D PH[ + ] Q F σ, (5) 73 rd EAGE Conference & Exhibition incorporating SPE EUROPEC 2 Vienna, Austria, May 2
3 for a situation where we are trying to recover a velocity perturbation relative to a constant background velocity, and so the perturbation is sparse in the physical doain. The algorith for (5) can also be used to solve (4), but requires special care to aintain the feasibility of transfored velocities C x. Nonlinear Basis Pursuit Denoise (NBPDN) algorith To solve (5), we ipleent an iterated algorith of the for ν+ = ν + τ ν s ν, (6) where s ν is the solution to a particular subproble at step ν, and τ ν is a step size chosen by a line search strategy. In developing the algorith, especially in the line search for τ ν, we follow ideas presented in Burke (989) and Burke (992). To obtain the subproble, at each step ν, we linearize the functions and D RH[ + ] Q, and solve the resulting optiization proble, using a ν-dependent paraeter σ ν : ν + s s s.t. D F( ν ) F( ν (7) )(s) F σ ν, where F() = PH[ + ] Q and F( ν ) denotes the linearized Born scattering operator. The solution to this proble is the direction s ν that appears in eq. (6). To solve this proble, we use the substitution y= ν + s to obtain y y (D F( ) s.t. ν )+ F(ν)ν F( ν )(y) σ ν. F (8) For a fixed ν, this proble is now equivalent to the basis pursuit denoise (BPDN) proble detailed in van den Berg and Friedlander (28). The algorith in that paper, called SPGl, allows us to solve (8) quickly, and oreover allows a functional representation of F to be provided (specifying its action on vectors y) rather than requiring an explicit atrix representation. The paraeters σ ν are chosen to start large and decrease untill it reaches the σ paraeter specified by the user. To obtain the step paraeter τ ν, we first define an auxiliary penalty function P α ()= + α( D F() 2 σ) +, which includes both the sparsity prooting objective and a easure of the distance fro optiality. The paraeter α ν is then selected to ensure that s ν, the solution to (5), is a descent direction for P αν (). In other words, the choice of α ν ensures P αν ( ν + s ν ) P αν ( ν ) <. We then use the backtracking Arijo line search (see e.g. Nocedal and Wright (999)) using the erit function P αν (). The resulting step τ ν is used to update the odel as described in (6). Results To illustrate the new algorith and the power of sparsity regularization, we considered a stylized crosswell proble. The true velocity consists of three sall features ebedded in a constant background of 2k/s and is depicted in figure 2. The features are sparse in the pixel-basis so we can directly enforce sparsity on the recovered perturbation. We use a 9-point discretization of the Helholtz operator with absorbing boundaries on a grid with spacing. The data are generated for equispaced sources and receivers located in vertical wells 8 apart for (randoly chosen) frequencies [5., 6.,.5, 4., 5.5, 7.5, 23.5] Hz. We consider two different scenarios: inversion with all the sources and inversion using only 5 randoly synthesized supershots. These are generated by weighting all the sources with rando Gaussian weights and stacking. Such techniques have recently been proposed to draatically reduce the costs of FWI (Krebs et al., 29; Moghadda and Herrann, 2; Haber et al., 2) (see also other contributions of the authors to these proceedings). We copare the use of unregularized L-BFGS on () and the newly proposed algorith on (8). The results are depicted in figure 2. We see that when using all the sources the unregularized approach produces a reasonable 73 rd EAGE Conference & Exhibition incorporating SPE EUROPEC 2 Vienna, Austria, May 2
4 iage. The resolution is not very high, as expected, and the vertical sides of the circle are not well recovered. The NBPDN algorith, however, produces a nearly exact recovery. The circle is now recovered copletely but the horizontal bar is soewhat distorted. When using only 5 supershots (a reduction of a factor 2 in the data volue) the L-BFGS approach produces an unusable iage. The artifacts introduced by the crosstalk between the shots copletely obscures the recovered velocity perturbations. The NBPDN forulation, rearkably, gives us alost the sae result as before. Conclusion We forulated FWI as a non-linear, sparsity prooting optiization proble. The underlying assuption is that the ediu paraeters that we are trying to recover have a sparse representation in soe basis. In particular, we envision that typical velocity structures are sparse in curvelets. Instead of adding a penalty ter to the isfit ter with a regularization paraeter, as is coonly done in for exaple TV regularization, we propose to iize the penalty subject to the isfit being saller than soe preset error level. The advantage of this forulation copared to other sparsity prooting strategies (e.g. LASSO) is that this error level ay be easier to detere than the regularization paraeter. We deonstrate the algorith on a toy cross-well exaple, where the unknown velocity perturbation is sparse in the pixel-basis. Copared to an unregularized least-squares inversion, our approach gives a superior result with uch higher resolution. We also consider using randoly synthesized data to reduce the coputational cost of the inversion. Such a reduction coes at the cost of introducing crosstalk between the shots. In the unregularized inversion, this crosstalk overshadows the reconstructed velocity perturbations. With the regularized inversion, however, we obtain a result nearly identical to the earlier case at roughly 5% of the coputational cost. The latter result ay be tentatively explained by invoking results fro copressive sensing; a sparse signal ay be reconstructed fro severely undersapled data by solving a linear sparsity prooting progra as long as the sapling satisfies soe additional criteria. Most notably, the sapling ust be rando. The current forulation is a direct generalization of the sparsity prooting linear forulation used in copressive sensing. Future research will be aied at further exploiting the connection to copressive sensing. 73 rd EAGE Conference & Exhibition incorporating SPE EUROPEC 2 Vienna, Austria, May 2
5 (a) (b) (c).5.5 (d).5 (e).5.5 Figure 2 (a) True odel for cross-well experient; asterisks are sources and triangles are receivers. (b) LBFGS recovery using full data ( shots). (c) NBPDN recovery using full data ( shots). (d) LBFGS recovery using five supershots (2 x speedup). (e) NBPDN recovery using five supershots (2 x speedup). References Burke, J.V. [989] A sequential quadratic prograg ethod for potentially infeasible atheatical progras. Journal of Matheatical Analysis and Applications, 39(2), Burke, J.V. [992] A robust trust region ethod for constrained nonlinear prograg probles. SIAM Journal on Optiization, 2(2), , doi:.37/826. Candes, E.J. and Donoho, D.L. [2] Curves and Surfaces, Vanderbilt University Press, Nashville, TN., chap. Curvelets - a surprisingly effective nonadaptive representation for objects with edges. Haber, E., Chung, M. and Herrann, F.J. [2] An effective ethod for paraeter estiation with pde constraints with ultiple right hand sides. Tech. Rep. TR-2-4, UBC-Earth and Ocean Sciences Departent. Hennenfent, G., Fenelon, L. and Herrann, F.J. [2] Nonequispaced curvelet transfor for seisic data reconstruction: a sparsity-prooting approach. Tech. Rep. TR-2-2, UBC-Earth and Ocean Sciences Departent. Herrann, F.J., Brown, C., Erlangga, Y. and Moghadda, P. [28] Curvelet-based igration preconditioning and scaling. Tech. Rep. TR-28-, The University of British Colubia, subitted for publication. Herrann, F.J., Erlangga, Y.A. and Lin, T. [29] Copressive siultaneous full-wavefor siulation. Geophysics, 74, A35. Herrann, F.J., Moghadda, P.P. and Stolk, C.C. [27] Sparsity- and continuity-prooting seisic iage recovery with curvelet fraes. Accepted for publication in the Journal of Applied and Coputational Haronic Analysis. Krebs, J.R. et al. [29] Fast full-wavefield seisic inversion using encoded sources. Geophysics, 74(6), WCC77 WCC88, doi:.9/ Moghadda, P.P. and Herrann, F.J. [2] Randoized full-wavefor inversion: a dienstionality-reduction approach. SEG Technical Progra Expanded Abstracts, 29(), , doi:.9/ Nocedal, J. and Wright, S.J. [999] Nuerical Optiization. Springer Series in Operations Research, Springer. Tarantola, A. [984] Inversion of seisic reflection data in the acoustic approxiation. Geophysics, 49(8), , doi:.9/ van den Berg, E. and Friedlander, M.P. [28] Probing the pareto frontier for basis pursuit solutions. SIAM Journal on Scientific Coputing, 3(2), 89 92, doi:.37/ Virieux, J. and Operto, S. [29] An overview of full-wavefor inversion in exploration geophysics. Geophysics, 74, 27 +, doi:.9/ Vogel, C.R. and Oan, M.E. [996] Iterative ethods for total variation denoising. SIAM J. Sci. Coput., 7, , ISSN , doi:.37/ rd EAGE Conference & Exhibition incorporating SPE EUROPEC 2 Vienna, Austria, May 2
FWI with Compressive Updates Aleksandr Aravkin, Felix Herrmann, Tristan van Leeuwen, Xiang Li, James Burke
Consortium 2010 FWI with Compressive Updates Aleksandr Aravkin, Felix Herrmann, Tristan van Leeuwen, Xiang Li, James Burke SLIM University of British Columbia Full Waveform Inversion The Full Waveform
More informationRecovering Data from Underdetermined Quadratic Measurements (CS 229a Project: Final Writeup)
Recovering Data fro Underdeterined Quadratic Measureents (CS 229a Project: Final Writeup) Mahdi Soltanolkotabi Deceber 16, 2011 1 Introduction Data that arises fro engineering applications often contains
More informationP016 Toward Gauss-Newton and Exact Newton Optimization for Full Waveform Inversion
P016 Toward Gauss-Newton and Exact Newton Optiization for Full Wavefor Inversion L. Métivier* ISTerre, R. Brossier ISTerre, J. Virieux ISTerre & S. Operto Géoazur SUMMARY Full Wavefor Inversion FWI applications
More information3D acoustic wave modeling with a time-space domain dispersion-relation-based Finite-difference scheme
P-8 3D acoustic wave odeling with a tie-space doain dispersion-relation-based Finite-difference schee Yang Liu * and rinal K. Sen State Key Laboratory of Petroleu Resource and Prospecting (China University
More informationSharp Time Data Tradeoffs for Linear Inverse Problems
Sharp Tie Data Tradeoffs for Linear Inverse Probles Saet Oyak Benjain Recht Mahdi Soltanolkotabi January 016 Abstract In this paper we characterize sharp tie-data tradeoffs for optiization probles used
More informationSource estimation for frequency-domain FWI with robust penalties
Source estimation for frequency-domain FWI with robust penalties Aleksandr Y. Aravkin, Tristan van Leeuwen, Henri Calandra, and Felix J. Herrmann Dept. of Earth and Ocean sciences University of British
More informationP032 3D Seismic Diffraction Modeling in Multilayered Media in Terms of Surface Integrals
P032 3D Seisic Diffraction Modeling in Multilayered Media in Ters of Surface Integrals A.M. Aizenberg (Institute of Geophysics SB RAS, M. Ayzenberg* (Norwegian University of Science & Technology, H.B.
More informationModel Fitting. CURM Background Material, Fall 2014 Dr. Doreen De Leon
Model Fitting CURM Background Material, Fall 014 Dr. Doreen De Leon 1 Introduction Given a set of data points, we often want to fit a selected odel or type to the data (e.g., we suspect an exponential
More informationTracking using CONDENSATION: Conditional Density Propagation
Tracking using CONDENSATION: Conditional Density Propagation Goal Model-based visual tracking in dense clutter at near video frae rates M. Isard and A. Blake, CONDENSATION Conditional density propagation
More informationStochastic Subgradient Methods
Stochastic Subgradient Methods Lingjie Weng Yutian Chen Bren School of Inforation and Coputer Science University of California, Irvine {wengl, yutianc}@ics.uci.edu Abstract Stochastic subgradient ethods
More informationSuppress Parameter Cross-talk for Elastic Full-waveform Inversion: Parameterization and Acquisition Geometry
Suress Paraeter Cross-talk for Elastic Full-wavefor Inversion: Paraeterization and Acquisition Geoetry Wenyong Pan and Kris Innanen CREWES Project, Deartent of Geoscience, University of Calgary Suary Full-wavefor
More informationWeighted- 1 minimization with multiple weighting sets
Weighted- 1 iniization with ultiple weighting sets Hassan Mansour a,b and Özgür Yılaza a Matheatics Departent, University of British Colubia, Vancouver - BC, Canada; b Coputer Science Departent, University
More informationCOS 424: Interacting with Data. Written Exercises
COS 424: Interacting with Data Hoework #4 Spring 2007 Regression Due: Wednesday, April 18 Written Exercises See the course website for iportant inforation about collaboration and late policies, as well
More informationRandomized Recovery for Boolean Compressed Sensing
Randoized Recovery for Boolean Copressed Sensing Mitra Fatei and Martin Vetterli Laboratory of Audiovisual Counication École Polytechnique Fédéral de Lausanne (EPFL) Eail: {itra.fatei, artin.vetterli}@epfl.ch
More informationData-Driven Imaging in Anisotropic Media
18 th World Conference on Non destructive Testing, 16- April 1, Durban, South Africa Data-Driven Iaging in Anisotropic Media Arno VOLKER 1 and Alan HUNTER 1 TNO Stieltjesweg 1, 6 AD, Delft, The Netherlands
More informationMulti-Scale/Multi-Resolution: Wavelet Transform
Multi-Scale/Multi-Resolution: Wavelet Transfor Proble with Fourier Fourier analysis -- breaks down a signal into constituent sinusoids of different frequencies. A serious drawback in transforing to the
More informationSeismic data interpolation and denoising using SVD-free low-rank matrix factorization
Seismic data interpolation and denoising using SVD-free low-rank matrix factorization R. Kumar, A.Y. Aravkin,, H. Mansour,, B. Recht and F.J. Herrmann Dept. of Earth and Ocean sciences, University of British
More informationCompressive Distilled Sensing: Sparse Recovery Using Adaptivity in Compressive Measurements
1 Copressive Distilled Sensing: Sparse Recovery Using Adaptivity in Copressive Measureents Jarvis D. Haupt 1 Richard G. Baraniuk 1 Rui M. Castro 2 and Robert D. Nowak 3 1 Dept. of Electrical and Coputer
More informationRECOVERY OF A DENSITY FROM THE EIGENVALUES OF A NONHOMOGENEOUS MEMBRANE
Proceedings of ICIPE rd International Conference on Inverse Probles in Engineering: Theory and Practice June -8, 999, Port Ludlow, Washington, USA : RECOVERY OF A DENSITY FROM THE EIGENVALUES OF A NONHOMOGENEOUS
More informationLower Bounds for Quantized Matrix Completion
Lower Bounds for Quantized Matrix Copletion Mary Wootters and Yaniv Plan Departent of Matheatics University of Michigan Ann Arbor, MI Eail: wootters, yplan}@uich.edu Mark A. Davenport School of Elec. &
More informationA Simplified Analytical Approach for Efficiency Evaluation of the Weaving Machines with Automatic Filling Repair
Proceedings of the 6th SEAS International Conference on Siulation, Modelling and Optiization, Lisbon, Portugal, Septeber -4, 006 0 A Siplified Analytical Approach for Efficiency Evaluation of the eaving
More informatione-companion ONLY AVAILABLE IN ELECTRONIC FORM
OPERATIONS RESEARCH doi 10.1287/opre.1070.0427ec pp. ec1 ec5 e-copanion ONLY AVAILABLE IN ELECTRONIC FORM infors 07 INFORMS Electronic Copanion A Learning Approach for Interactive Marketing to a Custoer
More informationHamming Compressed Sensing
Haing Copressed Sensing Tianyi Zhou, and Dacheng Tao, Meber, IEEE Abstract arxiv:.73v2 [cs.it] Oct 2 Copressed sensing CS and -bit CS cannot directly recover quantized signals and require tie consuing
More informationOptimal nonlinear Bayesian experimental design: an application to amplitude versus offset experiments
Geophys. J. Int. (23) 155, 411 421 Optial nonlinear Bayesian experiental design: an application to aplitude versus offset experients Jojanneke van den Berg, 1, Andrew Curtis 2,3 and Jeannot Trapert 1 1
More informationExperimental Design For Model Discrimination And Precise Parameter Estimation In WDS Analysis
City University of New York (CUNY) CUNY Acadeic Works International Conference on Hydroinforatics 8-1-2014 Experiental Design For Model Discriination And Precise Paraeter Estiation In WDS Analysis Giovanna
More informationA PROBABILISTIC AND RIPLESS THEORY OF COMPRESSED SENSING. Emmanuel J. Candès Yaniv Plan. Technical Report No November 2010
A PROBABILISTIC AND RIPLESS THEORY OF COMPRESSED SENSING By Eanuel J Candès Yaniv Plan Technical Report No 200-0 Noveber 200 Departent of Statistics STANFORD UNIVERSITY Stanford, California 94305-4065
More informationEE5900 Spring Lecture 4 IC interconnect modeling methods Zhuo Feng
EE59 Spring Parallel LSI AD Algoriths Lecture I interconnect odeling ethods Zhuo Feng. Z. Feng MTU EE59 So far we ve considered only tie doain analyses We ll soon see that it is soeties preferable to odel
More informationA method to determine relative stroke detection efficiencies from multiplicity distributions
A ethod to deterine relative stroke detection eiciencies ro ultiplicity distributions Schulz W. and Cuins K. 2. Austrian Lightning Detection and Inoration Syste (ALDIS), Kahlenberger Str.2A, 90 Vienna,
More informationarxiv: v1 [math.na] 10 Oct 2016
GREEDY GAUSS-NEWTON ALGORITHM FOR FINDING SPARSE SOLUTIONS TO NONLINEAR UNDERDETERMINED SYSTEMS OF EQUATIONS MÅRTEN GULLIKSSON AND ANNA OLEYNIK arxiv:6.395v [ath.na] Oct 26 Abstract. We consider the proble
More informationPh 20.3 Numerical Solution of Ordinary Differential Equations
Ph 20.3 Nuerical Solution of Ordinary Differential Equations Due: Week 5 -v20170314- This Assignent So far, your assignents have tried to failiarize you with the hardware and software in the Physics Coputing
More informationAn l 1 Regularized Method for Numerical Differentiation Using Empirical Eigenfunctions
Journal of Matheatical Research with Applications Jul., 207, Vol. 37, No. 4, pp. 496 504 DOI:0.3770/j.issn:2095-265.207.04.0 Http://jre.dlut.edu.cn An l Regularized Method for Nuerical Differentiation
More informationINTRODUCTION. Residual migration has proved to be a useful tool in imaging and in velocity analysis.
Stanford Exploration Project, Report, June 3, 999, pages 5 59 Short Note On Stolt prestack residual igration Paul Sava keywords: Stolt, residual igration INTRODUCTION Residual igration has proved to be
More informationOn the theoretical analysis of cross validation in compressive sensing
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.erl.co On the theoretical analysis of cross validation in copressive sensing Zhang, J.; Chen, L.; Boufounos, P.T.; Gu, Y. TR2014-025 May 2014 Abstract
More informationA Probabilistic and RIPless Theory of Compressed Sensing
A Probabilistic and RIPless Theory of Copressed Sensing Eanuel J Candès and Yaniv Plan 2 Departents of Matheatics and of Statistics, Stanford University, Stanford, CA 94305 2 Applied and Coputational Matheatics,
More informationUsing a De-Convolution Window for Operating Modal Analysis
Using a De-Convolution Window for Operating Modal Analysis Brian Schwarz Vibrant Technology, Inc. Scotts Valley, CA Mark Richardson Vibrant Technology, Inc. Scotts Valley, CA Abstract Operating Modal Analysis
More informationNumerical Studies of a Nonlinear Heat Equation with Square Root Reaction Term
Nuerical Studies of a Nonlinear Heat Equation with Square Root Reaction Ter Ron Bucire, 1 Karl McMurtry, 1 Ronald E. Micens 2 1 Matheatics Departent, Occidental College, Los Angeles, California 90041 2
More informationNon-Parametric Non-Line-of-Sight Identification 1
Non-Paraetric Non-Line-of-Sight Identification Sinan Gezici, Hisashi Kobayashi and H. Vincent Poor Departent of Electrical Engineering School of Engineering and Applied Science Princeton University, Princeton,
More informationQ ESTIMATION WITHIN A FORMATION PROGRAM q_estimation
Foration Attributes Progra q_estiation Q ESTIMATION WITHIN A FOMATION POGAM q_estiation Estiating Q between stratal slices Progra q_estiation estiate seisic attenuation (1/Q) on coplex stratal slices using
More informationInterferometry in dissipative media: Addressing the shallow sea problem for Seabed Logging applications
Evert Slob and Kees Wapenaar, Departent of Geotechnology, Delft University of Technology Roel Snieder, Center for Wave Phenoena and Departent of Geophysics, Colorado School of Mines SUMMARY We derive interferoetric
More informationSupport Vector Machine Classification of Uncertain and Imbalanced data using Robust Optimization
Recent Researches in Coputer Science Support Vector Machine Classification of Uncertain and Ibalanced data using Robust Optiization RAGHAV PAT, THEODORE B. TRAFALIS, KASH BARKER School of Industrial Engineering
More informationBlock designs and statistics
Bloc designs and statistics Notes for Math 447 May 3, 2011 The ain paraeters of a bloc design are nuber of varieties v, bloc size, nuber of blocs b. A design is built on a set of v eleents. Each eleent
More informationResearch Article Robust ε-support Vector Regression
Matheatical Probles in Engineering, Article ID 373571, 5 pages http://dx.doi.org/10.1155/2014/373571 Research Article Robust ε-support Vector Regression Yuan Lv and Zhong Gan School of Mechanical Engineering,
More informationA NEW ROBUST AND EFFICIENT ESTIMATOR FOR ILL-CONDITIONED LINEAR INVERSE PROBLEMS WITH OUTLIERS
A NEW ROBUST AND EFFICIENT ESTIMATOR FOR ILL-CONDITIONED LINEAR INVERSE PROBLEMS WITH OUTLIERS Marta Martinez-Caara 1, Michael Mua 2, Abdelhak M. Zoubir 2, Martin Vetterli 1 1 School of Coputer and Counication
More informationTransformation-invariant Collaborative Sub-representation
Transforation-invariant Collaborative Sub-representation Yeqing Li, Chen Chen, Jungzhou Huang Departent of Coputer Science and Engineering University of Texas at Arlington, Texas 769, USA. Eail: yeqing.li@avs.uta.edu,
More informationFeature Extraction Techniques
Feature Extraction Techniques Unsupervised Learning II Feature Extraction Unsupervised ethods can also be used to find features which can be useful for categorization. There are unsupervised ethods that
More informationPattern Recognition and Machine Learning. Artificial Neural networks
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2016/2017 Lessons 9 11 Jan 2017 Outline Artificial Neural networks Notation...2 Convolutional Neural Networks...3
More informationOn the Use of A Priori Information for Sparse Signal Approximations
ITS TECHNICAL REPORT NO. 3/4 On the Use of A Priori Inforation for Sparse Signal Approxiations Oscar Divorra Escoda, Lorenzo Granai and Pierre Vandergheynst Signal Processing Institute ITS) Ecole Polytechnique
More informationInspection; structural health monitoring; reliability; Bayesian analysis; updating; decision analysis; value of information
Cite as: Straub D. (2014). Value of inforation analysis with structural reliability ethods. Structural Safety, 49: 75-86. Value of Inforation Analysis with Structural Reliability Methods Daniel Straub
More informationPAC-Bayes Analysis Of Maximum Entropy Learning
PAC-Bayes Analysis Of Maxiu Entropy Learning John Shawe-Taylor and David R. Hardoon Centre for Coputational Statistics and Machine Learning Departent of Coputer Science University College London, UK, WC1E
More informationCh 12: Variations on Backpropagation
Ch 2: Variations on Backpropagation The basic backpropagation algorith is too slow for ost practical applications. It ay take days or weeks of coputer tie. We deonstrate why the backpropagation algorith
More informationNUMERICAL MODELLING OF THE TYRE/ROAD CONTACT
NUMERICAL MODELLING OF THE TYRE/ROAD CONTACT PACS REFERENCE: 43.5.LJ Krister Larsson Departent of Applied Acoustics Chalers University of Technology SE-412 96 Sweden Tel: +46 ()31 772 22 Fax: +46 ()31
More informationHIGH RESOLUTION NEAR-FIELD MULTIPLE TARGET DETECTION AND LOCALIZATION USING SUPPORT VECTOR MACHINES
ICONIC 2007 St. Louis, O, USA June 27-29, 2007 HIGH RESOLUTION NEAR-FIELD ULTIPLE TARGET DETECTION AND LOCALIZATION USING SUPPORT VECTOR ACHINES A. Randazzo,. A. Abou-Khousa 2,.Pastorino, and R. Zoughi
More informationKeywords: Estimator, Bias, Mean-squared error, normality, generalized Pareto distribution
Testing approxiate norality of an estiator using the estiated MSE and bias with an application to the shape paraeter of the generalized Pareto distribution J. Martin van Zyl Abstract In this work the norality
More informationIntelligent Systems: Reasoning and Recognition. Perceptrons and Support Vector Machines
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley osig 1 Winter Seester 2018 Lesson 6 27 February 2018 Outline Perceptrons and Support Vector achines Notation...2 Linear odels...3 Lines, Planes
More informationŞtefan ŞTEFĂNESCU * is the minimum global value for the function h (x)
7Applying Nelder Mead s Optiization Algorith APPLYING NELDER MEAD S OPTIMIZATION ALGORITHM FOR MULTIPLE GLOBAL MINIMA Abstract Ştefan ŞTEFĂNESCU * The iterative deterinistic optiization ethod could not
More informationASSUME a source over an alphabet size m, from which a sequence of n independent samples are drawn. The classical
IEEE TRANSACTIONS ON INFORMATION THEORY Large Alphabet Source Coding using Independent Coponent Analysis Aichai Painsky, Meber, IEEE, Saharon Rosset and Meir Feder, Fellow, IEEE arxiv:67.7v [cs.it] Jul
More informationOptimization of ripple filter for pencil beam scanning
Nuclear Science and Techniques 24 (2013) 060404 Optiization of ripple filter for pencil bea scanning YANG Zhaoxia ZHANG Manzhou LI Deing * Shanghai Institute of Applied Physics, Chinese Acadey of Sciences,
More informationQuantum algorithms (CO 781, Winter 2008) Prof. Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search
Quantu algoriths (CO 781, Winter 2008) Prof Andrew Childs, University of Waterloo LECTURE 15: Unstructured search and spatial search ow we begin to discuss applications of quantu walks to search algoriths
More informationAnalysis of Impulsive Natural Phenomena through Finite Difference Methods A MATLAB Computational Project-Based Learning
Analysis of Ipulsive Natural Phenoena through Finite Difference Methods A MATLAB Coputational Project-Based Learning Nicholas Kuia, Christopher Chariah, Mechatronics Engineering, Vaughn College of Aeronautics
More informationMatrix Probing and Simultaneous Sources: A New Approach for Preconditioning the Hessian
Matrix Probing and Simultaneous Sources: A New Approach for Preconditioning the Hessian Curt Da Silva 1 and Felix J. Herrmann 2 1 Dept. of Mathematics 2 Dept. of Earth and Ocean SciencesUniversity of British
More informationAnalyzing Simulation Results
Analyzing Siulation Results Dr. John Mellor-Cruey Departent of Coputer Science Rice University johnc@cs.rice.edu COMP 528 Lecture 20 31 March 2005 Topics for Today Model verification Model validation Transient
More informationSupport recovery in compressed sensing: An estimation theoretic approach
Support recovery in copressed sensing: An estiation theoretic approach Ain Karbasi, Ali Horati, Soheil Mohajer, Martin Vetterli School of Coputer and Counication Sciences École Polytechnique Fédérale de
More informationAn Inverse Interpolation Method Utilizing In-Flight Strain Measurements for Determining Loads and Structural Response of Aerospace Vehicles
An Inverse Interpolation Method Utilizing In-Flight Strain Measureents for Deterining Loads and Structural Response of Aerospace Vehicles S. Shkarayev and R. Krashantisa University of Arizona, Tucson,
More informationA MESHSIZE BOOSTING ALGORITHM IN KERNEL DENSITY ESTIMATION
A eshsize boosting algorith in kernel density estiation A MESHSIZE BOOSTING ALGORITHM IN KERNEL DENSITY ESTIMATION C.C. Ishiekwene, S.M. Ogbonwan and J.E. Osewenkhae Departent of Matheatics, University
More informationHybrid System Identification: An SDP Approach
49th IEEE Conference on Decision and Control Deceber 15-17, 2010 Hilton Atlanta Hotel, Atlanta, GA, USA Hybrid Syste Identification: An SDP Approach C Feng, C M Lagoa, N Ozay and M Sznaier Abstract The
More informationExplicit Approximate Solution for Finding the. Natural Frequency of the Motion of Pendulum. by Using the HAM
Applied Matheatical Sciences Vol. 3 9 no. 1 13-13 Explicit Approxiate Solution for Finding the Natural Frequency of the Motion of Pendulu by Using the HAM Ahad Doosthoseini * Mechanical Engineering Departent
More informationPattern Recognition and Machine Learning. Artificial Neural networks
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2016 Lessons 7 14 Dec 2016 Outline Artificial Neural networks Notation...2 1. Introduction...3... 3 The Artificial
More informationA Simple Regression Problem
A Siple Regression Proble R. M. Castro March 23, 2 In this brief note a siple regression proble will be introduced, illustrating clearly the bias-variance tradeoff. Let Y i f(x i ) + W i, i,..., n, where
More informationCS Lecture 13. More Maximum Likelihood
CS 6347 Lecture 13 More Maxiu Likelihood Recap Last tie: Introduction to axiu likelihood estiation MLE for Bayesian networks Optial CPTs correspond to epirical counts Today: MLE for CRFs 2 Maxiu Likelihood
More informationPattern Recognition and Machine Learning. Learning and Evaluation for Pattern Recognition
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2017 Lesson 1 4 October 2017 Outline Learning and Evaluation for Pattern Recognition Notation...2 1. The Pattern Recognition
More informationStatistical clustering and Mineral Spectral Unmixing in Aviris Hyperspectral Image of Cuprite, NV
CS229 REPORT, DECEMBER 05 1 Statistical clustering and Mineral Spectral Unixing in Aviris Hyperspectral Iage of Cuprite, NV Mario Parente, Argyris Zynis I. INTRODUCTION Hyperspectral Iaging is a technique
More informationTopic 5a Introduction to Curve Fitting & Linear Regression
/7/08 Course Instructor Dr. Rayond C. Rup Oice: A 337 Phone: (95) 747 6958 E ail: rcrup@utep.edu opic 5a Introduction to Curve Fitting & Linear Regression EE 4386/530 Coputational ethods in EE Outline
More informationSparsity-promoting migration with multiples
Sparsity-promoting migration with multiples Tim Lin, Ning Tu and Felix Herrmann SLIM Seismic Laboratory for Imaging and Modeling the University of British Columbia Courtesy of Verschuur, 29 SLIM Motivation..
More informationStructured signal recovery from quadratic measurements: Breaking sample complexity barriers via nonconvex optimization
Structured signal recovery fro quadratic easureents: Breaking saple coplexity barriers via nonconvex optiization Mahdi Soltanolkotabi Ming Hsieh Departent of Electrical Engineering University of Southern
More informationControl Theory & Applications
Control Theory & Applications Optial Dynaic Inversion Control Design for a Class of Nonlinear Distributed Paraeter Systes with Continuous and Discrete Actuators Journal: anuscript ID: anuscript Type: Date
More informationCourse Notes for EE227C (Spring 2018): Convex Optimization and Approximation
Course Notes for EE7C (Spring 018: Convex Optiization and Approxiation Instructor: Moritz Hardt Eail: hardt+ee7c@berkeley.edu Graduate Instructor: Max Sichowitz Eail: sichow+ee7c@berkeley.edu October 15,
More informationPattern Recognition and Machine Learning. Artificial Neural networks
Pattern Recognition and Machine Learning Jaes L. Crowley ENSIMAG 3 - MMIS Fall Seester 2017 Lessons 7 20 Dec 2017 Outline Artificial Neural networks Notation...2 Introduction...3 Key Equations... 3 Artificial
More informationA general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics, EPFL, Lausanne Phone: Fax:
A general forulation of the cross-nested logit odel Michel Bierlaire, EPFL Conference paper STRC 2001 Session: Choices A general forulation of the cross-nested logit odel Michel Bierlaire, Dpt of Matheatics,
More informationC na (1) a=l. c = CO + Clm + CZ TWO-STAGE SAMPLE DESIGN WITH SMALL CLUSTERS. 1. Introduction
TWO-STGE SMPLE DESIGN WITH SMLL CLUSTERS Robert G. Clark and David G. Steel School of Matheatics and pplied Statistics, University of Wollongong, NSW 5 ustralia. (robert.clark@abs.gov.au) Key Words: saple
More informationA Note on the Applied Use of MDL Approximations
A Note on the Applied Use of MDL Approxiations Daniel J. Navarro Departent of Psychology Ohio State University Abstract An applied proble is discussed in which two nested psychological odels of retention
More informationRemoval of Intensity Bias in Magnitude Spin-Echo MRI Images by Nonlinear Diffusion Filtering
Reoval of Intensity Bias in Magnitude Spin-Echo MRI Iages by Nonlinear Diffusion Filtering Alexei A. Sasonov *, Chris R. Johnson Scientific Coputing and Iaging Institute, University of Utah, 50 S Central
More informationConvex Programming for Scheduling Unrelated Parallel Machines
Convex Prograing for Scheduling Unrelated Parallel Machines Yossi Azar Air Epstein Abstract We consider the classical proble of scheduling parallel unrelated achines. Each job is to be processed by exactly
More informationKernel Methods and Support Vector Machines
Intelligent Systes: Reasoning and Recognition Jaes L. Crowley ENSIAG 2 / osig 1 Second Seester 2012/2013 Lesson 20 2 ay 2013 Kernel ethods and Support Vector achines Contents Kernel Functions...2 Quadratic
More informationAnalysis of ground vibration transmission in high precision equipment by Frequency Based Substructuring
Analysis of ground vibration transission in high precision equipent by Frequency Based Substructuring G. van Schothorst 1, M.A. Boogaard 2, G.W. van der Poel 1, D.J. Rixen 2 1 Philips Innovation Services,
More informationDISSIMILARITY MEASURES FOR ICA-BASED SOURCE NUMBER ESTIMATION. Seungchul Lee 2 2. University of Michigan. Ann Arbor, MI, USA.
Proceedings of the ASME International Manufacturing Science and Engineering Conference MSEC June -8,, Notre Dae, Indiana, USA MSEC-7 DISSIMILARIY MEASURES FOR ICA-BASED SOURCE NUMBER ESIMAION Wei Cheng,
More informationFairness via priority scheduling
Fairness via priority scheduling Veeraruna Kavitha, N Heachandra and Debayan Das IEOR, IIT Bobay, Mubai, 400076, India vavitha,nh,debayan}@iitbacin Abstract In the context of ulti-agent resource allocation
More informationGeometrical intuition behind the dual problem
Based on: Geoetrical intuition behind the dual proble KP Bennett, EJ Bredensteiner, Duality and Geoetry in SVM Classifiers, Proceedings of the International Conference on Machine Learning, 2000 1 Geoetrical
More informationORIE 6340: Mathematics of Data Science
ORIE 6340: Matheatics of Data Science Daek Davis Contents 1 Estiation in High Diensions 1 1.1 Tools for understanding high-diensional sets................. 3 1.1.1 Concentration of volue in high-diensions...............
More informationSparse Signal Reconstruction via Iterative Support Detection
Sparse Signal Reconstruction via Iterative Support Detection Yilun Wang and Wotao Yin Abstract. We present a novel sparse signal reconstruction ethod, iterative support detection (), aiing to achieve fast
More informationRANDOM GRADIENT EXTRAPOLATION FOR DISTRIBUTED AND STOCHASTIC OPTIMIZATION
RANDOM GRADIENT EXTRAPOLATION FOR DISTRIBUTED AND STOCHASTIC OPTIMIZATION GUANGHUI LAN AND YI ZHOU Abstract. In this paper, we consider a class of finite-su convex optiization probles defined over a distributed
More informationResearch Article Approximate Multidegree Reduction of λ-bézier Curves
Matheatical Probles in Engineering Volue 6 Article ID 87 pages http://dxdoiorg//6/87 Research Article Approxiate Multidegree Reduction of λ-bézier Curves Gang Hu Huanxin Cao and Suxia Zhang Departent of
More informationNumerical Solution of the MRLW Equation Using Finite Difference Method. 1 Introduction
ISSN 1749-3889 print, 1749-3897 online International Journal of Nonlinear Science Vol.1401 No.3,pp.355-361 Nuerical Solution of the MRLW Equation Using Finite Difference Method Pınar Keskin, Dursun Irk
More informationDistributed Subgradient Methods for Multi-agent Optimization
1 Distributed Subgradient Methods for Multi-agent Optiization Angelia Nedić and Asuan Ozdaglar October 29, 2007 Abstract We study a distributed coputation odel for optiizing a su of convex objective functions
More informationarxiv: v1 [cs.lg] 8 Jan 2019
Data Masking with Privacy Guarantees Anh T. Pha Oregon State University phatheanhbka@gail.co Shalini Ghosh Sasung Research shalini.ghosh@gail.co Vinod Yegneswaran SRI international vinod@csl.sri.co arxiv:90.085v
More informationAccelerated large-scale inversion with message passing Felix J. Herrmann, the University of British Columbia, Canada
Accelerated large-scale inversion with message passing Felix J. Herrmann, the University of British Columbia, Canada SUMMARY To meet current-day challenges, exploration seismology increasingly relies on
More informationA model reduction approach to numerical inversion for a parabolic partial differential equation
Inverse Probles Inverse Probles 30 (204) 250 (33pp) doi:0.088/0266-56/30/2/250 A odel reduction approach to nuerical inversion for a parabolic partial differential equation Liliana Borcea, Vladiir Drusin
More informationANALYSIS OF HALL-EFFECT THRUSTERS AND ION ENGINES FOR EARTH-TO-MOON TRANSFER
IEPC 003-0034 ANALYSIS OF HALL-EFFECT THRUSTERS AND ION ENGINES FOR EARTH-TO-MOON TRANSFER A. Bober, M. Guelan Asher Space Research Institute, Technion-Israel Institute of Technology, 3000 Haifa, Israel
More informationBoosting with log-loss
Boosting with log-loss Marco Cusuano-Towner Septeber 2, 202 The proble Suppose we have data exaples {x i, y i ) i =... } for a two-class proble with y i {, }. Let F x) be the predictor function with the
More informationNecessity of low effective dimension
Necessity of low effective diension Art B. Owen Stanford University October 2002, Orig: July 2002 Abstract Practitioners have long noticed that quasi-monte Carlo ethods work very well on functions that
More informationANALYTICAL INVESTIGATION AND PARAMETRIC STUDY OF LATERAL IMPACT BEHAVIOR OF PRESSURIZED PIPELINES AND INFLUENCE OF INTERNAL PRESSURE
DRAFT Proceedings of the ASME 014 International Mechanical Engineering Congress & Exposition IMECE014 Noveber 14-0, 014, Montreal, Quebec, Canada IMECE014-36371 ANALYTICAL INVESTIGATION AND PARAMETRIC
More information