A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition
|
|
- Bertina Poole
- 5 years ago
- Views:
Transcription
1 A novel method for estimating the distribution of convective heat flux in ducts: Gaussian Filtered Singular Value Decomposition F Bozzoli 1,2, L Cattani 1,2, A Mocerino 1, S Rainieri 1,2, F S V Bazán 3 1 Department of Industrial Engineering, University of Parma, Parma, Italy 2 SIEIA.PARMA Interdepartmental Centre, University of Parma, Parma, Italy 3 Department of Mathematics, Federal University of Santa Catarina, Florianópolis/SC, Brazil Corresponding author: fabio.bozzoli@unipr.it Abstract. A new regularization approach for the unconstrained linear least square problem is proposed and assessed. his approach improves the classical methods based on the singular value decomposition approach by employing the Gaussian filter, a kind of filter which has been proved to be effective in several application related to noise suppression. In particular, as benchmark, it is hereby considered the estimation of the heat flux at the internal wall surface in a forced convection problem in ducts, by solving the inverse heat conduction problem in the solid wall only using temperature distribution available at the exterior boundary. Results on both synthetic and experimental data are reported with the aim of discussing the effectiveness of the proposed method in comparison to other similar solution approaches. 1. Introduction Singular value decomposition (SVD), in the truncated formulation [1], is considered one of the most popular method for the regularization of ill-posed linear least square problems. Although this technique is very effective, some Authors have proposed improvements in order to overcome some of its acknowledged limitations. In particular, in the classical approach, the truncation of the SVD expansion is not very conservative when the signal to be estimated is supposed to be a wide-spectrum one. For this reason, it has been proposed a modified approach called damped SVD which damps the small singular values instead of neglecting them, [2]. It means that, while the truncated SVD filters the singular value series by a sharp ideal high-pass filter, the damped SVD smooths the singular value series by a first-order filter. his work proposes and assesses a new regularization approach, that refines the damped SVD method by employing the Gaussian filter, a kind of filter which has been proved to be effective in several application related to noise suppression with regards to inverse problems [3]. In particular, as benchmark, it is hereby considered the estimation of the heat flux at the internal wall surface in a forced convection problem in ducts, by solving the inverse heat conduction problem in the solid wall using only temperature distribution available at the exterior boundary [4]. Results developed on both synthetic and experimental data are reported to discuss the effectiveness of the proposed method in comparison to other similar solution approaches.
2 2. Regularization methods his paper deals with methods for solving the unconstrained linear least square problem: min x b Ax 2, A R m n, m n (1) It is well known that finding the minimizer is equivalent to solving the square n n system: A Ax = A b (2) Furthermore, when the columns of A are linearly independent, it turns out that A A is invertible, and so x is unique and given by x = (A A) 1 b (3) In the majority of the practical cases, A A is not invertible and the solution can be found by the Singular Value Decomposition approach (SVD): the matrix A (m n) can be decomposed it into three matrices U, Σ and V: A = UΣV = n i=1 u i σ i v i (4) where U=(u 1,u 2,,u n). and V=(v 1,v 2,,v n) are matrices with orthogonal columns, and where the matrix Σ has diagonal form: Σ = diag(σ 1, σ 2,, σ n ) (5) he matrix Σ has non-negative diagonal elements, called the singular values of A, appearing in the following non-increasing order: σ 1 σ 2 σ n (6) Based on SVD, the solution to the least-squares problem (1) is: x V 1 U b u b n i vi i1 i (7) It can be observed from Eq.(7) that those terms with small singular value σ i become large. Since the noise level in b is generally greater than the smallest non-zero singular values, it turns out that the problem ill-posed in the sense that a small perturbation of b leads to a large perturbation of the solution. An interesting and important aspect of discrete ill-posed problems is that ill-conditioning of the problem doesn t mean that a meaningful approximated solution cannot be computed. Rather, the ill-conditioning implies that standard methods in numerical linear algebra are unsuccessful, more sophisticated methods must be applied. he regularization method proposed in the present paper, named Gaussian Filtered Singular Value Decomposition (), is based on SVD and on the idea that a filter factor f i should be added in Eq.(7) in order to filter out the noise corresponding to the small singular values. he solution is then expressed by: x n i1 f i, ui b v i i (8) In particular, a Gaussian function is adopted. Gaussian filter is widely adopted in the enhancing of image quality within graphics software and its property to smooth noisy data has been experimented [3,5].
3 he filter factor assumes the following expression: 1 ( ) f i = e σ i 2 2 λ 2 (9) where λ is the regularization parameter that should be chosen adequately. he application of a Gaussian factor has the effect of reducing large 1/σ i values in order to overcome the ill-posedness of the problem. he proposed approach is compared to other three approaches that share the idea of smoothing the matrix Σ obtained by SVD: runcated Singular Value Decomposition (SVD) method, Damped Singular Value Decomposition (DSVD) method and ikhonov Regularization (R) method. In particular SVD can be reduced to Eq.(8) with a step function as filter factor: f i = {, σ i > λ; 1, σ i λ. (1) where λ is the regularization parameter. Analogously, the Damped Singular Value Decomposition (DSVD) method use the filter factors defined as follows: f i = σ i σ i +λ ikhonov Regularization (R) method is usually formulated in a different way but, as shown in [6,7], when its zero derivative formulation is considered, it could be easily expressed by Eq.(8) with filter factors defined as follows: f i = σ i 2 σ i 2 +λ 2 (12) he trend of the four considered filter functions are reported in Fig. 1., where the cut-off value σ c is introduced, according to the classical definition; σ c is the value at which f is equal to his figure highlights that the four filter functions defined in Eqs.(9-12) have a similar behavior but totally different shapes: SVD is the steepest one while DSVD is the most gradual. (11) 1 DSVD R SVD f / c Figure 1. Filter functions for the four considered approaches. It is well known that the effectiveness of all regularization approaches strongly depends on the choice of a proper value of the regularization parameter [8,9]. In the present analysis, to make the comparison
4 between the considered regularization techniques more straightforward, the criterion provided by the discrepancy principle, originally formulated by Morozov [1], was adopted for all the techniques. his principle, for the four approaches considered, suggests computing λ in such a way to satisfy the non linear equation: b A n f ui b v i, i i1 i 2 b N (13) where N is the size of the vector b and η b is the standard deviation of the measurement error in b. 3. est case he comparison of the four above described techniques (i.e.,, SVD, DSVD, R) was performed considering a well-known inverse heat conduction problem: the estimation of the local convective heat flux density inside a duct, heated by Joule effect, from the temperature distribution acquired on the external wall surface of the pipe. Figure 2. Geometrical domain with coordinate system. In the 2-D solid domain (sketched in Fig. 2), the steady state energy balance equation is expressed in the form: k 2 + g = (14) where g is the heat generated per unit volume and k is the tube wall thermal conductivity. he following two boundary conditions completed the energy balance equation: k r = ( env) R env (15) that is applied on surface S 1 and where R env is the overall heat transfer resistance between the tube wall and the surrounding environment with temperature env ; k = q (16) r
5 that is applied on surface S 2 and where q is the local convective heat flux at the fluid-internal wall interface, assumed to be varying with the angular coordinate and taken positive when it is released by the wall into the fluid. In the discrete domain, the direct problem, which is linear with respect to the heat flux q, can be described as follows: q Xq (17) where is the vector of the discrete temperature data at the external pipe surface, q is the heat flux vector at the fluid-internal wall interface, q= is a constant term and X is the sensitivity matrix. he inverse problem becomes: min q Y q= Xq 2 (18) where Y is the measured temperature distribution on the external tube s wall. his equation is equal to the problem expressed by Eq.(1). 4. Numerical comparison he comparison of the proposed techniques with the others described previously was first performed, within the Matlab environment, by adopting synthetic data. he q= and X terms of Eq. (17) were calculated by the finite element method implemented in Comsol Multiphysics. By imposing a known distribution of q, a synthetic temperature distribution on the external wall surface was then obtained. he physical and geometrical parameters used in this work correspond to a stainless steel tube with an internal radius of 7 mm and an external radius of 8 mm. For the internal convective heat flux, two meaningful distributions, suggested by the data of Bozzoli et al. [4], were adopted: 2 q a ( / 1) 2a ( / 1) a / 2 (19.a) b, α π/3 q (19.b) b/2, α π/3 In particular a=36 W/m 2 and b= W/m 2 were taken in order to have two distributions, compared in Fig. 3, with the same average value but totally different profiles: the first one is a typical parabolic function while the second is a step function. It is well known that effectiveness of inverse problem solution methods depends on the kind of function that has to be estimated, for this reason testing the proposed approach on different distributions is fundamental for performing a robust comparison.
6 Eq.(19.b) Eq.(19.a) (rad) Figure 3. est convective heat flux distributions. hen the synthetic temperature distribution Y on the external wall surface, deliberately spoiled by random noise, was used as the input data of the inverse problem. In particular, a white noise characterized by a standard deviation μ Y ranging from.1 K - 5 K was considered. In order to quantify the effectiveness of the two approaches at different signal to noise level an error analysis could be performed by plotting the global relative estimation error, defined as follows: E = (q) restored (q) exact 2 q exact 2 (2) versus the standard deviation of the measurement error. Since the added noise depends intrinsically on the random sequence generated by Matlab, the estimation procedure was repeated for 1 different random sequences of noise added to the simulated measurements and an averaged value E avg was calculated for each noise level. Eq.(19.a) - parabolic distribution Eq.(19.b) - step distribution E avg (%) DSVD SVD R E avg (%) DSVD SVD R Y Y Figure 4. Average estimation error of the four consider techniques at different noise level, for the two considered numerical test case.
7 his comparison, reported in Fig. 4, highlights that, SVD and R show similar performance while DSVD is unable to estimate the unknown heat flux distribution, also at low noise levels. Moreover, when a parabolic heat flux distribution is considered, and R worked slightly better than SVD. In order to improve the analysis on these three approaches, in Fig. 5 the local heat flux distributions restored by, SVD and R are compared with the exact one for two representative noise levels. SVD, for the parabolic distribution, overestimated the maximum value when the noise level is high. For the step distribution, SVD strongly suffers of ringing artifacts at low noise level and of excessive smoothing at high noise level. Although M and show a similar behavior in terms of estimation error, if step distribution with high noise level is considered, GSFD is more effective in locating the plateau while R catches better the background. Y =.5 K exact SVD R Y =.5 K exact SVD R (rad) (rad) Y = 1 K exact SVD R Y = 1 K exact SVD R (rad) (rad) Figure 5. Exact and reconstructed heat flux distribution for the two test cases with different noise levels.
8 4. Experimental comparison he proposed estimation technique was compared to the others more promising ones (i.e., SVD, R) through their application to a set of experimental data obtained in [4]: it was considered the forced convection problem within a stainless steel coiled tube under the prescribed condition of uniform heating generated by Joule effect in the wall. Ethylene Glycol was used as working fluid and laminar flow regime in coiled tubes was investigated. More details on the experimental facilities and procedures can be found in [4]. In order to apply the four estimation procedures, the noise level in the acquired data has to be estimated; this task was performed by measuring the surface temperature distribution while maintaining the coil wall under isothermal conditions. For a representative Reynolds number value, the distributions of the convective heat transfer coefficient restored by R, SVD and are compared in Fig. 6. SVD R (rad) Figure 6. Exact and reconstructed heat flux distribution for the experimental case. he comparison between the three restored distributions of the convective heat flux underlines that, for the case here investigated, and R give equivalent results while SVD suffers of ringing artifacts. 5. Conclusions A new regularization approach for the unconstrained linear least square problem was proposed and assessed. In particular, this approach, named Gaussian Filtered Singular Value Decomposition (), is based on the singular value decomposition approach smoothed by Gaussian filter. was compared to other three approaches that share the idea of inverting SVD: runcated Singular Value Decomposition (SVD) method, Damped Singular Value Decomposition (DSVD) method and ikhonov Regularization (R) method. As benchmark, it was considered the estimation of the heat flux at the internal wall surface in a forced convection problem in ducts. Results, on both synthetic and experimental data, highlighted the goodness of in solving this kind of inverse problem and the limits of SVD that, although it is probably the most widely used approach, could suffer of ringing artifacts.
9 6. References [1] Hanson, R. J. (1971). A numerical method for solving Fredholm integral equations of the first kind using singular values. SIAM Journal on Numerical Analysis, 8(3), [2] Ekstrom, M. P., & Rhoads, R. L. (1974). On the application of eigenvector expansions to numerical deconvolution. Journal of Computational Physics, 14(4), [3] Bozzoli, F., Pagliarini, G., & Rainieri, S. (213). Experimental validation of the filtering technique approach applied to the restoration of the heat source field. Experimental hermal and Fluid Science, 44, [4] Bozzoli, F., Cattani, L., Rainieri, S., Bazán, F. S. V., & Borges, L. S. (214). Estimation of the local heat-transfer coefficient in the laminar flow regime in coiled tubes by the ikhonov regularisation method. International Journal of Heat and Mass ransfer, 72, [5] Murio, D.A. (1993). he Mollification Method and the Numerical Solution of Ill-Posed Problems, John Wiley and Sons, New York [6] Hansen, P. C. (1987). he truncatedsvd as a method for regularization. BI Numerical Mathematics, 27(4), [7] Wei,., Hon, Y. C., & Ling, L. (27). Method of fundamental solutions with regularization techniques for Cauchy problems of elliptic operators. Engineering Analysis with Boundary Elements, 31(4), [8] Bazan, F.S.V., & Borges, L.S. (21). GKB-FP: an algorithm for large-scale discrete ill-posed problems. Bit Numerical Mathematics, 5(3), [9] Beck, J.V., Balckwell, B., Clair, C.R.St. (1985). Inverse Heat Conduction Ill-posed Problems, Wiley-Interscience, New York, USA. [1] ikhonov, A.N., Arsenin V.Y. (1977). Solution of Ill-Posed Problems, Winston & Sons, Washington DC, USA.
Passive techniques for the enhancement of convective heat transfer in single phase duct flow
Journal of Physics: Conference Series OPEN ACCESS Passive techniques for the enhancement of convective heat transfer in single phase duct flow To cite this article: S Rainieri et al 2014 J. Phys.: Conf.
More informationNumerical Investigation of The Convective Heat Transfer Enhancement in Coiled Tubes
Numerical Investigation of The Convective Heat Transfer Enhancement in Coiled Tubes Luca Cattani* 1 1 Department of Industrial Engineering - University of Parma Parco Area delle Scienze 181/A I-43124 Parma,
More informationRegularization methods for large-scale, ill-posed, linear, discrete, inverse problems
Regularization methods for large-scale, ill-posed, linear, discrete, inverse problems Silvia Gazzola Dipartimento di Matematica - Università di Padova January 10, 2012 Seminario ex-studenti 2 Silvia Gazzola
More informationNumerical analysis of the laminar forced convective heat transfer in coiled tubes with periodic ring-type corrugation
Journal of Physics: Conference Series PAPER OPEN ACCESS Numerical analysis of the laminar forced convective heat transfer in coiled tubes with periodic ring-type corrugation Recent citations - Investigation
More informationA MODIFIED TSVD METHOD FOR DISCRETE ILL-POSED PROBLEMS
A MODIFIED TSVD METHOD FOR DISCRETE ILL-POSED PROBLEMS SILVIA NOSCHESE AND LOTHAR REICHEL Abstract. Truncated singular value decomposition (TSVD) is a popular method for solving linear discrete ill-posed
More informationPreconditioning. Noisy, Ill-Conditioned Linear Systems
Preconditioning Noisy, Ill-Conditioned Linear Systems James G. Nagy Emory University Atlanta, GA Outline 1. The Basic Problem 2. Regularization / Iterative Methods 3. Preconditioning 4. Example: Image
More informationPreconditioning. Noisy, Ill-Conditioned Linear Systems
Preconditioning Noisy, Ill-Conditioned Linear Systems James G. Nagy Emory University Atlanta, GA Outline 1. The Basic Problem 2. Regularization / Iterative Methods 3. Preconditioning 4. Example: Image
More informationSingular Value Decomposition
Singular Value Decomposition Motivatation The diagonalization theorem play a part in many interesting applications. Unfortunately not all matrices can be factored as A = PDP However a factorization A =
More informationσ 11 σ 22 σ pp 0 with p = min(n, m) The σ ii s are the singular values. Notation change σ ii A 1 σ 2
HE SINGULAR VALUE DECOMPOSIION he SVD existence - properties. Pseudo-inverses and the SVD Use of SVD for least-squares problems Applications of the SVD he Singular Value Decomposition (SVD) heorem For
More informationTHE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR
THE SINGULAR VALUE DECOMPOSITION MARKUS GRASMAIR 1. Definition Existence Theorem 1. Assume that A R m n. Then there exist orthogonal matrices U R m m V R n n, values σ 1 σ 2... σ p 0 with p = min{m, n},
More informationStatistical Geometry Processing Winter Semester 2011/2012
Statistical Geometry Processing Winter Semester 2011/2012 Linear Algebra, Function Spaces & Inverse Problems Vector and Function Spaces 3 Vectors vectors are arrows in space classically: 2 or 3 dim. Euclidian
More informationNEW INVESTIGATIONS INTO THE MFS FOR 2D INVERSE LAPLACE PROBLEMS. Received June 2015; revised October 2015
International Journal of Innovative Computing, Information and Control ICIC International c 2016 ISSN 1349-4198 Volume 12, Number 1, February 2016 pp. 55 66 NEW INVESTIGATIONS INTO THE MFS FOR 2D INVERSE
More informationInverse Source Identification based on Acoustic Particle Velocity Measurements. Abstract. 1. Introduction
The 2002 International Congress and Exposition on Noise Control Engineering Dearborn, MI, USA. August 19-21, 2002 Inverse Source Identification based on Acoustic Particle Velocity Measurements R. Visser
More informationLaboratorio di Problemi Inversi Esercitazione 2: filtraggio spettrale
Laboratorio di Problemi Inversi Esercitazione 2: filtraggio spettrale Luca Calatroni Dipartimento di Matematica, Universitá degli studi di Genova Aprile 2016. Luca Calatroni (DIMA, Unige) Esercitazione
More informationRegularization Parameter Estimation for Least Squares: A Newton method using the χ 2 -distribution
Regularization Parameter Estimation for Least Squares: A Newton method using the χ 2 -distribution Rosemary Renaut, Jodi Mead Arizona State and Boise State September 2007 Renaut and Mead (ASU/Boise) Scalar
More informationBindel, Fall 2016 Matrix Computations (CS 6210) Notes for
1 A cautionary tale Notes for 2016-10-05 You have been dropped on a desert island with a laptop with a magic battery of infinite life, a MATLAB license, and a complete lack of knowledge of basic geometry.
More informationMulti-Linear Mappings, SVD, HOSVD, and the Numerical Solution of Ill-Conditioned Tensor Least Squares Problems
Multi-Linear Mappings, SVD, HOSVD, and the Numerical Solution of Ill-Conditioned Tensor Least Squares Problems Lars Eldén Department of Mathematics, Linköping University 1 April 2005 ERCIM April 2005 Multi-Linear
More informationCOMP 558 lecture 18 Nov. 15, 2010
Least squares We have seen several least squares problems thus far, and we will see more in the upcoming lectures. For this reason it is good to have a more general picture of these problems and how to
More informationApplication of COMSOL Multiphysics in Transport Phenomena Educational Processes
Application of COMSOL Multiphysics in Transport Phenomena Educational Processes M. Vasilev, P. Sharma and P. L. Mills * Department of Chemical and Natural Gas Engineering, Texas A&M University-Kingsville,
More informationnonlinear simultaneous equations of type (1)
Module 5 : Solving Nonlinear Algebraic Equations Section 1 : Introduction 1 Introduction Consider set of nonlinear simultaneous equations of type -------(1) -------(2) where and represents a function vector.
More informationSingular value decomposition. If only the first p singular values are nonzero we write. U T o U p =0
Singular value decomposition If only the first p singular values are nonzero we write G =[U p U o ] " Sp 0 0 0 # [V p V o ] T U p represents the first p columns of U U o represents the last N-p columns
More informationNumerical Investigation on The Convective Heat Transfer Enhancement in Coiled Tubes
Numerical Investigation on The Convective Heat Transfer Enhancement in Coiled Tubes Luca Cattani Department of Industrial Engineering - University of Parma Excerpt from the Proceedings of the 2012 COMSOL
More informationSingular Value Decomposition (SVD)
School of Computing National University of Singapore CS CS524 Theoretical Foundations of Multimedia More Linear Algebra Singular Value Decomposition (SVD) The highpoint of linear algebra Gilbert Strang
More informationLaminar flow heat transfer studies in a twisted square duct for constant wall heat flux boundary condition
Sādhanā Vol. 40, Part 2, April 2015, pp. 467 485. c Indian Academy of Sciences Laminar flow heat transfer studies in a twisted square duct for constant wall heat flux boundary condition RAMBIR BHADOURIYA,
More informationInverse Theory Methods in Experimental Physics
Inverse Theory Methods in Experimental Physics Edward Sternin PHYS 5P10: 2018-02-26 Edward Sternin Inverse Theory Methods PHYS 5P10: 2018-02-26 1 / 29 1 Introduction Indirectly observed data A new research
More informationBasic Fluid Mechanics
Basic Fluid Mechanics Chapter 3B: Conservation of Mass C3B: Conservation of Mass 1 3.2 Governing Equations There are two basic types of governing equations that we will encounter in this course Differential
More informationLEAST SQUARES SOLUTION TRICKS
LEAST SQUARES SOLUTION TRICKS VESA KAARNIOJA, JESSE RAILO AND SAMULI SILTANEN Abstract This handout is for the course Applications of matrix computations at the University of Helsinki in Spring 2018 We
More informationInfluence of the Heat Transfer on the Pressure Field in Radial Diffusers Flows
Purdue University Purdue e-pubs International Compressor Engineering Conference School of Mechanical Engineering 2010 Influence of the Heat Transfer on the Pressure Field in Radial Diffusers Flows Jose
More informationFinite-Element Evaluation of Thermal Response Tests Performed on U-Tube Borehole Heat Exchangers
Excerpt from the Proceedings of the COMSOL Conference 2008 Hannover Finite-Element Evaluation of Thermal Response Tests Performed on U-Tube Borehole Heat Exchangers E. Zanchini,1 and T. Terlizzese 1 1
More informationREGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE
Int. J. Appl. Math. Comput. Sci., 007, Vol. 17, No., 157 164 DOI: 10.478/v10006-007-0014-3 REGULARIZATION PARAMETER SELECTION IN DISCRETE ILL POSED PROBLEMS THE USE OF THE U CURVE DOROTA KRAWCZYK-STAŃDO,
More informationA Note on the Pin-Pointing Solution of Ill-Conditioned Linear System of Equations
A Note on the Pin-Pointing Solution of Ill-Conditioned Linear System of Equations Davod Khojasteh Salkuyeh 1 and Mohsen Hasani 2 1,2 Department of Mathematics, University of Mohaghegh Ardabili, P. O. Box.
More informationDS-GA 1002 Lecture notes 10 November 23, Linear models
DS-GA 2 Lecture notes November 23, 2 Linear functions Linear models A linear model encodes the assumption that two quantities are linearly related. Mathematically, this is characterized using linear functions.
More informationInverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging
11 th International Conference on Quantitative InfraRed Thermography Inverse Heat Flux Evaluation using Conjugate Gradient Methods from Infrared Imaging by J. Sousa*, L. Villafane*, S. Lavagnoli*, and
More informationUNIVERSITA DEGLI STUDI DI PARMA
UNIVERSITA DEGLI STUDI DI PARMA Dottorato di Ricerca in Ingegneria Industriale XXVII Ciclo Passive Techniques for the Enhancement of Convective Heat Transfer in Duct Flow for Highly Viscous Fluids: the
More information6 The SVD Applied to Signal and Image Deblurring
6 The SVD Applied to Signal and Image Deblurring We will discuss the restoration of one-dimensional signals and two-dimensional gray-scale images that have been contaminated by blur and noise. After an
More informationA Meshless Method for the Laplace and Biharmonic Equations Subjected to Noisy Boundary Data
Copyright c 4 Tech Science Press CMES, vol.6, no.3, pp.3-61, 4 A Meshless Method for the Laplace and Biharmonic Equations Subjected to Noisy Boundary Data B. Jin 1, Abstract: In this paper, we propose
More informationAssignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition. Name:
Assignment #10: Diagonalization of Symmetric Matrices, Quadratic Forms, Optimization, Singular Value Decomposition Due date: Friday, May 4, 2018 (1:35pm) Name: Section Number Assignment #10: Diagonalization
More informationComputational Methods. Eigenvalues and Singular Values
Computational Methods Eigenvalues and Singular Values Manfred Huber 2010 1 Eigenvalues and Singular Values Eigenvalues and singular values describe important aspects of transformations and of data relations
More informationNumerical Evaluation of Long-Term Performance of Borehole Heat Exchanger Fields
Presented at the COMSOL Conference 2009 Milan Numerical Evaluation of Long-Term Performance of Borehole Heat Exchanger Fields A. Priarone *, S. Lazzari, E. Zanchini Dipartimento di Ingegneria Energetica,
More information8 The SVD Applied to Signal and Image Deblurring
8 The SVD Applied to Signal and Image Deblurring We will discuss the restoration of one-dimensional signals and two-dimensional gray-scale images that have been contaminated by blur and noise. After an
More informationWhat is Image Deblurring?
What is Image Deblurring? When we use a camera, we want the recorded image to be a faithful representation of the scene that we see but every image is more or less blurry, depending on the circumstances.
More informationMathematical Beer Goggles or The Mathematics of Image Processing
How Mathematical Beer Goggles or The Mathematics of Image Processing Department of Mathematical Sciences University of Bath Postgraduate Seminar Series University of Bath 12th February 2008 1 How 2 How
More informationChapter 5 HIGH ACCURACY CUBIC SPLINE APPROXIMATION FOR TWO DIMENSIONAL QUASI-LINEAR ELLIPTIC BOUNDARY VALUE PROBLEMS
Chapter 5 HIGH ACCURACY CUBIC SPLINE APPROXIMATION FOR TWO DIMENSIONAL QUASI-LINEAR ELLIPTIC BOUNDARY VALUE PROBLEMS 5.1 Introduction When a physical system depends on more than one variable a general
More informationStructural Damage Detection Using Time Windowing Technique from Measured Acceleration during Earthquake
Structural Damage Detection Using Time Windowing Technique from Measured Acceleration during Earthquake Seung Keun Park and Hae Sung Lee ABSTRACT This paper presents a system identification (SI) scheme
More informationThe Singular Value Decomposition
The Singular Value Decomposition We are interested in more than just sym+def matrices. But the eigenvalue decompositions discussed in the last section of notes will play a major role in solving general
More informationApplied Linear Algebra in Geoscience Using MATLAB
Applied Linear Algebra in Geoscience Using MATLAB Contents Getting Started Creating Arrays Mathematical Operations with Arrays Using Script Files and Managing Data Two-Dimensional Plots Programming in
More informationLecture 6. Numerical methods. Approximation of functions
Lecture 6 Numerical methods Approximation of functions Lecture 6 OUTLINE 1. Approximation and interpolation 2. Least-square method basis functions design matrix residual weighted least squares normal equation
More informationWhy the QR Factorization can be more Accurate than the SVD
Why the QR Factorization can be more Accurate than the SVD Leslie V. Foster Department of Mathematics San Jose State University San Jose, CA 95192 foster@math.sjsu.edu May 10, 2004 Problem: or Ax = b for
More informationCONVECTIVE HEAT TRANSFER
CONVECTIVE HEAT TRANSFER Mohammad Goharkhah Department of Mechanical Engineering, Sahand Unversity of Technology, Tabriz, Iran CHAPTER 4 HEAT TRANSFER IN CHANNEL FLOW BASIC CONCEPTS BASIC CONCEPTS Laminar
More informationEIGENVALE PROBLEMS AND THE SVD. [5.1 TO 5.3 & 7.4]
EIGENVALE PROBLEMS AND THE SVD. [5.1 TO 5.3 & 7.4] Eigenvalue Problems. Introduction Let A an n n real nonsymmetric matrix. The eigenvalue problem: Au = λu λ C : eigenvalue u C n : eigenvector Example:
More informationDiscrete ill posed problems
Discrete ill posed problems Gérard MEURANT October, 2008 1 Introduction to ill posed problems 2 Tikhonov regularization 3 The L curve criterion 4 Generalized cross validation 5 Comparisons of methods Introduction
More informationMaths for Signals and Systems Linear Algebra in Engineering
Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 15, Tuesday 8 th and Friday 11 th November 016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN SIGNAL PROCESSING IMPERIAL COLLEGE
More informationTransmission Matrix Model of a Quarter-Wave-Tube with Gas Temperature Gradients
Transmission Matrix Model of a Quarter-Wave-Tube with Gas Temperature Gradients Carl Howard School of Mechanical Engineering, University of Adelaide, South Australia, Australia ABSTRACT A transmission
More informationNumerical Linear Algebra and. Image Restoration
Numerical Linear Algebra and Image Restoration Maui High Performance Computing Center Wednesday, October 8, 2003 James G. Nagy Emory University Atlanta, GA Thanks to: AFOSR, Dave Tyler, Stuart Jefferies,
More informationInverse Ill Posed Problems in Image Processing
Inverse Ill Posed Problems in Image Processing Image Deblurring I. Hnětynková 1,M.Plešinger 2,Z.Strakoš 3 hnetynko@karlin.mff.cuni.cz, martin.plesinger@tul.cz, strakos@cs.cas.cz 1,3 Faculty of Mathematics
More informationApplied Numerical Linear Algebra. Lecture 8
Applied Numerical Linear Algebra. Lecture 8 1/ 45 Perturbation Theory for the Least Squares Problem When A is not square, we define its condition number with respect to the 2-norm to be k 2 (A) σ max (A)/σ
More informationExercise Set 7.2. Skills
Orthogonally diagonalizable matrix Spectral decomposition (or eigenvalue decomposition) Schur decomposition Subdiagonal Upper Hessenburg form Upper Hessenburg decomposition Skills Be able to recognize
More information1 Linearity and Linear Systems
Mathematical Tools for Neuroscience (NEU 34) Princeton University, Spring 26 Jonathan Pillow Lecture 7-8 notes: Linear systems & SVD Linearity and Linear Systems Linear system is a kind of mapping f( x)
More informationITERATIVE REGULARIZATION WITH MINIMUM-RESIDUAL METHODS
BIT Numerical Mathematics 6-3835/3/431-1 $16. 23, Vol. 43, No. 1, pp. 1 18 c Kluwer Academic Publishers ITERATIVE REGULARIZATION WITH MINIMUM-RESIDUAL METHODS T. K. JENSEN and P. C. HANSEN Informatics
More informationSolving discrete ill posed problems with Tikhonov regularization and generalized cross validation
Solving discrete ill posed problems with Tikhonov regularization and generalized cross validation Gérard MEURANT November 2010 1 Introduction to ill posed problems 2 Examples of ill-posed problems 3 Tikhonov
More informationc 1999 Society for Industrial and Applied Mathematics
SIAM J. MATRIX ANAL. APPL. Vol. 21, No. 1, pp. 185 194 c 1999 Society for Industrial and Applied Mathematics TIKHONOV REGULARIZATION AND TOTAL LEAST SQUARES GENE H. GOLUB, PER CHRISTIAN HANSEN, AND DIANNE
More informationSIGNAL AND IMAGE RESTORATION: SOLVING
1 / 55 SIGNAL AND IMAGE RESTORATION: SOLVING ILL-POSED INVERSE PROBLEMS - ESTIMATING PARAMETERS Rosemary Renaut http://math.asu.edu/ rosie CORNELL MAY 10, 2013 2 / 55 Outline Background Parameter Estimation
More informationSingular Value Decomposition
Singular Value Decomposition (Com S 477/577 Notes Yan-Bin Jia Sep, 7 Introduction Now comes a highlight of linear algebra. Any real m n matrix can be factored as A = UΣV T where U is an m m orthogonal
More information8 The SVD Applied to Signal and Image Deblurring
8 The SVD Applied to Signal and Image Deblurring We will discuss the restoration of one-dimensional signals and two-dimensional gray-scale images that have been contaminated by blur and noise. After an
More informationLet A an n n real nonsymmetric matrix. The eigenvalue problem: λ 1 = 1 with eigenvector u 1 = ( ) λ 2 = 2 with eigenvector u 2 = ( 1
Eigenvalue Problems. Introduction Let A an n n real nonsymmetric matrix. The eigenvalue problem: EIGENVALE PROBLEMS AND THE SVD. [5.1 TO 5.3 & 7.4] Au = λu Example: ( ) 2 0 A = 2 1 λ 1 = 1 with eigenvector
More informationLinear Algebra. Session 12
Linear Algebra. Session 12 Dr. Marco A Roque Sol 08/01/2017 Example 12.1 Find the constant function that is the least squares fit to the following data x 0 1 2 3 f(x) 1 0 1 2 Solution c = 1 c = 0 f (x)
More informationNumerical method of active thermography for the reconstruction of back wall geometry
11 th International Conference on Quantitative InfraRed hermography Numerical method of active thermography for the reconstruction of bac wall geometry by Regina Richter *, Christiane Maierhofer *, Marc
More informationCross Directional Control
Cross Directional Control Graham C. Goodwin Day 4: Lecture 4 16th September 2004 International Summer School Grenoble, France 1. Introduction In this lecture we describe a practical application of receding
More informationMath 102, Winter Final Exam Review. Chapter 1. Matrices and Gaussian Elimination
Math 0, Winter 07 Final Exam Review Chapter. Matrices and Gaussian Elimination { x + x =,. Different forms of a system of linear equations. Example: The x + 4x = 4. [ ] [ ] [ ] vector form (or the column
More informationA study on regularization parameter choice in Near-field Acoustical Holography
Acoustics 8 Paris A study on regularization parameter choice in Near-field Acoustical Holography J. Gomes a and P.C. Hansen b a Brüel & Kjær Sound and Vibration Measurement A/S, Skodsborgvej 37, DK-285
More informationNew Fast Kalman filter method
New Fast Kalman filter method Hojat Ghorbanidehno, Hee Sun Lee 1. Introduction Data assimilation methods combine dynamical models of a system with typically noisy observations to obtain estimates of the
More informationThe Singular Value Decomposition (SVD) and Principal Component Analysis (PCA)
Chapter 5 The Singular Value Decomposition (SVD) and Principal Component Analysis (PCA) 5.1 Basics of SVD 5.1.1 Review of Key Concepts We review some key definitions and results about matrices that will
More informationMath 302 Outcome Statements Winter 2013
Math 302 Outcome Statements Winter 2013 1 Rectangular Space Coordinates; Vectors in the Three-Dimensional Space (a) Cartesian coordinates of a point (b) sphere (c) symmetry about a point, a line, and a
More informationGolub-Kahan iterative bidiagonalization and determining the noise level in the data
Golub-Kahan iterative bidiagonalization and determining the noise level in the data Iveta Hnětynková,, Martin Plešinger,, Zdeněk Strakoš, * Charles University, Prague ** Academy of Sciences of the Czech
More informationChapter 3 NATURAL CONVECTION
Fundamentals of Thermal-Fluid Sciences, 3rd Edition Yunus A. Cengel, Robert H. Turner, John M. Cimbala McGraw-Hill, 2008 Chapter 3 NATURAL CONVECTION Mehmet Kanoglu Copyright The McGraw-Hill Companies,
More informationLeast Squares Optimization
Least Squares Optimization The following is a brief review of least squares optimization and constrained optimization techniques. I assume the reader is familiar with basic linear algebra, including the
More informationLong-Term Performance of Borehole Heat Exchanger Fields with Groundwater Movement
Excerpt from the Proceedings of the COMSOL Conference 2 Paris Long-Term Performance of Borehole Heat Exchanger Fields with Groundwater Movement S. Lazzari *,1, A. Priarone 2 and E. Zanchini 1 1 Dipartimento
More informationDetermination of a source term and boundary heat flux in an inverse heat equation
ISSN 1746-7659, England, UK Journal of Information and Computing Science Vol. 8, No., 013, pp. 3-114 Determination of a source term and boundary heat flux in an inverse heat equation A.M. Shahrezaee 1
More information5.1 2D example 59 Figure 5.1: Parabolic velocity field in a straight two-dimensional pipe. Figure 5.2: Concentration on the input boundary of the pipe. The vertical axis corresponds to r 2 -coordinate,
More informationECE295, Data Assimila0on and Inverse Problems, Spring 2015
ECE295, Data Assimila0on and Inverse Problems, Spring 2015 1 April, Intro; Linear discrete Inverse problems (Aster Ch 1 and 2) Slides 8 April, SVD (Aster ch 2 and 3) Slides 15 April, RegularizaFon (ch
More informationA NO-REFERENCE SHARPNESS METRIC SENSITIVE TO BLUR AND NOISE. Xiang Zhu and Peyman Milanfar
A NO-REFERENCE SARPNESS METRIC SENSITIVE TO BLUR AND NOISE Xiang Zhu and Peyman Milanfar Electrical Engineering Department University of California at Santa Cruz, CA, 9564 xzhu@soeucscedu ABSTRACT A no-reference
More informationLinear Algebra Methods for Data Mining
Linear Algebra Methods for Data Mining Saara Hyvönen, Saara.Hyvonen@cs.helsinki.fi Spring 2007 The Singular Value Decomposition (SVD) continued Linear Algebra Methods for Data Mining, Spring 2007, University
More informationInverse Theory. COST WaVaCS Winterschool Venice, February Stefan Buehler Luleå University of Technology Kiruna
Inverse Theory COST WaVaCS Winterschool Venice, February 2011 Stefan Buehler Luleå University of Technology Kiruna Overview Inversion 1 The Inverse Problem 2 Simple Minded Approach (Matrix Inversion) 3
More informationNicholas Cox, Pawel Drapala, and Bruce F. Finlayson Department of Chemical Engineering, University of Washington, Seattle, WA, USA.
Transport Limitations in Thermal Diffusion Nicholas Cox, Pawel Drapala, and Bruce F. Finlayson Department of Chemical Engineering, University of Washington, Seattle, WA, USA Abstract Numerical simulations
More informationBasic Fluid Mechanics
Basic Fluid Mechanics Chapter 6A: Internal Incompressible Viscous Flow 4/16/2018 C6A: Internal Incompressible Viscous Flow 1 6.1 Introduction For the present chapter we will limit our study to incompressible
More informationINVESTIGATIONS ON THE INTERNAL SHAPE OF CONSTRUCTAL CAVITIES INTRUDING A HEAT GENERATING BODY
THERMAL SCIENCE: Year 2015, Vol. 19, No. 2, pp. 609-618 609 INVESTIGATIONS ON THE INTERNAL SHAPE OF CONSTRUCTAL CAVITIES INTRUDING A HEAT GENERATING BODY by Abouzar POUZESH, Mohammad Reza HAJMOHAMMADI
More informationTHE METHOD OF FUNDAMENTAL SOLUTION FOR SOLVING MULTIDIMENSIONAL INVERSE HEAT CONDUCTION PROBLEMS
THE METHOD OF FUNDAMENTAL SOLUTION FOR SOLVING MULTIDIMENSIONAL INVERSE HEAT CONDUCTION PROBLEMS Y.C. HON AND T.WEI Abstract. We propose in this paper an effective meshless and integration-free method
More information2. Review of Linear Algebra
2. Review of Linear Algebra ECE 83, Spring 217 In this course we will represent signals as vectors and operators (e.g., filters, transforms, etc) as matrices. This lecture reviews basic concepts from linear
More informationTikhonov Regularization of Large Symmetric Problems
NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS Numer. Linear Algebra Appl. 2000; 00:1 11 [Version: 2000/03/22 v1.0] Tihonov Regularization of Large Symmetric Problems D. Calvetti 1, L. Reichel 2 and A. Shuibi
More informationDUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM. Geunseop Lee
J. Korean Math. Soc. 0 (0), No. 0, pp. 1 0 https://doi.org/10.4134/jkms.j160152 pissn: 0304-9914 / eissn: 2234-3008 DUAL REGULARIZED TOTAL LEAST SQUARES SOLUTION FROM TWO-PARAMETER TRUST-REGION ALGORITHM
More informationPreliminary Examination, Numerical Analysis, August 2016
Preliminary Examination, Numerical Analysis, August 2016 Instructions: This exam is closed books and notes. The time allowed is three hours and you need to work on any three out of questions 1-4 and any
More informationApplied Fluid Mechanics
Applied Fluid Mechanics 1. The Nature of Fluid and the Study of Fluid Mechanics 2. Viscosity of Fluid 3. Pressure Measurement 4. Forces Due to Static Fluid 5. Buoyancy and Stability 6. Flow of Fluid and
More informationVector and Matrix Norms. Vector and Matrix Norms
Vector and Matrix Norms Vector Space Algebra Matrix Algebra: We let x x and A A, where, if x is an element of an abstract vector space n, and A = A: n m, then x is a complex column vector of length n whose
More informationApplied Mathematics 205. Unit V: Eigenvalue Problems. Lecturer: Dr. David Knezevic
Applied Mathematics 205 Unit V: Eigenvalue Problems Lecturer: Dr. David Knezevic Unit V: Eigenvalue Problems Chapter V.2: Fundamentals 2 / 31 Eigenvalues and Eigenvectors Eigenvalues and eigenvectors of
More informationLinear Algebra Review
Linear Algebra Review CS 205A: Mathematical Methods for Robotics, Vision, and Graphics Doug James (and Justin Solomon) CS 205A: Mathematical Methods Linear Algebra Review 1 / 16 Midterm Exam Tuesday Feb
More informationHolding Magnetic Field
Holding Magnetic Field Abstract The design of a solenoid to produce the required rotating/holding magnetic field in the n- 3 He experiment is presented The solenoid is constructed using 19 currents which
More informationLinear Inverse Problems. A MATLAB Tutorial Presented by Johnny Samuels
Linear Inverse Problems A MATLAB Tutorial Presented by Johnny Samuels What do we want to do? We want to develop a method to determine the best fit to a set of data: e.g. The Plan Review pertinent linear
More informationGeometric Modeling Summer Semester 2010 Mathematical Tools (1)
Geometric Modeling Summer Semester 2010 Mathematical Tools (1) Recap: Linear Algebra Today... Topics: Mathematical Background Linear algebra Analysis & differential geometry Numerical techniques Geometric
More informationExercise Sheet 1. 1 Probability revision 1: Student-t as an infinite mixture of Gaussians
Exercise Sheet 1 1 Probability revision 1: Student-t as an infinite mixture of Gaussians Show that an infinite mixture of Gaussian distributions, with Gamma distributions as mixing weights in the following
More informationPROJECTED TIKHONOV REGULARIZATION OF LARGE-SCALE DISCRETE ILL-POSED PROBLEMS
PROJECED IKHONOV REGULARIZAION OF LARGE-SCALE DISCREE ILL-POSED PROBLEMS DAVID R. MARIN AND LOHAR REICHEL Abstract. he solution of linear discrete ill-posed problems is very sensitive to perturbations
More information