Recent Developments in Numerical Methods for 4d-Var

Size: px
Start display at page:

Download "Recent Developments in Numerical Methods for 4d-Var"

Transcription

1 Recent Developments in Numerical Methods for 4d-Var Mike Fisher Slide 1

2 Recent Developments Numerical Methods 4d-Var Slide 2

3 Outline Non-orthogonal wavelets on the sphere: - Motivation: Covariance Modelling - Definition: Frames - Application: Wavelet J b Slide 3

4 -0.1 Wavelets on the Sphere Motivation Global mean vertical correlation for temperature Vertical Correlations vary with horizontal spatial scale model level ~200hPa ~500hPa ~850hPa wavenumber n Slide 4

5 Wavelets on the Sphere Motivation Zonal mean vertical correlation for temperature Vertical Correlations vary with horizontal location. ~200hPa ~500hPa ~850hPa Slide 5

6 Wavelets on the Sphere Motivation The variation of vertical correlation with location and with horizontal spatial scale are both important features, and both should be included in the covariance model. However, we are severely limited by the enormous size of the covariance matrix (~ ). Essentially, the covariance matrix must be blockdiagonal, with block size NLEVS NLEVS, and with many identical blocks. Currently, we specify one block per wavenumber, n. - variation with scale is modelled, variation with location is not. Alternatively, we could specify one block per gridpoint. - variation with location is modelled, variation with scale is not. Wavelets provide a way to do both (and still keep things sparse). Slide 6

7 Wavelets on the Sphere Frames It is possible to define orthogonal wavelets on the sphere by first gridding the sphere. Göttelmann (1997, citeseer.ist.psu.edu/ html) defined spherical wavelets using splines on a quasiuniform latitude-longitude grid. Schröder and Sweldens (1995, ACM SIGGRAPH, ) defined them for a triangulation of the sphere. However, these approaches necessarily have special points (poles or vertices). They do not retain rotational symmetry for finite truncations of the wavelet expansion. If we wish to retain rotational symmetry, we must give up on orthogonality. I.e. we must consider frames. Slide 7

8 Wavelets on the Sphere Frames Definitions ψ - A family of functions, { ; J} in a Hilbert space is called a frame if there exist A>0 and B< such that for all ƒ in the space: 2 2 2, ψ J A f f B f - The condition is sufficient to ensure the existence of a dual frame, { ψ ; J} with the property: 1 1 f, ψ ψ = f = f, ψ ψ A A J - A particularly interesting case occurs when A=B. This is called a tight frame. Tight frames are self-dual: f = 1 A J f ψ J ψ, Slide 8

9 Wavelets on the Sphere Frames Tight frames share many of the properties of orthogonal 2 bases. (An orthogonal basis is a tight frame with ψ = 1 and A=1). Tight frames define a transform, since we may write: 1 f = f, A ψ ψ J 1 as: c = f, ψ, f = cψ A c.f. Fourier series: J b ˆ 2 πimt ( b a) 1 2 πimt ( b a) m =, = ( ) d b a a f f e f t e t f() t = m= fˆ e m 2 π imt ( b a) Slide 9

10 Wavelets on the Sphere Frames Example: The Mercedes-Benz Frame - Daubechies, 1992: Ten Lectures on Wavelets ψ 1 = (0, 1) ψ 2 = (-( 3)/2, -1/2) ψ 3 = (( 3)/2, -1/2) Tight frame: = f, ψ = fy + fx fy + fx fy = f Hence, for any ƒ: = 1 f, ψ ψ = f Slide 10

11 Wavelets on the Sphere Frames Example: The discrete spherical transform. Consider functions where 0 n N, -n m n. Let be the (m,n) th spherical harmonic, evaluated at the th gridpoint of the Gaussian grid, and multiplied by sqrt(gaussian integration weight): Then: ψˆ ( mn, ) f ˆ( mn, ) ψˆ ( mn, ) = w( φ ) Y ( λ, φ ) m, n fˆ, ψˆ = fˆ( m, n) w( φ ) Y ( λ, φ ) = w ( φ ) f( λ, φ ) m, n mn, fˆ ( m, n) = f, ψˆ ψˆ ( m, n) = w ( φ ) f( λ, φ ) Y ( λ, φ ) m, n NB: This is a tight frame, not an orthogonal transform. There are more gridpoints than spectral coefficients. Slide 11

12 Wavelets on the Sphere Generalized Frames The concept of a frame can be generalized to the case where the number of basis functions, ψ is uncountable. The sum in the frame condition becomes an integral: A f f, ψ dx B f D x Most of the properties carry over from the discrete case. In particular, for a tight frame, we have: 1 f = f, ψx ψx dx A D - See Kaiser, 1994 A Friendly Guide to Wavelets Slide 12

13 Wavelets on the Sphere Generalized Frames We will consider a specific, semi-discrete case. ψ λ φ The basis functions,,, are labelled by 3 indices: - (discrete) indicates scale λ φ - (continuous) is longitude - (continuous) is latitude We define: ψ, λφ,( λ, φ ) = Ψ ( r( λ, φ, λ, φ)) r( λ, φ, λ, φ) ( λ, φ) - where is the great-circle distance between and. ( λ, φ ) Slide 13

14 Wavelets on the Sphere Generalized Frames The inner product is: f, ψ = f( λ, φ ) ψ ( λ, φ )cos( φ )dλ dφ Let us write:, λφ,, λφ, Ω f ( λφ, ) = f, ψ, λ, φ ψ,,( λ, φ ) Then, substituting for λφ we see that the inner product corresponds to a convolution on the sphere: f ( λ, φ) = f( λ, φ ) Ψ ( r( λ, φ, λ, φ))cos( φ )dλ dφ I.e. f Ω = f Ψ Slide 14

15 Wavelets on the Sphere Generalized Frames We seek a tight frame. The condition is: That is: I.e. Ω Ω f f f, λφ, 2 2, ψ cos( φ)dλdφ = A f 2 2 ( λφ, ) cos( φ)dλdφ= 2 2 = A f A f Evaluating the norms in terms of spherical harmonic coefficients, we have: mn,, mn, 2 2 fˆ ( m, n) = A fˆ( m, n) Slide 15

16 Wavelets on the Sphere Generalized Frames mn,, mn, 2 2 fˆ ( m, n) = A fˆ( m, n) f But, remember that, where is a function of great-circle distance. = f Ψ Ψ Hence: fˆ ( m, n) = fˆ( m, n) Ψˆ ( n) Ψˆ ( n) - where are Legendre transform coefficients. The condition for a tight frame is thus: mn,, mn, 2 2 fˆ( m, n) Ψ ˆ ( n) = A fˆ( m, n) Slide 16

17 Wavelets on the Sphere Generalized Frames I.e. mn,, mn, 2 2 fˆ( m, n) Ψ ˆ ( n) = A fˆ( m, n) Ψ ˆ ( ) ˆ(, ) ˆ n f m n = A f( m, n) mn, mn, ˆ 2 ( n) Ψ = A For convenience, we will scale the basis functions appropriately, so that A=1: ˆ 2 ( n) 1 Ψ = n Slide 17

18 Wavelets on the Sphere Generalized Frames If we have a tight frame, we have the transform property: f =, ψ ψ cos( φ )dλ dφ, λφ,, λφ, = f ( λ, φ ) Ψ ( r( λ, φ, λ, φ))cos( φ )dλ dφ Ω Ω f But, the right hand side is ust another convolution. Hence, the transform pair is ust: f f = Ψ f = Ψ f Slide 18

19 Wavelets on the Sphere Generalized Frames f =Ψ f, f = Ψ f The first equation defines. We can easily verify the second equation: f Ψ (, ) ˆ ( ) ˆ f m n = Ψ n f ( m, n) ˆ 2 = Ψ ( n) f( m, n) = fˆ( m, n ) Slide 19

20 Wavelets on the Sphere Summary A set of functions of great-circle distance, { Ψ () r ; =0,1,2,...} whose Legendre transform coefficients satisfy: ˆ 2 Ψ ( n) = 1 n define a tight generalized frame. The functions define a transform pair : f = Ψ f f = Ψ f Slide 20

21 Wavelets on the Sphere Example The condition: ˆ 2 ( n) 1 Ψ = n ˆ 2 ( ) Ψ n suggests we define the functions to be B-splines. For example, linear B-splines are triangle functions: n N 1 N 1 < n N N N 1 ˆ n N Ψ ( n) = N < n< N 0 otherwise N N + 1 Slide 21

22 Wavelets on the Sphere Example Ψ (n) Slide 22

23 Wavelets on the Sphere Example Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2N 2N N N 2N N 2S4S6S8S 2S 2S4S6S8S 2S 2S4S6S8S 2S 4S 4S 4S 6S 6S 6S 8S 8S 8S Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2N 2N 2N 2N 2N 2N 2S 4S6S 8S 8S 6S 4S2S 2S 4S6S 8S 8S 6S 4S2S 2S 4S6S 8S 8S 6S 4S2S Slide 23

24 Wavelets on the Sphere Example Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2E Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2E Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2E 2E 2E 2E Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2E 2E Slide 24

25 Spherical Wavelets Example T511 Model Orography: 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E N 7N N 5N N 3N 2N 2N N 1N 1S 1S 2S 2S S 3S 4S 4S 5S 5S S 6S 7S 7S 8S S 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E Slide 25

26 Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S4S6S8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S 4S6S 8S 2N 2S 4S 6S 8S 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Spherical Wavelets Example Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N Convolve with Ψ : 2S 4S6S 8S 2S 2S 4S6S 8S 2S 4S 4S 6S 6S 8S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height f =Ψ f 2N 2N 2N 2N 2S4S6S8S 2S 2S4S6S8S 2S 4S 4S 6S 6S 8S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N 2S 4S6S 8S 8S 6S 4S2S 2S 4S6S 8S 8S 6S 4S2S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N 2S 4S 6S 8S 8S6S4S 2S 2S 4S 6S 8S 8S6S4S 2S Slide 26

27 Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S4S6S8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2S 4S6S 8S 2N 2S 4S 6S 8S 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Spherical Wavelets Example Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N Convolve again... 2S 4S6S 8S 2S 2S 4S6S 8S 2S 4S 4S 6S 6S 8S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Ψ f 2N 2N 2N 2N 2S4S6S8S 2S 2S4S6S8S 2S 4S 4S 6S 6S 8S 8S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N 2S 4S6S 8S 8S 6S 4S2S 2S 4S6S 8S 8S 6S 4S2S Analysis VT:Wednesday 1 September UTC Model Level 1 geopotential height 2N 2N 2N 2N 2S 4S 6S 8S 8S6S4S 2S 2S 4S 6S 8S 8S6S4S 2S Slide 27

28 Spherical Wavelets Example... and add, to retrieve the original field: 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E f = Ψ 10E 12E 14E 16E f N 7N N 5N 3N 3N 2N 2N 1N 1N 1S 1S 2S 2S S 3S 4S 4S 5S 5S 6S 6S 7S 7S 8S S 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E Slide 28

29 Spherical Wavelets Other Approaches The wavelets we have derived are similar to those of Freeden and Windheuser (1996, Adv. Comp. Math They are a special case of the very broad range of spherical wavelet decompositions described by Freeden et al. (1998, Constructive Approximation on the Sphere, OUP). A different approach, using group theory, is taken by Antoine and Vandergheynst (1999, Appl. and Comput. Harm. Anal ). - They define spherical wavelets as coherent states of the product group of rotations on the sphere, and dilations on the polarstereographic tangent plane. Mhaskar et al. (2000, Adv. Comput. Math.) describe polynomial wavelet frames on the sphere. - and cite 11 papers, each defining a different approach to the construction of wavelets on the sphere. Slide 29

30 Wavelet J b So, how does all this help us formulate a covariance model? First, let s review the main idea behind the current J b. 3d/4d-Var determine the analysis by minimizing a cost function: J T ( ) 1 T x x B ( x x ) ( d H( x x )) R 1 ( d H( x x )) = + b b b b Usually, we do not minimize directly in terms of x, but formulate the problem as: J T ( ) ( ) χχ d HLχ R d HLχ T 1 = + x= x + Lχ b NB: L defines the background covariance matrix: B=LL T. Slide 30

31 Wavelet J b L defines the background covariance matrix: B=LL T. To keep things simple, consider a 2d, univariate model. The current covariance model boils down to: L = ΣD Σ is diagonal in grid space, and corresponds to multiplying each gridpoint by a standard deviation. - It accounts for the spatial variation of background error. D is diagonal in spectral space, and corresponds to multiplying each wavenumber, n, by a standard deviation, which is a function of n, only. - It accounts for the variation of background error with scale. Slide 31

32 Wavelet J b L = ΣD The current covariance model separates the spatial and spectral variation of background error. In particular, D corresponds to a convolution. D defines the horizontal correlation of background error for the covariance model. Because D is a convolution, the horizontal correlations are the same everywhere. This is a maor shortcoming of the covariance model. Slide 32

33 Wavelet J b To define a covariance model using wavelets, note first that there is no requirement for L to be square. A rectangular matrix L still defines a valid covariance model, B=LL T. We define the control variable as: χ χ χ= χ where the correspond to different scales. The change of variable matrix is defined by: x x = Lχ = Ψˆ Σ χ 1 2 b Slide 33

34 Wavelet J b x x = Lχ = Ψˆ Σ χ b The matrices Σ are diagonal in grid space, and account for the spatial variation of background error for each scale. Let us write the convolution with explicitly as a 1 matrix operator S Ψ ˆ S, where S is the spherical transform, and Ψˆ is diagonal. Using the symmetry of Ψˆ, and Σ, and the orthogonality of S, we can write the covariance matrix implied by L as: = = We will illustrate the covariance structures generated by wavelet Jb by applying this matrix to delta functions. ˆΨ B LL S Ψ SΣ S Ψ S T Slide 34

35 Wavelet J b B LL S Ψ SΣ S Ψ S = = T Consider the case where there is no spatial variation in the standard deviations: Σ. = σ I Then, Ψ SΣ S Ψ is diagonal, with elements. σ Ψˆ ( ) n But, ˆ 2 ( ) Ψ n =, so σ ˆ Ψ ( n) is a weighted average of σ 's ˆ 2 ( ) Ψ n If we choose to be B-splines, then the variation of variance with n is an interpolation between the prescribed. σ 's Slide 35

36 Wavelet J b Suppose we want approximately Gaussian structure functions, with length scale that is a smoothly-varying function of latitude and longitude. Weaver+Courtier (2000) give the following expression for the modal variances corresponding to convolution with a quasi-gaussian function with lengthscale L: b 2 ( n; L) = n ( Lnn ) 2 2 exp ( 1) / 2a + (2n+ 1) exp ( L n( n 1) ) + / 2a 2 2 We simply set: σ = ( N + 1) b( N ; L) max but allow L ( and hence σ ) to vary with latitude and longitude. Slide 36

37 Wavelet J b Desired Length scale (300km 1300km): 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E 7N 7N 5N 5N N 3N 2N 2N 1N 1N 1S 1S 2S 2S 3S 3S 4S S 5S 4S 6S 6S 7S 7S 8S 8S 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E Slide 37

38 2N S 4S6S 8S 2N 2S4S6S8S 2N 2S 4S6S 8S 2N 2S 4S 6S 8S Wavelet J b ˆΨ N S 4S6S 8S Slide 38 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2N 2S4S6S8S 2N 2S4S6S8S Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 2N 2S 4S6S 8S 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa specific humidity Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 2N 2S 4S 6S 8S 2N 2S 4S 6S 8S Analysis VT:Wednesday 1 September UTC 850hPa specific humidity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Ψ x Where x is a set of delta functions

39 2N 0.1 2S 4S6S 8S 2N 2S4S6S8S 2N 2S 4S6S 8S 2N 2S 4S 6S 8S Wavelet J b Analysis VT:Wednesday 1 September UTC 850hPa vorticity 2N S 4S6S 8S Slide 39 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Analysis VT:Wednesday 1 September UTC 850hPa vorticity S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa vorticity 2N 2S4S6S8S 2N 2S4S6S8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Analysis VT:Wednesday 1 September UTC 850hPa vorticity S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa vorticity 2N 2S 4S6S 8S 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Analysis VT:Wednesday 1 September UTC 850hPa vorticity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 2N 2S 4S 6S 8S 2N 2S 4S 6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Scale with σ 2 at each gridpoint, and for each scale.

40 N S 4S6S 8S N 2S4S6S8S 2N 2S 4S6S 8S 2N 2S 4S 6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Wavelet J b Analysis VT:Wednesday 1 September UTC 850hPa vorticity 0.03 Convolve again with 0.06 Slide N S 4S6S 8S N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa vorticity 2N 2S4S6S8S 2N 2S4S6S8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Analysis VT:Wednesday 1 September UTC 850hPa vorticity S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N Analysis VT:Wednesday 1 September UTC 850hPa vorticity 2N 2S 4S6S 8S 2N 2S 4S6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity Analysis VT:Wednesday 1 September UTC 850hPa vorticity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 2N 2S 4S 6S 8S 2N 2S 4S 6S 8S Analysis VT:Wednesday 1 September UTC 850hPa vorticity 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N 8S 6S 4S 2S 2N ˆ ( ) Ψ n

41 Wavelet J b Add together to give: Bx = S Ψ SΣ S Ψ Sx 16W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E N 7N 5N 5N N 3N 2N 2N 1N 1N S 1S 2S 2S 3S 3S S 4S 0.2 5S 5S 6S 6S 7S 7S S 8S W 14W 12W 10W 8W 6W 4W 2W 2E 4E 6E 8E 10E 12E 14E 16E Slide 41

42 Wavelet J b E-W cross-sections, and the Gaussians we wanted: Slide 42

43 Wavelet J b The agreement between the Gaussians we wanted, and the functions we got is not perfect! But note: - No attempt was made to tune the cut-off wavenumbers to improve the accuracy with which the Gaussian structure functions were modelled. - The implied modal variances are effectively linearly interpolated between those for wavenumbers 0,2,4,8,16,... - For large lengthscale (1300km), there is little variance beyond about n=10, so there are very few nodes in the interpolation. - More spectral resolution at large scales may improve the approximation. - Higher order B-splines would also help. Slide 43

44 Wavelet J b Modal variances. Solid = Gaussians. Dashed = Linear Interpolation. Slide 44

45 Wavelet J b E-W cross-sections for a different choice of spectral bands (0,1,3,6,10,16,25,39,60,91,138,208,313,471,511): Slide 45

46 Wavelet J b We demonstrated Wavelet J b by producing structure functions of a given analytic form. However, a significant advantage of Wavelet J b over other approaches to covariance modelling on the sphere (digital filters, diffusion operators, etc.) is that we can calculate the coefficients of the covariance model directly from data. The covariance model is: The transform property gives us: χ x x = Ψˆ Σχ b Σχ =Ψˆ x x But has covariance matrix = I, so (in 2d), Σ is simply the matrix of gridpoint standard deviations of This is easily generated, given a sample of bg errors. Slide 46 ( ) b ˆ Ψ ( x x ) b

47 Wavelet J b Extension of Wavelet J b to 3 spatial dimensions is straightforward. In 2 dimensions, we have: Σ where is diagonal. The diagonal elements are standard deviations. Σ x x = Ψˆ Σχ b In 3 dimensions, becomes block-diagonal, with blocks of dimension NLEVS NLEVS. The diagonal blocks are symmetric square-roots of vertical covariance matrices. This is not fully general, but is sufficient to capture the variation of vertical correlation with horizontal scale, and with location. Slide 47

48 Wavelet J b Example: Horizontal and vertical Vorticity Correlations. North America Equatorial Pacific Slide 48

49 Wavelet J b Memory and Cost At first sight, the memory requirements for Wavelet J b appear high. Ψ ˆ ( n) = 0 for n> N + χ However, if p then the are strictly band-limited, and may be represented on Gaussian grids of appropriate resolution. If we arrange for: N N then the memory requirement for the control vector is at most p+2 full model grids, where p is the order of the B- splines. Only p+1 full-resolution spherical transforms are required. Slide 49

50 Wavelet J b Memory and Cost Storage for the vertical covariance matrices is potentially enormous. But, can be reduced to manageable levels by reducing their spatial resolution (e.g. one matrix for every 10 gridpoints). The main CPU requirement is in handling the increasedlength control vector. The bottom line is that Wavelet J b adds about 5% to the cost of a 4d-Var analysis. I think it s worth it! Slide 50

51 Summary Tight frames provide a useful mathematical construct. They share many of the desirable properties of orthogonal bases, but allow considerable flexibility. Using tight frames, a flexible family of wavelets may be defined on the sphere. Unlike grid-based wavelets, there is no pole problem. There is a lot of scope for tuning of the spectral and spatial resolution. (This remains to be explored.) Wavelet J b is expected to be implemented operationally in the 4d-Var system by the end of this year. Slide 51

Background Error Covariance Modelling

Background Error Covariance Modelling Background Error Covariance Modelling Mike Fisher Slide 1 Outline Diagnosing the Statistics of Background Error using Ensembles of Analyses Modelling the Statistics in Spectral Space - Relaxing constraints

More information

Background Error Covariance Modelling

Background Error Covariance Modelling Background Error Covariance Modelling M Fisher European Centre for Medium-Range Weather Forecasts m.fisher@ecmwf.int. Introduction The modelling and specification of the covariance matrix of background

More information

Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices

Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices Representation of inhomogeneous, non-separable covariances by sparse wavelet-transformed matrices Andreas Rhodin, Harald Anlauf German Weather Service (DWD) Workshop on Flow-dependent aspects of data assimilation,

More information

Spectral transforms. Contents. ARPEGE-Climat Version 5.1. September Introduction 2

Spectral transforms. Contents. ARPEGE-Climat Version 5.1. September Introduction 2 Spectral transforms ARPEGE-Climat Version 5.1 September 2008 Contents 1 Introduction 2 2 Spectral representation 2 2.1 Spherical harmonics....................... 2 2.2 Collocation grid.........................

More information

Overview of the Numerics of the ECMWF. Atmospheric Forecast Model

Overview of the Numerics of the ECMWF. Atmospheric Forecast Model Overview of the Numerics of the Atmospheric Forecast Model M. Hortal Seminar 6 Sept 2004 Slide 1 Characteristics of the model Hydrostatic shallow-atmosphere approimation Pressure-based hybrid vertical

More information

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations

The ECMWF Hybrid 4D-Var and Ensemble of Data Assimilations The Hybrid 4D-Var and Ensemble of Data Assimilations Lars Isaksen, Massimo Bonavita and Elias Holm Data Assimilation Section lars.isaksen@ecmwf.int Acknowledgements to: Mike Fisher and Marta Janiskova

More information

Introduction to Hilbert Space Frames

Introduction to Hilbert Space Frames to Hilbert Space Frames May 15, 2009 to Hilbert Space Frames What is a frame? Motivation Coefficient Representations The Frame Condition Bases A linearly dependent frame An infinite dimensional frame Reconstructing

More information

A Fast Spherical Filter with Uniform Resolution

A Fast Spherical Filter with Uniform Resolution JOURNAL OF COMPUTATIONAL PHYSICS 136, 580 584 (1997) ARTICLE NO. CP975782 A Fast Spherical Filter with Uniform Resolution Rüdiger Jakob-Chien*, and Bradley K. Alpert *Department of Computer Science & Engineering,

More information

Inner product spaces. Layers of structure:

Inner product spaces. Layers of structure: Inner product spaces Layers of structure: vector space normed linear space inner product space The abstract definition of an inner product, which we will see very shortly, is simple (and by itself is pretty

More information

The spectral transform method

The spectral transform method The spectral transform method by Nils Wedi European Centre for Medium-Range Weather Forecasts wedi@ecmwf.int Advanced Numerical Methods for Earth-System Modelling Slide 1 Advanced Numerical Methods for

More information

MGA Tutorial, September 08, 2004 Construction of Wavelets. Jan-Olov Strömberg

MGA Tutorial, September 08, 2004 Construction of Wavelets. Jan-Olov Strömberg MGA Tutorial, September 08, 2004 Construction of Wavelets Jan-Olov Strömberg Department of Mathematics Royal Institute of Technology (KTH) Stockholm, Sweden Department of Numerical Analysis and Computer

More information

The quantum state as a vector

The quantum state as a vector The quantum state as a vector February 6, 27 Wave mechanics In our review of the development of wave mechanics, we have established several basic properties of the quantum description of nature:. A particle

More information

Spherical Harmonics and Related Topics. David Randall 2 S = 0, r 2 r r S 2. S = r n Y n

Spherical Harmonics and Related Topics. David Randall 2 S = 0, r 2 r r S 2. S = r n Y n ! Revised April 10, 2017 1:32 PM! 1 Spherical Harmonics and Related Topics David Randall The spherical surface harmonics are convenient functions for representing the distribution of geophysical quantities

More information

Biorthogonal Spline Type Wavelets

Biorthogonal Spline Type Wavelets PERGAMON Computers and Mathematics with Applications 0 (00 1 0 www.elsevier.com/locate/camwa Biorthogonal Spline Type Wavelets Tian-Xiao He Department of Mathematics and Computer Science Illinois Wesleyan

More information

GSI Tutorial Background and Observation Errors: Estimation and Tuning. Daryl Kleist NCEP/EMC June 2011 GSI Tutorial

GSI Tutorial Background and Observation Errors: Estimation and Tuning. Daryl Kleist NCEP/EMC June 2011 GSI Tutorial GSI Tutorial 2011 Background and Observation Errors: Estimation and Tuning Daryl Kleist NCEP/EMC 29-30 June 2011 GSI Tutorial 1 Background Errors 1. Background error covariance 2. Multivariate relationships

More information

Anouncements. Assignment 3 has been posted!

Anouncements. Assignment 3 has been posted! Anouncements Assignment 3 has been posted! FFTs in Graphics and Vision Correlation of Spherical Functions Outline Math Review Spherical Correlation Review Dimensionality: Given a complex n-dimensional

More information

UNIVERSITY OF WISCONSIN-MADISON CENTER FOR THE MATHEMATICAL SCIENCES. Tight compactly supported wavelet frames of arbitrarily high smoothness

UNIVERSITY OF WISCONSIN-MADISON CENTER FOR THE MATHEMATICAL SCIENCES. Tight compactly supported wavelet frames of arbitrarily high smoothness UNIVERSITY OF WISCONSIN-MADISON CENTER FOR THE MATHEMATICAL SCIENCES Tight compactly supported wavelet frames of arbitrarily high smoothness Karlheinz Gröchenig Amos Ron Department of Mathematics U-9 University

More information

Week 7: Integration: Special Coordinates

Week 7: Integration: Special Coordinates Week 7: Integration: Special Coordinates Introduction Many problems naturally involve symmetry. One should exploit it where possible and this often means using coordinate systems other than Cartesian coordinates.

More information

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2)

Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Numerical Weather prediction at the European Centre for Medium-Range Weather Forecasts (2) Time series curves 500hPa geopotential Correlation coefficent of forecast anomaly N Hemisphere Lat 20.0 to 90.0

More information

Learning gradients: prescriptive models

Learning gradients: prescriptive models Department of Statistical Science Institute for Genome Sciences & Policy Department of Computer Science Duke University May 11, 2007 Relevant papers Learning Coordinate Covariances via Gradients. Sayan

More information

Contents. 0.1 Notation... 3

Contents. 0.1 Notation... 3 Contents 0.1 Notation........................................ 3 1 A Short Course on Frame Theory 4 1.1 Examples of Signal Expansions............................ 4 1.2 Signal Expansions in Finite-Dimensional

More information

WAVELETS WITH COMPOSITE DILATIONS

WAVELETS WITH COMPOSITE DILATIONS ELECTRONIC RESEARCH ANNOUNCEMENTS OF THE AMERICAN MATHEMATICAL SOCIETY Volume 00, Pages 000 000 (Xxxx XX, XXXX S 1079-6762(XX0000-0 WAVELETS WITH COMPOSITE DILATIONS KANGHUI GUO, DEMETRIO LABATE, WANG-Q

More information

Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing

Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing Wavelet Bi-frames with Uniform Symmetry for Curve Multiresolution Processing Qingtang Jiang Abstract This paper is about the construction of univariate wavelet bi-frames with each framelet being symmetric.

More information

PART II : Least-Squares Approximation

PART II : Least-Squares Approximation PART II : Least-Squares Approximation Basic theory Let U be an inner product space. Let V be a subspace of U. For any g U, we look for a least-squares approximation of g in the subspace V min f V f g 2,

More information

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels

Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Solving the 3D Laplace Equation by Meshless Collocation via Harmonic Kernels Y.C. Hon and R. Schaback April 9, Abstract This paper solves the Laplace equation u = on domains Ω R 3 by meshless collocation

More information

Physics 6303 Lecture 11 September 24, LAST TIME: Cylindrical coordinates, spherical coordinates, and Legendre s equation

Physics 6303 Lecture 11 September 24, LAST TIME: Cylindrical coordinates, spherical coordinates, and Legendre s equation Physics 6303 Lecture September 24, 208 LAST TIME: Cylindrical coordinates, spherical coordinates, and Legendre s equation, l l l l l l. Consider problems that are no axisymmetric; i.e., the potential depends

More information

Lecture Notes 5: Multiresolution Analysis

Lecture Notes 5: Multiresolution Analysis Optimization-based data analysis Fall 2017 Lecture Notes 5: Multiresolution Analysis 1 Frames A frame is a generalization of an orthonormal basis. The inner products between the vectors in a frame and

More information

Adaptive Localization: Proposals for a high-resolution multivariate system Ross Bannister, HRAA, December 2008, January 2009 Version 3.

Adaptive Localization: Proposals for a high-resolution multivariate system Ross Bannister, HRAA, December 2008, January 2009 Version 3. Adaptive Localization: Proposals for a high-resolution multivariate system Ross Bannister, HRAA, December 2008, January 2009 Version 3.. The implicit Schur product 2. The Bishop method for adaptive localization

More information

Frame Diagonalization of Matrices

Frame Diagonalization of Matrices Frame Diagonalization of Matrices Fumiko Futamura Mathematics and Computer Science Department Southwestern University 00 E University Ave Georgetown, Texas 78626 U.S.A. Phone: + (52) 863-98 Fax: + (52)

More information

Computational Fluid Dynamics Prof. Dr. Suman Chakraborty Department of Mechanical Engineering Indian Institute of Technology, Kharagpur

Computational Fluid Dynamics Prof. Dr. Suman Chakraborty Department of Mechanical Engineering Indian Institute of Technology, Kharagpur Computational Fluid Dynamics Prof. Dr. Suman Chakraborty Department of Mechanical Engineering Indian Institute of Technology, Kharagpur Lecture No. #12 Fundamentals of Discretization: Finite Volume Method

More information

Heterogeneous Correlation Modeling Based on the Wavelet Diagonal Assumption and on the Diffusion Operator

Heterogeneous Correlation Modeling Based on the Wavelet Diagonal Assumption and on the Diffusion Operator SEPTEMBER 2009 P A N N E K O U C K E 2995 Heterogeneous Correlation Modeling Based on the Wavelet Diagonal Assumption and on the Diffusion Operator OLIVIER PANNEKOUCKE CNRM/GAME, Météo-France/CNRS, Toulouse,

More information

DISCRETE CDF 9/7 WAVELET TRANSFORM FOR FINITE-LENGTH SIGNALS

DISCRETE CDF 9/7 WAVELET TRANSFORM FOR FINITE-LENGTH SIGNALS DISCRETE CDF 9/7 WAVELET TRANSFORM FOR FINITE-LENGTH SIGNALS D. Černá, V. Finěk Department of Mathematics and Didactics of Mathematics, Technical University in Liberec Abstract Wavelets and a discrete

More information

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ).

x. Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ 2 ). .8.6 µ =, σ = 1 µ = 1, σ = 1 / µ =, σ =.. 3 1 1 3 x Figure 1: Examples of univariate Gaussian pdfs N (x; µ, σ ). The Gaussian distribution Probably the most-important distribution in all of statistics

More information

Symmetric Wavelet Tight Frames with Two Generators

Symmetric Wavelet Tight Frames with Two Generators Symmetric Wavelet Tight Frames with Two Generators Ivan W. Selesnick Electrical and Computer Engineering Polytechnic University 6 Metrotech Center, Brooklyn, NY 11201, USA tel: 718 260-3416, fax: 718 260-3906

More information

Mathematical Methods for Computer Science

Mathematical Methods for Computer Science Mathematical Methods for Computer Science Computer Laboratory Computer Science Tripos, Part IB Michaelmas Term 2016/17 Professor J. Daugman Exercise problems Fourier and related methods 15 JJ Thomson Avenue

More information

From Bernstein approximation to Zauner s conjecture

From Bernstein approximation to Zauner s conjecture From Bernstein approximation to Zauner s conjecture Shayne Waldron Mathematics Department, University of Auckland December 5, 2017 Shayne Waldron (University of Auckland) Workshop on Spline Approximation

More information

Wavelets and multiresolution representations. Time meets frequency

Wavelets and multiresolution representations. Time meets frequency Wavelets and multiresolution representations Time meets frequency Time-Frequency resolution Depends on the time-frequency spread of the wavelet atoms Assuming that ψ is centred in t=0 Signal domain + t

More information

Spherical Diffusion. ScholarlyCommons. University of Pennsylvania. Thomas Bülow University of Pennsylvania

Spherical Diffusion. ScholarlyCommons. University of Pennsylvania. Thomas Bülow University of Pennsylvania University of Pennsylvania ScholarlyCommons Technical Reports (CIS) Department of Computer & Information Science 12-30-2001 Spherical Diffusion Thomas Bülow University of Pennsylvania Follow this and additional

More information

Topics in Representation Theory: Fourier Analysis and the Peter Weyl Theorem

Topics in Representation Theory: Fourier Analysis and the Peter Weyl Theorem Topics in Representation Theory: Fourier Analysis and the Peter Weyl Theorem 1 Fourier Analysis, a review We ll begin with a short review of simple facts about Fourier analysis, before going on to interpret

More information

Lecture 8: Differential Equations. Philip Moriarty,

Lecture 8: Differential Equations. Philip Moriarty, Lecture 8: Differential Equations Philip Moriarty, philip.moriarty@nottingham.ac.uk NB Notes based heavily on lecture slides prepared by DE Rourke for the F32SMS module, 2006 8.1 Overview In this final

More information

Multiscale Frame-based Kernels for Image Registration

Multiscale Frame-based Kernels for Image Registration Multiscale Frame-based Kernels for Image Registration Ming Zhen, Tan National University of Singapore 22 July, 16 Ming Zhen, Tan (National University of Singapore) Multiscale Frame-based Kernels for Image

More information

Space-Frequency Atoms

Space-Frequency Atoms Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200

More information

An Introduction to Wavelets and some Applications

An Introduction to Wavelets and some Applications An Introduction to Wavelets and some Applications Milan, May 2003 Anestis Antoniadis Laboratoire IMAG-LMC University Joseph Fourier Grenoble, France An Introduction to Wavelets and some Applications p.1/54

More information

FFTs in Graphics and Vision. Fast Alignment of Spherical Functions

FFTs in Graphics and Vision. Fast Alignment of Spherical Functions FFTs in Graphics and Vision Fast Alignment of Spherical Functions Outline Math Review Fast Rotational Alignment Review Recall 1: We can represent any rotation R in terms of the triplet of Euler angles

More information

Fitting Linear Statistical Models to Data by Least Squares II: Weighted

Fitting Linear Statistical Models to Data by Least Squares II: Weighted Fitting Linear Statistical Models to Data by Least Squares II: Weighted Brian R. Hunt and C. David Levermore University of Maryland, College Park Math 420: Mathematical Modeling April 21, 2014 version

More information

How does 4D-Var handle Nonlinearity and non-gaussianity?

How does 4D-Var handle Nonlinearity and non-gaussianity? How does 4D-Var handle Nonlinearity and non-gaussianity? Mike Fisher Acknowledgements: Christina Tavolato, Elias Holm, Lars Isaksen, Tavolato, Yannick Tremolet Slide 1 Outline of Talk Non-Gaussian pdf

More information

RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee

RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets Class 22, 2004 Tomaso Poggio and Sayan Mukherjee RKHS, Mercer s theorem, Unbounded domains, Frames and Wavelets 9.520 Class 22, 2004 Tomaso Poggio and Sayan Mukherjee About this class Goal To introduce an alternate perspective of RKHS via integral operators

More information

Background error modelling: climatological flow-dependence

Background error modelling: climatological flow-dependence Background error modelling: climatological flow-dependence Yann MICHEL NCAR/MMM/B Meeting 16 th April 2009 1 Introduction 2 A new estimate of lengthscales 3 Climatological flow-dependence Yann MICHEL B

More information

A Tutorial on Wavelets and their Applications. Martin J. Mohlenkamp

A Tutorial on Wavelets and their Applications. Martin J. Mohlenkamp A Tutorial on Wavelets and their Applications Martin J. Mohlenkamp University of Colorado at Boulder Department of Applied Mathematics mjm@colorado.edu This tutorial is designed for people with little

More information

Comparison between Wavenumber Truncation and Horizontal Diffusion Methods in Spectral Models

Comparison between Wavenumber Truncation and Horizontal Diffusion Methods in Spectral Models 152 MONTHLY WEATHER REVIEW Comparison between Wavenumber Truncation and Horizontal Diffusion Methods in Spectral Models PETER C. CHU, XIONG-SHAN CHEN, AND CHENWU FAN Department of Oceanography, Naval Postgraduate

More information

2. Outline of the MRI-EPS

2. Outline of the MRI-EPS 2. Outline of the MRI-EPS The MRI-EPS includes BGM cycle system running on the MRI supercomputer system, which is developed by using the operational one-month forecasting system by the Climate Prediction

More information

Approximately dual frames in Hilbert spaces and applications to Gabor frames

Approximately dual frames in Hilbert spaces and applications to Gabor frames Approximately dual frames in Hilbert spaces and applications to Gabor frames Ole Christensen and Richard S. Laugesen October 22, 200 Abstract Approximately dual frames are studied in the Hilbert space

More information

Recurrence Relations and Fast Algorithms

Recurrence Relations and Fast Algorithms Recurrence Relations and Fast Algorithms Mark Tygert Research Report YALEU/DCS/RR-343 December 29, 2005 Abstract We construct fast algorithms for decomposing into and reconstructing from linear combinations

More information

Stochastic Spectral Approaches to Bayesian Inference

Stochastic Spectral Approaches to Bayesian Inference Stochastic Spectral Approaches to Bayesian Inference Prof. Nathan L. Gibson Department of Mathematics Applied Mathematics and Computation Seminar March 4, 2011 Prof. Gibson (OSU) Spectral Approaches to

More information

( nonlinear constraints)

( nonlinear constraints) Wavelet Design & Applications Basic requirements: Admissibility (single constraint) Orthogonality ( nonlinear constraints) Sparse Representation Smooth functions well approx. by Fourier High-frequency

More information

Numerical Methods I Orthogonal Polynomials

Numerical Methods I Orthogonal Polynomials Numerical Methods I Orthogonal Polynomials Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 Nov. 4th and 11th, 2010 A. Donev (Courant Institute)

More information

Cubic Splines MATH 375. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Cubic Splines

Cubic Splines MATH 375. J. Robert Buchanan. Fall Department of Mathematics. J. Robert Buchanan Cubic Splines Cubic Splines MATH 375 J. Robert Buchanan Department of Mathematics Fall 2006 Introduction Given data {(x 0, f(x 0 )), (x 1, f(x 1 )),...,(x n, f(x n ))} which we wish to interpolate using a polynomial...

More information

Moments conservation in adaptive Vlasov solver

Moments conservation in adaptive Vlasov solver 12 Moments conservation in adaptive Vlasov solver M. Gutnic a,c, M. Haefele b,c and E. Sonnendrücker a,c a IRMA, Université Louis Pasteur, Strasbourg, France. b LSIIT, Université Louis Pasteur, Strasbourg,

More information

+ y = 1 : the polynomial

+ y = 1 : the polynomial Notes on Basic Ideas of Spherical Harmonics In the representation of wavefields (solutions of the wave equation) one of the natural considerations that arise along the lines of Huygens Principle is the

More information

Rings, Paths, and Paley Graphs

Rings, Paths, and Paley Graphs Spectral Graph Theory Lecture 5 Rings, Paths, and Paley Graphs Daniel A. Spielman September 12, 2012 5.1 About these notes These notes are not necessarily an accurate representation of what happened in

More information

(ii) Observational Geomagnetism. Lecture 5: Spherical harmonic field models

(ii) Observational Geomagnetism. Lecture 5: Spherical harmonic field models (ii) Observational Geomagnetism Lecture 5: Spherical harmonic field models Lecture 5: Spherical harmonic field models 5.1 Introduction 5.2 How to represent functions on a spherical surface 5.3 Spherical

More information

Quantum Mechanics-I Prof. Dr. S. Lakshmi Bala Department of Physics Indian Institute of Technology, Madras. Lecture - 21 Square-Integrable Functions

Quantum Mechanics-I Prof. Dr. S. Lakshmi Bala Department of Physics Indian Institute of Technology, Madras. Lecture - 21 Square-Integrable Functions Quantum Mechanics-I Prof. Dr. S. Lakshmi Bala Department of Physics Indian Institute of Technology, Madras Lecture - 21 Square-Integrable Functions (Refer Slide Time: 00:06) (Refer Slide Time: 00:14) We

More information

Space-Frequency Atoms

Space-Frequency Atoms Space-Frequency Atoms FREQUENCY FREQUENCY SPACE SPACE FREQUENCY FREQUENCY SPACE SPACE Figure 1: Space-frequency atoms. Windowed Fourier Transform 1 line 1 0.8 0.6 0.4 0.2 0-0.2-0.4-0.6-0.8-1 0 100 200

More information

M. Holschneider 1 A. Eicker 2 R. Schachtschneider 1 T. Mayer-Guerr 2 K. Ilk 2

M. Holschneider 1 A. Eicker 2 R. Schachtschneider 1 T. Mayer-Guerr 2 K. Ilk 2 SPP project TREGMAT: Tailored Gravity Field Models for Mass Distributions and Mass Transport Phenomena in the Earth System by by M. 1 A. Eicker 2 R. Schachtschneider 1 T. Mayer-Guerr 2 K. Ilk 2 1 University

More information

A Riesz basis of wavelets and its dual with quintic deficient splines

A Riesz basis of wavelets and its dual with quintic deficient splines Note di Matematica 25, n. 1, 2005/2006, 55 62. A Riesz basis of wavelets and its dual with quintic deficient splines F. Bastin Department of Mathematics B37, University of Liège, B-4000 Liège, Belgium

More information

HARMONIC ANALYSIS. Date:

HARMONIC ANALYSIS. Date: HARMONIC ANALYSIS Contents. Introduction 2. Hardy-Littlewood maximal function 3. Approximation by convolution 4. Muckenhaupt weights 4.. Calderón-Zygmund decomposition 5. Fourier transform 6. BMO (bounded

More information

Variational Data Assimilation Current Status

Variational Data Assimilation Current Status Variational Data Assimilation Current Status Eĺıas Valur Hólm with contributions from Mike Fisher and Yannick Trémolet ECMWF NORDITA Solar and stellar dynamos and cycles October 2009 Eĺıas Valur Hólm (ECMWF)

More information

New variables in spherical geometry. David G. Dritschel. Mathematical Institute University of St Andrews.

New variables in spherical geometry. David G. Dritschel. Mathematical Institute University of St Andrews. New variables in spherical geometry David G Dritschel Mathematical Institute University of St Andrews http://www-vortexmcsst-andacuk Collaborators: Ali Mohebalhojeh (Tehran St Andrews) Jemma Shipton &

More information

2D Wavelets. Hints on advanced Concepts

2D Wavelets. Hints on advanced Concepts 2D Wavelets Hints on advanced Concepts 1 Advanced concepts Wavelet packets Laplacian pyramid Overcomplete bases Discrete wavelet frames (DWF) Algorithme à trous Discrete dyadic wavelet frames (DDWF) Overview

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 33: Adaptive Iteration Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter 33 1 Outline 1 A

More information

Introduction to Gabor Analysis

Introduction to Gabor Analysis Theoretical and Computational Aspects Numerical Harmonic Group under the supervision of Prof. Dr. Hans Georg Feichtinger 30 Oct 2012 Outline 1 2 3 4 5 6 7 DFT/ idft Discrete Given an input signal f of

More information

Filtering of variances and correlations by local spatial averaging. Loïk Berre Météo-France

Filtering of variances and correlations by local spatial averaging. Loïk Berre Météo-France Filtering of variances and correlations by local spatial averaging Loïk Berre Météo-France Outline 1. Contrast between two extreme approaches in Var/EnKF? 2.The spatial structure of sampling noise and

More information

NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE

NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE NEEDLET APPROXIMATION FOR ISOTROPIC RANDOM FIELDS ON THE SPHERE Quoc T. Le Gia Ian H. Sloan Yu Guang Wang Robert S. Womersley School of Mathematics and Statistics University of New South Wales, Australia

More information

Fast Numerical Methods for Stochastic Computations

Fast Numerical Methods for Stochastic Computations Fast AreviewbyDongbinXiu May 16 th,2013 Outline Motivation 1 Motivation 2 3 4 5 Example: Burgers Equation Let us consider the Burger s equation: u t + uu x = νu xx, x [ 1, 1] u( 1) =1 u(1) = 1 Example:

More information

Digital Image Processing

Digital Image Processing Digital Image Processing 2D SYSTEMS & PRELIMINARIES Hamid R. Rabiee Fall 2015 Outline 2 Two Dimensional Fourier & Z-transform Toeplitz & Circulant Matrices Orthogonal & Unitary Matrices Block Matrices

More information

Cambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information

Cambridge University Press The Mathematics of Signal Processing Steven B. Damelin and Willard Miller Excerpt More information Introduction Consider a linear system y = Φx where Φ can be taken as an m n matrix acting on Euclidean space or more generally, a linear operator on a Hilbert space. We call the vector x a signal or input,

More information

Digital Image Processing

Digital Image Processing Digital Image Processing Wavelets and Multiresolution Processing () Christophoros Nikou cnikou@cs.uoi.gr University of Ioannina - Department of Computer Science 2 Contents Image pyramids Subband coding

More information

Numerical Approximation Methods for Non-Uniform Fourier Data

Numerical Approximation Methods for Non-Uniform Fourier Data Numerical Approximation Methods for Non-Uniform Fourier Data Aditya Viswanathan aditya@math.msu.edu 2014 Joint Mathematics Meetings January 18 2014 0 / 16 Joint work with Anne Gelb (Arizona State) Guohui

More information

MATH 590: Meshfree Methods

MATH 590: Meshfree Methods MATH 590: Meshfree Methods Chapter 33: Adaptive Iteration Greg Fasshauer Department of Applied Mathematics Illinois Institute of Technology Fall 2010 fasshauer@iit.edu MATH 590 Chapter 33 1 Outline 1 A

More information

A Short Course on Frame Theory

A Short Course on Frame Theory A Short Course on Frame Theory Veniamin I. Morgenshtern and Helmut Bölcskei ETH Zurich, 8092 Zurich, Switzerland E-mail: {vmorgens, boelcskei}@nari.ee.ethz.ch April 2, 20 Hilbert spaces [, Def. 3.-] and

More information

A Reverse Technique for Lumping High Dimensional Model Representation Method

A Reverse Technique for Lumping High Dimensional Model Representation Method A Reverse Technique for Lumping High Dimensional Model Representation Method M. ALPER TUNGA Bahçeşehir University Department of Software Engineering Beşiktaş, 34349, İstanbul TURKEY TÜRKİYE) alper.tunga@bahcesehir.edu.tr

More information

Supporting Information

Supporting Information Supporting Information Harig and Simons 1.173/pnas.178519 SI Text Determination of Noise. Gravity Recovery and Climate Experiment (GRACE) data are released as spherical harmonic coefficients along with

More information

SOLVING HYPERBOLIC PARTIAL DIFFERENTIAL EQUATIONS IN SPHERICAL GEOMETRY WITH RADIAL BASIS FUNCTIONS

SOLVING HYPERBOLIC PARTIAL DIFFERENTIAL EQUATIONS IN SPHERICAL GEOMETRY WITH RADIAL BASIS FUNCTIONS SOLVING HYPERBOLIC PARTIAL DIFFERENTIAL EQUATIONS IN SPHERICAL GEOMETRY WITH RADIAL BASIS FUNCTIONS NATASHA FLYER 1. Introduction Mathematical modeling of space and climate phenomena generally requires

More information

Multiresolution Analysis

Multiresolution Analysis Multiresolution Analysis DS-GA 1013 / MATH-GA 2824 Optimization-based Data Analysis http://www.cims.nyu.edu/~cfgranda/pages/obda_fall17/index.html Carlos Fernandez-Granda Frames Short-time Fourier transform

More information

Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, Jeffreys priors. exp 1 ) p 2

Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, Jeffreys priors. exp 1 ) p 2 Stat260: Bayesian Modeling and Inference Lecture Date: February 10th, 2010 Jeffreys priors Lecturer: Michael I. Jordan Scribe: Timothy Hunter 1 Priors for the multivariate Gaussian Consider a multivariate

More information

The Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM

The Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM The Impact of Background Error on Incomplete Observations for 4D-Var Data Assimilation with the FSU GSM I. Michael Navon 1, Dacian N. Daescu 2, and Zhuo Liu 1 1 School of Computational Science and Information

More information

An Introduction to Filterbank Frames

An Introduction to Filterbank Frames An Introduction to Filterbank Frames Brody Dylan Johnson St. Louis University October 19, 2010 Brody Dylan Johnson (St. Louis University) An Introduction to Filterbank Frames October 19, 2010 1 / 34 Overview

More information

Lecture 22. r i+1 = b Ax i+1 = b A(x i + α i r i ) =(b Ax i ) α i Ar i = r i α i Ar i

Lecture 22. r i+1 = b Ax i+1 = b A(x i + α i r i ) =(b Ax i ) α i Ar i = r i α i Ar i 8.409 An Algorithmist s oolkit December, 009 Lecturer: Jonathan Kelner Lecture Last time Last time, we reduced solving sparse systems of linear equations Ax = b where A is symmetric and positive definite

More information

1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2

1 The Continuous Wavelet Transform The continuous wavelet transform (CWT) Discretisation of the CWT... 2 Contents 1 The Continuous Wavelet Transform 1 1.1 The continuous wavelet transform (CWT)............. 1 1. Discretisation of the CWT...................... Stationary wavelet transform or redundant wavelet

More information

10-701/ Recitation : Kernels

10-701/ Recitation : Kernels 10-701/15-781 Recitation : Kernels Manojit Nandi February 27, 2014 Outline Mathematical Theory Banach Space and Hilbert Spaces Kernels Commonly Used Kernels Kernel Theory One Weird Kernel Trick Representer

More information

Approximation by Conditionally Positive Definite Functions with Finitely Many Centers

Approximation by Conditionally Positive Definite Functions with Finitely Many Centers Approximation by Conditionally Positive Definite Functions with Finitely Many Centers Jungho Yoon Abstract. The theory of interpolation by using conditionally positive definite function provides optimal

More information

Spectra of Multiplication Operators as a Numerical Tool. B. Vioreanu and V. Rokhlin Technical Report YALEU/DCS/TR-1443 March 3, 2011

Spectra of Multiplication Operators as a Numerical Tool. B. Vioreanu and V. Rokhlin Technical Report YALEU/DCS/TR-1443 March 3, 2011 We introduce a numerical procedure for the construction of interpolation and quadrature formulae on bounded convex regions in the plane. The construction is based on the behavior of spectra of certain

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 12 Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign Copyright c 2002. Reproduction permitted for noncommercial,

More information

Lectures notes. Rheology and Fluid Dynamics

Lectures notes. Rheology and Fluid Dynamics ÉC O L E P O L Y T E C H N IQ U E FÉ DÉR A L E D E L A U S A N N E Christophe Ancey Laboratoire hydraulique environnementale (LHE) École Polytechnique Fédérale de Lausanne Écublens CH-05 Lausanne Lectures

More information

Mathematical Introduction

Mathematical Introduction Chapter 1 Mathematical Introduction HW #1: 164, 165, 166, 181, 182, 183, 1811, 1812, 114 11 Linear Vector Spaces: Basics 111 Field A collection F of elements a,b etc (also called numbers or scalars) with

More information

Machine Learning (Spring 2012) Principal Component Analysis

Machine Learning (Spring 2012) Principal Component Analysis 1-71 Machine Learning (Spring 1) Principal Component Analysis Yang Xu This note is partly based on Chapter 1.1 in Chris Bishop s book on PRML and the lecture slides on PCA written by Carlos Guestrin in

More information

A short introduction to frames, Gabor systems, and wavelet systems

A short introduction to frames, Gabor systems, and wavelet systems Downloaded from orbit.dtu.dk on: Mar 04, 2018 A short introduction to frames, Gabor systems, and wavelet systems Christensen, Ole Published in: Azerbaijan Journal of Mathematics Publication date: 2014

More information

Multivariate Distributions

Multivariate Distributions IEOR E4602: Quantitative Risk Management Spring 2016 c 2016 by Martin Haugh Multivariate Distributions We will study multivariate distributions in these notes, focusing 1 in particular on multivariate

More information

446 SCIENCE IN CHINA (Series F) Vol. 46 introduced in refs. [6, ]. Based on this inequality, we add normalization condition, symmetric conditions and

446 SCIENCE IN CHINA (Series F) Vol. 46 introduced in refs. [6, ]. Based on this inequality, we add normalization condition, symmetric conditions and Vol. 46 No. 6 SCIENCE IN CHINA (Series F) December 003 Construction for a class of smooth wavelet tight frames PENG Lizhong (Λ Π) & WANG Haihui (Ξ ) LMAM, School of Mathematical Sciences, Peking University,

More information

The Conjugate Gradient Method

The Conjugate Gradient Method The Conjugate Gradient Method Classical Iterations We have a problem, We assume that the matrix comes from a discretization of a PDE. The best and most popular model problem is, The matrix will be as large

More information