Ensemble Data Assimila.on and Uncertainty Quan.fica.on

Size: px
Start display at page:

Download "Ensemble Data Assimila.on and Uncertainty Quan.fica.on"

Transcription

1 Ensemble Data Assimila.on and Uncertainty Quan.fica.on Jeffrey Anderson, Alicia Karspeck, Tim Hoar, Nancy Collins, Kevin Raeder, Steve Yeager Na.onal Center for Atmospheric Research Ocean Sciences Mee.ng 24 Feb

2 What is Data Assimila.on? Observa.ons combined with a Model forecast + to produce an analysis (best possible es.mate). Ocean Sciences Mee.ng 24 Feb

3 What is Ensemble Data Assimila.on? Use an ensemble (set) of model forecasts. Use sample sta.s.cs to get covariance between state and observa.ons. OYen assume that ensemble members are random draw. Ensemble methods I use are op.mal solu.on when: 1. Model is linear, 2. Observa.on errors are unbiased gaussian, 3. Rela.on between model and obs is linear, 4. Ensemble is large enough. Ocean Sciences Mee.ng 24 Feb

4 Atmospheric Ensemble Reanalysis, O(1 million) atmospheric obs are assimilated every day. Assimilation uses 8 members of 2 o FV CAM forced by a single ocean (Hadley+ NCEP-OI2) and produces a very competitive reanalysis. hpa GPH Feb Ocean Sciences Mee.ng 24 Feb

5 Ensemble Filter for Large Geophysical Models 1. Use model to advance ensemble (3 members here) to.me at which next observa.on becomes available. Ensemble state es.mate ayer using previous observa.on (analysis) Ensemble state at.me of next observa.on (prior) Ocean Sciences Mee.ng 24 Feb. 212

6 Ensemble Filter for Large Geophysical Models 2. Get prior ensemble sample of observa.on, y = h(x), by applying forward operator h to each ensemble member. Theory: observa.ons from instruments with uncorrelated errors can be done sequen.ally. Ocean Sciences Mee.ng 24 Feb

7 Ensemble Filter for Large Geophysical Models 3. Get observed value and observa.onal error distribu.on from observing system. Ocean Sciences Mee.ng 24 Feb

8 Ensemble Filter for Large Geophysical Models 4. Find the increments for the prior observa.on ensemble (this is a scalar problem for uncorrelated observa.on errors). Note: Difference between various ensemble filters is primarily in observa.on increment calcula.on. Ocean Sciences Mee.ng 24 Feb

9 Ensemble Filter for Large Geophysical Models. Use ensemble samples of y and each state variable to linearly regress observa.on increments onto state variable increments. Theory: impact of observa.on increments on each state variable can be handled independently! Ocean Sciences Mee.ng 24 Feb

10 Ensemble Filter for Large Geophysical Models 6. When all ensemble members for each state variable are updated, there is a new analysis. Integrate to.me of next observa.on Ocean Sciences Mee.ng 24 Feb. 212

11 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

12 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

13 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

14 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

15 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

16 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

17 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

18 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

19 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

20 Ensemble Filter for Lorenz Variable Model 4 state variables: X1, X2,..., X4. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. Acts something like synop.c weather around a la.tude band. time Ocean Sciences Mee.ng 24 Feb

21 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 2 truth ensemble Ocean Sciences Mee.ng 24 Feb

22 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 4 truth ensemble Ocean Sciences Mee.ng 24 Feb

23 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 6 truth ensemble Ocean Sciences Mee.ng 24 Feb

24 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 8 truth ensemble Ocean Sciences Mee.ng 24 Feb

25 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 1 truth ensemble Ocean Sciences Mee.ng 24 Feb

26 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 112 truth ensemble Ocean Sciences Mee.ng 24 Feb

27 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 114 truth ensemble Ocean Sciences Mee.ng 24 Feb

28 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 116 truth ensemble Ocean Sciences Mee.ng 24 Feb

29 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 118 truth ensemble Ocean Sciences Mee.ng 24 Feb

30 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 12 truth ensemble Ocean Sciences Mee.ng 24 Feb

31 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 122 truth ensemble Ocean Sciences Mee.ng 24 Feb

32 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 124 truth ensemble Ocean Sciences Mee.ng 24 Feb

33 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 126 truth ensemble Ocean Sciences Mee.ng 24 Feb

34 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 128 truth ensemble Ocean Sciences Mee.ng 24 Feb

35 Lorenz- 96 is sensi.ve to small perturba.ons Introduce 2 ensemble state es.mates. Each is slightly perturbed for each of the 4- variables at.me. Refer to unperturbed control integra.on as truth.. time 13 truth ensemble Ocean Sciences Mee.ng 24 Feb

36 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 21 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

37 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 23 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

38 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 2 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

39 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 27 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

40 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 29 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

41 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 211 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

42 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 213 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

43 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 21 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

44 Assimilate observa.ons from 4 random loca.ons each step. Observa.ons generated by interpola.ng truth to sta.on loca.on. Simulate observa.onal error: Add random draw from N(, 16) to each. Start from climatological 2- member ensemble. time 217 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

45 Assimilate observa.ons from 4 random loca.ons each step. This isn t working very well. Ensemble spread is reduced, but..., Ensemble is inconsistent with truth most places. time 219 truth ensemble obs Confident and wrong. Confident and right. Ocean Sciences Mee.ng 24 Feb

46 Some Error Sources in Ensemble Filters 2. Obs. operator error; Representa.veness 3. Observa.on error 4. Sampling Error; Gaussian Assump.on. Sampling Error; Assuming Linear Sta.s.cal Rela.on 1. Model error Ocean Sciences Mee.ng 24 Feb

47 Observa.ons impact unrelated state variables through sampling error. Expected Sample Correlation Members.1 2 Members 4 Members 8 Members True Correlation Plot shows expected absolute value of sample correla.on vs. true correla.on. Unrelated obs. reduce spread, increase error. Apack with localiza.on. Don t let obs. Impact unrelated state. Ocean Sciences Mee.ng 24 Feb

48 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 21 truth ensemble obs No Localization time 21 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

49 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 23 truth ensemble obs No Localization time 23 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

50 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 2 truth ensemble obs No Localization time 2 truth ensemble obs Ocean Sciences Mee.ng 24 Feb. 212

51 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 27 truth ensemble obs No Localization time 27 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

52 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 29 truth ensemble obs No Localization time 29 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

53 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 211 truth ensemble obs No Localization time 211 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

54 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 213 truth ensemble obs No Localization time 213 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

55 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 21 truth ensemble obs No Localization time 21 truth ensemble obs Ocean Sciences Mee.ng 24 Feb. 212

56 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter time 217 truth ensemble obs No Localization time 217 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

57 Lorenz- 96 Assimila.on with localiza.on of observa.on impact. Localization from Hierarchical Filter This ensemble is more consistent with truth. time 219 truth ensemble obs No Localization time 219 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

58 Localiza.on computed by empirical offline computa.on. Localization from Hierarchical Filter 1 time 219 truth ensemble obs Sample Observation Localizations Ocean Sciences Mee.ng 24 Feb

59 Some Error Sources in Ensemble Filters 2. Obs. operator error; Representa.veness 3. Observa.on error 4. Sampling Error; Gaussian Assump.on. Sampling Error; Assuming Linear Sta.s.cal Rela.on 1. Model error Ocean Sciences Mee.ng 24 Feb

60 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. Time evolu.on for first state variable shown. Assimila.ng model quickly diverges from true model. Ocean Sciences Mee.ng 24 Feb

61 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 31 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

62 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 36 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

63 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 311 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

64 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 316 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

65 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 321 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

66 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 326 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

67 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 331 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

68 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 336 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

69 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 341 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

70 Assimila.ng in the presence of simulated model error. dxi / dt = (Xi+1 - Xi- 2)Xi- 1 - Xi + F. For truth, use F = 8. In assimila.ng model, use F = 6. time 346 truth ensemble obs This isn t working again! It will just keep gesng worse. Ocean Sciences Mee.ng 24 Feb

71 Reduce confidence in model prior to deal with model error Use infla.on. Simply increase prior ensemble variance for each state variable. Adap.ve algorithms use observa.ons to guide this. Probability Prior PDF Inflated S.D. Inflate SD by 1. Variance by 1. 2 Obs Ocean Sciences Mee.ng 24 Feb

72 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 31 truth ensemble obs No Inflation time 31 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

73 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 36 truth ensemble obs No Inflation time 36 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

74 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 311 truth ensemble obs No Inflation time 311 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

75 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 316 truth ensemble obs No Inflation time 316 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

76 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 321 truth ensemble obs No Inflation time 321 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

77 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 326 truth ensemble obs No Inflation time 326 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

78 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 331 truth ensemble obs No Inflation time 331 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

79 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 336 truth ensemble obs No Inflation time 336 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

80 Assimila.ng with Infla.on in presence of model error. Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm inflation Adaptive State Space Inflation time 341 truth ensemble obs No Inflation time 341 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

81 Assimila.ng with Infla.on in presence of model error Infla.on is a func.on of state variable and.me. Automa.cally selected by adap.ve infla.on algorithm. It can work, even in presence of severe model error. inflation Adaptive State Space Inflation time 346 truth ensemble obs No Inflation time 346 truth ensemble obs Ocean Sciences Mee.ng 24 Feb

82 Uncertainty Quan.fica.on from an Ensemble Kalman Filter Ø (Ensemble) KF op.mal for linear model, gaussian likelihood, perfect model. Ø In KF, only mean and covariance have meaning. Ø Ensemble allows computa.on of many other sta.s.cs. Ø What do they mean? Not en.rely clear. Ø What do they mean when there are all sorts of error? Even less clear. Ø Must Calibrate and Validate results. Ocean Sciences Mee.ng 24 Feb

83 Obs DART Current Ocean (POP) Assimila.on DATM 3D state 2D forcing from CAM assimila.on POP Coupler 3D restart 2D forcing Ocean Sciences Mee.ng 24 Feb

84 World Ocean Database T,S observa.on counts These counts are for 1998 & 1999 and are representa.ve. FLOAT_SALINITY 682 FLOAT_TEMPERATURE 3932 DRIFTER_TEMPERATURE MOORING_SALINITY MOORING_TEMPERATURE BOTTLE_SALINITY 798 BOTTLE_TEMPERATURE CTD_SALINITY CTD_TEMPERATURE STD_SALINITY 674 STD_TEMPERATURE 677 XCTD_SALINITY 3328 XCTD_TEMPERATURE 79 MBT_TEMPERATURE 826 XBT_TEMPERATURE 9333 APB_TEMPERATURE 8111 temperature observa.on error standard devia.on ==. K. salinity observa.on error standard devia.on ==. msu. Ocean Sciences Mee.ng 24 Feb

85 Physical Space: 1998/1999 SST Anomaly from HadOI- SST Coupled Free Run POP forced by observed atmosphere (hindcast) Ensemble Assimila.on 48 POP oceans Forced by 48 CAM reanalyses Ocean Sciences Mee.ng 24 Feb

86 Challenges where ocean model is unable, or unwilling, to simulate reality. Example: cross sec.on along Kuroshio; model separates too far north. Hurrell SST 2 4 o N 4 o N 3 o N 3 o N 2 1 Regarded to be accurate. 2 o N 12 o E 132 o E 144 o E 16 o E 168 o E 18 o W POP SST 2 4 o N 4 o N 3 o N 3 o N 2 1 Free run of POP, the warm water is too far North. 2 o N 12 o E 132 o E 144 o E 16 o E 168 o E 18 o W Ocean Sciences Mee.ng 24 Feb

87 Challenges in correc.ng posi.on of Kuroshio. 6- day assimila.on star.ng from model climatology on 1 January 24. Temperature Temperature Temperature.me = days.me = 2days.me = 3days La.tude La.tude La.tude Ini.ally warm water goes too far north. Many observa.ons are rejected (red), but others (blue) move temperature gradient south. Adap.ve infla.on increases ensemble spread as assimila.on struggles to push model towards obs..me = 4days.me = days.me = 6days Ocean Sciences Mee.ng 24 Feb

88 Challenges in correc.ng posi.on of Kuroshio. 6- day assimila.on star.ng from model climatology on 1 January 24. Green dashed line is posterior at previous.me, Blue dashed line is prior at current.me, Ensembles are thin lines. Model forecasts finally fail due Observa.ons keep pulling the warm water to the south; to numerical issues. Black Model forecasts con.nue to quickly move warm water dashes show original model further.me north. = days Infla.on con.nues to.me increase = 2days spread..me = 3days state from January. Temperature Temperature Temperature.me = 4days.me = days.me = 6days La.tude La.tude La.tude Ocean Sciences Mee.ng 24 Feb

89 Challenges in correc.ng posi.on of Kuroshio. 6- day assimila.on star.ng from model climatology on 1 January 24. Assimila.on cannot force model to fit observa.ons. Use of adap.ve infla.on leads to eventual model failure. Reduced adap.ve infla.on can lead to compromise between observa.ons and model..me = days.me = 2days.me = 3days Temperature Temperature Temperature.me = 4days.me = days.me = 6days La.tude La.tude La.tude Ocean Sciences Mee.ng 24 Feb

90 Ensemble DA and UQ for Global Ocean Models Ø Very certain that model predic.ons are different from observa.ons. Ø Very certain that small correla.ons have large errors. Ø Moderately confident that large correla.ons are realis.c. Ø Very uncertain about state in sparse/unobserved regions. Ø Must Calibrate and Validate results (adap.ve infla.on/localiza.on). Ø There may not be enough observa.ons to do this many places. Ø First order of business: Improving models. DA can help with this. Ocean Sciences Mee.ng 24 Feb

91 Code to implement all of the algorithms discussed are freely available from: hpp:// Ocean Sciences Mee.ng 24 Feb

Ensemble Data Assimila.on for Climate System Component Models

Ensemble Data Assimila.on for Climate System Component Models Ensemble Data Assimila.on for Climate System Component Models Jeffrey Anderson Na.onal Center for Atmospheric Research In collabora.on with: Alicia Karspeck, Kevin Raeder, Tim Hoar, Nancy Collins IMA 11

More information

Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART

Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART Kevin Raeder, Tim Hoar, Nancy Collins, Jeffrey Anderson: DAReS Mariana Vertenstein, Tony Craig, Jim Edwards: SEWG Alicia Karspeck:

More information

DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on

DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on DART Tutorial Sec'on 9: More on Dealing with Error: Infla'on UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

DART Tutorial Part II: How should observa'ons impact an unobserved state variable? Mul'variate assimila'on.

DART Tutorial Part II: How should observa'ons impact an unobserved state variable? Mul'variate assimila'on. DART Tutorial Part II: How should observa'ons impact an unobserved state variable? Mul'variate assimila'on. UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on.

More information

Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART

Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART Multi-instance CESM for Fully Coupled Data Assimilation Capability using DART Kevin Raeder, Tim Hoar, Nancy Collins, Jeffrey Anderson: DAReS Mariana Vertenstein, Tony Craig, Jim Edwards: SEWG Jen Kay:

More information

DART Tutorial Part IV: Other Updates for an Observed Variable

DART Tutorial Part IV: Other Updates for an Observed Variable DART Tutorial Part IV: Other Updates for an Observed Variable UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

DART Tutorial Sec'on 1: Filtering For a One Variable System

DART Tutorial Sec'on 1: Filtering For a One Variable System DART Tutorial Sec'on 1: Filtering For a One Variable System UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

DART and Land Data Assimila7on

DART and Land Data Assimila7on DART and Land Data Assimila7on Tim Hoar: Na#onal Center for Atmospheric Research with a whole lot of help from: Jeff Anderson, Nancy Collins, Kevin Raeder, Bill Sacks: NCAR Yongfei Zhang: University of

More information

Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed

Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed Introduction to Ensemble Kalman Filters and the Data Assimilation Research Testbed Jeffrey Anderson, Tim Hoar, Nancy Collins NCAR Institute for Math Applied to Geophysics pg 1 What is Data Assimilation?

More information

DART Tutorial Sec'on 5: Comprehensive Filtering Theory: Non-Iden'ty Observa'ons and the Joint Phase Space

DART Tutorial Sec'on 5: Comprehensive Filtering Theory: Non-Iden'ty Observa'ons and the Joint Phase Space DART Tutorial Sec'on 5: Comprehensive Filtering Theory: Non-Iden'ty Observa'ons and the Joint Phase Space UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on.

More information

Adaptive Inflation for Ensemble Assimilation

Adaptive Inflation for Ensemble Assimilation Adaptive Inflation for Ensemble Assimilation Jeffrey Anderson IMAGe Data Assimilation Research Section (DAReS) Thanks to Ryan Torn, Nancy Collins, Tim Hoar, Hui Liu, Kevin Raeder, Xuguang Wang Anderson:

More information

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation.

DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. DART_LAB Tutorial Section 2: How should observations impact an unobserved state variable? Multivariate assimilation. UCAR 2014 The National Center for Atmospheric Research is sponsored by the National

More information

Ensemble Data Assimilation and Uncertainty Quantification

Ensemble Data Assimilation and Uncertainty Quantification Ensemble Data Assimilation and Uncertainty Quantification Jeff Anderson National Center for Atmospheric Research pg 1 What is Data Assimilation? Observations combined with a Model forecast + to produce

More information

Data AssimilaJon with CLM & DART

Data AssimilaJon with CLM & DART Data AssimilaJon with CLM & DART Tim Hoar: Na#onal Center for Atmospheric Research with a whole lot of help from: Bill Sacks, Mariana Vertenstein, Tony Craig, Jim Edwards: NCAR Andrew Fox: Na#onal Ecological

More information

Data Assimilation Research Testbed Tutorial

Data Assimilation Research Testbed Tutorial Data Assimilation Research Testbed Tutorial Section 2: How should observations of a state variable impact an unobserved state variable? Multivariate assimilation. Single observed variable, single unobserved

More information

DART Ini)al Condi)ons for a Refined Grid CAM- SE Forecast of Hurricane Katrina. Kevin Raeder (IMAGe) Colin Zarzycki (ASP)

DART Ini)al Condi)ons for a Refined Grid CAM- SE Forecast of Hurricane Katrina. Kevin Raeder (IMAGe) Colin Zarzycki (ASP) DART Ini)al Condi)ons for a Refined Grid CAM- SE Forecast of Hurricane Katrina Kevin Raeder (IMAGe) Colin Zarzycki (ASP) 1 Mo)va)on Thousands of processors on current supercomputers. - > new CAM dynamical

More information

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading

Par$cle Filters Part I: Theory. Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Par$cle Filters Part I: Theory Peter Jan van Leeuwen Data- Assimila$on Research Centre DARC University of Reading Reading July 2013 Why Data Assimila$on Predic$on Model improvement: - Parameter es$ma$on

More information

Sea Ice Data Assimilation in the Arctic via DART/CICE5 in the CESM1

Sea Ice Data Assimilation in the Arctic via DART/CICE5 in the CESM1 Sea Ice Data Assimilation in the Arctic via DART/CICE5 in the CESM1 Yongfei Zhang and Cecilia Bitz 1 Jeffrey Anderson, Nancy Collins, Jonathan Hendricks, Tim Hoar, and Kevin Raeder 2 1 University of Washington,

More information

Land Surface Data AssimilaEon: DART and CLM

Land Surface Data AssimilaEon: DART and CLM Land Surface Data AssimilaEon: DART and CLM Yongfei Zhang: University of Texas Aus2n Tim Hoar, Bill Sacks, Tony Craig, Jeff Anderson: Na2onal Center for Atmospheric Research Andrew Fox: Na2onal Ecological

More information

DART Tutorial Sec'on 19: Making DART-Compliant Models

DART Tutorial Sec'on 19: Making DART-Compliant Models DART Tutorial Sec'on 19: Making DART-Compliant Models UCAR The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science Founda'on. Any opinions, findings and conclusions or recommenda'ons

More information

Introduction to Particle Filters for Data Assimilation

Introduction to Particle Filters for Data Assimilation Introduction to Particle Filters for Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Using DART Tools for CAM Development

Using DART Tools for CAM Development Using DART Tools for CAM Development Kevin Raeder, For DART: Jeff Anderson, Tim Hoar, Nancy Collins, Johnny Hendricks CSEG: Alice Bertini, Mariana Vertenstein, Steve Goldhaber, Jim Edwards And: Nick Pedatella

More information

Scalable Compu-ng Challenges in Ensemble Data Assimila-on. FRCRC Symposium Nancy Collins NCAR - IMAGe/DAReS 14 Aug 2013

Scalable Compu-ng Challenges in Ensemble Data Assimila-on. FRCRC Symposium Nancy Collins NCAR - IMAGe/DAReS 14 Aug 2013 Scalable Compu-ng Challenges in Ensemble Data Assimila-on FRCRC Symposium Nancy Collins NCAR - IMAGe/DAReS 14 Aug 2013 Overview What is Data Assimila-on? What is DART? Current Work on Highly Scalable Systems

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 014 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO July 14-16, 014 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Fundamentals of Data Assimila1on

Fundamentals of Data Assimila1on 2015 GSI Community Tutorial NCAR Foothills Campus, Boulder, CO August 11-14, 2015 Fundamentals of Data Assimila1on Milija Zupanski Cooperative Institute for Research in the Atmosphere Colorado State University

More information

Reducing the Impact of Sampling Errors in Ensemble Filters

Reducing the Impact of Sampling Errors in Ensemble Filters Reducing the Impact of Sampling Errors in Ensemble Filters Jeffrey Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Gaussian Filtering Strategies for Nonlinear Systems

Gaussian Filtering Strategies for Nonlinear Systems Gaussian Filtering Strategies for Nonlinear Systems Canonical Nonlinear Filtering Problem ~u m+1 = ~ f (~u m )+~ m+1 ~v m+1 = ~g(~u m+1 )+~ o m+1 I ~ f and ~g are nonlinear & deterministic I Noise/Errors

More information

Least Squares Parameter Es.ma.on

Least Squares Parameter Es.ma.on Least Squares Parameter Es.ma.on Alun L. Lloyd Department of Mathema.cs Biomathema.cs Graduate Program North Carolina State University Aims of this Lecture 1. Model fifng using least squares 2. Quan.fica.on

More information

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model

CS 6140: Machine Learning Spring What We Learned Last Week. Survey 2/26/16. VS. Model Logis@cs CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa@on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Assignment

More information

CS 6140: Machine Learning Spring 2016

CS 6140: Machine Learning Spring 2016 CS 6140: Machine Learning Spring 2016 Instructor: Lu Wang College of Computer and Informa?on Science Northeastern University Webpage: www.ccs.neu.edu/home/luwang Email: luwang@ccs.neu.edu Logis?cs Assignment

More information

Status of CESM data assimilation using the DART system

Status of CESM data assimilation using the DART system Status of CESM data assimilation using the DART system Alicia R. Karspeck (aliciak@ucar.edu) DARES personnel: Nancy Collins, Jeff Anderson, John Hendricks, Kevin Raeder, Tim Hoar CISL/ASAP: Brian Dobbins

More information

DART_LAB Tutorial Section 5: Adaptive Inflation

DART_LAB Tutorial Section 5: Adaptive Inflation DART_LAB Tutorial Section 5: Adaptive Inflation UCAR 14 The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings and conclusions or recommendations

More information

Fundamentals of Data Assimilation

Fundamentals of Data Assimilation National Center for Atmospheric Research, Boulder, CO USA GSI Data Assimilation Tutorial - June 28-30, 2010 Acknowledgments and References WRFDA Overview (WRF Tutorial Lectures, H. Huang and D. Barker)

More information

Model error and parameter estimation

Model error and parameter estimation Model error and parameter estimation Chiara Piccolo and Mike Cullen ECMWF Annual Seminar, 11 September 2018 Summary The application of interest is atmospheric data assimilation focus on EDA; A good ensemble

More information

Ensemble forecasting and flow-dependent estimates of initial uncertainty. Martin Leutbecher

Ensemble forecasting and flow-dependent estimates of initial uncertainty. Martin Leutbecher Ensemble forecasting and flow-dependent estimates of initial uncertainty Martin Leutbecher acknowledgements: Roberto Buizza, Lars Isaksen Flow-dependent aspects of data assimilation, ECMWF 11 13 June 2007

More information

GeMng to know the Data Assimila'on Research Testbed - DART. Tim Hoar, Data Assimilation Research Section, NCAR

GeMng to know the Data Assimila'on Research Testbed - DART. Tim Hoar, Data Assimilation Research Section, NCAR GeMng to know the Data Assimila'on Research Testbed - DART. Tim Hoar, Data Assimilation Research Section, NCAR UCAR 2014 The Na'onal Center for Atmospheric Research is sponsored by the Na'onal Science

More information

Accepted in Tellus A 2 October, *Correspondence

Accepted in Tellus A 2 October, *Correspondence 1 An Adaptive Covariance Inflation Error Correction Algorithm for Ensemble Filters Jeffrey L. Anderson * NCAR Data Assimilation Research Section P.O. Box 3000 Boulder, CO 80307-3000 USA Accepted in Tellus

More information

CSE 473: Ar+ficial Intelligence. Probability Recap. Markov Models - II. Condi+onal probability. Product rule. Chain rule.

CSE 473: Ar+ficial Intelligence. Probability Recap. Markov Models - II. Condi+onal probability. Product rule. Chain rule. CSE 473: Ar+ficial Intelligence Markov Models - II Daniel S. Weld - - - University of Washington [Most slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All CS188

More information

GEOG 401 Climate Change

GEOG 401 Climate Change GEOG 401 Climate Change Climate Downscaling GCMs have coarse resolu/on Spa

More information

Localization and Correlation in Ensemble Kalman Filters

Localization and Correlation in Ensemble Kalman Filters Localization and Correlation in Ensemble Kalman Filters Jeff Anderson NCAR Data Assimilation Research Section The National Center for Atmospheric Research is sponsored by the National Science Foundation.

More information

Decadal Hindcasts and Forecasts at GFDL

Decadal Hindcasts and Forecasts at GFDL Decadal Hindcasts and Forecasts at GFDL Tony Rosati T. Delworth, R. Gudgel, F. Zang, S. Zhang Key Ques;ons What seasonal decadal predictability exists in the climate system, and what are the mechanisms

More information

Data Assimilation Research Testbed Tutorial

Data Assimilation Research Testbed Tutorial Data Assimilation Research Testbed Tutorial Section 3: Hierarchical Group Filters and Localization Version 2.: September, 26 Anderson: Ensemble Tutorial 9//6 Ways to deal with regression sampling error:

More information

Review of Covariance Localization in Ensemble Filters

Review of Covariance Localization in Ensemble Filters NOAA Earth System Research Laboratory Review of Covariance Localization in Ensemble Filters Tom Hamill NOAA Earth System Research Lab, Boulder, CO tom.hamill@noaa.gov Canonical ensemble Kalman filter update

More information

The consistency between measured radiance and retrieved profiles at climate scales a study in uncertainty propaga9on

The consistency between measured radiance and retrieved profiles at climate scales a study in uncertainty propaga9on The consistency between measured radiance and retrieved profiles at climate scales a study in uncertainty propaga9on Nadia Smith, Dave Tobin, Bob Knuteson, Bill Smith Sr., Elisabeth Weisz and Hank Revercomb

More information

Initial Results of Altimetry Assimilation in POP2 Ocean Model

Initial Results of Altimetry Assimilation in POP2 Ocean Model Initial Results of Altimetry Assimilation in POP2 Ocean Model Svetlana Karol and Alicia R. Karspeck With thanks to the DART Group, CESM Software Development Group, Climate Modeling Development Group POP-DART

More information

Development of the NCAR 4D-REKF System and Comparison with RTFDDA, DART-EaKF and WRFVAR

Development of the NCAR 4D-REKF System and Comparison with RTFDDA, DART-EaKF and WRFVAR Development of the NCAR 4D-REKF System and Comparison with RTFDDA, DART-EaKF and WRFVAR Yubao Liu, Yonghui Wu, Linlin Pan, Al Bourgeois Thanks: Jason Knievel, Scott Swerdlin, Xin Zhang, and Xiang-Yu Huang

More information

ICOS-D inverse modelling using the CarboScope regional inversion system

ICOS-D inverse modelling using the CarboScope regional inversion system ICOS-D inverse modelling using the CarboScope regional inversion system Christoph Gerbig, Panagiotis Kountouris, Christian Rödenbeck (MPI-BGC, Jena), Thomas Koch (DWD), Ute Karstens (ICOS-CP, Lund) ICOS-D

More information

Nonlinear ensemble data assimila/on in high- dimensional spaces. Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades

Nonlinear ensemble data assimila/on in high- dimensional spaces. Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades Nonlinear ensemble data assimila/on in high- dimensional spaces Peter Jan van Leeuwen Javier Amezcua, Mengbin Zhu, Melanie Ades Data assimila/on: general formula/on Bayes theorem: The solu/on is a pdf!

More information

Juli I. Rubin. NRC Postdoctoral Research Associate Naval Research Laboratory, Monterey, CA

Juli I. Rubin. NRC Postdoctoral Research Associate Naval Research Laboratory, Monterey, CA Development of the Ensemble Navy Aerosol Analysis Prediction System and its application of the Data Assimilation Research Testbed in Support of Aerosol Forecasting Juli I. Rubin NRC Postdoctoral Research

More information

Mul$- model ensemble challenge ini$al/model uncertain$es

Mul$- model ensemble challenge ini$al/model uncertain$es Mul$- model ensemble challenge ini$al/model uncertain$es Yuejian Zhu Ensemble team leader Environmental Modeling Center NCEP/NWS/NOAA Acknowledgments: EMC ensemble team staffs Presenta$on for WMO/WWRP

More information

Ensemble Kalman Filter potential

Ensemble Kalman Filter potential Ensemble Kalman Filter potential Former students (Shu-Chih( Yang, Takemasa Miyoshi, Hong Li, Junjie Liu, Chris Danforth, Ji-Sun Kang, Matt Hoffman), and Eugenia Kalnay University of Maryland Acknowledgements:

More information

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation

An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation An Efficient Ensemble Data Assimilation Approach To Deal With Range Limited Observation A. Shah 1,2, M. E. Gharamti 1, L. Bertino 1 1 Nansen Environmental and Remote Sensing Center 2 University of Bergen

More information

A Non-Gaussian Ensemble Filter Update for Data Assimilation

A Non-Gaussian Ensemble Filter Update for Data Assimilation 4186 M O N T H L Y W E A T H E R R E V I E W VOLUME 138 A Non-Gaussian Ensemble Filter Update for Data Assimilation JEFFREY L. ANDERSON NCAR Data Assimilation Research Section,* Boulder, Colorado (Manuscript

More information

Ensemble of Climate Models

Ensemble of Climate Models Ensemble of Climate Models Claudia Tebaldi Climate Central and Department of Sta7s7cs, UBC Reto Knu>, Reinhard Furrer, Richard Smith, Bruno Sanso Outline Mul7 model ensembles (MMEs) a descrip7on at face

More information

WWRP working group meeting. on Predictability, Dynamics & Ensemble Forecasting

WWRP working group meeting. on Predictability, Dynamics & Ensemble Forecasting WWRP working group meeting on Predictability, Dynamics & Ensemble Forecasting Outline Introduce stochas.c parameteriza.on agenda Include some of your recent research How can the PDEF working group help

More information

Miscellaneous Thoughts on Ocean Data Assimilation

Miscellaneous Thoughts on Ocean Data Assimilation Miscellaneous Thoughts on Ocean Data Assimilation Mike Dowd Dept of Mathematics & Statistics (and Dept of Oceanography) Dalhousie University, Halifax, Canada STATMOS Summer School in Data Assimila5on,

More information

Ocean data assimilation for reanalysis

Ocean data assimilation for reanalysis Ocean data assimilation for reanalysis Matt Martin. ERA-CLIM2 Symposium, University of Bern, 14 th December 2017. Contents Introduction. On-going developments to improve ocean data assimilation for reanalysis.

More information

Growth of forecast uncertainties in global prediction systems and IG wave dynamics

Growth of forecast uncertainties in global prediction systems and IG wave dynamics Growth of forecast uncertainties in global prediction systems and IG wave dynamics Nedjeljka Žagar and Žiga Zaplotnik Department of physics, Faculty of mathematics and physics, University of Ljubljana,

More information

Developments to the assimilation of sea surface temperature

Developments to the assimilation of sea surface temperature Developments to the assimilation of sea surface temperature James While, Daniel Lea, Matthew Martin ERA-CLIM2 General Assembly, January 2017 Contents Introduction Improvements to SST bias correction Development

More information

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter

A data-driven method for improving the correlation estimation in serial ensemble Kalman filter A data-driven method for improving the correlation estimation in serial ensemble Kalman filter Michèle De La Chevrotière, 1 John Harlim 2 1 Department of Mathematics, Penn State University, 2 Department

More information

The Norwegian Climate Predic4on Model (NorCPM)

The Norwegian Climate Predic4on Model (NorCPM) WGSIP mee4ng - Modelling Centers: Norway The Norwegian Climate Predic4on Model (NorCPM) Noel Keenlyside, Francois Counillon, Ingo Bethke, Yiguo Wang, Mao-Lin Shen, Madlen Kimmritz, Marius Årthun, Tor Eldevik,

More information

A Physically Based Data QC Procedure and Its Impact on the Assimila9on of GPS RO Observa9ons in the Tropical Lower Troposphere

A Physically Based Data QC Procedure and Its Impact on the Assimila9on of GPS RO Observa9ons in the Tropical Lower Troposphere A Physically Based Data QC Procedure and Its Impact on the Assimila9on of GPS RO Observa9ons in the Tropical Lower Troposphere Y.- H. Kuo, H. Liu, S. Sokolovskiy, Z. Zeng University Corpora/on for Atmospheric

More information

Linear Regression and Correla/on. Correla/on and Regression Analysis. Three Ques/ons 9/14/14. Chapter 13. Dr. Richard Jerz

Linear Regression and Correla/on. Correla/on and Regression Analysis. Three Ques/ons 9/14/14. Chapter 13. Dr. Richard Jerz Linear Regression and Correla/on Chapter 13 Dr. Richard Jerz 1 Correla/on and Regression Analysis Correla/on Analysis is the study of the rela/onship between variables. It is also defined as group of techniques

More information

Linear Regression and Correla/on

Linear Regression and Correla/on Linear Regression and Correla/on Chapter 13 Dr. Richard Jerz 1 Correla/on and Regression Analysis Correla/on Analysis is the study of the rela/onship between variables. It is also defined as group of techniques

More information

Associa'on of U.S. tornado counts with the large- scale environment on monthly 'me- scales

Associa'on of U.S. tornado counts with the large- scale environment on monthly 'me- scales Associa'on of U.S. tornado counts with the large- scale environment on monthly 'me- scales Michael K. Tippe? 1, Adam H. Sobel 2,3 and Suzana J. Camargo 3 1 Interna)onal Research Ins)tute for Climate and

More information

Ensemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system. for the GFS

Ensemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system. for the GFS Ensemble 4DVAR and observa3on impact study with the GSIbased hybrid ensemble varia3onal data assimila3on system for the GFS Xuguang Wang University of Oklahoma, Norman, OK xuguang.wang@ou.edu Ting Lei,

More information

Quan&fying Uncertainty. Sai Ravela Massachuse7s Ins&tute of Technology

Quan&fying Uncertainty. Sai Ravela Massachuse7s Ins&tute of Technology Quan&fying Uncertainty Sai Ravela Massachuse7s Ins&tute of Technology 1 the many sources of uncertainty! 2 Two days ago 3 Quan&fying Indefinite Delay 4 Finally 5 Quan&fying Indefinite Delay P(X=delay M=

More information

Some Review and Hypothesis Tes4ng. Friday, March 15, 13

Some Review and Hypothesis Tes4ng. Friday, March 15, 13 Some Review and Hypothesis Tes4ng Outline Discussing the homework ques4ons from Joey and Phoebe Review of Sta4s4cal Inference Proper4es of OLS under the normality assump4on Confidence Intervals, T test,

More information

Data assimilation in high dimensions

Data assimilation in high dimensions Data assimilation in high dimensions David Kelly Kody Law Andy Majda Andrew Stuart Xin Tong Courant Institute New York University New York NY www.dtbkelly.com February 3, 2016 DPMMS, University of Cambridge

More information

Relative Merits of 4D-Var and Ensemble Kalman Filter

Relative Merits of 4D-Var and Ensemble Kalman Filter Relative Merits of 4D-Var and Ensemble Kalman Filter Andrew Lorenc Met Office, Exeter International summer school on Atmospheric and Oceanic Sciences (ISSAOS) "Atmospheric Data Assimilation". August 29

More information

Attributing climate variations: Part of an information system for the future. Kevin E Trenberth NCAR

Attributing climate variations: Part of an information system for the future. Kevin E Trenberth NCAR Attributing climate variations: Part of an information system for the future Kevin E Trenberth NCAR The climate is changing: It is likely to continue to change! Regardless of the success of mitigation

More information

The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics

The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich. Main topics The Local Ensemble Transform Kalman Filter (LETKF) Eric Kostelich Arizona State University Co-workers: Istvan Szunyogh, Brian Hunt, Ed Ott, Eugenia Kalnay, Jim Yorke, and many others http://www.weatherchaos.umd.edu

More information

Some ideas for Ensemble Kalman Filter

Some ideas for Ensemble Kalman Filter Some ideas for Ensemble Kalman Filter Former students and Eugenia Kalnay UMCP Acknowledgements: UMD Chaos-Weather Group: Brian Hunt, Istvan Szunyogh, Ed Ott and Jim Yorke, Kayo Ide, and students Former

More information

Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006

Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems. Eric Kostelich Data Mining Seminar, Feb. 6, 2006 Data Assimilation: Finding the Initial Conditions in Large Dynamical Systems Eric Kostelich Data Mining Seminar, Feb. 6, 2006 kostelich@asu.edu Co-Workers Istvan Szunyogh, Gyorgyi Gyarmati, Ed Ott, Brian

More information

Bias in Arc*c Ocean SST Retrieval from Metop- A AVHRR. C J Merchant University of Reading

Bias in Arc*c Ocean SST Retrieval from Metop- A AVHRR. C J Merchant University of Reading Bias in Arc*c Ocean SST Retrieval from Metop- A AVHRR C J Merchant University of Reading Introduc*on Percep*on that SST retrieval biases are poor in Arc*c Retrieval informed by simula*ons helps reduce

More information

WP2 task 2.2 SST assimilation

WP2 task 2.2 SST assimilation WP2 task 2.2 SST assimilation Matt Martin, Dan Lea, James While, Rob King ERA-CLIM2 General Assembly, Dec 2015. Contents Impact of SST assimilation in coupled DA SST bias correction developments Assimilation

More information

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter

Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Convective-scale data assimilation in the Weather Research and Forecasting model using a nonlinear ensemble filter Jon Poterjoy, Ryan Sobash, and Jeffrey Anderson National Center for Atmospheric Research

More information

The CMCC contribution to! ERA-CLIM2!

The CMCC contribution to! ERA-CLIM2! The CMCC contribution to! ERA-CLIM2!! Experiments with coupled covariances and! other activities! Andrea Storto! Ocean Modeling and Data Assimilation Division,! Euro-Mediterranean Center on Climate Change

More information

CSE 473: Ar+ficial Intelligence. Example. Par+cle Filters for HMMs. An HMM is defined by: Ini+al distribu+on: Transi+ons: Emissions:

CSE 473: Ar+ficial Intelligence. Example. Par+cle Filters for HMMs. An HMM is defined by: Ini+al distribu+on: Transi+ons: Emissions: CSE 473: Ar+ficial Intelligence Par+cle Filters for HMMs Daniel S. Weld - - - University of Washington [Most slides were created by Dan Klein and Pieter Abbeel for CS188 Intro to AI at UC Berkeley. All

More information

Consider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y.

Consider the joint probability, P(x,y), shown as the contours in the figure above. P(x) is given by the integral of P(x,y) over all values of y. ATMO/OPTI 656b Spring 009 Bayesian Retrievals Note: This follows the discussion in Chapter of Rogers (000) As we have seen, the problem with the nadir viewing emission measurements is they do not contain

More information

Numerical Weather Prediction: Data assimilation. Steven Cavallo

Numerical Weather Prediction: Data assimilation. Steven Cavallo Numerical Weather Prediction: Data assimilation Steven Cavallo Data assimilation (DA) is the process estimating the true state of a system given observations of the system and a background estimate. Observations

More information

Interpre'ng Model Results

Interpre'ng Model Results Interpre'ng Model Results Clara Deser Na'onal Center for Atmospheric Research Boulder, CO CESM Tutorial, 12 August 2016 Interpre'ng Model Results 1) What kind of model? 2) What kind of simula'on? 3) What

More information

The Canadian approach to ensemble prediction

The Canadian approach to ensemble prediction The Canadian approach to ensemble prediction ECMWF 2017 Annual seminar: Ensemble prediction : past, present and future. Pieter Houtekamer Montreal, Canada Overview. The Canadian approach. What are the

More information

Severe thunderstorms and climate change HAROLD BROOKS NOAA/NSSL

Severe thunderstorms and climate change HAROLD BROOKS NOAA/NSSL Severe thunderstorms and climate change HAROLD BROOKS NOAA/NSSL HAROLD.BROOKS@NOAA.GOV Big ques5ons! Have severe thunderstorms/tornadoes changed?! How and why do we expect severe thunderstorms to change

More information

KNMI Climate Explorer A tool for climate analysis [ and seasonal prediction]

KNMI Climate Explorer A tool for climate analysis [ and seasonal prediction] KNMI Climate Explorer A tool for climate analysis [ and seasonal prediction] MedCOF Training Workshop Madrid, 26-30 October 2015 Jonathan Eden Royal Netherlands Meteorological Institute (KNMI) An introduc+on

More information

Ergodicity in data assimilation methods

Ergodicity in data assimilation methods Ergodicity in data assimilation methods David Kelly Andy Majda Xin Tong Courant Institute New York University New York NY www.dtbkelly.com April 15, 2016 ETH Zurich David Kelly (CIMS) Data assimilation

More information

Multiple-scale error growth and data assimilation in convection-resolving models

Multiple-scale error growth and data assimilation in convection-resolving models Numerical Modelling, Predictability and Data Assimilation in Weather, Ocean and Climate A Symposium honouring the legacy of Anna Trevisan Bologna, Italy 17-20 October, 2017 Multiple-scale error growth

More information

Multiple timescale coupled atmosphere-ocean data assimilation

Multiple timescale coupled atmosphere-ocean data assimilation Multiple timescale coupled atmosphere-ocean data assimilation (for climate prediction & reanalysis) Robert Tardif Gregory J. Hakim H L H University of Washington w/ contributions from: Chris Snyder NCAR

More information

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP

Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Norwegian Climate Prediction Model (NorCPM) getting ready for CMIP6 DCPP Francois Counillon, Noel Keenlyside, Mats Bentsen, Ingo Bethke, Laurent Bertino, Teferi Demissie, Tor Eldevik, Shunya Koseki, Camille

More information

Forecasting and data assimilation

Forecasting and data assimilation Supported by the National Science Foundation DMS Forecasting and data assimilation Outline Numerical models Kalman Filter Ensembles Douglas Nychka, Thomas Bengtsson, Chris Snyder Geophysical Statistics

More information

State and Parameter Estimation in Stochastic Dynamical Models

State and Parameter Estimation in Stochastic Dynamical Models State and Parameter Estimation in Stochastic Dynamical Models Timothy DelSole George Mason University, Fairfax, Va and Center for Ocean-Land-Atmosphere Studies, Calverton, MD June 21, 2011 1 1 collaboration

More information

Jordan G. Powers Priscilla A. Mooney Kevin W. Manning

Jordan G. Powers Priscilla A. Mooney Kevin W. Manning Jordan G. Powers Priscilla A. Mooney Kevin W. Manning Mesoscale and Microscale Meteorology Laboratory Na

More information

(Extended) Kalman Filter

(Extended) Kalman Filter (Extended) Kalman Filter Brian Hunt 7 June 2013 Goals of Data Assimilation (DA) Estimate the state of a system based on both current and all past observations of the system, using a model for the system

More information

Coupled Ocean-Atmosphere Assimilation

Coupled Ocean-Atmosphere Assimilation Coupled Ocean-Atmosphere Assimilation Shu-Chih Yang 1, Eugenia Kalnay 2, Joaquim Ballabrera 3, Malaquias Peña 4 1:Department of Atmospheric Sciences, National Central University 2: Department of Atmospheric

More information

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data

Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data Local Ensemble Transform Kalman Filter: An Efficient Scheme for Assimilating Atmospheric Data John Harlim and Brian R. Hunt Department of Mathematics and Institute for Physical Science and Technology University

More information

Data assimilation with and without a model

Data assimilation with and without a model Data assimilation with and without a model Tim Sauer George Mason University Parameter estimation and UQ U. Pittsburgh Mar. 5, 2017 Partially supported by NSF Most of this work is due to: Tyrus Berry,

More information

DART Tutorial Section 18: Lost in Phase Space: The Challenge of Not Knowing the Truth.

DART Tutorial Section 18: Lost in Phase Space: The Challenge of Not Knowing the Truth. DART Tutorial Section 18: Lost in Phase Space: The Challenge of Not Knowing the Truth. UCAR The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings

More information

Comparison of of Assimilation Schemes for HYCOM

Comparison of of Assimilation Schemes for HYCOM Comparison of of Assimilation Schemes for HYCOM Ashwanth Srinivasan, C. Thacker, Z. Garraffo, E. P. Chassignet, O. M. Smedstad, J. Cummings, F. Counillon, L. Bertino, T. M. Chin, P. Brasseur and C. Lozano

More information

Data assimilation for the coupled ocean-atmosphere

Data assimilation for the coupled ocean-atmosphere GODAE Ocean View/WGNE Workshop 2013 19 March 2013 Data assimilation for the coupled ocean-atmosphere Eugenia Kalnay, Tamara Singleton, Steve Penny, Takemasa Miyoshi, Jim Carton Thanks to the UMD Weather-Chaos

More information

Adaptive ensemble Kalman filtering of nonlinear systems

Adaptive ensemble Kalman filtering of nonlinear systems Adaptive ensemble Kalman filtering of nonlinear systems Tyrus Berry George Mason University June 12, 213 : Problem Setup We consider a system of the form: x k+1 = f (x k ) + ω k+1 ω N (, Q) y k+1 = h(x

More information