Reanalysis a systematic approach to produce data sets for climate monitoring and research. Reanalyses are created via an unchanging ("frozen") data assimilation scheme and model(s) which ingest all available observations every 6-12 hours over the period being analyzed. This unchanging framework provides a dynamically consistent estimate of the climate state at each time step. The one component of this framework which does vary are the sources of the raw input data. This is unavoidable due to the ever changing observational network which includes, but is not limited to, radiosonde, satellite, buoy, aircraft and ship reports. Currently, approximately 7-9 million observations are ingested at each time step. Over the duration of each reanalysis product, the changing observation mix can produce artificial variability and spurious trends. Still, the various reanalysis products have proven to be quite useful when used with appropriate care.
Key Strengths:
- Global data sets, consistent spatial and temporal resolution over 3 or more decades, hundreds of variables available; model resolution and biases have steadily improved
- Reanalyses incorporate millions of observations into a stable data assimilation system that would be nearly impossible for an individual to collect and analyze separately, enabling a number of climate processes to be studied
- Reanalysis data sets are relatively straightforward to handle from a processing standpoint (although file sizes can be very large)
Key Limitations:
- Observational constraints, and therefore reanalysis reliability, can considerably vary depending on the location, time period, and variable considered
- The changing mix of observations, and biases in observations and models, can introduce spurious variability and trends into reanalysis output
- Diagnostic variables relating to the hydrological cycle, such as precipitation and evaporation, should be used with extreme caution
Expert User Guidance
The following was contributed by John Fasullo, NCAR, NOV, 2011:
#The use of 'n-th generation reanalysis' to classify different reanalyses [which you will see on the pages linked to in the table below] is based on the incremental advancement of reanalysis techniques. While uniform distinctions between groups of reanalyses are somewhat artificial, the introduction of major advancements in the reanalysis methodologies over time and the opportunity to learn from earlier reanalysis efforts are clear. In this context, our description of reanalysis efforts as 1st-generation (such as the initial reanalysis efforts of NCEP-NCAR and NCEP-DOE) and 2nd-generation (ERA40,JRA25) correspond, in part, to their evolving abilities to assimilate the full suite of available satellite radiances. For example, the NCEP-NCAR and NCEP-DOE reanalyses do not assimilate satellite water vapor channels over ocean while follow-on efforts do. The 3rd-generation efforts, such as ERAI, MERRA, CFSR, used more sophisticted data assimilation approaches (e.g. analysis increments and 4D-Var) and models and, again, addressed issues discovered in the 2nd-generation reanalysis efforts. Nonetheless, the artificial nature of these distinctions is evident in CFSR, which in many ways can be viewed as a 1st generation effort as it is the first reanalysis to include an interactive ocean in its reanalysis forecasts. Other reanalyses, such as the 20th Century reanalysis, further defy this simple classification as in attempting to extend its record back in time to the late 19th century, it intentionally excludes much of the modern observational record.##
The following was contributed by Dennis Shea, NCAR, NOV, 2011:
#Generally, users are advised to use third generation reanalysis products (ERA-Interim, MERRA, CFSR). To illustrate "use with appropriate care", the included figure of evaporation minus precipitation (Trenberth et al., 2011 J Clim v24 p4907), shows agreement over much of the globe. However, over Africa the derived estimates are of different sign!
Intercomparisons between similar generation reanalysis products may yield estimates of the uncertainty of some variables and derived quantities. Additionally, reanalyses can serve as focal point for model intercomparisons.##
The following was contributed by Dick Dee, ECMWF, March, 2012 (full contribution on the ERA-Interim page):
# Reanalysis data sets in general
Key strengths:
- The data are multivariate, spatially and temporally complete, and gridded
- The data combine information from many sources (observations and models)
- The data set is physically and dynamically coherent, according to the models used
Key weaknesses:
- Changes in the observing system can cause changes in mean errors
- Mixing observations with models tends to violate conservation properties
- Uncertainties in the reanalysis data are difficult to understand and quantify
...
Reanalysis data are often used to represent the "true state of the atmosphere according to observations." In actual fact, reanalysis combines inaccurate and incomplete observations with imperfect models, using methods and procedures that are technically and scientifically complex. Limitations and caveats of reanalysis data mainly result from:
- Lack of observations. The atmosphere is not now, nor ever has been, fully observed.
- Errors in the observations, and lack of information about those errors.
- Shortcomings in the assimilating model, and lack of information about model errors.
- Shortcomings in data assimilation methodology.
- Technical errors and mistakes.
- Computational limitations (e.g. limitations in spatial and temporal resolution)
Several of these items have to do with a lack of information. They represent fundamental limitations that are not restricted to reanalysis but play a role in any observational data set. (Note: replacing a skillfull forecast model by straightforward spatial interpolation does not solve anything - it is tantamount to removing, not adding, information).
To assess uncertainties in specific variables produced by reanalysis requires answering the following questions:
- How strongly is the variable constrained by observations? Is it directly or indirectly observed?
- What is the spatial and temporal distribution of the observations? How does this change in time?
- How accurately can the model represent the variable? Does the model have skill in extrapolating and/or predicting it?
Users interested in the quality of low-frequency variability and/or trend estimates need to consider these aspects throughout the time period in question. Temporal variation in the observational constraint can produce artificial shifts in the reanalysis time series, especially if the assimilating model has systematic errors. See Section 8 in Dee and Uppala (2008) for a stratospheric example of this problem.
Given the continuous changes in the observing system, and the fact that all models have some systematic errors, users should be cautious when using reanalysis data for climate studies. It is necessary (but not always possible) to verify trend estimates by comparing with independent data sets, e.g. as in Simmons et al (2010).
Most users do not have access to the information needed to answer the difficult questions listed above. On the other hand, producers of reanalysis data do not have the resources (nor the application-specific knowledge) to answer them either. The challenge is to provide better tools and information to support users in making their own uncertainty assessments. In particular, it should be made much easier for a user to get detailed information about the observations used in reanalysis, including the quality assessment and bias adjustments produced by the reanalysis process itself.##
Technical Notes
Summary information on atmospheric reanalyses is provided in the Table below. The names of each reanlaysis are linked to individual pages in Climate Data Guide that have further details, discussions of the strengths and limitations of the reanalysis, and links to download locations and other internet resources.
Usage Restrictions
- Dee, D.P. et al (2014): Toward a Consistent Reanalysis of the Climate System. Bull. Amer. Meteor. Soc., 95(8), 1235-1248
- Trenberth, K. E., T. Koike, and K. Onogi, 2008: Progress and prospects in reanalysis. Eos, 89, 26, 24 June 2008, 234-235.
- Bosilovich, Michael G., Junye Chen, Franklin R. Robertson, Robert F. Adler, 2008: Evaluation of Global Precipitation in Reanalyses. J. Appl. Meteor. Climatol., 47, 2279–2299. doi: 10.1175/2008JAMC1921.1
- Trenberth, K. E., J. T. Fasullo, and J. Mackaro, 2011: Atmospheric moisture transports from ocean to land and global energy flows in reanalyses. J. Climate, 24, 4907-4924, doi: 10.1175/2011JCLI4171.1
- Brunke, M.A., et al (2011): An Assessment of the Uncertainties in Ocean Surface Turbulent Fluxes in 11 Reanalysis, Satellite-Derived, and Combined Global Datasets
- Fasullo, J.A. (2012): A Mechanism for Land-Ocean Contrasts in Global Monsoon Trends in a Warming Climate, PAGES Special Issue on Global Monsoons, Climate Dynamics, doi:10.1007/s00382-011-1270-3
- van den Hurk, B (2012): Reanalyses and their Applicability for Climate Research. GEWEX NEWS: 22, No. 1 (pdf link)
- Bosilovich, M. (2012): After Two Decades of Retrospective-Analysis: What Next? GEWEX NEWS: 22, No. 1
- Nunes, A. (2012): Regional Reanalysis for Climate Research Applications: South American Hydroclimate Reconstruction. GEWEX NEWS: 22, No. 1
- Trenberth, K., J. Fasullo (2012): Atmospheric moisture Transports from Ocean to Land in Reanalyses. GEWEX NEWS: 22, No. 1
- Serreze, M. C., A. P. Barrett, and J. Stroeve (2012), Recent changes in tropospheric water vapor over the Arctic as assessed from radiosondes and atmospheric reanalyses, J. Geophys. Res., 117, D10104
- Vose, R. S., S. Applequist, M. J. Menne, C. N. Williams Jr., and P. Thorne (2012), An intercomparison of temperature trends in the U.S. Historical Climatology Network and recent atmospheric reanalyses, Geophys. Res. Lett., 39, L10703, doi:10.1029/2012GL05
- Decker, M. et al (2012): Evaluation of the Reanalysis Products from GSFC, NCEP, and ECMWF Using Flux Tower Observations. J. Climate, 25, 1916-1944
- Kumar et al (2013): Sea Surface Temperature–Precipitation Relationship in Different Reanalyses, Mon. Wea. Rev. 141: 1118-1123
- Chen, G et al (2104): Evaluation of the Warm-Season Diurnal Variability over East Asia in Recent Reanalyses JRA-55, ERA-Interim, NCEP CFSR, and NASA MERRA. J. Climate, 27(14), 5517-5537
- Lindsay, R. et al (2014): Evaluation of Seven Different Atmospheric Reanalysis Products in the Arctic. J. Climate, 27(7), 2588-2606
- Siam, M.S. et al (2014): Hydrological Cycles over the Congo and Upper Blue Nile Basins: Evaluation of General Circulation Model Simulations and Reanalysis Products. J. Climate, 26, 8881–8894.
- Parker, W.S. (2016): Reanalyses and Observations: What's the Difference? Bul. American Met. Soc., 1565-1572.
2 Comments
Atmospheric Reanalysis: Overview & Comparison Tables
Before posting your own comment, you may wish to review the comments policy, and consider the fact that your real name and primary affiliation will appear with your comment. All submitted comments are subject to approval; they will not immediately appear. If you cannot see the form to add a new comment, you must login.1
January 31, 2014 - 3:27amDr. Vivek Kumar Pandey of University of Allahabad says:
Include the following article as comments on NCEP/GODAS in the Indian Ocean.
http://www.tandfonline.com/doi/abs/10.1080/01490419.2013.859642
Vivek Kumar Pandeya & Prajvala Kishoreb
2
July 29, 2014 - 9:26pmPRASANTH MEIYAPPAN Meiyappan of University of Illinois at Urbana-Champaign says:
Are there articles that compare some of the reanalysis products (over land) and provides insights on why and where these reanalysis products differ among each other. I went through the litreature and found some detailed intercomparison projects are currently underway, although still no papers have been published (e.g. SPARC). At this point, any article that atleast touches on some of the reasons for differences would be helpful for me to handle these datasets correctly.
Thanks,
Prasanth