This archived Paleoclimatology Study is available from the NOAA National Centers for Environmental Information (NCEI), under the World Data Service (WDS) for Paleoclimatology. The associated NCEI study type is Other Collections. The data include parameters of database with a geographic location of . The time period coverage is from Unavailable begin date to Unavailable end date in calendar years before present (BP). See metadata information for parameter and study location details. Please cite this study when using the data.

Global Surface Summary of the Day is derived from The Integrated Surface Hourly (ISH) dataset. The ISH dataset includes global data obtained from the USAF Climatology Center, located in the Federal Climate Complex with NCDC. The latest daily summary data are normally available 1-2 days after the date-time of the observations used in the daily summaries. The online data files begin with 1929 and are at the time of this writing at the Version 8 software level. Over 9000 stations' data are typically available. The daily elements included in the dataset (as available from each station) are: Mean temperature (.1 Fahrenheit) Mean dew point (.1 Fahrenheit) Mean sea level pressure (.1 mb) Mean station pressure (.1 mb) Mean visibility (.1 miles) Mean wind speed (.1 knots) Maximum sustained wind speed (.1 knots) Maximum wind gust (.1 knots) Maximum temperature (.1 Fahrenheit) Minimum temperature (.1 Fahrenheit) Precipitation amount (.01 inches) Snow depth (.1 inches) Indicator for occurrence of: Fog, Rain or Drizzle, Snow or Ice Pellets, Hail, Thunder, Tornado/Funnel Cloud Global summary of day data for 18 surface meteorological elements are derived from the synoptic/hourly observations contained in USAF DATSAV3 Surface data and Federal Climate Complex Integrated Surface Hourly (ISH). Historical data are generally available for 1929 to the present, with data from 1973 to the present being the most complete. For some periods, one or more countries' data may not be available due to data restrictions or communications problems. In deriving the summary of day data, a minimum of 4 observations for the day must be present (allows for stations which report 4 synoptic observations/day). Since the data are converted to constant units (e.g, knots), slight rounding error from the originally reported values may occur (e.g, 9.9 instead of 10.0). The mean daily values described below are based on the hours of operation for the station. For some stations/countries, the visibility will sometimes 'cluster' around a value (such as 10 miles) due to the practice of not reporting visibilities greater than certain distances. The daily extremes and totals--maximum wind gust, precipitation amount, and snow depth--will only appear if the station reports the data sufficiently to provide a valid value. Therefore, these three elements will appear less frequently than other values. Also, these elements are derived from the stations' reports during the day, and may comprise a 24-hour period which includes a portion of the previous day. The data are reported and summarized based on Greenwich Mean Time (GMT, 0000Z - 2359Z) since the original synoptic/hourly data are reported and based on GMT.

Climate Data Online is a collection of climatic data that offers public access and consumption via discovery and ordering services. The data available through CDO is available at no charge and can be viewed online or ordered and delivered to your email inbox.

NOAA's Climate Data Records (CDRs) are robust, sustainable, and scientifically sound climate records that provide trustworthy information on how, where, and to what extent the land, oceans, atmosphere and ice sheets are changing. These datasets are thoroughly vetted time series measurements with the longevity, consistency, and continuity to assess and measure climate variability and change. NOAA CDRs are vetted using standards established by the National Research Council (NRC).

Climate Data Records are created by merging data from surface, atmosphere, and space-based systems across decades. NOAA’s Climate Data Records provides authoritative and traceable long-term climate records. NOAA developed CDRs by applying modern data analysis methods to historical global satellite data. This process can clarify the underlying climate trends within the data and allows researchers and other users to identify economic and scientific value in these records. NCEI maintains and extends CDRs by applying the same methods to present-day and future satellite measurements.

Atmospheric Climate Data Records are measurements of several global variables to help characterize the atmosphere at or just above the land and ocean surface as well as other upper air composition variables.

The NOAA Weather and Climate Toolkit is an application that provides simple visualization and data export of weather and climatological data archived at NCDC. The Toolkit also provides access to weather and climate web services provided from NCDC and other organizations. The Viewer provides tools for displaying custom data overlay, Web Map Services (WMS), animations and basic filters. The export of images and movies is provided in multiple formats. The Data Exporter allows for data export in both vector point/line/polygon and raster grid formats. Current data types supported include: CF-compliant Fridded NetCDF; Generic CF-compliant Irregularly-Spaced/Curvilinear Gridded NetCDF/HDF; GRIB1, GRIB2, GINI, GEMPAK, HDF(CF-compliant) and more gridded formats; GPES Satellite AREA Files; NEXRAD Radar Data(Level-II and Level-III); U.S. Drought Monitor Service from the National Drought Mitigation Center (NDMC); OPeNDAP support for Gridded Datasets

The U.S. Climate Normals are a large suite of data products that provide information about typical climate conditions for thousands of locations across the United States. Normals act both as a ruler to compare today’s weather and tomorrow’s forecast, and as a predictor of conditions in the near future. The official normals are calculated for a uniform 30 year period, and consist of annual/seasonal, monthly, daily, and hourly averages and statistics of temperature, precipitation, and other climatological variables from almost 15,000 U.S. weather stations.

NCEI generates the official U.S. normals every 10 years in keeping with the needs of our user community and the requirements of the World Meteorological Organization (WMO) and National Weather Service (NWS). The 1991–2020 U.S. Climate Normals are the latest in a series of decadal normals first produced in the 1950s. These data allow travelers to pack the right clothes, farmers to plant the best crop varieties, and utilities to plan for seasonal energy usage. Many other important economic decisions that are made beyond the predictive range of standard weather forecasts are either based on or influenced by climate normals.

The NOAA Monthly U.S. Climate Gridded Dataset (NClimGrid) consists of four climate variables derived from the GHCN-D dataset: maximum temperature, minimum temperature, average temperature and precipitation. Each file provides monthly values in a 5x5 lat/lon grid for the Continental United States. Data is available from 1895 to the present. On an annual basis, approximately one year of "final" nClimGrid will be submitted to replace the initially supplied "preliminary" data for the same time period. Users should be sure to ascertain which level of data is required for their research.

EpiNOAA is an analysis ready dataset that consists of a daily time-series of nClimGrid measures (maximum temperature, minimum temperature, average temperature, and precipitation) at the county scale. Each file provides daily values for the Continental United States. Data are available from 1951 to the present. Daily data are updated every 3 days with a preliminary data file and replaced with the scaled (i.e., quality controlled) data file every three months. This derivative data product is an enhancement from the original daily nClimGrid dataset in that all four weather parameters are now packaged into one file and assembled in a daily time-series format. In addition to a direct download option, an R package and web interface has been developed to streamline access to the final data product. These options allow end users three separate access modes to arrive at a customized dataset unique to each end user’s application. Users should be sure to review the data documentation to inform which level of data is required for their research.

The purpose of this dataset is to record weather to help people get quick access to climate data. Additionally, this dataset is useful for background information or looking at yearly differences.

Contains global weather station locations with data for monthly means from 1981 through 2010 for: Daily Mean Temperature °C Daily Maximum Temperature °C Daily Minimum Temperature °C Precipitation in mm Highest Daily Temperature °C Lowest Daily Temperature °C Additional monthly fields containing the equivalent values in °F and inches are available at the far right of the attribute table. GHCND stations were included if there were at least fifteen average daily values available in each month for all twelve months of the year, and for at least ten years between 1981 and 2010. 3,197 of the 7,480 stations did not collect or lacked sufficient precipitation data. These data are compiled from archived station values which have not undergone rigorous curation, and thus, there may be unexpected values, particularly in the daily extreme high and low fields. Esri is working to further curate this layer and will make updates as improvements are found. If your area of study is within the United States, we recommend using the U.S. Historical Climate - Monthly Averages for GHCN-D Stations 1981 - 2010 layer because the data in that service were compiled from web services produced by the Applied Climate Information System ( ACIS). ACIS staff curate the values for the U.S., including correcting erroneous values, reconciling data from stations that have been moved over their history, etc., thus the data in the U.S. service is of higher quality. Revision History: Initially Published: 6 Feb 2019 Updated: 12 Feb 2019 - Improved initial extraction algorithm to remove stations with extreme values. This included values higher than the highest temperature ever recorded on Earth, or those with mean values that were considerably different than adjacent neighboring stations.Updated: 18 Feb 2019 - Updated after finding an error in initial processing that excluded a 2,870 stations. Updated 16 Apr 2019 - We learned more precise coordinates for station locations were available from the Enhanced Master Station History Report (EMSHR) published by NOAA NCDC. With the publication of this layer the geometry and attributes for 635 of 7,452 stations now have more precise coordinates. The schema was updated to include the NCDC station identifier and elevation fields for feet and meters are also included. A large subset of the EMSHR metadata is available via EMSHR Stations Locations and Metadata 1738 to Present. Cite as:

Esri, 2019: World Historical Climate - Monthly Averages for GHCN-D Stations for 1981 - 2010. ArcGIS Online, Accessed April 2019. https://www.arcgis.com/home/item.html?id=ed59d3b4a8c44100914458dd722f054f Source Data: Station locations compiled from: Initially compiled using station locations from ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/ghcnd-stations.txt Menne, M.J., I. Durre, B. Korzeniewski, S. McNeal, K. Thomas, X. Yin, S. Anthony, R. Ray, R.S. Vose, B.E.Gleason, and T.G. Houston, 2012: Global Historical Climatology Network - Daily (GHCN-Daily), Version 3.24 Amended to use the most recent station locations from Russell S. Vose, Shelley McNeill, Kristy Thomas, Ethan Shepherd (2011): Enhanced Master Station History Report of March 2019. NOAA National Climatic Data Center. Access Date: April 10, 2019 doi:10.7289/V5NV9G8D. Station Monthly Means compiled from Daily Data: ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/ghcnd_all.tar.gz Menne, M.J., I. Durre, B. Korzeniewski, S. McNeal, K. Thomas, X. Yin, S. Anthony, R. Ray, R.S. Vose, B.E.Gleason, and T.G. Houston, 2012: Global Historical Climatology Network - Daily (GHCN-Daily), Version 3.24

Annual Climatological Summary contains historical monthly and annual summaries for over 8000 U.S. locations. Observing stations are located in the United States of America, U.S. Virgin Islands, Puerto Rico, and Pacific islands of the U.S. and associated nations. The major parameters are: monthly mean maximum, mean minimum and mean temperatures; monthly total precipitation and snowfall; departure from normal of the mean temperature and total precipitation; monthly heating and cooling degree days; number of days that temperatures and precipitation are above or below certain thresholds; and extreme daily temperature and precipitation amounts. Annual Climatological Summary is derived from the NCDC Summary of the Month dataset (DSI-3220).

This dataset contains Raleigh Durham International Airport weather data pulled from the NOAA web service described at Climate Data Online: Web Services Documentation. We have pulled this data and converted it to commonly used units. This dataset is an archive - it is not being updated.

This Global Summaries dataset, known as GSOM for Monthly, contains a monthly resolution of meteorological elements from 1763 to present with updates applied weekly. The major parameters are: monthly mean maximum, mean minimum and mean temperatures; monthly total precipitation and snowfall; departure from normal of the mean temperature and total precipitation; monthly heating and cooling degree days; number of days that temperatures and precipitation are above or below certain thresholds; extreme daily temperature and precipitation amounts; number of days with fog; and number of days with thunderstorms. The primary input data source is the Global Historical Climatology Network - Daily (GHCN-Daily) dataset. The Global Summaries datasets also include a yearly resolution of meteorological elements in the GSOY (for Yearly) dataset. See associated resources for more information. These datasets are not to be confused with "GHCN-Monthly", "Annual Summaries" or "NCDC Summary of the Month". There are unique elements that are produced globally within the GSOM and GSOY data files. There are also bias corrected temperature data in GHCN-Monthly, which are not available in GSOM and GSOY. The GSOM and GSOY datasets replace the legacy U.S. COOP Summaries (DSI-3220), and have been expanded to include non-U.S. (global) stations. U.S. COOP Summaries (DSI-3220) only includes National Weather Service (NWS) COOP Published, or "Published in CD", sites.

This data package contains locally verified daily meteorological observations from a NOAA National Weather Service station located at the USDA Jornada Experimental Range headquarters in southern New Mexico, USA. Daily data has been collected there by USDA staff since 1914 for minimum and maximum air temperature and daily accumulated precipitation using standard U.S. climatological service instrumentation and procedures. The included data were verified and transcribed directly from the original paper data sheets and have undergone quality control and assurance procedures different than those in place at NOAA. These data therefore differ from those directly downloadable from NOAA servers. Local verification and transcription of observations from the data sheets ceased in 2006 and data are now directly entered to the NOAA system. Therefore, this dataset is complete and will no longer be added to.All observations from this weather station have also undergone NOAA QA/QC procedures and those data are available by accessing the Jornada Experimental Range, NM US GHCN station through the National Climatic Data Center portal (https://www.ncdc.noaa.gov/cdo-web/datasets/GHCND/stations/GHCND:USC00294426/detail - daily and monthly data are available).

The Storm Events Database is an integrated database of severe weather events across the United States from 1950 to this year, with information about a storm event's location, azimuth, distance, impact, and severity, including the cost of damages to property and crops. It contains data documenting: The occurrence of storms and other significant weather phenomena having sufficient intensity to cause loss of life, injuries, significant property damage, and/or disruption to commerce. Rare, unusual, weather phenomena that generate media attention, such as snow flurries in South Florida or the San Diego coastal area. Other significant meteorological events, such as record maximum or minimum temperatures or precipitation that occur in connection with another event. Data about a specific event is added to the dataset within 120 days to allow time for damage assessments and other analysis.

The Integrated Surface Database (ISD) consists of global hourly and synoptic observations compiled from numerous sources into a gzipped fixed width format. ISD was developed as a joint activity within Asheville's Federal Climate Complex. The database includes over 35,000 stations worldwide, with some having data as far back as 1901, though the data show a substantial increase in volume in the 1940s and again in the early 1970s. Currently, there are over 14,000 "active" stations updated daily in the database. The total uncompressed data volume is around 600 gigabytes; however, it continues to grow as more data are added. ISD includes numerous parameters such as wind speed and direction, wind gust, temperature, dew point, cloud data, sea level pressure, altimeter setting, station pressure, present weather, visibility, precipitation amounts for various time periods, snow depth, and various other elements as observed by each station.

The "Unified Forecast System (UFS)" is a community-based, coupled, comprehensive Earth Modeling System. It supports " multiple applications" with different forecast durations and spatial domains. The UFS Short-Range Weather (SRW) Application figures among these applications. It targets predictions of atmospheric behavior on a limited spatial domain and on time scales from minutes to several days. The SRW Application includes a prognostic atmospheric model, pre-processor, post-processor, and community workflow for running the system end-to-end. The "SRW Application Users's Guide" includes information on these components and provides detailed instructions on how to build and run the SRW Application. Users can access additional technical support via the "UFS Community Forum"

This data registry contains the data required to run the “out-of-the-box” SRW Application case. The SRW App requires numerous input files to run, including static datasets (fix files containing climatological information, terrain and land use data), initial condition data files, lateral boundary condition data files, and model configuration files (such as namelists). The SRW App experiment generation system also contains a set of workflow end-to-end (WE2E) tests that exercise various configurations of the system (e.g., different grids, physics suites). Data for running a subset of these WE2E tests are also included within this registry.

Users can generate forecasts for dates not included in this data registry by downloading and manually adding raw model files for the desired dates. Many of these model files are publicly available and can be accessed via links on the "Developmental Testbed Center" website.

Documentation

https://ufs-srweather-app.readthedocs.io/en/develop/

Update Frequency

These are stable datasets for use with the SRW Application. They will not be updated frequently.

License

The UFS SRW Application license page can be found at: https://github.com/ufs-community/ufs-srweather-app/blob/develop/LICENSE.md

Surface Weather Observation 1001 Forms is a set of historical manuscript records for the period 1893-1948. The collection includes two very similar form types: Form 1001, in use by the US Weather Bureau, and Form 1, in use by the US Army and Navy. NCDC Climate Data Modernization Program (CDMP) scanned the vast majority of these forms in order to fill in the observation gap prior to the time when commercial aviation began in the U.S. Many forms contiaining observations taken on foreign soil have not yet been scanned. Observations were recorded two to four times daily beginning as early as 1893 at city Weather Bureau Offices. During the 1930s many of these city stations gradually moved to airport locations.

Through 1936 observations were taken twice daily; then in 1937 the general practice was to record four observations per day. The data elements are as follows: station pressure, sea level pressure, dry and wet bulb temperature, dew point, maximum and minimum temperature, wind direction and speed, precipitation, cloud amount and type, ceiling, state of weather and visibility. It should be noted that not all elements are present for all stations in this dataset, and that ceiling and visibility observations did not begin at the city offices until the 1930's. Official surface weather observation standards can be found in the Circular N manuals. The vast majority of records are available online, but some records are still only available in the physical format only.

The U.S. Daily Climate Normals (DSI-9641D) are based on monthly maximum, minimum, and mean temperature and monthly total precipitation records for each year in the 30-year period 1971-2000, inclusive (as well as separately computed monthly degree day totals). The monthly values are available in data set DSI-9641C or publication online (Climatography of the United States, No. 81 Monthly Station Normals of Temperature, Precipitation, and Heating and Cooling Degree Days, 1971-2000). In order to be included in the normals, a station had to have at least 10 years of monthly temperature data or 10 years of monthly precipitation data for each month in the period 1971-2000. In addition, a station had to be active since January 1, 1999, or had to be included as a normals station in the 1961-1990 normals.

The Analysis Of Record for Calibration (AORC) is a gridded record of near-surface weather conditions covering the continental United States and Alaska and their hydrologically contributing areas. It is defined on a latitude/longitude spatial grid with a mesh length of 30 arc seconds (~800 m), and a temporal resolution of one hour. Elements include hourly total precipitation, temperature, specific humidity, terrain-level pressure, downward longwave and shortwave radiation, and west-east and south-north wind components. It spans the period from 1979 across the Continental U.S. (CONUS) and from 1981 across Alaska, to the near-present (at all locations). This suite of eight variables is sufficient to drive most land-surface and hydrologic models and is used as input to the National Water Model (NWM) retrospective simulation. While the native AORC process generates netCDF output, the data is post-processed to create a cloud optimized Zarr formatted equivalent for dissemination using cloud technology and infrastructure.

AORC Version 1.1 dataset creation
The AORC dataset was created after reviewing, identifying, and processing multiple large-scale, observation, and analysis datasets. There are two versions of The Analysis Of Record for Calibration (AORC) data.

The initial AORC Version 1.0 dataset was completed in November 2019 and consisted of a grid with 8 elements at a resolution of 30 arc seconds. The AORC version 1.1 dataset was created to address issues "see Table 1 in Fall et al., 2023" in the version 1.0 CONUS dataset. Full documentation on version 1.1 of the AORC data and the related journal publication are provided below.

The native AORC version 1.1 process creates a dataset that consists of netCDF files with the following dimensions: 1 hour, 4201 latitude values (ranging from 25.0 to 53.0), and 8401 longitude values (ranging from -125.0 to -67).

The data creation runs with a 10-day lag to ensure the inclusion of any corrections to the input Stage IV and NLDAS data.

Note - The full extent of the AORC grid as defined in its data files exceed those cited above; those outermost rows and columns of data grids are filled with missing values and are the remnant of an early set of required AORC extents that have since been adjusted inward.

AORC Version 1.1 Zarr Conversion

The goal for converting the AORC data from netCDF to Zarr was to allow users to quickly and efficiently load/use the data. For example, one year of data takes 28 mins to load via NetCDF while only taking 3.2 seconds to load via Zarr (resulting in a substantial increase in speed). For longer periods of time, the percentage increase in speed using Zarr (vs NetCDF) is even higher. Using Zarr also leads to less memory and CPU utilization.

It was determined that the optimal conversion for the data was 1 year worth of Zarr files with a chunk size of 18MB. The chunking was completed across all 8 variables. The chunks consist of the following dimensions: 144 time, 128 latitude, and 256 longitude. To create the files in the Zarr format, the NetCDF files were rechunked using chunk() and "Xarray". After chunking the files, they were converted to a monthly Zarr file. Then, each monthly Zarr file was combined using "to_zarr" to create a Zarr file that represents a full year

Users wanting more than 1 year of data will be able to utilize Zarr utilities/libraries to combine multiple years up to the span of the full data set.

There are eight variables representing the meteorological conditions
Total Precipitaion (APCP_surface)

1. Hourly total precipitation (kgm-2 or mm) for Calibration (AORC) dataset
   

Air Temperature (TMP_2maboveground)

1. Temperature (at 2 m above-ground-level (AGL)) (K)
   

Specific Humidity (SPFH_2maboveground)

1. Specific humidity (at 2 m AGL) (g g-1)
   

Downward Long-Wave Radiation Flux (DLWRF_surface)

1. longwave (infrared)
2. radiation flux (at the surface) (W m-2)
   

Downward Short-Wave Radiation Flux (DSWRF_surface)

1. Downward shortwave (solar)
2. radiation flux (at the surface) (W m-2)
   

Pressure (PRES_surface)

1. Air pressure (at the surface) (Pa)
   

**U-Component of Wind (UGRD_10maboveground)"
1)U (west-east) - components of the wind (at 10 m AGL) (m s-1)
**V-Component of Wind (VGRD_10maboveground)"

1. V (south-north) - components of the wind (at 10 m AGL) (m s-1)
   
   

Precipitation and Temperature

The gridded AORC precipitation dataset contains one-hour Accumulated Surface Precipitation (APCP) ending at the “top” of each hour, in liquid water-equivalent units (kg m-2 to the nearest 0.1 kg m-2), while the gridded AORC temperature dataset is comprised of instantaneous, 2 m above-ground-level (AGL) temperatures at the top of each hour (in Kelvin, to the nearest 0.1).

Specific Humidity, Pressure, Downward Radiation, Wind

The development process for the six additional dataset components of the Conus AORC [i.e., specific humidity at 2m above ground (kg kg-1); downward longwave and shortwave radiation fluxes at the surface (W m-2); terrain-level pressure (Pa); and west-east and south-north wind components at 10 m above ground (m s-1)] has two distinct periods, based on datasets and methodology applied: 1979–2015 and 2016–present.

This data release consists of Network Common Data Form (NetCDF) data sets of daily total-precipitation and minimum and maximum air temperatures for the time period from January 1, 1895 to December 31, 1915. These data sets are based on individual station data obtained for 153 National Oceanic and Atmospheric Administration (NOAA) weather stations in Florida and parts of Georgia, Alabama, and South Carolina (available at http://www.ncdc.noaa.gov/cdo-web/results). Weather station data were used to produce a total of 23,007 daily raster surfaces (7,669 daily raster surfaces for each of the 3 data sets) using a thin-plate-spline method of interpolation. The geographic extent of the weather station data coincides with the geographic extent of the Floridan aquifer system, with the exception of a small portion of southeast Mississippi where the Floridan aquifer system is saline and was not used.