The Global Historical Climatology Network - Daily (GHCN-Daily/GHCNd) dataset integrates daily climate observations from approximately 30 different data sources. Version 3 was released in September 2012 with the addition of data from two additional station networks. Changes to the processing system associated with the version 3 release also allowed for updates to occur 7 days a week rather than only on most weekdays. Version 3 contains station-based measurements from well over 90,000 land-based stations worldwide, about two thirds of which are for precipitation measurement only. Other meteorological elements include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, snowfall and snow depth. Over 25,000 stations are regularly updated with observations from within roughly the last month. The dataset is also routinely reconstructed (usually every week) from its roughly 30 data sources to ensure that GHCNd is generally in sync with its growing list of constituent sources. During this process, quality assurance checks are applied to the full dataset. Where possible, GHCNd station data are also updated daily from a variety of data streams. Station values for each daily update also undergo a suite of quality checks.

Please note, this dataset has been superseded by a newer version (see below). Users should not use this version except in rare cases (e.g., when reproducing previous studies that used this version). The Global Historical Climatology Network - Daily (GHCN-Daily) dataset addresses the need for historical daily records over global land areas. Like its monthly counterpart (GHCN-Monthly), GHCN-Daily is a composite of climate records from numerous sources that were merged and then subjected to a suite of quality assurance reviews. The meteorological elements measured for the data set include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, precipitation (i.e., rainfall and snow water equivalent), snowfall and snow depth. GHCN-Daily serves as the official archive for daily data from the Global Climate Observing System (GCOS) Surface Network (GSN) and is particularly well suited for monitoring and assessment activities related to the frequency and magnitude of extremes. Sources for the GHCN-Daily data set include, but are not limited, to U.S. Cooperative Summary of the Day, U.S. Fort data, U.S. Climate Reference Network, Community Collaborative Rain, Hail and Snow Network, and numerous international sources. The dataset contains measurements from over 75,000 stations worldwide,about two thirds of which are for precipitation measurement only. Approximately 8500 are regularly updated with observations from within the last month. While most of these sites report precipitation, daily maximum and minimum temperatures are available at more than 25,000 of them, and over 24,000 contain records of snowfall and/or snow depth. The process of integrating data from multiple sources into the GHCN-Daily dataset takes place in three steps: screening the source data for stations whose identity is unknown or questionable; classifying each station in a source dataset either as one that is already represented in GHCN-Daily or as a new site; and mingling the data from the different sources. The first two of these steps are performed whenever a new source dataset or additional stations become available, while the actual mingling of data is part of the automated processing that creates GHCN-Daily on a regular basis. GHCN-Daily data are subject to a suite of quality assurance checks. The checks consist of several types of carefully evaluated tests that detect duplicated data, climatological outliers, and various inconsistencies (internal, temporal, and spatial). Manual review of random samples of flagged values was used to set the threshold for each procedure such that the tests false-positive rate is minimized. In addition, the tests are performed in a deliberate sequence in an effort to enhance the performance of the later checks by detecting errors with the checks applied earlier in the sequence.

Monthly Summaries of Global Historical Climatology Network (GHCN)-Daily is a dataset derived from GHCN-Daily. The data are produced by computing simple averages or monthly accumulations of the daily observations. The meteorological elements calculated for the data set include, but are not limited to: monthly maximum and minimum temperature, monthly precipitation (i.e., rainfall and snow water equivalent), snowfall and snow depth. Users of these monthly summaries have access to simple meteorological summaries for tens of thousands of stations worldwide.

The Global Historical Climatology Network daily (GHCNd) is an integrated database of daily climate summaries from land surface stations across the globe. GHCNd is made up of daily climate records from numerous sources that have been integrated and subjected to a common suite of quality assurance reviews. GHCNd contains records from more than 100,000 stations in 180 countries and territories. NCEI provides numerous daily variables, including maximum and minimum temperature, total daily precipitation, snowfall, and snow depth. About half the stations only report precipitation. Both record length and period of record vary by station and cover intervals ranging from less than a year to more than 175 years. Note: Description on torrent includes unrelated information, ignore torrent file comment and use this one instead.

NOTE: Version 3 of GHCN has been discontinued at NCEI, and so this dataset is no longer being updated. Version 4 of GHCN can be accessed here [https://www.ncdc.noaa.gov/data-access/land-based-station-data/land-based-datasets/global-historical-climatology-network-monthly-version-4]. The Global Historical Climatology Network (GHCN) is a baseline network of long-running surface global stations for the purpose of monitoring and detecting climate change. Monthly-summarized data from various global sources are processed on a daily basis assembled into version 3 of NCDC's GHCNM dataset. The CISL Research Data Archive is hosting a copy of the monthly-average surface temperatures in support of UCAR's Global Learning and Observation to Benefit the Environment (GLOBE) program.

Global Historical Climatology Network-hourly (GHCNh) is a multisource collection of weather station (meteorological) observations from the late 18th Century to the present from fixed weather stations over land across the globe. It is replacing the Integrated Surface Dataset (ISD) and will be used to generate the Local Climatological Data and Global Summary of the Day datasets. It is constructed to align with GHCN daily. Version 1 contains approximately 110 separate data sources and will be updated daily using the United States Air Force and NOAA Surface Weather Observations data streams. GHCNh v1 contains the following variables: altimeter; dew_point_temperature; precipitation; pressure_3hr_change; pres_wx_AU1; pres_wx_AU2; pres_wx_AU3; pres_wx_AW1; pres_wx_AW2; pres_wx_AW3; pres_wx_MW1; pres_wx_MW2; pres_wx_MW3; relative_humidity; Remarks; sea_level_pressure; sky_cov_baseht_1; sky_cov_baseht_2; sky_cov_baseht_3; sky_cover_1; sky_cover_2; sky_cover_3; station_level_pressure; dry bulb temperature; visibility; wet_bulb_temperature; wind_direction; wind_gust; wind_speed.

The GHCN-Monthly Temperature Version 4 dataset consists of monthly mean temperature (both raw and bias corrected data), monthly mean maximum, and minimum temperature. GHCN-M is the core global land surface air temperature dataset used for climate monitoring and assessment activities. GHCN-M version 4 contains monthly mean temperature for over 25,000 stations across the globe and brings consistency with temperature observations found in the GHCN-Daily dataset.

The table daily observations is part of the dataset NOAA Global Historical Climatology Network daily, available at https://redivis.com/datasets/yfsr-31rajeys9. It contains 2770275499 rows across 8 variables.

NOAA’s Global Historical Climatology Network (GHCN) is an integrated database of climate summaries from land surface stations across the globe that have been subjected to a common suite of quality assurance reviews. The data are obtained from more than 20 sources. Two GHCN datasets are available in BigQuery, the GHCN-D (daily) and the GHCN-M (monthly). The GHCN-Daily is an integrated database of daily climate summaries from land surface stations across the globe, and is comprised of daily climate records from over 100,000 stations in 180 countries and territories, and includes some data from every year since 1763. For a complete description of data variables available in this dataset, see NOAA’s GHCN-D readme . This public dataset is hosted in Google BigQuery and is included in BigQuery's 1TB/mo of free tier processing. This means that each user receives 1TB of free BigQuery processing every month, which can be used to run queries on this public dataset. Watch this short video to learn how to get started quickly using BigQuery to access public datasets. What is BigQuery .

Analysis of ‘Global Historical Climatology Network - Daily (GHCN-Daily), Version 3’ provided by Analyst-2 (analyst-2.ai), based on source dataset retrieved from https://catalog.data.gov/dataset/c4eba89a-70f7-4f74-82a0-7254ad379fd2 on 27 January 2022.

--- Dataset description provided by original source is as follows ---

The Global Historical Climatology Network - Daily (GHCN-Daily) dataset integrates daily climate observations from approximately 30 different data sources. Version 3 was released in September 2012 with the addition of data from two additional station networks. Changes to the processing system associated with the version 3 release also allowed for updates to occur 7 days a week rather than only on most weekdays. Version 3 contains station-based measurements from well over 90,000 land-based stations worldwide, about two thirds of which are for precipitation measurement only. Other meteorological elements include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, snowfall and snow depth. Over 25,000 stations are regularly updated with observations from within roughly the last month. The dataset is also routinely reconstructed (usually every week) from its roughly 30 data sources to ensure that GHCN-Daily is generally in sync with its growing list of constituent sources. During this process, quality assurance checks are applied to the full dataset. Where possible, GHCN-Daily station data are also updated daily from a variety of data streams. Station values for each daily update also undergo a suite of quality checks.

--- Original source retains full ownership of the source dataset ---

The Global Historical Climatology Network - Daily (GHCN-Daily) dataset integrates daily climate observations from approximately 30 different data sources. GHCN-Daily contains station-based measurements from well over 90,000 land-based stations worldwide, about two thirds of which are for precipitation measurement only. Other meteorological elements include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, snowfall and snow depth. Over 25,000 stations are regularly updated with observations from within roughly the last month. The dataset is also routinely reconstructed (usually every week) from its roughly data sources to ensure that GHCN-Daily is generally in sync with its growing list of constituent sources. During this process, quality assurance checks are applied to the full dataset. Where possible, GHCN-Daily station data are also updated daily from a variety of data streams. Station values for each daily update also undergo a suite of quality checks.

The GHCN-Daily was developed to meet the needs of climate analysis and monitoring studies that require data at a sub-monthly time resolution (e.g., assessments of the frequency of heavy rainfall, heat wave duration, etc.). It also serves as NCDC's sole source of U.S. Summary of the Day data, providing a diverse array of users in the public and private sector with weather and climate observations that meet needs from the local to national level. By bringing together contributions from dozens of national and international sources and combining historical with near real-time observations, this dataset helps users understand todays climate and how it impacts society while helping users prepare for weather and climate conditions in the future. The Global Historical Climatology Network - Daily (GHCN-Daily) dataset addresses the need for historical daily records over global land areas. Like its monthly counterpart (GHCN-Monthly), GHCN-Daily is a composite of climate records from numerous sources that were merged and then subjected to a suite of quality assurance reviews. The meteorological elements measured for the data set include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, precipitation (i.e., rainfall and snow water equivalent), snowfall and snow depth. GHCN-Daily serves as the official archive for daily data from the Global Climate Observing System (GCOS) Surface Network (GSN) and is particularly well suited for monitoring and assessment activities related to the frequency and magnitude of extremes. Sources for the GHCN-Daily data set include, but are not limited, to U.S. Cooperative Summary of the Day, U.S. Fort data, U.S. Climate Reference Network, Community Collaborative Rain, Hail and Snow Network, and numerous international sources. The dataset contains measurements from over 75,000 stations worldwide, about two thirds of which are for precipitation measurement only. Approximately 8500 are regularly updated with observations from within the last month. While most of these sites report precipitation, daily maximum and minimum temperatures are available at more than 25,000 of them, and over 24,000 contain records of snowfall and/or snow depth.MapData

Analysis of ‘Monthly Summaries of the Global Historical Climatology Network - Daily (GHCN-D)’ provided by Analyst-2 (analyst-2.ai), based on source dataset retrieved from https://catalog.data.gov/dataset/b2d970d1-63ce-44c9-a2fe-9153ddfe097a on 27 January 2022.

--- Dataset description provided by original source is as follows ---

Monthly Summaries of Global Historical Climatology Network (GHCN)-Daily is a dataset derived from GHCN-Daily. The data are produced by computing simple averages or monthly accumulations of the daily observations. The meteorological elements calculated for the data set include, but are not limited to: monthly maximum and minimum temperature, monthly precipitation (i.e., rainfall and snow water equivalent), snowfall and snow depth. Users of these monthly summaries have access to simple meteorological summaries for tens of thousands of stations worldwide.

--- Original source retains full ownership of the source dataset ---

The Global Historical Climatology Network - Daily (GHCN-Daily) dataset integrates daily climate observations from approximately 30 different data sources. Version 3 was released in September 2012 with the addition of data from two additional station networks. Changes to the processing system associated with the version 3 release also allowed for updates to occur 7 days a week rather than only on most weekdays. Version 3 contains station-based measurements from well over 90,000 land-based stations worldwide, about two thirds of which are for precipitation measurement only. Other meteorological elements include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, snowfall and snow depth. Over 25,000 stations are regularly updated with observations from within roughly the last month. The dataset is also routinely reconstructed (usually every week) from its roughly 30 data sources to ensure that GHCN-Daily is generally in sync with its growing list of constituent sources. During this process, quality assurance checks are applied to the full dataset. Where possible, GHCN-Daily station data are also updated daily from a variety of data streams. Station values for each daily update also undergo a suite of quality checks.MapData

The table stations is part of the dataset NOAA Global Historical Climatology Network daily, available at https://redivis.com/datasets/yfsr-31rajeys9. It contains 119502 rows across 10 variables.

The Global Historical Climatology Network - Daily (GHCN-Daily) dataset addresses the need for historical daily records over global land areas. Like its monthly counterpart (GHCN-Monthly), GHCN-Daily is a composite of climate records from numerous sources that were merged and then subjected to a suite of quality assurance reviews. The meteorological elements measured for the data set include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, precipitation (i.e., rainfall and snow water equivalent), snowfall and snow depth. GHCN-Daily serves as the official archive for daily data from the Global Climate Observing System (GCOS) Surface Network (GSN) and is particularly well suited for monitoring and assessment activities related to the frequency and magnitude of extremes. Sources for the GHCN-Daily data set include, but are not limited, to U.S. Cooperative Summary of the Day, U.S. Fort data, U.S. Climate Reference Network, Community Collaborative Rain, Hail and Snow Network, and numerous international sources.MapData

The Global Historical Climatology Network - Daily (GHCN-Daily) dataset integrates daily climate observations from approximately 30 different data sources. Version 3 was released in September 2012 with the addition of data from two additional station networks. Changes to the processing system associated with the version 3 release also allowed for updates to occur 7 days a week rather than only on most weekdays. Version 3 contains station-based measurements from well over 90,000 land-based stations worldwide, about two thirds of which are for precipitation measurement only. Other meteorological elements include, but are not limited to, daily maximum and minimum temperature, temperature at the time of observation, snowfall and snow depth. Over 25,000 stations are regularly updated with observations from within roughly the last month. The dataset is also routinely reconstructed (usually every week) from its roughly 30 data sources to ensure that GHCN-Daily is generally in sync with its growing list of constituent sources. During this process, quality assurance checks are applied to the full dataset. Where possible, GHCN-Daily station data are also updated daily from a variety of data streams. Station values for each daily update also undergo a suite of quality checks. cdm_data_type=Other citation=Menne, Matthew J., Imke Durre, Bryant Korzeniewski, Shelley McNeill, Kristy Thomas, Xungang Yin, Steven Anthony, Ron Ray, Russell S. Vose, Byron E.Gleason, and Tamara G. Houston (2012): Global Historical Climatology Network - Daily (GHCN-Daily), Version 3. [indicate subset used]. NOAA National Climatic Data Center. doi:10.7289/V5D21VHZ Conventions=COARDS, CF-1.6, ACDD-1.3 data_doi=doi:10.7289/V5D21VHZ Easternmost_Easting=174.983 geospatial_lat_max=-40.0092 geospatial_lat_min=-90.0 geospatial_lat_units=degrees_north geospatial_lon_max=174.983 geospatial_lon_min=-178.6 geospatial_lon_units=degrees_east infoUrl=https://www.ncei.noaa.gov/metadata/geoportal/rest/metadata/item/gov.noaa.ncdc:C00861/html institution=NOAA keywords_vocabulary=GCMD Science Keywords Northernmost_Northing=-40.0092 sourceUrl=(local files) Southernmost_Northing=-90.0 standard_name_vocabulary=CF Standard Name Table v70 time_coverage_end=2024-02-02T00:00:00Z time_coverage_start=1750-02-01T00:00:00Z Westernmost_Easting=-178.6

Please note, the temperature portion of this dataset has been superseded by a newer version. Users should not use this version except in rare cases (e.g., when reproducing previous studies that used this version). The precipitation subset of this dataset is still the latest version available. The Global Historical Climatology Network Monthly (GHCN-M) Version 2 dataset created by the NCDC contains historical temperature, precipitation, and pressure data for thousands of land stations worldwide. The period of record varies from station to station, with several thousand extending back to 1950 and several hundred being updated monthly. Both historical and near-real-time GHCN-M data undergo rigorous quality assurance reviews. These reviews include pre-processing checks on source data, time series checks that identify spurious changes in the mean and variance, spatial comparisons that verify the accuracy of the climatological mean and the seasonal cycle, and neighbor checks that identify outliers from both a temporal and a spatial perspective. Only one file for the temperature data is available from the archive (file is for period of record ending in 2011), but precipitation data has been archived daily since 2012.

This dataset is a cleaned-up extract from the following public BigQuery dataset: https://console.cloud.google.com/marketplace/details/noaa-public/ghcn-d

The dataset contains daily min/max temperatures from a selection of 1666 weather stations. The data spans exactly 50 years. Missing values have been interpolated and are marked as such.

This dataset is in TFRecord format.

About the original dataset: NOAA’s Global Historical Climatology Network (GHCN) is an integrated database of climate summaries from land surface stations across the globe that have been subjected to a common suite of quality assurance reviews. The data are obtained from more than 20 sources. The GHCN-Daily is an integrated database of daily climate summaries from land surface stations across the globe, and is comprised of daily climate records from over 100,000 stations in 180 countries and territories, and includes some data from every year since 1763.

Context

Weather is the state of the atmosphere, describing for example the degree to which it is hot or cold, wet or dry, calm or stormy, clear or cloudy. Source: https://en.wikipedia.org/wiki/Weather

Content

NOAA’s Global Historical Climatology Network (GHCN) is an integrated database of climate summaries from land surface stations across the globe that have been subjected to a common suite of quality assurance reviews. Two GHCN datasets are available in BigQuery, the GHCN-D (daily) and the GHCN-M (monthly). The data included in the GHCN datasets are obtained from more than 20 sources, including some data from every year since 1763.

For a complete description of data variables available in this dataset, see NOAA’s readme.txt: https://www1.ncdc.noaa.gov/pub/data/ghcn/daily/readme.txt

Update Frequency: daily

Fork this kernel to get started with this dataset.

Acknowledgements

https://bigquery.cloud.google.com/dataset/bigquery-public-data:ghcn_d

https://cloud.google.com/bigquery/public-data/noaa-ghcn

Dataset Source: NOAA. This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source — http://www.data.gov/privacy-policy#data_policy — and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

Banner Photo by Max LaRochelle from Unplash.

Inspiration

Find weather stations close to a specific location?

Daily rainfall amounts at specific station?

Pulling daily min/max temperature (in Celsius) and rainfall (in mm) for the past 14 days?