Overview

The International Comprehensive Ocean-Atmosphere Data Set (ICOADS) is a global ocean marine meteorological and surface ocean dataset. It is formed by merging many national and international data sources that contain measurements and visual observations from ships (merchant, navy, research), moored and drifting buoys, coastal stations, and other marine and near-surface ocean platforms. Each marine report contains individual observations of meteorological and oceanographic variables, such as sea surface and air temperatures, wind, pressure, humidity, and cloudiness. The coverage is global and sampling density varies depending on date and geographic position relative to shipping routes and ocean observing systems.

Content

The ICOADS dataset contains global marine data from ships (merchant, navy, research) and buoys, each capturing details according to the current weather or ocean conditions (wave height, sea temperature, wind speed, and so on). Each record contains the exact location of the observation which is great for visualizations. The historical depth of the data is quite comprehensive — There are records going back to 1662!

Querying BigQuery tables

You can use the BigQuery Python client library to query tables in this dataset in Kernels. Note that methods available in Kernels are limited to querying data. Tables are at bigquery-public-data.github_repos.[TABLENAME]. Fork this kernel to get started to learn how to safely manage analyzing large BigQuery datasets.

Acknowledgements

Dataset Source: NOAA Category: Meteorological, Climate, Transportation

Citation: National Centers for Environmental Information/NESDIS/NOAA/U.S. Department of Commerce, Research Data Archive/Computational and Information Systems Laboratory/National Center for Atmospheric Research/University Corporation for Atmospheric Research, Earth System Research Laboratory/NOAA/U.S. Department of Commerce, Cooperative Institute for Research in Environmental Sciences/University of Colorado, National Oceanography Centre/Natural Environment Research Council/United Kingdom, Met Office/Ministry of Defence/United Kingdom, Deutscher Wetterdienst (German Meteorological Service)/Germany, Department of Atmospheric Science/University of Washington, and Center for Ocean-Atmospheric Prediction Studies/Florida State University. 2016, updated monthly. International Comprehensive Ocean-Atmosphere Data Set (ICOADS) Release 3, Individual Observations. Research Data Archive at the National Center for Atmospheric Research, Computational and Information Systems Laboratory: https://doi.org/10.5065/D6ZS2TR3. Accessed 01 04 2017.

Use: This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source - http://www.data.gov/privacy-policy#data_policy — and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

Photo by Gleb Kozenko on Unsplash

Comprehensive demographic dataset for Naval Station Norfolk, Norfolk, VA, US including population statistics, household income, housing units, education levels, employment data, and transportation with year-over-year changes.

Comprehensive demographic dataset for Army Navy Country Club, Arlington, VA, US including population statistics, household income, housing units, education levels, employment data, and transportation with year-over-year changes.

Comprehensive demographic dataset for Navy Yard, Washington, DC, US including population statistics, household income, housing units, education levels, employment data, and transportation with year-over-year changes.

Original provider: HDR Environmental, Operations and Construction, Inc.

Dataset credits: The U.S. Navy Marine Species Monitoring Program

Abstract: In order to support the U.S. Navy in meeting regulatory requirements for monitoring established under the Final Rules and to provide a mechanism to assist with coordination of program objectives under the ICMP, this survey was conducted to confirm the Marine Mammal Monitoring on Navy Ranges (M3R) acoustic detections and marine mammal satellite tagging was prior to a training event, the Submarine Commander’s Course exercise, which would be conducted in the same area during February 2012.
The survey occurred from 11 to 19 January 2012 in the waters west of Kaua'i in the Pacific Missile Range Facility (PMRF) instrumented range within the HRC. This cruise was designed as a non-random, non-systematic survey designed to optimize encounter rates for the purpose of visual validation of acoustic detections and satellite tagging of species for which population size, habitat use, and movement pattern data are lacking and which may be exposed to U.S. Navy training.

Purpose: not provided

Supplemental information: [2017-10-13] Data fields are changed so that they follow other Navy datasets.

This dataset displays the number of active duty personnel and their location, by country. Included in these figures are the numbers for Army, Navy, Marine, and Air Force branches of the United States Military. Note: this data includes rounded figures for personnel involved in Operation Iraqi Freedom (OIF)and Operation Enduring Freedom (OEF). This data was collected from the department of Defense directly at: http://siadapp.dmdc.osd.mil/personnel/MILITARY/history/hst0706.pdf .

Original provider: Andrew DiMatteo, US Navy

Dataset credits: Kevin Foss, Christopher Newport University; U.S. Department of the Navy

Abstract: The Elizabeth River is bounded almost totally by industrial, urban, suburban, commercial shipping and military facilities. Tidal in nature, the river has low flow, resulting in heavy contamination loads. The population studied is the Northern Migratory Stock of the US Atlantic coast, appearing in this area from May through November. Standard small boat, focal group follow, passive observation techniques were used, along with photography of individuals. Data on location, group size estimates, activities observed and relevant environmental observations were recorded every five minutes. The dolphins appear as individuals or pairs in April and May, with group size increasing in June to a peak mean of 29 animals sighted per encounter. Group size then decreases in October and November. Probability of encountering dolphins ranges from 0% during the winter and early spring to over 80% in July, tapering off towards fall. Activity patterns show greatest diversity in July and August, with travel constituting the main activity early and late. Despite a peak of births in the area in May-June, there is little mating until July, with the incidence of sexual activity peaking in September.

Purpose: To better understand the seasonality and behavior of bottlenose dolphins in the lower Chesapeake Bay.

Data were originally collected by Mr. Kevin Foss at Christopher Newport University during field seasons from 2000-2006. Data were subsequently acquired by the U.S. Navy in 2013.

Supplemental information: [2015-03-24] A few records had a wrong animal count of zero. The value is replaced with a blank representing species presence only.

These data are the result of small boat transects with focal group follows, so that sightings were recorded at regular intervals. Therefore, there may be sightings of the same individuals at different times.

Records that originally estimated a range for the number of adults were attributed with the median number to be conservative.

Three records on land were excluded.

Original provider: Marine Ecology and Telemetry Research

Dataset credits: Marine Ecology and Telemetry Research

Abstract: The United States (US) Navy uses the Southern California (SOCAL) portion of the Hawaii-Southern California Training and Testing area, a collection of nearshore and offshore training areas that include much of the navigable water from Santa Barbara Island, California, to northern Baja California, Mexico, and extending several hundred miles to the west. It is among one of the most heavily used tactical training areas in the world, and is used for a variety of aerial, surface, and subsurface exercises. The Southern California Offshore Range (SCORE) is a subset of complexes within SOCAL centered on San Clemente Island and managed via the Range Operation Center (ROC) on North Island, Coronado. It includes the Southern California Anti-submarine Warfare Range (SOAR), a focal area for exercises involving mid-frequency active sonar (MFAS) systems within the San Nicolas Basin.

Through its N45 Living Marine Resources (LMR) research programs, and more recently in support of Pacific Fleet Monitoring efforts, the US Navy has funded directed studies on cetacean occurrence on SOAR since 2006. The primary focus of these studies is to support long-term surveys of Cuvier’s beaked whales and fin whales using photo-identification (photo-ID) and genetics to elucidate population size, structure, and trends, which can in turn provide a particularly robust basis for assessing population-level impacts of Navy training. Data is collected on all species encountered in this region as part of the monitoring program.

Whale data were collected using visual observations and other instruments in the Arctic Ocean from aircraft. Data were collected from 02 August 1979 to 18 October 1982 by the US Navy; Naval Ocean Systems Command as part of the MMS Studies program. Data has been processed by NODC to the NODC standard Marine Mammal Sighting and Census (F127) format. The F127 format is used for data from field observations of marine animals. Data may be reported either for individual, random sightings or for sightings made as part of systematic ship or aircraft surveys along specified tracks. These data provide information on animal population densities and distributions, activities, migratory routes and breeding locales. Cruise or survey information, start and end positions, start and end times, and platform speed, direction, and altitude are reported for each observation or series of observations. Position, date and time are reported for each sighting location, along with a code indicating presence or absence of animals and, if present, their distance to the observer, shoreline, and ice edge and heading direction. For each sighting location, animal sighting data are reported by species for all observed species. Species identification, total number of individuals, and counts by age group (adults, subadults, juveniles, unknown) may be reported in summary for all animals sighted or by subgroups distinguished by sex, behavior, markings, or other characteristics. A text record is available for comments.

Original provider: Duke University Marine Laboratory

Dataset credits: Duke University Marine Laboratory

Abstract: The United States (US) Navy proposed constructing an Undersea Warfare Training Range (USWTR) along the US Atlantic coast. In 2008, the US Navy chose the area off of Jacksonville, FL (JAX OPAREA) to be the preferred site of the USWTR. The JAX USWTR site and, like that in Onslow Bay, is 25 nm (46 km) long and 20 nm (37 km) wide (approximately 1700 km2). The survey area straddles the continental shelf and Blake Plateau and includes neritic, shelf waters and pelagic, offshore waters. As part of the Navy's Atlantic Fleet Training and Testing (AFTT) Monitoring Program, shipboard and aerial line transect surveys were implemented in 2009 to estimate density and document distribution and seasonal residency of marine mammals and sea turtles in the proposed USWTR (see "DUML vessel-based surveys for proposed JAX USWTR site 2009-2010" dataset). In January 2012, shipboard line-transect survey methods transitioned to biopsy and photo-identification sampling to address questions of residency and population structure in the area. Vessel survey effort was expended along the 200 m depth contour and occasionally around eddies and fronts generated by the Gulf Stream. We are focusing on residency and population structure with our shipboard surveys because we are: (1) obtaining adequate data with which to estimate density from aerial line transect sampling; (2) interested in addressing questions of residency in this area. Sightings within this dataset are from shipboard photo-ID and biopsy surveys conducted from 2012-2015.

Purpose: The primary objectives of these surveys are to: (1) document species occurrence and examine patterns of residency of marine mammals and turtles in the defined study area (2) determine relatedness among individuals, populations and species within the study area (3) supplement the visual surveys with acoustic monitoring using a High-frequency Acoustic Recording Package (HARP).

Supplemental information: [2020-09-30] The following invalid species names were corrected according to the Integrated Taxonomic Information System (ITIS). Turtles: Testudines (173749) => Testudines (948936)

[2016-04-14] Sightings from Jul to Dec 2015 were appended. The following columns were added (these columns are blank for the sightings before Jul 2015): end_time, end_lat, end_long, behav_state, totminest, totmaxest, mincalves, maxcalves, minyoy, maxyoy, totposid, totnoid, totfinbest, calfposid, calfnoid, calfinbest, yoyposid, comments, photo_notes, sighting_notes, observations, photo_grades, acoustics of which totposid, totnoid, totfinbest, calfposid, calfnoid, calfinbest, yoyposid, comments, sighting_notes, observations, photo_grades are blank for the newly added sightings.

[2015-05-13] The 2014-2015 data were appended. [2014-03-21] The 2013-14 data were appended. The following attributes were added since May 2013: SIGHTNO, BEAUSCALE, DEPTH, WATERTEMP, BESTCALVES, BESTYOY, PHOTOS [2013-03-19] Additional survey data for the JAX USWTR site are available on OBIS-SEAMAP in the "DUML vessel-based surveys for proposed JAX USWTR site 2009-2010" dataset.