A list of all datasets that were identified for publication on NYC Open Data and their current release status. For comprehensive information on each dataset currently on NYC Open Data, please refer to Local Law 251 of 2017: Published Data Asset Inventory.

Context

NYC Open Data is an opportunity to engage New Yorkers in the information that is produced and used by City government. We believe that every New Yorker can benefit from Open Data, and Open Data can benefit from every New Yorker. Source: https://opendata.cityofnewyork.us/overview/

Content

Thanks to NYC Open Data, which makes public data generated by city agencies available for public use, and Citi Bike, we've incorporated over 150 GB of data in 5 open datasets into Google BigQuery Public Datasets, including:

• Over 8 million 311 service requests from 2012-2016

• More than 1 million motor vehicle collisions 2012-present

• Citi Bike stations and 30 million Citi Bike trips 2013-present

• Over 1 billion Yellow and Green Taxi rides from 2009-present

• Over 500,000 sidewalk trees surveyed decennially in 1995, 2005, and 2015

This dataset is deprecated and not being updated.

Fork this kernel to get started with this dataset.

Acknowledgements

https://opendata.cityofnewyork.us/

https://cloud.google.com/blog/big-data/2017/01/new-york-city-public-datasets-now-available-on-google-bigquery

This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source - https://data.cityofnewyork.us/ - and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

By accessing datasets and feeds available through NYC Open Data, the user agrees to all of the Terms of Use of NYC.gov as well as the Privacy Policy for NYC.gov. The user also agrees to any additional terms of use defined by the agencies, bureaus, and offices providing data. Public data sets made available on NYC Open Data are provided for informational purposes. The City does not warranty the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set made available on NYC Open Data, nor are any such warranties to be implied or inferred with respect to the public data sets furnished therein.

The City is not liable for any deficiencies in the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set, or application utilizing such data set, provided by any third party.

Banner Photo by @bicadmedia from Unplash.

Inspiration

On which New York City streets are you most likely to find a loud party?

Can you find the Virginia Pines in New York City?

Where was the only collision caused by an animal that injured a cyclist?

What’s the Citi Bike record for the Longest Distance in the Shortest Time (on a route with at least 100 rides)?

https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png" alt="enter image description here"> https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png

The City Record Online (CROL) is a fully searchable database of notices published in the City Record newspaper, including, but not limited to: public hearings and meetings, public auctions and sales, solicitations and awards and official rules proposed and adopted by city agencies.

This dataset contains the list of dataset nominations submitted to the NYC Open Data team.

A Civil Service List consists of all candidates who passed an exam, ranked in score order. An established list is considered active for no less than one year and no more than four years from the date of establishment. For more information visit DCAS’ “Work for the City” webpage at: https://www1.nyc.gov/site/dcas/employment/take-an-exam.page

NOTE: To review the latest plan, make sure to filter the "Report Year" column to the latest year.

Data on public websites maintained by or on behalf of the city agencies.

NOTE: To review the latest plan, make sure to filter the "Report Year" column to the latest year. This dataset lists all datasets reported by agencies in their Annual Compliance plans for release on NYC Open Data. For the latest status, please refer to the NYC Open Data Release Tracker.

This dataset compiles a comprehensive database containing 90,327 street segments in New York City, covering their street design features, streetscape design, Vision Zero treatments, and neighborhood land use. It has two scales-street and street segment group (aggregation of same type of street at neighborhood). This dataset is derived based on all publicly available data, most from NYC Open Data. The detailed methods can be found in the published paper, Pedestrian and Car Occupant Crash Casualties Over a 9-Year Span of Vision Zero in New York City. To use it, please refer to the metadata file for more information and cite our work. A full list of raw data source can be found below:

Motor Vehicle Collisions – NYC Open Data: https://data.cityofnewyork.us/Public-Safety/Motor-Vehicle-Collisions-Crashes/h9gi-nx95

Citywide Street Centerline (CSCL) – NYC Open Data: https://data.cityofnewyork.us/City-Government/NYC-Street-Centerline-CSCL-/exjm-f27b

NYC Building Footprints – NYC Open Data: https://data.cityofnewyork.us/Housing-Development/Building-Footprints/nqwf-w8eh

Practical Canopy for New York City: https://zenodo.org/record/6547492

New York City Bike Routes – NYC Open Data: https://data.cityofnewyork.us/Transportation/New-York-City-Bike-Routes/7vsa-caz7

Sidewalk Widths NYC (originally from Sidewalk – NYC Open Data): https://www.sidewalkwidths.nyc/

LION Single Line Street Base Map - The NYC Department of City Planning (DCP): https://www.nyc.gov/site/planning/data-maps/open-data/dwn-lion.page

NYC Planimetric Database Median – NYC Open Data: https://data.cityofnewyork.us/Transportation/NYC-Planimetrics/wt4d-p43d

NYC Vision Zero Open Data (including multiple datasets including all the implementations): https://www.nyc.gov/content/visionzero/pages/open-data

NYS Traffic Data - New York State Department of Transportation Open Data: https://data.ny.gov/Transportation/NYS-Traffic-Data-Viewer/7wmy-q6mb

Smart Location Database - US Environmental Protection Agency: https://www.epa.gov/smartgrowth/smart-location-mapping

Race and ethnicity in area - American Community Survey (ACS): https://www.census.gov/programs-surveys/acs

gradio/NYC-Airbnb-Open-Data dataset hosted on Hugging Face and contributed by the HF Datasets community

All 311 Service Requests from 2010 to present. This information is automatically updated daily.

NOTE: To review the latest plan, make sure to filter the "Report Year" column to the latest year.

This dataset includes various FOIL reporting metrics as part of the NYC Open Data Compliance Plan.

This is the current version of the Open Data Handbook.

Context

These datasets were added to empower people to explore what are the housing complaints that affect New York the most. I added PLUTO data to enrich the set with building features and characteristics.

Content

The data was acquired from opendata and filtered for only HPD, PLUTO adds information about building features and is divided by boroughs.

Acknowledgements

Al the pictures from the banner are by Photo by Colton Duke on Unsplash

Inspiration

I would love to see what you find to be the most abundant complaints and if you could predict which ones will keep increasing in the future.

NOTE: To review the latest plan, make sure to filter the "Report Year" column to the latest year. This dataset lists the plan entries that were removed from publishing.

Details of Motor Vehicle Collisions in New York City provided by the Police Department (NYPD).

NOTE: To review the latest plan, make sure to filter the "Report Year" column to the latest year. This is a list of civic engagement activities reported by city agencies for the purpose of providing context, spreading awareness, and increasing the use of public data. Details include activity descriptions, date of completion and links to further information on the reported activity. For the historical 2018-2022 data please refer to https://data.cityofnewyork.us/d/keb3-v9xt/

A schedule of datasets that New York City agencies will make available on nyc.gov/data

Community Districts are mandated by the city charter to review and monitor quality of life issues for New York City neighborhoods.This dataset is sourced from the DCP_GIS Open Data Group:Original Source: https://www.arcgis.com/home/item.html?id=436c404eb5434240841488827c9167b8

Civic engagement activities agencies completed between September 15 and April 30 for the 2020-2022 reports. The latest data is available at https://data.cityofnewyork.us/d/9hhx-gjf8