Context

NYC Open Data is an opportunity to engage New Yorkers in the information that is produced and used by City government. We believe that every New Yorker can benefit from Open Data, and Open Data can benefit from every New Yorker. Source: https://opendata.cityofnewyork.us/overview/

Content

Thanks to NYC Open Data, which makes public data generated by city agencies available for public use, and Citi Bike, we've incorporated over 150 GB of data in 5 open datasets into Google BigQuery Public Datasets, including:

• Over 8 million 311 service requests from 2012-2016

• More than 1 million motor vehicle collisions 2012-present

• Citi Bike stations and 30 million Citi Bike trips 2013-present

• Over 1 billion Yellow and Green Taxi rides from 2009-present

• Over 500,000 sidewalk trees surveyed decennially in 1995, 2005, and 2015

This dataset is deprecated and not being updated.

Fork this kernel to get started with this dataset.

Acknowledgements

https://opendata.cityofnewyork.us/

https://cloud.google.com/blog/big-data/2017/01/new-york-city-public-datasets-now-available-on-google-bigquery

This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source - https://data.cityofnewyork.us/ - and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

By accessing datasets and feeds available through NYC Open Data, the user agrees to all of the Terms of Use of NYC.gov as well as the Privacy Policy for NYC.gov. The user also agrees to any additional terms of use defined by the agencies, bureaus, and offices providing data. Public data sets made available on NYC Open Data are provided for informational purposes. The City does not warranty the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set made available on NYC Open Data, nor are any such warranties to be implied or inferred with respect to the public data sets furnished therein.

The City is not liable for any deficiencies in the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set, or application utilizing such data set, provided by any third party.

Banner Photo by @bicadmedia from Unplash.

Inspiration

On which New York City streets are you most likely to find a loud party?

Can you find the Virginia Pines in New York City?

Where was the only collision caused by an animal that injured a cyclist?

What’s the Citi Bike record for the Longest Distance in the Shortest Time (on a route with at least 100 rides)?

https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png" alt="enter image description here"> https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png

The City Record Online (CROL) is a fully searchable database of notices published in the City Record newspaper, including, but not limited to: public hearings and meetings, public auctions and sales, solicitations and awards and official rules proposed and adopted by city agencies.

Population Numbers By New York City Neighborhood Tabulation Areas The data was collected from Census Bureaus' Decennial data dissemination (SF1). Neighborhood Tabulation Areas (NTAs), are aggregations of census tracts that are subsets of New York City's 55 Public Use Microdata Areas (PUMAs). Primarily due to these constraints, NTA boundaries and their associated names may not definitively represent neighborhoods. This report shows change in population from 2000 to 2010 for each NTA. Compiled by the Population Division – New York City Department of City Planning.

A Civil Service List consists of all candidates who passed an exam, ranked in score order. An established list is considered active for no less than one year and no more than four years from the date of establishment. For more information visit DCAS’ “Work for the City” webpage at: https://www1.nyc.gov/site/dcas/employment/take-an-exam.page

This dataset compiles a comprehensive database containing 90,327 street segments in New York City, covering their street design features, streetscape design, Vision Zero treatments, and neighborhood land use. It has two scales-street and street segment group (aggregation of same type of street at neighborhood). This dataset is derived based on all publicly available data, most from NYC Open Data. The detailed methods can be found in the published paper, Pedestrian and Car Occupant Crash Casualties Over a 9-Year Span of Vision Zero in New York City. To use it, please refer to the metadata file for more information and cite our work. A full list of raw data source can be found below:

Motor Vehicle Collisions – NYC Open Data: https://data.cityofnewyork.us/Public-Safety/Motor-Vehicle-Collisions-Crashes/h9gi-nx95

Citywide Street Centerline (CSCL) – NYC Open Data: https://data.cityofnewyork.us/City-Government/NYC-Street-Centerline-CSCL-/exjm-f27b

NYC Building Footprints – NYC Open Data: https://data.cityofnewyork.us/Housing-Development/Building-Footprints/nqwf-w8eh

Practical Canopy for New York City: https://zenodo.org/record/6547492

New York City Bike Routes – NYC Open Data: https://data.cityofnewyork.us/Transportation/New-York-City-Bike-Routes/7vsa-caz7

Sidewalk Widths NYC (originally from Sidewalk – NYC Open Data): https://www.sidewalkwidths.nyc/

LION Single Line Street Base Map - The NYC Department of City Planning (DCP): https://www.nyc.gov/site/planning/data-maps/open-data/dwn-lion.page

NYC Planimetric Database Median – NYC Open Data: https://data.cityofnewyork.us/Transportation/NYC-Planimetrics/wt4d-p43d

NYC Vision Zero Open Data (including multiple datasets including all the implementations): https://www.nyc.gov/content/visionzero/pages/open-data

NYS Traffic Data - New York State Department of Transportation Open Data: https://data.ny.gov/Transportation/NYS-Traffic-Data-Viewer/7wmy-q6mb

Smart Location Database - US Environmental Protection Agency: https://www.epa.gov/smartgrowth/smart-location-mapping

Race and ethnicity in area - American Community Survey (ACS): https://www.census.gov/programs-surveys/acs

Content

For up-to-date list of FHV bases, please visit this page

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

A brief history of water consumption in the New York City Water Supply System (Based on New York City Census population)

One of the most compelling trends in technology today is the open data and open governance movement. It's not without reason that no less than Tim Berners-Lee himself, the creator of the worldwide web and one of the most preeminent scholars of the Internet, is doing his latest work in getting more government data on the web: in an interview with The New York Times a few years ago he spoke to how even records as mundane as traffic statistics or weather data could drive tinkerers to "make government run better".

New York City has been at the forefront of this movement: mayor Bloomberg formalized a citywide analytics team as the Mayor's Office for Data Analytics in 2013, and the effort has continued under Mayor De Blasio, with the city cementing its first Open Data Plan in July 2015. The resultant NYC Open Data Portal is populated with over 1500 datasets. It was, and is, the largest citywide open data portal in the world.

Nevertheless, a good open data platform is more than a count; it's a function also of all of the maintenance and structure that goes into it. What's a "dataset", who's publishing them, and how well-maintained are they?

This dataset contains the publicly available metadata about the datasets in the NYC Open Data portal, provided in a JSON format.

For an initial exploration of its contents see this blog post.

Dataset

This dataset was created by Arthur de Andrade Almeida

Contents

DATA SOURCES:

1. ONLY state sources (city/county/state administration, federal agencies, ministries, etc.). We DO NOT use unverified databases
2. Over 2300 sources. We use even the smallest sources, because they contain valuable data. This allows us to provide our users with the most complete data

DATA RELEVANCE:

1. Our data is updated daily, weekly, monthly depending on the sources
2. We collect, process and store all data, regardless of their relevance. Historical data is also valuable

DATA TYPES:

1. Specifications
2. Owners
3. Permits
4. Sales
5. Inspections
6. Violations
7. Assessed values
8. Taxes
9. Risks
10. Foreclosures
11. Property Tax Liens
12. Deed Restrictions

NUMBERS:

1. 2300 data sources in total
2. 217 data sources in New York City
3. 4 billion records (listed in the "data types" block above) in total
4. 2 million new records every day

DATA USAGE:

1. Property check, investigation (even the smallest events are stored in our database)
2. Prospecting (more than 100 parameters to find the required records)
3. Tracking (our data allows us to track any changes)

Accession / Acquisition data details groups of records that are transferred from City agencies and donors through a records management disposition process. It typically includes the originating agency/donor and a general summary on the content, formats, and size of the collections. Information is also available at: https://a860-collectionguides.nyc.gov/

Digital objects are used to link born-digital or digitized content of archival collections. The data is collected from an archival management or archival preservation system. The data can be used to assess the extent of digitized content of archival collections. Digital Collections can also be accessed at https://a860-collectionguides.nyc.gov/.

Content

Web traffic statistics for the top 2000 most visited pages on nyc.gov by month.

Context

This is a dataset hosted by the City of New York. The city has an open data platform found here and they update their information according the amount of data that is brought in. Explore New York City using Kaggle and all of the data sources available through the City of New York organization page!

• Update Frequency: This dataset is updated quarterly.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Content

Locations of public recycling bins throughout NYC

Context

This is a dataset hosted by the City of New York. The city has an open data platform found here and they update their information according the amount of data that is brought in. Explore New York City using Kaggle and all of the data sources available through the City of New York organization page!

• Update Frequency: This dataset is updated monthly.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Content

Locations of voting/poll sites through the city.

Context

This is a dataset hosted by the City of New York. The city has an open data platform found here and they update their information according the amount of data that is brought in. Explore New York City using Kaggle and all of the data sources available through the City of New York organization page!

• Update Frequency: This dataset is updated quarterly.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Cover photo by Jon Tyson on Unsplash
Unsplash Images are distributed under a unique Unsplash License.

Historical dataset of population level and growth rate for the New York City metro area from 1950 to 2025.

The purpose of this data package is to offer demographic data for U.S. cities. The data sources are multiple, the most important one being the U.S. Census Bureau, American Community Survey. In this case, the data was organized by the Big Cities Health Coalition (BCHC). Others are the New York City Department of City Planning and Department of Parks and Recreation, data being available through the NYC Open Data.

Resources represent descriptions of collections and detail the Creators, dates, historical/biographical description, extent and formats available (boxes, folders, photographs, maps, volumes, digital objects, etc.). The data represents collections described at the collection level for improved accessibility. The data can be used to research and/or request collections available at the Municipal Archives. They can also be accessed at https://a860-collectionguides.nyc.gov/

Privately owned public spaces, also known by the acronym POPS, are outdoor and indoor spaces provided for public enjoyment by private owners in exchange for bonus floor area or waivers, an incentive first introduced into New York City's zoning regulations in 1961. To find out more about POPS, visit the Department of City Planning's website at http://nyc.gov/pops. This database contains detailed information about each privately owned public space in New York City.

Data Source: Privately Owned Public Space Database (2018), owned and maintained by the New York City Department of City Planning and created in collaboration with Jerold S. Kayden and The Municipal Art Society of New York. All previously released versions of this data are available on the DCP Website: BYTES of the BIG APPLE. Current version: 25v2

The dataset includes the names, employee sizes, asset sizes, business credit score, owner information, address, longitude and latitude, and census tract information for all businesses in New York City from 2010 to 2014. For nursing homes and hospitals, the dataset also categorizes capacity by the number of beds.