The NYC Department of City Planning’s (DCP) Housing Database contains all NYC Department of Buildings (DOB) approved housing construction and demolition jobs filed or completed in NYC since January 1, 2010. It includes the three primary construction job types that add or remove residential units: new buildings, major alterations, and demolitions, and can be used to determine the change in legal housing units across time and space. Records in the Housing Database Project-Level Files are geocoded to the greatest level of precision possible, subject to numerous quality assurance and control checks, recoded for usability, and joined to other housing data sources relevant to city planners and analysts. Data are updated semiannually, at the end of the second and fourth quarters of each year. Please see DCP’s annual Housing Production Snapshot summarizing findings from the 21Q4 data release here. Additional Housing and Economic analyses are also available. The NYC Department of City Planning’s (DCP) Housing Database Unit Change Summary Files provide the net change in Class A housing units since 2010, and the count of units pending completion for commonly used political and statistical boundaries (Census Block, Census Tract, City Council district, Community District, Community District Tabulation Area (CDTA), Neighborhood Tabulation Area (NTA). These tables are aggregated from the DCP Housing Database Project-Level Files, which is derived from Department of Buildings (DOB) approved housing construction and demolition jobs filed or completed in NYC since January 1, 2010. Net housing unit change is calculated as the sum of all three construction job types that add or remove residential units: new buildings, major alterations, and demolitions. These files can be used to determine the change in legal housing units across time and space.

Population Numbers By New York City Neighborhood Tabulation Areas The data was collected from Census Bureaus' Decennial data dissemination (SF1). Neighborhood Tabulation Areas (NTAs), are aggregations of census tracts that are subsets of New York City's 55 Public Use Microdata Areas (PUMAs). Primarily due to these constraints, NTA boundaries and their associated names may not definitively represent neighborhoods. This report shows change in population from 2000 to 2010 for each NTA. Compiled by the Population Division – New York City Department of City Planning.

New York City Population By Community Districts The data was collected from Census Bureaus' Decennial data dissemination (SF1) for the years 1970, 1980, 1990, 2000 and 2010. Compiled by the Population Division – New York City Department of City Planning

The purpose of this data package is to offer demographic data for U.S. cities. The data sources are multiple, the most important one being the U.S. Census Bureau, American Community Survey. In this case, the data was organized by the Big Cities Health Coalition (BCHC). Others are the New York City Department of City Planning and Department of Parks and Recreation, data being available through the NYC Open Data.

Table of Census Demographics represented at the NYC City Council district level

This dataset compiles a comprehensive database containing 90,327 street segments in New York City, covering their street design features, streetscape design, Vision Zero treatments, and neighborhood land use. It has two scales-street and street segment group (aggregation of same type of street at neighborhood). This dataset is derived based on all publicly available data, most from NYC Open Data. The detailed methods can be found in the published paper, Pedestrian and Car Occupant Crash Casualties Over a 9-Year Span of Vision Zero in New York City. To use it, please refer to the metadata file for more information and cite our work. A full list of raw data source can be found below:

Motor Vehicle Collisions – NYC Open Data: https://data.cityofnewyork.us/Public-Safety/Motor-Vehicle-Collisions-Crashes/h9gi-nx95

Citywide Street Centerline (CSCL) – NYC Open Data: https://data.cityofnewyork.us/City-Government/NYC-Street-Centerline-CSCL-/exjm-f27b

NYC Building Footprints – NYC Open Data: https://data.cityofnewyork.us/Housing-Development/Building-Footprints/nqwf-w8eh

Practical Canopy for New York City: https://zenodo.org/record/6547492

New York City Bike Routes – NYC Open Data: https://data.cityofnewyork.us/Transportation/New-York-City-Bike-Routes/7vsa-caz7

Sidewalk Widths NYC (originally from Sidewalk – NYC Open Data): https://www.sidewalkwidths.nyc/

LION Single Line Street Base Map - The NYC Department of City Planning (DCP): https://www.nyc.gov/site/planning/data-maps/open-data/dwn-lion.page

NYC Planimetric Database Median – NYC Open Data: https://data.cityofnewyork.us/Transportation/NYC-Planimetrics/wt4d-p43d

NYC Vision Zero Open Data (including multiple datasets including all the implementations): https://www.nyc.gov/content/visionzero/pages/open-data

NYS Traffic Data - New York State Department of Transportation Open Data: https://data.ny.gov/Transportation/NYS-Traffic-Data-Viewer/7wmy-q6mb

Smart Location Database - US Environmental Protection Agency: https://www.epa.gov/smartgrowth/smart-location-mapping

Race and ethnicity in area - American Community Survey (ACS): https://www.census.gov/programs-surveys/acs

Accession / Acquisition data details groups of records that are transferred from City agencies and donors through a records management disposition process. It typically includes the originating agency/donor and a general summary on the content, formats, and size of the collections. Information is also available at: https://a860-collectionguides.nyc.gov/

A single line street base map representing the city's streets and other linear geographic features, along with feature names and address ranges for each addressable street segment. This dataset includes the Nodes file. The Nodes file contains a point feature and unique NodeID for each node that exists in the LION file. The Node_StreetName.txt file lists the street names associated with those nodes. Most nodes, representing intersections, will have at least 2 street names associated in the Node_StreetName.txt file.

All previously released versions of this data are available on the DCP Website: BYTES of the BIG APPLE.

This dataset contains the employment forecast for New York City. Data is reported at the industry level (in units of thousands) and aggregated to total nonfarm and total private levels. Updates are posted twice per year.

Unadjusted decennial census data from 1950-2000 and projected figures from 2010-2040: summary table of New York City population numbers and percentage share by Borough, including school-age (5 to 17), 65 and Over, and total population.

Boundaries of New York City Council Districts. Based on the 2010 redistricting.

Context

NYC Open Data is an opportunity to engage New Yorkers in the information that is produced and used by City government. We believe that every New Yorker can benefit from Open Data, and Open Data can benefit from every New Yorker. Source: https://opendata.cityofnewyork.us/overview/

Content

Thanks to NYC Open Data, which makes public data generated by city agencies available for public use, and Citi Bike, we've incorporated over 150 GB of data in 5 open datasets into Google BigQuery Public Datasets, including:

• Over 8 million 311 service requests from 2012-2016

• More than 1 million motor vehicle collisions 2012-present

• Citi Bike stations and 30 million Citi Bike trips 2013-present

• Over 1 billion Yellow and Green Taxi rides from 2009-present

• Over 500,000 sidewalk trees surveyed decennially in 1995, 2005, and 2015

This dataset is deprecated and not being updated.

Fork this kernel to get started with this dataset.

Acknowledgements

https://opendata.cityofnewyork.us/

https://cloud.google.com/blog/big-data/2017/01/new-york-city-public-datasets-now-available-on-google-bigquery

This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source - https://data.cityofnewyork.us/ - and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

By accessing datasets and feeds available through NYC Open Data, the user agrees to all of the Terms of Use of NYC.gov as well as the Privacy Policy for NYC.gov. The user also agrees to any additional terms of use defined by the agencies, bureaus, and offices providing data. Public data sets made available on NYC Open Data are provided for informational purposes. The City does not warranty the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set made available on NYC Open Data, nor are any such warranties to be implied or inferred with respect to the public data sets furnished therein.

The City is not liable for any deficiencies in the completeness, accuracy, content, or fitness for any particular purpose or use of any public data set, or application utilizing such data set, provided by any third party.

Banner Photo by @bicadmedia from Unplash.

Inspiration

On which New York City streets are you most likely to find a loud party?

Can you find the Virginia Pines in New York City?

Where was the only collision caused by an animal that injured a cyclist?

What’s the Citi Bike record for the Longest Distance in the Shortest Time (on a route with at least 100 rides)?

https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png" alt="enter image description here"> https://cloud.google.com/blog/big-data/2017/01/images/148467900588042/nyc-dataset-6.png

This dataset contains seasonally adjusted employment data for New York City. Data is reported at the industry level (in units of thousands) and aggregated to total nonfarm and total private levels. Updates are posted after the not-seasonally-adjusted data is published by the NYS Department of Labor – typically monthly but with irregularities due to annual benchmark revisions.

Content

More details about each file are in the individual file descriptions.

Context

This is a dataset hosted by the City of New York. The city has an open data platform found here and they update their information according the amount of data that is brought in. Explore New York City using Kaggle and all of the data sources available through the City of New York organization page!

• Update Frequency: This dataset is updated quarterly.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Photo by Ricardo Gomez Angel on Unsplash

The Council has numerous standing committees that practice oversight of New York City functions, including human services, infrastructure, and government affairs. Each committee is headed by a Council Member (the Chair), includes at least five members, and meets at least once a month. In addition, the Council has several subcommittees, which are convened to review and make recommendations regarding topics of particular interest. After proposed legislation is heard by its appropriate Committee, it may be voted on and approved at that Committee. If the legislation is passed by Committee, is then sent to be considered by the whole Council. Council Members are assigned to committees through a process that the entire Council votes on. The NYC City Council Committee Membership dataset is drawn from the City Council's legislative API and updated weekly. Committee membership by City Council Members changes infrequently. This dataset includes committee membership starting Jan 1, 2018. Committee Descriptions: https://council.nyc.gov/committees/ Github: https://github.com/NewYorkCityCouncil/districts/tree/master/district_data/committees More info and API Key for Legislative API: https://council.nyc.gov/legislation/api/ Legislative API endpoints utilized for Committee Membership: 1)http://webapi.legistar.com/Help/Api/GET-v1-Client-Bodies https://webapi.legistar.com/v1/nyc/bodies/?token={}&$filter=(BodyTypeName+eq+'Committee'+or+BodyTypeName+eq+'Subcommittee'+or+BodyTypeName+eq+'Land Use')+and+BodyActiveFlag+eq+1 2)http://webapi.legistar.com/Help/Api/GET-v1-Client-Bodies-BodyId-OfficeRecords https://webapi.legistar.com/v1/nyc/bodies/{}/officerecords/?token={}&$filter=OfficeRecordStartDate+ge+datetime'{}'+and+OfficeRecordEndDate+eq+datetime'{}

This Excel workbook contains input and ouput variables for an index of gentrification for New York City census tracts based on changes from the year 2000 to 2016. The data are in one worksheet and a data dictionary is found in a separate worksheet.

The City Council Districts of New York City clipped to the shoreline at mean high tide. The City Council Districts are the result of the recent redistricting process, which takes place every ten years to reflect population changes reported in the 2000 Census. These geographies were redrawn by the New York City Council Redistricting Commission.

The weekly dataset contains regularly updated data on how the LinkNYC kiosks are being used, including numbers of users, number of Wi-Fi sessions, amount of data transmitted and other information. Data accuracy is limited as of the date of publication and by the methodology and accuracy of the original sources. The City shall not be liable for any costs related to, or in reliance of, the data contained in these datasets.

The New York City Department of Health and Mental Hygiene (NYC DOHMH) has shared vital statistics data (birth and mortality data) online. Birth data includes demographic information on the mother, including age, race, and education. Mortality data includes demographic information on the deceased, such as age, sex, race, and education. The publicly-available birth and death micro-SAS datasets provide aggregate data on the community district, zip code, and census tract levels. Researchers may also complete an application process to request line-listed and de-identified vital statistics data from NYC DOHMH.

Table of Census Demographics represented at the NTA level. NTAs are aggregations of census tracts that are subsets of New York City's 55 Public Use Micro data Areas (PUMAs)