A log of dataset alerts open, monitored or resolved on the open data portal. Alerts can include issues as well as deprecation or discontinuation notices.

Context

DataSF seeks to transform the way that the City of San Francisco works -- through the use of data.

https://datasf.org/about/

Content

This dataset contains the following tables: ['311_service_requests', 'bikeshare_stations', 'bikeshare_status', 'bikeshare_trips', 'film_locations', 'sffd_service_calls', 'sfpd_incidents', 'street_trees']

• This data includes all San Francisco 311 service requests from July 2008 to the present, and is updated daily. 311 is a non-emergency number that provides access to non-emergency municipal services.
• This data includes fire unit responses to calls from April 2000 to present and is updated daily. Data contains the call number, incident number, address, unit identifier, call type, and disposition. Relevant time intervals are also included. Because this dataset is based on responses, and most calls involved multiple fire units, there are multiple records for each call number. Addresses are associated with a block number, intersection or call box.
• This data includes incidents from the San Francisco Police Department (SFPD) Crime Incident Reporting system, from January 2003 until the present (2 weeks ago from current date). The dataset is updated daily. Please note: the SFPD has implemented a new system for tracking crime. This dataset is still sourced from the old system, which is in the process of being retired (a multi-year process).
• This data includes a list of San Francisco Department of Public Works maintained street trees including: planting date, species, and location. Data includes 1955 to present.

This dataset is deprecated and not being updated.

Fork this kernel to get started with this dataset.

Acknowledgements

http://datasf.org/

• https://cloud.google.com/bigquery/public-data/sfo-311
• https://cloud.google.com/bigquery/public-data/sffd-service-calls
• https://cloud.google.com/bigquery/public-data/sfpd-reports
• https://cloud.google.com/bigquery/public-data/sfo-trees

Dataset Source: SF OpenData. This dataset is publicly available for anyone to use under the following terms provided by the Dataset Source - http://sfgov.org/ - and is provided "AS IS" without any warranty, express or implied, from Google. Google disclaims all liability for any damages, direct or indirect, resulting from the use of the dataset.

Banner Photo by @meric from Unplash.

Inspiration

Which neighborhoods have the highest proportion of offensive graffiti?

Which complaint is most likely to be made using Twitter and in which neighborhood?

What are the most complained about Muni stops in San Francisco?

What are the top 10 incident types that the San Francisco Fire Department responds to?

How many medical incidents and structure fires are there in each neighborhood?

What’s the average response time for each type of dispatched vehicle?

Which category of police incidents have historically been the most common in San Francisco?

What were the most common police incidents in the category of LARCENY/THEFT in 2016?

Which non-criminal incidents saw the biggest reporting change from 2015 to 2016?

What is the average tree diameter?

What is the highest number of a particular species of tree planted in a single year?

Which San Francisco locations feature the largest number of trees?

Search and browse hundreds of datasets from the City and County of San Francisco

A. SUMMARY This dataset is used to report on public dataset access and usage within the open data portal. Each row sums the amount of users who access a dataset each day, grouped by access type (API Read, Download, Page View, etc).

B. HOW THE DATASET IS CREATED This dataset is created by joining two internal analytics datasets generated by the SF Open Data Portal. We remove non-public information during the process.

C. UPDATE PROCESS This dataset is scheduled to update every 7 days via ETL.

D. HOW TO USE THIS DATASET This dataset can help you identify stale datasets, highlight the most popular datasets and calculate other metrics around the performance and usage in the open data portal.

Please note a special call-out for two fields: - "derived": This field shows if an asset is an original source (derived = "False") or if it is made from another asset though filtering (derived = "True"). Essentially, if it is derived from another source or not. - "provenance": This field shows if an asset is "official" (created by someone in the city of San Francisco) or "community" (created by a member of the community, not official). All community assets are derived as members of the community cannot add data to the open data portal.

The dataset inventory provides a list of data maintained by departments that are candidates for open data publishing or have already been published and is collected in accordance with Chapter 22D of the Administrative Code. The inventory will be used in conjunction with department publishing plans to track progress toward meeting plan goals for each department. These plans will be made available early in the summer 2015.

Content

This dataset includes the locations of businesses that pay taxes to the City and County of San Francisco. Each registered business may have multiple locations and each location is a single row. The Treasurer & Tax Collector’s Office collects this data through business registration applications, account update/closure forms, and taxpayer filings. The data is collected to help enforce the Business and Tax Regulations Code including, but not limited to: Article 6, Article 12, Article 12-A, and Article 12-A-1. http://sftreasurer.org/registration

Context

This is a dataset hosted by the city of San Francisco. The organization has an open data platform found here and they update their information according the amount of data that is brought in. Explore San Francisco's Data using Kaggle and all of the data sources available through the San Francisco organization page!

• Update Frequency: This dataset is updated weekly.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Cover photo by Rezaul Karim on Unsplash
Unsplash Images are distributed under a unique Unsplash License.

Content

More details about each file are in the individual file descriptions.

Context

This is a dataset hosted by the city of San Francisco. The organization has an open data platform found here and they update their information according the amount of data that is brought in. Explore San Francisco's Data using Kaggle and all of the data sources available through the San Francisco organization page!

• Update Frequency: This dataset is updated daily.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Cover photo by Emanuel Haas on Unsplash
Unsplash Images are distributed under a unique Unsplash License.

This dataset is distributed under the following licenses: Open Data Commons Public Domain Dedication and License

City-owned and leased facilities maintained in the City's Facility System of Record (FSR). Does not include the following agencies which are not part of the City and County of San Francisco: SFHA, OCII and City College. This dataset was developed through a process involving some of the primary stewards for the facility data and their stakeholders. It is meant to be a living reference and will be maintained and updated through established workflows and processes over time. You can access the attached User Guide for more detail by clicking the red About button and scrolling to attachments.

Roadways (streets and highways) for the San Francisco Bay Region. Feature set was assembled using all roads county-based 2021 TIGER/Line shapefiles by the Metropolitan Transportation Commission.The All Roads shapefiles includes all features within the Census Bureau's Master Address File/Topologically Integrated Geographic Encoding and Referencing (MAF/TIGER) Database (MTDB) Super Class "Road/Path Features" distinguished where the MAF/TIGER Feature Classification Code for the feature in MTDB that begins with "S". This includes all primary, secondary, local neighborhood, and rural roads, city streets, vehicular trails (4wd), ramps, service drives, alleys, parking lot roads, private roads for service vehicles (logging, oil fields, ranches, etc.), bike paths or trails, bridle/horse paths, walkways/pedestrian trails, stairways, and winter trails.The feature set contains multiple overlapping road segments where a segment is associated with more than one road feature. For example, if a road segment is associated with US Route 36 and State Highway 7 and 28th Street, the route will contain three spatially coincident segments, each with a different name. The roadway feature set contains the set of unique road segments for each county, along with other linear features.Primary roads are generally divided limited-access highways within the Federal interstate highway system or under state management. Interchanges and ramps distinguish these roads, and some are toll highways.Secondary roads are main arteries, usually in the U.S. highway, state highway, or county highway system. These roads have one or more lanes of traffic in each direction, may or may not be divided, and usually have at-grade intersections with many other roads and driveways. They often have both a local name and a route number.

Mobile Food Facility Permits including name of vendor, location, type of food sold and status of permit. Mobile Food Facility Permit Schedule is here https://data.sfgov.org/d/jjew-r69b

Consolidated Infant, Pre-K, and K-14 education points for facilities both public and private.

Point features are intended to be located within a building footprint relevant to each site, so that they can be used to select an appropriate building footprint or parcel as seed for any required buffering.

Buffering may be applied when limiting possible sites for certain businesses or specific individuals, whenever these must remain a minimum distance from school locations.

Sources include: cde.ca.gov State of California Department of Education City and County Department of Technology, San Francisco Enterprise Geographic Information System Program

Data current as of December 8, 2015

Note: Due to the large file size the Shapefile export option does not work. To access geospatial data please select GeoJSON from the export menu

This data set includes the Office of the Assessor-Recorder’s secured property tax roll spanning from July 1, 2007 to June 30, 2024. It includes all legally disclosable information, including location of property, value of property, the unique property identifier, and specific property characteristics. The data is used to accurately and fairly appraise all taxable property in the City and County of San Francisco. The Office of the Assessor-Recorder makes no representation or warranty that the information provided is accurate and/or has no errors or omissions.

This dataset is updated annually after the roll is closed and certified. This typically happens by August of each year.

This part of DS 781 presents data for the bathymetry map of the Offshore of San Francisco, California, map area. The raster data file is included in "Bathymetry_OffshoreSanFrancisco.zip," which is accessible from https://pubs.usgs.gov/ds/781/OffshoreSanFrancisco/data_catalog_OffshoreSanFrancisco.html. These data accompany the pamphlet and map sheets of Cochrane, G.R., Johnson, S.Y., Dartnell, P., Greene, H.G., Erdey, M.D., Golden, N.E., Hartwell, S.R., Endris, C.A., Manson, M.W., Sliter, R.W., Kvitek, R.G., Watt, J.T., Ross, S.L., and Bruns, T.R. (G.R. Cochrane and S.A. Cochran, eds.), 2015, California State Waters Map Series—Offshore of San Francisco, California (ver. 1.1, June 2015): U.S. Geological Survey Open-File Report 2015–1068, pamphlet 39 p., 10 sheets, scale 1:24,000, https://dx.doi.org/10.3133/ofr20151068. The bathymetry map of Offshore of San Francisco, California, was generated from bathymetry data collected by Fugro Pelagos, and by California State University, Monterey Bay (CSUMB). Mapping was completed between 2004 and 2008, using a combination of 400-kHz Reson 7125 and 244-kHz Reson 8101 multibeam echosounders. These mapping missions combined to collect bathymetry (sheets 1, 2) from about the 10-m isobath to beyond the 3-nautical-mile limit of California's State Waters. A large portion of this map area was re-mapped in 2009, however the older bathymetry data were used in this map due to co-registered, acoustic backscatter data. NOTE: the horizontal datum of the bathymetry data (NAD83) differs from the horizontal datum of other layers in this SIM (WGS84). Some bathymetry grids within this map were projected horizontally from WGS84 to NAD83 using ESRI tools to be more consistent with the vertical reference of the North American Vertical Datum of 1988 (NAVD88). These data are not intended for navigational purposes.

Content

More details about each file are in the individual file descriptions.

Context

This is a dataset hosted by the city of San Francisco. The organization has an open data platform found here and they update their information according the amount of data that is brought in. Explore San Francisco's Data using Kaggle and all of the data sources available through the San Francisco organization page!

• Update Frequency: This dataset is updated annually.

Acknowledgements

This dataset is maintained using Socrata's API and Kaggle's API. Socrata has assisted countless organizations with hosting their open data and has been an integral part of the process of bringing more data to the public.

Cover photo by Sharon McCutcheon on Unsplash
Unsplash Images are distributed under a unique Unsplash License.

This dataset is distributed under the following licenses: Open Data Commons Public Domain Dedication and License

Departments collect and submit this data to the Controller's Office via the Budget and Performance Measurement System (BPMS). This data is collected to display on the City Performance Scorecard website, a site that provides timely performance information to the public and policy makers by major service area.

The City Survey asks residents to indicate their usage and satisfaction with city services and infrastructure like libraries, Muni, public safety, and street cleanliness. The City Survey was conducted every year from 1996 to 2004, and biennially from 2005 onward. The City Survey was not conducted in 2019 due to the COVID-19 pandemic, and resumed in 2023. Survey methodology was changed in 2015 from a mail to a phone survey, and expanded to include in-person and online options in 2023. Comparisons to previous years should be interpreted with caution. Results should be weighted using the column "weight" in order to adjust for demographic differences between the City Survey sample and San Francisco's population. Please note that survey results were originally reported as unweighted until 1997. From 1997 onward, all City Survey results were reweighted with the exception of data from 2011. For ease of use, the column "weight" has been coded with a value of one for these years. A code book is also attached to this dataset under About > Attachments. Neighborhood and Zip Code data have been hidden from this data set and are only available upon special request to citysurvey@sfgov.org. For more information regarding San Francisco City Survey 1996-2023 Database, please visit the City Survey website at https://sf.gov/citysurvey or contact the San Francisco Controller's Office at citysurvey@sfgov.org.

This part of DS 781 presents data for the shaded-relief bathymetry map of the Offshore of San Francisco, California, map area. The raster data file is included in "BathymetryHS_OffshoreSanFrancisco.zip," which is accessible from https://pubs.usgs.gov/ds/781/OffshoreSanFrancisco/data_catalog_OffshoreSanFrancisco.html. These data accompany the pamphlet and map sheets of Cochrane, G.R., Johnson, S.Y., Dartnell, P., Greene, H.G., Erdey, M.D., Golden, N.E., Hartwell, S.R., Endris, C.A., Manson, M.W., Sliter, R.W., Kvitek, R.G., Watt, J.T., Ross, S.L., and Bruns, T.R. (G.R. Cochrane and S.A. Cochran, eds.), 2015, California State Waters Map Series—Offshore of San Francisco, California (ver. 1.1, June 2015): U.S. Geological Survey Open-File Report 2015–1068, pamphlet 39 p., 10 sheets, scale 1:24,000, https://dx.doi.org/10.3133/ofr20151068. The shaded-relief bathymetry map of Offshore of San Francisco, California, was generated from bathymetry data collected by Fugro Pelagos, and by California State University, Monterey Bay (CSUMB). Mapping was completed between 2004 and 2008, using a combination of 400-kHz Reson 7125 and 244-kHz Reson 8101 multibeam echosounders. These mapping missions combined to collect bathymetry (sheets 1, 2) from about the 10-m isobath to beyond the 3-nautical-mile limit of California's State Waters. A large portion of this map area was re-mapped in 2009, however the older bathymetry data were used in this map due to co-registered, acoustic backscatter data.

Superseded

https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4-1## A more recent version of this product appears here:

This product will continue to be distributed for archival purposes.

Domain and Product

Changes in the current bathymetry release (version 4) are limited to the region east of the Carquinez Strait (starting around Carquinez Bridge). To facilitate compatibility released by us and our partners, DWR distribute the region west as a separate companion tile and delineate the boundary of active revision in the present product in a place where its source data matches that of other Bay elevation models, e.g., the 2m seamless high-resolution bathymetric and topographic DEM of San Francisco Bay by USGS Earth Resources Observation and Science Center (EROS) (https://topotools.cr.usgs.gov/coned/sanfrancisco.php ), the 2010 San Francisco Bay DEM by National Oceanic and Atmospheric Administration (https://www.ngdc.noaa.gov/metaview/page?xml=NOAA/NESDIS/NGDC/MGG/DEM/iso/xml/741.xml&view=getDataView&header=none ) or the prior (version 3) 10m digital elevation model (https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-v3 ).The 10m DEM for the Bay-Delta is based on the first on the list, i.e. EROS’ 2m DEM for the Bay

New work reported here was done at 2m resolution, although the improvements have been incorporated into the 10m products as much as possible. Relative to the previous DWR release (https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-v3), the 2m DEM product reported here consolidates work at this resolution into a small number of larger surfaces representing approximately one-third of the Delta (link to the Coverage Areas page). Laterally, the 2m models now extend over the levee crest as needed to match well with Delta LiDAR (http://www.atlas.ca.gov/download.html#/casil/imageryBaseMapsLandCover/lidar2009 ), the main terrestrial source of data used in this work. The 10m product (link to the Coverage Areas page) is based on the updated USGS DEM (https://www.sciencebase.gov/catalog/item/58599681e4b01224f329b484 ). In places where updated 2m models overlap the 10 meters, the 10m base elevation model was updated by resampling the new 2m model and adding levee enforcement. At the border between the 2m and 10m models, the two resolutions were locally edge-matched over a small region to maintain smoothness. For more information, please refer to the article: A Revised Continuous Surface Elevation Model for Modeling (link to Chapter 5 in the 2018 Annual Report).

Please note that by agreement with our data providers we distribute only our own integrated maps, not the original source point data.

Data Sources

https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4/resource/981a57b5-e16f-4632-b7e0-4a533534a79c

Coverage Areas

https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4/resource/2e3f2b6e-9f0d-4719-b32a-dff449be18af

A. SUMMARY This data is an annual snapshot of existing land use as of March of the indicated year for every parcel in the City and County of San Francisco. This year's 2023 data was produced from the Land Use 2020, updated for residential properties using the Planning Department's permit database and current 2023 Assessor-Recorder data. The commercial data was not updated; the commercial data will be updated in next year's 2024 release. Each row of data corresponds to a parcel with 16 columns (fields or attributes) of information about each parcel, as described below. B. HOW THE DATASET IS CREATED The dataset is assembled from a range of City and commercial databases, including Assessor’s office and Dun & Bradstreet for commercial land uses. C. UPDATE PROCESS A new dataset will be added annually without updating previous years’ data. D. HOW TO USE THIS DATASET Review this document to understand the data (fields and their categories): Land Use Database 2023 Summary Limitations: Although every attempt is made to provide accurate data, the volume of data and parcels does not allow the Department to guarantee accuracy. Should errors be found, or questions arise, please email rebecca.latto@sfgov.org. E. RELATED DATASETS San Francisco Land Use - 2020

This product is superseded by version 4.2. See: https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4-2

Citation and Main Description:

This product is described in Chapter 5 of the 2018 DWR Delta Modeling Section annual report, produced jointly with USGS.

https://water.ca.gov/-/media/DWR-Website/Web-Pages/Library/Modeling-And-Analysis/Files/Modeling-and-Analysis-PDFs/FINAL6BayDelta39thProgress-Report071918.pdf

Domain and Product

Changes between 4.0 and 4.1 are documented in the change log below and are most pronounced in the Suisun Marsh region and in the incorporation of some improvements in the South Delta.

Changes in version 4 relative to prior products are limited to the region east of the Carquinez Strait (starting around Carquinez Bridge). To facilitate compatibility between products released by DWR and USGS/NOAA partners, DWR distributes the region west of the active work at 10m resolution but does not actively work in this region. The San Pablo Bay boundary of active revision in the present product in a place where its source data matches that of other Bay elevation models, e.g., the 2m seamless high-resolution bathymetric and topographic DEM of San Francisco Bay by USGS Earth Resources Observation and Science Center (EROS) (https://topotools.cr.usgs.gov/coned/sanfrancisco.php ), the 2010 San Francisco Bay DEM by National Oceanic and Atmospheric Administration (https://www.ngdc.noaa.gov/metaview/page?xml=NOAA/NESDIS/NGDC/MGG/DEM/iso/xml/741.xml&view=getDataView&header=none ) or the prior (version 3) 10m digital elevation model (https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-v3 ).The 10m DEM for the Bay-Delta is based on the first on the list, i.e. EROS’ 2m DEM for the Bay

New work reported here was done at 2m resolution, although the improvements have been incorporated into the 10m products as much as possible. Relative to the previous DWR release (https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-v3), the 2m DEM product reported here consolidates work at this resolution into a small number of larger surfaces representing approximately one-third of the Delta (link to the Coverage Areas page). Laterally, the 2m models now extend over the levee crest as needed to match well with Delta LiDAR (http://www.atlas.ca.gov/download.html#/casil/imageryBaseMapsLandCover/lidar2009 ), the main terrestrial source of data used in this work. The 10m product (link to the Coverage Areas page) is based on the updated USGS DEM (https://www.sciencebase.gov/catalog/item/58599681e4b01224f329b484 ). In places where updated 2m models overlap the 10 meters, the 10m base elevation model was updated by resampling the new 2m model and adding levee enforcement. At the border between the 2m and 10m models, the two resolutions were locally edge-matched over a small region to maintain smoothness. For more information, please refer to the report: A Revised Continuous Surface Elevation Model for Modeling (link to Chapter 5 in the 2018 Delta Modeling Section Annual Report (https://water.ca.gov/-/media/DWR-Website/Web-Pages/Library/Modeling-And-Analysis/Files/Modeling-and-Analysis-PDFs/FINAL6BayDelta39thProgress-Report071918.pdf). Please note that by agreement with our data providers we distribute only our own integrated maps, not the original source point data. (https://water.ca.gov/-/media/DWR-Website/Web-Pages/Library/Modeling-And-Analysis/Files/Modeling-and-Analysis-PDFs/FINAL6BayDelta39thProgress-Report071918.pdf

Version: 4.1

• Time Completed: December 2018
• Horizontal Datum: NAD83
• Spheroid:GRS1980
• Projection:UTM_Zone_10N (meters)
• Vertical Datum:NAVD88 (meters)

Data Sources

https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4/resource/981a57b5-e16f-4632-b7e0-4a533534a79c

Coverage Areas

https://data.cnra.ca.gov/dataset/san-francisco-bay-and-sacramento-san-joaquin-delta-dem-for-modeling-version-4/resource/2e3f2b6e-9f0d-4719-b32a-dff449be18af

Changes since 4.0

• correct the year of survey for COE single-beam (OBJECTID 25) from 1988 to 1988
• update 2m DEM for Montezuma Slough based on newly connected multibean data by NCRO (August 2018 for Montezuma Slough and Hunter Cut)
• cut the portion of DEM for Calaveras from v3 2m San Joaquin River (dem_calaveras_river_2m_20120902
• Changes only occurs in part 1 of "dem_north_delta_2m_v4_20171220" (v4 final): 1.apply patch at the intersection of Sacramento River and Feather River; 2.add Fremont Weir from the 2m Yolo DEM
• The following modifications are applied to "dem_yolo_merge3_mod_20161202" (v4 final; D:\dem_list_review\yolo_bypass):
• Improved merge with Sacramento River on the north:
• Improved merge with 2m Shag/Stairstep dem (dem_shag_stairstep_toe_drain_2m_v4_beta_20150518.tif ) which goes beyond multibeam data, derived based on mixed single-beam datasets using GAM
• Improved patching and compatibility with USGS 10m release
• Create 2m DEM for the Old River between SWP/CVP to Five points based on new bathymetry data collected in June 2018
• Add the newly developed 2m Montazuma Slough DEM as part of v4 release. Update 10m Delta DEM to be consistent with this addition and update data source polygon accordingly.
• Create 2m DEM for the Old River near Coney Island based on new bathymetry data collected in June 2018
• Incorporate modifications done for Yolo and North Delta into 10m DEM for Delta and Bay-Delta.
• The 20181120 version of the 2m South Delta DEM missed a small region that is included in the old version
• Add LiDAR to Shag Slough in 2m Yolo DEM (dem_yolo_2m_20181012), The existing DEM for Shag Slough did not extend sufficiently over banks.