Crime incident reports are provided by Boston Police Department (BPD) to document the initial details surrounding an incident to which BPD officers respond. This is a dataset containing records from the new crime incident report system, which includes a reduced set of fields focused on capturing the type of incident as well as when and where it occurred. Records in the new system begin in June of 2015.

The Analyze Boston Data Exports posted now are the updated incident data from the Mark43 RMS Database which launched in September of 2019 and is complete through present with the exclusion of data that falls under MGL ch.41 s.98f. The 2019 data that was originally posted contained combined exports from the Intergraph RMS and the Mark43 RMS during 2019 but the Extract/Transfer/Load process was not updated during the transition.

Context

In 1975, the United States set a new record with 240,593 prisoners incarcerated by state or federal agencies. The United States achieved new record totals during each of the next 34 years. Today, there are over 1,500,000 prisoners in the United States. Over one quarter of the world's entire population of prisoners is located in the United States.

The U.S. Education deparment reports state and local government expenditures on prisons (and jails - not reflected in this dataset) have increased about three times as fast as spending on elementary and secondary education during this time period. Does this significant investment into imprisonment improve public safety? This dataset brings together crime and incarceration statistics to help researchers explore this relationship.

Content

The Bureau of Justice Statistics administers the National Prisoners Statistics Program (NPS), an annual data collection effort that began in response to a 1926 congressional mandate. The population statistics reflect each state's prisoner population as of December 31 for the recorded year. Prisoners listed under federal jurisdiction are incarcerated by the U.S. Bureau of Prisons.

The Uniform Crime Report (UCR) has served as the FBI's primary national data collection tool since a 1930 congressional mandate directed the Attorney General to "acquire, collect, classify, and preserve identification, criminal identification, crime, and other records." The FBI collects this information voluntarily submitted by local, state, and fedral law enforcement agencies. Some U.S. municipalities choose not to participate fully in the program. The crimes_estimated field indicates cases where the FBI estimated state totals due to lack of participation by some municipalities within a state. The crime_reporting_change field reflects instances when states' reporting standards change. For more information on the responsible use of this dataset, please see Uniform Crime Reporting Statistics: Their Proper Use

Acknowledgements

State and Federal prisoner population figures published by Bureau of Justice Statistics.

State crime and population statistics published by the FBI Uniform Crime Reporting (UCR) Program. https://www.ucrdatatool.gov/Search/Crime/State/RunCrimeStatebyState.cfm

Banner Photo by Oscar Söderlund on Unsplash

Inspiration

What is the relationship between incarceration rates and crime rates? Does mass incarceration improve public safety? See below for some recent statements from U.S. politicians related to the relationship between crime and incarceration. Are the data consistent with any of these statements?

"There is no better way to reduce crime than to identify, target, and incapacitate those hardened criminals... we cannot incapacitate these criminals unless we build sufficient prison and jail space to house them. " - Nominee for 85th U.S. Attorney General William Barr, [October 28, 1992][13]

"Violent crime has declined since the 1980s because mandatory minimums adopted then locked up violent criminals." - Senator Tom Cotton, August 15, 2018

"You may assume mass incarceration exists because people are committing more crimes. But that is not true... The incredibly costly reality is that prisons in our nation continue to grow irrespective of crime rates. It is a bureaucracy that has been expanding independent of our security or safety." - Senator Cory Booker, Apr 28, 2015

"It is far from clear whether this dramatic increase in incarceration for drug crimes has had enough of an effect on property and violent crime rates to justify the human toll of more incarceration." - Senator Ted Cruz, Apr 27, 2015

"For several decades, tough laws and long sentences have created the illusion that public safety is best served when we treat all offenders the same way: arrest, convict, incarcerate..." - Senator Kamala Harris, [Apr 27, 2015][11]

"We've got some space to put some people! We need to reverse a trend that suggested that criminals won't be confronted seriously with their crimes" - 84th U.S. Attorney General Jeff Sessions, [March 15, 2018][12]

...

The FIO program encompasses a wide range of interactions between the Boston Police Department (BPD) and private individuals. By releasing the records of these interactions, BPD hopes to add transparency to the execution of the program while still protecting the privacy of the individuals involved. These records are now sourced from three different record management systems titled: (OLD RMS) (NEW RMS) and (MARK43). The differences between the resulting files are described below.

About the FIO Records (Mark43) Files (Sept 29 2023 - Dec 31 2024)

These records are compiled from the BPD’s new Records Management System (RMS) on the BPD's FIO program. MARK43 went live September 29, 2019 and the FIO information has been structured into two separate tables. These tables are the same titles as (NEW RMS) but include new or different data points as retrieved from MARK43.

• FieldContact, which lists each contact between BPD and one or more individuals
• FieldContact_Name, which lists each individual involved in these contacts.

A FIO Data Key has also been created and posted to help distinguish the data categories (Data Key (Mark43)).

Lastly, FIOs are maintained in a live database and information related to each individual may change overtime. The data provided here should be considered a static representation of the Field Interaction and/or Observation that occurred in 2019.

NULL indicates no entry was made for an optional field.

About the FIO Records 2015 (New RMS) and 2016, 2017, 2018, 2019, and 2020 (Jan 1 - Sept 29 2020) Files

These records are compiled from the BPD’s new Records Management System (RMS) on the BPD's FIO program. The new RMS, which went live in June, 2015, structures the FIO information into two separate tables:

• FieldContact, which lists each contact between BPD and one or more individuals
• FieldContact_Name, which lists each individual involved in these contacts

While these two tables align on the field contact number (fc_num) column, it is not methodologically correct to join the two datasets for the purpose of generating aggregate statistics on columns from the FieldContact table. Doing so would lead to incorrect estimates stemming from contacts with multiple individuals. As noted in the Data Key (New RMS) file, several of the columns in the FieldContact table apply to the contact as a whole, but may not necessarily apply to each individual involved in the contact. These include:

• frisked
• searchperson
• summonsissued
• circumstances
• basis
• contact_reason

For example, the frisked column contains a value of Y if any of the individuals involved in a contact were frisked, but it would be inaccurate to assume that all individuals were frisked during that contact. As such, extrapolating from the frisked column for a contact to each individual and then summing across them would give an artificially high estimate of the number of people frisked in total. Likewise, the summonsissued column indicates when someone involved in a contact was issued a summons, but this does not imply that everyone involved in a contact was issued a summons.

For a detailed listing of columns in each table, see both tables of the Data Key (New RMS) file below.

About the FIO Records 2011 - 2015 (Old RMS) File

These records are sourced from BPD's older RMS, which was retired in June, 2015. This system (which stored all records in a single table, rather than the two tables in the newer system) captures similar information to the new RMS, but users should note that the fields are not identical and exercise care when comparing or combining records from each system.

Additional Notes

• The data provided is FIO information entered into the new system from June, 2015 through December, 2016, which includes some interactions which occurred before June, 2015 which were entered after the transition from the old system. For comprehensive analyses of interactions prior to the introduction of the new RMS, users will need to include data on interactions prior to June, 2015 from the 2015 (New RMS) file.
• These files are extracted from live databases which may have records added or updated at any time. As such, the number and content of records shared here may differ slightly from versions used to produce analyses such as those linked below, due to subsequent revisions to the underlying database records.
• A contact can consist of an observation of a vehicle, without direct contact with a person. This would create a record where no person-level details are recorded.

For more information on the FIO Program, please visit:

Boston Police Commissioner Announces Field Interrogation and Observation (FIO) Study Results

Commissioner Evans Continues Efforts to Increase Transparency and Accountability of Policing Activities to the Public

Boston Police Department Releases Latest Field Interrogation Observation Data