Data tables featured in National Center for Education Statistics publications.This encompasses roughly 8,500 tables. All of the tables have an estimate file, but not all tables have an associated standard error file. The file_directory.xlsx file has been included to help users locate specific files. The directory includes the name of the file and its associated table link, table name, and publication id. Additionally, the script used to retrieve these files and information have been included. Please note that not all estimate and standard error files are included. In these cases, the option to download the files on the DataLab website leads to an error.

About HS&BHS&B FeaturesNationally representative, longitudinal studies of 10th- and 12th- graders in 1980, and 9th-graders in 2022Follow-up surveys conducted throughout their postsecondary yearsSurveys of students, teachers, and parents of sampled studentsHigh school and postsecondary transcript data are provided to enhance analysesHS&B FocusWhat factors of the American educational system influence the educational and career outcomes of students?What are students' trajectories after leaving high school into postsecondary education, the workforce, and beyond?Data OrganizationEach table has an associated excel file, which is in a folder in the dataset (one folder per table).In the root folder, there is a catalog csv that provides a crosswalk between the folder names and file names and the original table titles.In addition to the tables, this project contains (1) codebooks for HS&B generated in NCES datalabs and found on the study website, (2) questionnaires for HS&B downloaded from the study website and (3) documentation related to HS&B found in the NCES resource library.

The Integrated Postsecondary Education Data System (IPEDS) is a system of interrelated surveys conducted annually by the U.S. Department of Education's National Center for Education Statistics (NCES). IPEDS annually gathers information from about 6,400 colleges, universities, and technical and vocational institutions that participate in the federal student aid programs. Access Database: To eliminate the step of downloading IPEDS separately by survey component or select variables, IPEDS has made available the entire survey data for one collection year in the Microsoft Access format beginning with the 2004-05 IPEDS data collection year. Each database contains the relational data tables as well as the metadata tables that describe each data table, the variable titles, descriptions and variables types. Value codes and value labels are also available for all categorical variables. When downloading an IPEDS Access Database, the file is compressed using WinZip.

The National Center for Education Statistics’ (NCES) Education Demographic and Geographic Estimate (EDGE) program develops annually updated point locations (latitude and longitude) for postsecondary institutions included in the NCES Integrated Postsecondary Education Data System (IPEDS). The IPEDS program annually collects information about enrollments, program completions, graduation rates, faculty and staff, finances, institutional prices, and student financial aid from every college, university, and technical and vocational institution that participates in federal student financial aid programs under the Higher Education Act of 1965 (as amended). The NCES EDGE program uses address information reported in the annually updated IPEDS directory file and collaborates with the U.S. Census Bureau’s Education Demographic, Geographic, and Economic Statistics (EDGE) Branch to develop point locations for all institutions reported in IPEDS. The point locations in this data layer represent the most current IPEDS collection available. Check the SURVYEAR attribute in the data table to determine file vintage. For more information about NCES school point data, see: https://nces.ed.gov/programs/edge/Geographic/SchoolLocations.Previous collections are available for the following years:2018-192017-182016-172015-16

About NTPSThe National Teacher and Principal Survey (NTPS) is a system of related questionnaires that provide descriptive data on the context of elementary and secondary education while also giving policymakers a variety of statistics on the condition of education in the United States.The NTPS is a redesign of the Schools and Staffing Survey (SASS), which the National Center for Education Statistics (NCES) conducted from 1987 to 2011. The design of the NTPS is a product of three key goals coming out of the SASS program: flexibility, timeliness, and integration with other Department of Education collections. The NTPS collects data on core topics including teacher and principal preparation, classes taught, school characteristics, and demographics of the teacher and principal labor force every two to three years. In addition, each administration of NTPS contains rotating modules on important education topics such as: professional development, working conditions, and evaluation. This approach allows policy makers and researchers to assess trends on both stable and dynamic topics.Data OrganizationEach table has an associated excel and excel SE file, which are grouped together in a folder in the dataset (one folder per table). The folders are named based on the excel file names, as they were when downloaded from the National Center for Education Statistics (NCES) website.In the NTPS folder, there is a catalog csv that provides a crosswalk between the folder names and the table titles.The documentation folder contains (1) codebooks for NTPS generated in NCES datalabs, (2) questionnaires for NTPS downloaded from the study website and (3) reports related to NTPS found in the NCES resource library

The National Center for Education Statistics' (NCES) Education Demographic and Geographic Estimate (EDGE) program develops annually updated point locations (latitude and longitude) for public elementary and secondary schools included in the NCES Common Core of Data (CCD). The CCD program annually collects administrative and fiscal data about all public schools, school districts, and state education agencies in the United States. The data are supplied by state education agency officials and include basic directory and contact information for schools and school districts, as well as characteristics about student demographics, number of teachers, school grade span, and various other administrative conditions. The CCD program also provides fiscal data about school district revenues and expenditures. CCD school and agency point locations are derived from reported information about the physical location of schools and agency administrative offices. The NCES EDGE program collaborates with the U.S. Census Bureau's Education Demographic, Geographic, and Economic Statistics (EDGE) Branch to develop point locations for schools reported in the annual CCD directory file. The point locations in this data layer represent the most current CCD collection. Check the SURVYEAR attribute in the data table to determine file vintage. For more information about NCES school point data, see: https://nces.ed.gov/programs/edge/Geographic/SchoolLocations.Previous collections are available for the following years:2018-192017-182016-172015-16

Author's Note 2019/04/20: Revisiting this project, I recently discovered the incredibly comprehensive API produced by the Urban Institute. It achieves all of the goals laid out for this dataset in wonderful detail. I recommend that users interested pay a visit to their site.

Context

This dataset is designed to bring together multiple facets of U.S. education data into one convenient CSV (states_all.csv).

Contents

• states_all.csv: The primary data file. Contains aggregates from all state-level sources in one CSV.

• output_files/states_all_extended.csv: The contents of states_all.csv with additional data related to race and gender.

Column Breakdown

Identification

• PRIMARY_KEY: A combination of the year and state name.
• YEAR
• STATE

Enrollment

A breakdown of students enrolled in schools by school year.

• GRADES_PK: Number of students in Pre-Kindergarten education.

• GRADES_4: Number of students in fourth grade.

• GRADES_8: Number of students in eighth grade.

• GRADES_12: Number of students in twelfth grade.

• GRADES_1_8: Number of students in the first through eighth grades.

• GRADES 9_12: Number of students in the ninth through twelfth grades.

• GRADES_ALL: The count of all students in the state. Comparable to ENROLL in the financial data (which is the U.S. Census Bureau's estimate for students in the state).

The extended version of states_all contains additional columns that breakdown enrollment by race and gender. For example:

• G06_A_A: Total number of sixth grade students.

• G06_AS_M: Number of sixth grade male students whose ethnicity was classified as "Asian".

• G08_AS_A_READING: Average reading score of eighth grade students whose ethnicity was classified as "Asian".

The represented races include AM (American Indian or Alaska Native), AS (Asian), HI (Hispanic/Latino), BL (Black or African American), WH (White), HP (Hawaiian Native/Pacific Islander), and TR (Two or More Races). The represented genders include M (Male) and F (Female).

Financials

A breakdown of states by revenue and expenditure.

• ENROLL: The U.S. Census Bureau's count for students in the state. Should be comparable to GRADES_ALL (which is the NCES's estimate for students in the state).

• TOTAL REVENUE: The total amount of revenue for the state.

  • FEDERAL_REVENUE
  • STATE_REVENUE
  • LOCAL_REVENUE

• TOTAL_EXPENDITURE: The total expenditure for the state.

  • INSTRUCTION_EXPENDITURE

  • SUPPORT_SERVICES_EXPENDITURE

  • CAPITAL_OUTLAY_EXPENDITURE

  • OTHER_EXPENDITURE

Academic Achievement

A breakdown of student performance as assessed by the corresponding exams (math and reading, grades 4 and 8).

• AVG_MATH_4_SCORE: The state's average score for fourth graders taking the NAEP math exam.

• AVG_MATH_8_SCORE: The state's average score for eight graders taking the NAEP math exam.

• AVG_READING_4_SCORE: The state's average score for fourth graders taking the NAEP reading exam.

• AVG_READING_8_SCORE: The state's average score for eighth graders taking the NAEP reading exam.

Data Processing

The original sources can be found here:

# Enrollment
https://nces.ed.gov/ccd/stnfis.asp
# Financials
https://www.census.gov/programs-surveys/school-finances/data/tables.html
# Academic Achievement
https://www.nationsreportcard.gov/ndecore/xplore/NDE

Data was aggregated using a Python program I wrote. The code (as well as additional project information) can be found [here][1].

Methodology Notes

• Spreadsheets for NCES enrollment data for 2014, 2011, 2010, and 2009 were modified to place key data on the same sheet, making scripting easier.

• The column 'ENROLL' represents the U.S. Census Bureau data value (financial data), while the column 'GRADES_ALL' represents the NCES data value (demographic data). Though the two organizations correspond on this matter, these values (which are ostensibly the same) do vary. Their documentation chalks this up to differences in membership (i.e. what is and is not a fourth grade student).

• Enrollment data from NCES has seen a number of changes across survey years. One of the more notable is that data on student gender does not appear to have been collected until 2009. The information in states_all_extended.csv reflects this.

• NAEP test score data is only available for certain years

• The current version of this data is concerned with state-level patterns. It is the author's hope that future versions will allow for school district-level granularity.

Acknowledgements

Data is sourced from the U.S. Census Bureau and the National Center for Education Statistics (NCES).

Licensing Notes

The licensing of these datasets state that it must not be us...

About SSOCSThe School Survey on Crime and Safety is a national survey of principals in U.S. public elementary, middle, and high schools. The survey covers topics such as:Frequency and types of crimes occurring at schoolDisciplinary actions allowed and used in schoolsPolicies and practices designed to prevent or reduce crime in schoolsCharacteristics of school climate related to safetyThe SSOCS was first conducted in the 1999-2000 school year. Data has been collected every other school year from 2004 to 2010 and from 2016 to 2020. The SSOCS data collection in the 2021-22 school year is the final planned collection.About SCSThe School Crime Supplement (SCS) is part of the National Crime Victimization Survey (NCVS), which is led by the Bureau of Justice Statistics (BJS) at the U.S. Department of Justice. NCES collaborates with BJS to survey students ages 12 to 18 years old in grades 6 through 12 about crime and safety at school and in the surrounding neighborhood.The SCS asks students about topics such as:Fighting, bullying, and hate-related behaviorPrevalence of guns and weaponsGangs at schoolAvailability of alcohol and drugs at schoolFear and avoidance behaviorsThe SCS was first conducted in 1989, followed by administrations in 1995 and 1999, and was conducted every other year thereafter, from 2001 to 2019. Data collection was postponed during the COVID-19 pandemic and resumed in 2022. The next collection of SCS is scheduled for 2025.Data OrganizationThe categories from the original tables library are represented as folders. Each table has its own folder within the category folders. Each table has an excel (XLS) and excel SE file associated with it. The catalog CSV in the top level folder provides a crosswalk between the original table names and the current folder names.Additionally, there are folders for Questionnaires and Reports from the SCS and SSOCS, which were downloaded from the NCES website. There is also a folder of SSOCS data users manuals, also downloaded from the NCES resource library. The SCS users manuals are already available in ICPSR, see listing here: https://nces.ed.gov/programs/crime/scs/data/.

Public (charter and district) and private schools from the NCES Elementary/Secondary Information System. Data were downloaded in January 2022 as separate tables and geocoded using the internal ADHS geocoder, then merged together.

The National Center for Education Statistics’ (NCES) Education Demographic and Geographic Estimate (EDGE) program develops annually updated school district boundary composite files that include public elementary, secondary, and unified school district boundaries clipped to the U.S. shoreline. School districts are special-purpose governments and administrative units designed by state and local officials to provide public education for local residents. District boundaries are collected for NCES by the U.S. Census Bureau to develop demographic estimates and to support educational research and program administration. The NCES Common Core of Data (CCD) program is an annual collection of basic administrative characteristics for all public schools, school districts, and state education agencies in the United States. These characteristics are reported by state education officials and include directory information, number of students, number of teachers, grade span, and other conditions. The administrative attributes in this layer were developed from the most current CCD collection available. For more information about NCES school district boundaries, see: https://nces.ed.gov/programs/edge/Geographic/DistrictBoundaries. For more information about CCD school district attributes, see: https://nces.ed.gov/ccd/files.asp.

Notes:

Collections are available for the following years:

• 2022-23
  
• 2021-22
  
• 2020-21
  
• 2019-20
  
• 2018-19
  
• 2017-18
  

All information contained in this file is in the public domain. Data users are advised to review NCES program documentation and feature class metadata to understand the limitations and appropriate use of these data.

The Integrated Postsecondary Education Data System (IPEDS) is a system of interrelated surveys conducted annually by the U.S. Department of Education's National Center for Education Statistics (NCES). IPEDS annually gathers information from about 6,400 colleges, universities, and technical and vocational institutions that participate in the federal student aid programs. Access Database: To eliminate the step of downloading IPEDS separately by survey component or select variables, IPEDS has made available the entire survey data for one collection year in the Microsoft Access format beginning with the 2004-05 IPEDS data collection year. Each database contains the relational data tables as well as the metadata tables that describe each data table, the variable titles, descriptions and variables types. Value codes and value labels are also available for all categorical variables. When downloading an IPEDS Access Database, the file is compressed using WinZip.

NOTE: Data in this table represent the 50 states and the District of Columbia. Data through 1995 are for institutions of higher education, while later data are for degree-granting institutions. Degree-granting institutions grant associate’s or higher degrees and participate in Title IV federal financial aid programs. The degree-granting classification is very similar to the earlier higher education classification, but it includes more 2-year colleges and excludes a few higher education institutions that did not grant degrees. Projections in this table were calculated after the onset of the coronavirus pandemic and take into account the expected impacts of the pandemic. Some data have been revised from previously published figures.

Information about ECLSThe Early Childhood Longitudinal Study (ECLS) program provides important information about children's knowledge, skills, and development from birth through elementary school. For more than 20 years, the ECLS program has helped educators, families, researchers, and policymakers improve children's educational experiences.The ECLS program includes four longitudinal studies that examine child development, school readiness, and early school experiences. However, the tables library only covers two of these studies. The kindergarten class of 1998–99 cohort is a sample of children followed from kindergarten through the eighth grade (ECLS-K). The kindergarten class of 2010–11 cohort is a sample of children followed from kindergarten through the fifth grade (ECLS-K:2011).Data OrganizationEach table has an associated excel file, which is in a folder in the dataset (one folder per table).In the root folder, there is a catalog csv that provides a crosswalk between the folder names and file names and the original table titles.In addition to the tables, this project contains (1) user manuals for ECLS-K and ECLS-K:2011 from the NCES resource library, (2) questionnaires for ECLS-K and ECLS-K:2011 downloaded from the study website and (3) other reports and documentation related to the two studies from the NCES resource library.

About SASSThe Schools and Staffing Survey (SASS) was conducted by NCES seven times between 1987 through 2011. SASS was an integrated study public and private school districts, schools, principals, and teachers designed to provide descriptive data on the context of elementary and secondary education. SASS covered a wide range of topics from teacher demand, teacher and principal characteristics, general conditions in schools, principals' and teachers' perceptions of school climate and problems in their schools, teacher compensation, district hiring and retention practices, to basic characteristics of the student population. After 2010–11, NCES redesigned SASS and named it the National Teacher and Principal Survey (NTPS) to reflect the redesigned study's focus on the teacher and principal labor market and on the state of K-12 school staff. NCES first conducted NTPS in 2015–16.Data OrganizationEach table has an associated excel and excel SE file, which are grouped together in a folder in the dataset (one folder per table). The folders are named based on the excel file names, as they were when downloaded from the National Center for Education Statistics (NCES) website.In the SASS folder, there is a catalog csv that provides a crosswalk between the folder names and the table titles.The documentation folder contains (1) codebooks for SASS generated in NCES datalabs, (2) questionnaires for SASS downloaded from the study website and (3) documentation and user manuals related to SASS found in the NCES resource library.

Hello world! - MT

This point datalayer shows the locations of institutions of higher education in Massachusetts. Sites appearing in this layer are those normally attended by students after completion of high school. Types are public and private, and categories include co-ed, vocational, technical, religious, medical, and traditional 2- and 4-year colleges and universities. This layer was developed by MassGIS and is primarily based on all Massachusetts colleges listed in the National Center for Education Statistics website as of March 12, 2018. Additional schools were added from lists of professional occupational/vocational institutions compiled by the Massachusetts Office of Consumer Affairs and Business Regulation Division of Professional Licensure.Data sources:https://nces.ed.gov/collegenavigator/https://www.mass.gov/files/documents/2017/09/27/schools.pdfhttps://www.mass.gov/files/documents/2018/02/15/electricians%20150-600-hrs-course-approved-schools.pdfIndividual college websites were also consulted to verify locations and other material. MassGIS geocoded site addresses and verfied them using current ortho imagery.A few institutions have multiple campuses, as distinct from satellite locations. For example, Harvard School of Business and Harvard Medical School are campuses within Harvard University, and a point is included in this dataset for each. Some satellite campuses may not be included. For example, Northeastern University conducts classes in satellite locations such as Milford High School. Since Milford High School is a separate educational facility, it is not considered to be a Northeastern University campus, and a point is not included in this layer.The layer is stored in ArcSDE and distributed as COLLEGES_PT.For pre-kindergarten through high school educational facilities, see the SCHOOL_PT layer.

Context

College tuition data is somewhat difficult to find - with many sites limiting it to online tools.

Content

The data this week comes from many different sources but originally came from the US Department of Education. The most comprehensive and easily accessible data cames from TuitionTracker.org who allows for a .csv download! Unfortunately it's in a very wide format that is not ready for analysis, but tidyr can make quick work of that with pivot_longer(). It has a massive amount of data, I have filtered it down to a few tables as seen in the attached .csv files. Tuition and diversity data can be quickly joined by dplyr::left_join(tuition_cost, diversity_school, by = c("name", "state")). Some of the other tables can also be joined but there may be some fuzzy matching needed.

Historical averages from the National Center for Education Statistics (NCES) - spanning the years 1985 - 2016.

• Tuition and fees by college/university for 2018-2019, along with school type, degree length, state, in-state vs out-of-state from the Chronicle of Higher Education.
• Diversity by college/university for 2014, along with school type, degree length, state, in-state vs out-of-state from the Chronicle of Higher Education.
• Example diversity graphics from Priceonomics.
• Average net cost by income bracket from TuitionTracker.org.
• Example price trend and graduation rates from TuitionTracker.org
• Salary potential data comes from payscale.com.

Acknowledgements

The data was downloaded and cleaned by Thomas Mock for #TidyTuesday during the week of March 10th, 2020. You can see the code used to clean the data in the TidyTuesday GitHub repository.

Inspiration

Use this dataset to explore the costs of college tuition in the US on their own, by geographic area, degree type, and/or salary. Whatever you choose to explore, consider sharing your notebook on Twitter using the #TidyTuesday hashtag!

License

The data provided in the TidyTuesday repository is licensed under the MIT License.

About TFSThis is a study of public and private school teachers in elementary and secondary schools and is part of the NTPS study, which collects information from U.S. elementary and secondary schools and their staff. Use this study to learn about teacher retention and attrition rates, characteristics of teachers who stayed in the teaching profession and those who changed professions or retired, activity and occupational information for those who left the position of a K-12 teacher, reasons for moving to a new school or leaving the K-12 teaching profession, and job satisfaction.Data OrganizationEach table has an associated excel and excel SE file, which are grouped together in a folder in the dataset (one folder per table). The folders are named based on the excel file names, as they were when downloaded from the National Center for Education Statistics (NCES) website.In the TFS folder, there is a catalog csv that provides a crosswalk between the folder names and the table titles.The documentation folder contains (1) codebooks for TFS generated in NCES datalabs, (2) questionnaires for TFS downloaded from the study website and (3) reports related to TFS found in the NCES resource library.

Integrated Postsecondary Education Data System (IPEDS) Complete Data Files from 1980 to 2023. Includes data file, STATA data file, SPSS program, SAS program, STATA program, and dictionary. All years compressed into one .zip file due to storage limitations.Updated on 2/14/2025 to add Microsoft Access Database files.From IPEDS Complete Data File Help Page (https://nces.ed.gov/Ipeds/help/complete-data-files):Choose the file to download by reading the description in the available titles. Then, click on the link in that row corresponding to the column header of the type of file/information desired to download.To download and view the survey files in basic CSV format use the main download link in the Data File column.For files compatible with the Stata statistical software package, use the alternate download link in the Stata Data File column.To download files with the SPSS, SAS, or STATA (.do) file extension for use with statistical software packages, use the download link in the Programs column.To download the data Dictionary for the selected file, click on the corresponding link in the far right column of the screen. The data dictionary serves as a reference for using and interpreting the data within a particular survey file. This includes the names, definitions, and formatting conventions for each table, field, and data element within the file, important business rules, and information on any relationships to other IPEDS data.For statistical read programs to work properly, both the data file and the corresponding read program file must be downloaded to the same subdirectory on the computer’s hard drive. Download the data file first; then click on the corresponding link in the Programs column to download the desired read program file to the same subdirectory.When viewing downloaded survey files, categorical variables are identified using codes instead of labels. Labels for these variables are available in both the data read program files and data dictionary for each file; however, for files that automatically incorporate this information you will need to select the Custom Data Files option.