Understanding Society, (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

Understanding Society (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Kantar Public and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society COVID-19 Study, 2020-2021 is a regular survey of households in the UK. The aim of the study is to enable research on the socio-economic and health consequences of the COVID-19 pandemic, in the short and long term. The surveys started in April 2020 and took place monthly until July 2020. From September 2020 they took place every other month until March 2021 and the final wave was fielded in September 2021. They complement the annual interviews of the Understanding Society study. The data can be linked to data on the same individuals from previous waves of the annual interviews (SN 6614) using the personal identifier pidp. However, the most recent pre-pandemic (2019) annual interviews for all respondents who have taken part in the COVID-19 Study are included as part of this data release. Please refer to the User Guide for further information on linking in this way and for geographical information options.

Latest edition information

For the eleventh edition (December 2021), revised April, May, June, July, September, November 2020, January 2021 and March 2021 data files for the adult survey have been deposited. These files have been amended to address issues identified during ongoing quality assurance activities. All documentation has been updated to explain the revisions, and users are advised to consult the documentation for details. In addition new data from the September 2021 web survey have been deposited.

Abstract copyright UK Data Service and data collection copyright owner.

Understanding Society (the UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex, and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society COVID-19 Study is a regular survey of households in the UK. The aim of the study is to enable research on the socio-economic and health consequences of the COVID-19 pandemic, in the short and long term. The surveys started in April 2020 and took place monthly until July 2020. From September they took place every other month until March 2021 and the final wave was fielded in September 2021. They complement the annual interviews of the Understanding Society study.

This dataset contains Census 2011 Lower Layer Super Output Areas (LSOA) geographic variables for the Understanding Society COVID-19 study.

A file is provided for each wave of the Understanding Society COVID-19 study to date, containing the Census 2011 Lower Layer Super Output Areas (LSOA) geographic variable and a personal identification serial number (pidp) for file matching to the main Understanding Society COVID-19 study (SN 8644). There are two types of waves: web waves have a filename postfix of _w and telephone waves have a filename postfix of _t.

In addition, this study also contains Census 2011 LSOA geographic variables that can be matched to a dataset released with the main Understanding Society COVID-19 study containing data taken from waves 10 and 11 of the main Understanding Society survey, specifically for the respondents in the COVID-19 study. This file is named jk_lsoa11_cv and as well as the LSOA11 geographic variable, it also contains a personal identification serial number (pidp) and a household identification serial number for both wave 10 (j_hidp) and wave 11 (k_hidp). Further details can be found in the Understanding Society COVID-19 User Guide.

Additional information can be found on the Understanding Society COVID-19 website, including Data documentation. A list of Understanding Society COVID-19 Research Outputs (regularly updated) is also available.

New edition information
For the seventh edition (December 2021), the new data file for wave 9 has been deposited.

Main Topics:

This dataset contains Census 2011 Lower Layer Super Output Areas (LSOA) geographic variables for use with the Understanding Society COVID-19 study.

Abstract copyright UK Data Service and data collection copyright owner.

As the UK went into the first lockdown of the COVID-19 pandemic, the team behind the biggest social survey in the UK, Understanding Society (UKHLS), developed a way to capture these experiences. From April 2020, participants from this Study were asked to take part in the Understanding Society COVID-19 survey, henceforth referred to as the COVID-19 survey or the COVID-19 study.

The COVID-19 survey regularly asked people about their situation and experiences. The resulting data gives a unique insight into the impact of the pandemic on individuals, families, and communities. The COVID-19 Teaching Dataset contains data from the main COVID-19 survey in a simplified form. It covers topics such as

• Socio-demographics
• Whether working at home and home-schooling
• COVID symptoms
• Health and well-being
• Social contact and neighbourhood cohesion
• Volunteering

The resource contains two data files:

• Cross-sectional: contains data collected in Wave 4 in July 2020 (with some additional variables from other waves);
• Longitudinal: Contains mainly data from Waves 1, 4 and 9 with key variables measured at three time points.

Key features of the dataset

• Missing values: in the web survey, participants clicking "Next" but not answering a question were given further options such as "Don't know" and "Prefer not to say". Missing observations like these are recorded using negative values such as -1 for "Don't know". In many instances, users of the data will need to set these values as missing. The User Guide includes Stata and SPSS code for setting negative missing values to system missing.

• The Longitudinal file is a balanced panel and is in wide format. A balanced panel means it only includes participants that took part in every wave. In wide format, each participant has one row of information, and each measurement of the same variable is a different variable.

• Weights: both the cross-sectional and longitudinal files include survey weights that adjust the sample to represent the UK adult population. The cross-sectional weight (betaindin_xw) adjusts for unequal selection probabilities in the sample design and for non-response. The longitudinal weight (ci_betaindin_lw) adjusts for the sample design and also for the fact that not all those invited to participate in the survey, do participate in all waves.

• Both the cross-sectional and longitudinal datasets include the survey design variables (psu and strata).

A full list of variables in both files can be found in the User Guide appendix.

Who is in the sample?

All adults (16 years old and over as of April 2020), in households who had participated in at least one of the last two waves of the main study Understanding Society, were invited to participate in this survey. From the September 2020 (Wave 5) survey onwards, only sample members who had completed at least one partial interview in any of the first four web surveys were invited to participate. From the November 2020 (Wave 6) survey onwards, those who had only completed the initial survey in April 2020 and none since, were no longer invited to participate

The User guide accompanying the data adds to the information here and includes a full variable list with details of measurement levels and links to the relevant questionnaire.

Main Topics:

• Socio-demographics;
• Whether working at home and home-schooling;
• COVID symptoms;
• Health and well-being;
• Social contact and neighbourhood cohesion;
• Volunteering.

Abstract copyright UK Data Service and data collection copyright owner.

Understanding Society, (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

Understanding Society (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Kantar Public and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society COVID-19 Study, 2020-2021 is a regular survey of households in the UK. The aim of the study is to enable research on the socio-economic and health consequences of the COVID-19 pandemic, in the short and long term. The surveys started in April 2020 and took place monthly until July 2020. From September 2020 they took place every other month until March 2021 and the final wave was fielded in September 2021. They complement the annual interviews of the Understanding Society study. The data can be linked to data on the same individuals from previous waves of the annual interviews (SN 6614) using the personal identifier pidp. However, the most recent pre-pandemic (2019) annual interviews for all respondents who have taken part in the COVID-19 Study are included as part of this data release. Please refer to the User Guide for further information on linking in this way and for geographical information options.

Latest edition information

For the eleventh edition (December 2021), revised April, May, June, July, September, November 2020, January 2021 and March 2021 data files for the adult survey have been deposited. These files have been amended to address issues identified during ongoing quality assurance activities. All documentation has been updated to explain the revisions, and users are advised to consult the documentation for details. In addition new data from the September 2021 web survey have been deposited.

Main Topics:

The survey contains information about mental and physical health, health behaviours, caring, housing, employment, job search, income, education, family relationships, return to school and children’s strength and difficulties questionnaire, young adults’ future intentions. The survey also includes data on COVID-19 antibodies analysed from blood samples.

This is the Zenodo archive for the manuscript "Likely community transmission of COVID-19 infections between neighboring, persistent hotspots in Ontario, Canada" (Mucaki EJ, Shirley BC and Rogan PK. F1000Research 2021, 10:1312, DOI: 10.12688/f1000research.75891.1). This study aimed to produce community-level geo-spatial mapping of patterns and clusters of symptoms, and of confirmed COVID-19 cases, in near real-time in order to support decision-making. This was accomplished by area-to-area geostatistical analysis, space-time integration, and spatial interpolation of COVID-19 positive individuals. This archive will contain data and image files from this study, which were too numerous to be included in the manuscript for this study. It also provides all program files pertaining to the Geostatistical Epidemiology Toolbox (Geostatistical analysis software package to be used in ArcGIS), as well as all other scripts described in this manuscript and other software developed (cluster, outlier, streak identification and pairing)..

We also provide a guide which provides a general description of the contents of the four sections in this archive (Documentation_for_Sections_of_Zenodo_Archive.docx). If you have any intent to utilize the data provided in Section 3, we greatly advise you to review this document as it describes the output of all geostatistical analyses performed in this study in detail.

Data Files:

Section 1. "Section_1.Tables_S1_S7.Figures_S1_S11.zip"

This section contains all additional tables and figures described in the manuscript "Likely community transmission of COVID-19 infections between neighboring, persistent hotspots in Ontario, Canada". Additional tables S1 to S7 are presented in an Excel document. These 7 tables provide summary statistics of various geostatistical tests described in the study (“Section 1 – Tables S1-S4”) and lists all identified single and paired high-case cluster streaks (“Section 1 – Tables S5-S7”). This section also contains 11 additional figures referred to in the manuscript (“Section 1 – Figures S1-S11”) both individually and within a Word document which describes them.

Section 2. "Section_2.Localized_Hotspot_Lists.zip"

All localized hotspots (identified through kriging analysis) were catalogued for each municipality evaluated (Hamilton, Kitchener/Waterloo, London, Ottawa, Toronto, Windsor/Essex). These files indicate the FSA in which the hotspot was identified, the date in which it was identified (utilizing 3-day case data at the postal code level), the amount of cases which occurred within the FSA within these 3 dates, the range of cases interpolated by kriging analysis (between 5-10, 10-15, 15-20, 20-25, 25-30, 30-35, 35-40, 40-50, >50), and whether or not the FSA was deemed a hotspot by Gi* relative to the rest of Ontario on any of the three dates evaluated. Please see Section 4 for map images of these localized hotspots.

Section 3. "Section_3.All-Data_Files.Kriging_GiStar_Local_and_GlobalMorans.2020_2021"

Section 3 – All output files from the geostatistical tests performed in this study are provided in this section. This includes the output from Ontario-wide FSA-level Gi* and Cluster and Outlier analyses, and PC-level Cluster and Outlier, Spatial Autocorrelation, and kriging analysis of 6 municipal regions. It also includes kriging analysis of 7 other municipal regions adjacent to Toronto (Ajax, Brampton, Markham, Mississauga, Pickering, Richmond Hill and Vaughan). This section also provides data files from our analyses of stratified case data (by age, gender, and at-risk condition). All coordinates presented in these data files are given in “PCS_Lambert_Conformal_Conic” format. Case values between 1-5 were masked (appear as “NA”).

Section 4. "Section_4.All_Map_Images_of_Geostat_Analyses.zip"

Sets of image files which map the results of our geostatistical analyses onto a map of Ontario or within the municipalities evaluated (Hamilton, Kitchener/Waterloo, London, Ottawa, Toronto, Windsor/Essex) are provided. This includes: Kriging analysis (PC-level), Local Moran's I cluster and outlier analysis (FSA and PC-level), normal and space-time Gi* analysis, and all images for all analyses performed on stratified data (by age, gender and at-risk condition). Kriging contour maps are also included for 7 other municipal regions adjacent to Toronto (Ajax, Brampton, Markham, Mississauga, Pickering, Richmond Hill and Vaughan).

Software:

This Zenodo archive also provides all program files pertaining to the Geostatistical Epidemiology Toolbox (Geostatistical analysis software package to be used in ArcGIS), as well as all other scripts described in this manuscript. This geostatistical toolbox was developed by CytoGnomix Inc., London ON, Canada and is distributed freely under the terms of the GNU General Public License v3.0. It can be easily modified to accommodate other Canadian provinces and, with some additional effort, other countries.

This distribution of the Geostatistical Epidemiology Toolbox does not include postal code (PC) boundary files (which are required for some of the tools included in the toolbox). The PC boundary shapefiles used to test the toolbox were obtained from DMTI (https://www.dmtispatial.com/canmap/) through the Scholar's Geoportal at the University of Western Ontario (http://geo2.scholarsportal.info/). The distribution of these files (through sharing, sale, donation, transfer, or exchange) is strictly prohibited. However, any equivalent PC boundary shape file should suffice, provided it contains polygon boundaries representing postal code regions (see guide for more details).

Software File 1. "Software.GeostatisticalEpidemiologyToolbox.zip"

The Geostatistical Epidemiology Toolbox is a set of custom Python-based geoprocessing tools which function as any built-in tool in the ArcGIS system. This toolbox implements data preprocessing, geostatistical analysis and post-processing software developed to evaluate the distribution and progression of COVID-19 cases in Canada. The purpose of developing this toolbox is to allow external users without programming knowledge to utilize the software scripts which generated our analyses and was intended to be used to evaluate Canadian datasets. While the toolbox was developed for evaluating the distribution of COVID-19, it could be utilized for other purposes.

The toolbox was developed to evaluate statistically significant distributions of COVID-19 case data at Canadian Forward Sortation Area (FSA) and Postal Code-level in the province of Ontario utilizing geostatistical tools available through the ArcGIS system. These tools include: 1) Standard Gi* analysis (finds areas where cases are significantly spatially clustered), 2) spacetime based Gi* analysis (finds areas where cases are both spatially and temporally clustered), 3) cluster and outlier analysis (determines if high case regions are an regional outlier or part of a case cluster), 4) spatial autocorrelation (determines the cases in a region are clustered overall) and, 5) Empirical Bayesian Kriging analysis (creates contour maps which define the interpolation of COVID-19 cases in measured and unmeasured areas). Post-processing tools are included that import these all of the preceding results into the ArcGIS system and automatically generate PNG images.

This archive also includes a guide ("UserManual_GeostatisticalEpidemiologyToolbox_CytoGnomix.pdf") which describes in detail how to set up the toolbox, how to format input case data, and how to use each tool (describing both the relevant input parameters and the structure of the resultant output files).

Software File 2: “Software.Additional_Programs_for_Cluster_Outlier_Streak_Idendification_and_Pairing.zip"

In the manuscript associated with this archive, Perl scripts were utilized to evaluate postal code-level Cluster and Outlier analysis to identify significantly, highly clustered postal codes over consecutive periods (i.e., high-case cluster “streaks”). The identified streaks are then paired to those in close proximity, based on the neighbors of each postal code from PC centroid data ("paired streaks"). Multinomial logistic regression models were then derived in the R programming language to measure the correlation between the number of cases reported in each paired streak, the interval of time separating each streak, and the physical distance between the two postal codes. Here, we provide the 3 Perl scripts and the R markdown file which perform these tasks:

“Ontario_City_Closest_Postal_Code_Identification.pl”

Using an input file with postal code coordinates (by centroid), this program identifies the nearest neighbors to all postal codes for a given municipal region (the name of this region is entered on the command line). Postal code centroids were calculated in ArcGIS using the “Calculate Geometry” function against DMTI postal code boundary files (not provided). Input from other sources could be used, however, as long as the input includes a list of coordinates with a unique label associated with a particular municipality.

The output of this program (for the same municipal region being evaluated) is required for the following two Perl

At the end of 2020 the GLA commissioned the University of Essex to analyse the impact on Londoners of the Covid-19 crisis, of the emergency policies put in place since March 2020 and of some counterfactual policy options, including the continuation of the £20 weekly uplift in Universal Credit and Working Tax Credit. The researchers used UKMOD, the UK tax-benefit microsimulation model, to conduct their analysis.

Files to replicate "Internet and mental health during the COVID-19 pandemic: Evidence from the UK", published in the Oxford Open Economics journal: https://doi.org/10.1093/ooec/odac007 The replication files use data from Understanding Society. Understanding Society is an initiative funded by the Economic and Social Research Council and various Government Departments, with scientific leadership by the Institute for Social and Economic Research, University of Essex, and survey delivery by NatCen Social Research and Kantar Public. The research data are distributed by the UK Data Service. Researchers who would like to use Understanding Society need to register with the UK Data Service before being allowed to apply for or download datasets. For more information visit: https://www.understandingsociety.ac.uk/documentation/access-data

Abstract copyright UK Data Service and data collection copyright owner.

Understanding Society, (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society: Calendar Year Dataset, 2021, is designed to enable cross-sectional analysis of individuals and households relating specifically to their annual interviews conducted in the year 2021, and, therefore, combine data collected in three waves (Waves 11, 12 and 13). It has been produced from the same data collected in the main Understanding Society study and released in the longitudinal datasets SN 6614 (End User Licence) and SN 6931 (Special Licence). Such cross-sectional analysis can, however, only involve variables that are collected in every wave in order to have data for the full sample panel. The 2021 dataset is the second of a series of planned Calendar Year Datasets to facilitate cross-sectional analysis of specific years. Full details of the Calendar Year Dataset sample structure (including why some individual interviews from 2022 are included), data structure and additional supporting information can be found in the document '9193_calendar_year_dataset_2021_user_guide'.

As multi-topic studies, the purpose of Understanding Society is to understand the short- and long-term effects of social and economic change in the UK at the household and individual levels. The study has a strong emphasis on domains of family and social ties, employment, education, financial resources, and health. Understanding Society is an annual survey of each adult member of a nationally representative sample. The same individuals are re-interviewed in each wave approximately 12 months apart. When individuals move, they are followed within the UK, and anyone joining their households is also interviewed as long as they are living with them. The fieldwork period for a single wave is 24 months. Data collection uses computer-assisted personal interviewing (CAPI) and web interviews (from wave 7) and includes a telephone mop-up. From March 2020 (the end of wave 10 and 2nd year of wave 11), due to the coronavirus pandemic, face-to-face interviews were suspended, and the survey has been conducted by web and telephone only but otherwise has continued as before. One person completes the household questionnaire. Each person aged 16 or older participates in the individual adult interview and self-completed questionnaire. Youths aged 10 to 15 are asked to respond to a paper self-completion questionnaire. In 2020, an additional frequent web survey was separately issued to sample members to capture data on the rapid changes in people’s lives due to the COVID-19 pandemic (see SN 8644). The COVID-19 Survey data are not included in this dataset.

Further information may be found on the Understanding Society main stage webpage and links to publications based on the study can be found on the Understanding Society Latest Research webpage.

Co-funders

In addition to the Economic and Social Research Council, co-funders for the study included the Department of Work and Pensions, the Department for Education, the Department for Transport, the Department of Culture, Media and Sport, the Department for Community and Local Government, the Department of Health, the Scottish Government, the Welsh Assembly Government, the Northern Ireland Executive, the Department of Environment and Rural Affairs, and the Food Standards Agency.

End User Licence and Special Licence versions:

There are two versions of the Calendar Year 2021 data. One is available under the standard End User Licence (EUL) agreement, and the other is a Special Licence (SL) version. The SL version contains month and year of birth variables instead of just age, more detailed country and occupation coding for a number of variables and various income variables have not been top-coded (see the document '9194_eul_vs_sl_variable_differences' for more details). Users are advised to first obtain the standard EUL version of the data to see if they are sufficient for their research requirements. The SL data have more restrictive access conditions; prospective users of the SL version will need to complete an extra application form and demonstrate to the data owners exactly why they need access to the additional variables in order to get permission to use that version. The main longitudinal versions of the Understanding Society study may be found under SNs 6614 (EUL) and 6931 (SL).

Low- and Medium-level geographical identifiers produced for the mainstage longitudinal dataset can be used with this Calendar Year 2021 dataset, subject to SL access conditions. See...

Understanding Society (the UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex, and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society: Calendar Year Dataset, 2021, is designed to enable cross-sectional analysis of individuals and households relating specifically to their annual interviews conducted in the year 2021, and, therefore, combine data collected in three waves (Waves 11, 12 and 13). It has been produced from the same data collected in the main Understanding Society study and released in the longitudinal datasets SN 6614 (End User Licence) and SN 6931 (Special Licence). Such cross-sectional analysis can, however, only involve variables that are collected in every wave in order to have data for the full sample panel. The 2021 dataset is the second of a series of planned Calendar Year Datasets to facilitate cross-sectional analysis of specific years. Full details of the Calendar Year Dataset sample structure (including why some individual interviews from 2022 are included), data structure and additional supporting information can be found in the document '9194_calendar_year_dataset_2020_user_guide'.

As multi-topic studies, the purpose of Understanding Society is to understand the short- and long-term effects of social and economic change in the UK at the household and individual levels. The study has a strong emphasis on domains of family and social ties, employment, education, financial resources, and health. Understanding Society is an annual survey of each adult member of a nationally representative sample. The same individuals are re-interviewed in each wave approximately 12 months apart. When individuals move, they are followed within the UK, and anyone joining their households is also interviewed as long as they are living with them. The fieldwork period for a single wave is 24 months. Data collection uses computer-assisted personal interviewing (CAPI) and web interviews (from wave 7) and includes a telephone mop-up. From March 2020 (the end of wave 10 and 2nd year of wave 11), due to the coronavirus pandemic, face-to-face interviews were suspended, and the survey has been conducted by web and telephone only but otherwise has continued as before. One person completes the household questionnaire. Each person aged 16 or older participates in the individual adult interview and self-completed questionnaire. Youths aged 10 to 15 are asked to respond to a paper self-completion questionnaire. In 2020, an additional frequent web survey was separately issued to sample members to capture data on the rapid changes in people’s lives due to the COVID-19 pandemic (see SN 8644). The COVID-19 Survey data are not included in this dataset.

Further information may be found on the Understanding Society main stage webpage and links to publications based on the study can be found on the Understanding Society Latest Research webpage.

Co-funders

In addition to the Economic and Social Research Council, co-funders for the study included the Department of Work and Pensions, the Department for Education, the Department for Transport, the Department of Culture, Media and Sport, the Department for Community and Local Government, the Department of Health, the Scottish Government, the Welsh Assembly Government, the Northern Ireland Executive, the Department of Environment and Rural Affairs, and the Food Standards Agency.

End User Licence and Special Licence versions:

There are two versions of the Calendar Year 2021 data. One is available under the standard End User Licence (EUL) agreement, and the other is a Special Licence (SL) version. The SL version contains month and year of birth variables instead of just age, more detailed country and occupation coding for a number of variables and various income variables have not been top-coded (see xxxx_eul_vs_sl_variable_differences for more details). Users are advised to first obtain the standard EUL version of the data to see if they are sufficient for their research requirements. The SL data have more restrictive access conditions; prospective users of the SL version will need to complete an extra application form and demonstrate to the data owners exactly why they need access to the additional variables in order to get permission to use that version. The main longitudinal versions of the Understanding Society study may be found under SNs 6614 (EUL) and 6931 (SL).

Low- and Medium-level geographical identifiers produced for the mainstage longitudinal dataset can be used with this Calendar Year 2021 dataset, subject to SL access conditions. See the User Guide for further details.

Suitable data analysis software

These data are provided by the depositor in Stata format. Users are strongly advised to analyse them in Stata. Transfer to other formats may result in unforeseen issues. Stata SE or MP software is needed to analyse the larger files, which contain about 1,900 variables.

Understanding Society (the UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex, and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

This release combines fourteen waves of Understanding Society data with harmonised data from all eighteen waves of the BHPS. As multi-topic studies, the purpose of Understanding Society and BHPS is to understand short- and long-term effects of social and economic change in the UK at the household and individual levels. The study has a strong emphasis on domains of family and social ties, employment, education, financial resources, and health. Understanding Society is an annual survey of each adult member of a nationally representative sample. The same individuals are re-interviewed in each wave approximately 12 months apart. When individuals move they are followed within the UK and anyone joining their households are also interviewed as long as they are living with them. The study has five sample components: the general population sample; a boost sample of ethnic minority group members; an immigrant and ethnic minority boost sample (from wave 6); participants from the BHPS; and a second general population boost sample added at this wave. In addition, there is the Understanding Society Innovation Panel (which is a separate standalone survey (see SN 6849)). The fieldwork period is for 24 months. Data collection uses computer assisted personal interviewing (CAPI) and web interviews (from wave 7), and includes a telephone mop-up. From March 2020 (the end of wave 10 and the 2nd year of wave 11), due to the coronavirus pandemic, face-to-face interviews were suspended, and the survey was conducted by web and telephone only, but otherwise has continued as before. Face-to-face interviewing was resumed from April 2022. One person completes the household questionnaire. Each person aged 16 is invited to complete the individual adult interview and self-completed questionnaire. Parents are asked questions about their children under 10 years old. Youths aged 10 to 15 are asked to respond to a self-completion questionnaire. For the general and BHPS samples biomarker, genetic and epigenetic data are also available. The biomarker data, and summary genetics and epigenetic scores, are available via UKDS (see SN 7251); detailed genetics and epigenetics data are available by application (see below). In 2020-21 an additional frequent web survey was separately issued to sample members to capture data on the rapid changes in people’s lives due to the COVID-19 pandemic (see SN 8644). Participants are asked consent to link their data to wide-ranging administrative data sets (see below).

Further information may be found on the Understanding Society Main stage webpage and links to publications based on the study can be found on the Understanding Society Latest Research webpage.

Co-funders

In addition to the Economic and Social Research Council, co-funders for the study included the Department of Work and Pensions, the Department for Education, the Department for Transport, the Department of Culture, Media and Sport, the Department for Community and Local Government, the Department of Health, the Scottish Government, the Welsh Assembly Government, the Northern Ireland Executive, the Department of Environment and Rural Affairs, and the Food Standards Agency.

End User Licence, Special Licence and Secure Access versions:

There are three versions of the main Understanding Society data with different access conditions. One is available under the standard End User Licence (EUL) agreement (SN 6614), one is a Special Licence (SL) version (this study) and the third is a Secure Access version (SN 6676). The SL version contains month as well as year of birth variables, more detailed country and occupation coding for a number of variables, various income variables that have not been top-coded, and other potentially sensitive variables (see 6931_eul_vs_sl_variable_differences document available with the SL version for full details of the differences). The Secure Access version, in addition to containing all the variables in the SL version, also contains day of birth as well as Grid Reference geographical variables. Users are advised to first obtain the standard EUL version of the data to see if they are sufficient for their research requirements. The SL and Secure Access versions of the data have more restrictive access conditions and prospective users of those versions should visit the catalogue entries for SN 6931 and SN 6676 respectively for further information.

Low- and Medium-level geographical identifiers are also available subject to SL access conditions; see SNs 6666, 6668-6675, 7453-4, 7629-30, 7245, 7248-9 and 9169-9170. Schools data are available subject to SL access conditions in SN 7182. Higher Education establishments for Wave 5 are available subject to SL access conditions in SN 8578. Interviewer Characteristics data, also subject to SL access conditions is available in SN 8579. In addition, a fine detail geographic dataset (SN 6676) is available under more restrictive Secure Access conditions that contains National Grid postcode grid references (at 1m resolution) for the unit postcode of each household surveyed, derived from ONS Postcode Directories (ONSPD). For details on how to make an application for Secure Access dataset, please see the SN 6676 catalogue record.

How to access genetic and/or bio-medical sample data from Understanding Society:

Information on how to access genetics and epigenetics data directly from the study team is available on the Understanding Society Accessing data webpage.

Linked administrative data

Linked Understanding Society / administrative data are available on a number of different platforms. See the Understanding Society Data linkage webpage for details of those currently available and how they can be accessed.

Latest edition information

For the 18th edition (November 2024) Wave 14 data has been added. Other minor changes and corrections have also been made to Waves 1-13. Please refer to the revisions document for full details.

m_hhresp and n_hhresp files updated, December 2024

In the previous release (18th edition, November 2024), there was an issue with household income estimates in m_hhresp and n_hhresp where a household resides in a new local authority (approx. 300 households in wave 14). The issue has been corrected and imputation models re-estimated and imputed values updated for the full sample. Imputed values will therefore change compared to the versions in the original release. The variables affected are w_ficountax_dv, w_fihhmnnet3_dv, n_fihhmnnet4_dv and n_ctband_dv.

Suitable data analysis software

These data are provided by the depositor in Stata format. Users are strongly advised to analyse them in Stata. Transfer to other formats may result in unforeseen issues. Stata SE or MP software is needed to analyse the larger files, which contain over 2,047 variables.

Abstract copyright UK Data Service and data collection copyright owner.

Understanding Society, (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

This release combines fourteen waves of Understanding Society data with harmonised data from all eighteen waves of the BHPS. As multi-topic studies, the purpose of Understanding Society and BHPS is to understand short- and long-term effects of social and economic change in the UK at the household and individual levels. The study has a strong emphasis on domains of family and social ties, employment, education, financial resources, and health. Understanding Society is an annual survey of each adult member of a nationally representative sample. The same individuals are re-interviewed in each wave approximately 12 months apart. When individuals move they are followed within the UK and anyone joining their households are also interviewed as long as they are living with them. The study has five sample components: the general population sample; a boost sample of ethnic minority group members; an immigrant and ethnic minority boost sample (from wave 6); participants from the BHPS; and a second general population boost sample added at this wave. In addition, there is the Understanding Society Innovation Panel (which is a separate standalone survey (see SN 6849)). The fieldwork period is for 24 months. Data collection uses computer assisted personal interviewing (CAPI) and web interviews (from wave 7), and includes a telephone mop-up. From March 2020 (the end of wave 10 and the 2nd year of wave 11), due to the coronavirus pandemic, face-to-face interviews were suspended, and the survey was conducted by web and telephone only, but otherwise has continued as before. Face-to-face interviewing was resumed from April 2022. One person completes the household questionnaire. Each person aged 16 is invited to complete the individual adult interview and self-completed questionnaire. Parents are asked questions about their children under 10 years old. Youths aged 10 to 15 are asked to respond to a self-completion questionnaire. For the general and BHPS samples biomarker, genetic and epigenetic data are also available. The biomarker data, and summary genetics and epigenetic scores, are available via UKDS (see SN 7251); detailed genetics and epigenetics data are available by application (see below). In 2020-21 an additional frequent web survey was separately issued to sample members to capture data on the rapid changes in people’s lives due to the COVID-19 pandemic (see SN 8644). Participants are asked consent to link their data to wide-ranging administrative data sets (see below).

Further information may be found on the Understanding Society Main stage webpage and links to publications based on the study can be found on the Understanding Society Latest Research webpage.

Co-funders

In addition to the Economic and Social Research Council, co-funders for the study included the Department of Work and Pensions, the Department for Education, the Department for Transport, the Department of Culture, Media and Sport, the Department for Community and Local Government, the Department of Health, the Scottish Government, the Welsh Assembly Government, the Northern Ireland Executive, the Department of Environment and Rural Affairs, and the Food Standards Agency.

End User Licence, Special Licence and Secure Access versions:

There are three versions of the main Understanding Society data with different access conditions. One is available under the standard End User Licence (EUL) agreement (this study), one is a Special Licence (SL) version (SN 6931) and the third is a Secure Access version (SN 6676). The SL version contains month as well as year of birth variables, more detailed country and occupation coding for a number of variables, various income variables that have not been top-coded, and other potentially sensitive variables (see 6931_eul_vs_sl_variable_differences document available with the SL version for full details of the differences). The Secure Access version, in addition to containing all the variables in the SL version, also contains day of birth as well as Grid Reference geographical variables. Users are advised to first obtain the standard EUL version of the data to see if they are sufficient for their research requirements. The SL and Secure Access versions of the data have more restrictive access conditions and prospective users of those versions should visit the catalogue entries for SN 6931 and SN 6676 respectively for further information.

Low- and Medium-level geographical identifiers are...

Abstract copyright UK Data Service and data collection copyright owner.

Understanding Society, (UK Household Longitudinal Study), which began in 2009, is conducted by the Institute for Social and Economic Research (ISER) at the University of Essex and the survey research organisations Verian Group (formerly Kantar Public) and NatCen. It builds on and incorporates, the British Household Panel Survey (BHPS), which began in 1991.

The Understanding Society: Calendar Year Dataset, 2020, is designed to enable cross-sectional analysis of individuals and households relating specifically to their annual interviews conducted in the year 2020, and, therefore, combine data collected in three waves (Waves 10, 11 and 12). It has been produced from the same data collected in the main Understanding Society study and released in the longitudinal datasets SN 6614 (End User Licence) and SN 6931 (Special Licence). Such cross-sectional analysis can, however, only involve variables that are collected in every wave in order to have data for the full sample panel. The 2020 dataset is the first of a series of planned Calendar Year Datasets to facilitate cross-sectional analysis of specific years. Full details of the Calendar Year Dataset sample structure (including why some individual interviews from 2021 are included), data structure and additional supporting information can be found in the 8988_calendar_year_dataset_2020_user_guide.

As multi-topic studies, the purpose of Understanding Society is to understand the short- and long-term effects of social and economic change in the UK at the household and individual levels. The study has a strong emphasis on domains of family and social ties, employment, education, financial resources, and health. Understanding Society is an annual survey of each adult member of a nationally representative sample. The same individuals are re-interviewed in each wave approximately 12 months apart. When individuals move they are followed within the UK and anyone joining their households are also interviewed as long as they are living with them. The fieldwork period for a single wave is 24 months. Data collection uses computer-assisted personal interviewing (CAPI) and web interviews (from wave 7), and includes a telephone mop-up. From March 2020 (the end of wave 10 and 2nd year of wave 11), due to the coronavirus pandemic, face-to-face interviews were suspended and the survey has been conducted by web and telephone only, but otherwise has continued as before. One person completes the household questionnaire. Each person aged 16 or older participates in the individual adult interview and self-completed questionnaire. Youths aged 10 to 15 are asked to respond to a paper self-completion questionnaire. In 2020 an additional frequent web survey was separately issued to sample members to capture data on the rapid changes in people’s lives due to the COVID-19 pandemic (see SN 8644). The COVID-19 Survey data are not included in this dataset.

Further information may be found on the Understanding Society main stage webpage and links to publications based on the study can be found on the Understanding Society Latest Research webpage.

Co-funders
In addition to the Economic and Social Research Council, co-funders for the study included the Department of Work and Pensions, the Department for Education, the Department for Transport, the Department of Culture, Media and Sport, the Department for Community and Local Government, the Department of Health, the Scottish Government, the Welsh Assembly Government, the Northern Ireland Executive, the Department of Environment and Rural Affairs, and the Food Standards Agency.

End User Licence and Special Licence versions:
There are two versions of the Calendar Year 2020 data. One is available under the standard End User Licence (EUL) agreement, and the other is a Special Licence (SL) version. The SL version contains month and year of birth variables instead of just age, more detailed country and occupation coding for a number of variables and various income variables have not been top-coded (see xxxx_eul_vs_sl_variable_differences for more details). Users are advised to first obtain the standard EUL version of the data to see if they are sufficient for their research requirements. The SL data have more restrictive access conditions; prospective users of the SL version will need to complete an extra application form and demonstrate to the data owners exactly why they need access to the additional variables in order to get permission to use that version. The main longitudinal versions of the Understanding Society study may be found under SNs 6614 (EUL) and 6931 (SL).

Low- and Medium-level geographical identifiers produced for the mainstage longitudinal dataset can be used with this Calendar Year 2020 dataset, subject to SL access conditions. See the...