Starts and completions of new build dwellings in the UK, on a quarterly and annual basis, time series data

Update 29-04-2020: The data is now split into two files based on the variable collection frequency (monthly and yearly). Additional variables added: area size in hectares, number of jobs in the area, number of people living in the area.

Context

I have been inspired by Xavier and his work on Barcelona to explore the city of London! 🇬🇧 💂

Content

The datasets is primarily centered around the housing market of London. However, it contains a lot of additional relevant data: - Monthly average house prices - Yearly number of houses - Yearly number of houses sold - Yearly percentage of households that recycle - Yearly life satisfaction - Yearly median salary of the residents of the area - Yearly mean salary of the residents of the area - Monthly number of crimes committed - Yearly number of jobs - Yearly number of people living in the area - Area size in hectares

The data is split by areas of London called boroughs (a flag exists to identify these), but some of the variables have other geographical UK regions for reference (like England, North East, etc.). There have been no changes made to the data except for melting it into a long format from the original tables.

Acknowledgements

The data has been extracted from London Datastore. It is released under UK Open Government License v2 and v3. The underlining datasets can be found here: https://data.london.gov.uk/dataset/uk-house-price-index https://data.london.gov.uk/dataset/number-and-density-of-dwellings-by-borough https://data.london.gov.uk/dataset/subjective-personal-well-being-borough https://data.london.gov.uk/dataset/household-waste-recycling-rates-borough https://data.london.gov.uk/dataset/earnings-place-residence-borough https://data.london.gov.uk/dataset/recorded_crime_summary https://data.london.gov.uk/dataset/jobs-and-job-density-borough https://data.london.gov.uk/dataset/ons-mid-year-population-estimates-custom-age-tables

Cover photo by Frans Ruiter from Unsplash

Inspiration

The dataset lends itself for extensive exploratory data analysis. It could also be a great supervised learning regression problem to predict house price changes of different boroughs over time.

Number of new residential property sales in England and Wales, by property type and administrative geographies. Quarterly rolling annual data. Formerly HPSSA dataset 7.

The number of dwellings by dwelling occupancy, shared dwellings, accommodation type, tenure, central heating type and number of bedrooms. Data are available at country, region, local authority, Middle layer Super Output Area and Lower layer Super Output Area in England and Wales, where possible.

Following large transfers of Social Housing stock from the Public Sector over the past twenty years, Housing Associations are now the major provider of social housing in the UK. The largest own thousands of houses but at the other end of the scale are very small organisations such as ancient Almshouse Charities, each owning a cottage or two and overseen by a part time Chairman or a Secretary.

The legal status and ownership of Housing Associations and Trusts is often complex. In some instances, a single management team may manage two or more Housing Associations which are distinct legal entities, for example one Charitable and one non-Charitable.

Housing Associations vary in the scope of their operations. The largest may cater for all types of tenants requiring public housing, whilst many of the smaller ones may cater for specific groups, for example, elderly residents of a certain parish or retired miners. The YMCAs and Foyers provide housing accommodation for single young people whilst the Abbeyfield Societies are voluntary bodies providing sheltered accommodation or nursing homes for the elderly.

How the data is organised:

Parent/Subsidiary Organisations - Housing Associations are regularly merging and renaming themselves. They are often managed in complex groups, with parent and subsidiaries organisations, some sharing their corporate management. Where there is a shared management team across a group, we list these contacts at the group organisation and not against each subsidiary, in order to avoid duplication.

Principal Contact - One person at each Association is identified as the "Chief Officer". In larger organisations this will normally be the Chief Executive or Director. In smaller Associations, it may be the Secretary or occasionally the Chairman, as requested by each organisation.

Job Functions - In addition to the Chief Officers we list a large number of other management posts. Due to the variety of job titles among Associations, we categorise by job function to identify responsibilities.

Units Owned/Managed - As well as recording the organisational structures, we also record the number of "units" each organisation owns/manages. "Units" can be anything from a detached house to a flat or a room or bed space in a nursing home or hostel.

Housing Index in the United Kingdom decreased to 511.60 points in June from 511.80 points in May of 2025. This dataset provides - United Kingdom House Price Index - actual values, historical data, forecast, chart, statistics, economic calendar and news.

Total number of households using data supplied by the Valuation Office. This is updated as at 31 March of each year

Median price paid for residential property in England and Wales, by property type and administrative geographies. Quarterly rolling annual data. Formerly HPSSA dataset 9

During the COVID-19 pandemic, the number of house sales in the UK spiked, followed by a period of decline. In 2023 and 2024, the housing market slowed notably, and in January 2025, transaction volumes fell to 46,774. House sales volumes are impacted by a number of factors, including mortgage rates, house prices, supply, demand, as well as the overall health of the market. The economic uncertainty and rising unemployment rates has also affected the homebuyer sentiment of Brits. How have UK house prices developed over the past 10 years? House prices in the UK have increased year-on-year since 2015, except for a brief period of decline in the second half of 2023 and the beginning of 2024. That is based on the 12-month percentage change of the UK house price index. At the peak of the housing boom in 2022, prices soared by nearly 14 percent. The decline that followed was mild, at under three percent. The cooling in the market was more pronounced in England and Wales, where the average house price declined in 2023. Conversely, growth in Scotland and Northern Ireland continued. What is the impact of mortgage rates on house sales? For a long period, mortgage rates were at record-low, allowing prospective homebuyers to take out a 10-year loan at a mortgage rate of less than three percent. In the last quarter of 2021, this period came to an end as the Bank of England rose the bank lending rate to contain the spike in inflation. Naturally, the higher borrowing costs affected consumer sentiment, urging many homebuyers to place their plans on hold and leading to a decline in sales.

The English Housing Survey (EHS) is a continuous national survey commissioned by the Department for Communities and Local Government (DCLG) that collects information about people's housing circumstances and the condition and energy efficiency of housing in England. The EHS brings together two previous survey series into a single fieldwork operation: the English House Condition Survey (EHCS) (available from the UK Data Archive under GN 33158) and the Survey of English Housing (SEH) (available under GN 33277). The EHS covers all housing tenures and provides valuable information and evidence to inform the development and monitoring of the department's housing policies. Results from the survey are also used by a wide range of other users including other government departments, local authorities, housing associations, landlords, academics, construction industry professionals, consultants, and the general public.

The EHS has a complex multi-stage methodology consisting of two main elements; an initial interview survey of around 14,000 households and a follow-up physical inspection. Some further elements are also periodically included in or derived from the EHS: for 2008 and 2009, a desk-based market valuation was conducted of a sub-sample of 8,000 dwellings (including vacant ones), but this was not carried out from 2010 onwards. A periodic follow-up survey of private landlords and agents (the Private Landlords Survey (PLS)) is conducted using information from the EHS interview survey. Fuel Poverty datasets are also available from 2003, created by the Department for Energy and Climate Change (DECC).

The EHS interview survey sample formed part of the Integrated Household Survey (IHS) (available from the Archive under GN 33420) from April 2008 to April 2011. During this period the core questions from the IHS formed part of the EHS questionnaire.

End User Licence and Special Licence Versions:
From 2014 data onwards, the End User Licence (EUL) versions of the EHS only include derived variables. In addition the number of variables on the EUL datasets from that date has been reduced and disclosure control increased on certain remaining variables. The new Special Licence versions of the EHS, which are subject to more restrictive access conditions, are of a similar nature to EHS EUL datasets prior to 2014 and include both derived and raw datasets.

Further information about the EHS and the latest news, reports and tables can be found on the GOV.UK English Housing Survey web pages.

The number of dwellings in the UK, and dwelling stock data by tenure for the UK’s constituent countries, where available.

These National Statistics provide monthly estimates of the number of residential and non-residential property transactions in the UK and its constituent countries. National Statistics are accredited official statistics.

England and Northern Ireland statistics are based on information submitted to the HM Revenue and Customs (HMRC) Stamp Duty Land Tax (SDLT) database by taxpayers on SDLT returns.

Land and Buildings Transaction Tax (LBTT) replaced SDLT in Scotland from 1 April 2015 and this data is provided to HMRC by https://www.revenue.scot/" class="govuk-link">Revenue Scotland to continue the time series.

Land Transaction Tax (LTT) replaced SDLT in Wales from 1 April 2018. To continue the time series, the https://gov.wales/welsh-revenue-authority" class="govuk-link">Welsh Revenue Authority (WRA) have provided HMRC with a monthly data feed of LTT transactions since July 2021.

LTT figures for the latest month are estimated using a grossing factor based on data for the most recent and complete financial year. Until June 2021, LTT transactions for the latest month were estimated by HMRC based upon year on year growth in line with other UK nations.

LTT transactions up to the penultimate month are aligned with LTT statistics.

Go to Stamp Duty Land Tax guidance for the latest rates and information.

Go to Stamp Duty Land Tax rates from 1 December 2003 to 22 September 2022 and Stamp Duty: rates on land transfers before December 2003 for historic rates.

The latest release was published 09:30 27 June 2025 and was updated with provisional data from completed transactions during May 2025.

The next release will be published 09:30 31 July 2025 and will be updated with provisional data from completed transactions during June 2025.

https://webarchive.nationalarchives.gov.uk/ukgwa/20240320184933/https://www.gov.uk/government/statistics/monthly-property-transactions-completed-in-the-uk-with-value-40000-or-above" class="govuk-link">Archive versions of the Monthly property transactions completed in the UK with value of £40,000 or above are available via the UK Government Web Archive, from the National Archives.

Quarterly house price data based on a sub-sample of the Regulated Mortgage Survey.

Median price paid for residential property in England and Wales by property type and electoral ward. Annual data.

The census is undertaken by the Office for National Statistics every 10 years and gives us a picture of all the people and households in England and Wales. The most recent census took place in March of 2021.The census asks every household questions about the people who live there and the type of home they live in. In doing so, it helps to build a detailed snapshot of society. Information from the census helps the government and local authorities to plan and fund local services, such as education, doctors' surgeries and roads.Key census statistics for Leicester are published on the open data platform to make information accessible to local services, voluntary and community groups, and residents.There is also a dashboard published showcasing various datasets from the census allowing users to view data for Leicester MSOAs and compare with Leicester overall statistics.Further information about the census and full datasets can be found on the ONS website - https://www.ons.gov.uk/census/aboutcensus/censusproductsAccommodation typeThis dataset provides Census 2021 estimates that classify households in England and Wales by accommodation type. The estimates are as at Census Day, 21 March 2021.Definition: The type of building or structure used or available by an individual or householdThis could be:the whole house or bungalowa flat, maisonette or apartmenta temporary or mobile structure, such as a caravanMore information about accommodation types:Whole house or bungalow: This property type is not divided into flats or other living accommodation. There are three types of whole houses or bungalows.Detached: None of the living accommodation is attached to another property but can be attached to a garage.Semi-detached: The living accommodation is joined to another house or bungalow by a common wall that they share.Terraced: A mid-terraced house is located between two other houses and shares two common walls. An end-of-terrace house is part of a terraced development but only shares one common wall.Flats (Apartments) and maisonettes: An apartment is another word for a flat. A maisonette is a 2-storey flat.This dataset includes details for Leicester city MSOAs.

The Survey of English Housing (SEH) was a continuous annual survey series, which began in 1993. The survey provided key housing data on tenure, owner occupation and the social rented sector, and regular information about the private rented sector. The survey was originally sponsored by the Department of the Environment, which became the Department of the Environment, Transport and the Regions in time for the 1996-1997 survey, then the Department for Transport, Local Government and the Regions, by 2000-2001. Responsibility for the SEH was transferred to the Office of the Deputy Prime Minister after the fieldwork for the 2002-2003 survey commenced, and on 5 May 2006 the series became part of the remit of the newly-established Department for Communities and Local Government (DCLG).

The main aims of the SEH were to provide regular information about the main features of people's housing and their views about their circumstances, and information about the private rented sector (not covered by routine administrative statistics like the owner-occupied and social rented sectors).

From 2008, the SEH merged with the English House Condition Survey (EHCS) to form the new English Housing Survey (EHS). The last SEH dataset is the 2007-2008 study. The EHS data are available at the UK Data Archive under GN 33422.

Further information about the SEH and the EHS may be found on the DCLG web site Survey of English Housing and English Housing Survey web pages.
A set of questions on air quality was also included in the 1998-1999 survey, asked on behalf of the Building Research Establishment.