Dataset Overview

This dataset provides a snapshot of properties listed for sale in London, sourced from the Rightmove website. It includes various property details such as the number of bedrooms, bathrooms, type of property, and price. The dataset is designed for educational purposes, offering insights into real estate trends and allowing data science enthusiasts to apply their skills in the context of property analysis.

Data Science Applications

This dataset is a valuable resource for students and researchers to practice various data science and analytics techniques. Potential applications include: - Exploratory Data Analysis (EDA): Understanding property distribution across London, price trends, and property types. - Price Prediction Models: Building machine learning models to estimate property prices based on available features. - Real Estate Trend Analysis: Analyzing trends in London’s real estate market, such as price fluctuations or differences in property features by neighborhood. - Text Analysis: Using the property descriptions for natural language processing (NLP) to extract keywords or sentiment related to property value or appeal.

Column Descriptions

• addedOn: Date when the property listing was added or updated on the website.
• title: Brief listing title describing the property, typically including the number of bedrooms and the location.
• descriptionHtml: Detailed description of the property, including features and potentially some promotional language.
• propertyType: Type of property, such as House, Terraced, or Detached.
• sizeSqFeetMax: Maximum size of the property in square feet, if provided.
• bedrooms: Number of bedrooms in the property.
• bathrooms: Number of bathrooms in the property.
• listingUpdateReason: Reason for updating the listing (e.g., new listing, price reduction).
• price: Price at which the property is listed for sale.

Ethically Mined Data

This dataset was ethically mined from a publicly accessible website using the APIFY API. All data in this dataset reflects publicly available information about properties listed for sale, with no Personally Identifiable Information (PII) included. The dataset does not include any data that could infringe on individual privacy.

Acknowledgements

• Data Source: Rightmove for providing publicly accessible real estate listings.
• Image Credit: Photo by Douglas Sheppard on Unsplash.

FOCUSONLONDON2011: HOUSING:AGROWINGCITY With the highest average incomes in the country but the least space to grow, demand for housing in London has long outstripped supply, resulting in higher housing costs and rising levels of overcrowding. The pressures of housing demand in London have grown in recent years, in part due to fewer people leaving London to buy homes in other regions. But while new supply during the recession held up better in London than in other regions, it needs to increase significantly in order to meet housing needs and reduce housing costs to more affordable levels. This edition of Focus on London authored by James Gleeson in the Housing Unit looks at housing trends in London, from the demand/supply imbalance to the consequences for affordability and housing need. PRESENTATION: How much pressure is London’s popularity putting on housing provision in the capital? This interactive presentation looks at the effect on housing pressure of demographic changes, and recent new housing supply, shown by trends in overcrowding and house prices. Click on the start button at the bottom of the slide to access. View Focus on London - Housing: A Growing City on Prezi FACTS: Some interesting facts from the data… ● Five boroughs with the highest proportion of households that have lived at their address for less than 12 months in 2009/10:

This dataset contains various characteristics and price information about houses in London. Consisting of 1000 entries, it reflects many aspects of each house, from location to interior design. In addition to physical features such as the address, neighborhood, number of rooms, and square footage, it also includes more specific details like the age of the building, garage availability, and balcony presence. Furthermore, the price of each house provides valuable insights into its market value.

Columns;

Address: The address of the house.

Neighborhood: The neighborhood or district where the house is located.

Bedrooms: The number of bedrooms in the house.

Bathrooms: The number of bathrooms in the house.

Square Meters: The total size of the house in square meters.

Building Age: The age of the building, indicating how long ago it was constructed.

Garden: Indicates whether the house has a garden ("Yes" or "No").

Garage: Indicates whether the house has a garage ("Yes" or "No").

Floors: The total number of floors in the house.

Property Type: The type of property, such as "Apartment" or "House."

Heating Type: The type of heating system used in the house (e.g., "Central Heating," "Gas").

Balcony: Indicates whether the house has a balcony ("Yes" or "No").

Interior Style: The interior design style of the house (e.g., "Modern," "Contemporary").

View: The type of view from the house (e.g., "City View," "Sea View").

Materials: The materials used in the construction of the house (e.g., "Brick," "Wood").

Building Status: The current condition of the building (e.g., "New," "Renovated," "Old").

Price (£): The sale price of the house, in British pounds (£).

This dataset contains detailed information about rental properties across various locations in the UK. The data was collected by scraping Rightmove, a popular real estate platform. Each entry in the dataset includes the property's address, subdistrict code, rental price, deposit amount, letting type, furnish type, council tax details, property type, number of bedrooms and bathrooms, size in square feet, average distance to the nearest train station, and the count of nearest stations.

Researchers and analysts interested in the UK rental market can utilize this dataset to explore rental trends, pricing variations based on location and property type, amenities preferences, and more. The dataset provides a valuable resource for machine learning models, statistical analysis, and market research in the real estate sector.

Metadata: Source: The data was collected by scraping the Rightmove real estate platform, a leading source for property listings in the UK. Date Range: The dataset covers rental property listings available during the scraping period. Geographical Coverage: Primarily focused on various locations across the UK, providing insights into regional rental markets. Data Fields: Address: The location of the rental property. Subdistrict Code: A code representing the subdistrict or area of the property. Rent: The monthly rental price in GBP (£) for the property. Deposit: The deposit amount required for renting the property. Let Type: Indicates whether the property is available for short-term or long-term rental. Furnish Type: Describes the furnishing status of the property (e.g., furnished, unfurnished, or flexible options). Council Tax: Information about the council tax associated with the property. Property Type: Specifies the type of property, such as apartment, flat, maisonette, etc. Bedrooms: The number of bedrooms in the property. Bathrooms: The number of bathrooms in the property. Size: The size of the property in square feet (sq ft). Average Distance to Nearest Station: The average distance (in miles) to the nearest train station from the property. Nearest Station Count: The count of nearest train stations within a certain distance from the property. Data Quality: The data may contain missing values or "Ask agent" placeholders, which require direct inquiry with agents or landlords for specific information. Potential Uses: The dataset can be used for market analysis, rental price prediction models, understanding property preferences, and exploring the impact of location and amenities on rental properties in the UK.

The Greater London Authority's ‘Housing in London’ report sets out the evidence base for the Mayor's housing policies, summarising key patterns and trends across a wide range of topics relevant to housing in the capital. The report is the evidence base for the Mayor’s London Housing Strategy, the latest edition of which was published in May 2018. The 2024 edition of Housing in London can be viewed here. It includes monitoring indicators for the London Housing Strategy, and five thematic chapters: Demographic, economic and social context Housing stock and supply Housing costs and affordability Housing needs, including homelessness and overcrowding Mobility and decent homes

Through reading this publication you will: • gain an understanding of how house prices are set in economics terms, how they are measured, and why the cost of housing matters for London’s economy and its residents • see whether incomes and earnings in London have kept pace with the costs of home ownership in London, and see how affordability may be affected by future changes in interest rates • find out about the drivers of demand for residential property in London, and how the supply of homes has responded to changing conditions

About this dataset

Context

The dataset presents the median household income across different racial categories in London. It portrays the median household income of the head of household across racial categories (excluding ethnicity) as identified by the Census Bureau. The dataset can be utilized to gain insights into economic disparities and trends and explore the variations in median houshold income for diverse racial categories.

Key observations

Based on our analysis of the distribution of London population by race & ethnicity, the population is predominantly White. This particular racial category constitutes the majority, accounting for 89.24% of the total residents in London. Notably, the median household income for White households is $63,590. Interestingly, White is both the largest group and the one with the highest median household income, which stands at $63,590.

Content

When available, the data consists of estimates from the U.S. Census Bureau American Community Survey (ACS) 2019-2023 5-Year Estimates.

Racial categories include:

• White
• Black or African American
• American Indian and Alaska Native
• Asian
• Native Hawaiian and Other Pacific Islander
• Some other race
• Two or more races (multiracial)

Variables / Data Columns

• Race of the head of household: This column presents the self-identified race of the household head, encompassing all relevant racial categories (excluding ethnicity) applicable in London.
• Median household income: Median household income, adjusting for inflation, presented in 2023-inflation-adjusted dollars

Good to know

Margin of Error

Data in the dataset are based on the estimates and are subject to sampling variability and thus a margin of error. Neilsberg Research recommends using caution when presening these estimates in your research.

Custom data

If you do need custom data for any of your research project, report or presentation, you can contact our research staff at research@neilsberg.com for a feasibility of a custom tabulation on a fee-for-service basis.

Inspiration

Neilsberg Research Team curates, analyze and publishes demographics and economic data from a variety of public and proprietary sources, each of which often includes multiple surveys and programs. The large majority of Neilsberg Research aggregated datasets and insights is made available for free download at https://www.neilsberg.com/research/.

Recommended for further research

This dataset is a part of the main dataset for London median household income by race. You can refer the same here

Median price paid for residential property in England and Wales, for all property types by lower layer super output area. Annual data..

Starts and completions of new build dwellings in the UK, on a quarterly and annual basis, time series data

📹Project Video available on YouTube - https://youtu.be/q-Omt6LgRLc

🖇️Connect with me on LinkedIn - https://www.linkedin.com/in/rohit-grewal

London Housing Price Dataset

The dataset contains housing market information for different areas of London over time. It includes details such as average house prices, the number of houses sold, and crime statistics. The data spans multiple years and is organized by date and geographic area.

This data is available as a CSV file. We are going to analyze this data set using the Pandas DataFrame.

Using this dataset, we answered multiple questions with Python in our Project.

Q. 1) Convert the Datatype of 'Date' column to Date-Time format.

Q. 2.A) Add a new column ''year'' in the dataframe, which contains years only.

Q. 2.B) Add a new column ''month'' as 2nd column in the dataframe, which contains month only.

Q. 3) Remove the columns 'year' and 'month' from the dataframe.

Q. 4) Show all the records where 'No. of Crimes' is 0. And, how many such records are there ?

Q. 5) What is the maximum & minimum 'average_price' per year in england ?

Q. 6) What is the Maximum & Minimum No. of Crimes recorded per area ?

Q. 7) Show the total count of records of each area, where average price is less than 100000.

Enrol in our Udemy courses : 1. Python Data Analytics Projects - https://www.udemy.com/course/bigdata-analysis-python/?referralCode=F75B5F25D61BD4E5F161 2. Python For Data Science - https://www.udemy.com/course/python-for-data-science-real-time-exercises/?referralCode=9C91F0B8A3F0EB67FE67 3. Numpy For Data Science - https://www.udemy.com/course/python-numpy-exercises/?referralCode=FF9EDB87794FED46CBDF

These are the main Features/Columns available in the dataset :

1) Date – The month and year when the data was recorded.

2) Area – The London borough or area for which the housing and crime data is reported.

3) Average_price – The average house price in the given area during the specified month.

4) Code – The unique area code (e.g., government statistical code) corresponding to each borough or region.

5) Houses_sold – The number of houses sold in the given area during the specified month.

6) No_of_crimes – The number of crimes recorded in the given area during the specified month.

This dataset provides information about the number of properties, residents, and average property values for May Lene Drive cross streets in London, KY.

About this dataset

Context

The dataset presents the median household income across different racial categories in London. It portrays the median household income of the head of household across racial categories (excluding ethnicity) as identified by the Census Bureau. The dataset can be utilized to gain insights into economic disparities and trends and explore the variations in median houshold income for diverse racial categories.

Key observations

Based on our analysis of the distribution of London population by race & ethnicity, the population is predominantly White. This particular racial category constitutes the majority, accounting for 91.60% of the total residents in London. Notably, the median household income for White households is $48,134. Interestingly, White is both the largest group and the one with the highest median household income, which stands at $48,134.

https://i.neilsberg.com/ch/london-ar-median-household-income-by-race.jpeg" alt="London median household income diversity across racial categories">

Content

When available, the data consists of estimates from the U.S. Census Bureau American Community Survey (ACS) 2017-2021 5-Year Estimates.

Racial categories include:

• White
• Black or African American
• American Indian and Alaska Native
• Asian
• Native Hawaiian and Other Pacific Islander
• Some other race
• Two or more races (multiracial)

Variables / Data Columns

• Race of the head of household: This column presents the self-identified race of the household head, encompassing all relevant racial categories (excluding ethnicity) applicable in London.
• Median household income: Median household income, adjusting for inflation, presented in 2022-inflation-adjusted dollars

Good to know

Margin of Error

Data in the dataset are based on the estimates and are subject to sampling variability and thus a margin of error. Neilsberg Research recommends using caution when presening these estimates in your research.

Custom data

If you do need custom data for any of your research project, report or presentation, you can contact our research staff at research@neilsberg.com for a feasibility of a custom tabulation on a fee-for-service basis.

Inspiration

Neilsberg Research Team curates, analyze and publishes demographics and economic data from a variety of public and proprietary sources, each of which often includes multiple surveys and programs. The large majority of Neilsberg Research aggregated datasets and insights is made available for free download at https://www.neilsberg.com/research/.

Recommended for further research

This dataset is a part of the main dataset for London median household income by race. You can refer the same here

This house price per square metre dataset is created through complex address-based matching between the Land Registry’s Price Paid Data (LR-PPD) and property size information from the Domestic Energy Performance Certificates (EPC) data published by the Department for Levelling Up, Housing and Communities (DLUHC, formerly MHCLG). Details of the data linkage are published in the UCL Open: Environment along with the related linkage code via the UK Data Service ReShare repository.

During this data linkage process, the transactions assigned as category B (Additional Price Paid entry) and other property types are removed. Here we publish our latest limited attribute version of the uncorrected house price per square metre dataset in England and Wales with the LR-PPD data (1/1/1995-26/2/2021) and Domestic EPCs data (the sixth version, up to 20/9/2020) downloaded on 1/4/2021 for non-commercial purpose. This uncorrected version of house price per square metre dataset records over 18 million transactions with 16 variables in England and Wales since 1995. Unlike in our published article, in this uncorrected version we have not removed transactions with any improbable price per square metre values - i.e. where either the transaction price or total floor area values are null, 0 or too low to be realistic. This uncorrected version of the data will offer the most flexibility for researchers.

We offer technical validation and data cleaning code via the UKDA ReShare repository to help users evaluate the representation of the linked data for a given time period. The data cleaning code shows our methods for cleaning up unlikely floor size records before using this data in analysis. Users can create their own rules and undertake this clean-up process based on their own experience and research aims.

This limited attribute version is published by local authority (2021 version). Details of the 16 variables are described in the explanation file. The National Statistics Postcode Lookup NSPL (May 2021 version) is used to assign the local authority unit for your production of area-based statistics. Users can match historical changes in LA boundaries by choosing appropriate aggregations using, for instance ONSPD, and the postcode variable in our dataset.

An extended version of this dataset containing additional variables is available from UK Data Service Reshare service. Users can directly access this full version dataset (tranall_link_01042021.zip) via the following link: https://reshare.ukdataservice.ac.uk/855033/ . Accompanying LR-PPD and EPC data are also supplied through the ReShare service. Users who would like to attach their own additional variables from the LR-PPD data are advised to use the transactionid variable to link to the LR-PPD (LRPPD_01042021.zip). Users who would like to attach additional variables from the EPC data are advised to use the id variable to link to the sixth version Domestic EPCs (epc6_id.zip).

The 2024 update

The 2024 updated version of the house price per square metre dataset extends the data coverage to the end of 2024 ( hpm_la_2024.zip ). This new version is the result of linking LR-PPD data (01/01/1995–31/10/2024) and Domestic EPCs data (up to 31/10/2024), downloaded on 26/12/2024 for non-commercial purposes. It records over 22 million transactions in England and Wales since 1995.

Unlike the previous versions, this updated removes the id variable (created by the authors) and adds the lmk_key variable (originally from the Domestic EPCs dataset). This change was made because the lmk_key serves as a unique identifier with no duplicate records since 2024.

The match rate of the linked data varies over time; therefore, we recommend users carefully choose the time coverage and validate the data coverage using the match rate. Please note that publicly available Domestic EPCs data starts in 2008, resulting in an extremely low match rate for the period between 1995 and 2008.

The National Statistics Postcode Lookup (November 2024 version) is used to assign local authorities (2023 version)

About this dataset

Context

The dataset tabulates the Non-Hispanic population of London by race. It includes the distribution of the Non-Hispanic population of London across various race categories as identified by the Census Bureau. The dataset can be utilized to understand the Non-Hispanic population distribution of London across relevant racial categories.

Key observations

Of the Non-Hispanic population in London, the largest racial group is White alone with a population of 9,284 (90.21% of the total Non-Hispanic population).

Content

When available, the data consists of estimates from the U.S. Census Bureau American Community Survey (ACS) 2019-2023 5-Year Estimates.

Racial categories include:

• White
• Black or African American
• American Indian and Alaska Native
• Asian
• Native Hawaiian and Other Pacific Islander
• Some other race
• Two or more races (multiracial)

Variables / Data Columns

• Race: This column displays the racial categories (for Non-Hispanic) for the London
• Population: The population of the racial category (for Non-Hispanic) in the London is shown in this column.
• % of Total Population: This column displays the percentage distribution of each race as a proportion of London total Non-Hispanic population. Please note that the sum of all percentages may not equal one due to rounding of values.

Good to know

Margin of Error

Data in the dataset are based on the estimates and are subject to sampling variability and thus a margin of error. Neilsberg Research recommends using caution when presening these estimates in your research.

Custom data

If you do need custom data for any of your research project, report or presentation, you can contact our research staff at research@neilsberg.com for a feasibility of a custom tabulation on a fee-for-service basis.

Inspiration

Neilsberg Research Team curates, analyze and publishes demographics and economic data from a variety of public and proprietary sources, each of which often includes multiple surveys and programs. The large majority of Neilsberg Research aggregated datasets and insights is made available for free download at https://www.neilsberg.com/research/.

Recommended for further research

This dataset is a part of the main dataset for London Population by Race & Ethnicity. You can refer the same here