https://raw.githubusercontent.com/Masterx-AI/Project_Housing_Price_Prediction_/main/hs.jpg" alt="">

Description:

A simple yet challenging project, to predict the housing price based on certain factors like house area, bedrooms, furnished, nearness to mainroad, etc. The dataset is small yet, it's complexity arises due to the fact that it has strong multicollinearity. Can you overcome these obstacles & build a decent predictive model?

Acknowledgement:

Harrison, D. and Rubinfeld, D.L. (1978) Hedonic prices and the demand for clean air. J. Environ. Economics and Management 5, 81–102. Belsley D.A., Kuh, E. and Welsch, R.E. (1980) Regression Diagnostics. Identifying Influential Data and Sources of Collinearity. New York: Wiley.

Objective:

• Understand the Dataset & cleanup (if required).
• Build Regression models to predict the sales w.r.t a single & multiple feature.
• Also evaluate the models & compare thier respective scores like R2, RMSE, etc.

Affordability ratios calculated by dividing house prices by gross annual residence-based earnings. Based on the median and lower quartiles of both house prices and earnings in England and Wales.

A dataset comprising various variables around housing and demographics for the top 50 American cities by population.

Variables:

Zip Code: Zip code within which the listing is present.

Price: Listed price for the property.

Beds: Number of beds mentioned in the listing.

Baths: Number of baths mentioned in the listing.

Living Space: The total size of the living space, in square feet, mentioned in the listing.

Address: Street address of the listing.

City: City name where the listing is located.

State: State name where the listing is located.

Zip Code Population: The estimated number of individuals within the zip code. Data from Simplemaps.com.

Zip Code Density: The estimated number of individuals per square mile within the zip code. Data from Simplemaps.com.

County: County where the listing is located.

Median Household income: Estimated median household income. Data from the U.S. Census Bureau.

Latitude: Latitude of the zip code. ** Data from Simplemaps.com.**

Longitude: Longitude of the zip code. Data from Simplemaps.com.

This table contains data on the percent of households paying more than 30% (or 50%) of monthly household income towards housing costs for California, its regions, counties, cities/towns, and census tracts. Data is from the U.S. Department of Housing and Urban Development (HUD), Consolidated Planning Comprehensive Housing Affordability Strategy (CHAS) and the U.S. Census Bureau, American Community Survey (ACS). The table is part of a series of indicators in the [Healthy Communities Data and Indicators Project of the Office of Health Equity] Affordable, quality housing is central to health, conferring protection from the environment and supporting family life. Housing costs—typically the largest, single expense in a family's budget—also impact decisions that affect health. As housing consumes larger proportions of household income, families have less income for nutrition, health care, transportation, education, etc. Severe cost burdens may induce poverty—which is associated with developmental and behavioral problems in children and accelerated cognitive and physical decline in adults. Low-income families and minority communities are disproportionately affected by the lack of affordable, quality housing. More information about the data table and a data dictionary can be found in the Attachments.

The Housing Affordability Data System (HADS) is a set of files derived from the 1985 and later national American Housing Survey (AHS) and the 2002 and later Metro AHS. This system categorizes housing units by affordability and households by income, with respect to the Adjusted Median Income, Fair Market Rent (FMR), and poverty income. It also includes housing cost burden for owner and renter households. These files have been the basis for the worst case needs tables since 2001. The data files are available for public use, since they were derived from AHS public use files and the published income limits and FMRs. These dataset give the community of housing analysts the opportunity to use a consistent set of affordability measures. The most recent year HADS is available as a Public Use File (PUF) is 2013. For 2015 and beyond, HADS is only available as an IUF and can no longer be released on a PUF. Those seeking access to more recent data should reach to the listed point of contact.

The housing affordability measure illustrates the relationship between income and housing costs. A household that spends 30% or more of its collective monthly income to cover housing costs is considered to be “housing cost-burden[ed].”[1] Those spending between 30% and 49.9% of their monthly income are categorized as “moderately housing cost-burden[ed],” while those spending more than 50% are categorized as “severely housing cost-burden[ed].”[2]

How much a household spends on housing costs affects the household’s overall financial situation. More money spent on housing leaves less in the household budget for other needs, such as food, clothing, transportation, and medical care, as well as for incidental purchases and saving for the future.

The estimated housing costs as a percentage of household income are categorized by tenure: all households, those that own their housing unit, and those that rent their housing unit.

Throughout the period of analysis, the percentage of housing cost-burdened renter households in Champaign County was higher than the percentage of housing cost-burdened homeowner households in Champaign County. All three categories saw year-to-year fluctuations between 2005 and 2023, and none of the three show a consistent trend. However, all three categories were estimated to have a lower percentage of housing cost-burdened households in 2023 than in 2005.

Data on estimated housing costs as a percentage of monthly income was sourced from the U.S. Census Bureau’s American Community Survey (ACS) 1-Year Estimates, which are released annually.

As with any datasets that are estimates rather than exact counts, it is important to take into account the margins of error (listed in the column beside each figure) when drawing conclusions from the data.

Due to the impact of the COVID-19 pandemic, instead of providing the standard 1-year data products, the Census Bureau released experimental estimates from the 1-year data in 2020. This includes a limited number of data tables for the nation, states, and the District of Columbia. The Census Bureau states that the 2020 ACS 1-year experimental tables use an experimental estimation methodology and should not be compared with other ACS data. For these reasons, and because data is not available for Champaign County, no data for 2020 is included in this Indicator.

For interested data users, the 2020 ACS 1-Year Experimental data release includes a dataset on Housing Tenure.

[1] Schwarz, M. and E. Watson. (2008). Who can afford to live in a home?: A look at data from the 2006 American Community Survey. U.S. Census Bureau.

[2] Ibid.

Sources: U.S. Census Bureau; American Community Survey, 2023 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using data.census.gov; (17 October 2024).; U.S. Census Bureau; American Community Survey, 2022 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using data.census.gov; (22 September 2023).; U.S. Census Bureau; American Community Survey, 2021 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using data.census.gov; (30 September 2022).; U.S. Census Bureau; American Community Survey, 2019 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using data.census.gov; (10 June 2021).; U.S. Census Bureau; American Community Survey, 2018 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using data.census.gov; (10 June 2021).;U.S. Census Bureau; American Community Survey, 2017 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (13 September 2018).; U.S. Census Bureau; American Community Survey, 2016 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (14 September 2017).; U.S. Census Bureau; American Community Survey, 2015 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (19 September 2016).; U.S. Census Bureau; American Community Survey, 2014 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2013 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2012 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2011 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2010 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2009 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2008 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; 16 March 2016).; U.S. Census Bureau; American Community Survey, 2007 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2006 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).; U.S. Census Bureau; American Community Survey, 2005 American Community Survey 1-Year Estimates, Table B25106; generated by CCRPC staff; using American FactFinder; (16 March 2016).

A commonly accepted threshold for affordable housing costs at the household level is 30% of a household's income. Accordingly, a household is considered cost burdened if it pays more than 30% of its income on housing. Households paying more than 50% are considered severely cost burdened. These thresholds apply to both homeowners and renters.

The Housing Affordability indicator only measures cost burden among the region's households, and not the supply of affordable housing. The directionality of cost burden trends can be impacted by changes in both income and housing supply. If lower income households are priced out of a county or the region, it would create a downward trend in cost burden, but would not reflect a positive trend for an inclusive housing market.

This dataset provides insights into the global housing market, covering various economic factors from 2015 to 2024. It includes details about property prices, rental yields, interest rates, and household income across multiple countries. This dataset is ideal for real estate analysis, financial forecasting, and market trend visualization.

📑 Column Descriptions

Affordability ratios calculated by dividing house prices by gross annual workplace-based earnings. Based on the median and lower quartiles of both house prices and earnings in England and Wales.

The standardised house price-to-income ratio is defined as the ratio of the current price to income ratio relative to the long-term average price-to-income ratio, calculated over the period 2000 to the most recent data available. If the ratio equals 100, it means the current price-to-income ratio is equal to its long term average. House prices are provided by Eurostat, and income is calculated as adjusted household gross disposable income (B7G) per head of population based on Eurostat data.

Housing affordability (median house prices to earnings ratio)

Displacement risk indicator showing how many households within the specified groups are facing either housing cost burden (contributing more than 30% of monthly income toward housing costs) or severe housing cost burden (contributing more than 50% of monthly income toward housing costs).

Portugal, Canada, and the United States were the countries with the highest house price to income ratio in 2024. In all three countries, the index exceeded 130 index points, while the average for all OECD countries stood at 116.2 index points. The index measures the development of housing affordability and is calculated by dividing nominal house price by nominal disposable income per head, with 2015 set as a base year when the index amounted to 100. An index value of 120, for example, would mean that house price growth has outpaced income growth by 20 percent since 2015. How have house prices worldwide changed since the COVID-19 pandemic? House prices started to rise gradually after the global financial crisis (2007–2008), but this trend accelerated with the pandemic. The countries with advanced economies, which usually have mature housing markets, experienced stronger growth than countries with emerging economies. Real house price growth (accounting for inflation) peaked in 2022 and has since lost some of the gain. Although, many countries experienced a decline in house prices, the global house price index shows that property prices in 2023 were still substantially higher than before COVID-19. Renting vs. buying In the past, house prices have grown faster than rents. However, the home affordability has been declining notably, with a direct impact on rental prices. As people struggle to buy a property of their own, they often turn to rental accommodation. This has resulted in a growing demand for rental apartments and soaring rental prices.

Rental Affordability Analysis Based on Median Income

Trends in Tier-Based Affordability Across the U.S

By Zillow Data [source]

About this dataset

This dataset contains rental affordability data for different regions in the US, giving valuable insights into regional rental markets. Renters can use this information to identify where their budget will go the farthest. The cities are organized by rent tier in order to analyze affordability trends within and between different housing stock types. Within each region, the data includes median household income, Zillow Rent Index (ZRI), and percent of income spent on rent.

The Zillow Home Value Forecast (ZHVF) is used to calculate future combined mortgage pay/rent payments in each region using current median home prices, actual outstanding debt amounts and 30-year fixed mortgage interest rates reported through partnership with TransUnion credit bureau. Zillow also provides a breakdown of cash vs financing purchases for buyers looking for an investment or cash option solution.

This dataset provides an effective tool for consumers who want to better understand how their budget fits into diverse rental markets across the US; from condominiums and co-ops, multifamily residences with five or more units, duplexes and triplexes - every renter can determine how their housing budget should be adjusted as they consider multiple living possibilities throughout the country based on real-time price data!

More Datasets

For more datasets, click here.

Featured Notebooks

• 🚨 Your notebook can be here! 🚨!

How to use the dataset

Introduction

Getting Started

• First, you'll need to download the TieredAffordability_Rental.csv dataset from this Kaggle page onto your computer or device.

• After downloading the data set onto your device, open it with any CSV viewing software of your choice (ex: Excel). It will include columns for RegionName**RegionName** , homes type/housing stock (All Homes or Condo/Co-op) SizeRank , Rent tier tier , Date date , median household income income , Zillow Rent Index zri and PercentIncomeSpentOnRent percentage (what portion of monthly median house-hold goes toward monthly mortgage payment) .

• To begin analyzing rental prices across different regions using this dataset, look first at column four: SizeRank; which ranks each region based on size - smallest regions listed first and largest at last - so that you can compare a similar range of Regions when looking at affordability by home sizes larger than one unit multiplex dwellings.*Duples/Triplex*. Once there is an understanding of how all homes compare overall now it is time to consider home types Multifamily 5+ units according to rent tiers tier .

• Next, choose one or more region(s) for comparison based on their rank in SizeRank column –so that all information gathered about them reflects what portionof households fall into certain categories ; eg; All Homes / Small Home /Large Home / MultiPlex Dwelling and what tier does each size rank falls into eg.: Affordable/Slightly Expensive/ Moderately Expensive etc.. This will enable further abstraction from other elements like date vs inflation rate per month or periodical intervals set herein by Rate segmentation i e dates givenin ‘Date’Columns – making the task easier and more direct while analyzing renatalAffordibility Analysis Based On Median Income zri 00 zwi & PCISOR 00 PCIRO

Research Ideas

• Use the PercentIncomeSpentOnRent column to compare rental affordability between regions within a particular tier and determine optimal rent tiers for relocating families.
• Analyze how market conditions are affecting rental affordability over time by using the income, zri, and PercentageIncomeSpentOnRent columns.
• Identify trends in housing prices for different tiers over the years by comparing SizeRank data with Zillow Home Value Forecast (ZHVF) numbers across different regions in order to identify locations that may be headed up or down in terms of home values (and therefore rent levels)

Acknowledgements

If you use this dataset in your research, please credit the original authors. Data Source

License

See the dataset description for more information.

Columns

File: TieredAffordability_Rental.csv | Column name | Description | |:-----------------------------|:-------------------------------------------------------------| | RegionName | The name of the region. (String) ...

The Housing Affordability Data System (HADS) is a set of housing unit level datasets that measures the affordability of housing units and the housing cost burdens of households, relative to area median incomes, poverty level incomes, and Fair Market Rents. The purpose of these datasets is to provide housing analysts with consistent measures of affordability and burdens over a long period. The datasets are based on the American Housing Survey (AHS) national files from 1985 through 2005 and the metropolitan files for 2002 and 2004. Users can link records in HADS files to AHS records, allowing access to all of the AHS variables. Housing-level variables include information on the number of rooms in the housing unit, the year the unit was built, whether it was occupied or vacant, whether the unit was rented or owned, whether it was a single family or multiunit structure, the number of units in the building, the current market value of the unit, and measures of relative housing costs. The dataset also includes variables describing the number of people living in the household, household income, and the type of residential area (e.g., urban or suburban).

This is the unadjusted median house priced for residential property sales (transactions) in the area for a 12 month period with April in the middle (year-ending September). These figures have been produced by the ONS (Office for National Statistics) using the Land Registry (LR) Price Paid data on residential dwelling transactions.

The LR Price Paid data are comprehensive in that they capture changes of ownership for individual residential properties which have sold for full market value and covers both cash sales and those involving a mortgage.

The median is the value determined by putting all the house sales for a given year, area and type in order of price and then selecting the price of the house sale which falls in the middle. The median is less susceptible to distortion by the presence of extreme values than is the mean. It is the most appropriate average to use because it best takes account of the skewed distribution of house prices.

Note that a transaction occurs when a change of freeholder or leaseholder takes place regardless of the amount of money involved and a property can transact more than once in the time period.

The LR records the actual price for which the property changed hands. This will usually be an accurate reflection of the market value for the individual property, but it is not always the case. In order to generate statistics that more accurately reflect market values, the LR has excluded records of houses that were not sold at market value from the dataset. The remaining data are considered a good reflection of market values at the time of the transaction. For full details of exclusions and more information on the methodology used to produce these statistics please see http://www.ons.gov.uk/peoplepopulationandcommunity/housing/qmis/housepricestatisticsforsmallareasqmi

The LR Price Paid data are not adjusted to reflect the mix of houses in a given area. Fluctuations in the types of house that are sold in that area can cause differences between the median transactional value of houses and the overall market value of houses. Therefore these statistics differ to the new UK House Price Index (HPI) which reports mix-adjusted average house prices and house price indices.

If, for a given year, for house type and area there were fewer than 5 sales records in the LR Price Paid data, the house price statistics are not reported. Data is Powered by LG Inform Plus and automatically checked for new data on the 3rd of each month.

The FHFA House Price Index (FHFA HPI®) is the nation’s only collection of public, freely available house price indexes that measure changes in single-family home values based on data from all 50 states and over 400 American cities that extend back to the mid-1970s. The FHFA HPI incorporates tens of millions of home sales and offers insights about house price fluctuations at the national, census division, state, metro area, county, ZIP code, and census tract levels. FHFA uses a fully transparent methodology based upon a weighted, repeat-sales statistical technique to analyze house price transaction data. ​ What does the FHFA HPI represent? The FHFA HPI is a broad measure of the movement of single-family house prices. The FHFA HPI is a weighted, repeat-sales index, meaning that it measures average price changes in repeat sales or refinancings on the same properties. This information is obtained by reviewing repeat mortgage transactions on single-family properties whose mortgages have been purchased or securitized by Fannie Mae or Freddie Mac since January 1975. The FHFA HPI serves as a timely, accurate indicator of house price trends at various geographic levels. Because of the breadth of the sample, it provides more information than is available in other house price indexes. It also provides housing economists with an improved analytical tool that is useful for estimating changes in the rates of mortgage defaults, prepayments and housing affordability in specific geographic areas. U.S. Federal Housing Finance Agency, All-Transactions House Price Index for Connecticut [CTSTHPI], retrieved from FRED, Federal Reserve Bank of St. Louis; https://fred.stlouisfed.org/series/CTSTHPI, August 2, 2023.

Graph and download economic data for Median Sales Price of Houses Sold for the United States (MSPUS) from Q1 1963 to Q2 2025 about sales, median, housing, and USA.

First launched by the U.S. Department of Housing and Urban Development (HUD) and Department of Transportation (DOT) in November 2013, the Location Affordability Index (LAI) provides ubiquitous, standardized household housing and transportation cost estimates for all 50 states and the District of Columbia. Because what is affordable is different for everyone, users can choose among eight household profiles—which vary by household income, size, and number of commuters—and see the impact of the built environment on affordability in a given location while holding household demographics constant.

Version 3 updates the constituent data sets with 2012-2016 American Community Survey data and makes several methodological tweaks, most notably moving to modeling at the Census tract level rather at the block group. As with Version 2, the inputs to the simultaneous equation model (SEM) include six endogenous variables—housing costs, car ownership, and transit usage for both owners and renters—and 18 exogenous variables, with vehicle miles traveled still modeled separately due to data limitations.To learn more about the Location Affordability Index (v.3) visit: https://www.hudexchange.info/programs/location-affordability-index/, for questions about the spatial attribution of this dataset, please reach out to us at GISHelpdesk@hud.gov. Date of Coverage: 2012-2016 Data Dictionary: DD_Location Affordability Indev v.3.0LAI Version 3 Data and MethodologyLAI Version 3 Technical Documentation

This table shows the average House Price/Earnings ratio, which is an important indicator of housing affordability. Ratios are calculated by dividing house price by the median earnings of a borough. The Annual Survey of Hours and Earnings (ASHE) is based on a 1 per cent sample of employee jobs. Information on earnings and hours is obtained in confidence from employers. It does not cover the self-employed nor does it cover employees not paid during the reference period. Information is as at April each year. The statistics used are workplace based full-time individual earnings. Pre-2013 Land Registry housing data are for the first half of the year only, so that they are comparable to the ASHE data which are as at April. This is no longer the case from 2013 onwards as this data uses house price data from the ONS House Price Statistics for Small Areas statistical release. Prior to 2006 data are not available for Inner and Outer London. The lowest 25 per cent of prices are below the lower quartile; the highest 75 per cent are above the lower quartile. The "lower quartile" property price/income is determined by ranking all property prices/incomes in ascending order. The 'median' property price/income is determined by ranking all property prices/incomes in ascending order. The point at which one half of the values are above and one half are below is the median. Regional data has not been published by DCLG since 2012. Data for regions has been calculated by the GLA. Data since 2014 has been calculated by the GLA using Land Registry house prices and ONS Earnings data. Link to DCLG Live Tables An interactive map showing the affordability ratios by local authority for 2013, 2014 and 2015 is also available.