https://raw.githubusercontent.com/Masterx-AI/Project_Housing_Price_Prediction_/main/hs.jpg" alt="">

Description:

A simple yet challenging project, to predict the housing price based on certain factors like house area, bedrooms, furnished, nearness to mainroad, etc. The dataset is small yet, it's complexity arises due to the fact that it has strong multicollinearity. Can you overcome these obstacles & build a decent predictive model?

Acknowledgement:

Harrison, D. and Rubinfeld, D.L. (1978) Hedonic prices and the demand for clean air. J. Environ. Economics and Management 5, 81–102. Belsley D.A., Kuh, E. and Welsch, R.E. (1980) Regression Diagnostics. Identifying Influential Data and Sources of Collinearity. New York: Wiley.

Objective:

• Understand the Dataset & cleanup (if required).
• Build Regression models to predict the sales w.r.t a single & multiple feature.
• Also evaluate the models & compare thier respective scores like R2, RMSE, etc.

Graph and download economic data for Average Sales Price of Houses Sold for the United States (ASPUS) from Q1 1963 to Q2 2025 about sales, housing, and USA.

House Price Prediction Dataset.

The dataset contains 2000 rows of house-related data, representing various features that could influence house prices. Below, we discuss key aspects of the dataset, which include its structure, the choice of features, and potential use cases for analysis.

1. Dataset Features

The dataset is designed to capture essential attributes for predicting house prices, including:

Area: Square footage of the house, which is generally one of the most important predictors of price. Bedrooms & Bathrooms: The number of rooms in a house significantly affects its value. Homes with more rooms tend to be priced higher. Floors: The number of floors in a house could indicate a larger, more luxurious home, potentially raising its price. Year Built: The age of the house can affect its condition and value. Newly built houses are generally more expensive than older ones. Location: Houses in desirable locations such as downtown or urban areas tend to be priced higher than those in suburban or rural areas. Condition: The current condition of the house is critical, as well-maintained houses (in 'Excellent' or 'Good' condition) will attract higher prices compared to houses in 'Fair' or 'Poor' condition. Garage: Availability of a garage can increase the price due to added convenience and space. Price: The target variable, representing the sale price of the house, used to train machine learning models to predict house prices based on the other features.

2. Feature Distributions

Area Distribution: The area of the houses in the dataset ranges from 500 to 5000 square feet, which allows analysis across different types of homes, from smaller apartments to larger luxury houses. Bedrooms and Bathrooms: The number of bedrooms varies from 1 to 5, and bathrooms from 1 to 4. This variance enables analysis of homes with different sizes and layouts. Floors: Houses in the dataset have between 1 and 3 floors. This feature could be useful for identifying the influence of multi-level homes on house prices. Year Built: The dataset contains houses built from 1900 to 2023, giving a wide range of house ages to analyze the effects of new vs. older construction. Location: There is a mix of urban, suburban, downtown, and rural locations. Urban and downtown homes may command higher prices due to proximity to amenities. Condition: Houses are labeled as 'Excellent', 'Good', 'Fair', or 'Poor'. This feature helps model the price differences based on the current state of the house. Price Distribution: Prices range between $50,000 and $1,000,000, offering a broad spectrum of property values. This range makes the dataset appropriate for predicting a wide variety of housing prices, from affordable homes to luxury properties.

3. Correlation Between Features

A key area of interest is the relationship between various features and house price: Area and Price: Typically, a strong positive correlation is expected between the size of the house (Area) and its price. Larger homes are likely to be more expensive. Location and Price: Location is another major factor. Houses in urban or downtown areas may show a higher price on average compared to suburban and rural locations. Condition and Price: The condition of the house should show a positive correlation with price. Houses in better condition should be priced higher, as they require less maintenance and repair. Year Built and Price: Newer houses might command a higher price due to better construction standards, modern amenities, and less wear-and-tear, but some older homes in good condition may retain historical value. Garage and Price: A house with a garage may be more expensive than one without, as it provides extra storage or parking space.

4. Potential Use Cases

The dataset is well-suited for various machine learning and data analysis applications, including:

House Price Prediction: Using regression techniques, this dataset can be used to build a model to predict house prices based on the available features. Feature Importance Analysis: By using techniques such as feature importance ranking, data scientists can determine which features (e.g., location, area, or condition) have the greatest impact on house prices. Clustering: Clustering techniques like k-means could help identify patterns in the data, such as grouping houses into segments based on their characteristics (e.g., luxury homes, affordable homes). Market Segmentation: The dataset can be used to perform segmentation by location, price range, or house type to analyze trends in specific sub-markets, like luxury vs. affordable housing. Time-Based Analysis: By studying how house prices vary with the year built or the age of the house, analysts can derive insights into the trends of older vs. newer homes.

5. Limitations and ...

The average sales price of new homes in the United States experienced a slight decrease in 2024, dropping to 512,2000 U.S. dollars from the peak of 521,500 U.S. dollars in 2022. This decline came after years of substantial price increases, with the average price surpassing 400,000 U.S. dollars for the first time in 2021. The recent cooling in the housing market reflects broader economic trends and changing consumer sentiment towards homeownership. Factors influencing home prices and affordability The rapid rise in home prices over the past few years has been driven by several factors, including historically low mortgage rates and increased demand during the COVID-19 pandemic. However, the market has since slowed down, with the number of home sales declining by over two million between 2021 and 2023. This decline can be attributed to rising mortgage rates and decreased affordability. The Housing Affordability Index hit a record low of 98.1 in 2023, indicating that the median-income family could no longer afford a median-priced home. Future outlook for the housing market Despite the recent cooling, experts forecast a potential recovery in the coming years. The Freddie Mac House Price Index showed a growth of 6.5 percent in 2023, which is still above the long-term average of 4.4 percent since 1990. However, homebuyer sentiment remains low across all age groups, with people aged 45 to 64 expressing the most pessimistic outlook. The median sales price of existing homes is expected to increase slightly until 2025, suggesting that affordability challenges may persist in the near future.

The U.S. housing market continues to evolve, with the median price for existing homes forecast to fall to ******* U.S. dollars by 2027. This projection comes after a period of significant growth and recent fluctuations, reflecting the complex interplay of economic factors affecting the real estate sector. The rising costs have not only impacted home prices but also down payments, with the median down payment more than doubling since 2012. Regional variations in housing costs Home prices and down payments vary dramatically across the United States. While the national median down payment stood at approximately ****** U.S. dollars in early 2024, homebuyers in states like California, Massachusetts, and Hawaii faced down payments exceeding ****** U.S. dollars. This disparity highlights the challenges of homeownership in high-cost markets and underscores the importance of location in determining housing affordability. Market dynamics and future outlook The housing market has shown signs of cooling after years of rapid growth, with a modest price increase of *** percent in 2024. This slowdown can be attributed in part to rising mortgage rates, which have tempered demand. Despite these challenges, most states continued to see year-over-year price growth in 2025, with Rhode Island and West Virginia leading the packby home appreciation. As the market adjusts to new economic realities, potential homebuyers and investors alike will be watching closely for signs of stabilization or renewed growth in the coming years.

View monthly updates and historical trends for US Existing Home Median Sales Price. from United States. Source: National Association of Realtors. Track ec…

The number of U.S. home sales in the United States declined in 2024, after soaring in 2021. A total of four million transactions of existing homes, including single-family, condo, and co-ops, were completed in 2024, down from 6.12 million in 2021. According to the forecast, the housing market is forecast to head for recovery in 2025, despite transaction volumes expected to remain below the long-term average. Why have home sales declined? The housing boom during the coronavirus pandemic has demonstrated that being a homeowner is still an integral part of the American dream. Nevertheless, sentiment declined in the second half of 2022 and Americans across all generations agreed that the time was not right to buy a home. A combination of factors has led to house prices rocketing and making homeownership unaffordable for the average buyer. A survey among owners and renters found that the high home prices and unfavorable economic conditions were the two main barriers to making a home purchase. People who would like to purchase their own home need to save up a deposit, have a good credit score, and a steady and sufficient income to be approved for a mortgage. In 2022, mortgage rates experienced the most aggressive increase in history, making the total cost of homeownership substantially higher. Are U.S. home prices expected to fall? The median sales price of existing homes stood at 413,000 U.S. dollars in 2024 and was forecast to increase slightly until 2026. The development of the S&P/Case Shiller U.S. National Home Price Index shows that home prices experienced seven consecutive months of decline between June 2022 and January 2023, but this trend reversed in the following months. Despite mild fluctuations throughout the year, home prices in many metros are forecast to continue to grow, albeit at a much slower rate.

Single Family Home Prices in the United States increased to 415200 USD in October from 412300 USD in September of 2025. This dataset provides - United States Existing Single Family Home Prices- actual values, historical data, forecast, chart, statistics, economic calendar and news.

Graph and download economic data for Median Sales Price of Houses Sold for the United States (MSPUS) from Q1 1963 to Q2 2025 about sales, median, housing, and USA.

The median sales price of new homes sold in the United States increased steadily from 1965 to 2022, followed by two years of decline. In 2024, a newly built home cost approximately ******* U.S. dollars. That was a decline from the peak price of 434,500 U.S. dollars in 2022. Prices varied greatly across different regions in the country, with the most expensive housing found in the Northeast region.

House prices grew year-on-year in most states in the U.S. in the first quarter of 2025. Hawaii was the only exception, with a decline of **** percent. The annual appreciation for single-family housing in the U.S. was **** percent, while in Rhode Island—the state where homes appreciated the most—the increase was ******percent. How have home prices developed in recent years? House price growth in the U.S. has been going strong for years. In 2025, the median sales price of a single-family home exceeded ******* U.S. dollars, up from ******* U.S. dollars five years ago. One of the factors driving house prices was the cost of credit. The record-low federal funds effective rate allowed mortgage lenders to set mortgage interest rates as low as *** percent. With interest rates on the rise, home buying has also slowed, causing fluctuations in house prices. Why are house prices growing? Many markets in the U.S. are overheated because supply has not been able to keep up with demand. How many homes enter the housing market depends on the construction output, whereas the availability of existing homes for purchase depends on many other factors, such as the willingness of owners to sell. Furthermore, growing investor appetite in the housing sector means that prospective homebuyers have some extra competition to worry about. In certain metros, for example, the share of homes bought by investors exceeded ** percent in 2025.

Average House Prices in the United States increased to 534100 USD in August from 478200 USD in July of 2025. This dataset includes a chart with historical data for the United States New Home Average Sales Price.

Purpose and brief description The house price index measures the inflation in the residential property market. The house price index reflects price developments for all residential properties purchased by households (apartments, terraced houses, detached houses), regardless of whether they are new or existing. Only market prices are taken into account, so self-build homes are excluded. The price of the land is included in the price of the properties. Population Real estate transactions involving residential properties Periodicity Quarterly. Release calendar Results available 3 months after the reference period Definitions House price index: The house price index measures changes in the prices of new or existing dwellings, regardless of their use or previous owner. Inflation - house price index: Inflation is defined as the ratio between the value of a given quarter and that of the same quarter of the previous year. Weighting - house price index: Weighting based on the national accounts (gross fixed capital formation in housing) and the total number of real estate transactions involving residential properties. Type of dwelling according to the classification set out in Regulation (EU) No 93/2013 on housing price indices. Technical information The house price index measures the price evolution of real estate prices on the market of private property. The index follows price changes of new or existing residential real estate purchased by households, irrespective of their purpose (letting or owner-occupying). Only market prices are taken into account. Houses built by their owners are therefore not included. The price of the building plot is included in the house price. The house price index is based on real estate transaction data from the General Administration of the Patrimonial Documentation of the FPS Finances. The prices used are those included in the deeds of sale. Given the time between the date on which the preliminary sales agreement is signed and the date on which the deed is executed (between three and four months), this index measures the price evolution with a delay compared to the actual date on which the sales price is set. This delay is inherent to the data source. The house price index is calculated by the European Union Member States, Norway and Iceland. Eurostat calculates the index for the Euro area (as well as for the European Union as a whole) using the harmonised indices of the Member States. Given the role of the housing market in the economic and financial crisis of 2008, the house price index was included in the indicators used in the procedure to prevent and correct macroeconomic imbalances in the European Union. The house price index is calculated under the European Regulation 2016/792 on harmonised indices of consumer prices and the house price index and 2023/1470 laying down the methodological and technical specifications as regards the house price index and the owner-occupied housing price index. Data are available from 2005 onward for Belgium as well as for the European Union and the majority of European countries. The house price index can be broken down by new houses and existing houses. The weights of these two items in the overall index are determined by the gross fixed capital formation in houses (for the new houses) and the total value of transactions of the previous year (for the existing houses). Until 2013, the house price index of new houses was roughly estimated based on the output price index in the construction sector. Since 2014, it is also based on real estate transaction data. House price index for existing houses is available per region since 2010. The data have therefore been completely reviewed when the results for the fourth quarter of 2023 were published in March 2024. Since the houses that are put up for sale differ from one quarter to another, the changes in characteristics are processed with hedonic regression models to eliminate price fluctuations due to changes in characteristics of the properties sold. These models aim to estimate the theoretical price based on the characteristics and location of the houses sold. The index is then calculated based on changes in the average prices observed and adjusted by a factor depending on the differences in quality observed between dwellings sold during the different periods.

The U.S. housing market has slowed, after ** consecutive years of rising home prices. In 2021, house prices surged by an unprecedented ** percent, marking the highest increase on record. However, the market has since cooled, with the Freddie Mac House Price Index showing more modest growth between 2022 and 2024. In 2024, home prices increased by *** percent. That was lower than the long-term average of *** percent since 1990. Impact of mortgage rates on homebuying The recent cooling in the housing market can be partly attributed to rising mortgage rates. After reaching a record low of **** percent in 2021, the average annual rate on a 30-year fixed-rate mortgage more than doubled in 2023. This significant increase has made homeownership less affordable for many potential buyers, contributing to a substantial decline in home sales. Despite these challenges, forecasts suggest a potential recovery in the coming years. How much does it cost to buy a house in the U.S.? In 2023, the median sales price of an existing single-family home reached a record high of over ******* U.S. dollars. Newly built homes were even pricier, despite a slight decline in the median sales price in 2023. Naturally, home prices continue to vary significantly across the country, with West Virginia being the most affordable state for homebuyers.

The number of home sales in the United States peaked in 2021 at almost ************* after steadily rising since 2018. Nevertheless, the market contracted in the following year, with transaction volumes falling to ***********. Home sales remained muted in 2024, with a mild increase expected in 2025 and 2026. A major factor driving this trend is the unprecedented increase in mortgage interest rates due to high inflation. How have U.S. home prices developed over time? The average sales price of new homes has also been rising since 2011. Buyer confidence seems to have recovered after the property crash, which has increased demand for homes and also the prices sellers are demanding for homes. At the same time, the affordability of U.S. homes has decreased. Both the number of existing and newly built homes sold has declined since the housing market boom during the coronavirus pandemic. Challenges in housing supply The number of housing units in the U.S. rose steadily between 1975 and 2005 but has remained fairly stable since then. Construction increased notably in the 1990s and early 2000s, with the number of construction starts steadily rising, before plummeting amid the infamous housing market crash. Housing starts slowly started to pick up in 2011, mirroring the economic recovery. In 2022, the supply of newly built homes plummeted again, as supply chain challenges following the COVID-19 pandemic and tariffs on essential construction materials such as steel and lumber led to prices soaring.

Reference: https://www.zillow.com/research/zhvi-methodology/

Official Background

In setting out to create a new home price index, a major problem Zillow sought to overcome in existing indices was their inability to deal with the changing composition of properties sold in one time period versus another time period. Both a median sale price index and a repeat sales index are vulnerable to such biases (see the analysis here for an example of how influential the bias can be). For example, if expensive homes sell at a disproportionately higher rate than less expensive homes in one time period, a median sale price index will characterize this market as experiencing price appreciation relative to the prior period of time even if the true value of homes is unchanged between the two periods.

The ideal home price index would be based off sale prices for the same set of homes in each time period so there was never an issue of the sales mix being different across periods. This approach of using a constant basket of goods is widely used, common examples being a commodity price index and a consumer price index. Unfortunately, unlike commodities and consumer goods, for which we can observe prices in all time periods, we can’t observe prices on the same set of homes in all time periods because not all homes are sold in every time period.

The innovation that Zillow developed in 2005 was a way of approximating this ideal home price index by leveraging the valuations Zillow creates on all homes (called Zestimates). Instead of actual sale prices on every home, the index is created from estimated sale prices on every home. While there is some estimation error associated with each estimated sale price (which we report here), this error is just as likely to be above the actual sale price of a home as below (in statistical terms, this is referred to as minimal systematic error). Because of this fact, the distribution of actual sale prices for homes sold in a given time period looks very similar to the distribution of estimated sale prices for this same set of homes. But, importantly, Zillow has estimated sale prices not just for the homes that sold, but for all homes even if they didn’t sell in that time period. From this data, a comprehensive and robust benchmark of home value trends can be computed which is immune to the changing mix of properties that sell in different periods of time (see Dorsey et al. (2010) for another recent discussion of this approach).

For an in-depth comparison of the Zillow Home Value Index to the Case Shiller Home Price Index, please refer to the Zillow Home Value Index Comparison to Case-Shiller

Each Zillow Home Value Index (ZHVI) is a time series tracking the monthly median home value in a particular geographical region. In general, each ZHVI time series begins in April 1996. We generate the ZHVI at seven geographic levels: neighborhood, ZIP code, city, congressional district, county, metropolitan area, state and the nation.

Underlying Data

Estimated sale prices (Zestimates) are computed based on proprietary statistical and machine learning models. These models begin the estimation process by subdividing all of the homes in United States into micro-regions, or subsets of homes either near one another or similar in physical attributes to one another. Within each micro-region, the models observe recent sale transactions and learn the relative contribution of various home attributes in predicting the sale price. These home attributes include physical facts about the home and land, prior sale transactions, tax assessment information and geographic location. Based on the patterns learned, these models can then estimate sale prices on homes that have not yet sold.

The sale transactions from which the models learn patterns include all full-value, arms-length sales that are not foreclosure resales. The purpose of the Zestimate is to give consumers an indication of the fair value of a home under the assumption that it is sold as a conventional, non-foreclosure sale. Similarly, the purpose of the Zillow Home Value Index is to give consumers insight into the home value trends for homes that are not being sold out of foreclosure status. Zillow research indicates that homes sold as foreclosures have typical discounts relative to non-foreclosure sales of between 20 and 40 percent, depending on the foreclosure saturation of the market. This is not to say that the Zestimate is not influenced by foreclosure resales. Zestimates are, in fact, influenced by foreclosure sales, but the pathway of this influence is through the downward pressure foreclosure sales put on non-foreclosure sale prices. It is the price signal observed in the latter that we are attempting to measure and, in turn, predict with the Zestimate.

Market Segments Within each region, we calculate the ZHVI for various subsets of homes (or mar...

The average price per square foot of floor space in new single-family housing in the United States decreased after the great financial crisis, followed by several years of stagnation. Since 2012, the price has continuously risen, hitting ****** U.S. dollars per square foot in 2024. In 2024, the average sales price of a new home exceeded ******* U.S. dollars. Development of house sales in the U.S. One of the reasons for rising property prices is the gradual growth of house sales between 2011 and 2020. This period was marked by the gradual recovery following the subprime mortgage crisis and a growing housing sentiment. Another significant factor for the housing demand was the growing number of new household formations each year. Despite this trend, housing transactions plummeted in 2021, amid soaring prices and borrowing costs. In 2021, the average construction cost for single-family housing rose by nearly ** percent year-on-year, and in 2022, the increase was even higher, at close to ** percent. Financing a house purchase Mortgage interest rates in the U.S. rose dramatically in 2022 and remained elevated until 2024. In 2020, a homebuyer could lock in a 30-year fixed interest rate of under ***** percent, whereas in 2024, the average rate for the same mortgage type was more than twice higher. That has led to a decline in homebuyer sentiment, and an increasing share of the population pessimistic about buying a home in the current market.

Redfin is a real estate brokerage and publishes the US housing market data on a regular basis. Using this dataset, you can analyze and visualize housing market data for US cities. Timeline: Starting from February 2012 until the present time (Data is refreshed and updated on a monthly basis)

The dataset has the following columns: - period_begin - period_end - period_duration
- region_type
- region_type_id - table_id - is_seasonally_adjusted. (indicates if prices are seasonally adjusted; f represents False) - region - city - state - state_code - property_type - property_type_id - median_sale_price
- median_sale_price_mom (median sale price changes month over month) - median_sale_price_yoy (median sale price changes year over year) - median_list_price
- median_list_price_mom (median list price changes month over month) - median_list_price_yoy (median list price changes year over year) - median_ppsf (median sale price per square foot) - median_ppsf_mom (median sale price per square foot changes month over month) - median_ppsf_yoy (median sale price per square foot changes year over year) - median_list_ppsf (median list price per square foot) - median_list_ppsf_mom (median list price per square foot changes month over month) - median_list_ppsf_yoy. (median list price per square foot changes year over year) - homes_sold (number of homes sold) - homes_sold_mom (number of homes sold month over month) - homes_sold_yoy (number of homes sold year over year) - pending_sales
- pending_sales_mom
- pending_sales_yoy
- new_listings - new_listings_mom
- new_listings_yoy
- inventory - inventory_mom
- inventory_yoy
- months_of_supply
- months_of_supply_mom - months_of_supply_yoy
- median_dom (median days on market until property is sold) - median_dom_mom (median days on market changes month over month) - median_dom_yoy (median days on market changes year over year) - avg_sale_to_list (average sale price to list price ratio) - avg_sale_to_list_mom (average sale price to list price ratio changes month over month) - avg_sale_to_list_yoy (average sale price to list price ratio changes year over year) - sold_above_list
- sold_above_list_mom - sold_above_list_yoy - price_drops - price_drops_mom - price_drops_yoy - off_market_in_two_weeks (number of properties that will be taken off the market within 2 weeks) - off_market_in_two_weeks_mom (changes in number of properties that will be taken off the market within 2 weeks, month over month) - off_market_in_two_weeks_yoy (changes in number of properties that will be taken off the market within 2 weeks, year over year) - parent_metro_region - parent_metro_region_metro_code - last_updated

Filetype: gzip (gz) Support for gzip files in Python: https://docs.python.org/3/library/gzip.html

Data Source & Credit: Redfin.com