As of April 10, 2025, tech giants Apple, Microsoft, Nvidia, Alphabet (Google), and Amazon dominated the S&P 500 index and were among only eight companies with a market capitalization exceeding *** ******** U.S. dollars in the U.S.

This dataset contains the top 20 companies of the S&P 500 by market capitalization for each year from 1989 to 2023.

The data includes: - Year: Reference year - Rank: Company rank by market capitalization - Company: Company name - Ticker: Yahoo Finance ticker symbol - MarketCap_BillionsUSD: Market capitalization in billions of USD

The data was extracted from Finhacker and enriched with tickers.

This dataset is useful for: - Historical financial analysis - Visualization of market capitalization trends - Long-term investment research

View monthly updates and historical trends for S&P 500 Market Cap. from United States. Source: Standard and Poor's. Track economic data with YCharts analy…

Context

This is a comprehensive dataset including numerous financial metrics that many professionals and investing gurus often use to value companies. This data is a look at the companies that comprise the S&P 500 (Standard & Poor's 500). The S&P 500 is a capitalization-weighted index of the top 500 publicly traded companies in the United States (top 500 meaning the companies with the largest market cap). The S&P 500 index is a useful index to study because it generally reflects the health of the overall U.S. stock market. The dataset was last updated in July 2020.

Content

There are 14 rows included in this dataset: ``` - 4 character variables: - Symbol: Ticker symbol used to uniquely identify each company on a particular stock market - Name: Legal name of the company - Sector: An area of the economy where businesses share a related product or service - SEC Filings: Helpful documents relating to a company

- 10 numeric variables:
  - Price: Price per share of the company
  - Price to Earnings (PE): The ratio of a company’s share price to its earnings per share
  - Dividend Yield: The ratio of the annual dividends per share divided by the price per share
  - Earnings Per Share (EPS): A company’s profit divided by the number of shares of its stock
  - 52 week high and low: The annual high and low of a company’s share price
  - Market Cap: The market value of a company’s shares (calculated as share price x number of shares)
  - EBITDA: A company’s earnings before interest, taxes, depreciation, and amortization; often used as a proxy for its profitability
  - Price to Sales (PS): A company’s market cap divided by its total sales or revenue over the past year
  - Price to Book (PB): A company’s price per share divided by its book value

### Acknowledgements

I found this data on the website datahub at https://datahub.io/core/s-and-p-500-companies-financials/r/1.html. All references and citations should be given to them.


### Inspiration

What useful information can you gleam from this dataset? Are these fundamentals enough to predict a high-quality company? How can you determine high from low quality? What would you liked to have seen in this dataset?

List of companies in the S&P 500 (Standard and Poor’s 500).

The S&P 500 is a free-float, capitalization-weighted index of the top 500 publicly listed stocks in the US (top 500 by market cap). The dataset includes a list of all the stocks contained therein and associated key financials such as price, market capitalization, earnings, price/earnings ratio, price to book etc.

View data of the S&P 500, an index of the stocks of 500 leading companies in the US economy, which provides a gauge of the U.S. equity market.

This dataset provides a fascinating look into the ever-changing landscape of the S&P 500 by tracking the top 30 companies by market capitalization from 2010 to 2024. Explore which giants consistently held their ground, which rising stars broke into the ranks, and which former leaders faded from the top.

With columns for 'Year', 'Ticker', 'Weight', '1Y_P' (1-year historical return), '1Y_F' (1-year forward return), 'Industry', and 'Sector', this dataset is a goldmine for analyzing:

Market Concentration: How has the weight of the top companies changed over time? Sector Shifts: Which sectors have dominated the top ranks, and how has this evolved? Performance of Leaders: How did the top companies perform in the year they were included and the year after? Turnover Analysis: Identify which companies were added and removed from the top 30 each year and investigate potential reasons. Whether you're a seasoned quantitative analyst, a student of market trends, or simply curious about the companies shaping the US economy, this dataset offers a unique perspective on market dynamics and the forces driving the S&P 500.

Potential Use Cases:

Time Series Analysis of Market Cap Concentration. Studying sector rotation and dominance. Backtesting strategies based on top-performing companies. Analyzing the characteristics of companies entering or leaving the top 30. Educational purposes for understanding market structure. Dive in and uncover the stories behind the numbers in the S&P 500's top tier!

With a market capitalization of 3.12 trillion U.S. dollars as of May 2024, Microsoft was the world’s largest company that year. Rounding out the top five were some of the world’s most recognizable brands: Apple, NVIDIA, Google’s parent company Alphabet, and Amazon. Saudi Aramco led the ranking of the world's most profitable companies in 2023, with a pre-tax income of nearly 250 billion U.S. dollars. How are market value and market capitalization determined? Market value and market capitalization are two terms frequently used – and confused - when discussing the profitability and viability of companies. Strictly speaking, market capitalization (or market cap) is the worth of a company based on the total value of all their shares; an important metric when determining the comparative value of companies for trading opportunities. Accordingly, many stock exchanges such as the New York or London Stock Exchange release market capitalization data on their listed companies. On the other hand, market value technically refers to what a company is worth in a much broader context. It is determined by multiple factors, including profitability, corporate debt, and the market environment as a whole. In this sense it aims to estimate the overall value of a company, with share price only being one element. Market value is therefore useful for determining whether a company’s shares are over- or undervalued, and in arriving at a price if the company is to be sold. Such valuations are generally made on a case-by-case basis though, and not regularly reported. For this reason, market capitalization is often reported as market value. What are the top companies in the world? The answer to this question depends on the metric used. Although the largest company by market capitalization, Microsoft's global revenue did not manage to crack the top 20 companies. Rather, American multinational retailer Walmart was ranked as the largest company in the world by revenue. Walmart also had the highest number of employees in the world.

The Standard and Poors (S&P) 500 stock market index, maintained by S&P Dow Jones Indices, comprises 505 common stocks issued by 500 large-cap companies and traded on American stock exchanges, and covers about 80 percent of the American equity market by capitalization. The index is weighted by free-float market capitalization, so more valuable companies account for relatively more of the index.

The dataset consists of companies listed in the S&P500, stock market index that measures the stock performance of 500 large companies listed on stock exchanges in the United State.

The S&P 500 stock market index, maintained by S&P Dow Jones Indices, comprises 505 common stocks issued by 500 large-cap companies and traded on American stock exchanges (including the 30 companies that compose the Dow Jones Industrial Average)

The S&P500 or SPX is the most commonly followed equity index, it covers about 80 percent of the American equity market by capitalization.

The index constituents and the constituent weights are updated regularly using rules published by S&P Dow Jones Indices. Although called the S&P 500, the index contains 505 stocks

This dataset provides comprehensive financial information for companies listed in the S&P 500 index. The dataset encompasses a range of fundamental financial metrics and attributes, making it a valuable resource for financial analysis, investment research, and market insights.

Features:

Symbol: The unique stock symbol or ticker identifier for each S&P 500 company.

Name: The official name or full corporate title of each company.

Sector: The sector to which the company belongs, categorizing it into specific industry groups within the S&P 500.

Price: The current trading price of the company's stock.

Price/Earnings: The price-to-earnings (P/E) ratio, a key valuation metric, indicating the relationship between the stock's price and its earnings per share.

Dividend Yield: The dividend yield, representing the ratio of the annual dividend payment to the stock's current price.

Earnings/Share: The earnings per share (EPS), a measure of a company's profitability, calculated as earnings divided by the number of outstanding shares.

52 Week Low: The lowest price at which the stock has traded over the past 52 weeks.

52 Week High: The highest price at which the stock has traded over the past 52 weeks.

Market Cap: The total market capitalization of the company, representing the product of the stock's current price and the total number of outstanding shares.

EBITDA: Earnings before interest, taxes, depreciation, and amortization, a measure of a company's operating performance.

Price/Sales: The price-to-sales ratio, which compares the stock's price to the company's revenue per share.

Price/Book: The price-to-book (P/B) ratio, comparing the stock's price to its book value per share, an indicator of the stock's relative value.

SEC Filings: Information regarding the company's filings with the U.S. Securities and Exchange Commission (SEC), providing transparency and compliance data.

The Standard & Poor’s (S&P) 500 Index is an index of 500 leading publicly traded companies in the United States. In 2021, the index value closed at ******** points, which was the second highest value on record despite the economic effects of the global coronavirus (COVID-19) pandemic. In 2023, the index values closed at ********, the highest value ever recorded. What is the S&P 500? The S&P 500 was established in 1860 and expanded to its present form of 500 stocks in 1957. It tracks the price of stocks on the major stock exchanges in the United States, distilling their performance down to a single number that investors can use as a snapshot of the economy’s performance at a given moment. This snapshot can be explored further. For example, the index can be examined by industry sector, which gives a more detailed illustration of the economy. Other measures Being a stock market index, the S&P 500 only measures equities performance. In addition to other stock market indices, analysts will look to other indicators such as GDP growth, unemployment rates, and projected inflation. Similarly, since these indicators say something about the economic future, stock market investors will use these indicators to speculate on the stocks in the S&P 500.

Context

The S&P 500,[2] or simply the S&P,[4] is a stock market index that measures the stock performance of 500 large companies listed on stock exchanges in the United States. It is one of the most commonly followed equity indices.[5] The average annual total return and compound annual growth rate of the index, including dividends, since inception in 1926 has been approximately 9.8%, or 6% after inflation; however, there were several years where the index declined over 30%.[6][7] The index has posted annual increases 70% of the time.[5] However, the index has only made new highs on 5% of trading days, meaning that on 95% of trading days, the index has closed below its all-time high.[8]

For a list of the components of the index, see List of S&P 500 companies. The components that have increased their dividends in 25 consecutive years are known as the S&P 500 Dividend Aristocrats.[9]:25

The S&P 500 index is a capitalization-weighted index and the 10 largest companies in the index account for 26% of the market capitalization of the index. The 10 largest companies in the index, in order of weighting, are Apple Inc., Microsoft, Amazon.com, Alphabet Inc., Facebook, Johnson & Johnson, Berkshire Hathaway, Visa Inc., Procter & Gamble and JPMorgan Chase, respectively.[2]

Funds that track the index have been recommended as investments by Warren Buffett, Burton Malkiel, and John C. Bogle for investors with long time horizons.[10]

Although the index includes only companies listed in the United States, companies in the index derive on average only 71% of their revenue in the United States.[11]

The index is one of the factors in computation of the Conference Board Leading Economic Index, used to forecast the direction of the economy.[12]

The index is associated with many ticker symbols, including: ^GSPC,[13] INX,[14] and $SPX, depending on market or website.[15] The index value is updated every 15 seconds, or 1,559 times per trading day, with price updates disseminated by Reuters.[16]

The S&P 500 is maintained by S&P Dow Jones Indices, a joint venture majority-owned by S&P Global and its components are selected by a committee.[17][18]

Content

What's inside is more than just rows and columns. Make it easy for others to get started by describing how you acquired the data and what time period it represents, too.

Acknowledgements

We wouldn't be here without the help of others. If you owe any attributions or thanks, include them here along with any citations of past research.

Inspiration

Your data will be in front of the world's largest data science community. What questions do you want to see answered?

📊 About Dataset This dataset provides a comprehensive historical record of the S&P 500's constituent companies and their respective weights, spanning from September 30, 2000, to 2024.

The data is sourced from the annual reports of the SPDR S&P 500 ETF (SPY), the largest and oldest exchange-traded fund that tracks the S&P 500. Because the SPY ETF's investment strategy is to hold all 500 stocks in the index in direct proportion to their index weighting, its holdings report is a precise, real-world snapshot of the S&P 500's composition at that time.

This dataset offers a clean, point-in-time view of the market's structure, allowing for analysis that avoids "survivorship bias" (i.e., analyzing only the companies that are currently in the index). It is a valuable resource for quantitative analysts, financial researchers, and data scientists looking to study the evolution of the U.S. large-cap market.

Each file represents an annual snapshot, typically from the end of the fiscal year (September 30th), and contains a list of all companies held by the ETF and their percentage weight in the portfolio.

💡 Potential Use Cases This historical data is ideal for a wide range of financial analysis, quantitative modeling, and academic research.

Market & Sector Trend Analysis:

Visualize the evolution of the U.S. economy by tracking the rise and fall of sector weights over time. For example, you can map the decline of Industrials and Energy and the dramatic rise of the Information Technology sector since 2000.

Analyze the changing landscape of top-tier companies, observing how giants from 2000 (like GE, Exxon, and Cisco) were replaced by today's tech leaders (like Apple, Microsoft, and Nvidia).

Quantitative Strategy Backtesting:

Build and test investment strategies against a historically accurate benchmark. For example, you could test a "sector rotation" strategy based on economic indicators and see how it would have performed.

Simulate portfolio performance without survivorship bias, leading to more realistic and robust backtest results.

Market Concentration Analysis:

Track the concentration of the index in its top 10 holdings.

Analyze how today's market concentration compares to historical periods like the 2000 dot-com bubble, which can be an indicator of market risk.

Academic & Economic Research:

Study the relationship between sector performance and the business cycle. For instance, do certain sectors (like Consumer Staples) consistently outperform during recessions?

Analyze factor investing (e.g., Value, Growth, Momentum) by applying factor definitions to the index constituents at each point in time.

Portfolio Management & Benchmarking:

Use the historical data as a benchmark to evaluate the performance of an active investment portfolio.

Analyze a portfolio's "active share" and "tracking error" against the S&P 500's actual composition from any given year.

Equity returns remained high in 2020, in spite of the uncertainty and volatility caused by the coronavirus pandemic and related partial shutdowns. Initial public offerings (IPOs) ended the year with the highest rate of equity returns, which amounted to ** percent returns for investors. However, the most compelling financial story in the second half of the year revolved around the huge increase in IPOs via special purpose acquisition companies (SPACs). SPAC mergers refer to the practice of a SPAC, which is a publicly listed company with no operations, merging with a private company to take the latter public without following the normal IPO process. In 2021, however, IPOs and SPAC mergers experienced negative returns. Why are NASDAQ and S&P 500 relevant benchmarks? The Nasdaq and the S&P 500 are two of the most important stock indices in the United States, if not the world. The Nasdaq Composite Index includes over 2,500 stocks listed on the Nasdaq stock market, which is the second largest stock exchange globally. The S&P 500 index tracks the stock value of 500 large companies, such as Facebook and Alphabet, listed on the New York Stock Exchange. What level of impact did the pandemic have on these indices? Over the past decade, both the NASDAQ Composite index and the S&P 500 index have skyrocketed in value. However, both indices took a hit in February and March 2020 when the uncertainty caused by the pandemic led to investors selling off assets en masse. This dip was short-lived and both indices had fully recovered by the third quarter.

Context

Every year Fortune, an American Business Magazine, publishes the Fortune 500, which ranks the top 500 corporations by revenue. This dataset includes the entire Fortune 1000, as opposed to just the top 500.

Content

The Fortune 1000 dataset is from the Fortune website, collected by the processes outlined in this notebook. It contains U.S. company data for the year 2022 (updated from 2021). The dataset is 1000 rows and 18 columns.

Features

• Company - values are the name of the company
• Rank - The 2021 rank established by Fortune (1-1000)
• Rank Change - The change in the rank from 2020 to 2021. There is only a rank change listed if the company is currently in the top 500 and was previously in the top 500.
• Revenue - Revenue of each company in millions. This is the criteria used to rank each company.
• Profit - Profit of each company in millions.
• Num. of Employees - The number of employees each company employs.
• Sector - The sector of the market the company operates in.
• City - The city where the company's headquarters is located.
• State - The state where the company's headquarters is located
• Newcomer - Indicates whether or not the company is new to the top Fortune 500 ("yes" or "no"). No value will be listed for companies outside of the top 500.
• CEO Founder - Indicates whether the CEO of the company is also the founder ("yes" or "no").
• CEO Woman - Indicates whether the CEO of the company is a woman ("yes" or "no").
• Profitable - Indicates whether the company is profitable or not ("yes" or "no").
• Prev. Rank - The 2020 rank of the company, as established by Fortune. There will only be previous rank data for the top 500 companies.
• CEO - The name of the CEO of the company
• Website - The url of the company website
• Ticker - The stock ticker symbol of public companies. Some rows will have empty values because the company is a private corporation.
• Market Cap - The market cap (or value) of the company in millions. Some rows will have empty values because the company is private. Market valuations were determined on January 20, 2021.

Inspiration

This dataset is made to explore the top corporations in the U.S. Answer questions such as: What percentage of companies have women ceo's? How many companies are newcomers? What percentage of companies have ceos who were also founders? What role does profitability play in ranking?

Enterprise value to earnings before interest, taxes, depreciation and amortization (EV/EBITDA) is a key measurement ratio used as a metric of valuing whether a company is under or overvalued as compared to a historical industry average. The S&P 500 (Standard & Poor’s) is an index of the 500 largest U.S. publicly traded companies by market capitalization. In 2023, the consumer staples sector displayed the highest EV/EBITDA multiple with *****.

In 2018, the intangible value of all companies on the S&P 500 Index was ***** trillion U.S. dollars. During the same year, the value of tangible assets of the same companies was only **** trillion U.S. dollars.

Context

In this dataset you can find the Top 100 companies in the technology sector. You can also find 5 of the most important and used indices in the financial market as well as a list of all the companies in the S&P 500 index and in the technology sector.

The Global Industry Classification Standard also known as GICS is the primary financial industry standard for defining sector classifications. The Global Industry Classification Standard was developed by index providers MSCI and Standard and Poor’s. Its hierarchy begins with 11 sectors which can be further delineated to 24 industry groups, 69 industries, and 158 sub-industries.

You can read the definition of each sector here.

The 11 broad GICS sectors commonly used for sector breakdown reporting include the following: Energy, Materials, Industrials, Consumer Discretionary, Consumer Staples, Health Care, Financials, Information Technology, Telecommunication Services, Utilities and Real Estate.

In this case we will focuse in the Technology Sector. You can see all the sectors and industry groups here.

To determine which companies, correspond to the technology sector, we use Yahoo Finance, where we rank the companies according to their “Market Cap”. After having the list of the Top 100 best valued companies in the sector, we proceeded to download the historical data of each of the companies using the NASDAQ website.

Regarding to the indices, we searched various sources to find out which were the most used and determined that the 5 most frequently used indices are: Dow Jones Industrial Average (DJI), S&P 500 (SPX), NASDAQ Composite (IXIC), Wilshire 5000 Total Market Inde (W5000) and to specifically view the technology sector SPDR Select Sector Fund - Technology (XLK). Historical data for these indices was also obtained from the NASDQ website.

Content

In total there are 107 files in csv format. They are composed as follows:

• 100 files contain the historical data of tech companies.
• 5 files contain the historical data of the most used indices.
• 1 file contain the list of all the companies in the S&P 500 index.
• 1 file contain the list of all the companies in the technology sector.

Column Description

Every company and index file has the same structure with the same columns:

Date: It is the date on which the prices were recorded. High: Is the highest price at which a stock traded during the course of the trading day. Low: Is the lowest price at which a stock traded during the course of the trading day. Open: Is the price at which a stock started trading when the opening bell rang. Close: Is the last price at which a stock trades during a regular trading session. Volume: Is the number of shares that changed hands during a given day. Adj Close: The adjusted closing price factors in corporate actions, such as stock splits, dividends, and rights offerings.

The two other files have different columns names:

List of S&P 500 companies

Symbol: Ticker symbol of the company. Name: Name of the company. Sector: The sector to which the company belongs.

Technology Sector Companies List

Symbol: Ticker symbol of the company. Name: Name of the company. Price: Current price at which a stock can be purchased or sold. (11/24/20) Change: Net change is the difference between closing prices from one day to the next. % Change: Is the difference between closing prices from one day to the next in percentage. Volume: Is the number of shares that changed hands during a given day. Avg Vol: Is the daily average of the cumulative trading volume during the last three months. Market Cap (Billions): Is the total value of a company’s shares outstanding at a given moment in time. It is calculated by multiplying the number of shares outstanding by the price of a single share. PE Ratio: Is the ratio of a company's share (stock) price to the company's earnings per share. The ratio is used for valuing companies and to find out whether they are overvalued or undervalued.

Acknowledgements

SEC EDGAR | Company Filings NASDAQ | Historical Quotes Yahoo Finance | Technology Sector Wikipedia | List of S&P 500 companies S&P Dow Jones Indices | S&P 500 [S&P Dow Jones Indices | DJI](https://www.spglobal.com/spdji/en/i...

Data from Fortune 500's 2023 ranking.
Includes data on top 1000 companies w/ additional info (Stock symbol/*ticker*, CEO name).

Update (New dataset): 2024 Fortune 1000 Companies

What Is the Fortune 1000?

From Investopedia:

The Fortune 1000 is an annual list of the 1000 largest American companies maintained by the popular magazine Fortune Fortune ranks the eligible companies by revenue generated from core operations, discounted operations, and consolidated subsidiaries Since revenue is the basis for inclusion, every company is authorized to operate in the United States and files a 10-K or comparable financial statement with a government agency -- .

Project Background

Fortune magazine publishes this list every year and some lists can be found from different sources. From looking at this year's available datasets, some features were missing or could not be found. This was built from scraping the standard features as well as what's included on Company Info (such as CEO, Ticker and website) from the Fortune magazine website. Details on how the data was generated can be found on this notebook where a few of the features were also visualized.

The source code from the 2023 fortune 500 Ranking includes 1000 companies. A reference page (slug) to additional info is included for each companies which were also scrapped to complete the dataset.

The Dataset

Available formats: csv, parquet

Features are follows:

[Note: References to datatypes are relevant when using the parquet file; Labels refer to the original website names]

• Rank
    dtype: int64; Label: Rank
• Company
    dtype: object; Label: Company
• Ticker
    dtype: object; Label: Ticker
• Sector
    dtype: category; Label: Sector
• Industry
    dtype: category; Label: Industry
• Profitable
    dtype: category; Label: Profitable
• Founder_is_CEO
    dtype: category; Label: Founder is CEO
• FemaleCEO
    dtype: category; Label: Female CEO
• Growth_in_Jobs
    dtype: category; Label: Growth in Jobs
• Change_in_Rank
    dtype: float64; Label: Change in Rank (Full 1000)
• Gained_in_Rank
    dtype: category; Label: Gained in Rank
• Dropped_in_Rank
    dtype: category; Label: Dropped in Rank
• Newcomer_to_the_Fortune500
    dtype: category; Label: Newcomer to the Fortune 500
• Global500
    dtype: category; Label: Global 500
• Best_Companies
    dtype: category; Label: Best Companies
• Number_of_employees
    dtype: int64; Label: Employees
• MarketCap_March31_M
    dtype: float64; Label: Market Value — as of March 31, 2023 ($M)
• Revenues_M
    dtype: int64; Label: Revenues ($M)
• RevenuePercentChange
    dtype: float64; Label: Revenue Percent Change
• Profits_M
    dtype: int64; Label: Profits ($M)
• ProfitsPercentChange
    dtype: float64; Label: Profits Percent Change
• Assets_M
    dtype: int64; Label: Assets ($M)
• CEO
    dtype: object; Label: CEO
• Country
    dtype: category; Label: Country
• HeadquartersCity
    dtype: object; Label: Headquarters City
• HeadquartersState
    dtype: category; Label: Headquarters State
• Website
    dtype: object; Label: Website
• CompanyType
    dtype: category; Label: Company type
• Footnote
    dtype: object; Label: Footnote
• MarketCap_Updated_M
    dtype: float64; Label: Market value ($M)
• Updated
    dtype: datetime64[ns]; Label: Updated Click to add a cell.