About:

This dataset encompasses the historical data of major stock indices from around the world, sourced directly from Yahoo Finance. With data reaching back to the early 1920s (where available), it serves as an invaluable repository for academic researchers, financial analysts, and market enthusiasts. Users can delve into trends across decades, evaluate historical market behaviors, or even design and validate predictive financial models.

Photo by Tötös Ádám on Unsplash

Info on CSVs:

1. all_indices_data.csv:

   • Description: A consolidated dataset merging all the stock indices from Yahoo Finance.
   • Columns:
     • date: The date of the data point (formatted as YYYY-MM-DD).
     • open: The opening value of the index on that date.
     • high: The highest value of the index during the trading session.
     • low: The lowest value of the index during the trading session.
     • close: The closing value of the index.
     • volume: The trading volume of the index on that date.
     • ticker: The ticker symbol of the stock index.

2. individual_indices_data/[SYMBOL]_data.csv:

   • Description: Individual datasets for each stock index, where [SYMBOL] denotes the ticker symbol of the respective stock index. Each dataset is curated from Yahoo Finance's historical data archives.
   • Columns:
     • date: The date of the data point (formatted as YYYY-MM-DD).
     • open: The opening value of the index on that date.
     • high: The highest value of the index during the trading session.
     • low: The lowest value of the index during the trading session.
     • close: The closing value of the index.
     • volume: The trading volume of the index on that date.

Context:

The provided dataset is extracted from yahoo finance using pandas and yahoo finance library in python. This deals with stock market index of the world best economies. The code generated data from Jan 01, 2003 to Jun 30, 2023 that’s more than 20 years. There are 18 CSV files, dataset is generated for 16 different stock market indices comprising of 7 different countries. Below is the list of countries along with number of indices extracted through yahoo finance library, while two CSV files deals with annualized return and compound annual growth rate (CAGR) has been computed from the extracted data.

Number of Countries & Index:

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F90ce8a986761636e3edbb49464b304d8%2FNumber%20of%20Index.JPG?generation=1688490342207096&alt=media" alt="">

Content:

Unit of analysis: Stock Market Index Analysis

This dataset is useful for research purposes, particularly for conducting comparative analyses involving capital market performance and could be used along with other economic indicators.

There are 18 distinct CSV files associated with this dataset. First 16 CSV files deals with number of indices and last two CSV file deals with annualized return of each year and CAGR of each index. If data in any column is blank, it portrays that index was launch in later years, for instance: Bse500 (India), this index launch in 2007, so earlier values are blank, similarly China_Top300 index launch in year 2021 so early fields are blank too.

The extraction process involves applying different criteria, like in 16 CSV files all columns are included, Adj Close is used to calculate annualized return. The algorithm extracts data based on index name (code given by the yahoo finance) according start and end date.

Annualized return and CAGR has been calculated and illustrated in below image along with machine readable file (CSV) attached to that.

To extract the data provided in the attachment, various criteria were applied:

1. Content Filtering: The data was filtered based on several attributes, including the index name, start and end date. This filtering process ensured that only relevant data meeting the specified criteria.

2. Collaborative Filtering: Another filtering technique used was collaborative filtering using yahoo finance, which relies on index similarity. This approach involves finding indices that are similar to other index or extended dataset scope to other countries or economies. By leveraging this method, the algorithm identifies and extracts data based on similarities between indices.

In the last two CSV files, one belongs to annualized return, that was calculated based on the Adj close column and new DataFrame created to store its outcome. Below is the image of annualized returns of all index (if unreadable, machine-readable or CSV format is attached with the dataset).

Annualized Return:

As far as annualised rate of return is concerned, most of the time India stock market indices leading, followed by USA, Canada and Japan stock market indices.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F37645bd90623ea79f3708a958013c098%2FAnnualized%20Return.JPG?generation=1688525901452892&alt=media" alt="">

Compound Annual Growth Rate (CAGR):

The best performing index based on compound growth is Sensex (India) that comprises of top 30 companies is 15.60%, followed by Nifty500 (India) that is 11.34% and Nasdaq (USA) all is 10.60%.

The worst performing index is China top300, however this is launch in 2021 (post pandemic), so would not possible to examine at that stage (due to less data availability). Furthermore, UK and Russia indices are also top 5 in the worst order.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F58ae33f60a8800749f802b46ec1e07e7%2FCAGR.JPG?generation=1688490409606631&alt=media" alt="">

Geography: Stock Market Index of the World Top Economies

Time period: Jan 01, 2003 – June 30, 2023

Variables: Stock Market Index Title, Open, High, Low, Close, Adj Close, Volume, Year, Month, Day, Yearly_Return and CAGR

File Type: CSV file

Inspiration:

• Time series prediction model
• Investment opportunities in world best economies
• Comparative Analysis of past data with other stock market indices or other indices

Disclaimer:

This is not a financial advice; due diligence is required in each investment decision.

What is this data?

This is a yahoo finance mapper for world indices. You can use this file to fetch the historical data using the YFinance API.

Original data?

https://finance.yahoo.com/world-indices

This is the name of the 38 global main stock indexes in the world. We collected from Yahoo! Finance. For the convenience of expression and computation later, we numbered it. For each item, the front is its serial number, followed by the corresponding stock index.

This dataset contains the full historical record of the S&P 500 index (^GSPC), downloaded via the Yahoo Finance API using the yfinance Python library.

The dataset includes: - Date: Trading date - Open, High, Low, Close: Daily price levels - Volume: Daily trading volume

Period covered: Dec 30, 1927 – Aug 31, 2025 Frequency: Daily

⚠️ Disclaimer: This dataset is provided for educational and research purposes only. Redistribution or commercial use may be subject to Yahoo Finance’s Terms of Service

License

Data sourced from Yahoo Finance. Provided for educational and research purposes only. Redistribution may be restricted.

################################################################################################## THE FILES HAVE BEEN CREATED BY SZILÁRD ERHART FOR A RESEARCH: ERHART (2021): ESG RATINGS OF GENERAL # STOCK EXCHANGE INDICES, INTERNATIONAL REVIEW OF FINANCIAL ANALYSIS# USERS OF THE FILES AGREE TO QUOTE THE ABOVE PAPER# THE PYTHON SCRIPT (PYTHONESG_ERHART.TXT) HELPS USERS TO GET TICKERS BY STOCK EXCHANGES AND EXTRACT ESG SCORES FOR THE UNDERLYING STOCKS FROM YAHOO FINANCE.# THE R SCRIPT (ESG_UA.TXT) HELPS TO REPLICATE THE MONTE CARLO EXPERIMENT DETAILED IN THE STUDY.# THE EXPORT_ALL CSV CONTAINS THE DOWNLOADED ESG DATA (SCORES, CONTROVERSIES, ETC) ORGANIZED BY STOCKS AND EXCHANGES.############################################################################################################################################################################################################### DISCLAIMER # The author takes no responsibility for the timeliness, accuracy, completeness or quality of the information provided. # The author is in no event liable for damages of any kind incurred or suffered as a result of the use or non-use of the # information presented or the use of defective or incomplete information. # The contents are subject to confirmation and not binding. # The author expressly reserves the right to alter, amend, whole and in part, # without prior notice or to discontinue publication for a period of time or even completely. ###########################################################################################################################################READ ME############################################################# BEFORE USING THE MONTE CARLO SIMULATIONS SCRIPT: # (1) COPY THE goascores.csv and goalscores_alt.csv FILES ONTO YOUR ON COMPUTER DRIVE. THE TWO FILES ARE IDENTICAL.# (2) SET THE EXACT FILE LOCATION INFORMATION IN THE 'Read in data' SECTION OF THE MONTE CARLO SCRIPT AND FOR THE OUTPUT FILES AT THE END OF THE SCRIPT# (3) LOAD MISC TOOLS AND MATRIXSTATS IN YOUR R APPLICATION# (4) RUN THE CODE.####################################READ ME

Full historical data for the S&P 500 (ticker ^GSPC), sourced from Yahoo Finance (https://finance.yahoo.com/).

Including Open, High, Low and Close prices in USD + daily volumes.

Info about S&P 500: https://en.wikipedia.org/wiki/S%26P_500

View market daily updates and historical trends for CBOE Equity Put/Call Ratio. from United States. Source: Chicago Board Options Exchange. Track economic…

Dataset

This dataset was created by EL Younes

Contents

A collective dataset derived from Yahoo Finance for:

1. Stock prices
2. Raw material prices
3. Volatility indices

For multiple historical scenarios.

Collected from Yahoo Finance, Investing.com and WJS, this dataset consists of the following indices ranging from July 17, 2017 to July 22, 2022:

1. DJI (Dow Jones Industrial Average)
2. SNP (Standard and Poor's 500)
3. IXIC (Nasdaq Composite)
4. VIX (CBOE Volatility Index)
5. FTSE (Financial Times Stock Exchange)
6. FCHI (CAC 40 Paris Index)
7. STOXX (The STOXX Europe 600)
8. AEX (Amsterdam Exchange Index)
9. IBEX (Iberian Index, Madrid)
10. MOEX (Russia Index)
11. BIST (Istanbul Index)
12. HSI (Hang Seng Index)
13. SSE (Shanghai Composite Index)
14. STI (Straits Times Index)
15. SZSE (Shenzhen Stock Exchange)
16. NIK (Nikkei 225 Index)
17. TWII (Taiwan Weighted)
18. JKSE (Jakarta Composite Index)

Dataset

This dataset was created by Aditya Rajuladevi

Released under CC0: Public Domain

Contents

Context

Stocks and financial instrument trading is a lucrative proposition. Stock markets across the world facilitate such trades and thus wealth exchanges hands. Stock prices move up and down all the time and having ability to predict its movement has immense potential to make one rich. Stock price prediction has kept people interested from a long time. There are hypothesis like the Efficient Market Hypothesis, which says that it is almost impossible to beat the market consistently and there are others which disagree with it.

There are a number of known approaches and new research going on to find the magic formula to make you rich. One of the traditional methods is the time series forecasting. Fundamental analysis is another method where numerous performance ratios are analyzed to assess a given stock. On the emerging front, there are neural networks, genetic algorithms, and ensembling techniques.

Another challenging problem in stock price prediction is Black Swan Event, unpredictable events that cause stock market turbulence. These are events that occur from time to time, are unpredictable and often come with little or no warning.

A black swan event is an event that is completely unexpected and cannot be predicted. Unexpected events are generally referred to as black swans when they have significant consequences, though an event with few consequences might also be a black swan event. It may or may not be possible to provide explanations for the occurrence after the fact – but not before. In complex systems, like economies, markets and weather systems, there are often several causes. After such an event, many of the explanations for its occurrence will be overly simplistic.

#
#

https://www.visualcapitalist.com/wp-content/uploads/2020/03/mm3_black_swan_events_shareable.jpg"> #
#
New bleeding age state-of-the-art deep learning models stock predictions is overcoming such obstacles e.g. "Transformer and Time Embeddings". An objectives are to apply these novel models to forecast stock price.

Content

Stock price prediction is the task of forecasting the future value of a given stock. Given the historical daily close price for S&P 500 Index, prepare and compare forecasting solutions. S&P 500 or Standard and Poor's 500 index is an index comprising of 500 stocks from different sectors of US economy and is an indicator of US equities. Other such indices are the Dow 30, NIFTY 50, Nikkei 225, etc. For the purpose of understanding, we are utilizing S&P500 index, concepts, and knowledge can be applied to other stocks as well.

Dataset

The historical stock price information is also publicly available. For our current use case, we will utilize the pandas_datareader library to get the required S&P 500 index history using Yahoo Finance databases. We utilize the closing price information from the dataset available though other information such as opening price, adjusted closing price, etc., are also available. We prepare a utility function get_raw_data() to extract required information in a pandas dataframe. The function takes index ticker name as input. For S&P 500 index, the ticker name is ^GSPC. The following snippet uses the utility function to get the required data.(See Simple LSTM Regression)

Features and Terminology: In stock trading, the high and low refer to the maximum and minimum prices in a given time period. Open and close are the prices at which a stock began and ended trading in the same period. Volume is the total amount of trading activity. Adjusted values factor in corporate actions such as dividends, stock splits, and new share issuance.

Starter Kernel(s)

• Simple LSTM Regression

Acknowledgements

Mining and updating of this dateset will depend upon Yahoo Finance .

Inspiration

Sort of variation of sequence modeling and bleeding age e.g. attention can be applied for research and forecasting

Some Readings

• Applications of deep learning in stock market prediction: recent progress
• Stock predictions with state-of-the-art Transformer and Time Embeddings
• https://arxiv.org/pdf/1712.02136.pdf
• https://catanacapital.com/blog/unpredictable-black-swan-event-stock-market/
• https://par.nsf.gov/servlets/purl/10149715
• https://arxiv.org/pdf/1712.02136.pdf

*If you download and find the data useful your upvote is an explicit feedback for future works*

MEASURING CONGESTION WORLDWIDE

Cotton futures showed resilience with gains despite early weakness, influenced by dollar and oil trends, CFTC positioning, and ICE stock changes.

Cryptocurrency historical datasets from January 2012 (if available) to October 2021 were obtained and integrated from various sources and Application Programming Interfaces (APIs) including Yahoo Finance, Cryptodownload, CoinMarketCap, various Kaggle datasets, and multiple APIs. While these datasets used various formats of time (e.g., minutes, hours, days), in order to integrate the datasets days format was used for in this research study. The integrated cryptocurrency historical datasets for 80 cryptocurrencies including but not limited to Bitcoin (BTC), Ethereum (ETH), Binance Coin (BNB), Cardano (ADA), Tether (USDT), Ripple (XRP), Solana (SOL), Polkadot (DOT), USD Coin (USDC), Dogecoin (DOGE), Tron (TRX), Bitcoin Cash (BCH), Litecoin (LTC), EOS (EOS), Cosmos (ATOM), Stellar (XLM), Wrapped Bitcoin (WBTC), Uniswap (UNI), Terra (LUNA), SHIBA INU (SHIB), and 60 more cryptocurrencies were uploaded in this online Mendeley data repository. Although the primary attribute of including the mentioned cryptocurrencies was the Market Capitalization, a subject matter expert i.e., a professional trader has also guided the initial selection of the cryptocurrencies by analyzing various indicators such as Relative Strength Index (RSI), Moving Average Convergence/Divergence (MACD), MYC Signals, Bollinger Bands, Fibonacci Retracement, Stochastic Oscillator and Ichimoku Cloud. The primary features of this dataset that were used as the decision-making criteria of the CLUS-MCDA II approach are Timestamps, Open, High, Low, Closed, Volume (Currency), % Change (7 days and 24 hours), Market Cap and Weighted Price values. The available excel and CSV files in this data set are just part of the integrated data and other databases, datasets and API References that was used in this study are as follows: [1] https://finance.yahoo.com/ [2] https://coinmarketcap.com/historical/ [3] https://cryptodatadownload.com/ [4] https://kaggle.com/philmohun/cryptocurrency-financial-data [5] https://kaggle.com/deepshah16/meme-cryptocurrency-historical-data [6] https://kaggle.com/sudalairajkumar/cryptocurrencypricehistory [7] https://min-api.cryptocompare.com/data/price?fsym=BTC&tsyms=USD [8] https://min-api.cryptocompare.com/ [9] https://p.nomics.com/cryptocurrency-bitcoin-api [10] https://www.coinapi.io/ [11] https://www.coingecko.com/en/api [12] https://cryptowat.ch/ [13] https://www.alphavantage.co/ This dataset is part of the CLUS-MCDA (Cluster analysis for improving Multiple Criteria Decision Analysis) and CLUS-MCDAII Project: https://aimaghsoodi.github.io/CLUSMCDA-R-Package/ https://github.com/Aimaghsoodi/CLUS-MCDA-II https://github.com/azadkavian/CLUS-MCDA

CRB Index rose to 378.33 Index Points on December 1, 2025, up 0.45% from the previous day. Over the past month, CRB Index's price has fallen 0.80%, but it is still 10.95% higher than a year ago, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. CRB Commodity Index - values, historical data, forecasts and news - updated on December of 2025.

CBOE Volatility Index (^VIX)

Daily data from 1993 of the VIX index, a popular measure of the stock market's expectation of volatility based on S&P 500 index options.

Data obtained from Yahoo Finance

Data interval: 02 January 1993 - 28 June 2021.

Daily IHSG (Jakarta Composite Index) Historical Data

This dataset contains daily historical prices for the IHSG (Indeks Harga Saham Gabungan), also known as the Jakarta Composite Index (JCI). IHSG is the main stock market index of the Indonesia Stock Exchange (IDX) and is widely used as a benchmark for the Indonesian equity market.

The dataset is intended for:

• Time series analysis and forecasting
• Financial modeling and backtesting
• Market behavior and volatility analysis
• Educational projects and tutorials in quantitative finance

Data Source and Disclaimer

• Original source: Yahoo Finance
• Ticker: ^JKSE (Jakarta Composite Index)
• Source URL: https://finance.yahoo.com/quote/%5EJKSE/

The data was downloaded from Yahoo Finance and then exported to CSV format.

Disclaimer:
This dataset repackages market data originally provided by Yahoo Finance and its data vendors. It is shared for research and educational purposes only. Yahoo’s Terms of Service and the data providers’ terms may restrict redistribution and commercial use. Users are responsible for ensuring that their use of this dataset complies with all applicable terms and laws. Past performance is not indicative of future results.

File Overview

File: ihsg_daily.csv

• Rows: ~8k daily records
• Columns: 5
• Date range: 1995-01-02 to 2025-10-06 (trading days only)

Columns

• Date
  • Trading date (originally M/D/YYYY in the source; may appear as YYYY-MM-DD depending on your environment).
• Open
  • Opening index level for that trading day.
• High
  • Highest index level reached during the trading day.
• Low
  • Lowest index level reached during the trading day.
• Close
  • Closing index level for that trading day.

There are no Adj Close or Volume columns in this CSV file.

This data-set has data spanning from 2013 till 2018. The S&P 500 stock market index, maintained by S&P Dow Jones Indices, comprises 505 common stocks issued by 500 large-cap companies and traded on American stock exchanges, and covers about 80 percent of the American equity market by capitalization. The index is weighted by free-float market capitalization, so more valuable companies account for relatively more of the index. The index constituents and the constituent weights are updated regularly using rules published by S&P Dow Jones Indices. Although the index is called the S&P "500", the index contains 505 stocks because it includes two share classes of stock from 5 of its component companies.

The dataset comprises of all the S&P 500 components with the records created for each stock's open and closing rate spanning from last 5 years.

yahoo finance