About:

This dataset encompasses the historical data of major stock indices from around the world, sourced directly from Yahoo Finance. With data reaching back to the early 1920s (where available), it serves as an invaluable repository for academic researchers, financial analysts, and market enthusiasts. Users can delve into trends across decades, evaluate historical market behaviors, or even design and validate predictive financial models.

Photo by Tötös Ádám on Unsplash

Info on CSVs:

1. all_indices_data.csv:

   • Description: A consolidated dataset merging all the stock indices from Yahoo Finance.
   • Columns:
     • date: The date of the data point (formatted as YYYY-MM-DD).
     • open: The opening value of the index on that date.
     • high: The highest value of the index during the trading session.
     • low: The lowest value of the index during the trading session.
     • close: The closing value of the index.
     • volume: The trading volume of the index on that date.
     • ticker: The ticker symbol of the stock index.

2. individual_indices_data/[SYMBOL]_data.csv:

   • Description: Individual datasets for each stock index, where [SYMBOL] denotes the ticker symbol of the respective stock index. Each dataset is curated from Yahoo Finance's historical data archives.
   • Columns:
     • date: The date of the data point (formatted as YYYY-MM-DD).
     • open: The opening value of the index on that date.
     • high: The highest value of the index during the trading session.
     • low: The lowest value of the index during the trading session.
     • close: The closing value of the index.
     • volume: The trading volume of the index on that date.

Context:

The provided dataset is extracted from yahoo finance using pandas and yahoo finance library in python. This deals with stock market index of the world best economies. The code generated data from Jan 01, 2003 to Jun 30, 2023 that’s more than 20 years. There are 18 CSV files, dataset is generated for 16 different stock market indices comprising of 7 different countries. Below is the list of countries along with number of indices extracted through yahoo finance library, while two CSV files deals with annualized return and compound annual growth rate (CAGR) has been computed from the extracted data.

Number of Countries & Index:

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F90ce8a986761636e3edbb49464b304d8%2FNumber%20of%20Index.JPG?generation=1688490342207096&alt=media" alt="">

Content:

Unit of analysis: Stock Market Index Analysis

This dataset is useful for research purposes, particularly for conducting comparative analyses involving capital market performance and could be used along with other economic indicators.

There are 18 distinct CSV files associated with this dataset. First 16 CSV files deals with number of indices and last two CSV file deals with annualized return of each year and CAGR of each index. If data in any column is blank, it portrays that index was launch in later years, for instance: Bse500 (India), this index launch in 2007, so earlier values are blank, similarly China_Top300 index launch in year 2021 so early fields are blank too.

The extraction process involves applying different criteria, like in 16 CSV files all columns are included, Adj Close is used to calculate annualized return. The algorithm extracts data based on index name (code given by the yahoo finance) according start and end date.

Annualized return and CAGR has been calculated and illustrated in below image along with machine readable file (CSV) attached to that.

To extract the data provided in the attachment, various criteria were applied:

1. Content Filtering: The data was filtered based on several attributes, including the index name, start and end date. This filtering process ensured that only relevant data meeting the specified criteria.

2. Collaborative Filtering: Another filtering technique used was collaborative filtering using yahoo finance, which relies on index similarity. This approach involves finding indices that are similar to other index or extended dataset scope to other countries or economies. By leveraging this method, the algorithm identifies and extracts data based on similarities between indices.

In the last two CSV files, one belongs to annualized return, that was calculated based on the Adj close column and new DataFrame created to store its outcome. Below is the image of annualized returns of all index (if unreadable, machine-readable or CSV format is attached with the dataset).

Annualized Return:

As far as annualised rate of return is concerned, most of the time India stock market indices leading, followed by USA, Canada and Japan stock market indices.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F37645bd90623ea79f3708a958013c098%2FAnnualized%20Return.JPG?generation=1688525901452892&alt=media" alt="">

Compound Annual Growth Rate (CAGR):

The best performing index based on compound growth is Sensex (India) that comprises of top 30 companies is 15.60%, followed by Nifty500 (India) that is 11.34% and Nasdaq (USA) all is 10.60%.

The worst performing index is China top300, however this is launch in 2021 (post pandemic), so would not possible to examine at that stage (due to less data availability). Furthermore, UK and Russia indices are also top 5 in the worst order.

https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F15657145%2F58ae33f60a8800749f802b46ec1e07e7%2FCAGR.JPG?generation=1688490409606631&alt=media" alt="">

Geography: Stock Market Index of the World Top Economies

Time period: Jan 01, 2003 – June 30, 2023

Variables: Stock Market Index Title, Open, High, Low, Close, Adj Close, Volume, Year, Month, Day, Yearly_Return and CAGR

File Type: CSV file

Inspiration:

• Time series prediction model
• Investment opportunities in world best economies
• Comparative Analysis of past data with other stock market indices or other indices

Disclaimer:

This is not a financial advice; due diligence is required in each investment decision.

This is the name of the 38 global main stock indexes in the world. We collected from Yahoo! Finance. For the convenience of expression and computation later, we numbered it. For each item, the front is its serial number, followed by the corresponding stock index.

Collected from Yahoo Finance, Investing.com and WJS, this dataset consists of the following indices ranging from July 17, 2017 to July 22, 2022:

1. DJI (Dow Jones Industrial Average)
2. SNP (Standard and Poor's 500)
3. IXIC (Nasdaq Composite)
4. VIX (CBOE Volatility Index)
5. FTSE (Financial Times Stock Exchange)
6. FCHI (CAC 40 Paris Index)
7. STOXX (The STOXX Europe 600)
8. AEX (Amsterdam Exchange Index)
9. IBEX (Iberian Index, Madrid)
10. MOEX (Russia Index)
11. BIST (Istanbul Index)
12. HSI (Hang Seng Index)
13. SSE (Shanghai Composite Index)
14. STI (Straits Times Index)
15. SZSE (Shenzhen Stock Exchange)
16. NIK (Nikkei 225 Index)
17. TWII (Taiwan Weighted)
18. JKSE (Jakarta Composite Index)

################################################################################################## THE FILES HAVE BEEN CREATED BY SZILÁRD ERHART FOR A RESEARCH: ERHART (2021): ESG RATINGS OF GENERAL # STOCK EXCHANGE INDICES, INTERNATIONAL REVIEW OF FINANCIAL ANALYSIS# USERS OF THE FILES AGREE TO QUOTE THE ABOVE PAPER# THE PYTHON SCRIPT (PYTHONESG_ERHART.TXT) HELPS USERS TO GET TICKERS BY STOCK EXCHANGES AND EXTRACT ESG SCORES FOR THE UNDERLYING STOCKS FROM YAHOO FINANCE.# THE R SCRIPT (ESG_UA.TXT) HELPS TO REPLICATE THE MONTE CARLO EXPERIMENT DETAILED IN THE STUDY.# THE EXPORT_ALL CSV CONTAINS THE DOWNLOADED ESG DATA (SCORES, CONTROVERSIES, ETC) ORGANIZED BY STOCKS AND EXCHANGES.############################################################################################################################################################################################################### DISCLAIMER # The author takes no responsibility for the timeliness, accuracy, completeness or quality of the information provided. # The author is in no event liable for damages of any kind incurred or suffered as a result of the use or non-use of the # information presented or the use of defective or incomplete information. # The contents are subject to confirmation and not binding. # The author expressly reserves the right to alter, amend, whole and in part, # without prior notice or to discontinue publication for a period of time or even completely. ###########################################################################################################################################READ ME############################################################# BEFORE USING THE MONTE CARLO SIMULATIONS SCRIPT: # (1) COPY THE goascores.csv and goalscores_alt.csv FILES ONTO YOUR ON COMPUTER DRIVE. THE TWO FILES ARE IDENTICAL.# (2) SET THE EXACT FILE LOCATION INFORMATION IN THE 'Read in data' SECTION OF THE MONTE CARLO SCRIPT AND FOR THE OUTPUT FILES AT THE END OF THE SCRIPT# (3) LOAD MISC TOOLS AND MATRIXSTATS IN YOUR R APPLICATION# (4) RUN THE CODE.####################################READ ME

Context

Stocks and financial instrument trading is a lucrative proposition. Stock markets across the world facilitate such trades and thus wealth exchanges hands. Stock prices move up and down all the time and having ability to predict its movement has immense potential to make one rich. Stock price prediction has kept people interested from a long time. There are hypothesis like the Efficient Market Hypothesis, which says that it is almost impossible to beat the market consistently and there are others which disagree with it.

There are a number of known approaches and new research going on to find the magic formula to make you rich. One of the traditional methods is the time series forecasting. Fundamental analysis is another method where numerous performance ratios are analyzed to assess a given stock. On the emerging front, there are neural networks, genetic algorithms, and ensembling techniques.

Another challenging problem in stock price prediction is Black Swan Event, unpredictable events that cause stock market turbulence. These are events that occur from time to time, are unpredictable and often come with little or no warning.

A black swan event is an event that is completely unexpected and cannot be predicted. Unexpected events are generally referred to as black swans when they have significant consequences, though an event with few consequences might also be a black swan event. It may or may not be possible to provide explanations for the occurrence after the fact – but not before. In complex systems, like economies, markets and weather systems, there are often several causes. After such an event, many of the explanations for its occurrence will be overly simplistic.

#
#

https://www.visualcapitalist.com/wp-content/uploads/2020/03/mm3_black_swan_events_shareable.jpg"> #
#
New bleeding age state-of-the-art deep learning models stock predictions is overcoming such obstacles e.g. "Transformer and Time Embeddings". An objectives are to apply these novel models to forecast stock price.

Content

Stock price prediction is the task of forecasting the future value of a given stock. Given the historical daily close price for S&P 500 Index, prepare and compare forecasting solutions. S&P 500 or Standard and Poor's 500 index is an index comprising of 500 stocks from different sectors of US economy and is an indicator of US equities. Other such indices are the Dow 30, NIFTY 50, Nikkei 225, etc. For the purpose of understanding, we are utilizing S&P500 index, concepts, and knowledge can be applied to other stocks as well.

Dataset

The historical stock price information is also publicly available. For our current use case, we will utilize the pandas_datareader library to get the required S&P 500 index history using Yahoo Finance databases. We utilize the closing price information from the dataset available though other information such as opening price, adjusted closing price, etc., are also available. We prepare a utility function get_raw_data() to extract required information in a pandas dataframe. The function takes index ticker name as input. For S&P 500 index, the ticker name is ^GSPC. The following snippet uses the utility function to get the required data.(See Simple LSTM Regression)

Features and Terminology: In stock trading, the high and low refer to the maximum and minimum prices in a given time period. Open and close are the prices at which a stock began and ended trading in the same period. Volume is the total amount of trading activity. Adjusted values factor in corporate actions such as dividends, stock splits, and new share issuance.

Starter Kernel(s)

• Simple LSTM Regression

Acknowledgements

Mining and updating of this dateset will depend upon Yahoo Finance .

Inspiration

Sort of variation of sequence modeling and bleeding age e.g. attention can be applied for research and forecasting

Some Readings

• Applications of deep learning in stock market prediction: recent progress
• Stock predictions with state-of-the-art Transformer and Time Embeddings
• https://arxiv.org/pdf/1712.02136.pdf
• https://catanacapital.com/blog/unpredictable-black-swan-event-stock-market/
• https://par.nsf.gov/servlets/purl/10149715
• https://arxiv.org/pdf/1712.02136.pdf

*If you download and find the data useful your upvote is an explicit feedback for future works*

As of October 2025, Google represented ***** percent of the global online search engine referrals on desktop devices. Despite being much ahead of its competitors, this represents a modest increase from the previous months. Meanwhile, its longtime competitor Bing accounted for ***** percent, as tools like Yahoo and Yandex held shares of over **** percent and **** percent respectively. Google and the global search market Ever since the introduction of Google Search in 1997, the company has dominated the search engine market, while the shares of all other tools has been rather lopsided. The majority of Google revenues are generated through advertising. Its parent corporation, Alphabet, was one of the biggest internet companies worldwide as of 2024, with a market capitalization of **** trillion U.S. dollars. The company has also expanded its services to mail, productivity tools, enterprise products, mobile devices, and other ventures. As a result, Google earned one of the highest tech company revenues in 2024 with roughly ****** billion U.S. dollars. Search engine usage in different countries Google is the most frequently used search engine worldwide. But in some countries, its alternatives are leading or competing with it to some extent. As of the last quarter of 2023, more than ** percent of internet users in Russia used Yandex, whereas Google users represented little over ** percent. Meanwhile, Baidu was the most used search engine in China, despite a strong decrease in the percentage of internet users in the country accessing it. In other countries, like Japan and Mexico, people tend to use Yahoo along with Google. By the end of 2024, nearly half of the respondents in Japan said that they had used Yahoo in the past four weeks. In the same year, over ** percent of users in Mexico said they used Yahoo.

Content

Daily price data for indexes tracking stock exchanges from all over the world (United States, China, Canada, Germany, Japan, and more). The data was all collected from Yahoo Finance, which had several decades of data available for most exchanges.

Prices are quoted in terms of the national currency of where each exchange is located.

Acknowledgements

Data collected from Yahoo Finance Photo by Jason Leung on Unsplash

In January 2025, Google accounted for 93.82 percent of the global mobile search engine market worldwide. Yandex had 2.5 percent of the global mobile search, while, competitors like Baidu and Yahoo! accounted for less than one percent each on a global scale.

Google is not only popular in its home country, but is also the dominant internet search provider in many major online markets, frequently generating between ** and ** percent of desktop search traffic. The search engine giant has a market share of over ** percent in India and accounted for the majority of the global search engine market, way ahead of other competitors such as Yahoo, Bing, Yandex, and Baidu. Google’s online dominance All roads lead to Rome, or if you are browsing the internet, all roads lead to Google. It is hard to imagine an online experience without the online behemoth, as the company offers a wide range of online products and services that all seamlessly integrate with each other. Google search and advertising are the core products of the company, accounting for the vast majority of the company revenues. When adding this up with the Chrome browser, Gmail, Google Maps, YouTube, Google’s ownership of the Android mobile operating system, and various other consumer and enterprise services, Google is basically a one-stop shop for online needs. Google anti-trust rulings However, Google’s dominance of the search market is not always welcome and is keenly watched by authorities and industry watchdogs – since 2017, the EU commission has fined Google over ***** billion euros in antitrust fines for abusing its monopoly in online advertising. In March 2019, European Commission found that Google violated antitrust regulations by imposing contractual restrictions on third-party websites in order to make them less competitive and fined the company *** billion euros.

Baltic Dry rose to 2,600 Index Points on December 2, 2025, up 0.66% from the previous day. Over the past month, Baltic Dry's price has risen 33.68%, and is up 110.19% compared to the same time last year, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. Baltic Exchange Dry Index - values, historical data, forecasts and news - updated on December of 2025.

As of March 2025, Google continued to dominate the global search engine industry by far, with an 89.62 percent market share. However, this stronghold may be showing signs of erosion, with its share across all devices dipping to its lowest point in over two decades. Bing, Google's closest competitor, currently holds a market share of 4.01 percent across, while Russia-based Yandex hikes to the third place with a share of around 2.51 percent. Competitive landscape and regional variations While Google's overall dominance persists, other search engines carve out niches in various markets and platforms. Bing holds a 12.21 percent market share across desktop devices worldwide, as Yandex and Baidu have found success inside and outside of their home markets. Yandex is used by over 63 percent of Russian internet users, but Baidu has seen its market share significantly in China As regional variations highlight the importance of local players in challenging Google's global supremacy, the company is likely to face more challenges with the AI-powered online search trend and increasing regulatory scrutiny. Search behavior and antitrust concerns Despite facing more competition, Google remains deeply ingrained in users' online habits. In 2024, "Google" itself was the most popular search query on its own platform, followed by "YouTube" - another Google-owned property. This self-reinforcing ecosystem has drawn scrutiny from regulators, with the European Commission imposing millionaire antitrust fines on the company. As its influence extends beyond search into various online services, the company's market position continues to be a subject of debate among industry watchdogs and authorities worldwide.

Context

I have scrapped the data from finance yahoo stocks for my own project related work Thank you for data science community without help of varies people and their ideas i cannot be achieved this dataset publishing in kaggle ,this is small contribution from me

Content

Daily price data for indexes tracking stock exchanges from all over the world (United States, China, Canada, Germany, Japan, and more). The data was all collected from Yahoo Finance, which had several decades of data available for most exchanges.

Acknowledgements

The data scrapped from Yahoo_finance stocks for last 20 years

Inspiration

Your data will be in front of the world's largest data science community. What questions do you want to see answered?

Coffee fell to 408.66 USd/Lbs on December 2, 2025, down 0.95% from the previous day. Over the past month, Coffee's price has risen 0.50%, and is up 38.54% compared to the same time last year, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. Coffee - values, historical data, forecasts and news - updated on December of 2025.

Context

Time series modelling for the prediction of stocks prices is a challenging task. Political events, market expectations and economic factors are just a few known factors that can impact financial market behaviour. The financial market is a complex, noisy, evolutionary and chaotic field of study that attracts many enthusiasts and researches — the first, usually driven by the economic benefit of it, the latter, inspired by the challenge of handling such complex data.

This project aims to predict Facebook (FB) next day stock price direction with machine learning algorithms. Technical indicators and global market indexes are used, and their influence on the forecast accuracy is analysed.

Content

Daily values were retrieved (volume, open, close, low and high prices) from Yahoo! Finance website. For Facebook (FB), July 2012 was the earliest data available. The date range is July 2012 to November 2018.

The closing price of current day C(t) and closing price from the previous day C(t-1) are compared to build the initial dataset. The objective is to define if the price trend is going up or down by analysing these two values. For each instance, a comparison was made and recorded. If the price is going up, C(t) > C(t-1), class “1” is assigned. Class “0” is assigned for the opposite case.

• ID: Sample ID
• Close: Closing value of previous day
• Low: Lowest value of previous day
• High: Highest value of previous day
• Volume: Volume value of previous day

Research was initiated to understand which features could help the model to forecast the stock direction. Three main routes were found: Lag features, Technical Indicators and Global Market Indexes. Below is an explanation of each group of features.

Lag features are features that contain the closing price and direction of previous days and it is a common strategy for Time Series models. The following features were added:

• C(t-5): Closing price of 5 days before
• C(t-4): Closing price of 4 days before
• C(t-3): Closing price of 3 days before
• C(t-2): Closing price of 2 days before
• C_up_4: Output 1 if closing price went up 4 days ago
• C_up_3: Output 1 if closing price went up 3 days ago
• C_up_2: Output 1 if closing price went up 2 days ago
• C_up_1: Output 1 if closing price went up 1 day ago

Technical indicators are used by researches and financial market analysts to support stock market trend forecasting. Common indicators retrieved from the literature were selected and calculated for Facebook stock. Techical Indicators added:

• MA-10: Moving Average considering previous 10 days
• MA-5: Moving Average considering previous 5 days
• WMA-10: Weighted Moving Average considering previous 10 days
• SO: Stochastic Oscillator
• M: Momentum as the difference in closing price in a 10 days interval
• SSO: Slow Stochastic Oscillator
• EMA: Exponential Moving Average for a 10 day period
• MACD_Sline_9: MACD Signal Line for a 9 day period
• RSI: Relative Strength Index
• CCI: Commodity Channel Index
• ADO: Accumulation Distribution Oscillator

Technical indicators provide a suggestion of the stock price movement. Additional features were created for each technical indicator by analysing its daily value and assigning a class according to their meaning. Class “1” is given if the indicator numerical value suggests upper trend, class “0” for a downtrend. In other words, financial market analysis is performed at a simplistic level, in the attempt to translate what the continuous value means.

• MA-10>C: If MA-10 is higher than Closing price output 1
• MA-5>C: If MA-5 is higher than Closing price output 1
• WMA-10>C: If WMA-10 is higher than Closing price output 1
• SO>SOt-1: Output is 1 if SO current value is higher than previous day
• M>0: A positive momentum outputs 1
• SSO>SSOt-1: SSO current value is higher than previous day
• EMA>C: If EMA is higher than Closing price output 1
• MACD>MACDt-1: If MACD current value is higher than previous day output 1
• RSI70-30: If RSI is above 70, output 0. Values below 30 output is one. For values within this range it compares to previous day and outputs 1 if value has increased
• CCI200-200: Similar to RSI, but if threshold set for 200 and -200.
• ADO>ADOt-1: Output is 1 if ADO current value is higher than previous day

For a given country or region, the stock market index characterises the performance of its financial market and the overall local economy. For this reason, the same day performance of these markets could contribute to the machine learning model predictions. Six global indexes were added as features, with their closing direction as up or down, class “1” or “0”, respectively. Data for these indexes (Nikkei, Hang Seng, All Ordinaries, Euronext 100, SSE and DAX) were also retrieved from Yahoo! Finance.

Overview This dataset provides daily snapshots of cryptocurrency, stock market, and forex data.

Sources Yahoo Finance (via yfinance)

Features Automated daily updates Covers major global indices and top cryptocurrencies Includes sentiment analysis for financial news

Use Cases Financial market analysis Machine learning for price prediction Trading strategy research

License Data compiled from public APIs for educational and analytical use.

https://upload.wikimedia.org/wikipedia/commons/thumb/8/87/NASDAQ_Logo.svg/1280px-NASDAQ_Logo.svg.png" alt="NASDAQ">

• The Nasdaq Stock Market ) is an American stock exchange based in New York City. It is ranked second on the list of stock exchanges by market capitalization of shares traded, behind the New York Stock Exchange.
• The exchange platform is owned by Nasdaq, Inc., which also owns the Nasdaq Nordic stock market network and several U.S. stock and options exchanges.
• "Nasdaq" was initially an acronym for the National Association of Securities Dealers Automated Quotations.
• It was founded in 1971 by the National Association of Securities Dealers (NASD), now known as the Financial Industry Regulatory Authority (FINRA).
• On February 8, 1971, the Nasdaq stock market began operations as the world's first electronic stock market.
• At first, it was merely a "quotation system" and did not provide a way to perform electronic trades.

Context

NASDAQ is one of the most popular stock exchanges in the world and the data trend determines the world economy in a way

Content

Stock prices of all NASDAQ-100 index stocks (as on Sep 2021) from 2010

Acknowledgements

Yahoo Finance API development team

Inspiration

All the Kagglers and Data Science Enthusiasts