This is the name of the 38 global main stock indexes in the world. We collected from Yahoo! Finance. For the convenience of expression and computation later, we numbered it. For each item, the front is its serial number, followed by the corresponding stock index.

Analysis of ‘Time Series Forecasting with Yahoo Stock Price ’ provided by Analyst-2 (analyst-2.ai), based on source dataset retrieved from https://www.kaggle.com/arashnic/time-series-forecasting-with-yahoo-stock-price on 28 January 2022.

--- Dataset description provided by original source is as follows ---

Context

Stocks and financial instrument trading is a lucrative proposition. Stock markets across the world facilitate such trades and thus wealth exchanges hands. Stock prices move up and down all the time and having ability to predict its movement has immense potential to make one rich. Stock price prediction has kept people interested from a long time. There are hypothesis like the Efficient Market Hypothesis, which says that it is almost impossible to beat the market consistently and there are others which disagree with it.

There are a number of known approaches and new research going on to find the magic formula to make you rich. One of the traditional methods is the time series forecasting. Fundamental analysis is another method where numerous performance ratios are analyzed to assess a given stock. On the emerging front, there are neural networks, genetic algorithms, and ensembling techniques.

Another challenging problem in stock price prediction is Black Swan Event, unpredictable events that cause stock market turbulence. These are events that occur from time to time, are unpredictable and often come with little or no warning.

A black swan event is an event that is completely unexpected and cannot be predicted. Unexpected events are generally referred to as black swans when they have significant consequences, though an event with few consequences might also be a black swan event. It may or may not be possible to provide explanations for the occurrence after the fact – but not before. In complex systems, like economies, markets and weather systems, there are often several causes. After such an event, many of the explanations for its occurrence will be overly simplistic.

#
#

https://www.visualcapitalist.com/wp-content/uploads/2020/03/mm3_black_swan_events_shareable.jpg"> #
#
New bleeding age state-of-the-art deep learning models stock predictions is overcoming such obstacles e.g. "Transformer and Time Embeddings". An objectives are to apply these novel models to forecast stock price.

Content

Stock price prediction is the task of forecasting the future value of a given stock. Given the historical daily close price for S&P 500 Index, prepare and compare forecasting solutions. S&P 500 or Standard and Poor's 500 index is an index comprising of 500 stocks from different sectors of US economy and is an indicator of US equities. Other such indices are the Dow 30, NIFTY 50, Nikkei 225, etc. For the purpose of understanding, we are utilizing S&P500 index, concepts, and knowledge can be applied to other stocks as well.

Dataset

The historical stock price information is also publicly available. For our current use case, we will utilize the pandas_datareader library to get the required S&P 500 index history using Yahoo Finance databases. We utilize the closing price information from the dataset available though other information such as opening price, adjusted closing price, etc., are also available. We prepare a utility function get_raw_data() to extract required information in a pandas dataframe. The function takes index ticker name as input. For S&P 500 index, the ticker name is ^GSPC. The following snippet uses the utility function to get the required data.(See Simple LSTM Regression)

Features and Terminology: In stock trading, the high and low refer to the maximum and minimum prices in a given time period. Open and close are the prices at which a stock began and ended trading in the same period. Volume is the total amount of trading activity. Adjusted values factor in corporate actions such as dividends, stock splits, and new share issuance.

Starter Kernel(s)

• Simple LSTM Regression

Acknowledgements

Mining and updating of this dateset will depend upon Yahoo Finance .

Inspiration

Sort of variation of sequence modeling and bleeding age e.g. attention can be applied for research and forecasting

Some Readings

• Applications of deep learning in stock market prediction: recent progress
• Stock predictions with state-of-the-art Transformer and Time Embeddings
• https://arxiv.org/pdf/1712.02136.pdf
• https://catanacapital.com/blog/unpredictable-black-swan-event-stock-market/
• https://par.nsf.gov/servlets/purl/10149715
• https://arxiv.org/pdf/1712.02136.pdf

*If you download and find the data useful your upvote is an explicit feedback for future works*

--- Original source retains full ownership of the source dataset ---

################################################################################################## THE FILES HAVE BEEN CREATED BY SZILÁRD ERHART FOR A RESEARCH: ERHART (2021): ESG RATINGS OF GENERAL # STOCK EXCHANGE INDICES, INTERNATIONAL REVIEW OF FINANCIAL ANALYSIS# USERS OF THE FILES AGREE TO QUOTE THE ABOVE PAPER# THE PYTHON SCRIPT (PYTHONESG_ERHART.TXT) HELPS USERS TO GET TICKERS BY STOCK EXCHANGES AND EXTRACT ESG SCORES FOR THE UNDERLYING STOCKS FROM YAHOO FINANCE.# THE R SCRIPT (ESG_UA.TXT) HELPS TO REPLICATE THE MONTE CARLO EXPERIMENT DETAILED IN THE STUDY.# THE EXPORT_ALL CSV CONTAINS THE DOWNLOADED ESG DATA (SCORES, CONTROVERSIES, ETC) ORGANIZED BY STOCKS AND EXCHANGES.############################################################################################################################################################################################################### DISCLAIMER # The author takes no responsibility for the timeliness, accuracy, completeness or quality of the information provided. # The author is in no event liable for damages of any kind incurred or suffered as a result of the use or non-use of the # information presented or the use of defective or incomplete information. # The contents are subject to confirmation and not binding. # The author expressly reserves the right to alter, amend, whole and in part, # without prior notice or to discontinue publication for a period of time or even completely. ###########################################################################################################################################READ ME############################################################# BEFORE USING THE MONTE CARLO SIMULATIONS SCRIPT: # (1) COPY THE goascores.csv and goalscores_alt.csv FILES ONTO YOUR ON COMPUTER DRIVE. THE TWO FILES ARE IDENTICAL.# (2) SET THE EXACT FILE LOCATION INFORMATION IN THE 'Read in data' SECTION OF THE MONTE CARLO SCRIPT AND FOR THE OUTPUT FILES AT THE END OF THE SCRIPT# (3) LOAD MISC TOOLS AND MATRIXSTATS IN YOUR R APPLICATION# (4) RUN THE CODE.####################################READ ME

Context

In this dataset you can find the Top 100 companies in the technology sector. You can also find 5 of the most important and used indices in the financial market as well as a list of all the companies in the S&P 500 index and in the technology sector.

The Global Industry Classification Standard also known as GICS is the primary financial industry standard for defining sector classifications. The Global Industry Classification Standard was developed by index providers MSCI and Standard and Poor’s. Its hierarchy begins with 11 sectors which can be further delineated to 24 industry groups, 69 industries, and 158 sub-industries.

You can read the definition of each sector here.

The 11 broad GICS sectors commonly used for sector breakdown reporting include the following: Energy, Materials, Industrials, Consumer Discretionary, Consumer Staples, Health Care, Financials, Information Technology, Telecommunication Services, Utilities and Real Estate.

In this case we will focuse in the Technology Sector. You can see all the sectors and industry groups here.

To determine which companies, correspond to the technology sector, we use Yahoo Finance, where we rank the companies according to their “Market Cap”. After having the list of the Top 100 best valued companies in the sector, we proceeded to download the historical data of each of the companies using the NASDAQ website.

Regarding to the indices, we searched various sources to find out which were the most used and determined that the 5 most frequently used indices are: Dow Jones Industrial Average (DJI), S&P 500 (SPX), NASDAQ Composite (IXIC), Wilshire 5000 Total Market Inde (W5000) and to specifically view the technology sector SPDR Select Sector Fund - Technology (XLK). Historical data for these indices was also obtained from the NASDQ website.

Content

In total there are 107 files in csv format. They are composed as follows:

• 100 files contain the historical data of tech companies.
• 5 files contain the historical data of the most used indices.
• 1 file contain the list of all the companies in the S&P 500 index.
• 1 file contain the list of all the companies in the technology sector.

Column Description

Every company and index file has the same structure with the same columns:

Date: It is the date on which the prices were recorded. High: Is the highest price at which a stock traded during the course of the trading day. Low: Is the lowest price at which a stock traded during the course of the trading day. Open: Is the price at which a stock started trading when the opening bell rang. Close: Is the last price at which a stock trades during a regular trading session. Volume: Is the number of shares that changed hands during a given day. Adj Close: The adjusted closing price factors in corporate actions, such as stock splits, dividends, and rights offerings.

The two other files have different columns names:

List of S&P 500 companies

Symbol: Ticker symbol of the company. Name: Name of the company. Sector: The sector to which the company belongs.

Technology Sector Companies List

Symbol: Ticker symbol of the company. Name: Name of the company. Price: Current price at which a stock can be purchased or sold. (11/24/20) Change: Net change is the difference between closing prices from one day to the next. % Change: Is the difference between closing prices from one day to the next in percentage. Volume: Is the number of shares that changed hands during a given day. Avg Vol: Is the daily average of the cumulative trading volume during the last three months. Market Cap (Billions): Is the total value of a company’s shares outstanding at a given moment in time. It is calculated by multiplying the number of shares outstanding by the price of a single share. PE Ratio: Is the ratio of a company's share (stock) price to the company's earnings per share. The ratio is used for valuing companies and to find out whether they are overvalued or undervalued.

Acknowledgements

SEC EDGAR | Company Filings NASDAQ | Historical Quotes Yahoo Finance | Technology Sector Wikipedia | List of S&P 500 companies S&P Dow Jones Indices | S&P 500 [S&P Dow Jones Indices | DJI](https://www.spglobal.com/spdji/en/i...

Baltic Dry rose to 1,663 Index Points on July 11, 2025, up 13.52% from the previous day. Over the past month, Baltic Dry's price has fallen 15.50%, and is down 16.73% compared to the same time last year, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. Baltic Exchange Dry Index - values, historical data, forecasts and news - updated on July of 2025.

CRB Index rose to 373.34 Index Points on July 11, 2025, up 1.06% from the previous day. Over the past month, CRB Index's price has risen 0.59%, and is up 9.33% compared to the same time last year, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. CRB Commodity Index - values, historical data, forecasts and news - updated on July of 2025.

Context

Time series modelling for the prediction of stocks prices is a challenging task. Political events, market expectations and economic factors are just a few known factors that can impact financial market behaviour. The financial market is a complex, noisy, evolutionary and chaotic field of study that attracts many enthusiasts and researches — the first, usually driven by the economic benefit of it, the latter, inspired by the challenge of handling such complex data.

This project aims to predict Facebook (FB) next day stock price direction with machine learning algorithms. Technical indicators and global market indexes are used, and their influence on the forecast accuracy is analysed.

Content

Daily values were retrieved (volume, open, close, low and high prices) from Yahoo! Finance website. For Facebook (FB), July 2012 was the earliest data available. The date range is July 2012 to November 2018.

The closing price of current day C(t) and closing price from the previous day C(t-1) are compared to build the initial dataset. The objective is to define if the price trend is going up or down by analysing these two values. For each instance, a comparison was made and recorded. If the price is going up, C(t) > C(t-1), class “1” is assigned. Class “0” is assigned for the opposite case.

• ID: Sample ID
• Close: Closing value of previous day
• Low: Lowest value of previous day
• High: Highest value of previous day
• Volume: Volume value of previous day

Research was initiated to understand which features could help the model to forecast the stock direction. Three main routes were found: Lag features, Technical Indicators and Global Market Indexes. Below is an explanation of each group of features.

Lag features are features that contain the closing price and direction of previous days and it is a common strategy for Time Series models. The following features were added:

• C(t-5): Closing price of 5 days before
• C(t-4): Closing price of 4 days before
• C(t-3): Closing price of 3 days before
• C(t-2): Closing price of 2 days before
• C_up_4: Output 1 if closing price went up 4 days ago
• C_up_3: Output 1 if closing price went up 3 days ago
• C_up_2: Output 1 if closing price went up 2 days ago
• C_up_1: Output 1 if closing price went up 1 day ago

Technical indicators are used by researches and financial market analysts to support stock market trend forecasting. Common indicators retrieved from the literature were selected and calculated for Facebook stock. Techical Indicators added:

• MA-10: Moving Average considering previous 10 days
• MA-5: Moving Average considering previous 5 days
• WMA-10: Weighted Moving Average considering previous 10 days
• SO: Stochastic Oscillator
• M: Momentum as the difference in closing price in a 10 days interval
• SSO: Slow Stochastic Oscillator
• EMA: Exponential Moving Average for a 10 day period
• MACD_Sline_9: MACD Signal Line for a 9 day period
• RSI: Relative Strength Index
• CCI: Commodity Channel Index
• ADO: Accumulation Distribution Oscillator

Technical indicators provide a suggestion of the stock price movement. Additional features were created for each technical indicator by analysing its daily value and assigning a class according to their meaning. Class “1” is given if the indicator numerical value suggests upper trend, class “0” for a downtrend. In other words, financial market analysis is performed at a simplistic level, in the attempt to translate what the continuous value means.

• MA-10>C: If MA-10 is higher than Closing price output 1
• MA-5>C: If MA-5 is higher than Closing price output 1
• WMA-10>C: If WMA-10 is higher than Closing price output 1
• SO>SOt-1: Output is 1 if SO current value is higher than previous day
• M>0: A positive momentum outputs 1
• SSO>SSOt-1: SSO current value is higher than previous day
• EMA>C: If EMA is higher than Closing price output 1
• MACD>MACDt-1: If MACD current value is higher than previous day output 1
• RSI70-30: If RSI is above 70, output 0. Values below 30 output is one. For values within this range it compares to previous day and outputs 1 if value has increased
• CCI200-200: Similar to RSI, but if threshold set for 200 and -200.
• ADO>ADOt-1: Output is 1 if ADO current value is higher than previous day

For a given country or region, the stock market index characterises the performance of its financial market and the overall local economy. For this reason, the same day performance of these markets could contribute to the machine learning model predictions. Six global indexes were added as features, with their closing direction as up or down, class “1” or “0”, respectively. Data for these indexes (Nikkei, Hang Seng, All Ordinaries, Euronext 100, SSE and DAX) were also retrieved from Yahoo! Finance.

Coffee fell to 288.72 USd/Lbs on July 11, 2025, down 0.41% from the previous day. Over the past month, Coffee's price has fallen 16.63%, but it is still 15.90% higher than a year ago, according to trading on a contract for difference (CFD) that tracks the benchmark market for this commodity. Coffee - values, historical data, forecasts and news - updated on July of 2025.

Context

This dataset contains historical data of stocks listed on IHSG with time ranges per minutes, hourly, and daily. The source of the dataset is taken from Yahoo Finance's public data and the IDX website which is listed in the metadata tab. This dataset was created with the intention of academic research purposes and not to be commercialized. If you have questions about the dataset, please ask in the discussion tab. Code snippet: https://github.com/muamkh/IHSGstockscraper

Content

Stock minutes data is taken from 1 November 2021 until 6 January 2023. Stock hourly data is taken from 16 April 2020 until 6 January 2023. Stock daily data is taken from 16 April 2001 until 6 January 2023. All of the data is using CSV format. Stock data isnt adjusted with dividend, stock split, and other corporate action.

Stocklist Structure

• Code = Stock code
• Name = Company name
• ListingDate = Listing date of stock on Indonesia Stock Exchange
• Shares = Amount of shares
• ListingBoard = Board category (Main Board, Development Board or Acceleration). More info: https://www.idx.co.id/en-us/products/stocks/
• Sector = Sector Category based on IDX-IC. More info: https://www.idx.co.id/en-us/products/stocks/
• LastPrice = Last stock price
• MarketCap = Market Capitalization.
• MinutesFirstAdded = Date the data first retrieved in minute range
• MinutesLastAdded = Date the data last retrieved in minute range
• HourlyFirstAdded = Date the data first retrieved in hourly range
• HourlyLastAdded = Date the data last retrieved in hourly range
• DailyFirstAdded = Date the data first retrieved in daily range
• DailyLastAdded = Date the data last retrieved in daily range

Struktur Data Saham

• timestamp = Date and time of stock transaction
• open = opening price
• low = lowest price in the timespan
• high = highest price in the timespan
• close = closing price
• volume = Total volume traded in the timespan