Dataset Description: 34-year Daily Stock Data (1990-2024)

Context and Inspiration

This dataset captures historical financial market data and macroeconomic indicators spanning over three decades, from 1990 onwards. It is designed for financial analysis, time series forecasting, and exploring relationships between market volatility, stock indices, and macroeconomic factors. This dataset is particularly relevant for researchers, data scientists, and enthusiasts interested in studying:

• Volatility forecasting (VIX)
• Stock market trends (S&P 500, DJIA, HSI)
• Macroeconomic influences on markets (joblessness, interest rates, etc.)
• The effect of geopolitical and economic uncertainty (EPU, GPRD)

Sources

The data has been aggregated from a mix of historical financial records and publicly available macroeconomic datasets:

• VIX (Volatility Index): Chicago Board Options Exchange (CBOE).
• Stock Indices (S&P 500, DJIA, HSI): Yahoo Finance and historical financial databases.
• Volume Data: Extracted from official exchange reports.
• Macroeconomic Indicators: Bureau of Economic Analysis (BEA), Federal Reserve, and other public records.
• Uncertainty Metrics (EPU, GPRD): Economic Policy Uncertainty Index and Global Policy Uncertainty Database.

Columns

1. dt: Date of observation in YYYY-MM-DD format.
2. vix: VIX (Volatility Index), a measure of expected market volatility.
3. sp500: S&P 500 index value, a benchmark of the U.S. stock market.
4. sp500_volume: Daily trading volume for the S&P 500.
5. djia: Dow Jones Industrial Average (DJIA), another key U.S. market index.
6. djia_volume: Daily trading volume for the DJIA.
7. hsi: Hang Seng Index, representing the Hong Kong stock market.
8. ads: Aruoba-Diebold-Scotti (ADS) Business Conditions Index, reflecting U.S. economic activity.
9. us3m: U.S. Treasury 3-month bond yield, a short-term interest rate proxy.
10. joblessness: U.S. unemployment rate, reported as quartiles (1 represents lowest quartile and so on).
11. epu: Economic Policy Uncertainty Index, quantifying policy-related economic uncertainty.
12. GPRD: Geopolitical Risk Index (Daily), measuring geopolitical risk levels.
13. prev_day: Previous day’s S&P 500 closing value, added for lag-based time series analysis.

Key Features

• Cross-Market Analysis: Compare U.S. markets (S&P 500, DJIA) with international benchmarks like HSI.
• Macroeconomic Insights: Assess how external factors like joblessness, interest rates, and economic uncertainty affect markets.
• Temporal Scope: Longitudinal data facilitates trend analysis and machine learning model training.

Potential Use Cases

• Forecasting market indices using machine learning or statistical models.
• Building volatility trading strategies with VIX Futures.
• Economic research on relationships between policy uncertainty and market behavior.
• Educational material for financial data visualization and analysis tutorials.

Feel free to use this dataset for academic, research, or personal projects.