README / README.md
maddes8cht's picture
Update README.md
e8dddbe verified
metadata
title: README
emoji: πŸ“‰
colorFrom: yellow
colorTo: red
sdk: static
pinned: false

πŸ“Š Traders-Lab β€” Open Financial Time Series Data

Traders-Lab publishes public financial time series datasets with a strong focus on high-quality intraday data accumulation over extended periods of time.

The primary goal is not short-term freshness, but long-term continuity and gap-free historical depth, especially for minute-level data.


πŸ“’ Announcement

A major update will be released today (December 17. 2025) after the US market close.

With this release, the long-running β€œPreliminary” phase will be officially concluded. A new dataset named TroveLedger will mark the transition to a stable and consolidated dataset line.

Earlier Preliminary datasets will remain available temporarily to allow a smooth transition.


πŸ”‘ Core Focus: Accumulated Minute-Level Data

High-quality minute-resolution OHLC data over long time spans is difficult to obtain from free sources.

Typical public data access (e.g. via yfinance) provides:

  • Daily candles: often spanning decades
  • Hourly candles: approximately one year into the past
  • Minute candles: typically limited to the most recent 7 days

This makes freshly downloaded minute data unsuitable for training models that rely on historical intraday patterns.

The key value of the datasets published here lies in continuous accumulation:

  • Minute-level data is collected day by day
  • Over time, this results in months of gap-free minute data
  • This provides a fundamentally different foundation for training and evaluation than repeatedly downloading short rolling windows

πŸ”„ Update Philosophy

The primary guarantee is data continuity, not update frequency.

Specifically:

  • Daily updates are not guaranteed
  • The absence of gaps in accumulated minute data is the main objective
  • Updates are performed on trading days whenever possible

All data updates are designed to extend existing time series, not to replace them.


⏱️ Update Rotation & Data Freshness

To balance data quality, processing time, and responsible use of public data sources:

  • Minute data is updated most frequently to ensure continuity
  • Hourly and daily data follow a rotation-based update schedule
  • Hourly and daily datasets are guaranteed to be no older than one week

This approach significantly reduces unnecessary repeated requests while remaining fully sufficient for training purposes.

In real-world usage, models are typically deployed using live data feeds from the target trading platform, which naturally provide up-to-date market data.


🎯 Intended Use

The datasets are intended for:

  • machine learning on financial time series
  • intraday and swing trading research
  • feature engineering on accumulated OHLC data
  • backtesting strategies that benefit from dense historical intraday data

πŸ” Further Information

Detailed structure descriptions, usage examples, and dataset-specific notes can be found in the individual dataset cards.