ETL_pipeline / docs /data_sources.md
heboya8's picture
Upload folder using huggingface_hub
2eee82e verified

Data Source: Binance BTCUSDT 1s Kline

  • Source: Binance Data Public
  • Example file: BTCUSDT-1s-2024-05.csv.gz
  • Columns:
    1. Open time
    2. Open
    3. High
    4. Low
    5. Close
    6. Volume
    7. Close time
    8. Quote asset volume
    9. Number of trades
    10. Taker buy base asset volume
    11. Taker buy quote asset volume
    12. Ignore

Usage

  • The pipeline downloads and processes this data for deep learning time series forecasting.
  • The DAG can be modified to use a different month by changing the filename in the download step.

Acknowledgment

You can refer to https://github.com/binance/binance-public-data?tab=readme-ov-file#klines to get more infromation