Files changed (1) hide show
  1. README.md +88 -0
README.md CHANGED
@@ -1,3 +1,91 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ pipeline_tag: time-series-forecasting
4
+ library_name: pytorch
5
+ base_model:
6
+ - amazon/chronos-2
7
+ - google/timesfm-2.5-200m-pytorch
8
+ - ibm-research/flowstate
9
+ - NX-AI/TiRex-1.1-gifteval
10
+ - ibm-research/patchtst-fm-r1
11
+ - Datadog/Toto-2.0-2.5B
12
+ tags:
13
+ - time-series-forecasting
14
+ - foundation-models
15
+ - pretrained-models
16
+ - time-series
17
+ - timeseries
18
+ - forecasting
19
+ - ensemble
20
+ - meta-learning
21
+ - agentic
22
+ - gift-eval
23
+ - xgboost
24
+
25
  ---
26
+
27
+ > [!WARNING]
28
+ > **This is a benchmarking artifact for the GIFT-Eval submission.**
29
+ > CastStar is an agentic time-series forecasting system built on top of multiple foundation forecasting models. The submitted GIFT-Eval result uses pre-computed forecasts and a meta-selection/ensemble layer over the model pool. It is intended to make the leaderboard submission reproducible and comparable under the GIFT-Eval protocol.
30
+
31
+ ## What This Is
32
+
33
+ CastStar combines forecasts from a pool of time-series foundation models and uses a learned gating strategy to select or weight base-model predictions for each forecasting setting. The system follows the same general meta-forecasting idea as FFORMA-style model selection, where lightweight time-series features and dataset metadata guide the choice of forecasting experts.
34
+
35
+ The GIFT-Eval submission evaluates CastStar on all 97 dataset configurations using the official CSV format.
36
+
37
+ ## Model Pool
38
+
39
+ CastStar uses the following base forecasting models. Compared with the Toto-2.0-FnF setup, CastStar only uses the **Toto-2.0-2.5B** checkpoint from the Toto family.
40
+
41
+ | # | Model | Family |
42
+ | :--: | ------------------------------------------------------------ | :-------: |
43
+ | 0 | [chronos-2](https://huggingface.co/amazon/chronos-2) | Chronos |
44
+ | 1 | [timesfm-2.5](https://huggingface.co/google/timesfm-2.5-200m-pytorch) | TimesFM |
45
+ | 2 | [flowstate](https://huggingface.co/ibm-research/flowstate) | FlowState |
46
+ | 3 | [tirex](https://huggingface.co/NX-AI/TiRex-1.1-gifteval) | TiRex |
47
+ | 4 | [patchtst-fm](https://huggingface.co/ibm-research/patchtst-fm-r1) | PatchTST |
48
+ | 5 | [toto-2.0-2.5b](https://huggingface.co/Datadog/Toto-2.0-2.5B) | Toto 2.0 |
49
+
50
+ ## Key Features
51
+
52
+ - **Agentic forecasting system:** CastStar uses multiple forecasting experts and a decision layer to produce final probabilistic forecasts.
53
+ - **Foundation-model pool:** The model pool includes Chronos-2, TimesFM-2.5, FlowState, TiRex, PatchTST-FM, and Toto-2.0-2.5B.
54
+ - **GIFT-Eval compatible:** Results are submitted in the official GIFT-Eval format with 97/97 dataset configurations and 11 evaluation metrics.
55
+ - **No test-data leakage:** The submitted configuration reports no GIFT-Eval test-data leakage.
56
+ - **Benchmark-focused artifact:** The submitted result is designed for leaderboard evaluation and reproducibility under the GIFT-Eval protocol.
57
+
58
+ ## GIFT-Eval Submission
59
+
60
+ The submitted files are:
61
+
62
+ ```text
63
+ results/CastStar/all_results.csv
64
+ results/CastStar/config.json
65
+ ```
66
+
67
+ Submission metadata:
68
+
69
+ ```json
70
+ {
71
+ "model": "CastStar",
72
+ "model_type": "agentic",
73
+ "model_dtype": "float32",
74
+ "model_link": "https://huggingface.co/USTC-AGI/CastStar",
75
+ "code_link": "https://github.com/ustc-time-series/CastStar",
76
+ "org": "CastStar",
77
+ "testdata_leakage": "No",
78
+ "replication_code_available": "No"
79
+ }
80
+ ```
81
+
82
+ ## Additional Resources
83
+
84
+ - [GIFT-Eval benchmark](https://huggingface.co/spaces/Salesforce/GIFT-Eval)
85
+ - [GIFT-Eval GitHub repository](https://github.com/SalesforceAIResearch/gift-eval)
86
+ - [CastStar GitHub repository](https://github.com/ustc-time-series/CastStar)
87
+ - [CastStar model page](https://huggingface.co/USTC-AGI/CastStar)
88
+
89
+ ## Citation
90
+
91
+ If you use CastStar, please cite the corresponding CastStar paper or repository when available.