Update README.md
#1
by fishsure - opened
README.md
CHANGED
|
@@ -1,3 +1,91 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: time-series-forecasting
|
| 4 |
+
library_name: pytorch
|
| 5 |
+
base_model:
|
| 6 |
+
- amazon/chronos-2
|
| 7 |
+
- google/timesfm-2.5-200m-pytorch
|
| 8 |
+
- ibm-research/flowstate
|
| 9 |
+
- NX-AI/TiRex-1.1-gifteval
|
| 10 |
+
- ibm-research/patchtst-fm-r1
|
| 11 |
+
- Datadog/Toto-2.0-2.5B
|
| 12 |
+
tags:
|
| 13 |
+
- time-series-forecasting
|
| 14 |
+
- foundation-models
|
| 15 |
+
- pretrained-models
|
| 16 |
+
- time-series
|
| 17 |
+
- timeseries
|
| 18 |
+
- forecasting
|
| 19 |
+
- ensemble
|
| 20 |
+
- meta-learning
|
| 21 |
+
- agentic
|
| 22 |
+
- gift-eval
|
| 23 |
+
- xgboost
|
| 24 |
+
|
| 25 |
---
|
| 26 |
+
|
| 27 |
+
> [!WARNING]
|
| 28 |
+
> **This is a benchmarking artifact for the GIFT-Eval submission.**
|
| 29 |
+
> CastStar is an agentic time-series forecasting system built on top of multiple foundation forecasting models. The submitted GIFT-Eval result uses pre-computed forecasts and a meta-selection/ensemble layer over the model pool. It is intended to make the leaderboard submission reproducible and comparable under the GIFT-Eval protocol.
|
| 30 |
+
|
| 31 |
+
## What This Is
|
| 32 |
+
|
| 33 |
+
CastStar combines forecasts from a pool of time-series foundation models and uses a learned gating strategy to select or weight base-model predictions for each forecasting setting. The system follows the same general meta-forecasting idea as FFORMA-style model selection, where lightweight time-series features and dataset metadata guide the choice of forecasting experts.
|
| 34 |
+
|
| 35 |
+
The GIFT-Eval submission evaluates CastStar on all 97 dataset configurations using the official CSV format.
|
| 36 |
+
|
| 37 |
+
## Model Pool
|
| 38 |
+
|
| 39 |
+
CastStar uses the following base forecasting models. Compared with the Toto-2.0-FnF setup, CastStar only uses the **Toto-2.0-2.5B** checkpoint from the Toto family.
|
| 40 |
+
|
| 41 |
+
| # | Model | Family |
|
| 42 |
+
| :--: | ------------------------------------------------------------ | :-------: |
|
| 43 |
+
| 0 | [chronos-2](https://huggingface.co/amazon/chronos-2) | Chronos |
|
| 44 |
+
| 1 | [timesfm-2.5](https://huggingface.co/google/timesfm-2.5-200m-pytorch) | TimesFM |
|
| 45 |
+
| 2 | [flowstate](https://huggingface.co/ibm-research/flowstate) | FlowState |
|
| 46 |
+
| 3 | [tirex](https://huggingface.co/NX-AI/TiRex-1.1-gifteval) | TiRex |
|
| 47 |
+
| 4 | [patchtst-fm](https://huggingface.co/ibm-research/patchtst-fm-r1) | PatchTST |
|
| 48 |
+
| 5 | [toto-2.0-2.5b](https://huggingface.co/Datadog/Toto-2.0-2.5B) | Toto 2.0 |
|
| 49 |
+
|
| 50 |
+
## Key Features
|
| 51 |
+
|
| 52 |
+
- **Agentic forecasting system:** CastStar uses multiple forecasting experts and a decision layer to produce final probabilistic forecasts.
|
| 53 |
+
- **Foundation-model pool:** The model pool includes Chronos-2, TimesFM-2.5, FlowState, TiRex, PatchTST-FM, and Toto-2.0-2.5B.
|
| 54 |
+
- **GIFT-Eval compatible:** Results are submitted in the official GIFT-Eval format with 97/97 dataset configurations and 11 evaluation metrics.
|
| 55 |
+
- **No test-data leakage:** The submitted configuration reports no GIFT-Eval test-data leakage.
|
| 56 |
+
- **Benchmark-focused artifact:** The submitted result is designed for leaderboard evaluation and reproducibility under the GIFT-Eval protocol.
|
| 57 |
+
|
| 58 |
+
## GIFT-Eval Submission
|
| 59 |
+
|
| 60 |
+
The submitted files are:
|
| 61 |
+
|
| 62 |
+
```text
|
| 63 |
+
results/CastStar/all_results.csv
|
| 64 |
+
results/CastStar/config.json
|
| 65 |
+
```
|
| 66 |
+
|
| 67 |
+
Submission metadata:
|
| 68 |
+
|
| 69 |
+
```json
|
| 70 |
+
{
|
| 71 |
+
"model": "CastStar",
|
| 72 |
+
"model_type": "agentic",
|
| 73 |
+
"model_dtype": "float32",
|
| 74 |
+
"model_link": "https://huggingface.co/USTC-AGI/CastStar",
|
| 75 |
+
"code_link": "https://github.com/ustc-time-series/CastStar",
|
| 76 |
+
"org": "CastStar",
|
| 77 |
+
"testdata_leakage": "No",
|
| 78 |
+
"replication_code_available": "No"
|
| 79 |
+
}
|
| 80 |
+
```
|
| 81 |
+
|
| 82 |
+
## Additional Resources
|
| 83 |
+
|
| 84 |
+
- [GIFT-Eval benchmark](https://huggingface.co/spaces/Salesforce/GIFT-Eval)
|
| 85 |
+
- [GIFT-Eval GitHub repository](https://github.com/SalesforceAIResearch/gift-eval)
|
| 86 |
+
- [CastStar GitHub repository](https://github.com/ustc-time-series/CastStar)
|
| 87 |
+
- [CastStar model page](https://huggingface.co/USTC-AGI/CastStar)
|
| 88 |
+
|
| 89 |
+
## Citation
|
| 90 |
+
|
| 91 |
+
If you use CastStar, please cite the corresponding CastStar paper or repository when available.
|