Improve model card metadata and add prominent links to paper and code

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +57 -50
README.md CHANGED
@@ -1,4 +1,9 @@
1
  ---
 
 
 
 
 
2
  tags:
3
  - time-series-forecasting
4
  - foundation-models
@@ -9,63 +14,65 @@ tags:
9
  - observability
10
  - safetensors
11
  - pytorch_model_hub_mixin
12
- license: apache-2.0
13
- pipeline_tag: time-series-forecasting
14
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
15
  model-index:
16
  - name: Toto-2.0-1B
17
  results:
18
- - task:
19
- type: time-series-forecasting
20
- dataset:
21
- name: BOOM
22
- type: BOOM
23
- metrics:
24
- - name: CRPS
25
- type: CRPS
26
- value: 0.349
27
- - name: MASE
28
- type: MASE
29
- value: 0.582
30
- source:
31
- name: BOOM ๐Ÿ’ฅ Observability Time-Series Forecasting Leaderboard
32
- url: https://huggingface.co/spaces/Datadog/BOOM
33
- - task:
34
- type: time-series-forecasting
35
- dataset:
36
- name: GIFT-Eval
37
- type: GIFT-Eval
38
- metrics:
39
- - name: CRPS
40
- type: CRPS
41
- value: 0.478
42
- - name: MASE
43
- type: MASE
44
- value: 0.699
45
- source:
46
- name: GIFT-Eval Time Series Forecasting Leaderboard
47
- url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
48
- - task:
49
- type: time-series-forecasting
50
- dataset:
51
- name: TIME
52
- type: TIME
53
- metrics:
54
- - name: CRPS
55
- type: CRPS
56
- value: 0.537
57
- - name: MASE
58
- type: MASE
59
- value: 0.643
60
- source:
61
- name: TIME Benchmark Leaderboard
62
- url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
63
  ---
64
 
65
  # Toto-2.0-1B
66
 
 
 
67
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
68
 
 
 
69
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
70
 
71
  ## ๐Ÿ“Š Performance
@@ -136,12 +143,12 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
136
 
137
  <figure>
138
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
139
- <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="#-additional-resources">technical report</a> for details.</figcaption>
140
  </figure>
141
 
142
  ## ๐Ÿ”— Additional Resources
143
 
144
- - [Technical Report](https://arxiv.org/abs/2605.20119)
145
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
146
  - [GitHub Repository](https://github.com/DataDog/toto)
147
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ€” all five base checkpoints
@@ -160,4 +167,4 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
160
  primaryClass={cs.LG},
161
  url={https://arxiv.org/abs/2605.20119},
162
  }
163
- ```
 
1
  ---
2
+ license: apache-2.0
3
+ pipeline_tag: time-series-forecasting
4
+ datasets:
5
+ - Datadog/BOOM
6
+ - Salesforce/GIFT-Eval
7
  tags:
8
  - time-series-forecasting
9
  - foundation-models
 
14
  - observability
15
  - safetensors
16
  - pytorch_model_hub_mixin
 
 
17
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
18
  model-index:
19
  - name: Toto-2.0-1B
20
  results:
21
+ - task:
22
+ type: time-series-forecasting
23
+ dataset:
24
+ name: BOOM
25
+ type: BOOM
26
+ metrics:
27
+ - type: CRPS
28
+ value: 0.349
29
+ name: CRPS
30
+ - type: MASE
31
+ value: 0.582
32
+ name: MASE
33
+ source:
34
+ url: https://huggingface.co/spaces/Datadog/BOOM
35
+ name: BOOM ๐Ÿ’ฅ Observability Time-Series Forecasting Leaderboard
36
+ - task:
37
+ type: time-series-forecasting
38
+ dataset:
39
+ name: GIFT-Eval
40
+ type: GIFT-Eval
41
+ metrics:
42
+ - type: CRPS
43
+ value: 0.478
44
+ name: CRPS
45
+ - type: MASE
46
+ value: 0.699
47
+ name: MASE
48
+ source:
49
+ url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
50
+ name: GIFT-Eval Time Series Forecasting Leaderboard
51
+ - task:
52
+ type: time-series-forecasting
53
+ dataset:
54
+ name: TIME
55
+ type: TIME
56
+ metrics:
57
+ - type: CRPS
58
+ value: 0.537
59
+ name: CRPS
60
+ - type: MASE
61
+ value: 0.643
62
+ name: MASE
63
+ source:
64
+ url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
65
+ name: TIME Benchmark Leaderboard
66
  ---
67
 
68
  # Toto-2.0-1B
69
 
70
+ [**Technical Report**](https://huggingface.co/papers/2605.20119) | [**GitHub**](https://github.com/DataDog/toto) | [**Blog Post**](https://www.datadoghq.com/blog/ai/toto-2/)
71
+
72
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-ฮผP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
73
 
74
+ The model was introduced in the paper [Toto 2.0: Time Series Forecasting Enters the Scaling Era](https://huggingface.co/papers/2605.20119) by Emaad Khwaja, Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, Chenghao Liu, Ameet Talwalkar, and David Asker.
75
+
76
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
77
 
78
  ## ๐Ÿ“Š Performance
 
143
 
144
  <figure>
145
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
146
+ <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="https://huggingface.co/papers/2605.20119">technical report</a> for details.</figcaption>
147
  </figure>
148
 
149
  ## ๐Ÿ”— Additional Resources
150
 
151
+ - [Technical Report](https://huggingface.co/papers/2605.20119)
152
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
153
  - [GitHub Repository](https://github.com/DataDog/toto)
154
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) โ€” all five base checkpoints
 
167
  primaryClass={cs.LG},
168
  url={https://arxiv.org/abs/2605.20119},
169
  }
170
+ ```