Improve model card: add paper, code links and author information

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +56 -50
README.md CHANGED
@@ -1,4 +1,6 @@
1
  ---
 
 
2
  tags:
3
  - time-series-forecasting
4
  - foundation-models
@@ -9,61 +11,61 @@ tags:
9
  - observability
10
  - safetensors
11
  - pytorch_model_hub_mixin
12
- license: apache-2.0
13
- pipeline_tag: time-series-forecasting
14
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
15
  model-index:
16
  - name: Toto-2.0-22m
17
  results:
18
- - task:
19
- type: time-series-forecasting
20
- dataset:
21
- name: BOOM
22
- type: BOOM
23
- metrics:
24
- - name: CRPS
25
- type: CRPS
26
- value: 0.363
27
- - name: MASE
28
- type: MASE
29
- value: 0.601
30
- source:
31
- name: BOOM 💥 Observability Time-Series Forecasting Leaderboard
32
- url: https://huggingface.co/spaces/Datadog/BOOM
33
- - task:
34
- type: time-series-forecasting
35
- dataset:
36
- name: GIFT-Eval
37
- type: GIFT-Eval
38
- metrics:
39
- - name: CRPS
40
- type: CRPS
41
- value: 0.496
42
- - name: MASE
43
- type: MASE
44
- value: 0.719
45
- source:
46
- name: GIFT-Eval Time Series Forecasting Leaderboard
47
- url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
48
- - task:
49
- type: time-series-forecasting
50
- dataset:
51
- name: TIME
52
- type: TIME
53
- metrics:
54
- - name: CRPS
55
- type: CRPS
56
- value: 0.556
57
- - name: MASE
58
- type: MASE
59
- value: 0.668
60
- source:
61
- name: TIME Benchmark Leaderboard
62
- url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
63
  ---
64
 
65
  # Toto-2.0-22m
66
 
 
 
67
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-μP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
68
 
69
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
@@ -136,12 +138,16 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
136
 
137
  <figure>
138
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
139
- <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="#-additional-resources">technical report</a> for details.</figcaption>
140
  </figure>
141
 
 
 
 
 
142
  ## 🔗 Additional Resources
143
 
144
- - [Technical Report](https://arxiv.org/abs/2605.20119)
145
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
146
  - [GitHub Repository](https://github.com/DataDog/toto)
147
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) — all five base checkpoints
@@ -160,4 +166,4 @@ All five Toto 2.0 sizes share the same training recipe; pick a size based on you
160
  primaryClass={cs.LG},
161
  url={https://arxiv.org/abs/2605.20119},
162
  }
163
- ```
 
1
  ---
2
+ license: apache-2.0
3
+ pipeline_tag: time-series-forecasting
4
  tags:
5
  - time-series-forecasting
6
  - foundation-models
 
11
  - observability
12
  - safetensors
13
  - pytorch_model_hub_mixin
 
 
14
  thumbnail: https://web-assets.dd-static.net/42588/1778691695-toto-2-hero.png
15
  model-index:
16
  - name: Toto-2.0-22m
17
  results:
18
+ - task:
19
+ type: time-series-forecasting
20
+ dataset:
21
+ name: BOOM
22
+ type: BOOM
23
+ metrics:
24
+ - type: CRPS
25
+ value: 0.363
26
+ name: CRPS
27
+ - type: MASE
28
+ value: 0.601
29
+ name: MASE
30
+ source:
31
+ url: https://huggingface.co/spaces/Datadog/BOOM
32
+ name: BOOM 💥 Observability Time-Series Forecasting Leaderboard
33
+ - task:
34
+ type: time-series-forecasting
35
+ dataset:
36
+ name: GIFT-Eval
37
+ type: GIFT-Eval
38
+ metrics:
39
+ - type: CRPS
40
+ value: 0.496
41
+ name: CRPS
42
+ - type: MASE
43
+ value: 0.719
44
+ name: MASE
45
+ source:
46
+ url: https://huggingface.co/spaces/Salesforce/GIFT-Eval
47
+ name: GIFT-Eval Time Series Forecasting Leaderboard
48
+ - task:
49
+ type: time-series-forecasting
50
+ dataset:
51
+ name: TIME
52
+ type: TIME
53
+ metrics:
54
+ - type: CRPS
55
+ value: 0.556
56
+ name: CRPS
57
+ - type: MASE
58
+ value: 0.668
59
+ name: MASE
60
+ source:
61
+ url: https://huggingface.co/spaces/Real-TSF/TIME-leaderboard
62
+ name: TIME Benchmark Leaderboard
63
  ---
64
 
65
  # Toto-2.0-22m
66
 
67
+ [Paper](https://huggingface.co/papers/2605.20119) | [Code](https://github.com/DataDog/toto) | [Blog](https://www.datadoghq.com/blog/ai/toto-2/)
68
+
69
  Toto (Time Series Optimized Transformer for [Observability](https://www.datadoghq.com/knowledge-center/observability/)) is a family of time series foundation models for multivariate forecasting developed by [Datadog](https://www.datadoghq.com/). Toto 2.0 is the current generation, featuring u-μP-scaled transformers ranging from 4m to 2.5B parameters, all trained from a single recipe. Forecast quality improves reliably with parameter count across the family.
70
 
71
  The family sets a new state of the art on three forecasting benchmarks: [BOOM](https://huggingface.co/spaces/Datadog/BOOM), our observability benchmark; [GIFT-Eval](https://huggingface.co/spaces/Salesforce/GIFT-Eval), the standard general-purpose benchmark; and the recent contamination-resistant [TIME](https://arxiv.org/abs/2602.12147) benchmark.
 
138
 
139
  <figure>
140
  <img src="assets/architecture.png" alt="Overview of the Toto 2.0 architecture.">
141
+ <figcaption>A decoder-only patched transformer whose attention layers alternate between time-axis (causal) and variate-axis (full) views of the input. Toto 2.0 adds <b>contiguous patch masking (CPM)</b> for single-pass parallel decoding, a <b>quantile output head</b> trained with pinball loss, a robust arcsinh input scaler, residual MLP patch projections, and is trained with NorMuon. See the <a href="https://huggingface.co/papers/2605.20119">technical report</a> for details.</figcaption>
142
  </figure>
143
 
144
+ ## 👥 Authors
145
+
146
+ Emaad Khwaja ([@Emaad](https://huggingface.co/Emaad)), Chris Lettieri, Gerald Woo, Eden Belouadah, Marc Cenac, Guillaume Jarry, Enguerrand Paquin, Xunyi Zhao, Viktoriya Zhukov, Othmane Abou-Amal, Chenghao Liu, Ameet Talwalkar, David Asker.
147
+
148
  ## 🔗 Additional Resources
149
 
150
+ - [Technical Report](https://huggingface.co/papers/2605.20119)
151
  - [Blog Post](https://www.datadoghq.com/blog/ai/toto-2/)
152
  - [GitHub Repository](https://github.com/DataDog/toto)
153
  - [Toto 2.0 Collection](https://huggingface.co/collections/Datadog/toto-20) — all five base checkpoints
 
166
  primaryClass={cs.LG},
167
  url={https://arxiv.org/abs/2605.20119},
168
  }
169
+ ```