Add model card, link to paper and code

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +38 -0
README.md CHANGED
@@ -1,3 +1,41 @@
1
  ---
2
  license: apache-2.0
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: transformers
4
+ pipeline_tag: time-series-forecasting
5
  ---
6
+
7
+ # TempoWAVE
8
+
9
+ This repository contains the model checkpoint for **TempoWAVE**, introduced in the paper [Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting](https://huggingface.co/papers/2606.26487).
10
+
11
+ TempoWAVE gives an LLM a numerically grounded digit interface. Each decimal digit is routed through one of ten dedicated tokenizer tokens and initialized from a multi-wavelet, multi-scale codebook. Text, signs, decimal points, and separators continue to use the base model's standard embeddings.
12
+
13
+ ## Paper Method Overview
14
+
15
+ For a fixed-precision value such as `-0.5000`, the repository renders each digit as an individual token:
16
+
17
+ ```text
18
+ -<|digit_0|>.<|digit_5|><|digit_0|><|digit_0|><|digit_0|>
19
+ ```
20
+
21
+ For each digit `d` in `{0,...,9}`, TempoWAVE:
22
+ 1. Maps `d` to `d / 9` on a fixed grid;
23
+ 2. Samples each scaled mother wavelet at the digit's impulse location;
24
+ 3. Concatenates coefficients across wavelets and scales;
25
+ 4. Maps that vector to the LLM embedding dimension; and
26
+ 5. Replaces only the corresponding digit-token embedding row.
27
+
28
+ ## Resources
29
+
30
+ - **Paper:** [Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting](https://huggingface.co/papers/2606.26487)
31
+ - **GitHub Repository:** [DC-research/TempoWAVE](https://github.com/DC-research/TempoWAVE)
32
+
33
+ ## Citation
34
+
35
+ ```bibtex
36
+ @article{tempowave2026,
37
+ title={Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting},
38
+ journal={arXiv preprint arXiv:2606.26487},
39
+ year={2026}
40
+ }
41
+ ```