Time Series Forecasting
Transformers
Safetensors
qwen2
text-generation
time-series
llm
number-embedding
wavelet
text-generation-inference
Instructions to use Melady/TempoWAVE with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Melady/TempoWAVE with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Melady/TempoWAVE") model = AutoModelForCausalLM.from_pretrained("Melady/TempoWAVE") - Notebooks
- Google Colab
- Kaggle
Add model card, link to paper and code
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,41 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
library_name: transformers
|
| 4 |
+
pipeline_tag: time-series-forecasting
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
# TempoWAVE
|
| 8 |
+
|
| 9 |
+
This repository contains the model checkpoint for **TempoWAVE**, introduced in the paper [Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting](https://huggingface.co/papers/2606.26487).
|
| 10 |
+
|
| 11 |
+
TempoWAVE gives an LLM a numerically grounded digit interface. Each decimal digit is routed through one of ten dedicated tokenizer tokens and initialized from a multi-wavelet, multi-scale codebook. Text, signs, decimal points, and separators continue to use the base model's standard embeddings.
|
| 12 |
+
|
| 13 |
+
## Paper Method Overview
|
| 14 |
+
|
| 15 |
+
For a fixed-precision value such as `-0.5000`, the repository renders each digit as an individual token:
|
| 16 |
+
|
| 17 |
+
```text
|
| 18 |
+
-<|digit_0|>.<|digit_5|><|digit_0|><|digit_0|><|digit_0|>
|
| 19 |
+
```
|
| 20 |
+
|
| 21 |
+
For each digit `d` in `{0,...,9}`, TempoWAVE:
|
| 22 |
+
1. Maps `d` to `d / 9` on a fixed grid;
|
| 23 |
+
2. Samples each scaled mother wavelet at the digit's impulse location;
|
| 24 |
+
3. Concatenates coefficients across wavelets and scales;
|
| 25 |
+
4. Maps that vector to the LLM embedding dimension; and
|
| 26 |
+
5. Replaces only the corresponding digit-token embedding row.
|
| 27 |
+
|
| 28 |
+
## Resources
|
| 29 |
+
|
| 30 |
+
- **Paper:** [Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting](https://huggingface.co/papers/2606.26487)
|
| 31 |
+
- **GitHub Repository:** [DC-research/TempoWAVE](https://github.com/DC-research/TempoWAVE)
|
| 32 |
+
|
| 33 |
+
## Citation
|
| 34 |
+
|
| 35 |
+
```bibtex
|
| 36 |
+
@article{tempowave2026,
|
| 37 |
+
title={Speaking Numbers to LLMs: Multi-Wavelet Number Embeddings for Time Series Forecasting},
|
| 38 |
+
journal={arXiv preprint arXiv:2606.26487},
|
| 39 |
+
year={2026}
|
| 40 |
+
}
|
| 41 |
+
```
|