NeoQuasar commited on
Commit
978253d
·
verified ·
1 Parent(s): c93317e

Upload WindFM-Tokenizer-robust weights and model card

Browse files
Files changed (3) hide show
  1. README.md +14 -0
  2. config.json +18 -0
  3. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: time-series-forecasting
4
+ tags:
5
+ - Wind Power
6
+ ---
7
+
8
+ # WindFM-Tokenizer-robust
9
+
10
+ This repository contains the model weights for `WindFM-Tokenizer-robust`.
11
+
12
+ Regarding how to use this model, please refer to this GitHub [repository](https://github.com/shiyu-coder/WindFM).
13
+
14
+ The model supports prediction when some covariates are missing. When a covariate is missing, set all values of that variable to 0.
config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "attn_dropout_p": 0.0,
3
+ "beta": 0.05,
4
+ "d_in": 6,
5
+ "d_model": 256,
6
+ "ff_dim": 512,
7
+ "ffn_dropout_p": 0.0,
8
+ "gamma": 1.1,
9
+ "gamma0": 1.0,
10
+ "group_size": 5,
11
+ "n_dec_layers": 4,
12
+ "n_enc_layers": 4,
13
+ "n_heads": 4,
14
+ "resid_dropout_p": 0.0,
15
+ "s1_bits": 10,
16
+ "s2_bits": 10,
17
+ "zeta": 0.05
18
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53d197a3178b1ae17ff13c11f3e6aef4a15e518b5104ee5b5b479099a7c43d10
3
+ size 15842376