This was causing test failures due to stricter config typing (#2)

- This was causing test failures due to stricter config typing (3408e3d7a69a92fa3df216dda7ccc2a3c6a8c53b)


Co-authored-by: Tom Aarsen <tomaarsen@users.noreply.huggingface.co>

config.json

@@ -18,7 +18,7 @@
     },
     "ffn_hidden_size": 24,
     "model_type": "",
-    "moe_jitter_eps": 0,
+    "moe_jitter_eps": 0.0,
     "moe_loss_weight": 0.05,
     "moe_normalize_expert_weights": 1.0,
     "moe_num_experts": 16,