mohammadmahdinouri
/

mol-tiny-v2-wrapper

Model card Files Files and versions

mohammadmahdinouri commited on Oct 17, 2025

Commit

39dce1c

·

verified ·

1 Parent(s): 4f90dd0

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -15,7 +15,7 @@
   "initializer_range": 0.02,
   "intermediate_size": 1152,
   "layer_norm_eps": 1e-06,
-  "load_balancing_loss_coef": 0.2,
   "lora_alpha": 32,
   "lora_rank": 16,
   "max_position_embeddings": 8192,

   "initializer_range": 0.02,
   "intermediate_size": 1152,
   "layer_norm_eps": 1e-06,
+  "load_balancing_loss_coef": 0.1,
   "lora_alpha": 32,
   "lora_rank": 16,
   "max_position_embeddings": 8192,