Hazan-Lab
/

STU-426M

Model card Files Files and versions

yagizdevre commited on Dec 6, 2024

Commit

d6abd97

·

1 Parent(s): f472e23

Patch fix.

Files changed (1) hide show

configuration_ministu.py +1 -1

configuration_ministu.py CHANGED Viewed

@@ -22,7 +22,7 @@ class MiniSTUConfig(PretrainedConfig):
         use_approx: bool = True,
         use_attn: bool = True,
         softcap: float = 50.0,
-        torch_dtype: str = "bfloat16",
         device: str = None,
         **kwargs,
     ):

         use_approx: bool = True,
         use_attn: bool = True,
         softcap: float = 50.0,
+        torch_dtype: str = torch.bfloat16,
         device: str = None,
         **kwargs,
     ):