Marmik
/

tiny-mixtral-5l-active

tiny_mixtral_5l_active

Model card Files Files and versions

Marmik commited on Jul 19, 2025

Commit

1ab66d9

·

verified ·

1 Parent(s): e8022d3

Update modeling_tiny_mixtral.py

Files changed (1) hide show

modeling_tiny_mixtral.py +1 -1

modeling_tiny_mixtral.py CHANGED Viewed

@@ -513,7 +513,7 @@ class layer(nn.Module):
         out=h+ffn_output
-        return out, router_loss
 class tiny_mixtral(nn.Module):

         out=h+ffn_output
+        return out
 class tiny_mixtral(nn.Module):