Charlie81
/

LoRE

Model card Files Files and versions

Metrics Training metrics Community

Charlie81 commited on Jul 10, 2025

Commit

50cd1ec

·

1 Parent(s): 1ec67ec

name

Files changed (1) hide show

myolmoe/modeling_myolmoe.py +1 -1

myolmoe/modeling_myolmoe.py CHANGED Viewed

@@ -1073,7 +1073,7 @@ class MyOlmoeForCausalLM(OlmoePreTrainedModel, GenerationMixin):
         #
         return MoeCausalLMOutputWithPast(
             loss=loss,
-            aux_loss=aux_loss,
             logits=logits,
             past_key_values=outputs.past_key_values,
             hidden_states=outputs.hidden_states,

         #
         return MoeCausalLMOutputWithPast(
             loss=loss,
+            aux_loss=total_aux_loss,
             logits=logits,
             past_key_values=outputs.past_key_values,
             hidden_states=outputs.hidden_states,