Synchronizing local compiler cache.

neuronxcc-2.19.8089.0+8ab9f450/MODULE_12763631830910829651+3cc9a3cb/model.neff

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d0e974bd200cfc5837529b767924b6ca25dffd2d34b0c63eaa00e69060ec7625
+oid sha256:a0f850b3b272e76f97c44a03bb431b6a66951f434850215361387978e9067787
 size 1711104

neuronxcc-2.19.8089.0+8ab9f450/MODULE_16991741760284872730+3cc9a3cb/model.log

@@ -1 +1 @@
-Failed compilation with ['neuronx-cc', 'compile', '--framework=XLA', '/tmp/no-user/neuroncc_compile_workdir/3cc6f508-3d8b-4e57-8b65-73703f8b4d3c/model.MODULE_16991741760284872730+3cc9a3cb.hlo_module.pb', '--output', '/tmp/no-user/neuroncc_compile_workdir/3cc6f508-3d8b-4e57-8b65-73703f8b4d3c/model.MODULE_16991741760284872730+3cc9a3cb.neff', '--target=trn1', '--model-type=transformer', '--verbose=35']: 2025-07-04T11:23:09Z [TEN404] Internal tensorizer error: MaskPropagation:Need to split to perfect loopnest - Please open a support ticket at https://github.com/aws-neuron/aws-neuron-sdk/issues/new. You may also be able to obtain more information using the 'XLA_IR_DEBUG' and 'XLA_HLO_DEBUG' environment variables.
+Failed compilation with ['neuronx-cc', 'compile', '--framework=XLA', '/tmp/ubuntu/neuroncc_compile_workdir/2828dd79-88f6-4a8e-b7ee-e27e3b20f5a6/model.MODULE_16991741760284872730+3cc9a3cb.hlo_module.pb', '--output', '/tmp/ubuntu/neuroncc_compile_workdir/2828dd79-88f6-4a8e-b7ee-e27e3b20f5a6/model.MODULE_16991741760284872730+3cc9a3cb.neff', '--target=trn1', '--model-type=transformer', '--verbose=35']: 2025-07-04T13:38:06Z [TEN404] Internal tensorizer error: MaskPropagation:Need to split to perfect loopnest - Please open a support ticket at https://github.com/aws-neuron/aws-neuron-sdk/issues/new. You may also be able to obtain more information using the 'XLA_IR_DEBUG' and 'XLA_HLO_DEBUG' environment variables.