Some weights of the model checkpoint were not used

#2
by uranus0515 - opened

Some weights of the model checkpoint at Qwen2.5-0.5B-Instruct-fp8-dynamic were not used when initializing Qwen2ForCausalLM: ['model.layers.0.mlp.down_proj.weight_scale', 'model.layers.0.mlp.gate_proj.weight_scale',.....
I don't know the meaning of this. Could you please give me some advice? Thanks a lot.

Sign up or log in to comment