Don't create pooling layer with Sentence Transformers
#8
by tomaarsen HF Staff - opened
Hello!
Pull Request overview
- Remove "Some weights were not initialized" warning
Details
We can introduce some model arguments in the configuration, which will be used in the eventual model creation. This solved the warning that users have been experiencing:
Some weights of BertModel were not initialized from the model and are newly initialized: ['pooler.dense.bias', 'pooler.dense.weight']
- Tom Aarsen
spacemanidol changed pull request status to open
spacemanidol changed pull request status to merged