Hugging Face's logo

LazarusNLP
/
NusaBERT-base

Fill-Mask
Transformers
TensorBoard
Safetensors
bert
Model card Files
xet
 Metrics Community
1

Warning when loading model:

#1
by Exqrch - opened
Discussion
Exqrch

Got a warning when trying to load. Maybe worth to look at.

BertForMaskedLM has generative capabilities, as `prepare_inputs_for_generation` is explicitly overwritten. However, it doesn't directly inherit from `GenerationMixin`. From 👉v4.50👈 onwards, `PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate` and other related functions.
  - If you're using `trust_remote_code=True`, you can get rid of this warning by loading the model with an auto class. See https://huggingface.co/docs/transformers/en/model_doc/auto#auto-classes
  - If you are the owner of the model architecture code, please modify your model class such that it inherits from `GenerationMixin` (after `PreTrainedModel`, otherwise you'll get an exception).
  - If you are not the owner of the model architecture class, please contact the model code owner to update it.
w11wo
 Lazarus NLP org

@Exqrch thanks for the heads up. I think this won't affect the model since we're not using a new architecture, nor using it for text generation. Please let us know if you find an issue during fine-tuning. Thanks!

Sign up or log in to comment