quietflamingo
/

dnabert2-no-flashattention

Model card Files Files and versions

zhihan1996 commited on Feb 22, 2024

Commit

5fdb2d9

·

1 Parent(s): feb9d4e

Update bert_layers.py

Files changed (1) hide show

bert_layers.py +1 -1

bert_layers.py CHANGED Viewed

@@ -522,7 +522,7 @@ class BertPredictionHeadTransform(nn.Module):
         return hidden_states
-class BertModel(PreTrainedModel):
     """Overall BERT model.
     Args:

         return hidden_states
+class BertModel(BertPreTrainedModel):
     """Overall BERT model.
     Args: