jwieting
/

paraphrastic_test

Sentence Similarity

sentence-transformers

feature-extraction

text-embeddings-inference

Model card Files Files and versions

jwieting commited on Nov 14, 2022

Commit

a6d5115

·

1 Parent(s): a5eac20

Update modeling_paragram_sp.py

Files changed (1) hide show

modeling_paragram_sp.py +1 -0

modeling_paragram_sp.py CHANGED Viewed

@@ -34,4 +34,5 @@ class ParagramSPModel(BertPreTrainedModel):
         embeddings = self.word_embeddings(input_ids)
         masked_embeddings = embeddings * attention_mask[:, :, None]
         mean_pooled_embeddings = masked_embeddings.sum(dim=1) / attention_mask[:, :, None].sum(dim=1)
         return (embeddings, mean_pooled_embeddings, embeddings)

         embeddings = self.word_embeddings(input_ids)
         masked_embeddings = embeddings * attention_mask[:, :, None]
         mean_pooled_embeddings = masked_embeddings.sum(dim=1) / attention_mask[:, :, None].sum(dim=1)
+        print(attention_mask[:, :, None].sum(dim=1))
         return (embeddings, mean_pooled_embeddings, embeddings)