impresso-project
/

ner-stacked-bert-multilingual-light

Token Classification

Model card Files Files and versions

emanuelaboros commited on May 16, 2025

Commit

83db5d3

·

1 Parent(s): 36dc636

move to pregenerated tokens

Files changed (1) hide show

generic_ner.py +2 -1

generic_ner.py CHANGED Viewed

@@ -707,7 +707,8 @@ class MultitaskTokenClassificationPipeline(Pipeline):
         return tokenized_inputs, text, tokens
     def _forward(self, inputs):
-        tokenized_inputs, text, tokens = inputs
         input_ids = torch.tensor([inputs["input_ids"]], dtype=torch.long).to(
             self.model.device
         )

         return tokenized_inputs, text, tokens
     def _forward(self, inputs):
+        inputs, text, tokens = inputs
         input_ids = torch.tensor([inputs["input_ids"]], dtype=torch.long).to(
             self.model.device
         )