dewdev
/

language_detection

Text Classification

text-embeddings-inference

Model card Files Files and versions

dewdev commited on Feb 26, 2025

Commit

f085d55

·

verified ·

1 Parent(s): 60e22d8

Upload 5 files

Files changed (1) hide show

tokenizer.json +2 -2

tokenizer.json CHANGED Viewed

@@ -53,7 +53,7 @@
     "type": "Sequence",
     "normalizers": [
       {
-        "type": "BertNormalizer"
       },
       {
         "type": "BertNormalizer",
@@ -50348,4 +50348,4 @@
       "erg": 50256
     }
   }
-}

     "type": "Sequence",
     "normalizers": [
       {
+        "type": "NFD"
       },
       {
         "type": "BertNormalizer",
       "erg": 50256
     }
   }
+}