billingsmoore
/

getok-v0

Model card Files Files and versions

billingsmoore commited on Jun 23, 2025

Commit

de7780f

·

verified ·

1 Parent(s): 9e49640

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -35,7 +35,7 @@ This model was developed as part of the MLotsawa project. [More information can
 **Normalization**: None
-**Special Tokens**: "[PAD]", "[UNK]", "[BOS]", "[EOS]", "<unk>"
 **Tokenization Level**: Subword

 **Normalization**: None
+**Special Tokens**: "[PAD]", "[BOS]", "[EOS]", "\<unk>"
 **Tokenization Level**: Subword