MultilingualUnigramLM
/

las-code-tokenizers-gemma-2-9b-pyt

Model card Files Files and versions

suchirsalhan commited on May 5

Commit

e935695

·

verified ·

1 Parent(s): 372b328

Upload folder using huggingface_hub

Files changed (2) hide show

base_tokenizer.json +2 -2
langspec_python.json +2 -2

base_tokenizer.json CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:90d6e634aa32c2015fbfbdb21435b263fb33eb0ee6d4425d1cdb25f75a4495a1
-size 16499642

 version https://git-lfs.github.com/spec/v1
+oid sha256:44f44d0b90d72fdb10a481648d9d0f282cf62c9a345767f71c195567187fdcbf
+size 16474764

langspec_python.json CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bd295dce3ef0ca8a101c19f198695d12d2e9064636dc8c98a0384862cd6cd78b
-size 16494285

 version https://git-lfs.github.com/spec/v1
+oid sha256:a9e7d2dafd546af550768284a2a89f6126dd6dd4fe1e47e5c2c87993dffafed0
+size 16474317