Hugging Face's logo

syssec-utd
/
py314-pylingual-v2-tok

Model card Files
xet
Community
py314-pylingual-v2-tok

Commit History

Extracted special tokens map
3d005f5
verified

lc10934 commited on

Extracted tokenizer
1e5afcc
verified

lc10934 commited on

Extracted merges from tokenizer
e372d68
verified

lc10934 commited on

Extracted vocabulary from tokenizer
4970285
verified

lc10934 commited on

Trained tokenizer using syssec-utd/statement-py314-pylingual-v2
c8af74e
verified

lc10934 commited on

initial commit
a8085e8
verified

lc10934 commited on