Spaces:

GABIRI
/

dol-rdt-zerogpu-random-verify

Sleeping

App Files Files Community

dol-rdt-zerogpu-random-verify / Tokenizer /data /sample_text.jsonl

GABIRI's picture

Include tokenizer package for full model import

56f291f verified 2 months ago

History Blame Contribute Delete

66 Bytes

	{"type":"text","text":"ᠮᠣᠩᠭᠣᠯ 文字 tokenizer test"}