TinyStories-Regional
/

tokenizer-comparisons

Model card Files Files and versions

tokenizer-comparisons

Ctrl+K

Ctrl+K

2 contributors

History: 41 commits

Jinom's picture

Rename Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362_[l=6, h=8, e=64].pt

c58e01b verified about 1 year ago

Bengali-Specific
Create Bengali-Specific/test.txt about 1 year ago
Hindi-Specific
Rename Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362_[l=6, h=8, e=64].pt about 1 year ago
Marathi-Specific
Create Marathi-Specific/test.txt about 1 year ago
SUTRA
Rename SUTRA/ckpt_sutra-hindi_val=0.522.pt to SUTRA/ckpt_sutra-hindi_val=0.516.pt about 1 year ago
Tiktoken
Upload folder using huggingface_hub about 1 year ago
.gitattributes

1.52 kB
initial commit about 1 year ago
README.md

31 Bytes
initial commit about 1 year ago
ckpt_indicBART-marathi_val=0.680.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
626 MB
xet

Upload ckpt_indicBART-marathi_val=0.680.pt with huggingface_hub about 1 year ago
ckpt_indicBERT-marathi_val=1.027.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.46 GB
xet

Upload ckpt_indicBERT-marathi_val=1.027.pt with huggingface_hub about 1 year ago
ckpt_sutra-marathi_val=0.627.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.81 GB
xet

Upload ckpt_sutra-marathi_val=0.627.pt with huggingface_hub about 1 year ago