Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

syssec-utd
/

py313-pylingual-v1-tok

Model card Files Files and versions

py313-pylingual-v1-tok

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

lc10934's picture

Extracted special tokens map

60bb491 verified over 1 year ago

.gitattributes

1.52 kB
initial commit over 1 year ago
merges.txt

68.2 kB
Extracted merges from tokenizer over 1 year ago
special_tokens_map.json

30 kB
Extracted special tokens map over 1 year ago
tokenizer.json

891 kB
Extracted tokenizer over 1 year ago
tokenizer_config.json

181 kB
Trained tokenizer using syssec-utd/statement-py313-pylingual-v1 over 1 year ago
vocab.json

151 kB
Extracted vocabulary from tokenizer over 1 year ago