Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

alibayram
/

turkish_tiktokenizer

Running

App Files Files Community

Fetching metadata from the HF Docker repository...

turkish_tiktokenizer

12 kB

Ctrl+K

Ctrl+K

1 contributor

History: 19 commits

alibayram's picture

Chore: Force rebuild on HF

f748ebb 2 months ago

.gitattributes

1.52 kB
initial commit about 1 year ago
.gitignore

15 Bytes
Update REQUIRED_FILES to reference kokler_v07.json instead of kokler_v05.json about 1 year ago
README.md

3.26 kB
Enhance README with a new section detailing the research paper on the hybrid tokenization approach, including citation information and authors. Update requirements to specify the version of the Turkish Tokenizer package. 8 months ago
app.py

7.23 kB
Chore: Force rebuild on HF 2 months ago
requirements.txt

32 Bytes
tokenizer updated 2 months ago