Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
- Website
- Community
- Solutions
Log In
Sign Up

Spaces:

alibayram
/

turkish_tiktokenizer

Running

App Files Files Community

Fetching metadata from the HF Docker repository...

turkish_tiktokenizer

12 kB

Ctrl+K

Ctrl+K

1 contributor

History: 19 commits

alibayram's picture

Chore: Force rebuild on HF

f748ebb 5 months ago

.gitattributes

1.52 kB
initial commit over 1 year ago
.gitignore

15 Bytes
Update REQUIRED_FILES to reference kokler_v07.json instead of kokler_v05.json over 1 year ago
README.md

3.26 kB
Enhance README with a new section detailing the research paper on the hybrid tokenization approach, including citation information and authors. Update requirements to specify the version of the Turkish Tokenizer package. 11 months ago
app.py

7.23 kB
Chore: Force rebuild on HF 5 months ago
requirements.txt

32 Bytes
tokenizer updated 5 months ago