Spaces:

anveshplus
/

BPE-Tokenizer

Sleeping

App Files Files Community

BPE-Tokenizer / README.md

anveshplus

updated

79715d6 about 1 year ago

preview code

raw

history blame contribute delete

308 Bytes

A newer version of the Streamlit SDK is available: 1.54.0

Upgrade

metadata

title: BPE Tokenizer
emoji: 📚
colorFrom: gray
colorTo: red
sdk: streamlit
sdk_version: 1.41.1
tokens length: 5000000
by paired tokens length (Tokens): 4817
compression ratio: 3.48X
app_file: app.py
pinned: false
license: mit
short_description: Tailored for Telugu, considering its unique script.