Spaces:
Sleeping
Sleeping
File size: 308 Bytes
ad5397c 79715d6 d114f76 ad5397c | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 | ---
title: BPE Tokenizer
emoji: 📚
colorFrom: gray
colorTo: red
sdk: streamlit
sdk_version: 1.41.1
tokens length: 5000000
by paired tokens length (Tokens): 4817
compression ratio: 3.48X
app_file: app.py
pinned: false
license: mit
short_description: Tailored for Telugu, considering its unique script.
---
|