Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
aayushraina
/
bpe-hindi
like
0
Text Generation
Hindi
hindi
tokenizer
bpe
subword
text-processing
text2text-generation
License:
mit
Model card
Files
Files and versions
xet
Community
main
bpe-hindi
2.07 MB
1 contributor
History:
8 commits
aayushraina
Upload 4 files
30325e1
verified
12 months ago
tokenizer
Upload 2 files
12 months ago
.gitattributes
1.52 kB
initial commit
12 months ago
README.md
2.91 kB
Upload 4 files
12 months ago
app.py
4.22 kB
Upload 4 files
12 months ago
app_gradio.py
4.08 kB
Upload 4 files
12 months ago
byte_pair_encoder.py
8.03 kB
Upload 9 files
12 months ago
data_loader.py
4.26 kB
Upload 9 files
12 months ago
download_dataset.py
6.47 kB
Upload 9 files
12 months ago
encoder.json
540 kB
Upload 9 files
12 months ago
hindi_bpe.py
4.56 kB
Upload 9 files
12 months ago
requirements.txt
149 Bytes
Upload 4 files
12 months ago
test_hindi_bpe.py
5.78 kB
Upload 9 files
12 months ago
tokenizer_config.json
359 Bytes
Upload tokenizer_config.json
12 months ago
vocab_stats.json
474 kB
Upload 9 files
12 months ago