Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
nilq
/
baby-tokenizer
like
1
nilq/babylm-100M
English
babylm
tokenizer
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
nilq
commited on
Feb 22, 2024
Commit
cc2d5e3
·
verified
·
1 Parent(s):
7357b8a
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+2
-0
README.md
CHANGED
Viewed
@@ -5,6 +5,8 @@ language:
5
tags:
6
- babylm
7
- tokenizer
8
---
9
10
## Baby Tokenizer
5
tags:
6
- babylm
7
- tokenizer
8
+
datasets:
9
+
- nilq/babylm-100M
10
---
11
12
## Baby Tokenizer