Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
georgeyw
/
TinyStories-tokenizer-10k
like
0
License:
mit
Model card
Files
Files and versions
xet
Community
georgeyw
commited on
Oct 18, 2023
Commit
473ae6f
·
1 Parent(s):
4a5181c
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+0
-1
README.md
CHANGED
Viewed
@@ -1,5 +1,4 @@
1
---
2
license: mit
3
---
4
-
5
GPT-2 tokenizer truncated to 10k tokens
1
---
2
license: mit
3
---
4
GPT-2 tokenizer truncated to 10k tokens