Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Zaynoid
/
Kimi-K2-Thinking-Tokenizer
like
0
Text Generation
Transformers
English
Chinese
deepseek_v3
tokenizer
tiktoken
kimi
moonshot
deepseek
conversational
custom_code
License:
modified-mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
7a3bbd9
Kimi-K2-Thinking-Tokenizer
7.4 MB
Ctrl+K
Ctrl+K
1 contributor
History:
12 commits
Zaynoid
Update special_tokens_map.json with correct token definitions
7a3bbd9
verified
5 months ago
.gitattributes
Safe
1.52 kB
initial commit
5 months ago
README.md
2.08 kB
Add README.md
5 months ago
chat_template.jinja
Safe
3.45 kB
Add chat_template.jinja
5 months ago
config.json
3.83 kB
Create config.json
5 months ago
special_tokens_map.json
303 Bytes
Update special_tokens_map.json with correct token definitions
5 months ago
tiktoken.model
Safe
2.8 MB
xet
Add tiktoken.model
5 months ago
tokenization_kimi.py
Safe
12.6 kB
Add tokenization_kimi.py
5 months ago
tokenizer.json
Safe
4.58 MB
Add tokenizer.json
5 months ago
tokenizer_config.json
4.02 kB
Update tokenizer_config.json with correct token definitions
5 months ago