Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

tokiers
/
phi-2

tokie
Model card Files Files and versions
xet
Community
phi-2
9.46 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 11 commits
bhavnicksm's picture
bhavnicksm
rebuild tokenizer.tokie from tokenizer.json
65e3845 verified 3 days ago
  • .gitattributes
    1.67 kB
    Add the tokie 0.2 tokenizer file 9 days ago
  • README.md
    1.34 kB
    Add model card README 8 months ago
  • special_tokens_map.json
    99 Bytes
    Add special_tokens_map.json from microsoft/phi-2 8 months ago
  • tokenizer.json
    2.11 MB
    Add tokenizer.json from microsoft/phi-2 8 months ago
  • tokenizer.tkz
    3.3 MB
    xet
    Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file) 4 months ago
  • tokenizer.tokie
    3.9 MB
    xet
    rebuild tokenizer.tokie from tokenizer.json 3 days ago
  • tokenizer_config.json
    7.34 kB
    Add tokenizer_config.json from microsoft/phi-2 8 months ago
  • tokie-banner.png
    135 kB
    xet
    Add tokie banner 8 months ago