Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

tokiers
/
gemma-2-2b

tokie
Model card Files Files and versions
xet
Community
gemma-2-2b
31.9 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 9 commits
bhavnicksm's picture
bhavnicksm
Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)
0a079d0 verified 23 days ago
  • .gitattributes
    1.67 kB
    Add tokenizer.json from google/gemma-2-2b 5 months ago
  • README.md
    1.37 kB
    Add model card README 5 months ago
  • special_tokens_map.json
    636 Bytes
    Add special_tokens_map.json from google/gemma-2-2b 5 months ago
  • tokenizer.json
    17.5 MB
    xet
    Add tokenizer.json from google/gemma-2-2b 5 months ago
  • tokenizer.model
    4.24 MB
    xet
    Add tokenizer.model for HF tokenizers compatibility 5 months ago
  • tokenizer.tkz
    9.93 MB
    xet
    Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file) 23 days ago
  • tokenizer_config.json
    46.4 kB
    Add tokenizer_config.json from google/gemma-2-2b 5 months ago
  • tokie-banner.png
    135 kB
    xet
    Add tokie banner 5 months ago