Commit History

  1. Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)

    Verified signature
    0a970c8

  1. Upload tokenizer.tkz with huggingface_hub

    Verified signature
    79519e4

  1. Update model card README with v0.0.4 API

    Verified signature
    cc0a34e
  2. Update tokenizer.tkz to v11 (with pad_token_id)

    Verified signature
    5e6b208

  1. Add tokie .tkz tokenizer for voyageai/voyage-code-3

    Verified signature
    5283582
  2. initial commit

    Verified signature
    d5b4fcd