Hugging Face's logo

hf-internal-testing
/
fuyu-tiny-tokenizer

fuyu
Model card Files
xet
 Community
fuyu-tiny-tokenizer

Commit History

  1. Update tokenizer_config.json: 760-token vocab with all 256 byte tokens

    hf-transformers-bot HF Staff
    Verified signature
    d2b6739

  2. Update config.json: 760-token vocab with all 256 byte tokens

    hf-transformers-bot HF Staff
    Verified signature
    44d0db7

  3. Add tiny Fuyu tokenizer fixture for testing

    hf-transformers-bot HF Staff
    Verified signature
    c7d83e1

  4. Update tokenizer_config.json

    hf-transformers-bot HF Staff
    Verified signature
    9e90e0b

  5. Update config.json

    hf-transformers-bot HF Staff
    Verified signature
    6e83cc1

  6. Add tiny Fuyu tokenizer fixture for testing

    hf-transformers-bot HF Staff
    Verified signature
    102357e

  7. Add tiny Fuyu tokenizer fixture for testing

    hf-transformers-bot HF Staff
    Verified signature
    724c0e8

  8. Add tiny Fuyu tokenizer fixture for testing

    hf-transformers-bot HF Staff
    Verified signature
    33c03cc

  9. Add tiny Fuyu tokenizer fixture for testing

    hf-transformers-bot HF Staff
    Verified signature
    8393b8f

  10. initial commit

    hf-transformers-bot HF Staff
    Verified signature
    f69776f