Commit History

  1. Regenerate tokenizer.tkz as format v13 (self-contained: added/special tokens stored in-file)

    Verified signature
    6872c26

  1. Add model card README

    Verified signature
    1e51f4f
  2. Add special_tokens_map.json from codellama/CodeLlama-7b-hf

    Verified signature
    c7236a9
  3. Add tokenizer_config.json from codellama/CodeLlama-7b-hf

    Verified signature
    b40bb05
  4. Add tokenizer.json from codellama/CodeLlama-7b-hf

    Verified signature
    37dbbd2
  5. Add tokie banner

    Verified signature
    8acef6b
  6. Update tokenizer.tkz to v11 (with pad_token_id)

    Verified signature
    325b489
  7. initial commit

    Verified signature
    ee3af5a