anthonym21
/

json-tokenizer-structured

Text Generation

structured-data

Model card Files Files and versions

json-tokenizer-structured / json_tokenizer

42.1 kB

1 contributor

History: 3 commits

anthonym21's picture

Upload json_tokenizer/bpe.py with huggingface_hub

8ae05a9 verified 3 days ago

bpe.py

7.86 kB

Upload json_tokenizer/bpe.py with huggingface_hub 3 days ago
hf_compat.py

13.3 kB

Upload json_tokenizer/hf_compat.py with huggingface_hub 3 days ago
tokenizer.py

21 kB

Upload json_tokenizer/tokenizer.py with huggingface_hub 3 days ago