Simple pika- / GPT-2- like BPE tokenizer that was trained on every possible byte. The script used to generate this was included.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Simple pika- / GPT-2- like BPE tokenizer that was trained on every possible byte. The script used to generate this was included.