tokenizer: keep the pre-fix token_bytes so published bpb numbers stay reproducible

4aad0ae

verified

ChrisMcCormick commited on 6 days ago