Error when saving tokenizer
#3
by adibm - opened
When I try to save the tokenizer using save_pretrained() method, I get the following error
raise TypeError(f'Object of type {o.class.name} '
TypeError: Object of type ByteLevel is not JSON serializable
Can you suggest any solution to this problem?