xingzhikb
/

deepspeed

deepspeed / transformers /utils /test_module /custom_tokenization.py

init

002bd9b about 1 year ago

88 Bytes

	from transformers import BertTokenizer


	class CustomTokenizer(BertTokenizer):
	pass