repo-app / transformers /utils /test_module /custom_tokenization.py
ghrua's picture
Initial commit with Dockerfile
8b821fa
raw
history blame contribute delete
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass