File size: 94 Bytes
602b5b1 |
1 2 3 4 |
class SimpleTokenizer:
def tokenize(self, text: str):
return text.lower().split()
|
602b5b1 |
1 2 3 4 |
class SimpleTokenizer:
def tokenize(self, text: str):
return text.lower().split()
|