Atticus / utils /split.py
aniruddhdoki's picture
added utilities folder
e419601
raw
history blame contribute delete
119 Bytes
import re
def split(text, chunk_size=1000):
return (text[0+i:chunk_size+i] for i in range(0, len(text), chunk_size))