PureVersation / convert.py
github-actions[bot]
Automated deployment to Hugging Face
963d10b
Raw
History Blame Contribute Delete
185 Bytes
import codecs
text = codecs.open('hf_files_june12.txt', 'r', 'utf-16le').read()
with codecs.open('hf_files_june12_utf8.txt', 'w', 'utf-8') as f:
f.write(text.replace('\ufeff', ''))