gpt2_medium_prefix_682k / scripts /preprocess_data.py
augustocsc's picture
GPT-2 Medium trained on prefix dataset (682K)
3742716 verified
# Script para pré-processar dados (raw -> processed)