GST_LIVING_NOVEL / generated_data /data_transform.py
atad-tokyo's picture
Add files using upload-large-folder tool
cbb1d4f verified
Raw
History Blame Contribute Delete
269 Bytes
import pandas as pd
# 读取 parquet 文件
df = pd.read_parquet("/root/githubs/LightRAG/generated_data/大生_train.parquet")
# 导出为 JSON
df.to_json("/root/githubs/LightRAG/generated_data/大生_yty_train.jsonl", orient="records", force_ascii=False, lines=True)