jiebi/TextFlow
Preview • Updated • 61
How to use jiebi/TextFlowEditor-R1-Distill-Llama-8B-unsloth-bnb-4bit with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/cluster/work/users/jiebi/unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "jiebi/TextFlowEditor-R1-Distill-Llama-8B-unsloth-bnb-4bit")The model is tailored specifically for Internet-Drafts Edit task.
To run the evaluation with (this script).
You can reproduce this with this script (reproduced here for convenience).
@inproceedings{bian2025instruction,
title={Instruction Tuning TextFlow Semi-automatic RFCs Generation},
author={Bian, Jie and Welzl, Michael},
booktitle={International Conference on Applications of Natural Language to Information Systems},
pages={350--364},
year={2025}
}
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B