jiebi/TextFlow
Preview • Updated • 60
How to use jiebi/TextFlowEditor-Mistral-Small-24B-Instruct-2501-bnb-4bit with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("/cluster/work/users/jiebi/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit")
model = PeftModel.from_pretrained(base_model, "jiebi/TextFlowEditor-Mistral-Small-24B-Instruct-2501-bnb-4bit")The model is tailored specifically for Internet-Drafts Edit task.
To run the evaluation with (this script).
You can reproduce this with this script (reproduced here for convenience).
@inproceedings{bian2025instruction,
title={Instruction Tuning TextFlow Semi-automatic RFCs Generation},
author={Bian, Jie and Welzl, Michael},
booktitle={International Conference on Applications of Natural Language to Information Systems},
pages={350--364},
year={2025}
}
Base model
mistralai/Mistral-Small-24B-Base-2501