File size: 1,334 Bytes
b301f99 5f79635 81bff6a 5f79635 b301f99 5f79635 b301f99 1bf4214 b301f99 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 |
---
base_model:
- meta-llama/Llama-3.2-3B-Instruct
datasets:
- songff/GenerAlign
language:
- en
license: apache-2.0
pipeline_tag: text-generation
library_name: transformers
---
Pilot-3B is designed to be a draft model in efficient preference alignment of LLMs for its small size while high performance in general domains. It is trained from [Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct) on [GenerAlign](https://huggingface.co/datasets/songff/GenerAlign).
Related links:
- Paper: [Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding](https://arxiv.org/abs/2506.07434)
- Github: [Weak-to-Strong-Decoding](https://github.com/F2-Song/Weak-to-Strong-Decoding)
- Dataset: [GenerAlign](https://huggingface.co/datasets/songff/GenerAlign)
# ⚠️Caution
Pilot-3B is not guaranteed always to provide safe and correct responses. Please use it at your own risk.
# Citation
If you find this work useful, please consider citing:
```bibtex
@misc{song2025well,
title={Well Begun is Half Done: Low-resource Preference Alignment by Weak-to-Strong Decoding},
author={Song, Feifan and Wei, Shaohang and Luo, Wen and Fan, Yuxuan and Liu, Tianyu and Wang, Guoyin and Wang, Houfeng},
year={2025},
eprint={2506.07434},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
``` |