Instructions to use StonyBrookNLP/StarCoder2-LPO with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use StonyBrookNLP/StarCoder2-LPO with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("bigcode/starcoder2-7b") model = PeftModel.from_pretrained(base_model, "StonyBrookNLP/StarCoder2-LPO") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,5 +6,4 @@ library_name: peft
|
|
| 6 |
# Model Card for StarCoder2-LPO
|
| 7 |
|
| 8 |
This is the adapter of the Starcoder2 model trained using LPO on DiSCo for the paper "Teaching an Old LLM Secure Coding:
|
| 9 |
-
Localized Preference Optimization on Distilled Preferences" (https://arxiv.org/abs/2506.00419). Merge it to the model {"bigcode/starcoder2-7b"
|
| 10 |
-
+ StarCoder2-SFT} (base model merged to the StarCoder2-SFT adapter) in order to use for downstream tasks.
|
|
|
|
| 6 |
# Model Card for StarCoder2-LPO
|
| 7 |
|
| 8 |
This is the adapter of the Starcoder2 model trained using LPO on DiSCo for the paper "Teaching an Old LLM Secure Coding:
|
| 9 |
+
Localized Preference Optimization on Distilled Preferences" (https://arxiv.org/abs/2506.00419). Merge it to the model {"bigcode/starcoder2-7b" \+ StarCoder2-SFT} (base model merged to the StarCoder2-SFT adapter) in order to use for downstream tasks.
|
|
|