Image-to-Text
PEFT
Safetensors
code-generation
multimodal
vision-encoder-decoder
lora
swin
qwen2.5-coder
code-trainer
Instructions to use cmndcntrlcyber/code-trainer-vision-adapter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use cmndcntrlcyber/code-trainer-vision-adapter with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Sync model card from docs/model_cards/code-trainer-vision-adapter.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
- peft
|
| 11 |
- swin
|
| 12 |
- qwen2.5-coder
|
| 13 |
-
- code-trainer
|
| 14 |
datasets:
|
| 15 |
- cmndcntrlcyber/code-trainer-offsec-dataset
|
| 16 |
pipeline_tag: image-to-text
|
|
@@ -23,7 +23,7 @@ A multimodal **screenshot → code** model: a frozen
|
|
| 23 |
encoder, an MLP projector, and a LoRA adapter for
|
| 24 |
[`Qwen/Qwen2.5-Coder-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct).
|
| 25 |
|
| 26 |
-
This is **Phase 3** of the Code-Trainer
|
| 27 |
([GitHub](https://github.com/cmndcntrlcyber/code-trainer-offsec-pipeline)) —
|
| 28 |
the multimodal stage that takes a Monaco-Editor-rendered VS Code screenshot of
|
| 29 |
source code and emits the underlying source.
|
|
@@ -150,7 +150,7 @@ print(model.generate(image, max_new_tokens=512))
|
|
| 150 |
* **Training launcher:**
|
| 151 |
```bash
|
| 152 |
python -m src.phase3_vision_model.scripts.launch_vision_training \
|
| 153 |
-
--config src/config/
|
| 154 |
```
|
| 155 |
* **W&B project:** [`rtpi-phase3-vision`](https://wandb.ai/cmndcntrlcyber-c3s-consulting/rtpi-phase3-vision).
|
| 156 |
* **Cost:** approximately $18 on `a100-large` (~5.5 h training + ~20 min eval).
|
|
|
|
| 10 |
- peft
|
| 11 |
- swin
|
| 12 |
- qwen2.5-coder
|
| 13 |
+
- code-trainer
|
| 14 |
datasets:
|
| 15 |
- cmndcntrlcyber/code-trainer-offsec-dataset
|
| 16 |
pipeline_tag: image-to-text
|
|
|
|
| 23 |
encoder, an MLP projector, and a LoRA adapter for
|
| 24 |
[`Qwen/Qwen2.5-Coder-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-Coder-1.5B-Instruct).
|
| 25 |
|
| 26 |
+
This is **Phase 3** of the Code-Trainer / RTPI pipeline
|
| 27 |
([GitHub](https://github.com/cmndcntrlcyber/code-trainer-offsec-pipeline)) —
|
| 28 |
the multimodal stage that takes a Monaco-Editor-rendered VS Code screenshot of
|
| 29 |
source code and emits the underlying source.
|
|
|
|
| 150 |
* **Training launcher:**
|
| 151 |
```bash
|
| 152 |
python -m src.phase3_vision_model.scripts.launch_vision_training \
|
| 153 |
+
--config src/config/config.yaml --wait
|
| 154 |
```
|
| 155 |
* **W&B project:** [`rtpi-phase3-vision`](https://wandb.ai/cmndcntrlcyber-c3s-consulting/rtpi-phase3-vision).
|
| 156 |
* **Cost:** approximately $18 on `a100-large` (~5.5 h training + ~20 min eval).
|