pad_model_linier_v3 / README.md
nuresens's picture
Upload folder using huggingface_hub
89e57cb verified
|
Raw
History Blame Contribute Delete
898 Bytes
---
language: id
tags:
- mistral
- merged
- lora
- linear-merge
- vision-language
base_model: mistralai/Ministral-3-3B-Base-2512
---
# PAD Model — Linear Adapter Merge
Merged model from 3 LoRA adapters on `mistralai/Ministral-3-3B-Base-2512` using **linear delta merging (Task Arithmetic)**.
## Merge Details
| Adapter | Weight |
|---------|--------|
| PAD-1 checkpoint-672 | 0.3 |
| PAD-2 checkpoint-3382 | 0.2 |
| VLM-IGRS | 0.5 |
## Merge Formula
final = base + (adapter1 - base)*0.3
+ (adapter2 - base)*0.2
+ (adapter3 - base)*0.5
## Chat Template
Borrowed from `unsloth/Ministral-3-3B-Instruct-2512`.
## Usage
```python
from transformers import AutoModelForImageTextToText, AutoProcessor
model = AutoModelForImageTextToText.from_pretrained("nuresens/pad_model_linier")
processor = AutoProcessor.from_pretrained("nuresens/pad_model_linier")
```