Add pipeline tag and improve documentation
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,22 +1,24 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: mit
|
|
|
|
| 3 |
tags:
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
- image-classification
|
| 10 |
-
base_model:
|
| 11 |
-
- openai/clip-vit-base-patch32
|
| 12 |
-
- openai/clip-vit-base-patch16
|
| 13 |
-
- openai/clip-vit-large-patch14
|
| 14 |
---
|
| 15 |
|
| 16 |
# Understanding and Enforcing Weight Disentanglement in Task Arithmetic
|
| 17 |
|
| 18 |
[CVPR 2026] Official checkpoints for the paper **"Understanding and Enforcing Weight Disentanglement in Task Arithmetic"**.
|
| 19 |
|
|
|
|
|
|
|
| 20 |
[[Paper](https://arxiv.org/abs/2604.17078)] [[Code](https://github.com/RL-MIND/OrthoReg)]
|
| 21 |
|
| 22 |
---
|
|
@@ -145,15 +147,6 @@ python src/eval_task_negation.py \
|
|
| 145 |
|
| 146 |
> Run `eval_single_task` with `--finetuning-mode none --ortho-lambda 0` first to generate `zeroshot_accuracies.json`, which is required as the reference for normalized accuracy.
|
| 147 |
|
| 148 |
-
### Argument reference
|
| 149 |
-
|
| 150 |
-
| Argument | Value for these checkpoints |
|
| 151 |
-
|---|---|
|
| 152 |
-
| `--seed` | `1993` |
|
| 153 |
-
| `--lr` | `1e-5` |
|
| 154 |
-
| `--ortho-lambda` | `0` for baselines, `xx` for OrthoReg variants |
|
| 155 |
-
| `--finetuning-mode` | see table above |
|
| 156 |
-
|
| 157 |
---
|
| 158 |
|
| 159 |
## 📦 Datasets
|
|
@@ -182,4 +175,4 @@ If you find this work useful, please cite:
|
|
| 182 |
|
| 183 |
## 📬 Acknowledgements
|
| 184 |
|
| 185 |
-
This codebase is built on top of [Task Arithmetic](https://github.com/mlfoundations/task_vectors), [Tangent Task Arithmetic](https://github.com/gortizji/tangent_task_arithmetic), and [Attention-Only Fine-tuning](https://github.com/kyrie-23/linear_task_arithmetic). We thank the authors for releasing their code.
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model:
|
| 3 |
+
- openai/clip-vit-base-patch32
|
| 4 |
+
- openai/clip-vit-base-patch16
|
| 5 |
+
- openai/clip-vit-large-patch14
|
| 6 |
license: mit
|
| 7 |
+
pipeline_tag: image-classification
|
| 8 |
tags:
|
| 9 |
+
- clip
|
| 10 |
+
- task-arithmetic
|
| 11 |
+
- model-merging
|
| 12 |
+
- fine-tuning
|
| 13 |
+
- orthogonal-regularization
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
# Understanding and Enforcing Weight Disentanglement in Task Arithmetic
|
| 17 |
|
| 18 |
[CVPR 2026] Official checkpoints for the paper **"Understanding and Enforcing Weight Disentanglement in Task Arithmetic"**.
|
| 19 |
|
| 20 |
+
**Authors**: [Shangge Liu](https://huggingface.co/gezi2333), Yuehan Yin, Lei Wang, Qi Fan, Yinghuan Shi, Wenbin Li, Yang Gao, and Dacheng Tao.
|
| 21 |
+
|
| 22 |
[[Paper](https://arxiv.org/abs/2604.17078)] [[Code](https://github.com/RL-MIND/OrthoReg)]
|
| 23 |
|
| 24 |
---
|
|
|
|
| 147 |
|
| 148 |
> Run `eval_single_task` with `--finetuning-mode none --ortho-lambda 0` first to generate `zeroshot_accuracies.json`, which is required as the reference for normalized accuracy.
|
| 149 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 150 |
---
|
| 151 |
|
| 152 |
## 📦 Datasets
|
|
|
|
| 175 |
|
| 176 |
## 📬 Acknowledgements
|
| 177 |
|
| 178 |
+
This codebase is built on top of [Task Arithmetic](https://github.com/mlfoundations/task_vectors), [Tangent Task Arithmetic](https://github.com/gortizji/tangent_task_arithmetic), and [Attention-Only Fine-tuning](https://github.com/kyrie-23/linear_task_arithmetic). We thank the authors for releasing their code.
|