Add pipeline tag and paper link
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,15 +1,18 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
| 3 |
tags:
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
---
|
| 10 |
|
| 11 |
# MMDiff — Multimodal SAE checkpoints
|
| 12 |
|
|
|
|
|
|
|
| 13 |
Text-only-masked SAEs trained on the residual streams of multimodal LLMs, used by the
|
| 14 |
**MMDiff** multimodal model-diffing pipeline (code:
|
| 15 |
[hunarbatra/MMDiff](https://github.com/hunarbatra/MMDiff), project page:
|
|
@@ -48,4 +51,4 @@ state = torch.load(p, map_location="cpu")
|
|
| 48 |
```
|
| 49 |
|
| 50 |
See the [MMDiff repo](https://github.com/hunarbatra/MMDiff) for the full pipeline
|
| 51 |
-
(training, adapted-feature selection, task-specific discovery, ablation, steering).
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: other
|
| 4 |
tags:
|
| 5 |
+
- sparse-autoencoder
|
| 6 |
+
- interpretability
|
| 7 |
+
- multimodal
|
| 8 |
+
- paligemma2
|
| 9 |
+
- llava
|
| 10 |
---
|
| 11 |
|
| 12 |
# MMDiff — Multimodal SAE checkpoints
|
| 13 |
|
| 14 |
+
This repository contains the SAE checkpoints used in the paper [Multimodal Model Diffing for Feature Discovery and Control](https://huggingface.co/papers/2608.09928).
|
| 15 |
+
|
| 16 |
Text-only-masked SAEs trained on the residual streams of multimodal LLMs, used by the
|
| 17 |
**MMDiff** multimodal model-diffing pipeline (code:
|
| 18 |
[hunarbatra/MMDiff](https://github.com/hunarbatra/MMDiff), project page:
|
|
|
|
| 51 |
```
|
| 52 |
|
| 53 |
See the [MMDiff repo](https://github.com/hunarbatra/MMDiff) for the full pipeline
|
| 54 |
+
(training, adapted-feature selection, task-specific discovery, ablation, steering).
|