Add model card, paper link, and project links

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-text-to-text
3
+ ---
4
+
5
+ # SPLASH-1B: Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs
6
+
7
+ This repository contains the SPLASH-1B model checkpoint presented in the paper [Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs](https://huggingface.co/papers/2607.00302).
8
+
9
+ SPLASH-1B integrates tactile perception into vision-language models by using [InternVL2.5-1B](https://huggingface.co/OpenGVLab/InternVL2_5-1B) as the base MLLM backbone and a ViT-Tiny tactile frontend.
10
+
11
+ - **Project Page:** [https://ewha-mmai.github.io/splash/](https://ewha-mmai.github.io/splash/)
12
+ - **Repository:** [https://github.com/ewha-mmai/splash](https://github.com/ewha-mmai/splash)
13
+
14
+ ## Description
15
+
16
+ SPLASH integrates tactile perception into vision-language models through a two-stage pipeline:
17
+ 1. **Dormant Mask Generation:** Quantifies the significance of each pretrained parameter via weight & activation importance scoring on the LLM backbone, partitioning the parameter space into a dormant and critical subspace.
18
+ 2. **Mask-Guided Sparse Training:** Updates the isolated dormant subspace to align tactile representations while freezing the critical subspace to safeguard established vision-language reasoning, preventing catastrophic forgetting.
19
+
20
+ <p align="center">
21
+ <img src="https://raw.githubusercontent.com/ewha-mmai/splash/main/assets/figure.png" width="100%">
22
+ </p>
23
+
24
+ ## Citation
25
+
26
+ If you find SPLASH useful, please cite the paper:
27
+
28
+ ```bibtex
29
+ @inproceedings{park2026splash,
30
+ title={Wake up for Touch! Mask-isolated Tactile Alignment Learning in MLLMs},
31
+ author={Yoonhyung Park and Minji Kim and Sungwon Moon and Jiyoung Lee},
32
+ booktitle={European Conference on Computer Vision (ECCV)},
33
+ year={2026}
34
+ }
35
+ ```