Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,22 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- ru
|
| 6 |
+
tags:
|
| 7 |
+
- data-leakage
|
| 8 |
+
- distribution shift
|
| 9 |
+
- multimodal
|
| 10 |
+
- membership inference attack
|
| 11 |
+
---
|
| 12 |
+
# FiMMIA: scaling semantic perturbation-based membership inference across modalities
|
| 13 |
+
This repository contains an implementation of **F**i**MMIA** - a modular **F**ramework for **M**ultimodal **M**embership **I**nference **A**ttacks (FiMMIA)
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
The system is the first collection of models and pipelines for membership inference attacks against multimodal large language models, built initially with a priority for the Russian language, and extendable to any other language or dataset.
|
| 17 |
+
Pipeline supports different modalities: **Audio**, Video and Image. In our experiments, we focus on [MERA datasets](https://github.com/MERA-Evaluation/MERA), however, the model can be used to other languages.
|
| 18 |
+
|
| 19 |
+
We support models for **Audio** (this), [Image](https://huggingface.co/ai-forever/FiMMIA-Image) and [Video](https://huggingface.co/ai-forever/FiMMIA-Video) modalities.
|
| 20 |
+
|
| 21 |
+
Training and inference code can be obtained [here](https://github.com/ai-forever/data_leakage_detect).
|
| 22 |
+
|