ai-forever commited on
Commit
53f9741
·
verified ·
1 Parent(s): 7ee7299

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -3
README.md CHANGED
@@ -1,3 +1,22 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ - ru
6
+ tags:
7
+ - data-leakage
8
+ - distribution shift
9
+ - multimodal
10
+ - membership inference attack
11
+ ---
12
+ # FiMMIA: scaling semantic perturbation-based membership inference across modalities
13
+ This repository contains an implementation of **F**i**MMIA** - a modular **F**ramework for **M**ultimodal **M**embership **I**nference **A**ttacks (FiMMIA)
14
+
15
+ ## Description
16
+ The system is the first collection of models and pipelines for membership inference attacks against multimodal large language models, built initially with a priority for the Russian language, and extendable to any other language or dataset.
17
+ Pipeline supports different modalities: **Audio**, Video and Image. In our experiments, we focus on [MERA datasets](https://github.com/MERA-Evaluation/MERA), however, the model can be used to other languages.
18
+
19
+ We support models for **Audio** (this), [Image](https://huggingface.co/ai-forever/FiMMIA-Image) and [Video](https://huggingface.co/ai-forever/FiMMIA-Video) modalities.
20
+
21
+ Training and inference code can be obtained [here](https://github.com/ai-forever/data_leakage_detect).
22
+