Update README.md
Browse files
README.md
CHANGED
|
@@ -20,6 +20,10 @@ rectified-flow head over the joint 22-dimensional affect vector.
|
|
| 20 |
Code, training scripts, and the full 28-experiment ablation study:
|
| 21 |
**[github.com/Bekhouche/AffectFlow-DINO](https://github.com/Bekhouche/AffectFlow-DINO)**.
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
## Quickstart
|
| 24 |
|
| 25 |
```bash
|
|
@@ -36,14 +40,14 @@ applicable, `au_thresholds.json` and/or `expr_weights.json` post-hoc calibration
|
|
| 36 |
|
| 37 |
| Folder | Backbone | Best decode | P_MTL (calibrated) | P_VA | P_EXPR | P_AU |
|
| 38 |
|---|---|---|---|---|---|---|
|
| 39 |
-
| `finetune-flow-retune-b10` | ViT-S/16, fine-tuned | Det | **1.177** | 0.325 | 0.350 | 0.502 |
|
| 40 |
-
| `vitb-finetune` | ViT-B/16, fine-tuned | Det | 1.116 | 0.354 | 0.255 | 0.507 |
|
| 41 |
-
| `finetune-flow-retune-b05` | ViT-S/16, fine-tuned | Det / Flow | 1.062 / 0.956 | 0.291 | 0.303 | 0.469 |
|
| 42 |
-
| `finetune` | ViT-S/16, fine-tuned | Det | 1.101 | 0.318 | 0.285 | 0.497 |
|
| 43 |
-
| `au-posw-cw` | ViT-S/16, frozen | Det | 0.890 (no cal.) | 0.211 | 0.240 | 0.439 |
|
| 44 |
-
| `psp` | ViT-S/16, frozen (patch soft-pool) | Det | 0.859 (no cal.) | 0.235 | 0.236 | 0.389 |
|
| 45 |
-
| `affectflow-base` | ViT-S/16, frozen | Flow | 0.888 | 0.237 | 0.210 | 0.441 |
|
| 46 |
-
| `det-baseline` | ViT-S/16, frozen | Det | 0.793 (no cal.) | 0.199 | 0.216 | 0.378 |
|
| 47 |
|
| 48 |
`P_MTL = P_VA + P_EXPR + P_AU` is the official ABAW MTL composite metric (P_VA = mean CCC of
|
| 49 |
valence/arousal, P_EXPR = expression macro-F1, P_AU = mean AU F1), evaluated on the s-Aff-Wild2
|
|
@@ -74,11 +78,11 @@ treat outputs as research signals, not clinical or high-stakes decisions.
|
|
| 74 |
## Citation
|
| 75 |
|
| 76 |
```bibtex
|
| 77 |
-
@
|
| 78 |
-
title
|
| 79 |
-
author
|
| 80 |
-
|
| 81 |
-
year
|
| 82 |
}
|
| 83 |
```
|
| 84 |
|
|
|
|
| 20 |
Code, training scripts, and the full 28-experiment ablation study:
|
| 21 |
**[github.com/Bekhouche/AffectFlow-DINO](https://github.com/Bekhouche/AffectFlow-DINO)**.
|
| 22 |
|
| 23 |
+
**Paper:** [AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional
|
| 24 |
+
Rectified Flow](https://arxiv.org/abs/2607.13250) — Salah Eddine Bekhouche, Abdellah Zakaria
|
| 25 |
+
Sellam, Fadi Dornaika, Abdenour Hadid. arXiv:2607.13250, 2026.
|
| 26 |
+
|
| 27 |
## Quickstart
|
| 28 |
|
| 29 |
```bash
|
|
|
|
| 40 |
|
| 41 |
| Folder | Backbone | Best decode | P_MTL (calibrated) | P_VA | P_EXPR | P_AU |
|
| 42 |
|---|---|---|---|---|---|---|
|
| 43 |
+
| [`finetune-flow-retune-b10`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/finetune-flow-retune-b10) | ViT-S/16, fine-tuned | Det | **1.177** | 0.325 | 0.350 | 0.502 |
|
| 44 |
+
| [`vitb-finetune`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/vitb-finetune) | ViT-B/16, fine-tuned | Det | 1.116 | 0.354 | 0.255 | 0.507 |
|
| 45 |
+
| [`finetune-flow-retune-b05`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/finetune-flow-retune-b05) | ViT-S/16, fine-tuned | Det / Flow | 1.062 / 0.956 | 0.291 | 0.303 | 0.469 |
|
| 46 |
+
| [`finetune`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/finetune) | ViT-S/16, fine-tuned | Det | 1.101 | 0.318 | 0.285 | 0.497 |
|
| 47 |
+
| [`au-posw-cw`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/au-posw-cw) | ViT-S/16, frozen | Det | 0.890 (no cal.) | 0.211 | 0.240 | 0.439 |
|
| 48 |
+
| [`psp`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/psp) | ViT-S/16, frozen (patch soft-pool) | Det | 0.859 (no cal.) | 0.235 | 0.236 | 0.389 |
|
| 49 |
+
| [`affectflow-base`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/affectflow-base) | ViT-S/16, frozen | Flow | 0.888 | 0.237 | 0.210 | 0.441 |
|
| 50 |
+
| [`det-baseline`](https://huggingface.co/Bekhouche/AffectFlow-DINO/tree/main/det-baseline) | ViT-S/16, frozen | Det | 0.793 (no cal.) | 0.199 | 0.216 | 0.378 |
|
| 51 |
|
| 52 |
`P_MTL = P_VA + P_EXPR + P_AU` is the official ABAW MTL composite metric (P_VA = mean CCC of
|
| 53 |
valence/arousal, P_EXPR = expression macro-F1, P_AU = mean AU F1), evaluated on the s-Aff-Wild2
|
|
|
|
| 78 |
## Citation
|
| 79 |
|
| 80 |
```bibtex
|
| 81 |
+
@article{bekhouche2026affectflowdino,
|
| 82 |
+
title = {AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow},
|
| 83 |
+
author = {Bekhouche, Salah Eddine and Sellam, Abdellah Zakaria and Dornaika, Fadi and Hadid, Abdenour},
|
| 84 |
+
journal = {arXiv preprint arXiv:2607.13250},
|
| 85 |
+
year = {2026}
|
| 86 |
}
|
| 87 |
```
|
| 88 |
|