anindyanag58 commited on
Commit
30bc00e
·
verified ·
1 Parent(s): 41b7eaa

Add model card

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - multimodal-retrieval
5
+ - text-video-retrieval
6
+ - audio-visual
7
+ - hypergraph
8
+ ---
9
+
10
+ # HyVol: Hypergraph-Regularized Gramian Volumes for Multimodal Retrieval
11
+
12
+ Pretrained weights for the WACV 2027 paper
13
+ **Hypergraph-Regularized Gramian Volumes for Multimodal Retrieval**
14
+ by Anindya Nag, Ambuj Mehrish and Sebastiano Vascon.
15
+
16
+ Paper: [arXiv:2609.15320](https://arxiv.org/abs/2609.15320)
17
+
18
+ HyVol is a training-only module for volume-based multimodal retrieval. A hypergraph
19
+ adds semantic relations between training samples before the volume loss is computed.
20
+ The hypergraph is removed after training, so the backbone, scoring function and
21
+ retrieval cost are unchanged.
22
+
23
+ ## Checkpoints
24
+
25
+ | File | Backbone |
26
+ |---|---|
27
+ | `GRAM_HYVOL/HyVol_GRAM.pt` | GRAM + HyVol |
28
+ | `HyperGRAM_HYVOL/HyVol_HyperGRAM.pt` | Hyperbolic GRAM + HyVol |
29
+
30
+ Both models are trained on a 150K-clip subset of VAST-27M and evaluated zero-shot.
31
+ Load each checkpoint with the codebase of its backbone (GRAM or Hyperbolic GRAM).
32
+
33
+ ## Citation
34
+
35
+ ```bibtex
36
+ @inproceedings{nag2027hyvol,
37
+ title = {Hypergraph-Regularized Gramian Volumes for Multimodal Retrieval},
38
+ author = {Nag, Anindya and Mehrish, Ambuj and Vascon, Sebastiano},
39
+ booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
40
+ year = {2027}
41
+ }
42
+ ```