dmgcsilva commited on
Commit
96a610a
·
verified ·
1 Parent(s): 01907a6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - dmgcsilva/InstructionVidDial
4
+ language:
5
+ - en
6
+ base_model:
7
+ - meta-llama/Llama-3.1-8B-Instruct
8
+ ---
9
+ # VIGiA: Instructional Video Guidance via Dialogue Reasoning and Retrieval
10
+
11
+ VIGiA is a multimodal dialogue model for conversational instructional plan guidance, accepted at **EACL 2026**.
12
+
13
+ It assists users through complex multi-step procedures (e.g., cooking, DIY) via interactive dialogue, supporting plan-grounded answer generation, plan-aware VQA, visually-informed step generation, and conversational video moment retrieval.
14
+
15
+ ## Model Details
16
+
17
+ - **Language Model**: LLaMA 3.1 8B Instruct
18
+ - **Visual Encoder**: SigLIP SO400M (224x224, patch size 14)
19
+ - **Connector**: 2-layer MLP
20
+ - **Training**: 4-stage progressive training with LoRA
21
+
22
+ ## Links
23
+
24
+ - **Code & full documentation**: [github.com/dmgcsilva/vigia](https://github.com/dmgcsilva/vigia)
25
+ - **Dataset**: [InstructionVidDial](#) <!-- TODO: add link -->
26
+ - **Paper**: *VIGiA: Instructional Video Guidance via Dialogue Reasoning and Retrieval* (EACL 2026)
27
+
28
+ ## Citation
29
+
30
+ ```bibtex
31
+ @inproceedings{gloria-silva-etal-2026-vigia,
32
+ title = "{VIG}i{A}: Instructional Video Guidance via Dialogue Reasoning and Retrieval",
33
+ author = "Gl{\'o}ria-Silva, Diogo and Semedo, David and Magalh{\~a}es, Jo{\~a}o",
34
+ booktitle = "Proceedings of the 2026 Conference of the European Chapter of the Association for Computational Linguistics",
35
+ year = "2026",
36
+ publisher = "Association for Computational Linguistics",
37
+ }
38
+ ```