File size: 1,937 Bytes
9021855 8629694 9021855 8629694 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 | ---
license: apache-2.0
language:
- en
base_model:
- naver/trecdl22-crossencoder-debertav3
pipeline_tag: text-classification
tags:
- reranker
- cross-encoder
- financial-qa
library_name: transformers
---
# FinQA-Table-random-DeBERTa-Reranker
A passage reranker for the **HiREC** framework, fine-tuned from `naver/trecdl22-crossencoder-debertav3` on table data from the FinQA training set. General-purpose rerankers often fail to capture table-specific cues (titles, periods, indicators) that matter more than raw numerical values; this model is adapted to address that gap.
- 📄 Paper: [ACL 2025 Findings](https://aclanthology.org/2025.findings-acl.855/)
- 💻 Code: [LOFin-bench-HiREC](https://github.com/deep-over/LOFin-bench-HiREC)
## Training Data
Constructed from the **FinQA** training set, where each question is paired with an evidence page containing the gold table.
- **Positive passages:** tables located on the evidence page of each question.
- **Negative passages:** tables sampled from pages *other than* the evidence page within the same document (**random** negative sampling).
- For each positive, `n_neg = 8` negatives are drawn.
## Training Setup
- **Base model:** `naver/trecdl22-crossencoder-debertav3`
- **Objective:** Binary cross-entropy on `(query, passage)` pairs; the cross-encoder applies an internal sigmoid, producing relevance scores in [0, 1].
- Batch size: 128 / Epochs: 3 / Learning rate: 2e-7
- **Hardware:** 1× NVIDIA GeForce RTX 4090
## Citation
```bibtex
@inproceedings{choe-etal-2025-hierarchical,
title = {Hierarchical Retrieval with Evidence Curation for Open-Domain Financial Question Answering on Standardized Documents},
author = {Choe, Jaeyoung and Kim, Jihoon and Jung, Woohwan},
booktitle = {Findings of the Association for Computational Linguistics: ACL 2025},
year = {2025},
url = {https://aclanthology.org/2025.findings-acl.855/}
}
``` |