s8frbroy commited on
Commit
90fd6c1
·
verified ·
1 Parent(s): 4608ee8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -11
README.md CHANGED
@@ -25,6 +25,29 @@ The model forms the **query-side encoder** in a **dual-encoder (DPR-style)** set
25
 
26
  ---
27
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
  ## 🧩 Model Overview
29
 
30
  | Property | Description |
@@ -38,17 +61,18 @@ The model forms the **query-side encoder** in a **dual-encoder (DPR-style)** set
38
 
39
  ---
40
 
41
- ## 🎯 Usage
42
 
43
- Example with `transformers`:
44
 
45
- ```python
46
- from transformers import AutoTokenizer, AutoModel
47
- import torch
48
-
49
- model = AutoModel.from_pretrained("s8frbroy/talk2ref_query_talk_encoder")
50
- tokenizer = AutoTokenizer.from_pretrained("sentence-transformers/all-MiniLM-L6-v2")
51
 
52
- text = "In this talk, we present a new transformer model for scientific retrieval..."
53
- inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True, max_length=512)
54
- embeddings = model(**inputs).last_hidden_state.mean(dim=1) # or custom weighted pooling
 
 
 
 
 
 
 
 
25
 
26
  ---
27
 
28
+ ## 🎯 Usage
29
+
30
+ Example with `transformers`:
31
+
32
+ ```python
33
+ from transformers import AutoModel
34
+ import torch
35
+
36
+ # Load model
37
+ model = AutoModel.from_pretrained("s8frbroy/talk2ref_query_talk_encoder")
38
+
39
+ # Example input
40
+ title = "Attention Is All You Need"
41
+ year = 2017
42
+ query_text = f"The following presentation is about the paper of the title: '{title}'. Published in {year}. " + \
43
+ "In this talk, we introduce the Transformer architecture and discuss its impact on sequence modeling."
44
+
45
+ # Compute embedding
46
+ with torch.no_grad():
47
+ embedding = model([query_text])
48
+
49
+ print(embedding.shape) # (1, hidden_dim)
50
+
51
  ## 🧩 Model Overview
52
 
53
  | Property | Description |
 
61
 
62
  ---
63
 
 
64
 
65
+ ## Citation
66
 
67
+ If you use this dataset, please cite the following paper:
 
 
 
 
 
68
 
69
+ ```bibtex
70
+ @misc{broy2025talk2refdatasetreferenceprediction,
71
+ title = {Talk2Ref: A Dataset for Reference Prediction from Scientific Talks},
72
+ author = {Frederik Broy and Maike Züfle and Jan Niehues},
73
+ year = {2025},
74
+ eprint = {2510.24478},
75
+ archivePrefix= {arXiv},
76
+ primaryClass = {cs.CL},
77
+ url = {https://arxiv.org/abs/2510.24478}
78
+ }