Query side instruction tuning
#5
by inkoon - opened
In the model card, it says "Instruction tuning, applied soley on the query side."
Does this mean that only the s(qi, dj) and s(qi, qj) terms are used in the contrastive loss?
If not, what does it mean?
Query side instruction tuning refers to using instructions only on the query side during both training and inference phases to indicate different tasks, domains, or other information, while no instructions are used on the document (doc) side. The input format for the query is {instruct} + Query, while the input for the doc remains the original document.
inkoon changed discussion status to closed