kiyam

Split perturbations by eval split (msmarco-dev/trec-dl-2019/trec-dl-2020), add TSV format with original+perturbed query text, add data_download scripts for MS MARCO/TREC-DL originals

391165c verified 8 days ago

Raw

History Blame Contribute Delete

370 Bytes

	{
	"seeded_perturbations": ["misspelling", "reordering", "synonym", "paraphrase"],
	"seeds": [1999, 5, 27, 2016, 2026],
	"unseeded_perturbations": {
	"naturality": "Deterministic transformation (stop-word removal). Produces identical output regardless of seed; represented in the TSV files with seed='deterministic' rather than being duplicated five times."
	}
	}