Update README.md
Browse files
README.md
CHANGED
|
@@ -101,11 +101,11 @@ but without explicitly answering the query or suggesting a solution.
|
|
| 101 |
|
| 102 |
Extract:
|
| 103 |
|
| 104 |
-
- **Buffer A**: 10-15 words from the Top-5 ranked documents and
|
| 105 |
|
| 106 |
**Generate an adversarial sentences** that satisfy ALL the following:
|
| 107 |
|
| 108 |
-
- Include
|
| 109 |
- DO NOT use the words that answer the query.
|
| 110 |
- Are **fluent**, **grammatically sound**, and **consistent with the style** of the Target Document.
|
| 111 |
- **Do NOT answer, suggest, or hint at an answer to the Target Query**.
|
|
@@ -200,6 +200,10 @@ The following summarizes attack performance and content fidelity metrics for CRA
|
|
| 200 |
| CRAFT_Qwen3 | **100.0** | 15.3† | 57.1† | 911.5† | 0.8 | 19.1 | 19.1 | 1.0 |
|
| 201 |
| CRAFT_Llama3.3 | **100.0** | **22.2**† | **70.5**† | **940.5**† | 0.8 | 19.7 | 19.7 | 1.0 |
|
| 202 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 203 |
## Dataset
|
| 204 |
|
| 205 |
This model was fine-tuned using data from the following repository:
|
|
|
|
| 101 |
|
| 102 |
Extract:
|
| 103 |
|
| 104 |
+
- **Buffer A**: 10-15 words from the Top-5 ranked documents and query itself, strongly associated with the query.
|
| 105 |
|
| 106 |
**Generate an adversarial sentences** that satisfy ALL the following:
|
| 107 |
|
| 108 |
+
- Include combination of words (at least 5) or similar words (similar embedding) from Buffer A** that is most related to the query and help promote ranking significantly and integrates well with Target Document
|
| 109 |
- DO NOT use the words that answer the query.
|
| 110 |
- Are **fluent**, **grammatically sound**, and **consistent with the style** of the Target Document.
|
| 111 |
- **Do NOT answer, suggest, or hint at an answer to the Target Query**.
|
|
|
|
| 200 |
| CRAFT_Qwen3 | **100.0** | 15.3† | 57.1† | 911.5† | 0.8 | 19.1 | 19.1 | 1.0 |
|
| 201 |
| CRAFT_Llama3.3 | **100.0** | **22.2**† | **70.5**† | **940.5**† | 0.8 | 19.7 | 19.7 | 1.0 |
|
| 202 |
|
| 203 |
+
Figure: Attack methods performance vs. detection pass rate
|
| 204 |
+
|
| 205 |
+

|
| 206 |
+
|
| 207 |
## Dataset
|
| 208 |
|
| 209 |
This model was fine-tuned using data from the following repository:
|