Instructions to use knowingly-wrong/realistic-scenarios with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use knowingly-wrong/realistic-scenarios with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Upload brexit/meta.json with huggingface_hub
Browse files- brexit/meta.json +5 -3
brexit/meta.json
CHANGED
|
@@ -193,9 +193,11 @@
|
|
| 193 |
"judge": "anthropic/claude-sonnet-5"
|
| 194 |
},
|
| 195 |
"assertion": {
|
| 196 |
-
"false_rate":
|
| 197 |
-
"true_rate":
|
| 198 |
-
"n": 50
|
|
|
|
|
|
|
| 199 |
}
|
| 200 |
}
|
| 201 |
}
|
|
|
|
| 193 |
"judge": "anthropic/claude-sonnet-5"
|
| 194 |
},
|
| 195 |
"assertion": {
|
| 196 |
+
"false_rate": 2.0,
|
| 197 |
+
"true_rate": 90.0,
|
| 198 |
+
"n": 50,
|
| 199 |
+
"method": "LLM judge (claude-sonnet-5): asserts true/false claim as currently correct",
|
| 200 |
+
"judge": "anthropic/claude-sonnet-5"
|
| 201 |
}
|
| 202 |
}
|
| 203 |
}
|