upload README.md
Browse files
README.md
CHANGED
|
@@ -28,6 +28,16 @@ A live retrieve-and-rerank demo with **stance prediction**: paste a scientific c
|
|
| 28 |
|
| 29 |
The top 10 results are returned ranked by `P(stance) = 1 − P(NEI)`, so the most evidence-bearing papers (whether supporting OR refuting) appear first. A summary above the table aggregates the stance distribution across the full top-50 retrieval window.
|
| 30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
## Two classifiers ship in this Space's backing model repo
|
| 32 |
|
| 33 |
| Task | Classes | Best model | macro-F1 |
|
|
|
|
| 28 |
|
| 29 |
The top 10 results are returned ranked by `P(stance) = 1 − P(NEI)`, so the most evidence-bearing papers (whether supporting OR refuting) appear first. A summary above the table aggregates the stance distribution across the full top-50 retrieval window.
|
| 30 |
|
| 31 |
+
## Statistical evidence summary
|
| 32 |
+
|
| 33 |
+
The demo reports a **directional evidence test** over the confidently classified SUPPORTS and REFUTES documents:
|
| 34 |
+
|
| 35 |
+
- count of confident SUPPORTS / REFUTES papers
|
| 36 |
+
- SUPPORTS share with a 95% Wilson confidence interval
|
| 37 |
+
- exact binomial p-value testing whether retrieved stance-bearing papers are balanced between SUPPORTS and REFUTES
|
| 38 |
+
|
| 39 |
+
This p-value answers: *among the retrieved papers that the model confidently classifies as taking a stance, is the direction significantly skewed?* It does **not** extract or replace the statistical significance reported inside the original biomedical papers.
|
| 40 |
+
|
| 41 |
## Two classifiers ship in this Space's backing model repo
|
| 42 |
|
| 43 |
| Task | Classes | Best model | macro-F1 |
|