RAGForge / docs /MIGRATION_1.5.md
ArchitSharma's picture
Upgrade RAGForge to v1.5 adaptive retrieval and evaluation history
27716f7
|
Raw
History Blame Contribute Delete
1.52 kB
# Migration to v1.5
v1.5 is an evidence-driven optimization/evaluation release over v1.4.1. It does not change the bundled demo corpus or dependency pins.
## Main changes
- per-workspace saved Quick/Standard/Deep evaluation history;
- instant saved-run switching and side-by-side comparison;
- optional zero-call reuse of an already compatible evaluation;
- incremental Deep evaluation that reuses a compatible Standard deterministic baseline;
- typed scalar Text2SQL benchmark checks;
- adaptive cross-encoder reranking based on profile/task/corpus complexity;
- deterministic evidence-aware citation repair with no extra model call;
- table planner examples distinguishing direct lookups from cross-row aggregation;
- saved-evaluation REST endpoints and updated Architecture + API tab.
## Deployment
Apply the v1.5 patch over a clean v1.4.1 project and commit normally. The patch does not contain the bundled NIST PDF, so the existing Hugging Face Xet/LFS setup is unchanged.
After deployment:
1. index the demo corpus;
2. run Quick, then Standard;
3. leave `Reuse saved evaluation` enabled and run Deep;
4. confirm Deep reports `reused_standard_baseline: true` and only the sampled judge requests;
5. switch `View saved evaluation` among Quick/Standard/Deep and inspect `Compare saved runs`;
6. verify the Text2SQL boolean case reports `match_method=typed_scalar`, `observed_value=true`, `expected_value=true`;
7. ask a normal focused document question and inspect `reranker_used`/`reranker_reason` in the trace.