RAGForge / docs /MIGRATION_1.4.1.md
ArchitSharma's picture
Stabilize RAGForge v1.4.1 evaluation quotas and runtime API view
bb5d2bb
|
Raw
History Blame Contribute Delete
1.89 kB

Migration to v1.4.1

v1.4.1 is a stabilization patch over v1.4. It does not change the core retrieval architecture or demo corpus.

Fixes

  • fixes Architecture + API -> Refresh runtime view, which could raise NameError: name 'f' is not defined because the generated curl-example string was truncated in the v1.4 packaged UI source;
  • changes visible evaluation wording from scorecard to score card;
  • adds quota-safe Gemini evaluation pacing, defaulting to 12 RPM;
  • records recent interactive requests in the same process-local per-key/per-model request ledger used by evaluation pacing;
  • honors surfaced Gemini 429 retry guidance before bounded retries;
  • prevents structured-output fallback code from immediately issuing another API request after transient 429/5xx failures;
  • reports deliberate pacing wait separately from service/pipeline latency;
  • reduces Text2SQL evaluation from roughly three Gemini calls per case to one by separating planner-routing evaluation from SQL generation/execution evaluation;
  • reduces Deep judge calls to a representative labeled benchmark subset.

Recommended free-tier setting

Use the active RPM displayed for your API project in Google AI Studio as the source of truth. The UI defaults to 12 RPM, which leaves headroom when a project currently has a 15 RPM limit. Lower the target if the same API key is also receiving traffic outside this Space.

Upgrade

Apply the v1.4.1 patch over a clean v1.4 tree, then commit normally. The patch does not contain the bundled NIST PDF.

After deployment:

  1. run Quick with quota-safe pacing enabled;
  2. run Standard and confirm request/pacing telemetry appears in the score card;
  3. run Deep immediately afterward to test rolling-window continuity;
  4. open Architecture + API and click Refresh runtime view;
  5. confirm the runtime JSON and curl examples populate without a traceback.