feat(chunking): introduce modular chunking framework

initial chunking pilotcore

report debug 2

report debug

insights and analysis

Add GaugePilot insights and recommendation engine phase 1

refactors

readme update and gaugepilot custom config fix

...

multi query enhancement

tracepilot pipeline config initialization and gaugepilot expsetup frontend fix

uploading routing for benchmarking

benchmark initial backend and frontend

added additional cross encoder models

fixed bm25

tracepilot trace data and reset traces button behavior decoupled between experimental and production modes, added clear all button to clear conversations/chats from docpilot with decoupled behavior

docpilot chat data decoupled between experimental and production mode, selector behavior fixed

assigning re-ranker its own dropdown

AWS deployment using EC2 and dropdown selector initial mapping

experimentation and production mode frontend

initial benchmark and improve query rewriting

query rewriting initial

ingestion and expire time

feat: improve retrieval evaluation and document ingestion

Added multi model selector capability in chat

feat(metadata): add section-title extraction and trace visibility

improve retrieval evaluation semantics and add reranker lineage observability

consensus frontend

indent

Add sigmoid-normalized reranker confidence & margin, compute retrieval consensus

debug

fix(pilotcore): enable Pydantic v2 validate_assignment on RetrievedChunk to prevent silent lineage field mutation drops

Patch the trace serialization / pipeline assembly layer

feat(tracepilot): add retrieval lineage visualization with per-chunk diagnostics, source badges, and pipeline stage breakdown

feat(retrieval): implement end-to-end retrieval score lineage and observability across dense, BM25, RRF, and reranking stages

add cross-encoder reranking and update README

Hybrid merge logic replaced with RRF fusion in runtime.py

migrate faiss retrieval to cosine similarity using IndexFlatIP

reset to remove bm25.pkl

evaluator

evaluation strategy changed

hybridize

init bm25

readme update

file type optimization for hf and ocr support

Increase context injection size

Improve vector store observability and ingestion tracing

k value

Improve RAG chunking and retrieval observability

evaluator recallibration