[NOTICKET] rrf merge now at router level

fix: fix dedup logic

[KM-533] now also retrieves table level chunk

[KM-533] add table level schema, differentiate with chunk level. expand retrieval result with FK exploration

[KM-455][document] decided methods retrieval for document

[KM-515][document] Make Query for Tabular Type (XLSX & CSV)

[NOTICKET] add pyarrow

[NOTICKET] add pyarrow

[NOTICKET]untrack software/ folder (ignored via .gitignore)

[KM-507] now only uses hybrid (cosine and bm25)

[NOTICKET] fix query now use orchestrator msg, rework db pipeline replace ingestion logic

[KM-516][KM-517] add new feature; ai can now see table & column names that have fk relationship with retrieved result

[KM-520] Integrate db query executor pipeline with existing rag retrieve pipeline

[NOTICKET] fix-revert string change

[NOTICKET] db_executor: CTE DML check now walks entire AST root, schema: cast instead of string interpolation

[NOTICKET] fix delete, now can filter by user

[KM-512] connect query executor to user question. add logging for db_executor

add to gitignore

[KM-513][document] add convert to parquet if type file is XLSX and CSV

Merge branch 'dev_new' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[NOTICKET] update .gitignore

[NOTICKET] rename file name, updated after uv sync

[KM-512] add Pydantic model the LLM fills via function calling in sql_query, and add same signature for db and tabular

[NOTICKET] minor fix in chat.py, add package for query, change schema used to hybrid (cosine+bm25)

[KM-512] create folder for querying from bd/tabular docs

[KM-507] add different methods, now using dense cosine

add to gitignore

[NOTICKET] add db_client for querying

[KM-507] add changes to methods

[KM-507] add multiple retrieval method to compare (dense, mmr, bm25, hybrid)

[NOTICKET] fixed multiple sources

[NOTICKET] fix single source to multiple sources

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[KM-438][KM-439] framework for knowledge retriever

[NOTICKET][document]: make a clean output to status error unsupported file type

[NO TICKET][document]: delete vector embedding on table langchain_pg_embedding if user delete document on knowledge

[NO TICKET][document]: add updated_at on metadata

[NOTICKET] add updated_at field for metadata & delete old embedding before appending

[NOTICKET] add total token logging (#9)

[NOTICKET] add total token logging

Merge branch 'dev_new' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

test-pr (#8)

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[KM-496] [DED][AI] Fix Response data structure for field sources (db flow)

[NOTICKET] [document]: add doctypes endpoint (#7)

[NOTICKET]: add to gitignore

[NOTICKET]: add comments to flag that file type lists must stay in sync

[NOTICKET]: add doctypes endpoint & 10MB file size limit