[KM-438-439] add retriever feature

[KM-436-437] edit knowledge handler pipeline

[KM 436-439] adjust endpoint for new features

[NOTICKET] edit settings

[NOTICKET] fix query now use orchestrator msg, rework db pipeline replace ingestion logic

[KM-516][KM-517] add new feature; ai can now see table & column names that have fk relationship with retrieved result

[KM-520] Integrate db query executor pipeline with existing rag retrieve pipeline

[NOTICKET] fix-revert string change

[NOTICKET] db_executor: CTE DML check now walks entire AST root, schema: cast instead of string interpolation

[NOTICKET] fix delete, now can filter by user

[KM-512] connect query executor to user question. add logging for db_executor

add to gitignore

[KM-513][document] add convert to parquet if type file is XLSX and CSV

Merge branch 'dev_new' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[NOTICKET] update .gitignore

[NOTICKET] rename file name, updated after uv sync

[KM-512] add Pydantic model the LLM fills via function calling in sql_query, and add same signature for db and tabular

[NOTICKET] minor fix in chat.py, add package for query, change schema used to hybrid (cosine+bm25)

[KM-512] create folder for querying from bd/tabular docs

[KM-507] add different methods, now using dense cosine

add to gitignore

[NOTICKET] add db_client for querying

[KM-507] add changes to methods

[KM-507] add multiple retrieval method to compare (dense, mmr, bm25, hybrid)

[NOTICKET] fixed single source into multiple sources (#12)

[NOTICKET] fixed multiple sources

[NOTICKET] fix single source to multiple sources

[NOTICKET][document] add updated_at on metadata and delete vector embedding if user delete document on knowledge (#11)

[NOTICKET] add updated_at metadata & prevent duplicate while adding new embedding (#10)

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[KM-438][KM-439] framework for knowledge retriever

[NOTICKET][document]: make a clean output to status error unsupported file type

[NO TICKET][document]: delete vector embedding on table langchain_pg_embedding if user delete document on knowledge

[NO TICKET][document]: add updated_at on metadata

[NOTICKET] add updated_at field for metadata & delete old embedding before appending

[NOTICKET] add total token logging (#9)

[NOTICKET] add total token logging

Merge branch 'dev_new' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

test-pr (#8)

Merge branch 'main' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new

[KM-496] [DED][AI] Fix Response data structure for field sources (db flow)

[NOTICKET] [document]: add doctypes endpoint (#7)

[NOTICKET]: add to gitignore

[NOTICKET]: add comments to flag that file type lists must stay in sync

[NOTICKET]: add doctypes endpoint & 10MB file size limit

[NOTICKET][DB] add endpoints for dbtypes (#6)

[NOTICKET][DB] add supported dbtype for frontend

[NOTICKET] add duplicate check for storing database