Commit History
-
merge dev_new to main
Rifqi Hafizuddin9257b7b
-
fix sorted ranking so model uses overall sorted retrieved chunks
Rifqi Hafizuddin3e7924d -
make executors self-contained, remove redundant pre-filter
73b7fe3 -
NOTICKET] add dev dependency group and update gitignore
36ffff4 -
[NOTICKET][doc] correct metadata key path in _format_context
16ab916 -
[NOTICKET][doc] remove column filter and fallback cap for full-schema approach
959b1b0 -
[NOTICKET][doc] add sheet-level leg and RRF voting for tabular retrieval
5f86993
-
fix: minor returned type if sql writes limit yang melebihi batas
Rifqi Hafizuddinb4df8b1 -
[NOTICKET][db] add sheet-level retrieval and focus LLM schema context to retrieved columns
a205d0c -
[NOTICKET] pass orchestrator search_query to sql executor for multi-turn context
Rifqi Hafizuddin +1: Claude Sonnet 4.6Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>23eeb2d -
[NOTICKET][doc] validate embedding vector for NaN/Infinity in manhattan retriever
2167a5b
-
fix fallback to fresh retrieval on corrupted Redis cache
9cb950f -
[NOTICKET][doc] add guard if filename None
b7fbaeb -
[NOTICKET] now retrieve db tables first, then get column from the obtained tables. reduce k to 5
Rifqi Hafizuddinbb29492 -
[NOTICKET][doc] fix aggregate count operation when value_col is not specified
00aa61d
-
fix: 5 bug fixes on tabular executor
- top_n: remove fallback to sort_col (must use value_col only) - coercion warning: log NaN introduced by numeric coercion in filters - source_type filter: restrict tabular results to source_type=document - raw fallback: cap columns to 20 to avoid oversized response - add comment clarifying cross-file JOIN is out of scope for v1 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>a49dc1b -
feat: add sheet-level chunk on CSV/XLSX ingestion
Each tabular file now produces a sheet-level chunk (chunk_level=sheet) alongside per-column chunks, enabling schema-aware retrieval without loading the full Parquet at search time. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>8daf9b5 -
fix: increase K in chat endpoint to 10
Rifqi Hafizuddinb59ef76 -
fix: query executor now use user question as prompt (sebelumnya pakai hasil orchestrator)
Rifqi Hafizuddin0935ede -
[NOTICKET] minor refactoring
Rifqi Hafizuddine4f62b8 -
[NOTICKET] rrf merge now at router level
Rifqi Hafizuddinde32ab0 -
fix: fix dedup logic
Rifqi Hafizuddinc9d3b33 -
[KM-533] now also retrieves table level chunk
Rifqi Hafizuddin4150ba7 -
[KM-533] add table level schema, differentiate with chunk level. expand retrieval result with FK exploration
Rifqi Hafizuddinfc1239a -
Make a query for tabular (XLSX and CSV) (#14)
- [NOTICKET] add software to gitignore (d43ecb180036339cf287e93f1d9116bd6eff9b9d) - [NOTICKET] add pyarrow (e50eadc82e160012e3319267f5bfe084cd9034d4) - [KM-515][document] Make Query for Tabular Type (XLSX & CSV) (695ca0a154a68077c51499ed83b7507b988be065) - [KM-455][document] decided methods retrieval for document (8c9cc79223eb1d96c8622d129219a83a4ba2500b) Co-authored-by: Sofhia Az-Zahra <sofhiaazzhr@users.noreply.huggingface.co>8802920
-
[KM-455][document] decided methods retrieval for document
cf77d20 -
[KM-515][document] Make Query for Tabular Type (XLSX & CSV)
3604994 -
[NOTICKET] add pyarrow
7ff66c9 -
[NOTICKET] add pyarrow
432c1fa -
[NOTICKET]untrack software/ folder (ignored via .gitignore)
0931c10 -
[KM-507] now only uses hybrid (cosine and bm25)
Rifqi Hafizuddin40925b4 -
Merge dev_new to main (improve retriever and add querying) (#13)
- [noticket] add gitignore (c87f27f458854787102eebc110b178c2572ef8a6) - [NOTICKET]: add document pipeline, simplify document API (fb871f3d7db9c5a9c95a012761c4180a432e7e4b) - [NOTICKET]: update folder document_pipelines after pipelines (a4cf97ab3890e35831c0043a1d411c17d84f374b) - [NOTICKET][DB] refactor code to new repo (7f3bb9782bb9b6ace69e6be35377c12757a2f81d) - [KM-441] add mean and median (9b5933420821187e73bb72a896e28d7adf6d6137) - [NOTICKET] new metadata format for cleaner code (6b590d94c398ac4966a0e376f2809aa52c5ba022) - update document (5a69e0eecf80dd807565dbc369374e41450c37fc) - delete duplicate file (3848d7b262745b758069e3ab8089437ced42a45f) - edit document for new pipeline (425e021053c4de65e2598b0f5554b7c1044a904c) - [NOTICKET]: add CSV and XLSX file type (31920c3bc6f9faf9e07095a02fc1faf08adc246e) - [DB] fix/rename db_pipeline.py (d913315c356d741cc7a5a5b1f8e36ba41397f2ab) - [NOTICKET][DB] menyesuaikan format struktur db_pipeline sesuai dengan file lain (e13a9017e0f7fd26ef9b8a…52999bc -
[NOTICKET] fix query now use orchestrator msg, rework db pipeline replace ingestion logic
Rifqi Hafizuddinbe9bbd9
-
[KM-516][KM-517] add new feature; ai can now see table & column names that have fk relationship with retrieved result
Rifqi Hafizuddinf86da27
-
[KM-520] Integrate db query executor pipeline with existing rag retrieve pipeline
Rifqi Hafizuddina25febe -
[NOTICKET] fix-revert string change
Rifqi Hafizuddin110ee34 -
[NOTICKET] db_executor: CTE DML check now walks entire AST root, schema: cast instead of string interpolation
Rifqi Hafizuddinbd2b1d9 -
[NOTICKET] fix delete, now can filter by user
Rifqi Hafizuddinf273db0 -
[KM-512] connect query executor to user question. add logging for db_executor
Rifqi Hafizuddinabc494f -
add to gitignore
Rifqi Hafizuddin1fef470 -
[KM-513][document] add convert to parquet if type file is XLSX and CSV
770f26b -
Merge branch 'dev_new' of https://huggingface.co/spaces/DataEyond/Agentic-Service-Data-Eyond into dev_new
29efec6 -
[NOTICKET] update .gitignore
240251c -
[NOTICKET] rename file name, updated after uv sync
Rifqi Hafizuddin948d6dd -
[KM-512] add Pydantic model the LLM fills via function calling in sql_query, and add same signature for db and tabular
Rifqi Hafizuddin220f59e -
[NOTICKET] minor fix in chat.py, add package for query, change schema used to hybrid (cosine+bm25)
Rifqi Hafizuddin15cd3a7
-
[KM-512] create folder for querying from bd/tabular docs
Rifqi Hafizuddin2c8a3e8 -
[KM-507] add different methods, now using dense cosine
Rifqi Hafizuddin145bca3 -
add to gitignore
Rifqi Hafizuddin83ed744 -
[NOTICKET] add db_client for querying
Rifqi Hafizuddine49db60