added type hints

new api = retrieve chunks + some more text fixing

new api = retrieve chunks + some more text fixing

max chunk size= 4000 + max row = 5

max chunk size= 4000 + max row = 5

max chunk size= 4000 + max row = 5

max chunk size= 4000 + max row = 5

topk query = 70 + 0.55 sim cut off + table chunk size= 4000

topk query = 50 + 0.55 sim cut off + table chunk size= 2500

topk query = 50 + 0.55 sim cut off + table chunk size= 2500

new dedublication

new documents prep

new documents prep

new documents prep

new documents prep

eski holat with utils simplified

eski holat with utils

eski holat with utils

api key added

api key added

api key added

eski holat

eski holat

eski holat

new function for should keep table whole for some files

max rows = 20, 150 + 150 bm25

chunk size = 2048 + rows=15

chunk size = 2048 + rows=15

chunk size = 2048 + rows=15

chunk size = 2048 + rows=15

chunk size = 2048 + rows=15

chunk size = 2048 + rows=15

chunk size = 1500

max rows = 20, 100 + 100 bm25

top k reranker = 20, max rows = 10, max chars= 2000 + new deduplication

top k reranker = 20, max rows = 10, max chars= 4000 + new deduplication

top k reranker = 25, max rows = 5, max chars= 4000

adaptive table chunking

doc id problem fixed

doc id problem fixed

new doc id filter + 100 + 100 retrieval

Much lower reranking threshold (-0.5 instead of 0.1) + detailed score logging

Much lower reranking threshold (-0.5 instead of 0.1) + detailed score logging

Much lower reranking threshold (-0.5 instead of 0.1) + detailed score logging

removed normalization doc id

removed normalization doc id

index retriever = 100 + 100

index retriever = 100 + 100

max_chars = 1500 + doc id retriever

new keyword score based index retriever + answer question