Hugging Face's logo

Spaces:
MrSimple01
/
RAG_AIEXP_01
Sleeping

App Files Community
RAG_AIEXP_01 / documents_prep.py

Commit History

Much lower reranking threshold (-0.5 instead of 0.1) + detailed score logging
a83db61

MrSimple07 commited on

Much lower reranking threshold (-0.5 instead of 0.1) + detailed score logging
806f3f9

MrSimple07 commited on

removed normalization doc id
ad8e8ec

MrSimple07 commited on

index retriever = 100 + 100
31659d7

MrSimple07 commited on

max_chars = 1500 + doc id retriever
ae5a669

MrSimple07 commited on

chunk size = 1024 + max chars = 1200 + deduplication variant
f79b229

MrSimple07 commited on

chunk size = 1024 + max chars = 1200 + keyword based
26c4970

MrSimple07 commited on

chunk siz = 512, max_chars = 1000
9bad02a

MrSimple07 commited on

chunk siz = 1000, max_chars = 1500
7f19939

MrSimple07 commited on

max chars = 3000 + removed normalize_doc_id
7c138ed

MrSimple07 commited on

max chars = 2000 + removed normalize_doc_id
05822e9

MrSimple07 commited on

max chars = 2000 for tables + new answer_question
7565a55

MrSimple07 commited on

max rows = 10 + new answer_question + reranking
2edec29

MrSimple07 commited on

max rows = 5
359257d

MrSimple07 commited on

content = format_table_content fixed
64543ac

MrSimple07 commited on

simplest version
30be7bf

MrSimple07 commited on

simplest version
f3e59e1

MrSimple07 commited on

simplest version
57e4dbd

MrSimple07 commited on

simplest version
f48820b

MrSimple07 commited on

simplest version
09fe356

MrSimple07 commited on

simplest version
0b6ee4f

MrSimple07 commited on

simplest version
123a5db

MrSimple07 commited on

simplest version
83b921a

MrSimple07 commited on

simplest version
0b34162

MrSimple07 commited on

simplest version
6b0d121

MrSimple07 commited on

simplest version
200954f

MrSimple07 commited on

simplest version
0b28542

MrSimple07 commited on

simplest version
9985d37

MrSimple07 commited on

added sheet_name
afcac41

MrSimple07 commited on

added the load_table_data function
451cdc6

MrSimple07 commited on

added the load_table_data function
f9e7c0c

MrSimple07 commited on

added the load_table_data function
c697463

MrSimple07 commited on

added the load_table_data function
ff92caa

MrSimple07 commited on

new version of rag
abca2ac

MrSimple07 commited on

new version of rag
a85d6bf

MrSimple07 commited on

new documents_prep
9160af0

MrSimple07 commited on

new documents_prep
4775037

MrSimple07 commited on

new documents_prep
a33029f

MrSimple07 commited on

new documents_prep
5fc122f

MrSimple07 commited on

new documents_prep
f0cb4f3

MrSimple07 commited on

a new way with keywords
90e6b4c

MrSimple07 commited on

new way of chunking
f85ad1c

MrSimple07 commited on

added the new chunking and loggings
822ef8c

MrSimple07 commited on

a new chunking with 3 000 size for all types of data
c0bcb11

MrSimple07 commited on

Removed all custom table configurations (CUSTOM_TABLE_CONFIGS)
0067c9d

MrSimple07 commited on

Removed duplicate logs throughout all files
c2a83c1

MrSimple07 commited on

Removed duplicate logs throughout all files
c81fd8c

MrSimple07 commited on

max size 25000 + improved table prep
9ad6501

MrSimple07 commited on

table processing + new version of np104
5884230

MrSimple07 commited on

chunk size = 8192
bf0077f

MrSimple07 commited on