Hugging Face's logo

Spaces:
MrSimple01
/
RAG_AIEXP_01
Sleeping

App Files Community
MrSimple07 commited on
Commit
634c04c
·
1 Parent(s): 2676cd6

chunk size = 2048 + rows=15

Browse files
Files changed (1) hide show
  1. documents_prep.py +0 -1
documents_prep.py CHANGED
@@ -13,7 +13,6 @@ def chunk_text_documents(documents):
13
  text_splitter = SentenceSplitter(
14
  chunk_size=CHUNK_SIZE,
15
  chunk_overlap=CHUNK_OVERLAP,
16
- metadata_chunk_size=2048 # ADD THIS LINE - match or exceed chunk_size
17
  )
18
 
19
  chunked = []
 
13
  text_splitter = SentenceSplitter(
14
  chunk_size=CHUNK_SIZE,
15
  chunk_overlap=CHUNK_OVERLAP,
 
16
  )
17
 
18
  chunked = []