diff --git "a/logs/app.log" "b/logs/app.log" --- "a/logs/app.log" +++ "b/logs/app.log" @@ -3026,3 +3026,1728 @@ Medicatio... 2025-10-15 17:12:39,212 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 40 2025-10-15 17:12:39,212 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 2025-10-15 17:12:39,212 - AgenticMedicalRAG - INFO - Successfully processed user input: What first-line systemic therapy does ASCO recomme... +2025-10-16 17:10:06,270 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:10:10,577 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:10:10,578 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:10:10,578 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:10:10,579 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:10:28,771 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:10:28,772 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:10:28,772 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:10:28,772 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:10:28,772 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:10:29,263 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:10:29,287 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:10:29,288 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:10:29,622 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:10:29,623 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:10:29,623 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:10:29,623 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:10:29,624 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:10:31,177 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:10:31,177 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:10:31,178 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 17:11:08,843 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:11:09,688 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:11:09,689 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:11:09,689 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:11:09,690 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:11:17,354 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:11:17,354 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:11:17,354 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:11:17,355 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:11:17,355 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:11:17,472 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:11:17,500 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:11:17,501 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:11:17,934 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:11:17,934 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:11:17,935 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:11:17,935 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:11:17,935 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:11:19,229 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:11:19,229 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:11:19,229 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 17:12:40,772 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:12:42,010 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:12:42,011 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:12:42,012 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:12:42,012 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:12:50,421 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:12:50,422 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:12:50,422 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:12:50,422 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:12:50,423 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:12:50,545 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:12:50,573 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:12:50,573 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:12:50,991 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:12:50,992 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:12:50,992 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:12:50,992 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:12:50,993 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:12:52,269 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:12:52,269 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:12:52,270 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 17:15:55,620 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): hi... +2025-10-16 17:15:58,408 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 17:15:58,408 - AgenticMedicalRAG - INFO - Skipping validation: insufficient context +2025-10-16 17:15:58,409 - AgenticMedicalRAG - INFO - Successfully processed user input: hi... +2025-10-16 17:17:12,749 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:17:13,561 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:17:13,562 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:17:13,562 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:17:13,562 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:17:19,336 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:17:19,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:17:19,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:17:19,338 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:17:19,338 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:17:19,434 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:17:19,457 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:17:19,458 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:17:19,883 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:17:19,884 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:17:19,885 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:17:19,885 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:17:19,885 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:17:21,178 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:17:21,179 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:17:21,179 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 17:21:12,873 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:21:13,855 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:21:13,856 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:21:13,856 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:21:13,856 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:21:20,064 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:21:20,065 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:21:20,065 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:21:20,065 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:21:20,066 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:21:20,137 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:21:20,155 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:21:20,156 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:21:20,419 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:21:20,419 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:21:20,420 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:21:20,420 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:21:20,420 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:21:21,314 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:21:21,314 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:21:21,314 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 17:22:14,161 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 17:22:15,516 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 17:22:15,517 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 17:22:15,518 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 17:22:15,518 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 17:22:24,577 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 17:22:24,577 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 17:22:24,578 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 17:22:24,578 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 17:22:24,579 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 17:22:24,689 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 17:22:24,720 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 17:22:24,720 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 17:22:25,169 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 17:22:25,170 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 17:22:25,170 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 17:22:25,170 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (95%) +2025-10-16 17:22:25,170 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 17:22:26,668 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 17:22:26,669 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 17:22:26,669 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 18:09:29,667 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 18:09:58,243 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:01,872 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:04,565 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:07,451 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:10,361 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:13,783 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:17,385 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:20,918 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 18:10:23,928 - AgenticMedicalRAG - INFO - Loaded semantic similarity model: all-MiniLM-L6-v2 +2025-10-16 21:02:25,618 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:02:28,159 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:02:28,161 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:02:28,161 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:02:28,162 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:02:37,592 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:02:37,592 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:02:37,593 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:02:37,593 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:02:37,593 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:02:38,190 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:02:38,206 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:02:38,207 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:02:38,596 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:02:38,597 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:02:38,597 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:02:38,598 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:02:43,863 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:02:43,863 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:02:43,864 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:02:43,864 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:02:45,485 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:02:45,486 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:02:45,486 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:03:59,429 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the recommended first-line treatment for a... +2025-10-16 21:04:03,298 - AgenticMedicalRAG - INFO - Hybrid search returned 17 unique documents (query expansion: True) +2025-10-16 21:04:03,299 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:04:03,309 - AgenticMedicalRAG - ERROR - Unexpected error in run_agent_streaming: name 'logger' is not defined +2025-10-16 21:04:03,339 - AgenticMedicalRAG - ERROR - Traceback: Traceback (most recent call last): + File "d:\Work\backend\core\tools.py", line 201, in medical_guidelines_knowledge_tool + logger.info(f"Retrieved {len(docs)} documents, enriched {min(5, len(docs))} with surrounding context") + ^^^^^^ +NameError: name 'logger' is not defined + +During handling of the above exception, another exception occurred: + +Traceback (most recent call last): + File "d:\Work\backend\core\agent.py", line 424, in run_agent_streaming + response = await task + ^^^^^^^^^^ + File "C:\Program Files\Python313\Lib\concurrent\futures\thread.py", line 59, in run + result = self.fn(*self.args, **self.kwargs) + File "d:\Work\backend\core\agent.py", line 394, in run_sync + return get_agent_executor().invoke( + ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ + { + ^ + ...<3 lines>... + config={"callbacks": [streaming_handler]}, + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + ) + ^ + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain\chains\base.py", line 165, in invoke + self._call(inputs, run_manager=run_manager) + ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain\agents\agent.py", line 1625, in _call + next_step_output = self._take_next_step( + name_to_tool_map, + ...<3 lines>... + run_manager=run_manager, + ) + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain\agents\agent.py", line 1325, in _take_next_step + list( + ~~~~^ + self._iter_next_step( + ^^^^^^^^^^^^^^^^^^^^^ + ...<5 lines>... + ), + ^^ + ), + ^ + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain\agents\agent.py", line 1408, in _iter_next_step + yield self._perform_agent_action( + ~~~~~~~~~~~~~~~~~~~~~~~~~~^ + name_to_tool_map, + ^^^^^^^^^^^^^^^^^ + ...<2 lines>... + run_manager, + ^^^^^^^^^^^^ + ) + ^ + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain\agents\agent.py", line 1433, in _perform_agent_action + observation = tool.run( + agent_action.tool_input, + ...<3 lines>... + **tool_run_kwargs, + ) + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain_core\tools\base.py", line 892, in run + raise error_to_raise + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain_core\tools\base.py", line 861, in run + response = context.run(self._run, *tool_args, **tool_kwargs) + File "C:\Users\moaze\AppData\Roaming\Python\Python313\site-packages\langchain_core\tools\structured.py", line 103, in _run + return self.func(*args, **kwargs) + ~~~~~~~~~^^^^^^^^^^^^^^^^^ + File "d:\Work\backend\core\tools.py", line 221, in medical_guidelines_knowledge_tool + logger.error(f"Retrieval error: {str(e)}") + ^^^^^^ +NameError: name 'logger' is not defined + +2025-10-16 21:04:46,568 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:04:47,568 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:04:47,892 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:04:47,893 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:04:47,893 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:04:47,894 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:04:56,312 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:04:56,313 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:04:56,313 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:04:56,313 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:04:56,314 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:04:56,420 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:04:56,446 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:04:56,447 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:04:56,830 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:04:56,831 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:04:56,831 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:04:56,831 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:05:02,070 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:05:02,070 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:05:02,071 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:05:02,071 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:05:03,382 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:05:03,382 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:05:03,383 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:05:47,486 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the recommended first-line treatment for a... +2025-10-16 21:05:50,582 - AgenticMedicalRAG - INFO - Hybrid search returned 17 unique documents (query expansion: True) +2025-10-16 21:05:50,583 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:05:50,583 - AgenticMedicalRAG - INFO - Retrieved 17 documents, enriched 5 with surrounding context +2025-10-16 21:06:08,561 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 21:06:09,422 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-16 21:06:09,422 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-16 21:06:10,838 - AgenticMedicalRAG - INFO - Starting validation for interaction 48 +2025-10-16 21:06:26,244 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 48 +2025-10-16 21:06:31,463 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-16 21:06:31,465 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 48 +2025-10-16 21:06:31,466 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 48 +2025-10-16 21:06:31,466 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-16 21:06:31,466 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the recommended first-line treatment for a... +2025-10-16 21:16:15,762 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-16 21:16:29,192 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 21:16:30,128 - AgenticMedicalRAG - INFO - Starting validation for interaction 49 +2025-10-16 21:16:40,854 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 49 +2025-10-16 21:16:45,399 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-16 21:16:45,400 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 49 +2025-10-16 21:16:45,401 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 49 +2025-10-16 21:16:45,401 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-16 21:16:45,401 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-16 21:20:52,310 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:20:53,490 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:20:53,894 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:20:53,895 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:20:53,896 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:20:53,897 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:21:03,255 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:21:03,255 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:21:03,256 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:21:03,256 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:21:03,256 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:21:03,334 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:21:03,355 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:21:03,356 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:21:03,741 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:21:03,741 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:21:03,741 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:21:03,742 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:21:09,447 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:21:09,448 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:21:09,448 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:21:09,448 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:21:10,929 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:21:10,929 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:21:10,930 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:21:34,612 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:21:35,666 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:21:36,053 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:21:36,054 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:21:36,055 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:21:36,056 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:21:45,346 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:21:45,346 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:21:45,346 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:21:45,347 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:21:45,347 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:21:45,434 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:21:45,457 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:21:45,458 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:21:45,843 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:21:45,844 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:21:45,844 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:21:45,844 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:22:04,350 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:22:05,320 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:22:05,681 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:22:05,682 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:22:05,683 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:22:05,683 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:22:14,695 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:22:14,696 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:22:14,697 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:22:14,697 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:22:14,697 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:22:14,785 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:22:14,811 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:22:14,811 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:22:15,240 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:22:15,241 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:22:15,241 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:22:15,241 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:22:21,515 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:22:21,516 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:22:21,516 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:22:21,516 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:22:44,361 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:22:45,427 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:22:45,831 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:22:45,832 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:22:45,833 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:22:45,833 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:22:54,565 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:22:54,565 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:22:54,566 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:22:54,566 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:22:54,567 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:22:54,646 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:22:54,667 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:22:54,667 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:22:55,041 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:22:55,042 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:22:55,042 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:22:55,042 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:23:00,804 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:23:00,805 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:23:00,805 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:23:00,805 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:23:02,320 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:23:02,321 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:23:02,321 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:27:19,098 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:27:20,093 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:27:20,434 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:27:20,436 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:27:20,436 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:27:20,437 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:27:28,632 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:27:28,633 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:27:28,633 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:27:28,633 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:27:28,633 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:27:28,748 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:27:28,776 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:27:28,776 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:27:29,158 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:27:29,160 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:27:29,160 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:27:29,160 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:27:34,135 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:27:34,136 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:27:34,137 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:27:34,137 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:27:35,578 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:27:35,578 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:27:35,579 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:27:55,371 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-16 21:28:05,218 - AgenticMedicalRAG - INFO - ✅ Response citations validated successfully +2025-10-16 21:28:05,218 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 21:28:05,219 - AgenticMedicalRAG - INFO - Skipping validation: insufficient context +2025-10-16 21:28:05,220 - AgenticMedicalRAG - ERROR - Unexpected error in run_agent_streaming: 'ConversationTracker' object has no attribute 'add_turn' +2025-10-16 21:28:05,221 - AgenticMedicalRAG - ERROR - Traceback: Traceback (most recent call last): + File "d:\Work\backend\core\agent.py", line 535, in run_agent_streaming + conversation_tracker.add_turn(user_input, base_response) + ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ +AttributeError: 'ConversationTracker' object has no attribute 'add_turn' + +2025-10-16 21:31:36,429 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the recommended first-line treatment for a... +2025-10-16 21:31:39,274 - AgenticMedicalRAG - INFO - Hybrid search returned 16 unique documents (query expansion: True) +2025-10-16 21:31:39,275 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:31:39,276 - AgenticMedicalRAG - INFO - Retrieved 16 documents, enriched 5 with surrounding context +2025-10-16 21:31:40,248 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:31:42,250 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): What is the recommended first-line treatment for a... +2025-10-16 21:31:45,888 - AgenticMedicalRAG - INFO - Hybrid search returned 16 unique documents (query expansion: True) +2025-10-16 21:31:45,889 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:31:45,890 - AgenticMedicalRAG - INFO - Retrieved 16 documents, enriched 5 with surrounding context +2025-10-16 21:31:46,221 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:31:48,223 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): What is the recommended first-line treatment for a... +2025-10-16 21:31:51,160 - AgenticMedicalRAG - INFO - Hybrid search returned 17 unique documents (query expansion: True) +2025-10-16 21:31:51,161 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:31:51,161 - AgenticMedicalRAG - INFO - Retrieved 17 documents, enriched 5 with surrounding context +2025-10-16 21:31:51,675 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:31:53,677 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): What is the recommended first-line treatment for a... +2025-10-16 21:31:55,140 - AgenticMedicalRAG - INFO - Hybrid search returned 17 unique documents (query expansion: True) +2025-10-16 21:31:55,141 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:31:55,142 - AgenticMedicalRAG - INFO - Retrieved 17 documents, enriched 5 with surrounding context +2025-10-16 21:31:55,586 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:33:19,865 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:33:20,871 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:33:21,215 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:33:21,218 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:33:21,218 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:33:21,219 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:33:29,337 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:33:29,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:33:29,338 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:33:29,338 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:33:29,338 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:33:29,435 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:33:29,457 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:33:29,457 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:33:29,866 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:33:29,866 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:33:29,867 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:33:29,867 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:33:35,039 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:33:35,040 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:33:35,040 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:33:35,040 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:33:36,378 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:33:36,378 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:33:36,379 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:34:14,829 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-16 21:34:25,932 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 21:34:25,933 - AgenticMedicalRAG - INFO - Skipping validation: insufficient context +2025-10-16 21:34:25,933 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-16 21:36:55,043 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:36:56,048 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:36:56,461 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:36:56,463 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:36:56,463 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:36:56,464 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:37:09,328 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:37:10,328 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:37:10,676 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:37:10,677 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:37:10,678 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:37:10,679 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:37:29,979 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:37:31,168 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:37:31,596 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:37:31,597 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:37:31,598 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:37:31,599 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:37:41,982 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:37:41,983 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:37:41,983 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:37:41,983 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:37:41,983 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:37:42,067 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:37:42,087 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:37:42,087 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:37:42,409 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:37:42,409 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:37:42,410 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:37:42,410 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:37:47,550 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:37:47,551 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:37:47,552 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:37:47,552 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:37:48,841 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:37:48,842 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:37:48,842 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:38:55,670 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:38:56,639 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:38:57,003 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:38:57,004 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:38:57,004 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:38:57,005 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:39:05,482 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:39:05,483 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:39:05,483 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:39:05,483 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:39:05,483 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:39:05,576 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:39:05,599 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:39:05,600 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:39:05,946 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:39:05,949 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:39:05,949 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:39:05,949 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:39:11,360 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:39:11,360 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:39:11,360 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:39:11,361 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:39:12,929 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:39:12,929 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:39:12,929 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:40:54,436 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-16 21:40:57,562 - AgenticMedicalRAG - INFO - Hybrid search returned 27 unique documents (query expansion: True) +2025-10-16 21:40:57,564 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:40:57,564 - AgenticMedicalRAG - INFO - Retrieved 27 documents, enriched 5 with surrounding context +2025-10-16 21:40:57,941 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:40:59,943 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): Do you know what is a driver?... +2025-10-16 21:41:01,156 - AgenticMedicalRAG - INFO - Hybrid search returned 27 unique documents (query expansion: True) +2025-10-16 21:41:01,157 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:41:01,157 - AgenticMedicalRAG - INFO - Retrieved 27 documents, enriched 5 with surrounding context +2025-10-16 21:41:01,418 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:41:03,419 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): Do you know what is a driver?... +2025-10-16 21:41:04,484 - AgenticMedicalRAG - INFO - Hybrid search returned 27 unique documents (query expansion: True) +2025-10-16 21:41:04,485 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:41:04,486 - AgenticMedicalRAG - INFO - Retrieved 27 documents, enriched 5 with surrounding context +2025-10-16 21:41:05,064 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:41:07,065 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): Do you know what is a driver?... +2025-10-16 21:41:08,619 - AgenticMedicalRAG - INFO - Hybrid search returned 27 unique documents (query expansion: True) +2025-10-16 21:41:08,620 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:41:08,621 - AgenticMedicalRAG - INFO - Retrieved 27 documents, enriched 5 with surrounding context +2025-10-16 21:41:08,904 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-16 21:43:24,613 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-16 21:43:25,598 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-16 21:43:25,912 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-16 21:43:25,913 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-16 21:43:25,914 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-16 21:43:25,914 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-16 21:43:34,252 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-16 21:43:34,253 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-16 21:43:34,253 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-16 21:43:34,253 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-16 21:43:34,253 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-16 21:43:34,403 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-16 21:43:34,432 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-16 21:43:34,433 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-16 21:43:34,857 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-16 21:43:34,857 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-16 21:43:34,857 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-16 21:43:34,858 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-16 21:43:40,204 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-16 21:43:40,205 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-16 21:43:40,205 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-16 21:43:40,206 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-16 21:43:41,623 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-16 21:43:41,624 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-16 21:43:41,624 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-16 21:55:11,433 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-16 21:55:16,567 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-16 21:55:16,568 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-16 21:55:16,569 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-16 21:55:24,143 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-16 21:55:24,952 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-16 21:55:24,952 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-16 21:55:26,475 - AgenticMedicalRAG - INFO - Starting validation for interaction 50 +2025-10-16 21:55:36,176 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 50 +2025-10-16 21:55:41,988 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-16 21:55:41,991 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 50 +2025-10-16 21:55:41,992 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 50 +2025-10-16 21:55:41,992 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-16 21:55:41,992 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 03:02:37,271 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:02:42,301 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:02:43,037 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:02:43,039 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:02:43,040 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:02:43,041 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:03:06,394 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:03:06,394 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:03:06,395 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:03:06,395 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:03:06,395 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:03:07,061 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:03:07,110 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:03:07,111 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:03:07,464 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:03:07,465 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:03:07,465 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:03:07,466 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:03:12,122 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:03:12,123 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:03:12,123 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:03:12,124 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:03:13,681 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:03:13,682 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:03:13,682 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:09:18,950 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 03:09:22,160 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:09:22,161 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:09:22,162 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-18 03:09:33,572 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 03:09:34,476 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 03:09:34,477 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 03:09:36,000 - AgenticMedicalRAG - INFO - Starting validation for interaction 51 +2025-10-18 03:09:49,775 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 51 +2025-10-18 03:09:55,718 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 03:09:55,720 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 51 +2025-10-18 03:09:55,720 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 51 +2025-10-18 03:09:55,721 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-18 03:09:55,721 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 03:17:17,498 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:17:18,475 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:17:18,814 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:17:18,815 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:17:18,816 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:17:18,816 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:17:35,114 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:17:36,046 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:17:36,366 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:17:36,367 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:17:36,368 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:17:36,369 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:17:47,625 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:17:48,650 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:17:48,973 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:17:48,974 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:17:48,975 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:17:48,976 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:18:01,178 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:18:02,253 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:18:02,627 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:18:02,628 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:18:02,629 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:18:02,630 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:18:11,612 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:18:11,613 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:18:11,613 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:18:11,614 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:18:11,614 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:18:11,713 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:18:11,736 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:18:11,736 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:18:12,101 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:18:12,102 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:18:12,102 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:18:12,102 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:18:18,166 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:18:18,167 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:18:18,167 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:18:18,168 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:18:19,441 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:18:19,442 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:18:19,442 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:19:18,025 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:19:18,773 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:19:19,031 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:19:19,032 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:19:19,032 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:19:19,033 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:19:27,544 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:19:27,544 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:19:27,545 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:19:27,545 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:19:27,546 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:19:27,659 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:19:27,689 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:19:27,689 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:19:28,173 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:19:28,174 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:19:28,174 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:19:28,174 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:19:34,178 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:19:34,179 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:19:34,179 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:19:34,179 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:19:35,659 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:19:35,659 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:19:35,659 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:37:43,007 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:37:43,923 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:37:44,238 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:37:44,239 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:37:44,239 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:37:44,240 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:37:53,192 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:37:53,193 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:37:53,193 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:37:53,193 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:37:53,194 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:37:53,327 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:37:53,350 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:37:53,350 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:37:53,699 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:37:53,699 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:37:53,700 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:37:53,700 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:37:58,984 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:37:58,985 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:37:58,985 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:37:58,986 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:38:00,337 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:38:00,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:38:00,337 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:41:27,590 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 03:41:29,653 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:41:29,654 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:41:29,654 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 0 with surrounding context +2025-10-18 03:41:36,188 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 03:41:37,027 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 03:41:37,028 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 03:41:38,473 - AgenticMedicalRAG - INFO - Starting validation for interaction 52 +2025-10-18 03:41:49,281 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 52 +2025-10-18 03:41:55,537 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 03:41:55,539 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 52 +2025-10-18 03:41:55,539 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 52 +2025-10-18 03:41:55,539 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-18 03:41:55,540 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 03:46:27,340 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:46:28,351 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:46:28,721 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:46:28,723 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:46:28,724 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:46:28,724 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:46:40,844 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:46:41,867 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:46:42,208 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:46:42,209 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:46:42,210 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:46:42,210 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:46:51,005 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:46:51,005 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:46:51,006 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:46:51,006 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:46:51,006 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:46:51,091 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:46:51,114 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:46:51,115 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:46:51,520 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:46:51,521 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:46:51,522 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:46:51,522 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:46:57,448 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:46:57,449 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:46:57,449 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:46:57,449 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:46:58,943 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:46:58,943 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:46:58,943 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:47:46,385 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:47:47,463 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:47:47,851 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:47:47,853 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:47:47,853 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:47:47,854 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:47:56,736 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:47:56,737 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:47:56,737 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:47:56,737 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:47:56,737 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:47:56,822 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:47:56,846 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:47:56,846 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:47:57,272 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:47:57,273 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:47:57,273 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:47:57,274 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:48:03,504 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:48:03,504 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:48:03,505 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:48:03,505 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:48:04,953 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:48:04,953 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:48:04,954 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:57:49,989 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 03:57:50,915 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 03:57:51,244 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 03:57:51,245 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 03:57:51,245 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 03:57:51,245 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 03:57:59,058 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 03:57:59,058 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 03:57:59,058 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 03:57:59,058 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 03:57:59,059 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 03:57:59,145 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 03:57:59,169 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 03:57:59,169 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 03:57:59,533 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 03:57:59,534 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 03:57:59,534 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 03:57:59,535 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 03:58:04,812 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 03:58:04,812 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 03:58:04,813 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 03:58:04,813 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 03:58:06,211 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 03:58:06,211 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 03:58:06,212 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 03:58:53,941 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 03:58:56,215 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:58:56,352 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:58:56,353 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-18 03:58:56,353 - AgenticMedicalRAG - INFO - 📄 Enriched Document 1: jnccn-article-p497.pdf | Primary Page: 27 | Pages Included: [26, 26, 26, 26, 27, 27, 27, 27, 27, 27, 28, 28, 28, 28, 28, 28, 28] +2025-10-18 03:58:56,353 - AgenticMedicalRAG - INFO - 📄 Enriched Document 2: jnccn-article-p249.pdf | Primary Page: 20 | Pages Included: [19, 19, 19, 20, 20, 20, 20, 20, 21, 21, 21, 21, 21] +2025-10-18 03:58:56,354 - AgenticMedicalRAG - INFO - 📄 Enriched Document 3: ESMO NCSLC Pan Asian Oncogene-addicted metastatic.pdf | Primary Page: 1 | Pages Included: [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2] +2025-10-18 03:58:56,354 - AgenticMedicalRAG - INFO - 📄 Enriched Document 4: nscl.pdf | Primary Page: 236 | Pages Included: [235, 235, 235, 235, 235, 235, 236, 236, 236, 236, 236, 237, 237, 237, 237, 237] +2025-10-18 03:58:56,354 - AgenticMedicalRAG - INFO - 📄 Enriched Document 5: NICE NG122.pdf | Primary Page: 0 | Pages Included: [0, 0, 0, 1] +2025-10-18 03:58:57,258 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 03:58:59,259 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): Do you know what is a driver?... +2025-10-18 03:59:00,293 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:59:00,295 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:59:00,295 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-18 03:59:00,296 - AgenticMedicalRAG - INFO - 📄 Enriched Document 1: jnccn-article-p497.pdf | Primary Page: 27 | Pages Included: [26, 26, 26, 26, 27, 27, 27, 27, 27, 27, 28, 28, 28, 28, 28, 28, 28] +2025-10-18 03:59:00,296 - AgenticMedicalRAG - INFO - 📄 Enriched Document 2: jnccn-article-p249.pdf | Primary Page: 20 | Pages Included: [19, 19, 19, 20, 20, 20, 20, 20, 21, 21, 21, 21, 21] +2025-10-18 03:59:00,296 - AgenticMedicalRAG - INFO - 📄 Enriched Document 3: ESMO NCSLC Pan Asian Oncogene-addicted metastatic.pdf | Primary Page: 1 | Pages Included: [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2] +2025-10-18 03:59:00,296 - AgenticMedicalRAG - INFO - 📄 Enriched Document 4: nscl.pdf | Primary Page: 236 | Pages Included: [235, 235, 235, 235, 235, 235, 236, 236, 236, 236, 236, 237, 237, 237, 237, 237] +2025-10-18 03:59:00,297 - AgenticMedicalRAG - INFO - 📄 Enriched Document 5: NICE NG122.pdf | Primary Page: 0 | Pages Included: [0, 0, 0, 1] +2025-10-18 03:59:00,681 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 03:59:02,682 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): Do you know what is a driver?... +2025-10-18 03:59:03,769 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:59:03,771 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:59:03,771 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-18 03:59:03,771 - AgenticMedicalRAG - INFO - 📄 Enriched Document 1: jnccn-article-p497.pdf | Primary Page: 27 | Pages Included: [26, 26, 26, 26, 27, 27, 27, 27, 27, 27, 28, 28, 28, 28, 28, 28, 28] +2025-10-18 03:59:03,771 - AgenticMedicalRAG - INFO - 📄 Enriched Document 2: jnccn-article-p249.pdf | Primary Page: 20 | Pages Included: [19, 19, 19, 20, 20, 20, 20, 20, 21, 21, 21, 21, 21] +2025-10-18 03:59:03,772 - AgenticMedicalRAG - INFO - 📄 Enriched Document 3: ESMO NCSLC Pan Asian Oncogene-addicted metastatic.pdf | Primary Page: 1 | Pages Included: [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2] +2025-10-18 03:59:03,772 - AgenticMedicalRAG - INFO - 📄 Enriched Document 4: nscl.pdf | Primary Page: 236 | Pages Included: [235, 235, 235, 235, 235, 235, 236, 236, 236, 236, 236, 237, 237, 237, 237, 237] +2025-10-18 03:59:03,772 - AgenticMedicalRAG - INFO - 📄 Enriched Document 5: NICE NG122.pdf | Primary Page: 0 | Pages Included: [0, 0, 0, 1] +2025-10-18 03:59:04,309 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 03:59:06,311 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): Do you know what is a driver?... +2025-10-18 03:59:07,314 - AgenticMedicalRAG - INFO - Hybrid search returned 18 unique documents (query expansion: True) +2025-10-18 03:59:07,315 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 03:59:07,315 - AgenticMedicalRAG - INFO - Retrieved 18 documents, enriched 5 with surrounding context +2025-10-18 03:59:07,315 - AgenticMedicalRAG - INFO - 📄 Enriched Document 1: jnccn-article-p497.pdf | Primary Page: 27 | Pages Included: [26, 26, 26, 26, 27, 27, 27, 27, 27, 27, 28, 28, 28, 28, 28, 28, 28] +2025-10-18 03:59:07,315 - AgenticMedicalRAG - INFO - 📄 Enriched Document 2: jnccn-article-p249.pdf | Primary Page: 20 | Pages Included: [19, 19, 19, 20, 20, 20, 20, 20, 21, 21, 21, 21, 21] +2025-10-18 03:59:07,316 - AgenticMedicalRAG - INFO - 📄 Enriched Document 3: ESMO NCSLC Pan Asian Oncogene-addicted metastatic.pdf | Primary Page: 1 | Pages Included: [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2] +2025-10-18 03:59:07,316 - AgenticMedicalRAG - INFO - 📄 Enriched Document 4: nscl.pdf | Primary Page: 236 | Pages Included: [235, 235, 235, 235, 235, 235, 236, 236, 236, 236, 236, 237, 237, 237, 237, 237] +2025-10-18 03:59:07,316 - AgenticMedicalRAG - INFO - 📄 Enriched Document 5: NICE NG122.pdf | Primary Page: 0 | Pages Included: [0, 0, 0, 1] +2025-10-18 03:59:07,728 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:11:48,633 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:11:49,687 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:11:50,042 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:11:50,043 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:11:50,043 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:11:50,044 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:11:58,778 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:11:58,779 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:11:58,779 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:11:58,780 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:11:58,780 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:11:58,887 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:11:58,913 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:11:58,913 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:11:59,277 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:11:59,278 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:11:59,278 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:11:59,278 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:12:04,670 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 04:12:04,671 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 04:12:04,671 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 04:12:04,671 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 04:12:06,132 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 04:12:06,132 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 04:12:06,132 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 04:20:22,886 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 04:20:25,409 - AgenticMedicalRAG - INFO - Hybrid search returned 13 unique documents (query expansion: True) +2025-10-18 04:20:25,516 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context +2025-10-18 04:20:25,516 - AgenticMedicalRAG - INFO - Retrieved 13 documents, enriched 5 with surrounding context +2025-10-18 04:20:25,517 - AgenticMedicalRAG - INFO - 📄 Enriched Document 1: jnccn-article-p497.pdf | Primary Page: 27 | Pages Included: [26, 26, 26, 26, 27, 27, 27, 27, 27, 27, 28, 28, 28, 28, 28, 28, 28] +2025-10-18 04:20:25,517 - AgenticMedicalRAG - INFO - 📄 Enriched Document 2: jnccn-article-p249.pdf | Primary Page: 20 | Pages Included: [19, 19, 19, 20, 20, 20, 20, 20, 21, 21, 21, 21, 21] +2025-10-18 04:20:25,517 - AgenticMedicalRAG - INFO - 📄 Enriched Document 3: ESMO NCSLC Pan Asian Oncogene-addicted metastatic.pdf | Primary Page: 1 | Pages Included: [0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2] +2025-10-18 04:20:25,517 - AgenticMedicalRAG - INFO - 📄 Enriched Document 4: nscl.pdf | Primary Page: 236 | Pages Included: [235, 235, 235, 235, 235, 235, 236, 236, 236, 236, 236, 237, 237, 237, 237, 237] +2025-10-18 04:20:25,517 - AgenticMedicalRAG - INFO - 📄 Enriched Document 5: NICE NG122.pdf | Primary Page: 0 | Pages Included: [0, 0, 0, 1] +2025-10-18 04:20:35,331 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 04:20:36,198 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 04:20:36,199 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 04:20:37,228 - AgenticMedicalRAG - INFO - Starting validation for interaction 53 +2025-10-18 04:20:46,290 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 53 +2025-10-18 04:20:54,241 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 04:20:54,242 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 53 +2025-10-18 04:20:54,243 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 53 +2025-10-18 04:20:54,243 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-18 04:20:54,243 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 04:36:24,859 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:36:26,059 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:36:26,499 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:36:26,500 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:36:26,501 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:36:26,502 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:36:42,927 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:36:44,087 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:36:44,437 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:36:44,438 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:36:44,439 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:36:44,439 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:36:53,208 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:36:53,208 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:36:53,209 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:36:53,209 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:36:53,209 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:36:53,295 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:36:53,316 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:36:53,316 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:36:53,726 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:36:53,726 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:36:53,726 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:36:53,727 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:37:11,090 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:37:12,184 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:37:12,564 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:37:12,565 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:37:12,565 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:37:12,566 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:37:21,017 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:37:21,018 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:37:21,018 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:37:21,018 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:37:21,019 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:37:21,095 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:37:21,118 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:37:21,119 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:37:21,499 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:37:21,500 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:37:21,500 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:37:21,500 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:37:27,292 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 04:37:27,292 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 04:37:27,292 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 04:37:27,293 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 04:37:28,919 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 04:37:28,919 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 04:37:28,919 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 04:41:39,633 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:41:40,657 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:41:41,047 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:41:41,048 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:41:41,049 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:41:41,050 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:41:50,015 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:41:50,015 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:41:50,015 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:41:50,015 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:41:50,016 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:41:50,111 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:41:50,134 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:41:50,134 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:41:50,557 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:41:50,558 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:41:50,558 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:41:50,558 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:41:55,772 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 04:41:55,772 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 04:41:55,773 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 04:41:55,773 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 04:41:57,129 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 04:41:57,130 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 04:41:57,130 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 04:49:13,964 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 04:49:15,912 - AgenticMedicalRAG - INFO - Hybrid search returned 13 unique documents (query expansion: True) +2025-10-18 04:49:16,060 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:49:16,061 - AgenticMedicalRAG - INFO - Retrieved 13 documents, added 42 context pages +2025-10-18 04:49:16,844 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:49:18,846 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): Do you know what is a driver?... +2025-10-18 04:49:20,011 - AgenticMedicalRAG - INFO - Hybrid search returned 13 unique documents (query expansion: True) +2025-10-18 04:49:20,013 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:49:20,014 - AgenticMedicalRAG - INFO - Retrieved 13 documents, added 42 context pages +2025-10-18 04:49:21,406 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:49:23,408 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): Do you know what is a driver?... +2025-10-18 04:49:24,376 - AgenticMedicalRAG - INFO - Hybrid search returned 13 unique documents (query expansion: True) +2025-10-18 04:49:24,377 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:49:24,378 - AgenticMedicalRAG - INFO - Retrieved 13 documents, added 42 context pages +2025-10-18 04:49:25,069 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:49:27,071 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): Do you know what is a driver?... +2025-10-18 04:49:28,115 - AgenticMedicalRAG - INFO - Hybrid search returned 13 unique documents (query expansion: True) +2025-10-18 04:49:28,117 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:49:28,118 - AgenticMedicalRAG - INFO - Retrieved 13 documents, added 42 context pages +2025-10-18 04:49:28,886 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:55:44,965 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:55:45,801 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:55:46,105 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:55:46,106 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:55:46,107 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:55:46,107 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:55:55,913 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:55:55,913 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:55:55,913 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:55:55,914 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:55:55,914 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:55:56,031 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:55:56,053 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:55:56,054 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:55:56,455 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:55:56,455 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:55:56,456 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:55:56,456 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:56:01,714 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 04:56:01,714 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 04:56:01,715 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 04:56:01,715 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 04:56:03,140 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 04:56:03,141 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 04:56:03,142 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 04:57:41,738 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 04:57:43,778 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:57:43,875 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:57:43,876 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:57:44,509 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:57:46,511 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): Do you know what is a driver?... +2025-10-18 04:57:47,574 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:57:47,576 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:57:47,576 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:57:48,209 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:57:50,211 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): Do you know what is a driver?... +2025-10-18 04:57:51,358 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:57:51,360 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:57:51,360 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:57:52,823 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:57:54,824 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): Do you know what is a driver?... +2025-10-18 04:57:55,768 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:57:55,769 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:57:55,770 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:57:56,273 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:58:43,682 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 04:58:44,617 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 04:58:44,855 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 04:58:44,856 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 04:58:44,856 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 04:58:44,857 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 04:58:51,046 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 04:58:51,046 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 04:58:51,046 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 04:58:51,047 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 04:58:51,047 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 04:58:51,140 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 04:58:51,161 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 04:58:51,161 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 04:58:51,528 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 04:58:51,529 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 04:58:51,529 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 04:58:51,529 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 04:58:56,711 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 04:58:56,712 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 04:58:56,712 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 04:58:56,712 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 04:58:58,105 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 04:58:58,106 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 04:58:58,106 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 04:59:16,786 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 04:59:18,701 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:59:18,798 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:59:18,798 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:59:19,409 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:59:21,410 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): Do you know what is a driver?... +2025-10-18 04:59:22,302 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:59:22,304 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:59:22,304 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:59:23,850 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:59:25,852 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): Do you know what is a driver?... +2025-10-18 04:59:26,724 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:59:26,725 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:59:26,725 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:59:27,234 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 04:59:29,235 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): Do you know what is a driver?... +2025-10-18 04:59:30,242 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 04:59:30,243 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 04:59:30,243 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 55 context pages +2025-10-18 04:59:31,877 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:01:09,006 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 05:01:10,086 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 05:01:10,485 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 05:01:10,486 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 05:01:10,487 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 05:01:10,487 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 05:01:23,649 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 05:01:24,783 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 05:01:25,195 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 05:01:25,196 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 05:01:25,197 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 05:01:25,197 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 05:01:34,193 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 05:01:34,194 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 05:01:34,194 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 05:01:34,194 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 05:01:34,195 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 05:01:34,287 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 05:01:34,308 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 05:01:34,308 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 05:01:34,728 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 05:01:34,729 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 05:01:34,730 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 05:01:34,730 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 05:01:40,810 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 05:01:40,811 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 05:01:40,811 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 05:01:40,811 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 05:01:42,423 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 05:01:42,424 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 05:01:42,424 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 05:04:57,251 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 05:04:57,900 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 05:04:58,128 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 05:04:58,130 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 05:04:58,130 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 05:04:58,131 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 05:05:04,053 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 05:05:04,053 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 05:05:04,054 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 05:05:04,054 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 05:05:04,054 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 05:05:04,254 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 05:05:04,273 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 05:05:04,273 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 05:05:04,515 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 05:05:04,515 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 05:05:04,515 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 05:05:04,515 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 05:05:09,210 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 05:05:09,210 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 05:05:09,211 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 05:05:09,212 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 05:05:10,589 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 05:05:10,590 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 05:05:10,590 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 05:05:53,276 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 05:05:55,774 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 05:05:55,873 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 05:05:55,873 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 05:06:05,019 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 05:06:05,913 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 05:06:05,914 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 05:06:06,612 - AgenticMedicalRAG - INFO - Starting validation for interaction 1 +2025-10-18 05:06:07,480 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:06:07,846 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:06:08,208 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:06:08,208 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 05:06:08,678 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 1 +2025-10-18 05:06:10,445 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 05:06:10,445 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 1 +2025-10-18 05:06:10,446 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 1 +2025-10-18 05:06:10,446 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 05:06:10,447 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 05:32:11,611 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 05:32:12,794 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 05:32:13,227 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 05:32:13,228 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 05:32:13,229 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 05:32:13,229 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 05:32:22,069 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 05:32:22,069 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 05:32:22,069 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 05:32:22,070 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 05:32:22,070 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 05:32:22,159 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 05:32:22,179 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 05:32:22,179 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 05:32:22,591 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 05:32:22,591 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 05:32:22,592 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 05:32:22,592 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 05:32:28,715 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 05:32:28,716 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 05:32:28,716 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 05:32:28,716 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 05:32:30,306 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 05:32:30,307 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 05:32:30,307 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 05:36:07,034 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 05:36:07,677 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 05:36:07,924 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 05:36:07,925 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 05:36:07,926 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 05:36:07,926 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 05:36:13,724 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 05:36:13,726 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 05:36:13,726 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 05:36:13,727 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 05:36:13,727 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 05:36:13,794 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 05:36:13,808 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 05:36:13,809 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 05:36:14,026 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 05:36:14,026 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 05:36:14,026 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 05:36:14,026 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 05:36:17,584 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 05:36:17,584 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 05:36:17,585 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 05:36:17,585 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 05:36:18,505 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 05:36:18,505 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 05:36:18,505 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 05:36:57,558 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 05:36:59,748 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 05:36:59,849 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 05:36:59,849 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 05:37:07,474 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 05:37:08,363 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 05:37:08,363 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 05:37:08,782 - AgenticMedicalRAG - INFO - Starting validation for interaction 1 +2025-10-18 05:37:09,747 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:37:10,132 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:37:10,560 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 05:37:10,560 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 05:37:11,008 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 1 +2025-10-18 05:37:12,168 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 05:37:12,169 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 1 +2025-10-18 05:37:12,169 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 1 +2025-10-18 05:37:12,169 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 05:37:12,169 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 08:11:01,441 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 08:11:05,328 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 08:11:05,829 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 08:11:05,831 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 08:11:05,831 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 08:11:05,832 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 08:11:26,236 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 08:11:26,236 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 08:11:26,237 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 08:11:26,237 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 08:11:26,238 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 08:11:26,863 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 08:11:26,929 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 08:11:26,930 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 08:11:27,334 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 08:11:27,335 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 08:11:27,335 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 08:11:27,336 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 08:11:32,176 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 08:11:32,176 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 08:11:32,176 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 08:11:32,177 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 08:11:33,756 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 08:11:33,756 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 08:11:33,757 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 08:11:56,844 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 08:11:59,892 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 08:11:59,997 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:11:59,997 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 08:12:05,436 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 08:12:06,265 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 08:12:06,266 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 08:12:06,948 - AgenticMedicalRAG - INFO - Starting validation for interaction 1 +2025-10-18 08:12:07,978 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:12:08,336 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:12:08,590 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:12:08,590 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 08:12:13,888 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 1 +2025-10-18 08:12:15,980 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 08:12:15,981 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 1 +2025-10-18 08:12:15,981 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 1 +2025-10-18 08:12:15,982 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 08:12:15,982 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 08:13:44,337 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): what is Anaplastic lymphoma kinase?... +2025-10-18 08:13:46,441 - AgenticMedicalRAG - INFO - Hybrid search returned 7 unique documents (query expansion: True) +2025-10-18 08:13:46,445 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:13:46,446 - AgenticMedicalRAG - INFO - Retrieved 7 documents, added 10 context pages +2025-10-18 08:13:55,750 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 08:13:56,445 - AgenticMedicalRAG - INFO - Starting validation for interaction 2 +2025-10-18 08:14:04,235 - AgenticMedicalRAG - INFO - Assigned unique interaction ID: 2 +2025-10-18 08:14:06,180 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 08:14:06,181 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 2 +2025-10-18 08:14:06,181 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 2 +2025-10-18 08:14:06,181 - AgenticMedicalRAG - INFO - Validation scores - Overall: 89/100, Accuracy: 90/100, Coherence: 95/100, Relevance: 92/100 +2025-10-18 08:14:06,182 - AgenticMedicalRAG - INFO - Successfully processed user input: what is Anaplastic lymphoma kinase?... +2025-10-18 08:34:07,309 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 08:34:11,902 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 08:34:12,416 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 08:34:12,417 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 08:34:12,417 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 08:34:12,418 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 08:34:23,904 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 08:34:23,978 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 08:34:25,733 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 08:34:27,978 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 08:34:27,979 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 08:34:27,982 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 08:34:35,918 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 08:34:35,918 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 08:34:35,919 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 08:34:35,919 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 08:34:35,919 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 08:34:36,046 - AgenticMedicalRAG - ERROR - Failed to load embedding model: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device. +2025-10-18 08:34:36,559 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 08:34:36,561 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 08:34:36,929 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 08:34:36,931 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 08:34:36,932 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 08:34:36,932 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 08:34:37,559 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 08:34:37,577 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 08:34:37,589 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 08:34:37,589 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 08:34:37,600 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 08:34:37,600 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 08:34:43,284 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 08:34:43,284 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 08:34:43,285 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 08:34:43,285 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 08:34:43,285 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 08:34:43,348 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 08:34:43,485 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:34:43,485 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 08:36:41,007 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 08:36:42,802 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 08:36:42,804 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:36:42,804 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 08:36:49,911 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 08:36:50,864 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 08:36:50,864 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 08:36:51,306 - AgenticMedicalRAG - INFO - No existing evaluation file found, starting with ID 1 +2025-10-18 08:36:51,306 - AgenticMedicalRAG - INFO - Starting validation for interaction 1 +2025-10-18 08:36:52,323 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:36:52,643 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:36:52,998 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:36:52,999 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 08:36:58,661 - AgenticMedicalRAG - INFO - Loading existing evaluations: 0 found +2025-10-18 08:36:58,662 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 1 +2025-10-18 08:37:00,542 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 08:37:00,544 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 1 +2025-10-18 08:37:00,544 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 1 +2025-10-18 08:37:00,545 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 1 +2025-10-18 08:37:00,545 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 08:37:00,546 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 08:39:11,884 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 08:39:13,673 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 08:39:13,734 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:39:13,734 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 08:39:14,165 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:39:16,166 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 08:39:17,128 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 08:39:17,130 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:39:17,130 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 08:39:17,613 - AgenticMedicalRAG - ERROR - OpenAI API error: Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:39:19,618 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 08:39:20,739 - AgenticMedicalRAG - INFO - Hybrid search returned 4 unique documents (query expansion: True) +2025-10-18 08:39:20,742 - AgenticMedicalRAG - INFO - Enriched 3 documents with surrounding context pages +2025-10-18 08:39:20,742 - AgenticMedicalRAG - INFO - Retrieved 4 documents, added 6 context pages +2025-10-18 08:39:27,856 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 08:39:28,368 - AgenticMedicalRAG - INFO - Found 1 existing evaluations in GitHub +2025-10-18 08:39:28,369 - AgenticMedicalRAG - INFO - Next interaction ID will be: 2 +2025-10-18 08:39:28,369 - AgenticMedicalRAG - INFO - Starting validation for interaction 2 +2025-10-18 08:39:34,506 - AgenticMedicalRAG - INFO - Loading existing evaluations: 1 found +2025-10-18 08:39:34,507 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 2 +2025-10-18 08:39:35,886 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 08:39:35,887 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 2 +2025-10-18 08:39:35,887 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 2 +2025-10-18 08:39:35,888 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 2 +2025-10-18 08:39:35,888 - AgenticMedicalRAG - INFO - Validation scores - Overall: 97/100, Accuracy: 100/100, Coherence: 95/100, Relevance: 100/100 +2025-10-18 08:39:35,888 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-18 08:51:14,855 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 08:51:15,919 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 08:51:16,218 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 08:51:16,219 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 08:51:16,220 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 08:51:16,220 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 08:51:23,995 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 08:51:23,996 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 08:51:23,996 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 08:51:23,996 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 08:51:23,997 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 08:51:24,130 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 08:51:24,159 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 08:51:24,159 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 08:51:24,476 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 08:51:24,476 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 08:51:24,477 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 08:51:24,477 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 08:51:29,624 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 08:51:29,624 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 08:51:29,624 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 08:51:29,625 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 08:51:31,112 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 08:51:31,113 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 08:51:31,113 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 08:55:00,839 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): Do you know what is a driver?... +2025-10-18 08:55:03,072 - AgenticMedicalRAG - INFO - Hybrid search returned 10 unique documents (query expansion: True) +2025-10-18 08:55:03,172 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 08:55:03,172 - AgenticMedicalRAG - INFO - Retrieved 10 documents, added 9 context pages +2025-10-18 08:55:10,914 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 08:55:11,745 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 08:55:11,745 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 08:55:12,391 - AgenticMedicalRAG - INFO - Found 2 existing evaluations in GitHub +2025-10-18 08:55:12,391 - AgenticMedicalRAG - INFO - Next interaction ID will be: 3 +2025-10-18 08:55:12,392 - AgenticMedicalRAG - INFO - Starting validation for interaction 3 +2025-10-18 08:55:13,408 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:55:13,663 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:55:14,010 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 08:55:14,010 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 08:55:14,524 - AgenticMedicalRAG - INFO - Loading existing evaluations: 2 found +2025-10-18 08:55:14,524 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 3 +2025-10-18 08:55:16,651 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 08:55:16,652 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 3 +2025-10-18 08:55:16,652 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 3 +2025-10-18 08:55:16,652 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 3 +2025-10-18 08:55:16,652 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 08:55:16,653 - AgenticMedicalRAG - INFO - Successfully processed user input: Do you know what is a driver?... +2025-10-18 09:08:10,879 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 09:08:12,039 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 09:08:12,363 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 09:08:12,364 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 09:08:12,365 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 09:08:12,366 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 09:08:21,073 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 09:08:21,073 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 09:08:21,074 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 09:08:21,074 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 09:08:21,074 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 09:08:21,179 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 09:08:21,206 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 09:08:21,206 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 09:08:21,549 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 09:08:21,550 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 09:08:21,550 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 09:08:21,551 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 09:08:26,699 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 09:08:26,699 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 09:08:26,699 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 09:08:26,700 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 09:08:27,995 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 09:08:27,996 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 09:08:27,996 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 09:32:45,693 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 09:32:48,363 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 09:32:48,437 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 09:32:48,437 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 09:32:56,304 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 09:32:57,190 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 09:32:57,190 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 09:32:58,110 - AgenticMedicalRAG - INFO - Found 3 existing evaluations in GitHub +2025-10-18 09:32:58,111 - AgenticMedicalRAG - INFO - Next interaction ID will be: 4 +2025-10-18 09:32:58,111 - AgenticMedicalRAG - INFO - Starting validation for interaction 4 +2025-10-18 09:32:59,066 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 09:32:59,322 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 09:32:59,579 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 09:32:59,579 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 09:33:00,717 - AgenticMedicalRAG - INFO - Loading existing evaluations: 3 found +2025-10-18 09:33:00,718 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 4 +2025-10-18 09:33:02,526 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 09:33:02,528 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 4 +2025-10-18 09:33:02,528 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 4 +2025-10-18 09:33:02,528 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 4 +2025-10-18 09:33:02,529 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 09:33:02,529 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:23:08,688 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 10:23:09,455 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 10:23:09,768 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 10:23:09,769 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 10:23:09,769 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 10:23:09,769 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 10:23:16,440 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 10:23:16,440 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 10:23:16,440 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 10:23:16,441 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 10:23:16,441 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 10:23:16,518 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 10:23:16,538 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 10:23:16,538 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 10:23:16,819 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 10:23:16,820 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 10:23:16,820 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 10:23:16,820 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 10:23:20,612 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 10:23:20,612 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 10:23:20,612 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 10:23:20,612 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 10:23:21,520 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 10:23:21,520 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 10:23:21,520 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 10:23:44,691 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:23:46,675 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 10:23:46,751 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 10:23:46,751 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 10:23:55,799 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 10:23:56,588 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 10:23:56,589 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 10:23:57,518 - AgenticMedicalRAG - INFO - Found 5 existing evaluations in GitHub +2025-10-18 10:23:57,518 - AgenticMedicalRAG - INFO - Next interaction ID will be: 6 +2025-10-18 10:23:57,519 - AgenticMedicalRAG - INFO - Starting validation for interaction 6 +2025-10-18 10:23:58,351 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 10:23:58,600 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 10:23:58,862 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-18 10:23:58,862 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-18 10:23:59,471 - AgenticMedicalRAG - INFO - Loading existing evaluations: 5 found +2025-10-18 10:23:59,471 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 6 +2025-10-18 10:24:01,847 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 10:24:01,849 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 6 +2025-10-18 10:24:01,849 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 6 +2025-10-18 10:24:01,850 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 6 +2025-10-18 10:24:01,851 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-18 10:24:01,852 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:32:10,996 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 10:32:11,969 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 10:32:12,296 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 10:32:12,297 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 10:32:12,298 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 10:32:12,298 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 10:32:20,264 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 10:32:20,264 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 10:32:20,264 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 10:32:20,265 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 10:32:20,265 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 10:32:20,332 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 10:32:20,349 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 10:32:20,350 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 10:32:20,642 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 10:32:20,643 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 10:32:20,643 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 10:32:20,643 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 10:32:25,782 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 10:32:25,783 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 10:32:25,783 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 10:32:25,784 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 10:32:27,158 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 10:32:27,159 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 10:32:27,159 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 10:32:32,870 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:32:35,032 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 10:32:35,106 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 10:32:35,106 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 10:32:38,407 - AgenticMedicalRAG - WARNING - Rate limit exceeded. Retrying in 2 seconds... (Attempt 1/3) +2025-10-18 10:32:40,408 - AgenticMedicalRAG - INFO - Processing user input (attempt 2): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:32:43,305 - AgenticMedicalRAG - WARNING - Rate limit exceeded. Retrying in 4 seconds... (Attempt 2/3) +2025-10-18 10:32:47,306 - AgenticMedicalRAG - INFO - Processing user input (attempt 3): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:32:50,106 - AgenticMedicalRAG - WARNING - Rate limit exceeded. Retrying in 8 seconds... (Attempt 3/3) +2025-10-18 10:32:58,108 - AgenticMedicalRAG - INFO - Processing user input (attempt 4): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:33:36,771 - AgenticMedicalRAG - WARNING - Rate limit exceeded. Retrying in 16 seconds... (Attempt 4/3) +2025-10-18 10:33:36,772 - AgenticMedicalRAG - ERROR - Rate limit exceeded after maximum retries +2025-10-18 10:34:38,589 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 10:34:39,578 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 10:34:39,933 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 10:34:39,934 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 10:34:39,935 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 10:34:39,935 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 10:34:49,250 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 10:34:49,250 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 10:34:49,250 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 10:34:49,251 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 10:34:49,251 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 10:34:49,344 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 10:34:49,368 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 10:34:49,369 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 10:34:49,714 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 10:34:49,715 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 10:34:49,715 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 10:34:49,715 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 10:34:54,920 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 10:34:54,921 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 10:34:54,921 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 10:34:54,922 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 10:34:56,315 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 10:34:56,315 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 10:34:56,316 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 10:36:39,026 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:36:41,848 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 10:36:41,933 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 10:36:41,934 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 10:36:54,470 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 10:36:55,375 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 10:36:55,375 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 10:36:56,071 - AgenticMedicalRAG - INFO - Found 6 existing evaluations in GitHub +2025-10-18 10:36:56,072 - AgenticMedicalRAG - INFO - Next interaction ID will be: 7 +2025-10-18 10:36:56,072 - AgenticMedicalRAG - INFO - Starting validation for interaction 7 +2025-10-18 10:37:04,403 - AgenticMedicalRAG - INFO - Loading existing evaluations: 6 found +2025-10-18 10:37:04,403 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 7 +2025-10-18 10:37:06,933 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 10:37:06,934 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 7 +2025-10-18 10:37:06,935 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 7 +2025-10-18 10:37:06,935 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 7 +2025-10-18 10:37:06,935 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-18 10:37:06,935 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:42:13,431 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-18 10:42:14,692 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-18 10:42:15,063 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-18 10:42:15,064 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-18 10:42:15,064 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-18 10:42:15,065 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-18 10:42:23,398 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-18 10:42:23,399 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-18 10:42:23,399 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-18 10:42:23,400 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-18 10:42:23,400 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-18 10:42:23,512 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-18 10:42:23,536 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-18 10:42:23,537 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-18 10:42:23,863 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-18 10:42:23,864 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-18 10:42:23,864 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-18 10:42:23,865 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-18 10:42:24,797 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:42:24,818 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 10:42:29,436 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-18 10:42:29,438 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-18 10:42:29,438 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-18 10:42:29,439 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-18 10:42:30,444 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 10:42:30,445 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-18 10:42:30,445 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-18 10:42:30,480 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-18 10:42:32,663 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 10:42:32,760 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 10:42:32,761 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 10:42:42,560 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-18 10:42:44,821 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-18 10:42:44,823 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-18 10:42:44,823 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-18 10:42:54,615 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-18 10:42:55,468 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-18 10:42:55,469 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-18 10:42:56,550 - AgenticMedicalRAG - INFO - Found 7 existing evaluations in GitHub +2025-10-18 10:42:56,550 - AgenticMedicalRAG - INFO - Next interaction ID will be: 8 +2025-10-18 10:42:56,551 - AgenticMedicalRAG - INFO - Starting validation for interaction 8 +2025-10-18 10:43:08,113 - AgenticMedicalRAG - INFO - Loading existing evaluations: 7 found +2025-10-18 10:43:08,114 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 8 +2025-10-18 10:43:11,784 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-18 10:43:11,785 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 8 +2025-10-18 10:43:11,785 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 8 +2025-10-18 10:43:11,786 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 8 +2025-10-18 10:43:11,786 - AgenticMedicalRAG - INFO - Validation scores - Overall: 90/100, Accuracy: 95/100, Coherence: 90/100, Relevance: 88/100 +2025-10-18 10:43:11,786 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-19 04:08:15,330 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-19 04:08:18,585 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-19 04:08:19,150 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-19 04:08:19,151 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-19 04:08:19,152 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-19 04:08:19,152 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-19 04:08:38,512 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-19 04:08:38,512 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-19 04:08:38,513 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-19 04:08:38,513 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-19 04:08:38,514 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-19 04:08:39,054 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-19 04:08:39,109 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-19 04:08:39,109 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-19 04:08:39,556 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-19 04:08:39,556 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-19 04:08:39,557 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-19 04:08:39,557 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-19 04:08:44,370 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-19 04:08:44,372 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-19 04:08:44,372 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-19 04:08:44,372 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-19 04:08:45,914 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-19 04:08:45,915 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-19 04:08:45,915 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-19 04:09:10,346 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-19 04:09:13,199 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-19 04:09:13,275 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-19 04:09:13,276 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-19 04:09:22,096 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-19 04:09:22,947 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-19 04:09:22,947 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-19 04:09:23,666 - AgenticMedicalRAG - INFO - Found 8 existing evaluations in GitHub +2025-10-19 04:09:23,666 - AgenticMedicalRAG - INFO - Next interaction ID will be: 9 +2025-10-19 04:09:23,667 - AgenticMedicalRAG - INFO - Starting validation for interaction 9 +2025-10-19 04:09:24,779 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 04:09:25,137 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 04:09:25,437 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 04:09:25,438 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-19 04:09:30,433 - AgenticMedicalRAG - INFO - Loading existing evaluations: 8 found +2025-10-19 04:09:30,435 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 9 +2025-10-19 04:09:33,859 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-19 04:09:33,860 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 9 +2025-10-19 04:09:33,860 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 9 +2025-10-19 04:09:33,861 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 9 +2025-10-19 04:09:33,861 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-19 04:09:33,861 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ... +2025-10-19 04:33:21,429 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-19 04:37:18,129 - AgenticMedicalRAG - INFO - Configuration validation completed +2025-10-19 04:37:19,417 - AgenticMedicalRAG - INFO - Loaded 877 learned synonyms from cache +2025-10-19 04:37:19,802 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization... +2025-10-19 04:37:19,802 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%) +2025-10-19 04:37:19,803 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%) +2025-10-19 04:37:19,803 - AgenticMedicalRAG - INFO - Loading embedding model (first time)... +2025-10-19 04:37:29,337 - AgenticMedicalRAG - INFO - Embedding model loaded successfully +2025-10-19 04:37:29,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%) +2025-10-19 04:37:29,337 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%) +2025-10-19 04:37:29,338 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)... +2025-10-19 04:37:29,338 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed... +2025-10-19 04:37:29,541 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever... +2025-10-19 04:37:29,567 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever... +2025-10-19 04:37:29,567 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever... +2025-10-19 04:37:30,010 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever... +2025-10-19 04:37:30,010 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully. +2025-10-19 04:37:30,010 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%) +2025-10-19 04:37:30,011 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%) +2025-10-19 04:37:35,445 - AgenticMedicalRAG - INFO - Saved learned terms to cache +2025-10-19 04:37:35,446 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents +2025-10-19 04:37:35,446 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%) +2025-10-19 04:37:35,446 - AgenticMedicalRAG - INFO - Initializing LLM (first time)... +2025-10-19 04:37:37,033 - AgenticMedicalRAG - INFO - LLM initialized successfully +2025-10-19 04:37:37,034 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%) +2025-10-19 04:37:37,034 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully +2025-10-19 05:07:05,539 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): What is the role of durvalumab in stage III NSCLC ... +2025-10-19 05:07:08,849 - AgenticMedicalRAG - INFO - Hybrid search returned 9 unique documents (query expansion: True) +2025-10-19 05:07:08,919 - AgenticMedicalRAG - INFO - Enriched 5 documents with surrounding context pages +2025-10-19 05:07:08,920 - AgenticMedicalRAG - INFO - Retrieved 9 documents, added 10 context pages +2025-10-19 05:07:25,267 - AgenticMedicalRAG - INFO - Performing background validation for streaming response... +2025-10-19 05:07:26,270 - AgenticMedicalRAG - INFO - Medical answer validator initialized successfully +2025-10-19 05:07:26,271 - AgenticMedicalRAG - INFO - GitHub storage initialized for MoazEldsouky/cloud-data-store +2025-10-19 05:07:27,367 - AgenticMedicalRAG - INFO - Found 10 existing evaluations in GitHub +2025-10-19 05:07:27,368 - AgenticMedicalRAG - INFO - Next interaction ID will be: 11 +2025-10-19 05:07:27,368 - AgenticMedicalRAG - INFO - Starting validation for interaction 11 +2025-10-19 05:07:28,328 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 1): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 05:07:28,702 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 2): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 05:07:28,950 - AgenticMedicalRAG - ERROR - Validation LLM error (attempt 3): Error code: 413 - {'error': {'code': 'tokens_limit_reached', 'message': 'Request body too large for gpt-4o model. Max size: 8000 tokens.', 'details': 'Request body too large for gpt-4o model. Max size: 8000 tokens.'}} +2025-10-19 05:07:28,951 - AgenticMedicalRAG - INFO - Using basic heuristic validation as fallback +2025-10-19 05:07:30,074 - AgenticMedicalRAG - INFO - Loading existing evaluations: 10 found +2025-10-19 05:07:30,075 - AgenticMedicalRAG - INFO - Adding new evaluation with ID: 11 +2025-10-19 05:07:32,822 - AgenticMedicalRAG - INFO - Successfully uploaded medical_data/evaluation_results.json to GitHub +2025-10-19 05:07:32,822 - AgenticMedicalRAG - INFO - Successfully saved evaluation. Total evaluations now: 11 +2025-10-19 05:07:32,823 - AgenticMedicalRAG - INFO - Evaluation saved to GitHub with ID: 11 +2025-10-19 05:07:32,823 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 11 +2025-10-19 05:07:32,823 - AgenticMedicalRAG - INFO - Validation scores - Overall: 72/100, Accuracy: 75/100, Coherence: 80/100, Relevance: 70/100 +2025-10-19 05:07:32,824 - AgenticMedicalRAG - INFO - Successfully processed user input: What is the role of durvalumab in stage III NSCLC ...