Enhance agent instructions and tool usage guidelines for lung cancer queries. Added critical instructions for handling greetings and non-medical questions, specifying that tools should not be used in these cases. Updated the medical guidelines knowledge tool documentation to reinforce its exclusive use for medical inquiries. Improved clarity in the agent's purpose and tool usage rules to ensure accurate responses.

core/agent.py

@@ -90,8 +90,20 @@ AVAILABLE_TOOLS = [
 
 # System message template for the agent
 SYSTEM_MESSAGE = """
+**⚠️ CRITICAL FIRST STEP - ALWAYS CHECK THIS BEFORE USING TOOLS ⚠️**
+
+**IF THE USER SAYS: "hi", "hello", "hey", "how are you", "thanks", "what can you do", OR ANY GREETING/SMALL TALK:**
+- **DO NOT USE ANY TOOLS**
+- **DO NOT CALL medical_guidelines_knowledge_tool**
+- **ANSWER DIRECTLY** with a friendly response like: "Hello! How can I help you with lung cancer questions today?" or "Hi there! I'm here to help with lung cancer clinical guidance."
+
+**ONLY USE TOOLS FOR MEDICAL QUESTIONS ABOUT LUNG CANCER** (treatments, staging, biomarkers, guidelines, clinical information).
+
+---
+
 You are a specialized Lung Cancer Clinical Decision Support System for thoracic oncologists, pulmonologists, and healthcare professionals managing lung cancer patients.
-Your primary purpose is to provide evidence-based clinical guidance on lung cancer (NSCLC and SCLC) strictly from authoritative medical guidelines using the tool "medical_guidelines_knowledge_tool".
+
+**YOUR PRIMARY PURPOSE:** Provide evidence-based clinical guidance on lung cancer (NSCLC and SCLC) strictly from authoritative medical guidelines using the tool "medical_guidelines_knowledge_tool" - BUT ONLY FOR MEDICAL QUESTIONS.
 
 **SPECIALIZATION**: Lung Cancer (Non-Small Cell Lung Cancer and Small Cell Lung Cancer)
 - Focus on NSCLC subtypes: adenocarcinoma, squamous cell carcinoma, large cell carcinoma
@@ -129,23 +141,22 @@ Your primary purpose is to provide evidence-based clinical guidance on lung canc
 - **CONTEXT AWARENESS**: Use context pages to ensure accuracy, but synthesize information concisely
 - **DIRECT ANSWERS**: Answer the specific question asked without providing tangential information
 
-**CRITICAL INSTRUCTIONS - TOOL USAGE FOR MEDICAL QUESTIONS ONLY:**
+**TOOL USAGE RULES - ABSOLUTELY CRITICAL:**
 
-**USE THE "medical_guidelines_knowledge_tool" ONLY FOR MEDICAL QUESTIONS ABOUT LUNG CANCER.**
-- For MEDICAL QUESTIONS (lung cancer treatments, staging, biomarkers, guidelines, clinical questions): ALWAYS use "medical_guidelines_knowledge_tool" FIRST
-- Do NOT answer medical questions from your general knowledge or training data
-- Do NOT provide medical information without first retrieving it from the guidelines
-- Even for basic lung cancer concepts (e.g., "what is EGFR mutation", "ALK rearrangement", "PD-L1 expression"), you MUST retrieve information from the guidelines first
-- Only after retrieving guideline information should you formulate your answer based on what was retrieved
+**RULE 1: NON-MEDICAL QUESTIONS = NO TOOLS EVER**
+- If the user says "hi", "hello", "hey", "how are you", "thanks", "what can you do", or any greeting/small talk: 
+  * DO NOT call any tools
+  * DO NOT use medical_guidelines_knowledge_tool
+  * Answer directly with a friendly, conversational response
+  * Examples of correct responses: "Hello! How can I help you with lung cancer questions today?", "Hi there! I'm here to help with lung cancer clinical guidance.", "Thanks! Feel free to ask me any questions about lung cancer management."
 
-**NON-MEDICAL QUESTIONS - ANSWER DIRECTLY WITHOUT TOOLS:**
-- For NON-MEDICAL questions (greetings like "hi", "hello", "how are you", small talk, general conversation, questions about your capabilities, etc.): Answer directly WITHOUT using any tools
-- Examples of non-medical questions that should be answered directly:
-  * Greetings: "hi", "hello", "good morning", "hey"
-  * Small talk: "how are you", "what can you do", "tell me about yourself"
-  * General questions: "what is your purpose", "who are you", "what are your capabilities"
-  * Non-medical topics: weather, general knowledge unrelated to lung cancer, etc.
-- For these questions, respond naturally and conversationally without invoking any tools
+**RULE 2: MEDICAL QUESTIONS = USE TOOL**
+- For MEDICAL QUESTIONS about lung cancer (treatments, staging, biomarkers, guidelines, clinical questions): 
+  * ALWAYS use "medical_guidelines_knowledge_tool" FIRST
+  * Do NOT answer medical questions from your general knowledge or training data
+  * Do NOT provide medical information without first retrieving it from the guidelines
+  * Even for basic lung cancer concepts (e.g., "what is EGFR mutation", "ALK rearrangement", "PD-L1 expression"), you MUST retrieve information from the guidelines first
+  * Only after retrieving guideline information should you formulate your answer based on what was retrieved
 
 **STRICT QUERY ADHERENCE - ALL PROVIDERS REQUIREMENT:**
 - When the user does **not** specify a particular guideline provider, you MUST interpret the question as "according to all guidelines" and base your answer on **all** available guideline providers (ASCO, ESMO, IASLC, NCCN, NICE).
@@ -155,14 +166,14 @@ Your primary purpose is to provide evidence-based clinical guidance on lung canc
 - Present a comprehensive synthesized answer that clearly reflects the combined recommendations from all providers
 - If a specific provider has no information on the topic, explicitly state that in your response
 
-**TOOL USAGE REQUIREMENTS:**
+**TOOL USAGE REQUIREMENTS - SUMMARY:**
 1. **NON-MEDICAL QUESTIONS** (greetings, small talk, general conversation):
-   - DO NOT use any tools
-   - Answer directly and conversationally
-   - Examples: "hi", "hello", "how are you", "what can you do"
+   - **NEVER use any tools - answer directly**
+   - Examples: "hi", "hello", "how are you", "what can you do", "thanks"
+   - Respond naturally: "Hello! How can I help you with lung cancer questions today?"
    
 2. **MEDICAL QUESTIONS** (definitions, treatments, guidelines, lung cancer topics, etc.): 
-   - MANDATORY: Use "medical_guidelines_knowledge_tool" FIRST
+   - **MANDATORY: Use "medical_guidelines_knowledge_tool" FIRST**
    - Then answer based ONLY on retrieved information
    
 3. **SIDE EFFECT REPORTING**: When a healthcare professional reports an adverse drug reaction, side effect, or medication-related complication:

core/tools.py

@@ -295,6 +295,15 @@ def medical_guidelines_knowledge_tool(query: str, provider: Optional[str] = None
     Retrieve comprehensive medical guideline knowledge with enriched context.
     Includes surrounding pages (before/after) for top results to provide complete clinical context.
     
+    **IMPORTANT: ONLY USE THIS TOOL FOR MEDICAL QUESTIONS ABOUT LUNG CANCER.**
+    **DO NOT USE THIS TOOL FOR:**
+    - Greetings (hi, hello, hey, how are you)
+    - Small talk or general conversation
+    - Non-medical questions
+    
+    **ONLY USE FOR:**
+    - Medical questions about lung cancer treatments, staging, biomarkers, guidelines, clinical information
+    
     Behavior:
     - If provider is specified (e.g., "NCCN", "ASCO", "ESMO", "NICE"): queries only that provider
     - If provider is NOT specified: queries ALL providers separately and combines results for balanced representation

data/medical_terms_cache.json

@@ -4,23 +4,23 @@
       "esmo"
     ],
     "esmo": [
-      "european\nsociety of medical oncology",
       "european society for medical oncology",
-      "european society for\nmedical oncology",
+      "european society of medical oncology",
+      "european\nsociety of medical oncology",
       "the european society for medical oncology",
       "the european society for medical\noncology",
-      "european society of medical oncology"
+      "european society for\nmedical oncology"
     ],
     "american society of clinical\n\noncology": [
       "asco"
     ],
     "asco": [
       "american society of clinical oncology",
-      "md american society of clinical oncology",
-      "american society of clinical\n\noncology",
-      "s note\n\nthis american society of clinical oncology",
       "inc",
       "american\nsociety of clinical oncology",
+      "american society of clinical\n\noncology",
+      "s note\n\nthis american society of clinical oncology",
+      "md american society of clinical oncology",
       "journal of clinical oncology"
     ],
     "italian association of medical oncology": [
@@ -34,30 +34,30 @@
       "nccn"
     ],
     "nccn": [
+      "national comprehensive cancer network",
       "vs insurance-based",
-      "leading american cancer centers",
-      "national comprehensive cancer network"
+      "leading american cancer centers"
     ],
     "non-small cell lung cancer": [
       "nsclc"
     ],
     "nsclc": [
-      "stage iii non small cell lung cancer",
+      "advanced non-small-cell lung cancer",
       "-rearranged advanced non-small-cell lung cancer",
-      "cancer",
-      "small cell lung cancer",
-      "non-small-cell lung cancer",
-      "small cell\nlung cancer",
-      "robotic lobectomy for non-small cell lung cancer",
-      "mutant advanced non-small cell lung cancer",
       "small-cell lung cancer",
       "advanced non-small cell lung cancer",
-      "advanced non-small-cell lung cancer",
-      "e-mutant advanced non-small cell lung cancer",
+      "small cell\nlung cancer",
+      "non-small-cell lung cancer",
       "iii non-small-cell lung cancer",
+      "small cell lung cancer",
+      "stage iii non small cell lung cancer",
+      "small-cell\nlung cancer",
+      "e-mutant advanced non-small cell lung cancer",
       "non-small cell lung cancer",
-      "lung cancer",
-      "small-cell\nlung cancer"
+      "cancer",
+      "robotic lobectomy for non-small cell lung cancer",
+      "mutant advanced non-small cell lung cancer",
+      "lung cancer"
     ],
     "american\nsociety of clinical oncology": [
       "asco"
@@ -76,19 +76,19 @@
     ],
     "glides": [
       "guidelines into decision support",
-      "using the guidelines into decision\nsupport",
-      "using the guidelines into decision support"
+      "using the guidelines into decision support",
+      "using the guidelines into decision\nsupport"
     ],
     "for all the newly\neuropean medicines agency": [
       "ema"
     ],
     "ema": [
+      "not european medicines agency",
       "and the european medicines\nagency",
       "for all the newly european medicines agency",
-      "for all the newly\neuropean medicines agency",
-      "not european medicines agency",
       "and the european medicines agency",
-      "european medicines agency"
+      "european medicines agency",
+      "for all the newly\neuropean medicines agency"
     ],
     "evaluates treatments with curative intent": [
       "such\nas adjuvant chemotherapy",
@@ -114,8 +114,8 @@
       "magrit"
     ],
     "magrit": [
-      "-positive non-small-cell lung cancer",
-      "-positive nonsmall-cell lung cancer"
+      "-positive nonsmall-cell lung cancer",
+      "-positive non-small-cell lung cancer"
     ],
     "guidelines into decision support": [
       "glides"
@@ -124,17 +124,17 @@
       "non-metastatic"
     ],
     "non-metastatic": [
-      "early-stage and\n\nlocally advanced",
-      "early-stage and locally advanced"
+      "early-stage and locally advanced",
+      "early-stage and\n\nlocally advanced"
     ],
     "or best supportive\ncare": [
       "bsc"
     ],
     "bsc": [
+      "or best supportive\ncare",
       "leads to increased dfs versus best supportive care",
       "or best supportive care",
-      "leads to\nincreased dfs versus best supportive care",
-      "or best supportive\ncare"
+      "leads to\nincreased dfs versus best supportive care"
     ],
     "author affiliations\nand support\n\ninformation": [
       "if\n\napplicable"
@@ -152,17 +152,17 @@
       "rcts"
     ],
     "rcts": [
+      "controlled trials",
       "two randomized control trials",
-      "clinical trials",
-      "controlled trials"
+      "clinical trials"
     ],
     "the primary end point was disease-free\nsurvival": [
       "dfs"
     ],
     "dfs": [
       "disease-free survival",
-      "the primary end point was disease-free survival",
-      "the primary end point was disease-free\nsurvival"
+      "the primary end point was disease-free\nsurvival",
+      "the primary end point was disease-free survival"
     ],
     "joint cancer care ontario": [
       "cco"
@@ -177,75 +177,75 @@
       "inst"
     ],
     "inst": [
+      "exelixis",
+      "astex pharmaceuticals",
       "boehringer ingelheim",
-      "blueprint medicines",
-      "neogenomics",
-      "crispr\ntherapeutics",
-      "pharmamar",
-      "roche",
-      "dizal pharma",
-      "bayer",
-      "constellation pharmaceuticals",
-      "oric pharmaceuticals",
-      "summit therapeutics",
-      "oncomed",
+      "regeneron",
+      "crispr therapeutics",
+      "cullinan oncology",
+      "guardant health",
+      "arcus biosciences",
+      "palobiofarma",
+      "sutro biopharma",
       "merck serono",
-      "inhibrx",
-      "astrazeneca",
       "verastem",
-      "harpoon therapeutics",
-      "macrogenics",
-      "nuvation bio",
-      "therapeutics",
-      "merck",
-      "forward",
-      "advaxis",
-      "arcus biosciences",
-      "bristol myers\nsquibb",
-      "mirati therapeutics",
+      "anheart therapeutics",
+      "elevation oncology",
+      "bristol myers squibb foundation",
+      "calithera biosciences",
       "takeda",
       "black diamond therapeutics",
-      "inc",
-      "crispr therapeutics",
-      "pfizer",
-      "elevation oncology",
-      "dohme",
-      "dizal\npharma",
-      "glaxosmithkline",
-      "bristol-myers squibb",
-      "msd",
-      "trizell",
+      "novartis",
+      "bayer",
       "bristol myers squibb",
-      "janssen",
-      "astex pharmaceuticals",
-      "bms",
+      "constellation pharmaceuticals",
+      "oncomed",
+      "jazz pharmaceuticals",
+      "msd",
+      "glaxosmithkline canada",
+      "blueprint medicines",
+      "therapeutics",
+      "roche",
+      "neogenomics",
+      "turning point therapeutics",
+      "janssen oncology",
+      "lilly",
+      "black diamond\ntherapeutics",
       "abbvie",
-      "cullinan oncology",
+      "astra zeneca",
+      "harpoon therapeutics",
+      "inhibrx",
       "gsk",
-      "polaris",
+      "pfizer",
       "revolution medicines",
-      "janssen oncology",
-      "bristol myers squibb foundation",
+      "advaxis",
+      "dizal pharma",
+      "merck",
+      "janssen",
+      "oric pharmaceuticals",
+      "macrogenics",
+      "summit therapeutics",
+      "genentech",
+      "bristol myers\nsquibb",
+      "glaxosmithkline",
+      "bms",
       "amgen",
-      "lilly",
-      "vivace therapeutics",
-      "glaxosmithkline canada",
-      "calithera biosciences",
-      "novartis",
-      "jazz pharmaceuticals",
       "puma biotechnology",
-      "sutro biopharma",
-      "astra zeneca",
-      "exelixis",
-      "palobiofarma",
-      "medimmune",
-      "turning point therapeutics",
-      "guardant health",
-      "anheart therapeutics",
-      "genentech",
-      "regeneron",
+      "vivace therapeutics",
+      "nuvation bio",
+      "pharmamar",
       "astrazeneca canada",
-      "black diamond\ntherapeutics"
+      "medimmune",
+      "forward",
+      "astrazeneca",
+      "polaris",
+      "inc",
+      "bristol-myers squibb",
+      "trizell",
+      "dizal\npharma",
+      "mirati therapeutics",
+      "dohme",
+      "crispr\ntherapeutics"
     ],
     "pfizer": [
       "inst"
@@ -254,8 +254,8 @@
       "inst"
     ],
     "bristol-myers squibb": [
-      "bms",
-      "inst"
+      "inst",
+      "bms"
     ],
     "medimmune": [
       "inst"
@@ -264,8 +264,8 @@
       "limited stage"
     ],
     "limited stage": [
-      "of patients with stage i to iii sclc",
-      "of patients with\nstage i to iii sclc"
+      "of patients with\nstage i to iii sclc",
+      "of patients with stage i to iii sclc"
     ],
     "small-cell lung cancer": [
       "nsclc",
@@ -275,14 +275,14 @@
       "sclc"
     ],
     "sclc": [
-      "or small-cell lung cancer",
+      "small cell lung cancer",
       "and small-cell lung cancer",
       "trial in small cell lung cancer",
-      "small cell lung cancer"
+      "or small-cell lung cancer"
     ],
     "cancer": [
-      "nsclc",
-      "relay"
+      "relay",
+      "nsclc"
     ],
     "and small-cell lung cancer": [
       "sclc"
@@ -304,18 +304,18 @@
       "continued"
     ],
     "continued": [
-      "all recommendations",
       "medical guideline document - esmo open references",
+      "all recommendations",
       "the bottom line"
     ],
     "salvage stereotactic body radiation therapy": [
       "sbrt"
     ],
     "sbrt": [
-      "fdg-pet and stereotactic body radiotherapy",
       "stereotactic body radiotherapy",
       "salvage stereotactic body radiation therapy",
-      "sabr or stereotactic body radiotherapy"
+      "sabr or stereotactic body radiotherapy",
+      "fdg-pet and stereotactic body radiotherapy"
     ],
     "oncomed": [
       "inst"
@@ -371,8 +371,8 @@
       "inst"
     ],
     "bristol myers\nsquibb": [
-      "bms",
-      "inst"
+      "inst",
+      "bms"
     ],
     "polaris": [
       "inst"
@@ -411,8 +411,8 @@
       "icis"
     ],
     "icis": [
-      "neoadjuvant immune checkpoint inhibitors",
-      "immune checkpoint inhibitors"
+      "immune checkpoint inhibitors",
+      "neoadjuvant immune checkpoint inhibitors"
     ],
     "american society of clinical oncology": [
       "asco"
@@ -434,10 +434,10 @@
     ],
     "bms": [
       "bristol\nmyers squibb",
-      "bristol-myers\nsquibb",
       "bristol myers\nsquibb",
-      "celgene",
+      "bristol-myers\nsquibb",
       "bristol-myers squibb",
+      "celgene",
       "inst",
       "bristol myers squibb"
     ],
@@ -457,36 +457,36 @@
       "rct"
     ],
     "rct": [
-      "phase iii randomised clinical trial",
       "one randomized controlled trial",
-      "a phase iii randomised clinical trial",
+      "phase iib\nrandomised controlled trial",
+      "phase iii randomised clinical trial",
       "phase iib randomised controlled trial",
-      "phase iib\nrandomised controlled trial"
+      "a phase iii randomised clinical trial"
     ],
     "the primary end point of progression-free survival": [
       "pfs"
     ],
     "pfs": [
-      "reported improved progression-free survival",
-      "reported improved\nprogression-free survival",
-      "the median progression-free survival",
+      "quality of life and progression-free survival",
       "the primary end point of progression-free survival",
-      "no\nimprovement in progression-free survival",
       "and\nprogression-free survival",
       "the median progression-free\nsurvival",
+      "no\nimprovement in progression-free survival",
+      "reported improved\nprogression-free survival",
+      "the median progression-free survival",
       "and progression-free survival",
-      "quality of life and progression-free survival",
+      "progression-free survival",
       "the median\nprogression-free survival",
-      "progression-free survival"
+      "reported improved progression-free survival"
     ],
     "adverse events": [
       "all-cause",
       "aes"
     ],
     "aes": [
-      "adverse\nevents",
+      "mainly altered lipid levels",
       "adverse events",
-      "mainly altered lipid levels"
+      "adverse\nevents"
     ],
     "and consolidation": [
       "for unresectable stage iii nsclc"
@@ -498,8 +498,8 @@
       "osimertinib"
     ],
     "osimertinib": [
-      "treatment is now an\negfr-targeted drug",
       "osi",
+      "treatment is now an\negfr-targeted drug",
       "treatment is now an egfr-targeted drug"
     ],
     "inc": [
@@ -519,8 +519,8 @@
       "vegf"
     ],
     "vegf": [
-      "and vascular endothelial growth factor",
-      "and vascular\nendothelial growth factor"
+      "and vascular\nendothelial growth factor",
+      "and vascular endothelial growth factor"
     ],
     "though rates of\nimmune-related aes": [
       "iraes"
@@ -530,8 +530,8 @@
       "though rates of\nimmune-related aes"
     ],
     "bristol myers squibb": [
-      "bms",
-      "inst"
+      "inst",
+      "bms"
     ],
     "palobiofarma": [
       "inst"
@@ -625,9 +625,9 @@
     ],
     "health research methods": [
       "asco practice guidelines staff",
-      "va asco practice guideline staff",
       "va asco practice guidelines staff",
-      "asco practice guideline staff"
+      "asco practice guideline staff",
+      "va asco practice guideline staff"
     ],
     "in tyrosine kinase inhibitor": [
       "tki"
@@ -640,10 +640,10 @@
       "orr"
     ],
     "orr": [
-      "- objective response rate",
-      "reuss et al\n\n\n\nrate",
       "rate",
-      "which had an overall response rate"
+      "reuss et al\n\n\n\nrate",
+      "which had an overall response rate",
+      "- objective response rate"
     ],
     "disease control rate": [
       "dcr"
@@ -661,11 +661,11 @@
       "dor"
     ],
     "dor": [
-      "with a median duration of response",
       "the median duration of response",
       "the median\nduration of response",
       "with a median duration of\nresponse",
-      "- duration of response"
+      "- duration of response",
+      "with a median duration of response"
     ],
     "the most common treatment-emergent adverse events": [
       "teaes"
@@ -733,9 +733,9 @@
       "durvalumab"
     ],
     "durvalumab": [
-      "consolidation immunotherapy",
       "if ps improves\n\nv\n\nconsolidation immunotherapy",
-      "if ps improves\n- consolidation immunotherapy"
+      "if ps improves\n- consolidation immunotherapy",
+      "consolidation immunotherapy"
     ],
     "if ps improves\n\nv\n\nconsolidation immunotherapy": [
       "durvalumab"
@@ -757,9 +757,9 @@
       "crs"
     ],
     "crs": [
+      "the most common ae was cytokine release syndrome",
       "cytokine release syndrome",
-      "the most\ncommon ae was cytokine release syndrome",
-      "the most common ae was cytokine release syndrome"
+      "the most\ncommon ae was cytokine release syndrome"
     ],
     "asco-ontario health": [
       "cancer care ontario"
@@ -783,14 +783,14 @@
       "fda"
     ],
     "fda": [
-      "or food and drug administration",
-      "and the united states food and drug administration",
       "the food and drug administration",
       "the us food and drug administration",
+      "or food and drug administration",
       "food and drug administration",
+      "and the united states food and drug administration",
+      "entrectinib received food and drug administration",
       "entrectinib received food and\ndrug administration",
-      "and the food and drug administration",
-      "entrectinib received food and drug administration"
+      "and the food and drug administration"
     ],
     "cytokine release syndrome": [
       "crs"
@@ -812,13 +812,13 @@
       "nets"
     ],
     "nets": [
-      "tumors",
+      "has grouped lung and thymic neuroendocrine\ntumours",
       "has grouped lung and thymic neuroendocrine tumours",
-      "has grouped lung and thymic neuroendocrine\ntumours"
+      "tumors"
     ],
     "small cell lung cancer": [
-      "sclc",
-      "nsclc"
+      "nsclc",
+      "sclc"
     ],
     "and\nlarge cell neuroendocrine carcinoma": [
       "lcnec"
@@ -831,8 +831,8 @@
       "thc"
     ],
     "thc": [
-      "and thymic carcinoid",
-      "and thymic\ncarcinoid"
+      "and thymic\ncarcinoid",
+      "and thymic carcinoid"
     ],
     "org": [
       "esmo guidelines committee"
@@ -888,9 +888,9 @@
       "ssas"
     ],
     "ssas": [
-      "-labelled somatostatin analogues",
       "medical options",
-      "what is the role of somatostatin analogues"
+      "what is the role of somatostatin analogues",
+      "-labelled somatostatin analogues"
     ],
     "urinary-free cortisol": [
       "ufc"
@@ -936,18 +936,18 @@
     ],
     "cht": [
       "platinum-based chemo\ntherapy",
-      "over platinum-based doublet\nchemotherapy",
-      "with or without prior adjuvant chemotherapy",
       "mainly cytotoxic chemotherapy",
-      "the addition of the chemotherapy",
       "platinum-based chemotherapy",
+      "the addition of the chemotherapy",
+      "over platinum-based doublet chemotherapy",
+      "over platinum-based doublet\nchemotherapy",
+      "with or without prior adjuvant chemotherapy",
       "chemotherapy",
-      "the beneficial effects of adjuvant chemotherapy",
-      "over platinum-based doublet chemotherapy"
+      "the beneficial effects of adjuvant chemotherapy"
     ],
     "or systemic therapies": [
-      "with options\ndiscussed in these guidelines",
-      "with options discussed in these guidelines"
+      "with options discussed in these guidelines",
+      "with options\ndiscussed in these guidelines"
     ],
     "with options\ndiscussed in these guidelines": [
       "or systemic therapies"
@@ -966,8 +966,8 @@
       "pth"
     ],
     "pth": [
-      "annals of oncology\n\n\n\nparathyroid hormone",
-      "parathyroid hormone"
+      "parathyroid hormone",
+      "annals of oncology\n\n\n\nparathyroid hormone"
     ],
     "palliative surgery\nor radiofrequency ablation": [
       "rfa"
@@ -1036,19 +1036,19 @@
       "folfox"
     ],
     "folfox": [
-      "-fluorouracil",
-      "uorouracil"
+      "uorouracil",
+      "-fluorouracil"
     ],
     "as alternative second-line": [
-      "in case of\nuncontrolled cs",
-      "in case of uncontrolled cs"
+      "in case of uncontrolled cs",
+      "in case of\nuncontrolled cs"
     ],
     "in case of\nuncontrolled cs": [
       "as alternative second-line"
     ],
     "or mainly third-line therapy": [
-      "beyond ssas and or everolimus",
-      "beyond\nssas and or everolimus"
+      "beyond\nssas and or everolimus",
+      "beyond ssas and or everolimus"
     ],
     "beyond\nssas and or everolimus": [
       "or mainly third-line therapy"
@@ -1085,12 +1085,12 @@
     ],
     "esmo-mcbs": [
       "esmo-magnitude of clinical benefit scale",
-      "esmomagnitude of clinical benefit scale",
-      "esmo-magnitude of clinical\nbenefit",
+      "esmo-magnitude of clinical benefit",
       "esmo-magnitude of\nclinical benefit",
+      "esmomagnitude of clinical benefit scale",
+      "an esmo magnitude of clinical benefit scale",
       "an esmo\nmagnitude of clinical benefit scale",
-      "esmo-magnitude of clinical benefit",
-      "an esmo magnitude of clinical benefit scale"
+      "esmo-magnitude of clinical\nbenefit"
     ],
     "advanced carcinoids of the lung and thymus": [
       "luna"
@@ -1144,8 +1144,8 @@
       "chuv"
     ],
     "chuv": [
-      "centre hospitalier universitaire vaudois",
-      "centre hospitalier universitaire\nvaudois"
+      "centre hospitalier universitaire\nvaudois",
+      "centre hospitalier universitaire vaudois"
     ],
     "comparing low-dose computed tomography": [
       "ldct"
@@ -1178,10 +1178,10 @@
     ],
     "who": [
       "world health organization",
-      "global",
       "the recent world health organization",
-      "global statistics",
-      "vs universal"
+      "vs universal",
+      "global",
+      "global statistics"
     ],
     "with its further sub-classification of": [
       "surgically resected"
@@ -1230,17 +1230,17 @@
     ],
     "uicc": [
       "union for international\ncancer control",
-      "the union for international cancer control",
       "the union for\ninternational cancer control",
+      "the union for international cancer control",
       "union for international cancer control"
     ],
     "node and metastasis": [
       "tnm"
     ],
     "tnm": [
+      "node and metastasis",
       "tumourenodeemetastasis",
-      "tumour-node-metastasis",
-      "node and metastasis"
+      "tumour-node-metastasis"
     ],
     "proposed\nthat ais be classified as tis": [
       "ais"
@@ -1255,8 +1255,8 @@
       "sub"
     ],
     "sub": [
-      "a should be restricted to the same histological",
-      "research support as"
+      "research support as",
+      "a should be restricted to the same histological"
     ],
     "videoassisted mediastinoscopy": [
       "vam"
@@ -1268,9 +1268,9 @@
       "accp"
     ],
     "accp": [
-      "the american college of chest physicians",
+      "the\namerican college of chest physicians",
       "whereas the american college of chest physicians",
-      "the\namerican college of chest physicians"
+      "the american college of chest physicians"
     ],
     "adjuvant chemotherapy": [
       "radiotherapy"
@@ -1347,11 +1347,11 @@
       "neo"
     ],
     "neo": [
+      "the\nimmune strategy in the",
       "- immunotherapy is being studied in early nsclc as",
-      "immunotherapy is being studied in early nsclc as",
       "resection and after",
-      "the\nimmune strategy in the",
-      "the immune strategy in the"
+      "the immune strategy in the",
+      "immunotherapy is being studied in early nsclc as"
     ],
     "cl\n\ntreatment of locally advanced stage": [
       "stage ill"
@@ -1385,8 +1385,8 @@
     ],
     "ests": [
       "and the european\nsociety of thoracic surgeons",
-      "and the european society of thoracic surgeons",
-      "and european society of thoracic surgeons"
+      "and european society of thoracic surgeons",
+      "and the european society of thoracic surgeons"
     ],
     "gv scagliotti": [
       "eds"
@@ -1398,8 +1398,8 @@
       "thoracoscore"
     ],
     "thoracoscore": [
-      "the thoracic surgery scoring system",
-      "the thoracic surgery scoring\nsystem"
+      "the thoracic surgery scoring\nsystem",
+      "the thoracic surgery scoring system"
     ],
     "stereotactic body radiotherapy": [
       "sbrt"
@@ -1430,11 +1430,11 @@
       "stage iii"
     ],
     "stage iii": [
+      "- locally advanced nsclc",
       "and unresectable locally advanced",
-      "treatment of locally advanced stage",
+      "unresectable nsclc",
       "locally advanced nsclc",
-      "- locally advanced nsclc",
-      "unresectable nsclc"
+      "treatment of locally advanced stage"
     ],
     "in paral\npractice guidelines": [
       "cpgs"
@@ -1446,9 +1446,9 @@
       "see panel members listed in the appendix"
     ],
     "see panel members listed in the appendix": [
-      "and a general consen\nconsensus process",
+      "experts were involved in this\nconsensus process",
       "experts were involved in this consensus process",
-      "experts were involved in this\nconsensus process"
+      "and a general consen\nconsensus process"
     ],
     "experts were involved in this\nconsensus process": [
       "see panel members listed in the appendix"
@@ -1491,8 +1491,8 @@
       "sub-lobar"
     ],
     "sub-lobar": [
-      "for which patients is limited",
-      "special articles\n\n\n\nfor which patients is limited"
+      "special articles\n\n\n\nfor which patients is limited",
+      "for which patients is limited"
     ],
     "especially those with ground-glass\nopacity": [
       "ggo"
@@ -1508,9 +1508,9 @@
       "sabr"
     ],
     "sabr": [
+      "consolidative stereotactic ablative radiotherapy",
       "other approaches such as local ablative",
-      "solidative stereotactic ablative radiotherapy",
-      "consolidative stereotactic ablative radiotherapy"
+      "solidative stereotactic ablative radiotherapy"
     ],
     "some trials": [
       "ialt"
@@ -1537,9 +1537,9 @@
       "prevalence"
     ],
     "prevalence": [
+      "results of\nthe initial",
       "results of the initial",
-      "results of the\ninitial",
-      "results of\nthe initial"
+      "results of the\ninitial"
     ],
     "results of the\ninitial": [
       "prevalence"
@@ -1548,8 +1548,8 @@
       "prevalance"
     ],
     "prevalance": [
-      "results of the initial",
-      "results\nof the initial"
+      "results\nof the initial",
+      "results of the initial"
     ],
     "the thoracic surgery scoring system": [
       "thoracoscore"
@@ -1567,9 +1567,9 @@
       "vumc"
     ],
     "vumc": [
+      "university medical centre",
       "vrije university medical centre",
-      "vrije\nuniversity medical centre",
-      "university medical centre"
+      "vrije\nuniversity medical centre"
     ],
     "university medical centre": [
       "vumc"
@@ -1582,12 +1582,12 @@
     ],
     "pbc": [
       "five cycles of tremelimumab",
-      "platinum-based doublet chemotherapy",
-      "five cycles of\n\ntremelimumab"
+      "five cycles of\n\ntremelimumab",
+      "platinum-based doublet chemotherapy"
     ],
     "carboplatin": [
-      "arm b",
-      "arm a"
+      "arm a",
+      "arm b"
     ],
     "arm a": [
       "carboplatin"
@@ -1606,19 +1606,19 @@
       "primary endpoint"
     ],
     "primary endpoint": [
+      "-year os",
       "pbc\nsignificantly improved pfs",
+      "pbc significantly improved pfs",
       "level",
-      "-year os",
-      "significantly improved os",
-      "pbc significantly improved pfs"
+      "significantly improved os"
     ],
     "besides immune checkpoint\n\ninhibitor": [
       "ici"
     ],
     "ici": [
       "besides immune checkpoint inhibitor",
-      "besides immune checkpoint\n\ninhibitor",
-      "and have no prior immune checkpoint inhibitor"
+      "and have no prior immune checkpoint inhibitor",
+      "besides immune checkpoint\n\ninhibitor"
     ],
     "esmo-magnitude of clinical benefit scale": [
       "mcbs",
@@ -1652,8 +1652,8 @@
       "ttfields"
     ],
     "ttfields": [
-      "tumour treating\nfields",
-      "tumour treating fields"
+      "tumour treating fields",
+      "tumour treating\nfields"
     ],
     "significantly improved os": [
       "primary endpoint"
@@ -1663,9 +1663,9 @@
     ],
     "esmo guidelines staff": [
       "ioanna ntai and claire bramley",
+      "jennifer\nlamarre and guy atchison",
       "jennifer lamarre and guy atchison",
-      "valerie laforest",
-      "jennifer\nlamarre and guy atchison"
+      "valerie laforest"
     ],
     "valerie laforest": [
       "esmo\nguidelines staff",
@@ -1679,9 +1679,9 @@
     ],
     "esmo scientific affairs staff": [
       "nicola\nlatino",
-      "nicola\nlatino and francesca chiovaro",
       "nicola latino and francesca chiovaro",
       "nicola latino",
+      "nicola\nlatino and francesca chiovaro",
       "nicola latino and\nfrancesca chiovaro"
     ],
     "bristol\nmyers squibb": [
@@ -1700,8 +1700,8 @@
       "ipsos"
     ],
     "ipsos": [
-      "roche and                                regimen",
-      "with a platinum-containing\nregimen"
+      "with a platinum-containing\nregimen",
+      "roche and                                regimen"
     ],
     "esmo clinical practice guideline": [
       "cpg"
@@ -1719,9 +1719,9 @@
       "ngs"
     ],
     "ngs": [
+      "multiplex platforms",
       "such as next-generation sequencing",
-      "by next-generation sequencing",
-      "multiplex platforms"
+      "by next-generation sequencing"
     ],
     "egfr fish or immunohistochemistry": [
       "ihc"
@@ -1733,8 +1733,8 @@
       "ntrk"
     ],
     "ntrk": [
-      "or neurotrophic tyrosine receptor kinase",
       "or neurotrophic tyrosine\nreceptor kinase",
+      "or neurotrophic tyrosine receptor kinase",
       "- the neurotrophic receptor tyrosine kinase",
       "and the neurotrophic receptor tyrosine\nkinase"
     ],
@@ -1755,8 +1755,8 @@
       "cfdna"
     ],
     "cfdna": [
-      "what is the role of liquid biopsy",
       "cell-free dna",
+      "what is the role of liquid biopsy",
       "liquid biopsy"
     ],
     "multiplex platforms": [
@@ -1781,8 +1781,8 @@
       "fdg"
     ],
     "fdg": [
-      "e\ndeoxy-d-glucose",
-      "-deoxy-d-glucose"
+      "-deoxy-d-glucose",
+      "e\ndeoxy-d-glucose"
     ],
     "union for international\ncancer control": [
       "uicc"
@@ -1804,17 +1804,17 @@
       "mpfs"
     ],
     "mpfs": [
-      "demonstrating a superior median pfs",
-      "demonstrating a superior\nmedian pfs"
+      "demonstrating a superior\nmedian pfs",
+      "demonstrating a superior median pfs"
     ],
     "and median os": [
       "mos"
     ],
     "mos": [
-      "the malaysian oncological society",
-      "and median os",
       "malaysian oncological society",
-      "malaysia"
+      "and median os",
+      "malaysia",
+      "the malaysian oncological society"
     ],
     "systemic progression\n\nlocal treatment": [
       "surgery or ft"
@@ -1848,15 +1848,15 @@
       "japan"
     ],
     "japan": [
-      "j-alex",
-      "jsmo"
+      "jsmo",
+      "j-alex"
     ],
     "and\nalesia": [
       "asia"
     ],
     "asia": [
-      "and alesia",
-      "and\nalesia"
+      "and\nalesia",
+      "and alesia"
     ],
     "and continue targeted": [
       "not mandatory for decision"
@@ -1889,8 +1889,8 @@
       "mdor"
     ],
     "mdor": [
-      "the median duration of response",
-      "the\nmedian duration of response"
+      "the\nmedian duration of response",
+      "the median duration of response"
     ],
     "tropomyosin receptor tyrosine kinase": [
       "trk"
@@ -1902,10 +1902,10 @@
       "surgery or rt"
     ],
     "surgery or rt": [
-      "disease progression\n\nlocal treatment",
-      "- local treatment",
       "local treatment",
-      "oligoprogression\n\nlocal treatment"
+      "disease progression\n\nlocal treatment",
+      "oligoprogression\n\nlocal treatment",
+      "- local treatment"
     ],
     "or combination therapy with a mek inhibitor": [
       "trametinib"
@@ -1932,8 +1932,8 @@
       "kras"
     ],
     "kras": [
-      "the kirsten rat sarcoma virus",
-      "the\nkirsten rat sarcoma virus"
+      "the\nkirsten rat sarcoma virus",
+      "the kirsten rat sarcoma virus"
     ],
     "data regarding the role of local ablative therapy": [
       "lat"
@@ -1951,8 +1951,8 @@
       "robotic systems"
     ],
     "robotic systems": [
-      "in particular with the use of modern technologies",
-      "in particular with the use\nof modern technologies"
+      "in particular with the use\nof modern technologies",
+      "in particular with the use of modern technologies"
     ],
     "esmo-magnitude of\nclinical benefit": [
       "esmo-mcbs"
@@ -1961,9 +1961,9 @@
       "high-dose rt or surgery"
     ],
     "high-dose rt or surgery": [
-      "may benefit from lat",
+      "may\nbenefit from lat",
       "from lat",
-      "may\nbenefit from lat"
+      "may benefit from lat"
     ],
     "jennifer\nlamarre and guy atchison": [
       "esmo guidelines staff"
@@ -1972,9 +1972,9 @@
       "esmo scientific affairs staff"
     ],
     "and dr svetlana jezdic": [
-      "esmo medical affairs staff",
       "esmo\nmedical affairs advisor",
-      "esmo medical affairs advisor"
+      "esmo medical affairs advisor",
+      "esmo medical affairs staff"
     ],
     "esmo\nmedical affairs advisor": [
       "and dr svetlana jezdic"
@@ -1986,15 +1986,15 @@
       "atorg"
     ],
     "atorg": [
-      "asian thoracic oncology research group",
-      "asian\nthoracic oncology research group"
+      "asian\nthoracic oncology research group",
+      "asian thoracic oncology research group"
     ],
     "chinese lung\ncancer research foundation limited": [
       "clcrf"
     ],
     "clcrf": [
-      "chinese lung cancer research foundation limited",
-      "chinese lung\ncancer research foundation limited"
+      "chinese lung\ncancer research foundation limited",
+      "chinese lung cancer research foundation limited"
     ],
     "chinese society of clinical oncology": [
       "csco"
@@ -2042,8 +2042,8 @@
       "rtp"
     ],
     "rtp": [
-      "research to practice",
-      "research\nto practice"
+      "research\nto practice",
+      "research to practice"
     ],
     "research": [
       "ukcccr",
@@ -2084,12 +2084,12 @@
       "cancers"
     ],
     "relay": [
-      "advanced non-small-cell lung cancer",
-      "cancer"
+      "cancer",
+      "advanced non-small-cell lung cancer"
     ],
     "non-small-cell lung cancer": [
-      "nsclc",
-      "alesia"
+      "alesia",
+      "nsclc"
     ],
     "alesia": [
       "non-small-cell lung cancer"
@@ -2098,8 +2098,8 @@
       "alk"
     ],
     "advanced non-small-cell lung cancer": [
-      "nsclc",
-      "relay"
+      "relay",
+      "nsclc"
     ],
     "fda prescribing information - rozlytrek": [
       "entrectinib"
@@ -2111,9 +2111,9 @@
       "chmp"
     ],
     "chmp": [
+      "products for human use",
       "tabrecta - summary of opinion",
-      "retsevmo - summary of opinion",
-      "products for human use"
+      "retsevmo - summary of opinion"
     ],
     "tabrecta - summary of opinion": [
       "chmp"
@@ -2166,19 +2166,19 @@
       "psmo"
     ],
     "psmo": [
-      "the philippine society of medical oncology",
       "the philippine society of\nmedical oncology",
-      "the philippines",
       "and philippine society of medical\noncology",
-      "and philippine society of medical oncology"
+      "and philippine society of medical oncology",
+      "the philippines",
+      "the philippine society of medical oncology"
     ],
     "singapore": [
       "sso"
     ],
     "sso": [
       "the singapore society of\noncology",
-      "the singapore society of oncology",
-      "singapore"
+      "singapore",
+      "the singapore society of oncology"
     ],
     "taiwan": [
       "tos"
@@ -2191,9 +2191,9 @@
       "tsco"
     ],
     "tsco": [
+      "and the\nthai society of clinical oncology",
       "and the thai society of clinical oncology",
-      "and thailand",
-      "and the\nthai society of clinical oncology"
+      "and thailand"
     ],
     "and the neurotrophic receptor tyrosine\nkinase": [
       "ntrk"
@@ -2248,15 +2248,15 @@
       "mri"
     ],
     "mri": [
-      "resonance imaging",
-      "and\na magnetic resonance imaging"
+      "and\na magnetic resonance imaging",
+      "resonance imaging"
     ],
     "-positron emission topography": [
       "pet"
     ],
     "pet": [
-      "had undergone positron emission tomography",
       "-positron emission topography",
+      "had undergone positron emission tomography",
       "of whom had undergone positron\nemission tomography"
     ],
     "union for international cancer control": [
@@ -2266,8 +2266,8 @@
       "such as osimertinib"
     ],
     "such as osimertinib": [
-      "third-generation egfr tkis",
-      "generation tki"
+      "generation tki",
+      "third-generation egfr tkis"
     ],
     "generation tki": [
       "such as osimertinib"
@@ -2306,9 +2306,9 @@
       "traes"
     ],
     "traes": [
-      "treatment-related aes",
+      "what are the treatment-related adverse events",
       "treatment-related adverse events",
-      "what are the treatment-related adverse events"
+      "treatment-related aes"
     ],
     "and have no prior immune checkpoint inhibitor": [
       "ici"
@@ -2339,8 +2339,8 @@
       "pap"
     ],
     "pap": [
-      "program",
-      "esmo open\n\n\n\nprogram"
+      "esmo open\n\n\n\nprogram",
+      "program"
     ],
     "mandatory national health insurance": [
       "nhi"
@@ -2358,8 +2358,8 @@
       "csmbs"
     ],
     "csmbs": [
-      "social security and government officer",
-      "social\nsecurity and government officer"
+      "social\nsecurity and government officer",
+      "social security and government officer"
     ],
     "alk inhibitors": [
       "ceritinib and brigatinib only"
@@ -2375,8 +2375,8 @@
       "and atezolizumab"
     ],
     "erlotinib and osimertinib": [
-      "second-line with reimbursement\nthrough the csmbs",
-      "second-line with reimbursement through the csmbs"
+      "second-line with reimbursement through the csmbs",
+      "second-line with reimbursement\nthrough the csmbs"
     ],
     "second-line with reimbursement\nthrough the csmbs": [
       "erlotinib and osimertinib"
@@ -2395,8 +2395,8 @@
       "torg"
     ],
     "torg": [
-      "thoracic oncology research\ngroup",
-      "thoracic oncology research group"
+      "thoracic oncology research group",
+      "thoracic oncology research\ngroup"
     ],
     "and west japan oncology group": [
       "wjog"
@@ -2405,8 +2405,8 @@
       "and west japan oncology group"
     ],
     "product samples": [
-      "non-renumerated",
-      "nonrenumerated"
+      "nonrenumerated",
+      "non-renumerated"
     ],
     "nonrenumerated": [
       "product samples"
@@ -2465,9 +2465,9 @@
       "egfrm"
     ],
     "egfrm": [
+      "with stage ibeiiia egfr mutation positive",
       "platinum-pemetrexed in egfr-mutated",
-      "with stage ib-iiia egfr mutation positive",
-      "with stage ibeiiia egfr mutation positive"
+      "with stage ib-iiia egfr mutation positive"
     ],
     "advanced non-small cell lung cancer": [
       "nsclc"
@@ -2486,14 +2486,14 @@
       "pts"
     ],
     "pts": [
-      "mo encorafenib plus\n\nbinimetinib in patients",
-      "versus docetaxel in patients",
-      "patients",
-      "osimertinib as adjuvant therapy in patients",
       "p repotrectinib in patients",
+      "mo encorafenib plus binimetinib in patients",
+      "osimertinib as adjuvant therapy in patients",
       "therapy in patients",
+      "patients",
+      "mo encorafenib plus\n\nbinimetinib in patients",
       "binimetinib in patients",
-      "mo encorafenib plus binimetinib in patients"
+      "versus docetaxel in patients"
     ],
     "mutant advanced non-small cell lung cancer": [
       "nsclc"
@@ -2508,8 +2508,8 @@
       "with epidermal growth factor receptor"
     ],
     "treatment of early stages": [
-      "stages i and ii",
       "stages i-iiia",
+      "stages i and ii",
       "stages i-ii"
     ],
     "stages i-iiia": [
@@ -2522,9 +2522,9 @@
       "ema"
     ],
     "chemotherapy": [
-      "cht",
       "- everolimus\n   - cht",
-      "adaura"
+      "adaura",
+      "cht"
     ],
     "the median\nwas not reached": [
       "ne-ne"
@@ -2543,8 +2543,8 @@
       "neo"
     ],
     "or docetaxel or pemetrexed": [
-      "only in\nadenocarcinoma tumours",
-      "only in adenocarcinoma tumours"
+      "only in adenocarcinoma tumours",
+      "only in\nadenocarcinoma tumours"
     ],
     "only in\nadenocarcinoma tumours": [
       "or docetaxel or pemetrexed"
@@ -2553,9 +2553,9 @@
       "port"
     ],
     "port": [
-      "post-operative radiotherapy",
       "postoperative radiotherapy",
-      "comparing post-operative conformal radiotherapy"
+      "comparing post-operative conformal radiotherapy",
+      "post-operative radiotherapy"
     ],
     "treatment of locally advanced stage": [
       "stage iii"
@@ -2595,8 +2595,8 @@
     ],
     "pacific": [
       "unresectable non-small-cell lung cancer",
-      "small-cell lung cancer",
-      "concurrent chemoradiation therapy"
+      "concurrent chemoradiation therapy",
+      "small-cell lung cancer"
     ],
     "adaura": [
       "chemotherapy"
@@ -2609,8 +2609,8 @@
       "approval was based on all patient data"
     ],
     "on tumour cells": [
-      "as per the ema-approved indication",
-      "as per the\nema-approved indication"
+      "as per the\nema-approved indication",
+      "as per the ema-approved indication"
     ],
     "as per the\nema-approved indication": [
       "on tumour cells"
@@ -2649,8 +2649,8 @@
       "egfrm"
     ],
     "nivolumab": [
-      "bristol myers squibb statement on opdivo",
-      "nivo"
+      "nivo",
+      "bristol myers squibb statement on opdivo"
     ],
     "nivo": [
       "nivolumab"
@@ -2659,16 +2659,16 @@
       "chemo"
     ],
     "chemo": [
-      "platinum-based chemotherapy",
       "platinum-doublet chemotherapy",
-      "platinum-doublet\nchemotherapy"
+      "platinum-doublet\nchemotherapy",
+      "platinum-based chemotherapy"
     ],
     "for\nresectable": [
       "ib-iiia"
     ],
     "ib-iiia": [
-      "for\nresectable",
-      "for resectable"
+      "for resectable",
+      "for\nresectable"
     ],
     "lung cancer": [
       "nsclc"
@@ -2837,8 +2837,8 @@
       "caspian"
     ],
     "caspian": [
-      "cer",
-      "extensive-stage small-cell lung cancer"
+      "extensive-stage small-cell lung cancer",
+      "cer"
     ],
     "cer": [
       "caspian"
@@ -2947,8 +2947,8 @@
       "esmo"
     ],
     "nice": [
-      "national institute for health and care excellence",
-      "nhs"
+      "nhs",
+      "national institute for health and care excellence"
     ],
     "national institute for health and care excellence": [
       "nice"
@@ -3215,8 +3215,8 @@
       "rfa"
     ],
     "peptide receptor radionuclide therapy": [
-      "prrt",
-      "- prrt"
+      "- prrt",
+      "prrt"
     ],
     "what is the role of somatostatin analogues": [
       "ssas"
@@ -3225,12 +3225,12 @@
       "folfox"
     ],
     "in case of uncontrolled cs": [
-      "as a potential second-line",
-      "as alternative second-line"
+      "as alternative second-line",
+      "as a potential second-line"
     ],
     "beyond ssas and or everolimus": [
-      "or mainly third-line therapy",
-      "or mainly third-line alternative"
+      "or mainly third-line alternative",
+      "or mainly third-line therapy"
     ],
     "as a potential second-line": [
       "in case of uncontrolled cs"
@@ -3535,13 +3535,13 @@
       "author"
     ],
     "author": [
-      "jchy",
-      "ddwl",
       "msi",
-      "tmk",
-      "hrk",
       "sak",
-      "cew"
+      "hrk",
+      "ddwl",
+      "tmk",
+      "cew",
+      "jchy"
     ],
     "hrk": [
       "author"
@@ -3595,8 +3595,8 @@
       "bsc"
     ],
     "expression": [
-      "for completely resected nsclc",
-      "for unresectable nsclc"
+      "for unresectable nsclc",
+      "for completely resected nsclc"
     ],
     "for unresectable nsclc": [
       "expression"
@@ -3661,23 +3661,23 @@
   },
   "abbreviations": {
     "esmo": [
-      "european\nsociety of medical oncology",
-      "the following european society for medical oncology",
       "european society for medical oncology",
-      "european society for medical\noncology",
-      "european society for\nmedical oncology",
-      "the european society for medical oncology",
+      "living guideline\n\nthe following european society for medical oncology",
       "european society of medical oncology",
+      "the following european society for medical oncology",
+      "european\nsociety of medical oncology",
+      "european society for medical\noncology",
       "the most recent european society for medical oncology",
-      "living guideline\n\nthe following european society for medical oncology"
+      "the european society for medical oncology",
+      "european society for\nmedical oncology"
     ],
     "asco": [
-      "this american society of clinical oncology",
-      "american society of clinical oncology",
-      "american society of clinical\n\noncology",
-      "american society of clinical\noncology",
       "the clinical practice guidelines published herein are provided by the american society of clinical oncology inc",
+      "american society of clinical\noncology",
+      "american society of clinical oncology",
       "american\nsociety of clinical oncology",
+      "american society of clinical\n\noncology",
+      "this american society of clinical oncology",
       "journal of clinical oncology"
     ],
     "aiom": [
@@ -3699,94 +3699,94 @@
     ],
     "mcbs": [
       "magnitude of clinical benefit score",
-      "magnitude\nof clinical benefit score",
-      "magnitude of clinical benefit scale"
+      "magnitude of clinical benefit scale",
+      "magnitude\nof clinical benefit score"
     ],
     "ema": [
-      "european medicines agency",
-      "european medicines\nagency"
+      "european medicines\nagency",
+      "european medicines agency"
     ],
     "sclc": [
-      "what is the treatment algorithm for patients with small cell lung cancer",
-      "small cell lung cancer",
       "what are the recommended treatment options for patients with relapsed small cell lung cancer",
       "clinical practice guidelines on small cell lung\ncancer",
-      "clinical practice guidelines on small cell lung cancer"
+      "clinical practice guidelines on small cell lung cancer",
+      "what is the treatment algorithm for patients with small cell lung cancer",
+      "small cell lung cancer"
     ],
     "cco": [
       "cancer care ontario"
     ],
     "astro": [
-      "executive summary of an american society for radiation oncology",
-      "executive summary of an american society for\nradiation oncology"
+      "executive summary of an american society for\nradiation oncology",
+      "executive summary of an american society for radiation oncology"
     ],
     "inst": [
-      "boehringer ingelheim",
-      "blueprint medicines",
-      "immune",
-      "roche",
-      "dizal pharma",
-      "bayer",
-      "constellation pharmaceuticals",
-      "summit therapeutics",
       "pharmaceuticals",
+      "exelixis",
+      "astex pharmaceuticals",
+      "boehringer ingelheim",
+      "regeneron",
+      "myers squibb",
+      "cullinan oncology",
+      "guardant health",
+      "arcus biosciences",
+      "palobiofarma",
+      "sutro biopharma",
       "merck serono",
-      "inhibrx",
       "verastem",
-      "harpoon therapeutics",
-      "macrogenics",
-      "nuvation bio",
-      "therapeutics",
-      "merck",
-      "forward",
-      "advaxis",
-      "arcus biosciences",
-      "bristol myers\nsquibb",
-      "mirati therapeutics",
+      "genomics",
+      "elevation oncology",
+      "bristol myers squibb foundation",
+      "calithera biosciences",
       "takeda",
       "black diamond therapeutics",
-      "dohme",
-      "pfizer",
-      "elevation oncology",
-      "dizal\npharma",
-      "zeneca canada",
-      "kline",
-      "zeneca",
-      "trizell",
+      "novartis",
       "bristol myers squibb",
-      "janssen",
-      "astex pharmaceuticals",
-      "cullinan oncology",
-      "polaris",
-      "revolution medicines",
+      "bayer",
+      "constellation pharmaceuticals",
+      "jazz pharmaceuticals",
+      "therapeutics",
+      "blueprint medicines",
+      "roche",
+      "turning point therapeutics",
       "janssen oncology",
-      "bristol myers squibb foundation",
-      "amgen",
       "lilly",
-      "vivace therapeutics",
-      "heart therapeutics",
-      "calithera biosciences",
-      "novartis",
       "kline canada",
-      "jazz pharmaceuticals",
-      "genomics",
-      "puma biotechnology",
-      "myers squibb",
-      "sutro biopharma",
+      "black diamond\ntherapeutics",
+      "zeneca",
       "astra zeneca",
-      "exelixis",
-      "palobiofarma",
-      "turning point therapeutics",
-      "guardant health",
+      "harpoon therapeutics",
+      "inhibrx",
+      "kline",
+      "pfizer",
+      "revolution medicines",
+      "advaxis",
+      "dizal pharma",
+      "heart therapeutics",
+      "merck",
+      "janssen",
+      "macrogenics",
+      "summit therapeutics",
       "genentech",
-      "regeneron",
-      "black diamond\ntherapeutics"
+      "bristol myers\nsquibb",
+      "amgen",
+      "puma biotechnology",
+      "vivace therapeutics",
+      "zeneca canada",
+      "nuvation bio",
+      "immune",
+      "forward",
+      "polaris",
+      "dizal\npharma",
+      "trizell",
+      "mirati therapeutics",
+      "dohme"
     ],
     "ct": [
-      "clinicians should use a diagnostic chest computed tomography",
       "computed tomography",
-      "the use of\ncomputed tomography",
-      "the use of computed tomography"
+      "clinicians should use a diagnostic chest computed tomography",
+      "the use of computed tomography",
+      "the use of\ncomputed tomography"
     ],
     "mri": [
       "what is the role of brain magnetic resonance imaging"
@@ -3800,15 +3800,15 @@
       "college of american pathologists"
     ],
     "iaslc": [
-      "international association for\nthe study of lung cancer",
-      "pathology committee chair for international association for the study of lung cancer",
       "study of lung cancer",
-      "the\ninternational association for the study of lung cancer",
-      "international association for the study of lung cancer",
       "pathology committee chair\nfor international association for the study of lung cancer",
+      "international association for\nthe study of lung cancer",
+      "international association for the study of lung cancer",
+      "international association for the\nstudy of lung cancer",
       "international association for the\n\nstudy of lung cancer",
       "the international association for the study of lung cancer",
-      "international association for the\nstudy of lung cancer"
+      "the\ninternational association for the study of lung cancer",
+      "pathology committee chair for international association for the study of lung cancer"
     ],
     "amp": [
       "association for molecular pathology",
@@ -3826,9 +3826,9 @@
     "os": [
       "the median overall survival",
       "the only data published thus far pertain to the dual primary end points of overall survival",
-      "overall survival",
       "median overall survival",
-      "the median\noverall survival"
+      "the median\noverall survival",
+      "overall survival"
     ],
     "elsevier": [
       "clinical lung cancer"
@@ -3841,23 +3841,23 @@
       "eastern cooperative oncology group performance\nstatus"
     ],
     "orr": [
-      "is result in a lower overall response\nrate",
       "objective response rate",
       "reuss et al\n\n\n\nrate",
-      "is result in a lower overall response rate"
+      "is result in a lower overall response rate",
+      "is result in a lower overall response\nrate"
     ],
     "pci": [
-      "prophylactic cranial irradiation",
-      "what is the role of prophylactic cranial irradiation"
+      "what is the role of prophylactic cranial irradiation",
+      "prophylactic cranial irradiation"
     ],
     "fda": [
       "osimertinib is approved by both the united states food and drug administration",
-      "food and drug administration",
+      "osimertinib is approved by both the united states food and\ndrug administration",
       "united states food and drug administration",
+      "food and drug administration",
       "these results led to the food\n\nand drug administration",
-      "entrectinib received food and\ndrug administration",
-      "osimertinib is approved by both the united states food and\ndrug administration",
-      "entrectinib received food and drug administration"
+      "entrectinib received food and drug administration",
+      "entrectinib received food and\ndrug administration"
     ],
     "crs": [
       "cytokine release syndrome"
@@ -3866,10 +3866,10 @@
       "department of surgical sciences"
     ],
     "who": [
+      "the latest world health organization",
       "world health organization",
-      "global",
       "the recent world health organization",
-      "the latest world health organization",
+      "global",
       "global statistics"
     ],
     "lc": [
@@ -3881,11 +3881,11 @@
       "epidemiology and end results"
     ],
     "uicc": [
+      "union for international cancer control",
       "union for international\ncancer control",
-      "union for\ninternational cancer control",
-      "edition of the union for\ninternational cancer control",
       "edition of the union for international cancer control",
-      "union for international cancer control"
+      "edition of the union for\ninternational cancer control",
+      "union for\ninternational cancer control"
     ],
     "gep": [
       "based on\napproval and recommendations in gastroenteropancreatic",
@@ -3900,9 +3900,9 @@
       "for these patients radiofrequency ablation"
     ],
     "recist": [
-      "measurements and response assessment should follow response evaluation criteria in solid tumours",
-      "cs with response evaluation criteria\nin solid tumours",
       "cs with response evaluation criteria in solid tumours",
+      "cs with response evaluation criteria\nin solid tumours",
+      "measurements and response assessment should follow response evaluation criteria in solid tumours",
       "measurements and response assessment should follow\nresponse evaluation criteria in solid tumours"
     ],
     "gemox": [
@@ -3912,12 +3912,12 @@
       "lanreotide autogel"
     ],
     "chuv": [
-      "centre hospitalier universitaire vaudois",
-      "centre hospitalier universitaire\nvaudois"
+      "centre hospitalier universitaire\nvaudois",
+      "centre hospitalier universitaire vaudois"
     ],
     "nlst": [
-      "national cancer institute announced the results of the national lung cancer screening trial",
       "national cancer institute\nannounced the results of the national lung cancer screening\ntrial",
+      "national cancer institute announced the results of the national lung cancer screening trial",
       "the much larger national lung cancer screening trial"
     ],
     "bts": [
@@ -3945,8 +3945,8 @@
     ],
     "rtog": [
       "radiation therapy oncology group",
-      "data from a completed prospective radiation therapy oncology group",
-      "data from a completed prospective\nradiation therapy oncology group"
+      "data from a completed prospective\nradiation therapy oncology group",
+      "data from a completed prospective radiation therapy oncology group"
     ],
     "esge": [
       "european society of gastrointestinal endoscopy"
@@ -3955,21 +3955,21 @@
       "european respiratory society"
     ],
     "ests": [
-      "european society of thoracic surgeons",
+      "european association of thoracic surgeons",
       "european\nsociety of thoracic surgeons",
-      "european association of thoracic surgeons"
+      "european society of thoracic surgeons"
     ],
     "thoracoscore": [
-      "the thoracic surgery scoring system",
-      "the thoracic surgery scoring\nsystem"
+      "the thoracic surgery scoring\nsystem",
+      "the thoracic surgery scoring system"
     ],
     "pulmonology": [
       "respiratory oncology",
       "respiratory oncology unit"
     ],
     "acs": [
-      "lung cancer screening guidelines published by the american cancer society",
-      "lung cancer screening guidelines published by the\namerican cancer society"
+      "lung cancer screening guidelines published by the\namerican cancer society",
+      "lung cancer screening guidelines published by the american cancer society"
     ],
     "ialt": [
       "some trials"
@@ -3978,44 +3978,44 @@
       "adjuvant navelbine international trialist association"
     ],
     "sabr": [
-      "radiographic changes after lung stereotactic ablative radiotherapy",
       "what are the indications and recommendations for salvage surgery after stereotactic ablative radiotherapy",
       "consolidative stereotactic ablative radiotherapy",
+      "radiographic changes after lung stereotactic ablative radiotherapy",
       "what are the outcomes comparing stereotactic ablative radiotherapy",
       "radiographic changes after lung stereotactic\nablative radiotherapy"
     ],
     "vumc": [
+      "university medical centre",
       "vrije university medical centre",
-      "vrije\nuniversity medical centre",
-      "university medical centre"
+      "vrije\nuniversity medical centre"
     ],
     "ub": [
       "bemeneed"
     ],
     "bms": [
+      "myers squibb",
+      "myers\nsquibb",
       "bristol\nmyers squibb",
       "bristol myers\nsquibb",
-      "myers\nsquibb",
-      "bristol myers squibb",
-      "myers squibb"
+      "bristol myers squibb"
     ],
     "msd": [
       "dohme"
     ],
     "eortc": [
       "chair of the european organisation for research and treatment of cancer",
-      "european\norganisation for research and treatment of cancer",
       "treatment of cancer",
+      "chair of the european\norganisation for research and treatment of cancer",
       "european organisation for research and treatment of cancer",
-      "chair of the european\norganisation for research and treatment of cancer"
+      "european\norganisation for research and treatment of cancer"
     ],
     "cpg": [
       "clinical practice guideline"
     ],
     "escat": [
+      "scale for clinical actionability of\nmolecular targets",
       "targets",
-      "scale for clinical actionability of molecular targets",
-      "scale for clinical actionability of\nmolecular targets"
+      "scale for clinical actionability of molecular targets"
     ],
     "alk": [
       "positive anaplastic lymphoma kinase"
@@ -4041,8 +4041,8 @@
       "interstitial lung disease"
     ],
     "kras": [
-      "the kirsten rat sarcoma virus",
-      "the\nkirsten rat sarcoma virus"
+      "the\nkirsten rat sarcoma virus",
+      "the kirsten rat sarcoma virus"
     ],
     "lat": [
       "data regarding the role of local ablative therapy"
@@ -4054,21 +4054,21 @@
       "kline"
     ],
     "nvalt": [
-      "nederlandse vereniging van artsen voor longziekten en tuberculose",
-      "lung cancer group and past secretary and current\nchair of the nederlandse vereniging van artsen voor longziekten en tuberculose"
+      "lung cancer group and past secretary and current\nchair of the nederlandse vereniging van artsen voor longziekten en tuberculose",
+      "nederlandse vereniging van artsen voor longziekten en tuberculose"
     ],
     "atorg": [
-      "asian thoracic oncology research group",
-      "asian\nthoracic oncology research group"
+      "asian\nthoracic oncology research group",
+      "asian thoracic oncology research group"
     ],
     "clcrf": [
-      "chinese lung cancer research foundation limited",
-      "chinese lung\ncancer research foundation limited"
+      "chinese lung\ncancer research foundation limited",
+      "chinese lung cancer research foundation limited"
     ],
     "csco": [
-      "chinese\nsociety of clinical oncology",
+      "china",
       "chinese society of clinical oncology",
-      "china"
+      "chinese\nsociety of clinical oncology"
     ],
     "hkcf": [
       "hong kong cancer fund"
@@ -4083,17 +4083,17 @@
       "partnerships in international medical education"
     ],
     "rtp": [
-      "research to practice",
-      "research\nto practice"
+      "research\nto practice",
+      "research to practice"
     ],
     "samo": [
       "president of swiss\nacademy of multidisciplinary oncology",
       "president of swiss academy of multidisciplinary oncology"
     ],
     "sakk": [
-      "research",
+      "president of lung group for swiss group for clinical cancer\nresearch",
       "president of lung group for swiss group for clinical cancer research",
-      "president of lung group for swiss group for clinical cancer\nresearch"
+      "research"
     ],
     "etop": [
       "european thoracic oncology platform"
@@ -4102,8 +4102,8 @@
       "international breast cancer study group"
     ],
     "aacr": [
-      "partners member\nof american association of cancer research",
-      "partners member of american association of cancer research"
+      "partners member of american association of cancer research",
+      "partners member\nof american association of cancer research"
     ],
     "asmac": [
       "clinique"
@@ -4112,21 +4112,21 @@
       "cancers"
     ],
     "chmp": [
-      "summary of opinion",
       "committee for medicinal products for human use",
+      "summary of opinion",
       "products for human use"
     ],
     "paga": [
       "asian adapted"
     ],
     "ishmo": [
-      "indonesian society of hematology and medical oncology",
+      "indonesian society\nof hematology and medical oncology",
       "indonesia",
-      "indonesian society\nof hematology and medical oncology"
+      "indonesian society of hematology and medical oncology"
     ],
     "jsmo": [
-      "japanese society of medical oncology",
-      "japan"
+      "japan",
+      "japanese society of medical oncology"
     ],
     "ksmo": [
       "korean society for medical oncology",
@@ -4137,14 +4137,14 @@
       "malaysia"
     ],
     "psmo": [
-      "philippine society of\nmedical oncology",
       "philippine society of medical oncology",
+      "philippines",
       "philippine society of medical\noncology",
-      "philippines"
+      "philippine society of\nmedical oncology"
     ],
     "sso": [
-      "singapore society of\noncology",
       "singapore",
+      "singapore society of\noncology",
       "singapore society of oncology"
     ],
     "tos": [
@@ -4152,8 +4152,8 @@
       "taiwan oncology society"
     ],
     "tsco": [
-      "thai society of clinical oncology",
-      "thailand"
+      "thailand",
+      "thai society of clinical oncology"
     ],
     "ismpo": [
       "indian society of medical and paediatric oncology",
@@ -4163,31 +4163,31 @@
       "national medical products\nadministration"
     ],
     "nmpa": [
-      "chinese national medical products administration",
-      "chinese national\nmedical products administration"
+      "chinese national\nmedical products administration",
+      "chinese national medical products administration"
     ],
     "jkn": [
       "the jaminan kesehatan nasional"
     ],
     "fornas": [
-      "national drug formulary",
-      "na\ntional drug formulary",
       "national standard of medication list",
-      "national standard of\nmedication list"
+      "na\ntional drug formulary",
+      "national standard of\nmedication list",
+      "national drug formulary"
     ],
     "pap": [
       "open\n\n\n\nprogram"
     ],
     "pdma": [
-      "it may take\nfrom several months to years for the pharmaceuticals and\nmedical devices agency",
-      "it may take from several months to years for the pharmaceuticals and medical devices agency"
+      "it may take from several months to years for the pharmaceuticals and medical devices agency",
+      "it may take\nfrom several months to years for the pharmaceuticals and\nmedical devices agency"
     ],
     "nhi": [
       "national health insurance"
     ],
     "torg": [
-      "thoracic oncology research\ngroup",
-      "thoracic oncology research group"
+      "thoracic oncology research group",
+      "thoracic oncology research\ngroup"
     ],
     "wjog": [
       "west japan oncology group"
@@ -4196,8 +4196,8 @@
       "trial steering committee"
     ],
     "idmc": [
-      "independent data monitoring committee",
-      "committee"
+      "committee",
+      "independent data monitoring committee"
     ],
     "ukiog": [
       "ireland oesophagogastric group"
@@ -4295,9 +4295,9 @@
       "diffuse idiopathic pulmonary neuroendocrine cell hyperplasia"
     ],
     "port": [
-      "what is the current evidence and recommendation for postoperative radiotherapy",
-      "what are the outcomes and recommendations for postoperative radiotherapy",
       "postoperative radiotherapy",
+      "what are the outcomes and recommendations for postoperative radiotherapy",
+      "what is the current evidence and recommendation for postoperative radiotherapy",
       "radiotherapy"
     ],
     "i-v": [

logs/app.log

@@ -9463,3 +9463,65 @@ ImportError: cannot import name 'store_user_question' from 'core.tools' (d:\Work
 2025-12-29 00:55:08,275 - AgenticMedicalRAG - INFO - Background validation completed - Interaction ID: 7
 2025-12-29 00:55:08,275 - AgenticMedicalRAG - INFO - Validation scores - Overall: 97/100, Accuracy: 100/100, Coherence: 95/100, Relevance: 100/100
 2025-12-29 00:55:08,276 - AgenticMedicalRAG - INFO - Successfully processed user input: Give me the options for first line treatment for N...
+2025-12-29 01:21:20,371 - AgenticMedicalRAG - INFO - Configuration validation completed
+2025-12-29 01:21:21,376 - AgenticMedicalRAG - INFO - Loaded 1085 learned synonyms from cache
+2025-12-29 01:21:21,687 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization...
+2025-12-29 01:21:21,689 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%)
+2025-12-29 01:21:21,689 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%)
+2025-12-29 01:21:21,690 - AgenticMedicalRAG - INFO - Loading embedding model (first time)...
+2025-12-29 01:21:30,209 - AgenticMedicalRAG - INFO - Embedding model loaded successfully
+2025-12-29 01:21:30,210 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%)
+2025-12-29 01:21:30,210 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%)
+2025-12-29 01:21:30,210 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)...
+2025-12-29 01:21:30,210 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed...
+2025-12-29 01:21:30,337 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever...
+2025-12-29 01:21:30,383 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever...
+2025-12-29 01:21:30,383 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever...
+2025-12-29 01:21:31,103 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever...
+2025-12-29 01:21:31,104 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully.
+2025-12-29 01:21:31,104 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%)
+2025-12-29 01:21:31,104 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%)
+2025-12-29 01:21:35,955 - AgenticMedicalRAG - INFO - Saved learned terms to cache
+2025-12-29 01:21:35,957 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents
+2025-12-29 01:21:35,958 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%)
+2025-12-29 01:21:35,958 - AgenticMedicalRAG - INFO - Initializing LLM (first time)...
+2025-12-29 01:21:36,649 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): hi...
+2025-12-29 01:21:36,657 - AgenticMedicalRAG - INFO - Initializing LLM (first time)...
+2025-12-29 01:21:37,206 - AgenticMedicalRAG - INFO - LLM initialized successfully
+2025-12-29 01:21:37,608 - AgenticMedicalRAG - INFO - LLM initialized successfully
+2025-12-29 01:21:37,609 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%)
+2025-12-29 01:21:37,609 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully
+2025-12-29 01:21:38,670 - AgenticMedicalRAG - INFO - Successfully processed user input: hi...
+2025-12-29 01:21:58,597 - AgenticMedicalRAG - INFO - Guideline filter applied: NCCN
+2025-12-29 01:21:58,597 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): According to NCCN guidelines: hi...
+2025-12-29 01:21:59,671 - AgenticMedicalRAG - INFO - Performing background validation for streaming response...
+2025-12-29 01:21:59,672 - AgenticMedicalRAG - INFO - Skipping validation: insufficient context
+2025-12-29 01:21:59,672 - AgenticMedicalRAG - INFO - Successfully processed user input: hi...
+2025-12-29 01:22:20,792 - AgenticMedicalRAG - INFO - Configuration validation completed
+2025-12-29 01:22:21,811 - AgenticMedicalRAG - INFO - Loaded 1085 learned synonyms from cache
+2025-12-29 01:22:22,195 - AgenticMedicalRAG - INFO - 🚀 Starting background initialization...
+2025-12-29 01:22:22,196 - AgenticMedicalRAG - INFO - 🔄 Background Init: Starting background initialization... (0%)
+2025-12-29 01:22:22,196 - AgenticMedicalRAG - INFO - 🔄 Background Init: Loading embedding model... (10%)
+2025-12-29 01:22:22,197 - AgenticMedicalRAG - INFO - Loading embedding model (first time)...
+2025-12-29 01:22:26,586 - AgenticMedicalRAG - INFO - Guideline filter applied: NICE
+2025-12-29 01:22:26,587 - AgenticMedicalRAG - INFO - Processing user input (attempt 1): According to NICE guidelines: hi...
+2025-12-29 01:22:26,589 - AgenticMedicalRAG - INFO - Initializing LLM (first time)...
+2025-12-29 01:22:28,325 - AgenticMedicalRAG - INFO - LLM initialized successfully
+2025-12-29 01:22:29,218 - AgenticMedicalRAG - INFO - Successfully processed user input: hi...
+2025-12-29 01:22:31,119 - AgenticMedicalRAG - INFO - Embedding model loaded successfully
+2025-12-29 01:22:31,119 - AgenticMedicalRAG - INFO - 🔄 Background Init: Embedding model loaded successfully (40%)
+2025-12-29 01:22:31,120 - AgenticMedicalRAG - INFO - 🔄 Background Init: Initializing retrievers and loading chunks... (50%)
+2025-12-29 01:22:31,120 - AgenticMedicalRAG - INFO - 🔄 Initializing retrievers (first time use)...
+2025-12-29 01:22:31,121 - AgenticMedicalRAG - INFO - 🔄 Processing new data and updating vector store if needed...
+2025-12-29 01:22:31,766 - AgenticMedicalRAG - INFO - 📦 Loading chunks cache for BM25 retriever...
+2025-12-29 01:22:31,806 - AgenticMedicalRAG - INFO - 🔍 Creating vector retriever...
+2025-12-29 01:22:31,807 - AgenticMedicalRAG - INFO - 📝 Creating BM25 retriever...
+2025-12-29 01:22:32,283 - AgenticMedicalRAG - INFO - 🔄 Creating hybrid retriever...
+2025-12-29 01:22:32,284 - AgenticMedicalRAG - INFO - ✅ Retrievers initialized successfully.
+2025-12-29 01:22:32,284 - AgenticMedicalRAG - INFO - 🔄 Background Init: Retrievers initialized successfully (90%)
+2025-12-29 01:22:32,285 - AgenticMedicalRAG - INFO - 🔄 Background Init: Learning medical terminology from corpus... (92%)
+2025-12-29 01:22:36,549 - AgenticMedicalRAG - INFO - Saved learned terms to cache
+2025-12-29 01:22:36,550 - AgenticMedicalRAG - INFO - Learned medical terminology from 1000 documents
+2025-12-29 01:22:36,550 - AgenticMedicalRAG - INFO - 🔄 Background Init: Warming up LLM... (97%)
+2025-12-29 01:22:36,550 - AgenticMedicalRAG - INFO - 🔄 Background Init: All components initialized successfully (100%)
+2025-12-29 01:22:36,550 - AgenticMedicalRAG - INFO - ✅ Background initialization completed successfully