Upload transparent_execution_traces.md with huggingface_hub
Browse files
transparent_execution_traces.md
ADDED
|
@@ -0,0 +1,85 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# FastMemory Comprehensive Transparent Execution Traces\n\nThis document contains the raw execution data, ground-truth dataset context, and explicit FastMemory CBFDAE JSON AST logic arrays mapping directly to the query structure.\n\n\n## 1. GraphRAG-Bench (Multi-Hop Routing)\n**Raw Dataset Query:** In the narrative of 'An Unsentimental Journey through Cornwall', which plant known scientifically as Erica vagans is also referred to by another common name, and what is that name?\n**Raw Dataset Ground Truth Text:** The plant known scientifically as Erica vagans is referred to as Cornish heath.\n**Raw Dataset Ground Truth Triples:** ['(erica vagans, is also known as, Cornish heath).']\n\n**Vector-RAG Cosine Similarity (Logic Text Match):** 0.8660 (Susceptible to token dilution)\n\n**FastMemory Topology Extraction JSON:**\n```json\n[
|
| 2 |
+
{
|
| 3 |
+
"id": "ATF_0",
|
| 4 |
+
"action": "Logic_Extract",
|
| 5 |
+
"input": "{Data}",
|
| 6 |
+
"logic": "The plant known scientifically as Erica vagans is referred to as Cornish heath.",
|
| 7 |
+
"data_connections": [
|
| 8 |
+
"Erica_vagans",
|
| 9 |
+
"Cornish_heath"
|
| 10 |
+
],
|
| 11 |
+
"access": "Open",
|
| 12 |
+
"events": "Search",
|
| 13 |
+
"cluster": 0
|
| 14 |
+
}
|
| 15 |
+
]\n```\n\n## 2. STaRK-Prime (Semantic Similarity vs Deterministic Logic)\n**Raw Dataset Query:** Looking for a chess strategy guide from The House of Staunton that offers tactics against Old Indian and Modern defenses. Any recommendations?\n**Raw Dataset Answer IDs (Nodes):** [16]\n\n**FastMemory Topology Extraction JSON:**\n```json\n[
|
| 16 |
+
{
|
| 17 |
+
"id": "STARK_0",
|
| 18 |
+
"action": "Retrieve_Product",
|
| 19 |
+
"input": "{Query}",
|
| 20 |
+
"logic": "Looking for a chess strategy guide from The House of Staunton that offers tactics against Old Indian and Modern defenses. Any recommendations?",
|
| 21 |
+
"data_connections": [
|
| 22 |
+
"Node_16"
|
| 23 |
+
],
|
| 24 |
+
"access": "Open",
|
| 25 |
+
"events": "Fetch",
|
| 26 |
+
"cluster": 1
|
| 27 |
+
}
|
| 28 |
+
]\n```\n\n## 3. FinanceBench (100% Deterministic Routing)\n**Raw Dataset Query:** What is the FY2018 capital expenditure amount (in USD millions) for 3M? Give a response to the question by relying on the details shown in the cash flow statement.\n**Raw Dataset Evidence Payload (Excerpt):** Table of Contents
|
| 29 |
+
3M Company and Subsidiaries
|
| 30 |
+
Consolidated Statement of Cash Flow s
|
| 31 |
+
Years ended December 31
|
| 32 |
+
|
| 33 |
+
(Millions)
|
| 34 |
+
|
| 35 |
+
2018
|
| 36 |
+
|
| 37 |
+
2017
|
| 38 |
+
|
| 39 |
+
2016
|
| 40 |
+
|
| 41 |
+
Cash Flows from Operating Activities
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
|
| 48 |
+
|
| 49 |
+
Net income including noncontrolling interest
|
| 50 |
+
|
| 51 |
+
$
|
| 52 |
+
5,363
|
| 53 |
+
$
|
| 54 |
+
4,869
|
| 55 |
+
$
|
| 56 |
+
5,058
|
| 57 |
+
Adjustments to reconcile net i...\n\n**FastMemory Topology Extraction JSON:**\n```json\n[
|
| 58 |
+
{
|
| 59 |
+
"id": "FIN_0",
|
| 60 |
+
"action": "Finance_Audit",
|
| 61 |
+
"input": "{Context}",
|
| 62 |
+
"logic": "$1577.00",
|
| 63 |
+
"data_connections": [
|
| 64 |
+
"Net_Income",
|
| 65 |
+
"SEC_Filing"
|
| 66 |
+
],
|
| 67 |
+
"access": "Audited",
|
| 68 |
+
"events": "Search",
|
| 69 |
+
"cluster": 2
|
| 70 |
+
}
|
| 71 |
+
]\n```\n\n## 4. BiomixQA (Biomedical KG-RAG Route Security)\n**Raw Dataset Query:** Out of the given list, which Gene is associated with head and neck cancer and uveal melanoma. Given list is: ABO, CACNA2D1, PSCA, TERT, SULT1B1\n**Raw Dataset Ground Truth Constraints:** CACNA2D1...\n\n**FastMemory Topology Extraction JSON:**\n```json\n[
|
| 72 |
+
{
|
| 73 |
+
"id": "BIO_0",
|
| 74 |
+
"action": "Compliance_Audit",
|
| 75 |
+
"input": "{Patient_Data}",
|
| 76 |
+
"logic": "CACNA2D1",
|
| 77 |
+
"data_connections": [
|
| 78 |
+
"Medical_Record",
|
| 79 |
+
"Treatment_Plan"
|
| 80 |
+
],
|
| 81 |
+
"access": "Role_Doctor",
|
| 82 |
+
"events": "Authorized_Fetch",
|
| 83 |
+
"cluster": 3
|
| 84 |
+
}
|
| 85 |
+
]\n```\n
|