Post
1,091
Hugging face article: https://huggingface.co/blog/javadtaghia/atmem-2310-bounded-evidence-discovery-for-persiste
AtMem 2.3.10 is out; and our full DolphinBench result has more than doubled.
AtMem 2.3.9 passed 192 of 600 tasks (32%).
AtMem 2.3.10 passed 390 of 600 (65%). We doubled it.
What changed?
We focused on how an agent discovers and uses evidence.
AtMem combined lexical and semantic retrieval while keeping related passages together with their original source and provenance and more.
Where do we stand?
This is substantial progress, with a clear tradeoff: median recorded task latency increased from 31.87 to 85.78 seconds. More successful investigation currently takes more time.
The published Hermes/Luna/Mem0 reference scores 424/600 (70.7%).
What comes next?
We want to understand the remaining failures: was evidence missing, poorly ranked, packed incompletely, interpreted with the wrong temporal state, or used incorrectly during an action?
Evidence discovery remains opt-in.
Release: https://github.com/aetna000/atmem/releases/tag/v2.3.10
DolphinBench submission PR: https://github.com/mem0ai/dolphinbench/pull/10
Results and execution evidence: atmem/atmem-2.3.10b1-dolphinbench
PS: DolphinBench tests whether an agent can use a simulated userβs history to complete actions in applications. Finding a relevant passage isnβt enoughβa task passes only when all its required checks pass.
AtMem 2.3.10 is out; and our full DolphinBench result has more than doubled.
AtMem 2.3.9 passed 192 of 600 tasks (32%).
AtMem 2.3.10 passed 390 of 600 (65%). We doubled it.
What changed?
We focused on how an agent discovers and uses evidence.
AtMem combined lexical and semantic retrieval while keeping related passages together with their original source and provenance and more.
Where do we stand?
This is substantial progress, with a clear tradeoff: median recorded task latency increased from 31.87 to 85.78 seconds. More successful investigation currently takes more time.
The published Hermes/Luna/Mem0 reference scores 424/600 (70.7%).
What comes next?
We want to understand the remaining failures: was evidence missing, poorly ranked, packed incompletely, interpreted with the wrong temporal state, or used incorrectly during an action?
Evidence discovery remains opt-in.
Release: https://github.com/aetna000/atmem/releases/tag/v2.3.10
DolphinBench submission PR: https://github.com/mem0ai/dolphinbench/pull/10
Results and execution evidence: atmem/atmem-2.3.10b1-dolphinbench
PS: DolphinBench tests whether an agent can use a simulated userβs history to complete actions in applications. Finding a relevant passage isnβt enoughβa task passes only when all its required checks pass.