Direct recall
Can the system retrieve the stored personal fact when the query explicitly asks for it?
Paper results · 125 tasks
InMind
Leaderboard.
A single view of every backbone and query-time memory configuration reported in the paper's main results table. Rankings use end-to-end Application accuracy.
Reference control
Backbone control (in-context)
The target memory is already visible; no retriever or embedding is used.
Target recall100.0%
Application84.0%
Query-time configurations
Leaderboard
Results are ordered by end-to-end Application. Higher is better for every metric, tied scores share a rank, and evidence badges link to the public paper and code where available.
| Rank | Memory system (embedding) | Direct recallNaive query | Target recallIndirect context | ApplicationEnd-to-end |
|---|---|---|---|---|
| 01 | Naive RAG (text-embedding-3-large)Retrieval control | 97.6% | 6.4% | 16.0% |
| 02 | MemoryOS (text-embedding-3-large)Memory system | 96.8% | 7.2% | 14.4% |
| 03 | Naive RAG (MiniLM)Retrieval control | 92.0% | 0.8% | 9.6% |
| 03 | Naive RAG (BM25)Retrieval control | 53.6% | 3.2% | 9.6% |
| 03 | A-Mem (text-embedding-3-large)Memory system | 100.0% | 12.0% | 9.6% |
| 06 | HippoRAG 2 (MiniLM)Memory system | 93.6% | 0.8% | 8.8% |
| 07 | MemoryOS (MiniLM)Memory system | 87.2% | 2.4% | 8.0% |
| 08 | A-RAG (text-embedding-3-large)Memory system | 93.6% | 11.2% | 7.2% |
| 09 | xMemory (text-embedding-3-large)Memory system | 91.2% | 6.4% | 6.4% |
| 09 | Mem0 (text-embedding-3-large)Memory system | 76.8% | 6.4% | 6.4% |
| 09 | A-Mem (MiniLM)Memory system | 99.2% | 2.4% | 6.4% |
| 12 | HippoRAG 2 (text-embedding-3-large)Memory system | 96.0% | 2.4% | 5.6% |
| 13 | A-RAG (MiniLM)Memory system | 97.6% | 5.6% | 4.8% |
| 13 | xMemory (MiniLM)Memory system | 84.8% | 3.2% | 4.8% |
| 15 | Mem0 (MiniLM)Memory system | 76.0% | 2.4% | 3.2% |
Target recall
Does the decisive fact reach GPT-5-mini's context for the indirect query?
Application
Does the final answer correctly apply the personal fact through the required world-knowledge bridge?
MiniLM denotes all-MiniLM-L6-v2 (384 dimensions); text-embedding-3-large uses 3,072 dimensions. BM25 is lexical retrieval. Scores are percentages on the same 125-task evaluation set.
Unverified scores are reported, not guaranteed.
For entries without an InMind team verification badge, we cannot independently confirm the authenticity of the results. Those scores come from the submitting author team's report and are provided for reference only.
Need a spot on the leaderboard?
Contact the InMind team with your system, configuration, and reproducible result package.
imlrz@mail.ustc.edu.cn