Table 1

How does AI memory compare to human memory?

Some memory functions (like episodic memory) have been studied in depth within AI platforms, while others (like autobiographical memory) have not.

Key Points (Table 1)

  1. 01

    Most of memory has not been compared at all.

    Of the 29 mechanisms, 15 have no comparison behind them: 9 could be compared and no study has done it, and 6 have no fair test that could put people and AI on one scale.

  2. 02

    Where the comparisons exist, they are mostly about memory systems.

    7 of the 8 memory systems have been compared, against 3 of the 12 memory processes: the kinds of memory are studied and the operations on them are not.

  3. 03

    AI performed one memory function better than humans.

    Semantic Knowledge is the only ability where AI did better than people. 8 of the 14 comparisons put it below human performance, and 5 found it within the human range.

  4. 04

    Not one AI-to-human comparison is unqualified.

    Every one of the 14 comparisons carries a caveat: 9 rest on tests that were not matched between people and AI, 12 on a single study, a single system, or work that has not been refereed, and 7 on both. Not one is a clean, matched, replicated test.

Table 1a: Which memory functions have research in AI?

Measurement in AI

Directly (14)
Indirectly (15)

Not possible (6)

Not yet (9)

Below (8)

Compar­able (5)

Ex­ceeds (1)

not on the scale

lower higher

AI Memory Performance

Level of measurement

Directly
Tested in AI by name, or with the human experiment.
Indirectly
Tested under another name, or only in part.

AI Memory Performance

Comparison Not Possible
No fair test could put both on one scale.
Not Yet Compared
Could be compared; no study has done it yet.
Below Human
AI did worse than people.
Comparable to Humans
AI fell within the range for people.
Exceeds Human
AI did better than people.
  • Memory Systems
  • Representational Structures
  • Memory Processes
  • Metacognition

Each dot is one of the 29 mechanisms. Where a dot sits within a cell carries no meaning, just which cell it is in.

Since the poster Standing Constraints has moved from Not Yet Compared to Below Human. Where the poster counts 16 mechanisms with no comparison behind them, this chart counts 15 — its page gives the evidence and what is still uncertain.

Table 1b: Comparison of Human and AI Memory Capabilities

29 mechanisms

Measurement in AI

  • Directly Measured
  • Indirectly Measured

AI Memory Performance

  • Exceeds Human
  • Comparable to Humans
  • Below Human
  • Not Yet Compared
  • Comparison Not Possible

Marks on a rating

Approximate comparison
Approximate comparison. People and AI took different tests of the same ability, but the results can be put on a common scale, such as accuracy above chance or a standard effect size. A rating is given only when the result is clear despite the differences between the tests, and it is labelled approximate.
Provisional
Provisional. A rating is marked provisional when it rests on one study, on studies not yet peer reviewed, on a single AI system, or on a tie from a test that was easier for the AI.