Mechanisms
Memory Systems
Immediate
Declarative
Representational Structures
Schemas
Person Models
Memory Processes
Acquisition and Transformation
Retrieval and Surfacing
Degradation
Metacognition
Attribution
Confidence
Control
Nothing matches that.
Memory Processes · Acquisition and Transformation
Consolidation
Example
You work through something difficult in the evening, sleep, and find the next morning that you handle it better, without having practised again. Something happened to the memory while you weren't using it.
On this page
Consolidation in Humans
Definition
The transformation of a memory over the hours and days after acquisition, through recurrent reactivation during both waking and sleep (Dudai et al., 2015). The trace does not simply settle. It is redistributed to additional sites and integrated into existing knowledge, so what is available later differs from what was encoded.
*Framing note: scoped to the post-acquisition transformation of a specific memory. Schema Formation covers the resulting knowledge structures; Reconsolidation covers re-entry into a labile state after retrieval. The three are aspects of one process rather than a fixed sequence. Reconsolidation is conditional: it does not appear to follow every reactivation of a long-term memory, and is more likely when new information is available in the retrieval situation and when the reactivated representation is strong enough to control behaviour (Dudai et al., 2015). They are separated here because each stands in a different relation to the AI material.*
Neural Substrate
Human evidence exists at the systems level and is the basis for what follows. Intracranial recordings from patients with epilepsy identified recurring spatiotemporal sequences of high gamma activity spanning widespread cortical sites during waking, and in all six patients analysed those sequences recurred more often across the two nights following the waking period than across the two preceding it; more than 90% of the recurring sequences were novel, and their recurrence was coupled to sleep spindles, down-to-up transitions, theta bursts, and hippocampal sharp wave ripples (Jiang et al., 2017). Scalp EEG in 20 healthy sleepers shows the same reactivation without any experimenter-delivered cue, with classifier evidence for the stimulus category studied before a nap rising above chance between 800 and 1200 ms after the slow oscillation downstate, and only where a slow oscillation and a spindle occurred together, since neither event alone produced above-chance classification (Schreiner et al., 2021). Human fMRI across three months shows the redistribution itself, with hippocampal activity during confident recognition of remote items declining while ventral medial prefrontal activity rises, the two closely anticorrelated, and with the amount of slow-wave sleep during a post-encoding nap predicting retention for material learned before the nap but not after it (Takashima et al., 2006). Neither the intracranial nor the scalp EEG study establishes that reactivation causes consolidation; Jiang et al. say so explicitly, and Schreiner et al. report a correlation between reactivation strength and retention.
Synaptic consolidation is a different case, because no human evidence characterises it. The account of it in the reviews is drawn from invertebrate and rodent preparations, chiefly Aplysia and mice, with the classic time course established in goldfish (Dudai, 2004; Dudai et al., 2015). At that level the claim is not regional: consolidation is a molecular and cellular process at the circuits where the memory was first encoded, traditionally assumed to draw to a close within hours of learning, and it has been described in every species, preparation and task examined so far. Systems consolidation is the slower time-dependent reorganisation of the representation across distributed circuits, over weeks to years, during which the trace spreads to new locations while relinquishing dependence on parts of the circuit that supported its acquisition (Dudai, 2004). Dudai et al. (2015) treat synaptic consolidation as a repeating subroutine within the systems-level process rather than as a separate mechanism, which is why the non-human basis of the first does not carry over to the second.
AI at a Glance
In humans, consolidation transforms a memory over hours to years through recurrent reactivation during waking and sleep, redistributing it across brain sites and integrating it into existing knowledge (Dudai et al., 2015; Takashima et al., 2006). In AI systems an offline pass over already-stored material is implemented and measured at the memory layer, either as prompted reorganisation of a retained context before queries arrive (Lin et al., 2025) or as scheduled deduplication and promotion inside a pipeline whose stages are named for the human process (Kerestecioglu et al., 2026), but the selection principle differs, since what gets worked on is chosen by predicted usefulness to an anticipated question rather than by significance or by fit to existing knowledge.
- Context: the body of text a system is given alongside a question, such as a document, a codebase, or a conversation history (Lin et al., 2025).
- Memory layer: the component of a deployed system that stores material outside the model itself and decides what to retain, rewrite, or retrieve, as distinct from the model's trained parameters (Kerestecioglu et al., 2026).
Consolidation in AI
How Far It Has Been Measured
Measurement in AI: Indirectly Measured
AI Memory Performance: Not Yet Compared
Where It Lives in the System
What Has Been Measured
- Widely used AI assistants update nothing in the model itself between conversations; a 2026 preprint tested nightly consolidation of conversations into the model's weights (its long-term learned parameters) and found it retained 80.4% of knowledge versus 36.8% for repeatedly summarizing the conversation, across 10 conversations and 1,146 questions (Dennis et al., 2026).
- Other 2026 preprints build explicit 'sleep' phases into research models, distilling recent in-context knowledge into long-term parameters with replay, or converting the recent conversation into persistent weights offline, and report better performance with longer sleep; these are prototypes scored against other AI methods, not tests against people (Behrouz et al., 2026; Lee et al., 2026).
- In training, facts a model picks up are not stabilized: each exposure raises their probability, but later training dilutes it through forgetting that follows a power law, measured as knowledge acquisition and forgetting rather than as consolidation (Chang et al., 2024).
- In saved memory, systems such as Mem0 extract and 'consolidate' facts from conversations into a store the AI can search later; this is scored only as part of broad long-conversation question-answering benchmarks, where Mem0 beat OpenAI's memory feature by 26% (relative) on a model-judged score (Chhikara et al., 2025).
- A 2026 preprint found that rewriting interactions into stored facts kept claims but erased the limits their source placed on using them (for example, a user's say-so becoming a standing instruction) in 48 of 49 combinations of seven memory systems and seven language models, so the failure was nearly uniform across systems; this resembles consolidation losing source detail but included no human comparison (Zhan et al., 2026).
- The closest classic paradigm tried on AI is interference: across 39 language models, earlier information in the conversation disrupted recall of later updates more than the reverse (d = 1.73), opposite to the typical human pattern, but this tests the context window (what the model can see in the current conversation) with no delay or offline period, and no people were tested (Chattaraj & Raj, 2026).
- Not yet compared: no study was found that gave AI and people the same consolidation test, such as retention after an offline period versus none; the AI results are gains of one engineered method over another, which cannot be placed on a common scale with the human sleep benefit of roughly g = 0.3 to 0.4 (Berres & Erdfelder, 2021).
Where a Mechanism Can Live
04 Product
The whole configuration, and the only thing a benchmark observes directly.
01
Weights
Across deployments
02
Context Window
Within a session
03
Memory Layer
Across sessions
Which of the three a result belongs to is inferred from it, not seen in it.
Read more
Cerebral cortex
Division in the cerebral hemisphere
The folded sheet of grey matter covering each hemisphere, two to four millimetres thick and layered rather than uniform.
The cortex is a continuous sheet of neurons and local circuitry spread over the hemisphere's surface, thrown into gyri and sulci so that roughly two-thirds of it lies buried in the folds. Most of it (the neocortex) has six layers distinguished by cell type and by which connections arrive and leave; older allocortex has three or four. Areas differ in layer thickness, cell packing and connectivity, which is what cytoarchitectonic maps such as Brodmann's record. Where any given area's boundary actually falls, and how closely those maps correspond to functional divisions, is still argued over; modern multimodal parcellations disagree with Brodmann in places.
Hippocampus
Cortex in the hippocampal formation
A curved allocortical structure in the medial temporal lobe whose bilateral damage reliably produces dense anterograde amnesia in humans.
A paired, seahorse-shaped fold of three-layered cortex running front to back inside the temporal lobe, connected to the rest of the brain mainly through entorhinal cortex and the fornix. What it does is genuinely contested and has been for fifty years: the human lesion literature reads it as necessary for forming new declarative memories, the rodent recording literature as a map of space, and a third position treats both as instances of binding arbitrary elements into relations. The accounts differ on which species and which task they explain best, and the question of which is right remains open.
Prefrontal cortex
Cortex in the frontal lobe
The frontal cortex in front of the motor areas, defined classically by its connections with the mediodorsal thalamus rather than by any one function.
The prefrontal cortex occupies the front of the frontal lobe, anterior to premotor and motor cortex, and accounts for roughly a sixth to a quarter of human cortex depending on where the posterior border is drawn. Three competing definitions are in use (projection from the mediodorsal thalamus, the presence of a granular layer IV, and the absence of movement on electrical stimulation), and they do not enclose the same tissue, which is why rodent-to-primate homology is still argued over. It is reliably engaged by tasks with delays, rules, and conflicting options; what it contributes to those tasks is the open question, not whether it participates.
Berres & Erdfelder (2021)
The sleep benefit in episodic memory: An integrative review and a meta-analysis.
In
Psychological Bulletin, 147(12), 1309-1353
Abstract
People recall more information after sleep than after an equally long period of wakefulness. This sleep benefit in episodic memory has been documented in almost a century of research. However, an integrative review of hypothesized underlying processes, a comprehensive quantification of the benefit, and a systematic investigation of potential moderators has been missing so far. Here, we address these issues by analyzing 823 effect sizes from 271 independent samples that were reported in 177 articles published between 1967 and 2019. Using multilevel metaregressions with robust variance estimates, we found a moderate overall sleep benefit in episodic memory (g = 0.44). Moderator analyses...
Find it
Chang et al. (2024)
How Do Large Language Models Acquire Factual Knowledge During Pretraining?
In
arXiv
Abstract
Despite the recent observation that large language models (LLMs) can store substantial factual knowledge, there is a limited understanding of the mechanisms of how they acquire factual knowledge through pretraining. This work addresses this gap by studying how LLMs acquire factual knowledge during pretraining. The findings reveal several important insights into the dynamics of factual knowledge acquisition during pretraining. First, counterintuitively, we observe that pretraining on more data shows no significant improvement in the model's capability to acquire and maintain factual knowledge. Next, there is a power-law relationship between training steps and forgetting of memorization and...
Find it
Chattaraj & Raj (2026)
LLMs Remember First, Forget Last: Dual-Process Interference in Large Language Models
In
arXiv
Abstract
Large language models can process millions of tokens, yet how they handle conflicting information within context remains poorly understood. From patient health logs tracking evolving vital signs to legal documents with superseding clauses, real-world applications routinely require models to retrieve specific values from streams of semantically similar, competing updates. We adapt classical interference paradigms from cognitive psychology to compare retroactive interference (RI; recalling initial values after updates) and proactive interference (PI; recalling recent values despite competing prior encodings) across 39 LLMs spanning 1B to 2.5T parameters. Every model exhibits the same...
Find it
Chhikara et al. (2025)
Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
In
Frontiers in Artificial Intelligence and Applications
Abstract
Large Language Models (LLMs) have demonstrated remarkable prowess in generating contextually coherent responses, yet their fixed context windows pose fundamental challenges for maintaining consistency over prolonged multi-session dialogues. We introduce Mem0, a scalable memory-centric architecture that addresses this issue by dynamically extracting, consolidating, and retrieving salient information from ongoing conversations. Building on this foundation, we further propose an enhanced variant that leverages graph-based memory representations to capture complex relational structures among conversational elements. Through comprehensive evaluations on LOCOMO benchmark, we systematically...
Find it
Dennis et al. (2026)
Beyond Inference-Only Deployment: Comparing Weight-Based Consolidation Against Cascading Compaction
In
arXiv
Abstract
Major LLM platforms deploy models in an inference-only configuration: the model serves requests but never updates per-user weights. Users must repeatedly re-teach preferences, corrections, and project context, and context-based workarounds consume context-window space and degrade under cascading compaction. We evaluate an alternative: nightly consolidation of interaction knowledge into model weights via reflection, synthesis, and Low-Rank Adaptation (LoRA) fine-tuning on a single consumer GPU. Across ten realistic software development conversations (n = 10, 1,146 test questions across three memory types), three cycles of cascading compaction retain 36.8 +/- 3.0% of knowledge (between an...
Find it
Dudai (2004)
The Neurobiology of Consolidations, Or, How Stable is the Engram?
In
Annual Review of Psychology, 55(1), 51-86
Abstract
Consolidation is the progressive postacquisition stabilization of long-term memory. The term is commonly used to refer to two types of processes: synaptic consolidation, which is accomplished within the first minutes to hours after learning and occurs in all memory systems studied so far; and system consolidation, which takes much longer, and in which memories that are initially dependent upon the hippocampus undergo reorganization and may become hippocampal-independent. The textbook account of consolidation is that for any item in memory, consolidation starts and ends just once. Recently, a heated debate has been revitalized on whether this is indeed the case, or, alternatively, whether...
Find it
Dudai et al. (2015)
The Consolidation and Transformation of Memory
In
Neuron, 88(1), 20-32
Abstract
Memory consolidation refers to the transformation over time of experience-dependent internal representations and their neurobiological underpinnings. The process is assumed to be embodied in synaptic and cellular modifications at brain circuits in which the memory is initially encoded and to proceed by recurrent reactivations, both during wakefulness and during sleep, culminating in the distribution of information to additional locales and integration of new information into existing knowledge. We present snapshots of our current knowledge and gaps in knowledge concerning the progress of consolidation over time and the cognitive architecture that supports it and shapes our long-term...
Find it
Jiang et al. (2017)
Replay of large-scale spatio-temporal patterns from waking during subsequent NREM sleep in human cortex
In
Scientific Reports, 7(1)
Abstract
Animal studies support the hypothesis that in slow-wave sleep, replay of waking neocortical activity under hippocampal guidance leads to memory consolidation. However, no intracranial electrophysiological evidence for replay exists in humans. We identified consistent sequences of population firing peaks across widespread cortical regions during complete waking periods. The occurrence of these “Motifs” were compared between sleeps preceding the waking period (“Sleep-Pre”) when the Motifs were identified, and those following (“Sleep-Post”). In all subjects, the majority of waking Motifs (most of which were novel) had more matches in Sleep-Post than in Sleep-Pre. In rodents, hippocampal...
Find it
Kerestecioglu et al. (2026)
Human-Inspired Memory Architecture for LLM Agents
In
arXiv
Abstract
Current LLM agents lack principled mechanisms for managing persistent memory across long interaction horizons. We present a biologically-grounded memory architecture comprising six cognitive mechanisms: (1) sleep-phase consolidation, (2) interference-based forgetting, (3) engram maturation, (4) reconsolidation upon retrieval, (5) entity knowledge graphs, and (6) hybrid multi-cue retrieval. Each mechanism addresses a specific failure mode of naive memory accumulation. We introduce a synthetic calibration methodology that derives all pipeline thresholds without benchmark data exposure, eliminating a common source of evaluation leakage. We evaluate on two benchmarks. First, a VSCode...
Find it
Lin et al. (2025)
Sleep-time Compute: Beyond Inference Scaling at Test-time
In
arXiv
Abstract
Scaling test-time compute has emerged as a key ingredient for enabling large language models (LLMs) to solve difficult problems, but comes with high latency and inference cost. We introduce sleep-time compute, which allows models to "think" offline about contexts before queries are presented: by anticipating what queries users might ask and pre-computing useful quantities, we can significantly reduce the compute requirements at test-time. To demonstrate the efficacy of our method, we create modified versions of two reasoning tasks - Stateful GSM-Symbolic and Stateful AIME. We find that sleep-time compute can reduce the amount of test-time compute needed to achieve the same accuracy by ~...
Find it
Schreiner et al. (2021)
Endogenous memory reactivation during sleep in humans is clocked by slow oscillation-spindle complexes
In
Nature Communications, 12(1)
Abstract
Sleep is thought to support memory consolidation via reactivation of prior experiences, with particular electrophysiological sleep signatures (slow oscillations (SOs) and sleep spindles) gating the information flow between relevant brain areas. However, empirical evidence for a role of endogenous memory reactivation (i.e., without experimentally delivered memory cues) for consolidation in humans is lacking. Here, we devised a paradigm in which participants acquired associative memories before taking a nap. Multivariate decoding was then used to capture endogenous memory reactivation during non-rapid eye movement (NREM) sleep in surface EEG recordings. Our results reveal reactivation of...
Find it
Takashima et al. (2006)
Declarative memory consolidation in humans: A prospective functional magnetic resonance imaging study
In
Proceedings of the National Academy of Sciences, 103(3), 756-761
Abstract
Retrieval of recently acquired declarative memories depends on the hippocampus, but with time, retrieval is increasingly sustainable by neocortical representations alone. This process has been conceptualized as system-level consolidation. Using functional magnetic resonance imaging, we assessed over the course of three months how consolidation affects the neural correlates of memory retrieval. The duration of slow-wave sleep during a nap/rest period after the initial study session and before the first scan session on day 1 correlated positively with recognition memory performance for items studied before the nap and negatively with hippocampal activity associated with correct confident...
Find it
Zhan et al. (2026)
When Memory Becomes Authority: Benchmarking Authority Collapse at the Memory Consolidation Boundary
In
arXiv
Abstract
Persistent memory allows (self-evolving) LLM agents to adapt across tasks by consolidating heterogeneous interaction histories into reusable facts, preferences, observations, and rules. Yet consolidation also imposes an implicit authorization boundary: it determines whether stored information may later be consumed as a user fact, an attested observation, or a standing instruction. We identify authority collapse, in which consolidation preserves a claim while erasing the source constraints governing its authorized use, causing the stored memory to imply greater authority than its source permits. We introduce AuthMem-Bench, a controlled paired benchmark that holds the focal claim and...
Find it