Zhao et al. (2024)

Set the Clock: Temporal Alignment of Pretrained Language Models

Findings of the Association for Computational Linguistics ACL 2024, 15015-15040

Find It

DOI

Reference

Zhao, B., Brumbaugh, Z., Wang, Y., Hajishirzi, H., & Smith, N. (2024). Set the Clock: Temporal Alignment of Pretrained Language Models. Findings of the Association for Computational Linguistics ACL 2024, 15015-15040. https://doi.org/10.18653/v1/2024.findings-acl.892

What Rests on This

1 mechanism cites this source. Each finding below is quoted as it appears on that mechanism's own page.

Temporal Placement Memory Processes

Measured in AI

Models also misplace their own knowledge in time: Llama 2, trained on text up to 2022, mostly answered time-sensitive questions with facts as of about 2019 until it was tuned toward a target year. This resembles misdating one's own memories, but no human group was tested