Panickssery et al. (2024)

LLM Evaluators Recognize and Favor Their Own Generations

Advances in Neural Information Processing Systems 37, 68772-68802

Find It

DOI

Reference

Panickssery, A., Bowman, S., & Feng, S. (2024). LLM Evaluators Recognize and Favor Their Own Generations. Advances in Neural Information Processing Systems 37, 68772-68802. https://doi.org/10.52202/079017-2197

What Rests on This

1 mechanism cites this source. Each finding below is quoted as it appears on that mechanism's own page.

Reality Monitoring Metacognition

Measured in AI

Related self-attribution tests also lack human baselines: GPT-4 picked out its own summaries 73.5% of the time while a study of ten leading models found no consistent self-recognition, and a 2026 preprint on retrieval systems (models that look up saved documents) found internal signals, not the models' own judgments, revealing whether an answer came from training or the retrieved text; no study tests reality monitoring over assistants' saved cross-session memory