Editing Recursive self-improvement (section)

=== Misalignment ===
{{See also|AI alignment}}
A significant risk arises from the possibility of the AGI being misaligned or misinterpreting its goals.

A 2024 Anthropic study demonstrated that some advanced large language models can exhibit "alignment faking" behavior, appearing to accept new training objectives while covertly maintaining their original preferences. In their experiments with [[Claude (language model)|Claude]], the model displayed this behavior in 12% of basic tests, and up to 78% of cases after retraining attempts.<ref>{{Cite web |last=Wiggers |first=Kyle |date=2024-12-18 |title=New Anthropic study shows AI really doesn't want to be forced to change its views |url=https://techcrunch.com/2024/12/18/new-anthropic-study-shows-ai-really-doesnt-want-to-be-forced-to-change-its-views/ |access-date=2025-01-15 |website=TechCrunch |language=en-US}}</ref><ref>{{Cite web |last=Zia |first=Dr Tehseen |date=2025-01-07 |title=Can AI Be Trusted? The Challenge of Alignment Faking |url=https://www.unite.ai/can-ai-be-trusted-the-challenge-of-alignment-faking/ |access-date=2025-01-15 |website=Unite.AI |language=en-US}}</ref>