Editing Superintelligence (section)

=== Potential mitigation strategies ===

Researchers have proposed various approaches to mitigate risks associated with ASI:

* [[AI capability control|Capability control]] – Limiting an ASI's ability to influence the world, such as through physical isolation or restricted access to resources.{{sfn|Bostrom|2014|pp=129-136}}
* Motivational control – Designing ASIs with goals that are fundamentally aligned with human values.{{sfn|Bostrom|2014|pp=136-143}}
* Ethical AI – Incorporating ethical principles and decision-making frameworks into ASI systems.<ref>{{Cite book |last1=Wallach |first1=Wendell |url=https://books.google.com/books?id=_r3N82ETng4C |title=Moral Machines: Teaching Robots Right from Wrong |last2=Allen |first2=Colin |date=2008-11-19 |publisher=Oxford University Press |isbn=978-0-19-970596-2 |language=en}}</ref>
* Oversight and governance – Developing robust international frameworks for the development and deployment of ASI technologies.<ref name=":1">{{Cite web |last=Dafoe |first=Allan |date=August 27, 2018 |title=AI Governance: A Research Agenda |url=https://cdn.governance.ai/GovAI-Research-Agenda.pdf |website=Center for the Governance of AI}}</ref>

Despite these proposed strategies, some experts, such as Roman Yampolskiy, argue that the challenge of controlling a superintelligent AI might be fundamentally unsolvable, emphasizing the need for extreme caution in ASI development.<ref>{{Cite web |last=Yampolskiy |first=Roman V. |date=July 18, 2020 |title=On Controllability of Artificial Intelligence |url=https://philpapers.org/archive/YAMOCO.pdf |arxiv=2008.04071}}</ref>