What is the "control problem"?

The "control problem" is the problem of preventing artificial superintelligence (ASI) from harming humanity. How do we keep a more intelligent being under control, or how do we align it with our values? If we succeed in solving this problem, intelligence vastly superior to ours can take the baton of human progress and carry it to unfathomable heights. Solving our most complex problems could be simple to a sufficiently intelligent machine. If we fail in solving the control problem and create a powerful ASI not aligned with our values, it could spell the end of the human race. For these reasons, The control problem may be the most important challenge that humanity has ever faced, and may be our last.



AISafety.info

We’re a global team of specialists and volunteers from various backgrounds who want to ensure that the effects of future AI are beneficial rather than catastrophic.