Ray Kurzweil

Further, what will “human” even ultimately mean in the context of control when, starting in the 2030s, we introduce a nonbiological addition to our own decision-making with brain–computer interfaces? That nonbiological component will only grow exponentially, while our biological intelligence will stay the same. And as we get to the late 2030s, our thinking itself will be largely nonbiological. Where will the human decision-making be when our own thoughts largely use nonbiological systems?

…

Since AI is emerging from a deeply integrated economic infrastructure, it will reflect our values, because in an important sense it will be us. We are already a human-machine civilization.

…

Instead of pinning our hopes on the unstable distinction between humans and AI, we should focus on how to make the AI systems safe and aligned with humanity’s wellbeing.

…

We should thus work toward a world where the powers of AI are broadly distributed, so that its effects reflect the values of humanity as a whole.

—

“The best way to avoid destructive conflict in the future is to continue the advance of our ethical ideals,” as the computer systems we build will reflect their creators.