We only have to look at ourselves to see how intelligent life might develop into something we wouldn't want to meet.
As Irving Good realised in 1965, machines with superhuman intelligence could repeatedly improve their design even further, triggering what Vernor Vinge called a 'singularity.'
Interpretation
What this quote means
This quote highlights the concept of machines advancing to a point where they can enhance their own capabilities beyond human intelligence.
Stephen Hawking references a profound idea proposed by Irving Good in 1965 regarding the development of machines that possess superhuman intelligence. These machines are envisioned to have the ability to iteratively improve their own design, potentially leading to a point of unprecedented technological advancement known as 'the singularity,' as further described by Vernor Vinge. This idea raises important discussions about the future of artificial intelligence and its implications for humanity.
Themes
In practice
Example use cases
In a technology conference discussing future innovations.
More from Stephen Hawking
All quotes βI regard the brain as a computer which will stop working when its components fail. There is no heaven or afterlife for broken down computers; that is a fairy story for people afraid of the dark.
It surprises me how disinterested we are today about things like physics, space, the universe and philosophy of our existence, our purpose, our final destination. Its a crazy world out there. Be curious.
I was not a good student. I did not spend much time at college; I was too busy enjoying myself.
The world has changed far more in the past 100 years than in any other century in history. The reason is not political or economic but technological-technologies that flowed directly from advances in basic science. Clearly, no scientist better represents those advances than Albert Einstein: TIME's Person of the Century.
In my opinion, there is no aspect of reality beyond the reach of the human mind.
Similar quotes
Space tourism is a logical outgrowth of the adventure tourist market.
Government isn't that good at rapid advancement of technology. It tends to be better at funding basic research. To have things take off, you've got to have commercial companies do it.
Digital media are biased toward replication and storage. Our digital photos practically upload and post themselves on Facebook, and our most deleted e-mails tend to resurface when we least expect it. Yes, everything you do in the digital realm may as well be broadcast on prime-time television and chiseled on the side of the Parthenon.
Why don't I talk about Big Data? Because I am focused on intelligent answers and not speeds and feeds. It doesn't matter if it is quick if it's the wrong answer.
Everybody copied Atari products. So we started messing with them and it was fun. We bought enough chips that we could get them mislabeled. So we bankrupted at least two companies which copied our boards, and bought all the parts but they were the wrong parts, so they're sitting on all this inventory they can't sell because the games don't work.
What the computer in virtual reality enables us to do is to recalibrate ourselves so that we can start seeing those pieces of information that are invisible to us but have become important for us to understand.