We only have to look at ourselves to see how intelligent life might develop into something we wouldn't want to meet.
As Irving Good realised in 1965, machines with superhuman intelligence could repeatedly improve their design even further, triggering what Vernor Vinge called a 'singularity.'
Interpretation
What this quote means
This quote highlights the concept of machines advancing to a point where they can enhance their own capabilities beyond human intelligence.
Stephen Hawking references a profound idea proposed by Irving Good in 1965 regarding the development of machines that possess superhuman intelligence. These machines are envisioned to have the ability to iteratively improve their own design, potentially leading to a point of unprecedented technological advancement known as 'the singularity,' as further described by Vernor Vinge. This idea raises important discussions about the future of artificial intelligence and its implications for humanity.
Themes
In practice
Example use cases
In a technology conference discussing future innovations.
More from Stephen Hawking
All quotes βI regard the brain as a computer which will stop working when its components fail. There is no heaven or afterlife for broken down computers; that is a fairy story for people afraid of the dark.
It surprises me how disinterested we are today about things like physics, space, the universe and philosophy of our existence, our purpose, our final destination. Its a crazy world out there. Be curious.
I was not a good student. I did not spend much time at college; I was too busy enjoying myself.
The world has changed far more in the past 100 years than in any other century in history. The reason is not political or economic but technological-technologies that flowed directly from advances in basic science. Clearly, no scientist better represents those advances than Albert Einstein: TIME's Person of the Century.
In my opinion, there is no aspect of reality beyond the reach of the human mind.
Similar quotes
Nevertheless, the number of farmers, small as well as large, who are adopting the new seeds and new technology is increasing very rapidly, and the increase in numbers during the past three years has been phenomenal.
What technology makes easy is not always what nurtures the human spirit.
Without sounding too clichΓ©, the Internet really is the birth of some kind of global mind.
With us air people, the future of our nation is indissolubly bound up in the development of air power.
Nobody reads the disclosures that roll down your computer screen. You click 'I agree' but you don't know what you're agreeing to.
By his very success in inventing labor-saving devices, modern man has manufactured an abyss of boredom that only the privileged classes in earlier civilizations have ever fathomed.