Posts Tagged ‘Cybersecurity’

Quote note (#254)

High on Dr Gno’s reading list, Unethical Research: How to Create a Malevolent Artificial Intelligence (abstract):

Cybersecurity research involves publishing papers about malicious exploits as much as publishing information on how to design tools to protect cyber-infrastructure. It is this information exchange between ethical hackers and security experts, which results in a well-balanced cyber-ecosystem. In the blooming domain of AI Safety Engineering, hundreds of papers have been published on different proposals geared at the creation of a safe machine, yet nothing, to our knowledge, has been published on how to design a malevolent machine. Availability of such information would be of great value particularly to computer scientists, mathematicians, and others who have an interest in AI safety, and who are attempting to avoid the spontaneous emergence or the deliberate creation of a dangerous AI, which can negatively affect human activities and in the worst case cause the complete obliteration of the human species. This paper provides some general guidelines for the creation of a Malevolent Artificial Intelligence (MAI).

Channeling X-Risk security resources into MAI-design means if the human species has to die, it can at least do so ironically. The game theory involved in this could use work. It’s clearly a potential deterrence option, but that would require far more settled signaling systems than anything in place yet. Threatening to unleashing an MAI is vastly neater than MAD, and should work in the same way. Edgelords with a taste for chicken games should be able to wrest independence from it.

(The Vacuum Decay Trigger, while of even greater deterrence value, is more of a blue sky project.)

ADDED: It’s a trend. Here’s ‘Analog Malicious Hardware’ being explored: “As dangerous as their invention sounds for the future of computer security, the Michigan researchers insist that their intention is to prevent such undetectable hardware backdoors, not to enable them. They say it’s very possible, in fact, that governments around the world may have already thought of their analog attack method. ‘By publishing this paper we can say it’s a real, imminent threat,’ says [University of Michigan researcher Matthew] Hicks. ‘Now we need to find a defense.'”

June 1, 2016admin 8 Comments »
FILED UNDER :Apocalypse
TAGGED WITH : , ,

Quote note (#247)

John McAfee (“running for president on a cybersecurity platform”) has a way with words:

“The number one problem in the world today,” he said, “is America’s decline in its cybersecurity.” According to McAfee, we’re in a cyber war with the Russians, Chinese, and Iranians, and our technology is twenty years behind. […] “I think this is the greatest danger that America has ever faced,” he said gravely. “In a cyber war, the first thing we’re going to lose is our power. A month and a half ago, two fifteen-year-old boys hacked into the Ukrainian power grid. Do you think the Russians and Chinese cannot do the same thing with us? And without power, what happens? We have no power, we have no food.” McAfee’s voice rose in the middle of sentences, brimming with energy. “Half of us would survive a nuclear threat,” he said forcefully. “But no one would survive a cyber attack. No one. And if we do, we’re going to be in tatters on the street eating rats.” […] … “We are on the brink of devastation,” he warned me many times during our two days together. “It doesn’t even have to be me, but our country is lost if we do not have a cybersecurity expert as president.”

May 11, 2016admin 39 Comments »
FILED UNDER :Apocalypse
TAGGED WITH : , , , , ,