In the Mouth of Madness
A prompt by @hugodoingthings to explore the spook-dense crypts of Roko’s Basilisk (which, inexplicably, has never latched before) led straight to this enthralling RationalWiki account. The whole article is gripping, but the following short paragraphs stand out for their extraordinary dramatic intensity:
Roko’s basilisk is notable for being completely banned from discussion on LessWrong, where any mention of it is deleted. Eliezer Yudkowsky, founder of LessWrong, considers the basilisk to not work, but will not explain why because he does not consider open discussion of the notion of acausal trade with possible superintelligences to be provably safe.
Silly over-extrapolations of local memes, jargon and concepts are posted to LessWrong quite a lot; almost all are just downvoted and ignored. But for this one, Yudkowsky reacted to it hugely, then doubled-down on his reaction. Thanks to the Streisand effect, discussion of the basilisk and the details of the affair soon spread outside of LessWrong. Indeed, it’s now discussed outside LessWrong frequently, almost anywhere that LessWrong is discussed at all. The entire affair constitutes a worked example of spectacular failure at community management and at controlling purportedly dangerous information.