A while ago Nyan posed a series of questions about the XS rejection of (fact-value, or capability-volition) orthogonality. He sought first of all to differentiate between the possibility, feasibility, and desirability of unconstrained and unconditional intelligence explosion, before asking:
On desirability, given possibility and feasibility, it seems straightforward to me that we prefer to exert control over the direction of the future so that it is closer to the kind of thing compatible with human and posthuman glorious flourishing (eg manifest Samo’s True Emperor), rather than raw Pythia. That is, I am a human-supremacist, rather than cosmist. This seems to be the core of the disagreement, you regarding it as somehow blasphemous for us to selfishly impose direction on Pythia. Can you explain your position on this part?
If this whole conception is the cancer that’s killing the West or whatever, could you explain that in more detail than simply the statement?
(It’s worth noting, as a preliminary, that the comments of Dark Psy-Ops and Aeroguy on that thread are highly-satisfactory proxies for the XS stance.)
First, a short micro-cultural digression. The distinction between Inner- and Outer-NRx, which this blog expects to have settled upon by the end of the year, describes the shape of the stage upon which such discussions unfold (and implex). Where the upstart Inner-NRx — comparatively populist, activist, political, and orthogenic — aims primarily at the construction of a robust, easily communicable doctrinal core, with attendant ‘entryism’ anxieties, Outer-NRx is a system of creative frontiers. By far the most fertile of these are the zones of intersection with Libertarianism and Rationalism. One reason to treasure Nyan’s line of interrogation is the fidelity with which it represents deep-current concerns and presuppositions of the voices gathered about, or spun-off from, LessWrong.
Continue Reading