Archive for October 25th, 2013

Against Orthogonality

A long and mutually frustrating Twitter discussion with Michael Anissimov about intelligence and values — especially in respect to the potential implications of advanced AI — has been clarifying in certain respects. It became very obvious that the fundamental sticking point concerns the idea of ‘orthogonality’, which is to say: the claim that cognitive capabilities and goals are independent dimensions, despite minor qualifications complicating this schema.

The orthogonalists, who represent the dominant tendency in Western intellectual history, find anticipations of their position in such conceptual structures as the Humean articulation of reason / passion, or the fact / value distinction inherited from the Kantians. They conceive intelligence as an instrument, directed towards the realization of values that originate externally. In quasi-biological contexts, such values can take the form of instincts, or arbitrarily programmed desires, whilst in loftier realms of moral contemplation they are principles of conduct, and of goodness, defined without reference to considerations of intrinsic cognitive performance.

Anissimov referenced these recent classics on the topic, laying out the orthogonalist case (or, in fact, presumption). The former might be familiar from the last foray into this area, here. This is an area which I expect to be turned over numerous times in the future, with these papers as standard references.

The philosophical claim of orthogonality is that values are transcendent in relation to intelligence. This is a contention that Outside in systematically opposes.

Continue Reading

October 25, 2013admin 95 Comments »
FILED UNDER :Cosmos , Uncategorized