Minds, Meaning and Morals

July 26, 2006

Thinking Machines

Filed under: mind — Jeff G @ 9:11 pm

In his classic article “Computing Machinery and Intelligence” Alan Turing lays out what is now known as the Turing Test, a means by which one can, supposedly identify intelligence in another being, regardless of what external qualities this being may or may not have. John Searle, however, finds the Turing Test to be not only insufficient, but entirely misguided altogether, at least in the way in which most would implement it. It will be the purpose of this paper to briefly describe both the Turing Test as well as Searle’s Chinese Room argument, which is intended as a refutation of the former. I will also very briefly consider some of the objections which have been brought against Searle’s Chinese Room argument and conclude that all of these objections are largely irrelevant to Searle’s main point. In the end, I will argue that Searle is correct in calling the Turing Test as an unqualified test of intelligent thought into serious question.

The primary aim of Turing’s paper is to limit or even completely do away with the intuition that something must be human-like if it is to be considered intelligent in any meaningful way. Before the age of Sci-Fi thrillers it was, and still is to a large extent, “natural” to define humans as the paragon of intelligence, they being “above” all other animals and just below the gods. It has been rational thought which has been the essence of humanity since the time of Aristotle. To be human was to be rational and intelligent, which is more than enough to give most people the intuition that the converse must also be true as well: to be intelligent is to be human or at least human-like.

It is in this context that Turing argues quite convincingly that the degree to which a being (be it biological or artificial) is human is largely irrelevant to how intelligent is it. It is for this reason that the intelligence of a being should be judged on its own terms, isolated from any other features which will only serve to manipulate our intuitions in one direction or another. The way in which this is to be accomplished, according to Turing, is by way of an imitation game, wherein the being whose capacities for thought are in question is placed in a separate room while we are allowed to communicate with it by way of written messages. We are able to ask it any question or interact with it in any way which we may desire just so long as it is done by way of written communication. Turing’s main point is this: if under such conditions we are unable to distinguish a machine placed in the other room from another human placed in the same situation, by what reason are we to deny that such a machine has the capacity for thought? Turing’s answer to this rhetorical question is, of course, none; the machine has not merely simulated intelligent thought, but has actually engaged in intelligent thought.

John Searle disagrees, and I will argue that the disagreement lies largely in the fact that while a machine should not have to be human-like at all, there are some features and characteristics which a machine must have, characteristics which human do in fact have, in order for either to have intelligent thought. What Searle sees as being the central problem with the Turing Test is this, syntax is not sufficient for semantics. A Turing machine is simply manipulating formal symbols which have absolutely no meaning which is intrinsic to them. Accordingly, the processing which the Turing machine is engaged in is simply not meaningful.

This is what the Chinese Room argument (it’s actually more of a thought experiment than an argument) is supposed to illustrate. Suppose that you are locked in a room, just as a Turing machine would be in a Turing Test, into which you are only allowed to communicate with an interlocutor by way of written communication. Suppose further, however, that your interlocutor is Chinese and all the symbols which you receive as well as send are only written in what are to you utterly meaningless Chinese symbols. In order to complete the comparison, you are equipped in the room with an instruction book which allows you to follow the immensely huge list of instructions on what it is that you are supposed to “output” in response to all possible Chinese “inputs.” Thus, in the Chinese Room you have become the Turing machine, complete with a tape with Chinese input/output symbols and a machine table to consult. The entire point of Searle’s thought experiment is to show that even if you were able to pass this Chinese Turing Test, the simple fact of the matter is that you would not yourself understand a single word of the Chinese “conversation” in which you had just taken part. You had all you needed by way of syntax, but this did not provide you with a single bit of semantic content, and the exact same thing can and should be said of any Turing machine which is itself simply manipulating formal symbols.

Searle’s argument has not gone unchallenged by any means. The problem with most responses, however, is that they ignore Searle’s actual argument (that syntax is not sufficient for semantics) in favor of attacking his Chinese Room thought experiment. The most common response, one which I myself found persuasive for some time, is what Searle calls “the system’s reply”. The reply states that you, while locked in the room, do not yourself know Chinese, you combined with the instruction book do know it; it is the system which knows Chinese, not you. But this plays directly into Searle’s line of thought, for the instruction book is simply the programming of the system, it is the smuggling of another mind (namely that of the books author) into the system. Such a response only attempts to establish that the programmers of the Turing machine are intelligent rather than the machine itself. While the symbols certainly have semantic content to the programmers in the case of the Turing machine, or to the books author in the case of the Chinese Room, this does not change the fact that such Chinese/formal symbols are completely meaningless to me/the machine.

Another very popular reply, if only because it gets repeated in many popular publications, is that Searle’s Chinese Room is simply a thought experiment which is meant to manipulate our intuitions. Indeed, Daniel Dennett goes so far as to call Searle a “conjuror” who is using a “trick” to pump our intuitions in a misguided direction. His response is simply to reassert that if a machine could pass a really hard Turing Test by engaging and explaining a slightly off-colored political joke, then our intuitions are back in line with where they should be: the machine is acting intelligent and therefore must actually be intelligent. Steve Pinker’s response is similar in that he asserts that Searle is merely slowing down the process of manipulating symbols in order to guide our intuitions. Such, however, is simply beside the point. Let us suppose that we have an entire army of English-speakers locked in a Chinese Room who jointly have the entire instruction book memorized. Furthermore, let us say that they are able to perform their task at blinding speeds. Let us juice up the story all we want with greater speed and power but the point is this: neither speed nor power is sufficient to overcome the syntax/semantics gap, and it is this gap which distinguishes mere acting intelligently from actually being intelligent.

As an illustration of what the machine is lacking, consider the following question: what does the word “horses” mean to a Turing machine? Of course the machine can be programmed to respond to such an inquiry and thus behave as if “horses” meant something to it, but in such a case we are supplying all the semantic content to such a conversation, not the machine. In this we can see the Behaviorist influences in Turing’s test, for intelligence is defined by him as consisting in behaving intelligently and nothing else. But this is exactly where Searle sees him as going wrong, for even though a machine can be trained to behave as if it were engaging in intelligent thought, this would not, contrary to Turing’s rhetorical question, actually amount to intelligent thought.

To the machine, “horses” is simply a symbol, period. To us, “horses” is a symbol which means something in virtue of its referring to horses. The machine has no idea what horses are, but is instead engaged in the meaningless shuffling of symbols, a pure language game without any content at all. What the machine lacks is indexicality, the ability to reference the symbolic system (which it certainly has) to the actual world of objects which the symbols are supposed to refer to. Consequently, I argue that in order for a machine to engage in intelligent thought as we do, especially in terms of language use, it must interact with the world of objects in a way parallel to the way in which we do. Turing was right in that an intelligent machine does not have to do so in a way which is similar to the way in which we do, but to suggest that such a machine need not interact with the world of objects in any way at all beyond the mere passing of symbols back and forth is simply untenable.

In conclusion, Turing’s test for intelligent thought was useful in overcoming the strong intuition that intelligence and humanness are necessarily linked. His affirmative claim, however, that behaving as an intelligent thinker is sufficient for actually being an intelligent thinker is flawed. The gap between a machine behaving intelligently and being intelligent consists, at minimum, in the gap which exists between syntax and semantics. It is not through more computing power or speed in which this gap is to be bridged, but rather by way of environmental interaction. It is indexicality which the machine lacks, not proper programming.

Bibliography

Terrence Deacon: The Symbolic Species (W. W. Norton & Company Ltd. 1997)
Daniel Dennett: Consciousness Explained (Little, Brown & Company 1991)
Steve Pinker: How the Mind Works (W. W. Norton & Company Ltd. 1997)
John Searle: “Minds, Brains and Programs” as reprinted in Minds, Brains and Computers: The Foundations of Cognitive Science (Blackwell Publishers Ltd. 2000)
Alan Turing: “Computing Machinery and Intelligence” as reprinted in Minds, Brains and Computers: The Foundations of Cognitive Science (Blackwell Publishers Ltd. 2000)

6 Comments »

  1. Searle’s argument seems to be saying to me, “One neuron cannot understand Chinese. Therefore, it’s impossible to consider a brain conscious, even if it’s communicating in Chinese.”  

    Posted by Carl

    Comment by Carl Johnson — July 29, 2006 @ 4:50 pm

  2. See, I think that this is the conclusion that people come to when they approach the thought experiment rather than his actual argument. For instance, if we imagine an army of a billion people each with all their instructions memorized operating at a blinding speed, we can actually imagine that the room itself has some how become conscious or has engaged in thinking of some kind. But this is why his thought experiment is almost misleading.

    Consider the question, what is the room conscious of? It could only be of symbols which are in themselves absolutely meaningless. Now even if this consciousness should count for something, it is certainly not at all like the consciousness and language use that we experience.

    Searle’s thought experiment is an attempt to slow down or rather over-simplify the computing process in order to show that there is simply no step where consciousness comes in. But it is in his attempt at oversimplifying the process that people accuse him of being a “conjuror.” 

    Posted by Jeff G

    Comment by jeff g — July 29, 2006 @ 7:55 pm

  3. I agree that words do not have any meaning to a computer, they are just a string of symbols. Still I think using current technology we should be able to build machines that pass the Turing test.

    http://indradhanush-laal.blogspot.com/ ;

    Posted by lvs

    Comment by L. Venkata Subramaniam — August 13, 2006 @ 10:39 pm

  4. Right. That is exactly Searle’s point though, namely that machines can pass the test without actually being conscious or intelligent. I actually think that actual artificial intelligence is possible, but not for a desktop computer. I think that the Turing test will have little say in establishing whether a machine is intelligent or not. 

    Posted by Jeff G

    Comment by jeff g — August 14, 2006 @ 12:40 am

  5. The systems reply is to me the most appealing reply, and thus far I have not come across any satisfactory refutation of the systems reply. I don’t think the systems reply has anything to do with who programmed/wrote the book. Basically, as humans we find it hard to place ourselves in the “shoes” of the Person+Book system and endow it with consciousness. We keep slipping intuitively into the role of the person in the room, which is why the experiment works.

    Searle claims, as you say, that syntax is not sufficient for semantics. But, where is the justification for this? This claim is not actually self-evident. Semantics could be an emergent property of a sufficiently complex system of syntax. I think you misunderstand the claim of semantics equals syntax. No one is claiming that the string “horses” conveys the meaning of the word to a computer. But the string together with structural data such as multilevel ontologies and associations might give rise to semantics, though it is all syntax.

    Daniel Dennett’s main objection to Searle’s experiment is well respected. His objection is not, as claimed by Searle, that Searle is a conjurer or to deny the idea of thought experiments. These are simply straw man devices used by Searle (in his book, the Mystery of Consciousness).

    I have detailed these two objections (to the Chinese Room experiment) on this page.

    Comment by Armchair Guy — December 29, 2006 @ 10:06 am

  6. I should be clear. I do think that the strongest form of AI is possible, however I do not think it will be possible in some box which sits on a table. I simply do not see how a box, without any interaction with the environment beyond symbolic inputs and outputs, could ever be engaged in more than an entirely self-referential language game. All symbols would simply refer to other symbols and so on with no “grounding” of those symbols in the things which they are supposed to reference. That is the beef which Searle seems to have, and I share his pain.

    Thus, no matter how big you make a computer, no matter how fast you make it, the symbols simply aren’t going to mean anything beyond the relationships which they have with other symbols.

    Even if it could be argued that the rules which govern the use of such symbols are all there is to their meaning, the fact of the matter is that we use such linguistic symbols in ways in which a box on a table never does. Thus, the symbols might mean something to the computer which sits on a table top, but I don’t see such meaning as being the same as the meaning which we attribute to such symbols.

    The meaning which we attribute to such symbols is primarily of pragmatic consequence. What the word “rabbit” really means, following Quine, is not all that important. What matters is that when I want a rabbit, I get one. The problem for the computer on the table top, is that it never “gets” a rabbit in any concrete way. I see this difference as being significant.

    Comment by Jeff G — December 29, 2006 @ 1:51 pm


RSS feed for comments on this post. TrackBack URI

Leave a comment

Blog at WordPress.com.