Minds, Meaning and Morals

February 22, 2007

The Chinese Room, pt. 7

Filed under: mind — Jeff G @ 12:05 pm

The Chinese Room is not merely intended as a refutation of Strong AI, but also as demonstration of the unreliability of the Turing Test for intelligence.  According to John Searle, the Chinese Room passes the Turing Test without being intelligent in the relevant sense, therefore passing the Turing Test is not sufficient for having intelligence.  It is, partially, for this reason that Searle reintroduces all the chauvinistic and prejudicial preconditions for intelligence (I will use the terms ‘intelligence’, ‘conscious’ and ‘understanding’ rather interchangeably) that Turing attempted to dispose of with his test in the form of causal powers.

There are (at least) two ways in which the Turing Test can be salvaged from Searle’s criticisms.  First, one can attempt to show that the Chinese Room actually is intelligent in the relevant sense after all.  (I personally find the virtual mind approach quite compelling.)  This, of course, would amount to a refutation of the Chinese Room argument altogether. 

While I am not at all persuaded by the Chinese Room argument, as a functionalist I see this approach as being deeply problematic.  The Chinese Room argument is aimed at showing that any and all programs that pass the Turing Test are, by themselves, insufficient for consciousness.  The denial of this conclusion does not entail that every program which passes the Turing Test is, therefore, conscious.  Consider two definitions of the “right” program which the man in the Chinese Room is running:

  1. The Behavioral Definition: The right program has the proper input/output relations, regardless of what formal relations hold between the two.
  2. The Functional Definition: The right program has both the proper input/output relations as well as the proper formal relations between two.

The functionalist is committed to the claim that anything which instantiated the functionally right program is conscious and any thing which is conscious instantiates the functionally right program.  Nevertheless, there are many programs which are behaviorally right, and therefore pass the Turing Test, without being functionally right.  Thus, the functionalist seems committed to the claim that the Turing Test does not serve as a reliable indicator of intelligence.

There is, however, another way for to save the Turing Test, or something very close to it, from Searle’s criticisms which not only does not deny the strength of the Chinese Room argument but also allows the functionalist to place more confidence in the test.  This approach is to accept that the Turing Test is a reliable indicator of intelligence but not a reliable locator of intelligence.

Consider the case of communicating with a friend by way of walkie-talkie.  Strictly speaking, the walkie-talkie is passing the Turing Test!  The same can be said for a telephone, instant messenger programs, mailboxes, etc.  When we communicate through these mediums, we are completely convinced that we are indeed communicating with some intelligence, exactly the reaction which the Turing Test suggests we should have.  Nevertheless, we are not, for a second, tempted to think that the mediums are where the intelligence resides.

Let us now turn our attention to the Chinese Room which, by definition, passes the Turing Test.  To deny that there is any intelligence, understanding or consciousness anyway is far too strong of a claim.  After all, how in the world is the room passing the test in the first place?  Where did Searle’s rule book come from?  The proper conclusion for Searle to draw from the Chinese Room argument is “Yes, the outside interlocutor is indeed communicating with an intelligent entity, but the man inside the room is not it.  The intelligence with which the interlocutor is communicating is the author of the rule book.”  Thus, Searle can still hold that instantiating the proper program is not, in itself, sufficient for intelligence while at the same time accepting the Turing Test as a reliable indicator of intelligence.

The functionalist, on the other hand, can tell a very similar story.  Even if the Chinese Room instantiates a program which is merely behaviorally right, as opposed to functionally right, the functionalist can claim that behaviorally right program is simply the product of some functionally right program, namely the author of the behaviorally right program.  Thus, the functionalist can claim that while passing the Turing Test does not logically entail the unidentified presence of some intelligent being, is serves, in practice, as a highly reliable indicator (but not locator!) of such.

Let us now consider the case of the Chinese Room which instantiates a functionally right program.  While the functionalist is (it seems) compelled to grant intelligence to this Chinese Room, the question of where the program came from still lingers.  Even if we grant that the room is now intelligent, is it not a sort of derived, second class intelligence?  Isn’t the real intelligence in the programmer after all?

The proper response to this question is that the difference between real and derived intelligence makes no difference since ALL intelligence is derived.  This point, I take it, is similar to Dennett’s rejection of intrinsic intentionality.  Humans, according to the functionalist, are intelligent in virtue of the program they are running in their brains.  Where did this program come from?  The answer is from our biology (by way of natural selection), our culture (by way of shared knowledge and language) and our personal experience with the world.  Human intelligence is no less derived than is that of the functionally right program in the Chinese Room.

6 Comments »

  1. Nice response. I think this is the first time I’ve read the intelligence detector v. intelligence locator point. Very original. You could probably get it published.

    Comment by Carl — February 22, 2007 @ 12:49 pm

  2. I agree with Carl about the level of your arguments. However …

    If everything else Searle ever said is forgotten, the Chinese Room will be remembered as the reply to Turing, because Searle’s argument is intuitively correct. We are no longer interested in computers that can handle narrow, well-defined, rule based tasks, such as chess. That has been proven to be actual. What we are interested in is the possibility of artificial sentience, which is the goal of strong AI. And that, as Searle proved, is impossible.

    To see why that is so, one must step outside of logical analysis, and see that logical analysis, which is all that machines can ever be capable of, is just a small incomplete part of the big picture. Whether the instructions are implicit or explicit doesn’t really matter.

    What is missing are the context that complements the rules to give specific meaning, the innate propensities that make a person human, and the physical and social environment that create a natural mind in the first place.

    Comment by YadaYada — February 22, 2007 @ 5:42 pm

  3. I think YadaYada is begging the question. How do we know an AI that’s wired in the “right” way isn’t sentient? I dispute that Searle “proved” anything that isn’t either trivial or wrong.

    Obviously, chatbots aren’t sentient, but that’s because they aren’t wired in the right way. A chatbot’s response to the environment isn’t based on contemplation but a simple dictionary look up. However, I maintain that no chatbot is capable of continuing to beat the Turing Test over a long enough period of time. A true intelligence has the capacity to produce an infinite number of utterances, for example by logically working out the properties of math and listing them. Thus, in order for an AI with a finite dictionary to talk about math, it will need to be able to think logically. After a long enough period of time, the Turing Test becomes a functional test.

    If we dispute that a robot with a perfect functional copy of a human brain can truly be sentient on the basis of Searle’s arguments, then we must accept that *we* aren’t sentient either, since our neurons are just a lacking in understanding as the man in the Chinese room. Indeed, if we take evolution for granted, unlike the computer, our intelligence is not based on any higher intelligence arranging a connection between our mental states and the state of the external world, hence while an intelligent robot’s connection to the world is purposeful, ours is merely the contingent outcome of evolution, which means that we have a lesser claim to the title “sentient” under Searle’s rules! (Although, in that case one might argue against the intelligence of the robot on the grounds that the robot cannot “bootstrap” sentience from the non-sentient humans any more than we can from non-sentient evolution… But this only strengthens the case against Searle, since if sentience can arise from non-sentient processes, then it doesn’t matter if neurons/silicon chips/the man in the Chinese room are lacking in sentience.)

    Comment by Carl — February 23, 2007 @ 3:24 am

  4. I meant my post as a brain teaser for Jeff, as it is based on a dozen or so of his wonderful essays. For those who have the time to research the place of strong AI in Western thought and the reasons for its futility, I recommend mathematician Keith Devlin’s 1997 book Goodbye, Descartes

    Comment by YadaYada — February 23, 2007 @ 11:52 am

  5. I have to admit, I do think that strong AI is possible. However, I allow that there may be some good, powerful or even conclusive arguments against it which I simply haven’t read. The Chinese Room, on the other hand, is a complete failure in my mind. The essay which I am shaping up to write with concentrate of motivating the virtual mind reply and the neural-net reply. I think both of these points are completely fatal to Searle’s argument.

    I would also dispute the idea that computers are only capable of logical analysis. This is the confusion between the syntax of understanding/representation/consciousness and the understanding/representation/consciousness of syntax. Just because there is certainly a logic which underlies the computation does not mean that all the computation is about logic. My next post on the subject will discuss this a bit more.

    Comment by Jeff G — February 23, 2007 @ 11:22 pm

  6. A computer no more does logical analysis than does a slide rule, an abacus, or a poster with a multiplication table. In each case, a human sees a physical reality and then from that infers properties of the mathematical world. To say a computer “only does logical analysis” is to neglect the fact what the computer does is completely rooted in the physical world and only seems to reflect the non-physical because of our contrivances. Following the performance of a physical act which gains its significance as computation through human interpretation to say that an AI cannot be sentient because it lacks grounding in the physical world is to ignore the fact of the machine’s physicality.

    Comment by Carl — February 24, 2007 @ 2:34 am


RSS feed for comments on this post.

Leave a comment

Blog at WordPress.com.