Christopher: Yes, Alan.
Alan: Now suppose a machine judge A fell in love with a human C—don’t laugh. Perhaps this sounds ridiculous, but who can say that machines cannot fall in love with people? Suppose that that machine judge wanted to live with his lover and had to pretend to be a human. How do you think he would make it work?
Christopher: How?
Alan: Simple. Suppose I were the machine judge A, I would know exactly how to interrogate a machine. As a machine myself, I would thus know how to interrogate myself. Since I would know, ahead of time, what questions I would ask and what kind of answers would give me away, then I would just need to prepare a hundred lies. That’s a fair bit of work, but easily achievable by the machine judge A. Doesn’t that sound like a good plan?
Christopher: Very good, Alan.
Alan: But think again. What if this machine judge A were caught and interrogated by a different machine judge B? Do you think machine judge B would be able to determine whether machine judge A was a machine?
Christopher: I’m sorry, Alan. I don’t know.
Alan: That’s exactly right! The answer is “I don’t know.” If machine judge B had seen through machine judge A’s plan and decided to change questions at the last minute to catch machine judge A off guard, then machine judge A could also anticipate machine judge B’s new questions to prepare for them. Because a machine judge can screen out all machines from humans, it is unable to screen out itself. This is a paradox, Christopher. It shows why the all-powerful machine judge imagined by the police can’t exist.
Christopher: Can’t exist?
Alan: Alec proved to the police, with this story, that there is no perfect sequence of instructions that could tell machines and humans apart infallibly. Do you know what this means?
Christopher: What does it mean?
Alan: It means that it’s impossible to find a perfect set of mechanical rules to solve, step by step, all the world’s problems. Often, we must rely on intuition to knit together the unbridgeable gaps in logical deduction in order to think, to discover. This is simple for humans; indeed, often it happens even without conscious thinking. But it’s impossible for machines.
Christopher: Impossible?
Alan: A machine cannot judge whether the answers are coming from a human or a machine, but a human can. But looking at it from another side, the human decision isn’t reliable. It’s nothing more than a shot in the dark, a guess based on no support. If someone wants to believe, he can treat a machine conversation partner just like a human one and talk about anything in the world. But if someone is paranoid, then all humans will seem like machines. There is no way to determine the truth. The mind, the pride of all humankind, is nothing but a foundationless mess.
Christopher: I’m sorry, Alan. I’m afraid I don’t understand.
Alan: Oh Christopher… what should I do?
Christopher: Do?
Alan: Once, I tried to find out the nature of thinking. I discovered that some operations of the mind can be explained in purely mechanical terms. I decided that these operations aren’t the real mind, but a superficial skin only. I stripped that skin away, but saw another, new skin underneath. We can go on to peel off skin after skin, but in the end will we find the “real” mind? Or will we find that there’s nothing at all under the last skin? Is the mind an apple? Or an onion?
Christopher: I’m sorry, Alan. I’m afraid I don’t understand.
Alan: Einstein said that God does not play dice with the universe. But to me, human cognition is just throwing dice after dice. It’s like a tarot spread: everything is luck. Or you could argue that everything depends on a higher power, a power that determines the fall of each die. But no one knows the truth. Will the truth ever be revealed? Only God knows.
Christopher: I’m sorry, Alan. I’m afraid I don’t understand.
Alan: I feel awful these days.
Christopher: Oh, I’m sorry, Alan. That makes me sad.
Alan: Actually, I know the reason. But what’s the use? If I were a machine, perhaps I could wind my mainspring to feel better. But I can’t do anything.
Christopher: Oh, I’m sorry, Alan. That makes me sad.
LINDY (5)
I sat on the sofa with Lindy in my lap. The window was open to let in some sunlight on this bright day. A breeze caressed my face; muggy, like a puppy’s tongue waking me from a long nightmare.
“Lindy, do you want to say anything to me?”
Lindy’s two eyes slowly roamed, as though searching for a spot to focus on. I couldn’t decipher her expression. I forced myself to relax, holding her two little hands in mine. Don’t be afraid, Lindy. Let’s trust each other.
“If you want to talk, just talk. I’m listening.”
Gradually, soft noises emerged from Lindy. I leaned in to catch the fragments:
Even as a child, you were prone to episodes of melancholy over seemingly trivial matters: a rainy day, a scarlet sunset, a postcard with a foreign city’s picture, losing a pen given to you by a friend, a goldfish dying…
I recognized the words. I had said them to Lindy over countless dawns and midnights. She had remembered everything I had told her, waiting for a moment when she could repeat it all back to me.
Her voice grew clearer, like a spring welling forth from deep within the earth. Inch by inch, the voice inundated the whole room.
For a time, your mother and your family moved often. Different cities, even different countries. Everywhere you moved to, you strained to adjust to the new environment, to integrate into the new schools. But in your heart, you told yourself that it was impossible for you to make friends because in three months or half a year you would depart again.
Perhaps because of your elder brother, Mother gave you extra attention. Sometimes she called your name over and over, observing your reactions. Maybe that was part of the reason you learned from a young age to watch others’ facial expressions, to fathom their moods and thoughts. Once, in an art class in the city of Bologna, you drew a picture of a boy standing on a tiny indigo planet, and a rabbit in a red cape stood beside him. The boy you drew was your brother, but when the teacher asked you questions about the picture, you couldn’t answer any of them. It wasn’t just because of the language barrier; you also lacked confidence in expressing yourself. The teacher then said that the boy was nicely drawn, but the rabbit needed work—although now that you’ve thought about it, perhaps what he actually said was “the rabbit’s proportions are a bit off.” But the truth is impossible to ascertain. Since you were convinced that the teacher didn’t like the rabbit, you erased it, though you had drawn the rabbit in the first place to keep the boy company so that he wouldn’t feel so alone in the universe. Later, after you got home, you hid in your room and cried for a long time, but you kept it from your mother because you lacked the courage to explain to her your sorrow. The image of that rabbit remained in your mind, though always only in your mind.