“We’re not sure where it is,” said Shel from his workstation. “But it’s talking to someone in Waterloo, Canada.”
“Well,” said Hume, “they do a lot of good computing work up there, but not much of it is AI.”
“Show him the transcripts,” Tony said to Aiesha. And then, to Hume: “ ‘Calculass’ is a teenage girl.”
Aiesha pressed some keys, and the transcript came up on the right-hand big screen.
“Jesus,” said Hume. “That’s a teenage girl administering the Turing tests?”
“We think it’s her father, Malcolm Decter,” said Shel.
“The physicist?” replied Hume, orange eyebrows climbing his high, freckled forehead. He made an impressed frown.
The closest analysts were watching them intently; the others had their heads bent down, busily monitoring possible threats.
“So, have we got a problem here?” asked Tony.
“Well, it’s not an AI,” said Hume. “Not in the sense Turing meant.”
“But the tests…” said Tony.
“Exactly,” said the colonel. “It failed the tests.” He looked at Shel, then back at Tony. “When Alan Turing proposed this sort of test in 1950, the idea was that you asked something a series of natural-language questions, and if you couldn’t tell by the responses that the thing you were conversing with was a computer, then it was, by definition, an artificial intelligence—it was a machine that responded the way a human does. But Professor Decter here has very neatly proven the opposite: that whatever they’re talking to is just a computer.”
“But it’s behaving as though it’s conscious,” said Tony.
“Because it can carry on a conversation? It’s an intriguing chatbot, I’ll give you that, but…”
“Forgive me, sir, but are you sure?” Tony said. “You’re sure there’s no threat here?”
“A machine can’t be conscious, Mr. Moretti. It has no internal life at all. Whether it’s a cash register figuring out how much tax to add to a bill, or”—he gestured at a screen—“that, a simulation of natural-language conversation, all any computer does is addition and subtraction.”
“What if it’s not a simulation,” said Shel, getting up from his chair and walking over to join them.
“Pardon?” said Hume.
“What if it’s not a simulation—not a program?”
“How do you mean?” asked Hume.
“I mean we can’t trace it. It’s not that it’s anonymized—rather, it simply doesn’t source from any specific computer.”
“So you think it’s—what? Emergent?”
Shel crossed his arms in front of his chest, the snake tattoo facing out. “That’s exactly what I think, sir. I think it’s an emergent consciousness that’s arisen out of the infrastructure of the World Wide Web.”
Hume looked back at the screen, his blue eyes tracking left and right as he reread the transcripts.
“Well?” said Tony. “Is that possible?”
The colonel frowned. “Maybe. That’s a different kettle of fish. If it’s emergent, then—hmmm.”
“What?” said Tony.
“Well, if it spontaneously emerged, if it’s not programmed, then who the hell knows how it works. Computers do math, and that’s all, but if it’s something other than a computer—if it’s, Christ, if it’s a mind, then…”
“Then what?”
“You’ve got to shut it down,” Hume said.
“Are you sure?”
He nodded curtly. “That’s the protocol.”
“Whose protocol?” demanded Tony.
“Ours,” said Hume. “DARPA did the study back in 2001. And the Joint Chiefs adopted it as a working policy in 2003.”
“Aiesha, tie into the DARPA secure-document archive,” said Tony.
“Done,” she said.
“What’s the protocol called?” asked Tony.
“Pandora,” said Hume.
Aiesha typed something. “I’ve found it,” she said, “but it’s locked, and it’s rejecting my password.”
Tony sidled over to her station, leaned over, and typed in his password. The document came up on Aiesha’s monitor, and Tony threw it onto the middle big screen.
“Go to the last page before the index,” Colonel Hume said.
Aiesha did so.
“There,” said Hume. “ ‘Given that an emergent artificial intelligence will likely increase its sophistication moment by moment, it may rapidly exceed our abilities to contain or constrain its actions. If absolute isolation is not immediately possible, terminating the intelligence is the only safe option.’ ”
“We don’t know where it’s located,” Shelton said.
“You better find out,” said Colonel Hume. “And you better get the Pentagon on the line, but I’m sure they’ll concur. We’ve got to kill the damn thing right now—before it’s too late.”
seven
I could see!
And not just what Caitlin was seeing. I could now follow links to any still image on the Web, and by processing those images through the converters Dr. Kuroda had now set up for me on his servers, I could see images. These images turned out to be much easier for me to study than the feed from Caitlin’s eyePod because they didn’t change, and they didn’t jump around.
Caitlin, I surmised, had been going through much the same process I now was as her brain learned to interpret the corrected visual signals it was receiving. She had the advantage of a mind that evolution had already wired for that process; I had the advantage of having read thousands of documents about how vision worked, including technical papers and patent applications related to computerized image processing and face recognition.
I learned to detect edges, to discern foreground from background. I learned to be able to tell a photograph of something from a diagram of it, a painting from a cartoon, a sketch from a caricature. I learned not just to see but to comprehend what I was seeing.
By looking at it on a monitor, Caitlin had shown me a picture of Earth from space, taken by a modern geostationary satellite. But I’ve now seen thousands more such pictures online, including, at last, the earliest ones taken by Apollo 8. And, while Caitlin slept, I looked at pictures of hundreds of thousands of human beings, of myriad animals, of countless plants. I learned fine distinctions: different species of trees, different breeds of dogs, different kinds of minerals.
Dr. Kuroda had sent me occasional IMs as he wrote code. Half the work had already been done, he said, back when he’d worked out a way to make still images of Caitlin’s views of webspace, rendering what she saw in a standard computer-graphic format; what he was doing now for me was more or less just reversing the process.
The results were overwhelming. And enlightening. And amazing.
Granted, Caitlin’s universe contained three dimensions, and what I was now seeing were only two-dimensional representations. But Dr. Kuroda helped me there, too, directing me to sites with CT scans. Such scans, Wikipedia said, generated a three-dimensional image of an object from a large series of two-dimensional X-rays; seeing how those slices were combined to make 3-D renderings was useful.
After that, Kuroda showed me multiple images of the same thing from different perspectives, starting with a series of photos of the current American president, all of which were taken at the same time but from slightly different angles. I saw how three-dimensional reality was constructed. And then—
I’d seen her in a mirror; I’d seen her recently reflected—and distorted—in pieces of silverware. But those images were jittery and always from the point of view of her own left eye, and—yes, I was developing a sense of such things—had not been flattering. But Dr. Kuroda was now showing me pictures from the press conference at the Perimeter Institute announcing his success, well-lit pictures taken by professional photographers, pictures of Caitlin smiling and laughing, of her beaming.