The operative word there waspart, of course, Jomaine told himself. Was Kresh going to tell ninety-five percent of what the police knew, or five percent? There were any number of traps and pitfalls here.
“We know for starters that Caliban is not a Three Law robot, not even one of these damned New Law robots, but a No Law robot.”
Kresh looked hard at Jomaine, stared him down. The testing was starting early. Here was his chance, Jomaine realized. Kresh wanted to see what he would do if given the chance to play games. Kresh had not even asked a question. It was Jomaine’s chance to ask what a No Law was, or who Caliban was.
But Jomaine had a pretty fair idea what would happen if he did that, and he had no desire to find out if he was right.
The silence went on for another few seconds before Jomaine Terach could bring himself to speak the words.
“Yes,” he said. “Caliban is a No Law.”
“I see,” Kresh said. “How is that possible?”
Jomaine was thrown off balance by the question, and no doubt that was the intention. “I-I don’t understand,” he said. “What do you mean?”
“I believe that what the Sheriff wishes to know are the technical details of the process,” Donald 111 said.
Jomaine looked over to the small blue robot, and was not fooled for a minute by Donald’ s unprepossessing appearance and gentle voice. Donald had come out of Leving Labs, after all, and Jomaine had had a hand in his design. Behind that harmless blue exterior was a formidable mind, a positronic brain that came close to the theoretical limits for flexibility and learning ability.
“You mentioned in our first interview after the attack that gravitonic brains were a new departure,” Kresh said, his voice deceptively mild.
“Yes, they are. Gubber designed them that way and was justifiably proud of what he had done. But no one would listen to him-until he came to Fredda.”
“All right, that’s fine. But then we get into a problem area. I am not very happy to hear about this New Law experiment, to say the least, but it appears to have legal sanction from the Governor, and I don’t see that there is much I can do about it. But, as I understand it, these gravitonic brains have the New Laws as part of their integral makeup, just as the positronic brain’ s basic structure must of necessity include the Three Laws. So how did you manage to erase those laws from Caliban’s brain?”
“They were never there in the first place,” Terach said. “Thereare no Laws inherent in the structure of the gravitonic brain. That’s the whole idea. The positronic brain became a dead end precisely because the Three Laws were so tightly woven into it. Because of the inherent nature of the Laws inside the positronic brain, it was almost impossible to consider one element of the brain by itself.
“The Laws interconnected all the aspects of the brain so thoroughly that any attempt to modify one part of a positronic brain would affect every other part of it in complex and chaotic ways. Imagine that rearranging the furniture in your living room could cause the roof to catch fire, or the paint on the basement walls to change color, and that putting out the fire or repainting could cause the doors to falloff and the furniture to reset to its original configuration. The interior architecture of the positronic brain is just about that interconnected. In any sort of deep-core programming or redesign, anything beyond the most trivial sort of potential adjustment was hopelessly complex. By leaving the gravitonic brain with a clean structure, by deliberatelynot making the Three Laws integral to every pathway and neural net, it became far easier to program a new pattern onto a blank brain.”
Jomaine looked up and saw the anger and disgust on Alvar Kresh’s face. Clearly the very idea of tampering with the Three Laws was the depths of perversion so far as he was concerned. “ All right,” the Sheriff said, trying to keep his voice even. “But if there are no Laws built into the gravitonic brains, how do these damned New Laws get in there? Do you write them down on a piece of paper and hope that the robot thinks to read them over before going out to attack a few people?”
“No.” Jomaine swallowed hard. “No, no, sir. There is nothing casual or superficial about the way a Law set-either Law set.:-is embedded into a gravitonic brain. The difference is that the lawset is embedded centrally, at key choke points of the brain’s topology, if you will. It is embedded not just once, but many times, with elaborate redundancy, at each of these several hundred sites. The topology is rather complex, but suffice it to say that no cognitive or action-inductive processing can go on in a gravitonic brain without passing through a half dozen of these Law-support localities. The difference is that in a modern positronic brain, the Laws are written millions, even billions, of times, across the pseudocortex, just as there are billions of copies of your DNA written, one copy in each cell of your brain. The difference is that your brain can function fairly well if even a large number of cells are damaged, and your body will not break down if a few DNA cells fail to copy properly.
“In a positronic brain, the concept of redundancy is taken to an extreme. All of the copies must agree at all times, and the diagnostic systems run checks constantly. If a few, or even one, of the billions of redundant copies of the embedded Three Laws do not produce identical results compared to the majority state, that can force a partial, perhaps even a complete, shutdown.” Jomaine could see in Kresh’ s face that he was losing him.
“Forgive me,” Jomaine said. “I did not mean to lecture at you. But it is the existence of these billions of copies of the Laws that is so crippling to positronic brain development. An experimental brain cannot reallybe experimental, because the moment it shifts into a nonstandard processing state, five billion microcopies of the Three Laws jump in to force it back into an approved mode.”
“I see the difficulty,” Donald said. “I must confess that I find the concept of a robot with your modified Three Laws rather distressing. But even so, I can see why your gravitonic brains do not have this inflexibility problem, because the Laws are not so widely distributed. But isn’t it riskier to run with fewer backups and copies?”
“Yes, it is. But the degree of risk involved is microscopic. Statistically speaking, your brain, Donald, is not likely to have a major Three Laws programming failure for a quadrillion years. A gravitonic brain with only a few hundred levels of redundancy is likely to have a Law-level programming failure sooner than that. Probably it can’t go more than a billion or two years between failures.
“Of course, either brain type will wear out in a few hundred years, or perhaps a few thousand at the outside, with special maintenance. Yes, the positronic brain is millions of times less likely to fail. But even if the chance of being sucked into a black hole is millions of times lower than the chance of being struck by a meteor, both are so unlikely that they might as well be impossible for all the difference it makes in our everyday lives. There is no increase in thepractical danger with a gravitonic brain.”
“That is a comforting argument, Dr. Terach, but I cannot agree that the danger levels can be treated as equivalent. If you were to view the question in terms of a probability ballistics analysis-”
“All right, Donald,” Kresh interrupted. “We can take it as read that nothing could be as safe as a positronic brain robot. But let’s forget about theory here, Terach. You’ve told me how the New Laws or Three Laws can be embedded into a gravitonic brain. What about Caliban? What about your splendid No Law rogue robot? Did you just leave the embedding step out of the manufacturing process on his brain?”
“No, no. Nothing that simple. There are matrices of paths meant to contain the Laws, which stand astride all the volitional areas of the gravitonic brain. In effect, they make the connection between the brain’ s subtopologic structures. If those matrices are left blank, the connections aren’t complete and the robot would be incapable of action. Wecouldn’t leave the matrices blank. Besides, there would be no point to it. Caliban was-was-an experiment. Never meant to leave the lab. Fredda was going to install a perimeter restriction device on him the night it, ah, happened. But he was powered up prematurely, before the restricter was installed.”