The human brain filters vast quantities of data, seeking things that appear unusual, and only then does it send out a conscious signaclass="underline" Wow! Look at that! The wider we cast our pattern-seeking net, the more likely it is to catch a clump. For this reason, it's illegitimate to include the data that brought the clump to our attention as part of the evidence that the same clump is unusual. It would be like sorting through a pack of cards until you found the ace of spades, putting it on the table, and then claiming miraculous powers that unerringly accomplish a feat whose probability is one in 52.
Exactly this error was made in early experiments on extra-sensory perception. Thousands of subjects were asked to guess cards from a special pack of five symbols. Anyone whose success rate was above average was invited back, while the others were sent home. After this had gone on for several weeks, the survivors all had an amazing record of success! Then these 'good guessers' were tested some more. Strangely, as time went on, their success rate slowly dropped back towards the average, as if their powers were 'running down'. Actually, that effect wasn't strange at all. It happened because the initial high scores were included in the running total. If they had been omitted, then the scoring rate would have dropped, immediately, to near average.
So it is with the fighter pilots. The curious figures that drew researchers' attention to these particular effects may well have been the result of selective reporting, or selective attention. If so, then we can make a simple prediction: 'From now on, the figures will revert to fifty-fifty.' If this prediction fails, and if the results instead confirm the bias that revealed the clump, then the new data can be considered significant, and a significance level can sensibly be assigned by the usual methods. But the smart money is on a fifty-fifty split.
The alleged decline in the human sperm count may be an example of selective reporting. The story, widely repeated in the press, is that over the past 50 years the human sperm count for 'normal' men has halved. We don't mean selective reporting by the people who published the first evidence, they took pains to avoid all the sources of bias that they could think of. The 'selective reporting' was done by researchers who had contrary evidence but didn't publish it because they thought it must be wrong, by journal referees who accepted papers that confirmed a decline more often than they accepted those that didn't, and by the press, who strung together a whole pile of sex-related defects in various parts of the animal kingdom into a single seamless story, unaware that each individual instance has an entirely reasonable explanation that has nothing to do with falling sperm-counts and often nothing to do with sex.
Sexual abnormalities in fish near sewer outlets, for instance, are probably due to excess nitrites, which all fish-breeders know cause abnormalities of all kinds, and not to oestrogen-like compounds in the water, which would bolster the 'sperm count' story. Current data from fertility clinics, by the way, show no signs of a decline.
Humans add narrativium to their world. They insist in interpreting the universe as if it's telling a story. This leads them to focus on facts that fit the story, while ignoring those that don't. But we mustn't let the coincidence, the clump, choose the sample space -when we do that, we're ignoring the surrounding space of near-coincidences.
Jack and Ian managed to test this theory on a trip to Sweden. On the plane, Jack predicted that a coincidence would happen at Stockholm airport, for reasons of selective reporting. If they looked hard enough, they'd find one. They got to the bus stop outside the terminal, and no coincidences had occurred. But they couldn't find the right bus, so Jack went back to the enquiries desk. As he waited, someone came up next to him, Stefano, a mathematician who normally occupied the office next door to Jack's. Prediction confirmed. But what was really needed was evidence of a near-coincidence, one that hadn't happened, but could have been selectively reported if it had. For instance, if some other acquaintance had shown up at exactly the same time, but on the wrong day, or at the wrong airport, they'd never have noticed. Near coincidences, by definition, are hard to observe ... but not impossible. Ianhappened to mention all of the above to his friend Ted, who was visiting soon after. 'Stockholm?' said Ted: 'When?' Iantold him. 'Which hotel?' Iantold him 'Funny, I was staying there one day later than your Had the trip been one day later, the 'coincidental' encounter with Stefano wouldn't have happened, but the one with Ted would.
What we must not do, then, is to look back at past events and find significance in the inevitable few that look odd. That is the way of the pyramidologists and the tea-leaf readers. Every pattern of raindrops on the pavement is unique. We're not saying that if one such patterns happens to spell your name, this is not to be wondered at, but if your name had been written on the pavement in Beijing during the Ming dynasty, at midnight, nobody would have noticed. We should not look at past history when assessing significance: we should look at all the other things that might have happened instead.
Every event is unique. Until we place that event in a category, we can't work out which background to view it against. Until we choose a background, we can't estimate the event's probability. If we consider the sample space of all possible DNA codes, for instance, then we can calculate the probability of a human being having exactly your DNA code, which is vanishingly small. But it would be silly to conclude that it is impossible for you to exist.
STILL BLOODY LIZARDS
'THE FUTURE IS LIZARD,' said Ridcully. 'Obviously.' It was a few days later. The omniscope was focused on a mound of leaves and rotting vegetation a little way from the banks of the river. There was a large depression hanging over the Senior Wrangler, and the Dean had a black eye. The war between land and sea had just entered a terminal stage.
'Little portable seas,' said Ponder. 'You know, I never thought of them like that.'
'An egg is an egg, however you look at it,' said Ridcully. 'Look, you two, I don't want to see a scuffle like that again, d'you hear?' The Senior Wrangler dabbed at his bleeding nose. 'He goaded be,' he said. 'Id's still osuns, howeber you look at id.' 'A private ocean full of food,' said Ponder, still entranced. 'Hidden in a heap of... well, compost. Which heats up. That's like having private sunshine.'
The little lizard-like creatures that had hatched from the eggs in the mound slithered and slid down the bank into the water, bright-eyed and hopeful. The first few were instantly snapped up by a large male lying in wait among the weeds.
'However, the mothers still have something to learn about postnatal care,' said Ridcully. 'I wonder if they'll have time to learn? And how did they know how to do this? Who's telling them?'
The wizards were depressed again. Most days started that way now. Creatures seemed to turn up in the world randomly, and certainly not according to any pictures in a book. If things were changing into other things, and no one had seen that happen yet, why were the original things still the original things? If the land was so great, why were any fish left in the sea?