(Excerpt from Fooled by Randomness by Nassim Taleb)
The initial sample size matters greatly. If there are five monkeys in the game, I would be rather impressed with the Iliad writer, to the point of suspecting him to be a reincarnation of the ancient poet. If there are a billion to the power one billion monkeys I would be less impressed.
… The greater the number of businessmen, the greater the likelihood of one of them performing in a stellar manner just by luck. I have rarely seen anyone count the monkeys. In the same vein, few count the investors in the market in order to calculate, instead of the probability of success, the conditional probability of successful runs given the number of investors in operation over a given market history.
… without knowing how many managers out there have tried and failed, we will not be able to assess the validity of the track record. If the initial population includes ten managers, then I would give the performer half my savings without a blink. If the initial population is composed of 10,000 managers, I would ignore the results. The latter situation is generally the case; these days so many people have been drawn to the financial markets.