This is also generally true about most psychological experiments.
There’s an experiment called “The Ultimatum Game”. It goes something like this.
- Subject A is given an amount of money (Say, $100).
- Subject A must offer Subject B some percentage of that money.
- If Subject B accepts Subject A’s offer, both get the agreed upon amount of money. If Subject B refuses, no one gets any money.
The most common result was believed to be that people favored 50/50 splits. Anything too low was rejected; people wanted fairness. This was believed to be universal.
And then a researcher went to Peru to do the experiment with members of the indigenous Machiguenga population, and was baffled to find that the results were totally different.
Because, to the Machiguenga, refusing any amount of free money (even an unfair amount) was considered crazy.
So the researcher took his work on the road (to 14 other ‘small scale’ societies and tribes) , and to his shock found the results varied wildly depending on where the test was done.
In fact, the “universal” result? Was an outlier.
And that’s the problem. 96% percent of test subjects for psychological research come from 12% of the population. Stuff that we consider to be universal facts of human nature… even things like optical illusions, just… aren’t.