The "Machiavellian intelligence" hypothesis (or the "social brain" hypothesis) posits that large brains and distinctive cognitive abilities of humans have evolved via intense social competition in which social competitors developed increasingly sophisticated "Machiavellian" strategies as a means to achieve higher social and reproductive success. Here we build a mathematical model aiming to explore this hypothesis. In the model, genes control brains which invent and learn strategies (memes) which are used by males to gain advantage in competition for mates. We show that the dynamics of intelligence has three distinct phases. During the dormant phase only newly invented memes are present in the population. During the cognitive explosion phase the population's meme count and the learning ability, cerebral capacity (controlling the number of different memes that the brain can learn and use), and Machiavellian fitness of individuals increase in a runaway fashion. During the saturation phase natural selection resulting from the costs of having large brains checks further increases in cognitive abilities. Overall, our results suggest that the mechanisms underlying the "Machiavellian intelligence" hypothesis can indeed result in the evolution of significant cognitive abilities on the time scale of 10 to 20 thousand generations. We show that cerebral capacity evolves faster and to a larger degree than learning ability. Our model suggests that there may be a tendency toward a reduction in cognitive abilities (driven by the costs of having a large brain) as the reproductive advantage of having a large brain decreases and the exposure to memes increases in modern societies.

Normal human brain volume is heritable. The genes responsible for variation in brain volume are not known. Microcephalin (MCPH1) and ASPM (abnormal spindle-like microcephaly associated) have been proposed as candidate genes since mutations in both genes are associated with microcephaly and common variants of each gene are apparently under strong positive selective pressure. In 120 normal subjects, we genotyped these variants and measured brain volumes using magnetic resonance imaging. We found no evidence that the selected alleles were associated with increases or decreases in brain volume. This result suggests that the selective pressure on these genes may be related to subtle neurobiological effects or to their expression outside the brain.

Most theories of human mental evolution assume that selection favored higher intelligence and larger brains, which should have reduced genetic variance in both. However, adult human intelligence remains highly heritable, and is genetically correlated with brain size. This conflict might be resolved by estimating the coefficient of additive genetic variance (CVA) in human brain size, since CVAs are widely used in evolutionary genetics as indexes of recent selection. Here we calculate for the first time that this CVA is about 7.8, based on data from 19 recent MRI studies of adult human brain size in vivo: 11 studies on brain size means and standard deviations, and 8 studies on brain size heritabilities. This CVA appears lower than that for any other human organ volume or life-history trait, suggesting that the brain has been under strong stabilizing (average-is-better) selection. This result is hard to reconcile with most current theories of human mental evolution, which emphasize directional (more-is-better) selection for higher intelligence and larger brains. Either these theories are all wrong, or CVAs are not as evolutionarily informative as most evolutionary geneticists believe, or, as we suggest, brain size is not a very good index for understanding the evolutionary genetics of human intelligence.