https://www.nationalreview.com/magazine/2021/07/01/how-flawed-social-science-leads-us-astray/?utm_source=recirc-desktop&utm_
There are two classes of people in the world, the old saw goes, those who divide humanity into two classes, and those who do not.
The charms of easy categorization and broad generalization have tempted social scientists for centuries. But the trend has picked up speed, especially in psychology, over the last several decades, as Jesse Singal capably demonstrates in The Quick Fix, his engaging and persuasive examination of the growing, unfortunate popularity of faddish theories and their prosperous purveyors.
A heterodox liberal who wrote for various center-left outlets before succumbing to the Substack revolution and starting a popular podcast with fellow nonconformist Katie Herzog, Singal characterizes his book as “an attempt to explain the allure of fad psychology, why that allure is so strong, and how both individuals and institutions can do a better job of resisting it.” The product of rigorous research and thoughtful interviews, The Quick Fix surveys a broad expanse of social-science findings and methodically assesses their flaws.
Singal bemoans the all-too-typical “jump from claims that are empirically defensible but complex and context-dependent to claims that are scientifically questionable but sexy and exciting — and simple.” Instead, he argues in favor of slow, incremental progress in social-science research that, while less flashy than the regnant style of inquiry, would not be as susceptible to debunking.
The Quick Fix takes aim at a wide range of pop-psychological trends, including those originating on the left (such as the self-esteem movement, inaugurated in Northern California) as well as those coming from the right (such as the “superpredator” theory of juvenile crime in the mid 1990s, which conservatives championed and which even Hillary Clinton and Joe Biden came to embrace). These swiftly adopted theories all fell woefully short in practice, however, frequently confusing correlation with causation, falling prey to attribution error (unduly emphasizing personality-based explanations over situational reasons for a given phenomenon), and confounding scholarly and popular work.
Particular forms of statistical manipulation have come to infect many of the studies purporting to document key psychological trends. One such method is “p-hacking”: massaging data so that they fit snugly under a widely accepted statistical threshold designed to help exclude results that could have been the product of pure randomness. “Hidden flexibility” is another: suppressing testing results not congenial to the desired hypothesis and instead publishing only supportive data. “File-drawing” is yet another: ignoring unpublished studies that revealed results contrary to the published ones. Then there is “range restriction”: clustering data samples in a particular segment of distribution, yielding a misleading result.