Jonathan Mellon
Assistant Professor
Research Interests
Make your next move.
Prepare your application
Review drafts before you send them.
Explore related searches
Articles (10)
Publication practices in the social sciences act as a filter that favors statistically significant results over null findings. While the problem of selection on significance (SoS) is well-known in theory, it has been difficult to measure its scope empirically, and it has been challenging to determine how selection varies across contexts. In this article, we use large language models to extract granular and validated data on about 100,000 articles published in over 150 political science journals from 2010 to 2024. We show that fewer than 2% of articles that rely on statistical methods report null-only findings in their abstracts, while over 90% of papers highlight significant results. To put these findings in perspective, we develop and calibrate a simple model of publication bias. Across a range of plausible assumptions, we find that statistically significant results are estimated to be one to two orders of magnitude more likely to enter the published record than null results. Leveraging metadata extracted from individual articles, we show that the pattern of strong SoS holds across subfields, journals, methods, and time periods. However, a few factors such as pre-registration and randomized experiments correlate with greater acceptance of null results. We conclude by discussing implications for the field and the potential of our new dataset for investigating other questions about political science.
Year:
2026
Brexit accelerated the long-term realignment of how demographic groups vote in Britain. However, Europe is no longer salient to voters, support for the pro-Brexit Conservatives has collapsed, and the 2024 UK General Election was the most volatile on record. So, did the Brexit realignment persist? We address this question by examining the relationship between Brexit preferences and demographic groups with vote choice. We find that the demographic alignments that underpinned Brexit support continue to shape political behaviour through support for party blocs. Thus, while Brexit itself no longer drives party competition directly, the trends that it intensified are still crucial for understanding British politics.
Year:
2025
Instrumental variable (IV) analysis relies on the exclusion restriction—that the instrument only affects the dependent variable via its relationship with the independent variable and not via other causal routes. However, scholars generally justify the exclusion restriction based on its plausibility. I propose a method for searching for additional violations implied by existing social science studies. I show that the use of weather to instrument different independent variables represents strong prima facie evidence of exclusion‐restriction violations for all weather‐IV studies. A review of 289 studies reveals 194 variables previously linked to weather: all representing potential exclusion‐restriction violations. Using sensitivity analysis, I show that the magnitude of many of these violations is sufficient to overturn numerous existing IV results. I conclude with practical steps to systematically review existing literature to identify and quantify possible exclusion‐restriction violations when using IV designs.
Year:
2024
Year:
2021
Year:
2021
Year:
2021
Year:
2020
Year:
2020
Year:
2020
Year:
2020
Collaborators (4)
Christopher Prosser
Associate Professor
Royal Holloway, University of London
Ryan Briggs
University of Guelph
Vincent Arel-Bundock
Professor
Université de Montréal
Jack Bailey
The University of Manchester
Make your next move.
Prepare your application
Review drafts before you send them.