Overview
Research indicates that larger scientific teams exhibit greater disruptiveness, a conclusion derived from an analysis of approximately 60 million scientific publications. This finding contradicts an influential 2019 study that reported smaller teams as more disruptive. The discrepancy is attributed to a measurement artifact within the standard disruption index, specifically its sensitivity to the length of reference lists. The current work proposes a refined measurement approach that accounts for this issue, demonstrating increased disruptiveness with larger team sizes across various scientific domains and decades.
Research Context
Modern scientific research has shown a clear trend towards increased collaboration and the formation of larger teams. This trend contrasts with a 2019 study which suggested that smaller teams were more disruptive. The prior conclusion was difficult to reconcile with observations of widely recognized disruptive research, including Nobel Prize-winning work, often originating from disproportionately large teams. The present research investigates this apparent contradiction by scrutinizing the methodology used to assess scientific disruption.
Approach
The study analyzed approximately 60 million scientific publications. The investigation focused on understanding the relationship between team size and scientific disruption, specifically re-evaluating the standard disruption index. A key part of the methodology involved examining the mechanical decline of this index as reference lists lengthen. The researchers equalized reference-count distributions across different team sizes to isolate the effect of team size from measurement artifacts.
A new, reference-robust measure of disruption was developed by evaluating each paper against one reference at a time. This measure was then validated against six independently curated benchmarks, including Nobel Prize-awarded research, to assess its ability to distinguish recognized breakthroughs from ordinary papers more sharply and consistently than the standard disruption index.
Findings
- The reported disruptive advantage of small teams, as per the 2019 study, was largely an artifact of measurement.
- Larger teams tend to cite more references.
- The standard disruption index declines mechanically as reference lists lengthen, creating a spurious inverse relationship between team size and disruption.
- Equalizing reference-count distributions across team sizes reverses the negative gradient observed within the standard disruption index's framework.
- The newly developed reference-robust measure, which evaluates each paper against one reference at a time, distinguishes recognized breakthroughs from ordinary papers more sharply and consistently across six independently curated benchmarks, including the Nobel Prize.
- Under this validated measurement, scientific disruption increases with team size.
- This increase in disruption with team size was observed across four scientific domains.
- The trend of increasing disruption with team size was consistent across every decade from the 1970s to the 2010s.
Why This Matters
The findings indicate that for scientific publications, larger teams are more disruptive. This re-evaluation of how scientific disruption is measured provides a revised understanding of team dynamics in modern science. It reconciles empirical observations of large, collaborative teams producing significant breakthroughs with a robust quantitative framework, challenging previous conclusions that may have misattributed disruptive capacity based on measurement limitations.