Science is often described as the purest expression of individual reason: a mind confronts evidence, revises belief, and knowledge advances. Yet the enterprise that produced quantum mechanics, plate tectonics, and germ theory is not a collection of isolated reasoners. It is a population of millions of researchers embedded in citation networks, funding hierarchies, peer review systems, and reputational economies. The question is not whether scientists are rational. It is how boundedly rational agents, each responding to local incentives, collectively produce something that resembles cumulative progress.

Herbert Simon argued that organisations solve problems no individual could solve because they break complexity into tractable parts and coordinate through rules and signals. Science fits this description closely. Its participants rarely evaluate the totality of evidence. Instead, they follow cues: whose work is cited, which journals carry prestige, which questions attract grants, which methods reviewers will accept. These heuristics are efficient. They are also the channels through which herding, inertia, and strategic behaviour enter the system.

Three mechanisms show how the system actually behaves. The first is the tension between conformity and deviation, which determines how much exploration a field can afford. The second is the priority rule, a convention for allocating credit that shapes the speed, secrecy, and quality of research. The third is the social machinery of paradigm change, where demographic turnover and network structure often matter as much as evidence. Together, they suggest that scientific progress is an emergent property, not a guaranteed one.

Conformity and Innovation: The Exploration Budget of a Field

Every scientific community faces a version of the exploration and exploitation dilemma. Exploitation means working within established frameworks: refining measurements, extending accepted models, and filling gaps that the dominant paradigm marks as important. Exploration means testing unfamiliar combinations of ideas, methods, or assumptions whose payoff is uncertain. A field that only exploits stagnates. A field that only explores never accumulates. The central question is how a decentralised community with no central planner arrives at some mixture of the two.

Large-scale bibliometric evidence suggests that individual incentives tilt heavily toward exploitation. Analysing millions of biomedical abstracts, Jacob Foster, Andrey Rzhetsky, and James Evans found that research linking previously unconnected chemicals was rarer than conservative work. When it succeeded, however, it received disproportionately more citations. The rewards for innovation were real but did not appear large enough to offset the added risk of failure. Scientists facing career timelines and grant cycles therefore underinvest in exploration relative to what would benefit the field as a whole.

What survives this filter is revealing. Brian Uzzi and colleagues studied roughly 18 million papers. They found that the highest-impact work tended to combine a deeply conventional base with a small injection of atypical pairings. Pure novelty performed poorly. Pure convention performed adequately but rarely spectacularly. The pattern suggests that conformity is not merely an obstacle to innovation. It is the scaffolding that makes deviation legible to reviewers, citers, and collaborators, who must recognise a contribution before they can reward it.

Network structure modulates this balance. Models developed by the philosopher Kevin Zollman show that tightly connected communities converge quickly but can lock onto an inferior theory when early results happen to mislead. Sparser communities, where information spreads slowly, preserve diversity long enough for better alternatives to prove themselves. The connectivity that accelerates consensus, through preprint servers, conferences, and constant digital exchange, may therefore reduce a field's capacity to sustain productive dissent.

This reframes scientific heterodoxy as a collective resource rather than an individual virtue. Diversity of approach is maintained through structural features: independent funding sources, smaller institutions with different norms, tenure protections that buffer risk, and disciplinary boundaries that slow homogenisation. When those features erode, the system loses exploratory capacity even if every individual scientist remains honest, careful, and competent. The deficit would not appear in any single career. It would appear only in the aggregate trajectory of the field.

Takeaway

Innovation in science depends less on brave individuals than on structures that make deviation survivable. A field's capacity for discovery is a property of its incentive architecture.

The Priority Rule: How Credit Allocation Shapes Discovery

Science runs on an unusual currency. Researchers are rarely paid per discovery. Instead, they are rewarded with recognition, and recognition flows overwhelmingly to whoever establishes a finding first. Robert Merton documented how persistently this priority rule generated conflict, from Newton and Leibniz over the calculus to Darwin's alarm when Alfred Russel Wallace independently arrived at natural selection. Merton also showed that multiple independent discoveries are the norm rather than the exception, which makes such collisions statistically inevitable. These disputes are not lapses of character. They are predictable outcomes of a winner-take-all reward structure.

The economists Partha Dasgupta and Paul David, and later the philosopher Michael Strevens, argued that the priority rule serves a purpose. A discovery's social value is captured only once, by whoever makes it, so rewarding only the first discoverer aligns individual incentives with collective benefit. Because credit requires publication, the rule encourages rapid disclosure. It also distributes researchers across problems according to expected payoff, much as a market distributes capital. In this view, the rule converts private ambition into public knowledge.

The same mechanism carries systemic costs. Ryan Hill and Carolyn Stein, studying structural biology, found that projects facing greater competitive pressure were completed faster but produced lower-quality protein structures. When being second earns little, researchers rationally trade rigour for speed. The replication difficulties seen in several fields are partly a downstream consequence. Incentives reward the first striking claim far more than the careful confirmation or refutation that follows it.

Credit allocation also compounds over time. Merton's Matthew effect describes how established scientists receive disproportionate recognition for work comparable to that of lesser-known peers, including on co-authored papers and simultaneous discoveries. Cumulative advantage operates through citations, funding, and access to talented students, producing heavily skewed distributions of productivity and influence. Small early differences, sometimes amounting to luck, grow into large and durable inequalities. The resulting concentration means a field's agenda can reflect the preferences of a relatively small core.

Seen systemically, the priority rule is a tuning parameter. Strengthen it, and the system becomes faster, more competitive, and more prone to error. Weaken it, and coordination improves but motivation may diffuse. Recent institutional experiments try to adjust this parameter without abandoning the motivation it provides. Registered reports accept papers before results are known, and scoop-protection policies treat concurrent findings as equally novel.

Takeaway

How a system assigns credit determines what it produces. The priority rule buys speed and disclosure at a price paid in rigour and inequality.

Paradigm Shifts as Social Contagion

Thomas Kuhn's account of scientific revolutions unsettled many readers because it suggested that theory change is not a straightforward response to evidence. Anomalies accumulate for years without dislodging a paradigm. Then, relatively quickly, a community reorganises around new assumptions. From a systems perspective, this pattern is familiar. It resembles threshold-driven cascades in collective behaviour, where adoption remains low until enough of a network has shifted to make switching individually rational.

Max Planck offered a blunter mechanism: a new truth triumphs not by convincing its opponents but because those opponents eventually die. Pierre Azoulay, Christian Fons-Rosen, and Joshua Graff Zivin tested this claim directly. After the premature deaths of eminent life scientists, publications in their subfields by researchers outside the star's collaboration network rose noticeably, and these papers were disproportionately likely to be highly cited. The barrier was not open hostility so much as gatekeeping by an influential, cohesive group that shaped reviews, funding, and perceived legitimacy.

Paradigms therefore persist partly through switching costs. A researcher's laboratory techniques, collaborators, students, and reputation are all invested in the existing framework, and abandoning it devalues that accumulated investment. Younger researchers have fewer sunk costs and more to gain from new territory, so they adopt novel frameworks earlier. This is why demographic turnover drives change. Continental drift, proposed by Alfred Wegener in 1912, was resisted for decades before a new generation, armed with seafloor data, consolidated it into plate tectonics.

Field size matters as well. Johan Chu and James Evans found that as fields grow larger, citations concentrate on papers that are already canonical, and novel ideas struggle to gain traction. Attention is finite. When the volume of publications exceeds what any researcher can read, scientists rely more heavily on established anchors. Growth intended to accelerate progress can therefore entrench existing paradigms, because the cognitive load of a crowded field rewards conformity to familiar reference points.

None of this implies that evidence is irrelevant. Revolutions succeed when new frameworks eventually explain more and predict better. But evidence operates through a social medium with its own dynamics: thresholds, network centrality, generational turnover, and limits on attention. The epistemic and the behavioural are not rivals. Evidence determines which paradigms could win. Social mechanisms determine when, how quickly, and at what cost the transition actually occurs. Understanding those mechanisms allows institutions to shorten the lag between a better idea and its acceptance.

Takeaway

Evidence decides which ideas deserve to win, but network structure and generational turnover decide when they actually do.

Viewed as a complex adaptive system, science is neither the idealised meritocracy of popular imagination nor the arbitrary social construction its critics sometimes describe. It is a population of boundedly rational agents whose local choices, shaped by credit, conformity, and network position, aggregate into a remarkably productive but imperfect process for generating knowledge.

The three mechanisms examined here interact. The priority rule intensifies pressure toward safe, rapid work. That pressure reduces exploratory diversity. Reduced diversity lengthens the time anomalies must accumulate before a paradigm yields. Interventions that target one lever without considering the others will often produce unintended effects elsewhere in the system.

The practical implication is that scientific progress is designable, at least at the margins. Funding portfolios, review practices, credit conventions, and network structures are institutional choices. Each one sets the conditions under which individual researchers make decisions, and thereby shapes the collective trajectory of what humanity comes to know. Science advances at the speed its incentive architecture permits.