Same Data, Different Conclusions: Why Assumptions Matter in Science | The Institute for Creation Research


Same Data, Different Conclusions: Why Assumptions Matter in Science

Two scientists can examine the same data and reach very different conclusions. Is that proof that science is broken or simply evidence that assumptions matter? A recent paper in Science Advances claims that a researcher’s personal views can shape scientific results.1 The authors suggest this reveals a serious weakness in science itself. However, their study does not indicate that science is broken. Instead, it shows that scientific conclusions depend on starting assumptions and method choices, which should not surprise us. All people bring bias into their work, and Christians have recognized this truth for centuries.

In the study, 158 researchers in 71 teams were given the same dataset and asked one question: does immigration affect public support for social welfare programs?1 Each team analyzed the data individually and got varied results. Teams whose members supported immigration often reported positive effects, but teams that opposed immigration often reported negative effects. Based on this pattern, the authors concluded that ideology influenced the production of the findings, reducing confidence in the results.1 But their own conclusion rests on a fragile assumption.

The authors’ key assumption is that systematic alignment between researchers’ ideology and their analytic conclusions demonstrates ideological bias. But this does not necessarily follow. In research, scientists make methodological decisions at every step: which variables to include, how to define key terms, how to treat missing data, and which statistical models best address the research question. These choices are not signs of dishonesty or hidden ideology but are normal features of complex data analysis and are widely acknowledged in research methodology.2 When data are multifaceted, different reasonable decisions can legitimately produce different results. Correlation between ideology and outcomes does not by itself demonstrate that ideological bias caused those differences; it may simply reflect the inherent flexibility within standard scientific practice.

Again, correlation should not be confused with causation. Showing that two things appear together does not prove that one caused the other. The study did not explain how personal beliefs changed specific analysis steps, nor did it evince careless or flawed models. It also did not test whether the differences would remain if the same teams repeated the work. Without tracing these decision paths, claims of ideological influence remain speculative.1 This highlights the broader issue about how assumptions guide interpretation.

And this issue does appear throughout science. For example, DNA stores information using a precise coding system, complete with error-checking and repair mechanisms that protect genetic integrity. Conventional scientists often assume these systems arose through unguided processes. Creation scientists begin with the expectation of purposeful design. Both groups study the same molecular structures but interpret their origin differently. The contrast lies not in the data but in the assumptions brought to the data—just as the Science Advances study unintentionally demonstrates.3

Jeremiah 17:9 explains why this happens: “The heart is deceitful above all things.” All people are subject to God’s diagnosis, including conventional scientists.4 Yet Scripture does not say truth is unreachable. It calls us to humility, honesty, and careful testing. These traits support good science.

By treating normal method differences as ideological bias, the paper goes beyond what its data support. From a creation perspective, the study points to a deeper truth—science works best when assumptions are clearly identified and tested against observable reality. True objectivity does not come from denying one’s worldview but from submitting human reason to the God who designed both the mind and the orderly world it seeks to understand.

References

  1. Borjas, G. J. and Breznau, N. 2026. Ideological Bias in the Production of Research Findings. Science Advances. 12 (1).
  2. Gelman, A. and Hill, J. 2006. Data Analysis Using Regression and Multilevel/Hierarchical Models. Cambridge, UK: Cambridge University Press.
  3. Lohrey, A. and Boreham, B. 2023. The Two Principles That Shape Scientific Research. Communicative & Integrative Biology. 16 (1), article 2203625.
  4. Cupps, V. R. Hijacking the Scientific Method. Creation Science Update. Posted on ICR.org July 31, 2014.

* Dr. Corrado earned a Ph.D. in systems engineering from Colorado State University and a Th.M. from Liberty University. He is a freelance contributor to ICR’s Creation Science Update, works in the nuclear industry, and is a Captain in the U.S. Naval Reserve.

The Latest
NEWS
Fearsome Cleveland Fossil Is Still a Fish
According to evolutionary theory, fish went through a variety of forms until they evolved into the fish we see swimming today. Recently, what conventional...

NEWS
Let the Fossils Speak for Themselves
When conventional scientists call a fossil an early step in animal evolution, the claim may rest more on a reading of the fossil than on the fossil...

CREATION PODCAST
Christian Biologist: My Colleagues Will NOT Be Happy I’m Sharing...
Trey sits down with Dr. Michael Boyle to talk about his time in mainstream science, what ultimately led him to the Institute for Creation Research, and...

NEWS
Drilling Down: Neanderthals Practiced Dentistry
Over 60 years ago, conventional scientists taught that Neanderthals were slouching, subhuman brutes—just another evolutionary link bridging the...

NEWS
T. rex Engineered with Small Arms to Balance Its Large Head
Conventional scientists have been baffled for many years by the small arms of Tyrannosaurus rex. To many, they just seem disproportionately small compared...

NEWS
The Creator Behind American Liberty
Every Fourth of July, Americans celebrate freedom with flags, fireworks, and familiar words, such as this line from the Declaration of Independence,...

NEWS
America's 250th Birthday
The United States of America is officially 250 years old! Most Americans celebrate and thank God for reaching such a milestone. After all, the history...

NEWS
U.S. Supreme Court Ruling Aligns with Genesis Gender Distinctions
On Tuesday, June 30, the Supreme Court ruled to uphold the rights of West Virginia and Idaho to ban transgender women, who are biological males, from...

NEWS
July Wallpaper
"Now the Lord is the Spirit; and where the Spirit of the Lord is, there is liberty. (1 Corinthians 3:17, NKJV) ICR's July...

ACTS & FACTS
Creation Kids: Galaxies
Hi, kids! We created a special Acts & Facts page just for you! Have fun doing the activities while learning about the wonderful world...