Machine Learning Reconfigures Science From Inference to Prediction
The arXiv preprint From inference to prediction, revised on July 7, 2026, analyzes 4.9 million publications and 255 ML techniques to show how machine learning has shifted scientific work from inference toward prediction. According to Malena Mendez Isla and coauthors, physical sciences sit near the methodological core, health sciences are a major adoption area, predictive methods concentrate in computer science, and inferential approaches remain spread across applied fields. The paper identifies two waves: 2015-2021 deep-learning adoption and post-2022 use of external commercial models. For practitioners, the risk is not just opacity; it is weaker reproducibility when model data, versions, and audit trails are unavailable.
The useful takeaway is methodological, not just bibliometric: the paper treats model choice as a change in how scientific claims are made, audited, and reproduced.
What happened
According to the arXiv preprint by Malena Mendez Isla, Vincent Lariviere, and Diego Kozlowski, the authors map machine-learning research using 4.9 million publications and 255 ML techniques. The paper reports a core-periphery structure in which physical sciences form the methodological core and health sciences represent a major adoption area. It also reports that predictive techniques are concentrated in computer science, while inferential approaches remain distributed across applied fields.
Technical context
The preprint's central practitioner issue is the trade-off between predictive performance and traceability. A shift from inference-oriented methods to predictive architectures can improve benchmark performance while making causal interpretation, uncertainty explanation, and replication harder. The post-2022 dependence on external commercial models adds another layer because training data, model versions, and internal processes may be inaccessible to downstream researchers.
For practitioners
For AI/DS teams, this argues for stronger experiment records: model versioning, dataset provenance, disclosed prompts or APIs where possible, and evaluation methods that separate predictive fit from explanatory claims. In regulated or clinical settings, the same shift can create review friction when a strong predictor cannot support an interpretable claim.
What to watch
Track whether journals and conferences start requiring clearer disclosure for external model use, model-version pinning, or interpretability checks when predictive systems replace inferential methods. Those rules will shape whether the reported shift becomes a reproducibility problem or a managed methodological transition.
Key Points
- 1The paper maps millions of publications to show prediction-oriented ML concentrating in computer science while inference remains broadly distributed.
- 2Deep learning and external commercial models are presented as separate waves that increase opacity in applied research.
- 3Practitioners should treat model choice, versioning, and data provenance as reproducibility controls, not just implementation details.
Scoring Rationale
This is a useful, large-scale analysis for practitioners thinking about reproducibility, model choice, and the governance of external ML systems. It is notable as science-of-science evidence, but it is not a new technical method or product release.
Sources
Public references used for this report.
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems