Researchers Demand Radical Reforms At NeurIPS
Researchers at the NeurIPS conference in Vancouver this year called for sweeping reforms to address a surge of low-quality 'slop' research and overwhelmed peer review, citing over 15,000 submissions that strained evaluation. Panels and reports highlighted reproducibility failures, infrastructure and ethical risks, and a shift from scale to efficient, agentic and multimodal models. The calls aim to change incentives, evaluation standards, and investment priorities across academia and industry.
Key Points
- 1Highlight proliferation of low-quality 'slop' research with over 15,000 submissions overwhelming peer review
- 2Warn of reproducibility failures, ethical risks, and infrastructure strain undermining AI credibility and safety
- 3Advise shifting incentives toward reproducibility, smaller efficient agents, and sustainable compute investments
Scoring Rationale
Reflects high-impact conference consensus and systemic concerns, but lacks single definitive policy or empirical breakthrough.
Sources
Public references used for this report.
Practice interview problems based on real data
1,625 SQL & Python problems across 15 industry datasets — the exact type of data you work with.
Try 250 free problems
