GPT-5 Outperforms Judges in Rule Application
University of Chicago law professors Eric Posner and Shivam Saran report in a 2025 paper that GPT-5 applied applicable state-law rules correctly in their replication study of federal-judge decisions. The researchers found GPT-5 (and Google Gemini 3 Pro) reached legally correct outcomes in 100 percent of tested car-accident choice-of-law scenarios, compared with judges' 52 percent compliance. The result raises questions about delegating consequential judicial decisions to rule-bound models.
Key Points
- 1Finds GPT-5 applies legal rules correctly in 100 percent of tested cases
- 2Shows AI formalism contrasts judges' 52% compliance, indicating less discretionary interpretation
- 3Raises governance challenge about delegating consequential judicial decisions to rule-bound models
Scoring Rationale
Strong empirical evidence of LLM legal formalism; limited by narrow case scenarios and unresolved normative implications.
Sources
Public references used for this report.
Practice with real Logistics & Shipping data
90 SQL & Python problems · 15 industry datasets
250 free problems · No credit card
See all Logistics & Shipping problems
