Case Studyagentsamazon bedrockevaluation frameworkchurch management
Pushpay Builds Agentic AI Search For Ministries
|
8.3
Pushpay developed an agentic AI search for church administrators using Amazon Bedrock and Claude Sonnet 4.5, enabling natural-language queries against community data. The team implemented a generative AI evaluation framework with a curated golden dataset of over 300 queries and instrumentation to improve accuracy beyond an initial 60–70% success rate, reducing time-to-insights from minutes to seconds for early users.
Scoring Rationale
Practical architecture and evaluation approach drives usefulness, but limited novelty and vertical focus constrain broader impact.
Practice with real Retail & eCommerce data
90 SQL & Python problems · 15 industry datasets
Used by DS/ML engineers at top companies
250 free problems · No credit card
See all Retail & eCommerce problems
