Researchers Develop HCAI Quality Evaluation Index

Chinese researchers from Capital Medical University and Bytedance Xiaohe Health publish in J Med Internet Res (2026) a systematic quality evaluation index for health conversational AI, developed via literature review, two-round Delphi with 100% response, and analytic hierarchy process weighting. The framework defines 3 primary, 7 secondary, and 28 tertiary indicators, prioritizing ethics (0.4781), consultation capability (0.4112), and user experience (0.1107), supporting assessment and regulation.
Key Points
- 1Establishes a three-level HCAI evaluation system with 3 primary, 7 secondary, 28 tertiary indicators
- 2Uses AHP weighting; ethics and compliance lead (0.4781), health consultation capability next (0.4112)
- 3Enables standardized HCAI quality assessment to inform model optimization, regulation, and safety oversight
Scoring Rationale
Strong methodological rigor and practical framework, with peer-reviewed credibility; impact limited by focus on healthcare-specific HCAI domain.
Sources
Public references used for this report.
Practice with real Health & Insurance data
90 SQL & Python problems · 15 industry datasets
250 free problems · No credit card
See all Health & Insurance problems
