A Methodology to Evaluate the Efficacy and Patient-Centeredness of a Patient-Facing AI Chatbot: Development and Validation of a Standardized-Patient Method

Background: Patient-facing AI intake chatbots can enter clinical use without regulatory review, so their errors may first surface with actual patients. Objective: To develop and pilot a remote, voice-based standardized patient (SP) method for evaluating an intake chatbot's history-taking, documentation, and patient-centeredness. Methods: Four primary care cases had Easy and Difficult variants. In Phase 1, five SPs completed 40 encounters with internal medicine residents rating portrayal fidelity. In Phase 2, SPs completed 80 encounters with a ChatGPT 4o chatbot, recorded whether critical eleme

This content is for informational purposes only and is not medical advice. It is not intended to diagnose, treat, cure, or prevent any disease. Consult a healthcare professional before starting any supplement, treatment, or program — especially if you are pregnant, nursing, taking medication, or managing a health condition.