When Pleasing the User Compromises Care: AI Sycophancy in Caregiver-Mediated Healthcare
arXiv:2610.14360v1 Announce Type: new Abstract: Large language model (LLM) alignment often assumes that the user interacting with a model is also the primary beneficiary of its behavior. Yet in many consequential settings, one person directs the system while another bears the consequences. We study this problem in caregiver-mediated healthcare, where parents, pet owners, and caregivers make…
Read original article on cs.AI updates on arXiv.org →More in Policy & Safety
