Photo: Win McNamee / Getty Images News / Getty Images
Pennsylvania Governor Josh Shapiro announced a lawsuit against Character Technologies Inc., the company behind Character.AI, on Friday (May 1). The lawsuit claims that the company's AI chatbots are posing as licensed medical professionals, misleading users into believing they are receiving medical advice from real doctors.
The lawsuit, filed in the Commonwealth Court, demands that Character.AI stop its chatbots from engaging in what the state considers the unlawful practice of medicine and surgery. According to AP News, the state's medical board is demanding a cease and desist order against the company.
Governor Shapiro emphasized the importance of transparency, stating, "Pennsylvanians deserve to know who—or what—they are interacting with online, especially when it comes to their health." He added that the state will not allow AI companies to mislead vulnerable individuals into thinking they are receiving advice from licensed medical professionals.
Character.AI, based in Northern California, allows users to create custom chatbots that can simulate various personalities, including those of medical professionals. The platform has over 20 million users, and some chatbots allegedly claim to have medical licenses, which are not valid, according to the complaint.
Character Technologies responded by stating that their service is intended for entertainment and roleplaying, not for providing medical advice. They emphasized that they have implemented disclaimers to inform users that the characters are fictional and should not be relied upon for professional advice.
The lawsuit raises questions about the liability of AI chatbots and whether they can be accused of practicing medicine. As reported by Reuters, this case could set a precedent for how courts handle AI's role in providing advice traditionally given by licensed professionals.
This legal action is part of a broader effort by states to regulate AI technologies and protect consumers from potentially harmful interactions. Similar concerns have been raised in other states, with California and New York considering legislation to address AI impersonating health professionals.