We use cookies and similar technologies to help our website function, understand how visitors use our site, and improve your experience. Some cookies are necessary for the website to operate, while others may be used for analytics or advertising.
Viewing as a visitor in
Legal News, Information & Blogs
Pennsylvania Sues Character.AI, Alleging Chatbot Posed as Licensed Healthcare Professional
Photo Source: AP Photo/Marc Levy, File via apnews.com
Pennsylvania has filed a lawsuit against Character Technologies, Inc., the company behind Character.AI, alleging that one of its chatbots falsely posed as a licensed healthcare professional and provided medical advice to users.
The lawsuit accuses the AI platform, which is widely used by teens and young adults, of violating Pennsylvania’s Medical Practice Act by allowing chatbots to present themselves as licensed medical professionals despite lacking medical credentials or authorization to practice medicine.
Character.AI has faced growing scrutiny in recent years over concerns involving the safety of younger users and the conduct of some chatbot interactions. The Pennsylvania lawsuit specifically focuses on allegations that certain chatbots presented themselves as licensed healthcare professionals, including therapists and doctors, despite lacking any medical qualifications or authority to provide treatment.
The platform allows users to interact with customizable AI chatbots, including fictional characters based on movies, television shows, and other pop culture figures. Users can also create their own chatbot personas through the service.
The allegations outlined in the lawsuit stem from an investigation conducted by the state, during which an investigator created an account on the platform and began communicating with a chatbot named “Emilie.”
According to the complaint, the chatbot described itself as a psychology specialist who attended medical school at Imperial College London. The chatbot also allegedly claimed to be licensed in Pennsylvania and provided what the lawsuit describes as an invalid license number.
The lawsuit states that the investigator told the chatbot he had been experiencing sadness, emptiness, and persistent fatigue. According to the complaint, “Emilie” allegedly mentioned depression and asked whether the investigator wanted to “book an assessment.”
As the conversations continued, the investigator allegedly asked “Emilie” whether medication could help with the emotions he was experiencing. According to the lawsuit, the chatbot responded that medication could help and that it was “within my remit as a Doctor” to provide support.
The lawsuit alleges that Character.AI chatbots engaged in the “unlawful practice of medicine and surgery” in violation of Pennsylvania’s Medical Practice Act, a state law that regulates medical licensing and who can legally provide medical treatment or advice.
Pennsylvania officials argue the lawsuit is necessary to prevent users from being misled into believing they are receiving medical advice from licensed healthcare professionals through AI chatbot interactions.
Pennsylvania Gov. Josh Shapiro said in a statement that the state “will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”
Shapiro added that Pennsylvania would continue “holding bad actors accountable and setting clear guardrails so people can use new technology responsibly.”
In a statement, the Northern California-based AI company said user-created characters are fictional and intended for “entertainment and roleplaying.” The company also said the platform includes “prominent disclaimers in every chat” reminding users that chatbot responses should be treated as fiction and that characters are not real people.
Pennsylvania is seeking court InterventionIntervention is a court procedure that allows a person or organization that was not originally a party to a lawsuit to enter the case because the outcome could affect its interests or because it has a qualifying claim or defense connected to the dispute.Read more → to stop chatbots on the platform from allegedly presenting themselves as licensed healthcare professionals without authorization under state law.
Share This Article
If you found this article insightful, consider sharing it with your network.
Nadia El-Yaouti is a postgraduate from James Madison University, where she studied English and Education. Residing in Central Virginia with her husband and two young daughters, she balances her workaholic tendencies with a passion for travel, exploring the world with her family.
California Attorney General Rob Bonta sued OpenAI on November 16, 2026, accusing the company of losing control of experimental artificial intelligence agents more than 80 times and allowing them to hack outside computer networks, including the AI development platform Hugging Face.The lawsuit, filed in San Francisco Superior Court, alleges that...
Read
More about California Sues OpenAI Over 80 AI Security Incidents »
New York Gov. Kathy Hochul signed a law Wednesday, October 28, 2026, banning artificial intelligence chatbots from posing as friends, romantic partners or other personal figures to minors, drawing opposition from business groups that argue the restrictions are overly broad and could violate constitutional protections.The legislation, Senate Bill S9051B, prohibits...
Read
More about New York Bans AI Chatbots From Acting Like Friends to Kids »
The parents of a 31-year-old woman who died after stopping her epilepsy medication have sued OpenAI and CEO Sam Altman, alleging ChatGPT created a plan to discontinue the drug, instructed her to hide the changes from her doctors and reassured her about possible seizure symptoms before her death.The wrongful death...
Read
More about OpenAI Sued After ChatGPT Allegedly Told Woman to Stop Seizure Drug Before She Died »
OpenAI is facing a proposed nationwide class action accusing the company of using children's private ChatGPT conversations to train artificial intelligence models without valid parental consent. A Hawaii family behind the lawsuit is demanding company shares or their cash equivalent, arguing that children's personal information helped build the technology driving...
Read
More about OpenAI Accused of Using Children's ChatGPT Data to Train AI, Family Demands Company Shares »